2021-11-15T14:12:42.150 INFO:root:teuthology version: 1.1.0-d4737010 2021-11-15T14:12:42.152 DEBUG:teuthology.run:Teuthology command: teuthology --block --verbose --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --owner scheduled_teuthology@teuthology --name teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba --lock --archive /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751 -- /tmp/teuthology-worker.s663zkit.tmp 2021-11-15T14:12:42.193 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T14:12:42.266 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751 branch: octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6498751' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: gibba name: teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: d4737010a85099043cf081dc05b4069d301b23fb timestamp: 2021-11-12_04:10:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.gibba.12707 2021-11-15T14:12:42.266 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa; will attempt to use it 2021-11-15T14:12:42.267 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks 2021-11-15T14:12:42.267 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-15T14:12:42.269 INFO:teuthology.task.internal:Checking packages... 2021-11-15T14:12:42.291 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b0aaed0fe8cdfe99c82a70b230004934b51091ff' 2021-11-15T14:12:42.291 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-15T14:12:42.292 INFO:teuthology.packaging:ref: None 2021-11-15T14:12:42.292 INFO:teuthology.packaging:tag: None 2021-11-15T14:12:42.293 INFO:teuthology.packaging:branch: octopus 2021-11-15T14:12:42.293 INFO:teuthology.packaging:sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:12:42.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-11-15T14:12:42.595 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:12:42.595 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-15T14:12:42.612 INFO:teuthology.task.internal:no buildpackages task found 2021-11-15T14:12:42.613 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-11-15T14:12:42.650 INFO:teuthology.lock.ops:Locking machines... 2021-11-15T14:12:42.651 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T14:12:42.723 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:12:52.742 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:13:02.765 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:13:12.789 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:13:22.804 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 2)... 2021-11-15T14:13:32.826 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:13:42.847 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:13:52.866 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:02.886 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:12.908 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:22.924 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:32.942 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:42.966 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:14:52.988 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:15:03.015 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:15:13.038 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:15:23.058 INFO:teuthology.lock.ops:waiting for more gibba machines to be free (need 0 + 4, have 0)... 2021-11-15T14:15:33.084 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 4, 'machine_type': 'gibba', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751'} 2021-11-15T14:15:33.125 DEBUG:teuthology.lock.ops:locked ubuntu@gibba035.front.sepia.ceph.com, ubuntu@gibba019.front.sepia.ceph.com, ubuntu@gibba038.front.sepia.ceph.com, ubuntu@gibba032.front.sepia.ceph.com 2021-11-15T14:15:33.287 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3b2d0c3ea0>, signals=[15]) 2021-11-15T14:15:33.292 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba035.front.sepia.ceph.com' reimaging 2021-11-15T14:15:33.295 INFO:teuthology.lock.ops:Updating [ubuntu@gibba035.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T14:15:33.296 INFO:teuthology.lock.ops:Updating gibba035.front.sepia.ceph.com on lock server 2021-11-15T14:15:33.324 INFO:teuthology.lock.ops:Node 'ubuntu@gibba035.front.sepia.ceph.com' reimaging is complete 2021-11-15T14:15:33.325 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba019.front.sepia.ceph.com' reimaging 2021-11-15T14:15:33.325 INFO:teuthology.lock.ops:Updating [ubuntu@gibba019.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T14:15:33.326 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-15T14:15:33.347 INFO:teuthology.lock.ops:Node 'ubuntu@gibba019.front.sepia.ceph.com' reimaging is complete 2021-11-15T14:15:33.347 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging 2021-11-15T14:15:33.348 INFO:teuthology.lock.ops:Updating [ubuntu@gibba038.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T14:15:33.349 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-11-15T14:15:33.374 INFO:teuthology.lock.ops:Node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging is complete 2021-11-15T14:15:33.374 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba032.front.sepia.ceph.com' reimaging 2021-11-15T14:15:33.376 INFO:teuthology.lock.ops:Updating [ubuntu@gibba032.front.sepia.ceph.com]: reset os type and version on server 2021-11-15T14:15:33.376 INFO:teuthology.lock.ops:Updating gibba032.front.sepia.ceph.com on lock server 2021-11-15T14:15:33.402 INFO:teuthology.lock.ops:Node 'ubuntu@gibba032.front.sepia.ceph.com' reimaging is complete 2021-11-15T14:15:33.575 INFO:teuthology.provision.fog.gibba035:Scheduling deploy of ubuntu 20.04 2021-11-15T14:15:33.603 INFO:teuthology.provision.fog.gibba019:Scheduling deploy of ubuntu 20.04 2021-11-15T14:15:33.633 INFO:teuthology.provision.fog.gibba038:Scheduling deploy of ubuntu 20.04 2021-11-15T14:15:33.651 INFO:teuthology.provision.fog.gibba032:Scheduling deploy of ubuntu 20.04 2021-11-15T14:15:33.940 INFO:teuthology.orchestra.console:Power off gibba035 2021-11-15T14:15:33.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T14:15:33.964 INFO:teuthology.orchestra.console:Power off gibba019 2021-11-15T14:15:33.965 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T14:15:33.983 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:34.000 INFO:teuthology.orchestra.console:Power off gibba038 2021-11-15T14:15:34.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T14:15:34.013 INFO:teuthology.orchestra.console:Power off gibba032 2021-11-15T14:15:34.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-11-15T14:15:34.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:34.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:34.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:38.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:38.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:38.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:38.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.360 INFO:teuthology.orchestra.console:Power off for gibba035 completed 2021-11-15T14:15:42.389 INFO:teuthology.orchestra.console:Power off for gibba019 completed 2021-11-15T14:15:42.412 INFO:teuthology.orchestra.console:Power off for gibba038 completed 2021-11-15T14:15:42.419 INFO:teuthology.orchestra.console:Power off for gibba032 completed 2021-11-15T14:15:42.461 INFO:teuthology.orchestra.console:Power on gibba035 2021-11-15T14:15:42.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T14:15:42.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.496 INFO:teuthology.orchestra.console:Power on gibba019 2021-11-15T14:15:42.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T14:15:42.513 INFO:teuthology.orchestra.console:Power on gibba038 2021-11-15T14:15:42.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T14:15:42.521 INFO:teuthology.orchestra.console:Power on gibba032 2021-11-15T14:15:42.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-11-15T14:15:42.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:42.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:46.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:46.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:46.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:46.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:50.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:50.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:50.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:50.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H gibba032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-11-15T14:15:50.851 INFO:teuthology.orchestra.console:Power on for gibba035 completed 2021-11-15T14:15:50.876 INFO:teuthology.orchestra.console:Power on for gibba019 completed 2021-11-15T14:15:50.882 INFO:teuthology.orchestra.console:Power on for gibba038 completed 2021-11-15T14:15:50.889 INFO:teuthology.orchestra.console:Power on for gibba032 completed 2021-11-15T14:15:50.953 INFO:teuthology.provision.fog.gibba035:Waiting for deploy to finish 2021-11-15T14:15:50.978 INFO:teuthology.provision.fog.gibba019:Waiting for deploy to finish 2021-11-15T14:15:50.984 INFO:teuthology.provision.fog.gibba038:Waiting for deploy to finish 2021-11-15T14:15:50.990 INFO:teuthology.provision.fog.gibba032:Waiting for deploy to finish 2021-11-15T14:18:21.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:18:21.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:18:21.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:18:22.020 ERROR:teuthology.orchestra.connection:Error authenticating with gibba035.front.sepia.ceph.com: Authentication failed. 2021-11-15T14:18:22.084 ERROR:teuthology.orchestra.connection:Error authenticating with gibba019.front.sepia.ceph.com: Authentication failed. 2021-11-15T14:18:37.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:19:46.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:19:47.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:19:47.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:20:01.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:10.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:11.202 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T14:21:11.205 DEBUG:teuthology.orchestra.run.gibba038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T14:21:11.710 INFO:teuthology.provision.fog.gibba038:Node is ready 2021-11-15T14:21:11.711 DEBUG:teuthology.orchestra.run.gibba038:> hostname 2021-11-15T14:21:11.757 INFO:teuthology.orchestra.run.gibba038.stdout:gibba038.front.sepia.ceph.com 2021-11-15T14:21:11.758 DEBUG:teuthology.orchestra.run.gibba038:> grep gibba038.front.sepia.ceph.com /etc/hosts 2021-11-15T14:21:11.765 INFO:teuthology.orchestra.run.gibba038.stdout:172.21.2.138 gibba038.front.sepia.ceph.com gibba038 2021-11-15T14:21:11.765 DEBUG:teuthology.orchestra.run.gibba038:> sudo hostname gibba038 2021-11-15T14:21:11.854 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i -e 's/gibba038.front.sepia.ceph.com/gibba038/g' /etc/hosts 2021-11-15T14:21:11.865 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i -e 's/172.21.2.138/172.21.2.138/g' /etc/hosts 2021-11-15T14:21:11.914 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i -e 's/gibba038.front.sepia.ceph.com/gibba038/g' /etc/hostname 2021-11-15T14:21:11.922 DEBUG:teuthology.orchestra.run.gibba038:> sudo hostname gibba038 2021-11-15T14:21:11.928 INFO:teuthology.provision.fog.gibba038:Deploy complete! 2021-11-15T14:21:11.929 DEBUG:teuthology.parallel:result is None 2021-11-15T14:21:11.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:11.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:12.154 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T14:21:12.155 DEBUG:teuthology.orchestra.run.gibba035:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T14:21:12.256 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T14:21:12.257 DEBUG:teuthology.orchestra.run.gibba019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T14:21:12.635 INFO:teuthology.provision.fog.gibba035:Node is ready 2021-11-15T14:21:12.635 DEBUG:teuthology.orchestra.run.gibba035:> hostname 2021-11-15T14:21:12.643 INFO:teuthology.orchestra.run.gibba035.stdout:gibba035.front.sepia.ceph.com 2021-11-15T14:21:12.643 DEBUG:teuthology.orchestra.run.gibba035:> grep gibba035.front.sepia.ceph.com /etc/hosts 2021-11-15T14:21:12.652 INFO:teuthology.orchestra.run.gibba035.stdout:172.21.2.135 gibba035.front.sepia.ceph.com gibba035 2021-11-15T14:21:12.653 DEBUG:teuthology.orchestra.run.gibba035:> sudo hostname gibba035 2021-11-15T14:21:12.718 DEBUG:teuthology.orchestra.run.gibba035:> sudo sed -i -e 's/gibba035.front.sepia.ceph.com/gibba035/g' /etc/hosts 2021-11-15T14:21:12.728 DEBUG:teuthology.orchestra.run.gibba035:> sudo sed -i -e 's/172.21.2.135/172.21.2.135/g' /etc/hosts 2021-11-15T14:21:12.733 DEBUG:teuthology.orchestra.run.gibba035:> sudo sed -i -e 's/gibba035.front.sepia.ceph.com/gibba035/g' /etc/hostname 2021-11-15T14:21:12.740 DEBUG:teuthology.orchestra.run.gibba035:> sudo hostname gibba035 2021-11-15T14:21:12.746 INFO:teuthology.provision.fog.gibba035:Deploy complete! 2021-11-15T14:21:12.746 DEBUG:teuthology.parallel:result is None 2021-11-15T14:21:12.759 INFO:teuthology.provision.fog.gibba019:Node is ready 2021-11-15T14:21:12.760 DEBUG:teuthology.orchestra.run.gibba019:> hostname 2021-11-15T14:21:12.767 INFO:teuthology.orchestra.run.gibba019.stdout:gibba019.front.sepia.ceph.com 2021-11-15T14:21:12.768 DEBUG:teuthology.orchestra.run.gibba019:> grep gibba019.front.sepia.ceph.com /etc/hosts 2021-11-15T14:21:12.824 INFO:teuthology.orchestra.run.gibba019.stdout:172.21.2.119 gibba019.front.sepia.ceph.com gibba019 2021-11-15T14:21:12.824 DEBUG:teuthology.orchestra.run.gibba019:> sudo hostname gibba019 2021-11-15T14:21:12.908 DEBUG:teuthology.orchestra.run.gibba019:> sudo sed -i -e 's/gibba019.front.sepia.ceph.com/gibba019/g' /etc/hosts 2021-11-15T14:21:12.919 DEBUG:teuthology.orchestra.run.gibba019:> sudo sed -i -e 's/172.21.2.119/172.21.2.119/g' /etc/hosts 2021-11-15T14:21:12.924 DEBUG:teuthology.orchestra.run.gibba019:> sudo sed -i -e 's/gibba019.front.sepia.ceph.com/gibba019/g' /etc/hostname 2021-11-15T14:21:12.930 DEBUG:teuthology.orchestra.run.gibba019:> sudo hostname gibba019 2021-11-15T14:21:12.935 INFO:teuthology.provision.fog.gibba019:Deploy complete! 2021-11-15T14:21:12.935 DEBUG:teuthology.parallel:result is None 2021-11-15T14:21:22.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:23.329 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-15T14:21:23.330 DEBUG:teuthology.orchestra.run.gibba032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-11-15T14:21:23.809 INFO:teuthology.provision.fog.gibba032:Node is ready 2021-11-15T14:21:23.810 DEBUG:teuthology.orchestra.run.gibba032:> hostname 2021-11-15T14:21:23.816 INFO:teuthology.orchestra.run.gibba032.stdout:gibba032.front.sepia.ceph.com 2021-11-15T14:21:23.817 DEBUG:teuthology.orchestra.run.gibba032:> grep gibba032.front.sepia.ceph.com /etc/hosts 2021-11-15T14:21:23.825 INFO:teuthology.orchestra.run.gibba032.stdout:172.21.2.132 gibba032.front.sepia.ceph.com gibba032 2021-11-15T14:21:23.825 DEBUG:teuthology.orchestra.run.gibba032:> sudo hostname gibba032 2021-11-15T14:21:23.893 DEBUG:teuthology.orchestra.run.gibba032:> sudo sed -i -e 's/gibba032.front.sepia.ceph.com/gibba032/g' /etc/hosts 2021-11-15T14:21:23.902 DEBUG:teuthology.orchestra.run.gibba032:> sudo sed -i -e 's/172.21.2.132/172.21.2.132/g' /etc/hosts 2021-11-15T14:21:23.909 DEBUG:teuthology.orchestra.run.gibba032:> sudo sed -i -e 's/gibba032.front.sepia.ceph.com/gibba032/g' /etc/hostname 2021-11-15T14:21:23.914 DEBUG:teuthology.orchestra.run.gibba032:> sudo hostname gibba032 2021-11-15T14:21:23.920 INFO:teuthology.provision.fog.gibba032:Deploy complete! 2021-11-15T14:21:23.920 DEBUG:teuthology.parallel:result is None 2021-11-15T14:21:24.134 INFO:teuthology.lock.ops:Checking gibba035.front.sepia.ceph.com 2021-11-15T14:21:24.135 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T14:21:24.156 INFO:teuthology.lock.ops:Checking gibba019.front.sepia.ceph.com 2021-11-15T14:21:24.156 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T14:21:24.174 INFO:teuthology.lock.ops:Checking gibba038.front.sepia.ceph.com 2021-11-15T14:21:24.174 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T14:21:24.192 INFO:teuthology.lock.ops:Checking gibba032.front.sepia.ceph.com 2021-11-15T14:21:24.192 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-15T14:21:24.210 INFO:teuthology.lock.ops:Updating [gibba035.front.sepia.ceph.com]: set os type and version on server 2021-11-15T14:21:24.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba035.front.sepia.ceph.com' 2021-11-15T14:21:24.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:24.266 DEBUG:teuthology.orchestra.run.gibba035:> true 2021-11-15T14:21:24.342 DEBUG:teuthology.orchestra.run.gibba035:> uname -m 2021-11-15T14:21:24.391 INFO:teuthology.orchestra.run.gibba035.stdout:x86_64 2021-11-15T14:21:24.392 DEBUG:teuthology.orchestra.run.gibba035:> cat /etc/os-release 2021-11-15T14:21:24.400 INFO:teuthology.orchestra.run.gibba035.stdout:NAME="Ubuntu" 2021-11-15T14:21:24.400 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:24.400 INFO:teuthology.orchestra.run.gibba035.stdout:ID=ubuntu 2021-11-15T14:21:24.401 INFO:teuthology.orchestra.run.gibba035.stdout:ID_LIKE=debian 2021-11-15T14:21:24.401 INFO:teuthology.orchestra.run.gibba035.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:24.401 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION_ID="20.04" 2021-11-15T14:21:24.401 INFO:teuthology.orchestra.run.gibba035.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:24.402 INFO:teuthology.orchestra.run.gibba035.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:24.402 INFO:teuthology.orchestra.run.gibba035.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:24.402 INFO:teuthology.orchestra.run.gibba035.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:24.402 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:24.402 INFO:teuthology.orchestra.run.gibba035.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:24.404 INFO:teuthology.lock.ops:Updating gibba035.front.sepia.ceph.com on lock server 2021-11-15T14:21:24.423 INFO:teuthology.lock.ops:Updating [gibba019.front.sepia.ceph.com]: set os type and version on server 2021-11-15T14:21:24.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-15T14:21:24.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:24.457 DEBUG:teuthology.orchestra.run.gibba019:> true 2021-11-15T14:21:24.598 DEBUG:teuthology.orchestra.run.gibba019:> uname -m 2021-11-15T14:21:24.602 INFO:teuthology.orchestra.run.gibba019.stdout:x86_64 2021-11-15T14:21:24.602 DEBUG:teuthology.orchestra.run.gibba019:> cat /etc/os-release 2021-11-15T14:21:24.650 INFO:teuthology.orchestra.run.gibba019.stdout:NAME="Ubuntu" 2021-11-15T14:21:24.651 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:24.651 INFO:teuthology.orchestra.run.gibba019.stdout:ID=ubuntu 2021-11-15T14:21:24.651 INFO:teuthology.orchestra.run.gibba019.stdout:ID_LIKE=debian 2021-11-15T14:21:24.652 INFO:teuthology.orchestra.run.gibba019.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:24.652 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_ID="20.04" 2021-11-15T14:21:24.652 INFO:teuthology.orchestra.run.gibba019.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:24.652 INFO:teuthology.orchestra.run.gibba019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:24.653 INFO:teuthology.orchestra.run.gibba019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:24.653 INFO:teuthology.orchestra.run.gibba019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:24.653 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:24.654 INFO:teuthology.orchestra.run.gibba019.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:24.654 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-15T14:21:24.671 INFO:teuthology.lock.ops:Updating [gibba038.front.sepia.ceph.com]: set os type and version on server 2021-11-15T14:21:24.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-15T14:21:24.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:24.703 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-15T14:21:24.782 DEBUG:teuthology.orchestra.run.gibba038:> uname -m 2021-11-15T14:21:24.829 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64 2021-11-15T14:21:24.829 DEBUG:teuthology.orchestra.run.gibba038:> cat /etc/os-release 2021-11-15T14:21:24.836 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu" 2021-11-15T14:21:24.836 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:24.836 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu 2021-11-15T14:21:24.836 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian 2021-11-15T14:21:24.837 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:24.837 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="20.04" 2021-11-15T14:21:24.837 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:24.837 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:24.837 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:24.838 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:24.838 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:24.838 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:24.839 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-11-15T14:21:24.856 INFO:teuthology.lock.ops:Updating [gibba032.front.sepia.ceph.com]: set os type and version on server 2021-11-15T14:21:24.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba032.front.sepia.ceph.com' 2021-11-15T14:21:24.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:24.891 DEBUG:teuthology.orchestra.run.gibba032:> true 2021-11-15T14:21:24.978 DEBUG:teuthology.orchestra.run.gibba032:> uname -m 2021-11-15T14:21:24.982 INFO:teuthology.orchestra.run.gibba032.stdout:x86_64 2021-11-15T14:21:24.982 DEBUG:teuthology.orchestra.run.gibba032:> cat /etc/os-release 2021-11-15T14:21:24.987 INFO:teuthology.orchestra.run.gibba032.stdout:NAME="Ubuntu" 2021-11-15T14:21:24.987 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:24.987 INFO:teuthology.orchestra.run.gibba032.stdout:ID=ubuntu 2021-11-15T14:21:24.987 INFO:teuthology.orchestra.run.gibba032.stdout:ID_LIKE=debian 2021-11-15T14:21:24.988 INFO:teuthology.orchestra.run.gibba032.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:24.988 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_ID="20.04" 2021-11-15T14:21:24.988 INFO:teuthology.orchestra.run.gibba032.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:24.988 INFO:teuthology.orchestra.run.gibba032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:24.989 INFO:teuthology.orchestra.run.gibba032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:24.989 INFO:teuthology.orchestra.run.gibba032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:24.989 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:24.989 INFO:teuthology.orchestra.run.gibba032.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:24.990 INFO:teuthology.lock.ops:Updating gibba032.front.sepia.ceph.com on lock server 2021-11-15T14:21:25.009 INFO:teuthology.lock.ops:4 gibba machines locked this try, 4/4 locked so far 2021-11-15T14:21:25.098 INFO:teuthology.lock.ops:Locked targets: gibba019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9GAfH3aAd5lecXVRByaCaWgGApMHWxlHFV78zSMnj/Jf1ox3vgcx4dkspa6vxQ9pQVvqC0U30Bgy1AktOkN9qCoiLysH4OysYU5UkYHPbEsWmV8FKcHptiam2UDqN4KtH6V3HK4NLJvrNVj0R/1AA3s84zgWNog2oUz1JG9vG6CS+5vr73SYmEwm2ygpfBpzeXrBWup6qYcBR5ZphecskX92/sbpyyHduflw3wp4m9oLblyyagcWH4cCucPS405WgpfKvIODOUd8ioRBmKNvNsAv42zYHs1E7CkSlrg+yugCb0R3aUb48w4tbLVUkD3WvkU8rUihKOnCrv7GBBNuS5LARwsxE6zps94mc4ZBeKB/fUjvLUKpjqiTctqHkogXUtXmt2nHcRDKs/udG/s5vHXfrQ2+9KOlFSk1BI8ISRuJK43b0lN2/IwFBdgJeF2ftdUNwlMf1QviOc/xfR9XDthDr62gH6IAkSznkHJvRsU2pWAhoGHXby+NLfVYiHxU= gibba032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5su0/SP3ZNSDHsIsz7Q+CSzkusG/RcGCFLSx3rwZUiK6Ob6C3WppsEGG9KzwPqPIwpZ6cjUXbm7D/qc2q+GgO0b/vmHQlHjxBz2PzycytYiKcLk1O6kWOZteYbtcryKnyQcKn/LD8nWOFxEFKgczY/Iap3v39M6S2ac9x3SC18IFizXhQ42nhwFLg/FVFRC2rQWFPSFZYnPSl3k6Bp8EyJhuAH5sqQcV88HA0rcv3UifYQ6RKkTIqIBt2JfmigADcVn6qmPIHB/rwpE7ig9aLA4hlDItZ9TR3mSz50K0gAaLXLeHEta7WUB1ap55rsQ5PgZBh2Ctbe/Y96DJ7rp6M9MUNmt+SnNBXi5tF4sMLhIi/XNZm0neldMF3cfOo+npK/qEv+WBPkQ0LzJ7JJfWX/k9cJg1+zKDdFJXiH5OUqUse6bk8FzrPf9Iko8R0AdnL1mM11MECGU+K9V3S9+Ryi78rzAXIH3c7xBPgqVHPFMp7WbubAMZGvzO8HWcmyIM= gibba035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdoQrdhmFWU8Ip3YPNeNsqlVGcDQ2m2e7YNfDKDfsb25hWm5R2l6NHnh3iRBpvu1ufUSXejUSOZe0FzeBcjZaMRZRxkja67D8P5LT1SqUNddzor3sOPyGVx9z5Ikso9OfENHPGkS8d/mr6S2PnUpkuyfqUbF31lTQ8EHoRqIop+ANuIu5lumaMEYVpLzuVIXujSIg3mT14gg/cIUpe1tae/VJnTNAUfdFI316fvtXb+N2fjFtyzVJYoC2miiRKGmMclqqB6lff9OjluM6e+tp3SC2r6b1QDfdl8Y8xRQNLC9Z/M5DfLpr7gsnHf0ZClIa16LE0tQc7Z+vBn8i5rbYFP/RfersIg3pXzT21ath8/mwczES05l/ik0Q2WEnOH9WpO5ibQL37EMouh1h/yxGuinaiC5S4Khv8Eo7l5HiafaNa+sFyja8iYdihQgWOMVe9vYlnoAMakhekMWjhBS7rnUe7nepjtVzWN+FgAqjtUY4GLvGu1ZsznDFqc8EaS0c= gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7m7IpvKkSkTn1LiQ6OWNKReM0vhqPVKkIN/bRrCWCdTjsY0mTk6T/DKv3TrM+NXxNOOGg/LN+uFy286fo6M+pF8eP84kdnq7uYFOYc01B66apkb+HwhvcriNLVRvQkPIpZZF6Y+L3y7UF63u74Wk+bkrGqmT17DRnaD6Vgy8NlRLw7ln/tyQBFNwZUTuEaK6ZqWXhlkxfVFV8mcWLoReyqPXwcxJ8PUsNeBsvlt9MjiuQm9+TZ8Z2ioqmMBLYDyV9ruWU7fJ+BuVN30uAESTFf7CJfkSI+yjAd4rUL4OUEf7Bs16EnRuBmQ5ZEywSTRNPckWt2TkrhV2XWGVy8s0Q0sMqa97P+j22O8+WMMJVKBROzS7ufbK3H7Zog5uyK+idy5cmbCX0js2DsPMfSkMx6TuaTgP2USxaJaeTbQa8sLX0lpBP2FZ+nTu3LJFJoeeXVazNgh8uofvP6QyY1CvbbGkjfCERdxPcqJzzN+7oRg9MjmhBLR/9LYg36s79SeM= 2021-11-15T14:21:25.099 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-15T14:21:25.175 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-15T14:21:25.185 INFO:teuthology.task.internal:Saving configuration 2021-11-15T14:21:25.201 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-15T14:21:25.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-15T14:21:25.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba035.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 14:15:33.094954', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICdDOx7TgjXMuLBcCIkAXEkLJJDbp3uinV2s4NI3I3UT'} 2021-11-15T14:21:25.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 14:15:33.096804', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPiniVAfC+mbZ18LGQq2MixplukYQ9JXubv268pErCkj'} 2021-11-15T14:21:25.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 14:15:33.098145', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILWm/tLzbB36N6sohEaWQVMJ9ENaEAvQmVqG7+vvsKSM'} 2021-11-15T14:21:25.326 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-15 14:15:33.099393', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGOH+SjSOedUcwfD/KICKiRlPA5mKcYd5054xXH78BAp'} 2021-11-15T14:21:25.327 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-15T14:21:25.337 INFO:teuthology.task.internal:roles: ubuntu@gibba035.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-11-15T14:21:25.337 INFO:teuthology.task.internal:roles: ubuntu@gibba019.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-11-15T14:21:25.337 INFO:teuthology.task.internal:roles: ubuntu@gibba038.front.sepia.ceph.com - ['client.0'] 2021-11-15T14:21:25.338 INFO:teuthology.task.internal:roles: ubuntu@gibba032.front.sepia.ceph.com - ['client.1'] 2021-11-15T14:21:25.338 INFO:teuthology.run_tasks:Running task console_log... 2021-11-15T14:21:25.552 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3b2d0f0e18>, signals=[15]) 2021-11-15T14:21:25.553 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-15T14:21:25.560 INFO:teuthology.task.internal:Opening connections... 2021-11-15T14:21:25.560 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:21:25.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:25.598 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:21:25.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:25.632 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba038.front.sepia.ceph.com 2021-11-15T14:21:25.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:25.666 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba032.front.sepia.ceph.com 2021-11-15T14:21:25.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:21:25.702 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-15T14:21:25.710 DEBUG:teuthology.orchestra.run.gibba035:> uname -m 2021-11-15T14:21:25.715 INFO:teuthology.orchestra.run.gibba035.stdout:x86_64 2021-11-15T14:21:25.715 DEBUG:teuthology.orchestra.run.gibba035:> cat /etc/os-release 2021-11-15T14:21:25.765 INFO:teuthology.orchestra.run.gibba035.stdout:NAME="Ubuntu" 2021-11-15T14:21:25.765 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:25.766 INFO:teuthology.orchestra.run.gibba035.stdout:ID=ubuntu 2021-11-15T14:21:25.766 INFO:teuthology.orchestra.run.gibba035.stdout:ID_LIKE=debian 2021-11-15T14:21:25.766 INFO:teuthology.orchestra.run.gibba035.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:25.766 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION_ID="20.04" 2021-11-15T14:21:25.767 INFO:teuthology.orchestra.run.gibba035.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:25.767 INFO:teuthology.orchestra.run.gibba035.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:25.767 INFO:teuthology.orchestra.run.gibba035.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:25.767 INFO:teuthology.orchestra.run.gibba035.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:25.768 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:25.768 INFO:teuthology.orchestra.run.gibba035.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:25.768 INFO:teuthology.lock.ops:Updating gibba035.front.sepia.ceph.com on lock server 2021-11-15T14:21:25.788 DEBUG:teuthology.orchestra.run.gibba019:> uname -m 2021-11-15T14:21:25.797 INFO:teuthology.orchestra.run.gibba019.stdout:x86_64 2021-11-15T14:21:25.797 DEBUG:teuthology.orchestra.run.gibba019:> cat /etc/os-release 2021-11-15T14:21:25.843 INFO:teuthology.orchestra.run.gibba019.stdout:NAME="Ubuntu" 2021-11-15T14:21:25.844 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:25.844 INFO:teuthology.orchestra.run.gibba019.stdout:ID=ubuntu 2021-11-15T14:21:25.844 INFO:teuthology.orchestra.run.gibba019.stdout:ID_LIKE=debian 2021-11-15T14:21:25.844 INFO:teuthology.orchestra.run.gibba019.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:25.845 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_ID="20.04" 2021-11-15T14:21:25.845 INFO:teuthology.orchestra.run.gibba019.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:25.845 INFO:teuthology.orchestra.run.gibba019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:25.845 INFO:teuthology.orchestra.run.gibba019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:25.846 INFO:teuthology.orchestra.run.gibba019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:25.846 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:25.846 INFO:teuthology.orchestra.run.gibba019.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:25.847 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-15T14:21:25.865 DEBUG:teuthology.orchestra.run.gibba038:> uname -m 2021-11-15T14:21:25.873 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64 2021-11-15T14:21:25.874 DEBUG:teuthology.orchestra.run.gibba038:> cat /etc/os-release 2021-11-15T14:21:25.882 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu" 2021-11-15T14:21:25.882 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:25.883 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu 2021-11-15T14:21:25.883 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian 2021-11-15T14:21:25.883 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:25.883 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="20.04" 2021-11-15T14:21:25.884 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:25.884 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:25.884 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:25.884 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:25.885 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:25.885 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:25.885 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-11-15T14:21:25.902 DEBUG:teuthology.orchestra.run.gibba032:> uname -m 2021-11-15T14:21:25.912 INFO:teuthology.orchestra.run.gibba032.stdout:x86_64 2021-11-15T14:21:25.912 DEBUG:teuthology.orchestra.run.gibba032:> cat /etc/os-release 2021-11-15T14:21:25.962 INFO:teuthology.orchestra.run.gibba032.stdout:NAME="Ubuntu" 2021-11-15T14:21:25.962 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-15T14:21:25.962 INFO:teuthology.orchestra.run.gibba032.stdout:ID=ubuntu 2021-11-15T14:21:25.963 INFO:teuthology.orchestra.run.gibba032.stdout:ID_LIKE=debian 2021-11-15T14:21:25.963 INFO:teuthology.orchestra.run.gibba032.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-15T14:21:25.963 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_ID="20.04" 2021-11-15T14:21:25.963 INFO:teuthology.orchestra.run.gibba032.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-15T14:21:25.964 INFO:teuthology.orchestra.run.gibba032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-15T14:21:25.964 INFO:teuthology.orchestra.run.gibba032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-15T14:21:25.964 INFO:teuthology.orchestra.run.gibba032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-15T14:21:25.964 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_CODENAME=focal 2021-11-15T14:21:25.964 INFO:teuthology.orchestra.run.gibba032.stdout:UBUNTU_CODENAME=focal 2021-11-15T14:21:25.965 INFO:teuthology.lock.ops:Updating gibba032.front.sepia.ceph.com on lock server 2021-11-15T14:21:25.983 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-15T14:21:26.022 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-15T14:21:26.030 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-15T14:21:26.031 DEBUG:teuthology.orchestra.run.gibba019:> test '!' -e /home/ubuntu/cephtest 2021-11-15T14:21:26.034 DEBUG:teuthology.orchestra.run.gibba032:> test '!' -e /home/ubuntu/cephtest 2021-11-15T14:21:26.037 DEBUG:teuthology.orchestra.run.gibba035:> test '!' -e /home/ubuntu/cephtest 2021-11-15T14:21:26.041 DEBUG:teuthology.orchestra.run.gibba038:> test '!' -e /home/ubuntu/cephtest 2021-11-15T14:21:26.048 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-15T14:21:26.055 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-15T14:21:26.056 DEBUG:teuthology.orchestra.run.gibba019:> test -z $(ls -A /var/lib/ceph) 2021-11-15T14:21:26.082 DEBUG:teuthology.orchestra.run.gibba032:> test -z $(ls -A /var/lib/ceph) 2021-11-15T14:21:26.087 DEBUG:teuthology.orchestra.run.gibba035:> test -z $(ls -A /var/lib/ceph) 2021-11-15T14:21:26.092 DEBUG:teuthology.orchestra.run.gibba038:> test -z $(ls -A /var/lib/ceph) 2021-11-15T14:21:26.110 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-15T14:21:26.210 INFO:teuthology.run_tasks:Running task kernel... 2021-11-15T14:21:26.227 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-15T14:21:26.227 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-15T14:21:26.228 DEBUG:teuthology.orchestra.run.gibba035:> uname -r 2021-11-15T14:21:26.237 INFO:teuthology.orchestra.run.gibba035.stdout:5.4.0-88-generic 2021-11-15T14:21:26.237 INFO:teuthology.task.kernel:Running kernel on gibba035: 5.4.0-88-generic 2021-11-15T14:21:26.237 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-get clean 2021-11-15T14:21:26.318 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-get update 2021-11-15T14:21:26.565 INFO:teuthology.orchestra.run.gibba035.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T14:21:26.588 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:21:26.650 INFO:teuthology.orchestra.run.gibba035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T14:21:26.989 INFO:teuthology.orchestra.run.gibba035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T14:21:26.991 INFO:teuthology.orchestra.run.gibba035.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T14:21:27.162 INFO:teuthology.orchestra.run.gibba035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-15T14:21:27.194 INFO:teuthology.orchestra.run.gibba035.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T14:21:27.318 INFO:teuthology.orchestra.run.gibba035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T14:21:27.361 INFO:teuthology.orchestra.run.gibba035.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T14:21:27.371 INFO:teuthology.orchestra.run.gibba035.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T14:21:27.373 INFO:teuthology.orchestra.run.gibba035.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T14:21:27.412 INFO:teuthology.orchestra.run.gibba035.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T14:21:27.414 INFO:teuthology.orchestra.run.gibba035.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T14:21:27.418 INFO:teuthology.orchestra.run.gibba035.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:21:27.419 INFO:teuthology.orchestra.run.gibba035.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T14:21:27.450 INFO:teuthology.orchestra.run.gibba035.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T14:21:27.455 INFO:teuthology.orchestra.run.gibba035.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T14:21:27.470 INFO:teuthology.orchestra.run.gibba035.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T14:21:27.470 INFO:teuthology.orchestra.run.gibba035.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T14:21:27.471 INFO:teuthology.orchestra.run.gibba035.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T14:21:27.473 INFO:teuthology.orchestra.run.gibba035.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T14:21:27.475 INFO:teuthology.orchestra.run.gibba035.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T14:21:27.499 INFO:teuthology.orchestra.run.gibba035.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T14:21:27.502 INFO:teuthology.orchestra.run.gibba035.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:21:27.503 INFO:teuthology.orchestra.run.gibba035.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T14:21:27.526 INFO:teuthology.orchestra.run.gibba035.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T14:21:27.527 INFO:teuthology.orchestra.run.gibba035.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T14:21:27.527 INFO:teuthology.orchestra.run.gibba035.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T14:21:27.531 INFO:teuthology.orchestra.run.gibba035.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T14:21:27.547 INFO:teuthology.orchestra.run.gibba035.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T14:21:27.553 INFO:teuthology.orchestra.run.gibba035.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T14:21:27.585 INFO:teuthology.orchestra.run.gibba035.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T14:21:27.586 INFO:teuthology.orchestra.run.gibba035.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T14:21:27.586 INFO:teuthology.orchestra.run.gibba035.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T14:21:27.586 INFO:teuthology.orchestra.run.gibba035.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T14:21:27.586 INFO:teuthology.orchestra.run.gibba035.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T14:21:27.617 INFO:teuthology.orchestra.run.gibba035.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T14:21:27.617 INFO:teuthology.orchestra.run.gibba035.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T14:21:27.699 INFO:teuthology.orchestra.run.gibba035.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T14:21:29.811 INFO:teuthology.orchestra.run.gibba035.stdout:Fetched 8,407 kB in 2s (5,091 kB/s) 2021-11-15T14:21:30.830 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:21:30.840 DEBUG:teuthology.orchestra.run.gibba035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:21:30.881 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:21:30.984 INFO:teuthology.orchestra.run.gibba035.stdout:Building dependency tree... 2021-11-15T14:21:30.984 INFO:teuthology.orchestra.run.gibba035.stdout:Reading state information... 2021-11-15T14:21:31.065 INFO:teuthology.orchestra.run.gibba035.stdout:The following package was automatically installed and is no longer required: 2021-11-15T14:21:31.066 INFO:teuthology.orchestra.run.gibba035.stdout: libllvm11 2021-11-15T14:21:31.066 INFO:teuthology.orchestra.run.gibba035.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T14:21:31.066 INFO:teuthology.orchestra.run.gibba035.stdout:The following additional packages will be installed: 2021-11-15T14:21:31.066 INFO:teuthology.orchestra.run.gibba035.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:21:31.067 INFO:teuthology.orchestra.run.gibba035.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T14:21:31.067 INFO:teuthology.orchestra.run.gibba035.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T14:21:31.068 INFO:teuthology.orchestra.run.gibba035.stdout:Suggested packages: 2021-11-15T14:21:31.068 INFO:teuthology.orchestra.run.gibba035.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T14:21:31.068 INFO:teuthology.orchestra.run.gibba035.stdout:Recommended packages: 2021-11-15T14:21:31.068 INFO:teuthology.orchestra.run.gibba035.stdout: thermald 2021-11-15T14:21:31.090 INFO:teuthology.orchestra.run.gibba035.stdout:The following NEW packages will be installed: 2021-11-15T14:21:31.090 INFO:teuthology.orchestra.run.gibba035.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:21:31.091 INFO:teuthology.orchestra.run.gibba035.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T14:21:31.091 INFO:teuthology.orchestra.run.gibba035.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T14:21:31.092 INFO:teuthology.orchestra.run.gibba035.stdout:The following packages will be upgraded: 2021-11-15T14:21:31.092 INFO:teuthology.orchestra.run.gibba035.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T14:21:31.263 INFO:teuthology.orchestra.run.gibba035.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:21:31.264 INFO:teuthology.orchestra.run.gibba035.stdout:Need to get 75.6 MB of archives. 2021-11-15T14:21:31.264 INFO:teuthology.orchestra.run.gibba035.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T14:21:31.264 INFO:teuthology.orchestra.run.gibba035.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T14:21:32.347 INFO:teuthology.orchestra.run.gibba035.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T14:21:32.603 INFO:teuthology.orchestra.run.gibba035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T14:21:33.871 INFO:teuthology.orchestra.run.gibba035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T14:21:33.872 INFO:teuthology.orchestra.run.gibba035.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T14:21:33.872 INFO:teuthology.orchestra.run.gibba035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T14:21:34.219 INFO:teuthology.orchestra.run.gibba035.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T14:21:34.255 INFO:teuthology.orchestra.run.gibba035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T14:21:34.490 INFO:teuthology.orchestra.run.gibba035.stdout:Fetched 75.6 MB in 3s (23.9 MB/s) 2021-11-15T14:21:34.634 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T14:21:36.578 INFO:teuthology.orchestra.run.gibba035.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T14:21:36.587 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:21:36.641 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:38.030 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T14:21:38.038 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:21:38.118 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:38.934 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T14:21:38.959 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:21:39.034 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:42.022 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:21:42.141 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:21:42.461 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:21:42.585 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:21:42.913 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T14:21:42.940 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T14:21:42.980 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:21:46.808 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T14:21:46.849 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:21:46.891 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:48.643 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:21:49.412 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:21:49.734 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:21:49.857 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:50.616 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:50.726 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T14:21:50.826 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:51.531 INFO:teuthology.orchestra.run.gibba035.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:21:51.531 INFO:teuthology.orchestra.run.gibba035.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T14:21:51.532 INFO:teuthology.orchestra.run.gibba035.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:21:51.532 INFO:teuthology.orchestra.run.gibba035.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T14:21:51.663 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:52.480 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T14:21:52.623 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T14:21:52.749 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:21:52.870 INFO:teuthology.orchestra.run.gibba035.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T14:21:52.870 INFO:teuthology.orchestra.run.gibba035.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:22:13.649 INFO:teuthology.orchestra.run.gibba035.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T14:22:13.650 INFO:teuthology.orchestra.run.gibba035.stdout:Sourcing file `/etc/default/grub' 2021-11-15T14:22:13.672 INFO:teuthology.orchestra.run.gibba035.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:22:13.695 INFO:teuthology.orchestra.run.gibba035.stdout:Generating grub configuration file ... 2021-11-15T14:22:14.038 INFO:teuthology.orchestra.run.gibba035.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:22:14.074 INFO:teuthology.orchestra.run.gibba035.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:22:14.537 INFO:teuthology.orchestra.run.gibba035.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:22:14.551 INFO:teuthology.orchestra.run.gibba035.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:22:14.678 INFO:teuthology.orchestra.run.gibba035.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:22:14.691 INFO:teuthology.orchestra.run.gibba035.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:22:17.323 INFO:teuthology.orchestra.run.gibba035.stdout:done 2021-11-15T14:22:17.582 DEBUG:teuthology.orchestra.run.gibba035:> dpkg -s linux-image-generic 2021-11-15T14:22:17.596 INFO:teuthology.orchestra.run.gibba035.stdout:Package: linux-image-generic 2021-11-15T14:22:17.596 INFO:teuthology.orchestra.run.gibba035.stdout:Status: install ok installed 2021-11-15T14:22:17.597 INFO:teuthology.orchestra.run.gibba035.stdout:Priority: optional 2021-11-15T14:22:17.597 INFO:teuthology.orchestra.run.gibba035.stdout:Section: kernel 2021-11-15T14:22:17.597 INFO:teuthology.orchestra.run.gibba035.stdout:Installed-Size: 18 2021-11-15T14:22:17.597 INFO:teuthology.orchestra.run.gibba035.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:22:17.597 INFO:teuthology.orchestra.run.gibba035.stdout:Architecture: amd64 2021-11-15T14:22:17.598 INFO:teuthology.orchestra.run.gibba035.stdout:Source: linux-meta 2021-11-15T14:22:17.598 INFO:teuthology.orchestra.run.gibba035.stdout:Version: 5.4.0.90.94 2021-11-15T14:22:17.598 INFO:teuthology.orchestra.run.gibba035.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:22:17.598 INFO:teuthology.orchestra.run.gibba035.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:22:17.599 INFO:teuthology.orchestra.run.gibba035.stdout:Recommends: thermald 2021-11-15T14:22:17.599 INFO:teuthology.orchestra.run.gibba035.stdout:Description: Generic Linux kernel image 2021-11-15T14:22:17.599 INFO:teuthology.orchestra.run.gibba035.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:22:17.599 INFO:teuthology.orchestra.run.gibba035.stdout: available. 2021-11-15T14:22:17.599 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T14:22:17.600 DEBUG:teuthology.orchestra.run.gibba019:> uname -r 2021-11-15T14:22:17.609 INFO:teuthology.orchestra.run.gibba019.stdout:5.4.0-88-generic 2021-11-15T14:22:17.609 INFO:teuthology.task.kernel:Running kernel on gibba019: 5.4.0-88-generic 2021-11-15T14:22:17.609 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-get clean 2021-11-15T14:22:17.749 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-get update 2021-11-15T14:22:17.995 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:22:17.998 INFO:teuthology.orchestra.run.gibba019.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T14:22:18.054 INFO:teuthology.orchestra.run.gibba019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T14:22:18.385 INFO:teuthology.orchestra.run.gibba019.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T14:22:18.398 INFO:teuthology.orchestra.run.gibba019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T14:22:18.505 INFO:teuthology.orchestra.run.gibba019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-15T14:22:18.602 INFO:teuthology.orchestra.run.gibba019.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T14:22:18.659 INFO:teuthology.orchestra.run.gibba019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T14:22:18.766 INFO:teuthology.orchestra.run.gibba019.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T14:22:18.777 INFO:teuthology.orchestra.run.gibba019.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T14:22:18.779 INFO:teuthology.orchestra.run.gibba019.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T14:22:18.780 INFO:teuthology.orchestra.run.gibba019.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T14:22:18.792 INFO:teuthology.orchestra.run.gibba019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T14:22:18.810 INFO:teuthology.orchestra.run.gibba019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T14:22:18.811 INFO:teuthology.orchestra.run.gibba019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T14:22:18.812 INFO:teuthology.orchestra.run.gibba019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T14:22:18.824 INFO:teuthology.orchestra.run.gibba019.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T14:22:18.829 INFO:teuthology.orchestra.run.gibba019.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:22:18.829 INFO:teuthology.orchestra.run.gibba019.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T14:22:18.839 INFO:teuthology.orchestra.run.gibba019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T14:22:18.843 INFO:teuthology.orchestra.run.gibba019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:22:18.843 INFO:teuthology.orchestra.run.gibba019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T14:22:18.859 INFO:teuthology.orchestra.run.gibba019.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T14:22:18.867 INFO:teuthology.orchestra.run.gibba019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T14:22:18.879 INFO:teuthology.orchestra.run.gibba019.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T14:22:18.884 INFO:teuthology.orchestra.run.gibba019.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T14:22:18.891 INFO:teuthology.orchestra.run.gibba019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T14:22:18.896 INFO:teuthology.orchestra.run.gibba019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T14:22:18.925 INFO:teuthology.orchestra.run.gibba019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T14:22:18.926 INFO:teuthology.orchestra.run.gibba019.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T14:22:18.926 INFO:teuthology.orchestra.run.gibba019.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T14:22:18.926 INFO:teuthology.orchestra.run.gibba019.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T14:22:18.927 INFO:teuthology.orchestra.run.gibba019.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T14:22:18.933 INFO:teuthology.orchestra.run.gibba019.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T14:22:18.933 INFO:teuthology.orchestra.run.gibba019.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T14:22:18.933 INFO:teuthology.orchestra.run.gibba019.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T14:22:18.960 INFO:teuthology.orchestra.run.gibba019.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T14:22:18.960 INFO:teuthology.orchestra.run.gibba019.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T14:22:19.042 INFO:teuthology.orchestra.run.gibba019.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T14:22:21.274 INFO:teuthology.orchestra.run.gibba019.stdout:Fetched 8,407 kB in 2s (5,304 kB/s) 2021-11-15T14:22:22.251 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:22:22.262 DEBUG:teuthology.orchestra.run.gibba019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:22:22.297 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:22:22.400 INFO:teuthology.orchestra.run.gibba019.stdout:Building dependency tree... 2021-11-15T14:22:22.401 INFO:teuthology.orchestra.run.gibba019.stdout:Reading state information... 2021-11-15T14:22:22.481 INFO:teuthology.orchestra.run.gibba019.stdout:The following package was automatically installed and is no longer required: 2021-11-15T14:22:22.482 INFO:teuthology.orchestra.run.gibba019.stdout: libllvm11 2021-11-15T14:22:22.482 INFO:teuthology.orchestra.run.gibba019.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T14:22:22.482 INFO:teuthology.orchestra.run.gibba019.stdout:The following additional packages will be installed: 2021-11-15T14:22:22.482 INFO:teuthology.orchestra.run.gibba019.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:22:22.483 INFO:teuthology.orchestra.run.gibba019.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T14:22:22.483 INFO:teuthology.orchestra.run.gibba019.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T14:22:22.483 INFO:teuthology.orchestra.run.gibba019.stdout:Suggested packages: 2021-11-15T14:22:22.484 INFO:teuthology.orchestra.run.gibba019.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T14:22:22.484 INFO:teuthology.orchestra.run.gibba019.stdout:Recommended packages: 2021-11-15T14:22:22.484 INFO:teuthology.orchestra.run.gibba019.stdout: thermald 2021-11-15T14:22:22.515 INFO:teuthology.orchestra.run.gibba019.stdout:The following NEW packages will be installed: 2021-11-15T14:22:22.515 INFO:teuthology.orchestra.run.gibba019.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:22:22.515 INFO:teuthology.orchestra.run.gibba019.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T14:22:22.516 INFO:teuthology.orchestra.run.gibba019.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T14:22:22.516 INFO:teuthology.orchestra.run.gibba019.stdout:The following packages will be upgraded: 2021-11-15T14:22:22.516 INFO:teuthology.orchestra.run.gibba019.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T14:22:22.687 INFO:teuthology.orchestra.run.gibba019.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:22:22.688 INFO:teuthology.orchestra.run.gibba019.stdout:Need to get 75.6 MB of archives. 2021-11-15T14:22:22.688 INFO:teuthology.orchestra.run.gibba019.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T14:22:22.688 INFO:teuthology.orchestra.run.gibba019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T14:22:23.804 INFO:teuthology.orchestra.run.gibba019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T14:22:24.063 INFO:teuthology.orchestra.run.gibba019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T14:22:25.297 INFO:teuthology.orchestra.run.gibba019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T14:22:25.297 INFO:teuthology.orchestra.run.gibba019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T14:22:25.297 INFO:teuthology.orchestra.run.gibba019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T14:22:25.649 INFO:teuthology.orchestra.run.gibba019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T14:22:25.682 INFO:teuthology.orchestra.run.gibba019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T14:22:25.908 INFO:teuthology.orchestra.run.gibba019.stdout:Fetched 75.6 MB in 3s (23.9 MB/s) 2021-11-15T14:22:26.055 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T14:22:28.033 INFO:teuthology.orchestra.run.gibba019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T14:22:28.042 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:22:28.095 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:29.518 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T14:22:29.527 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:22:29.635 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:30.455 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T14:22:30.480 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:22:30.521 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:33.512 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:22:33.639 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:22:33.993 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:22:34.117 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:22:34.445 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T14:22:34.453 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T14:22:34.494 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:22:37.912 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T14:22:37.952 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:22:38.003 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:39.524 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:22:39.652 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:22:40.008 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:22:40.140 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:40.908 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:41.059 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T14:22:41.185 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:41.904 INFO:teuthology.orchestra.run.gibba019.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:22:41.905 INFO:teuthology.orchestra.run.gibba019.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T14:22:41.905 INFO:teuthology.orchestra.run.gibba019.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:22:41.905 INFO:teuthology.orchestra.run.gibba019.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T14:22:42.045 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:42.829 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T14:22:42.940 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T14:22:43.066 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:22:43.197 INFO:teuthology.orchestra.run.gibba019.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T14:22:43.197 INFO:teuthology.orchestra.run.gibba019.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:23:04.186 INFO:teuthology.orchestra.run.gibba019.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T14:23:04.187 INFO:teuthology.orchestra.run.gibba019.stdout:Sourcing file `/etc/default/grub' 2021-11-15T14:23:04.198 INFO:teuthology.orchestra.run.gibba019.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:23:04.213 INFO:teuthology.orchestra.run.gibba019.stdout:Generating grub configuration file ... 2021-11-15T14:23:04.575 INFO:teuthology.orchestra.run.gibba019.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:23:04.599 INFO:teuthology.orchestra.run.gibba019.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:23:05.075 INFO:teuthology.orchestra.run.gibba019.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:23:05.089 INFO:teuthology.orchestra.run.gibba019.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:23:05.229 INFO:teuthology.orchestra.run.gibba019.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:23:05.243 INFO:teuthology.orchestra.run.gibba019.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:23:07.918 INFO:teuthology.orchestra.run.gibba019.stdout:done 2021-11-15T14:23:08.247 DEBUG:teuthology.orchestra.run.gibba019:> dpkg -s linux-image-generic 2021-11-15T14:23:08.264 INFO:teuthology.orchestra.run.gibba019.stdout:Package: linux-image-generic 2021-11-15T14:23:08.265 INFO:teuthology.orchestra.run.gibba019.stdout:Status: install ok installed 2021-11-15T14:23:08.265 INFO:teuthology.orchestra.run.gibba019.stdout:Priority: optional 2021-11-15T14:23:08.265 INFO:teuthology.orchestra.run.gibba019.stdout:Section: kernel 2021-11-15T14:23:08.265 INFO:teuthology.orchestra.run.gibba019.stdout:Installed-Size: 18 2021-11-15T14:23:08.265 INFO:teuthology.orchestra.run.gibba019.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:23:08.266 INFO:teuthology.orchestra.run.gibba019.stdout:Architecture: amd64 2021-11-15T14:23:08.266 INFO:teuthology.orchestra.run.gibba019.stdout:Source: linux-meta 2021-11-15T14:23:08.266 INFO:teuthology.orchestra.run.gibba019.stdout:Version: 5.4.0.90.94 2021-11-15T14:23:08.266 INFO:teuthology.orchestra.run.gibba019.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:23:08.267 INFO:teuthology.orchestra.run.gibba019.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:23:08.267 INFO:teuthology.orchestra.run.gibba019.stdout:Recommends: thermald 2021-11-15T14:23:08.267 INFO:teuthology.orchestra.run.gibba019.stdout:Description: Generic Linux kernel image 2021-11-15T14:23:08.267 INFO:teuthology.orchestra.run.gibba019.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:23:08.268 INFO:teuthology.orchestra.run.gibba019.stdout: available. 2021-11-15T14:23:08.268 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T14:23:08.268 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-15T14:23:08.277 INFO:teuthology.orchestra.run.gibba038.stdout:5.4.0-88-generic 2021-11-15T14:23:08.277 INFO:teuthology.task.kernel:Running kernel on gibba038: 5.4.0-88-generic 2021-11-15T14:23:08.278 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-11-15T14:23:08.365 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-15T14:23:08.501 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T14:23:08.590 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:23:08.673 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T14:23:08.726 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T14:23:08.799 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T14:23:08.841 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T14:23:08.842 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T14:23:08.843 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T14:23:08.853 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T14:23:08.854 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T14:23:08.854 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:23:08.855 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T14:23:08.864 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T14:23:08.869 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T14:23:08.870 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T14:23:08.883 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T14:23:08.883 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T14:23:08.883 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T14:23:09.014 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T14:23:09.114 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-15T14:23:09.280 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T14:23:09.411 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T14:23:09.431 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T14:23:09.432 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T14:23:09.458 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T14:23:09.459 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T14:23:09.462 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:23:09.463 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T14:23:09.487 INFO:teuthology.orchestra.run.gibba038.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T14:23:09.509 INFO:teuthology.orchestra.run.gibba038.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T14:23:09.516 INFO:teuthology.orchestra.run.gibba038.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T14:23:09.545 INFO:teuthology.orchestra.run.gibba038.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T14:23:09.545 INFO:teuthology.orchestra.run.gibba038.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T14:23:09.546 INFO:teuthology.orchestra.run.gibba038.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T14:23:09.546 INFO:teuthology.orchestra.run.gibba038.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T14:23:09.546 INFO:teuthology.orchestra.run.gibba038.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T14:23:09.576 INFO:teuthology.orchestra.run.gibba038.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T14:23:09.576 INFO:teuthology.orchestra.run.gibba038.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T14:23:09.658 INFO:teuthology.orchestra.run.gibba038.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T14:23:11.586 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 8,407 kB in 1s (6,255 kB/s) 2021-11-15T14:23:12.535 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:23:12.547 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:23:12.583 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:23:12.684 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-15T14:23:12.685 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-15T14:23:12.766 INFO:teuthology.orchestra.run.gibba038.stdout:The following package was automatically installed and is no longer required: 2021-11-15T14:23:12.767 INFO:teuthology.orchestra.run.gibba038.stdout: libllvm11 2021-11-15T14:23:12.767 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T14:23:12.767 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-11-15T14:23:12.768 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:23:12.768 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T14:23:12.768 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T14:23:12.768 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-15T14:23:12.769 INFO:teuthology.orchestra.run.gibba038.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T14:23:12.769 INFO:teuthology.orchestra.run.gibba038.stdout:Recommended packages: 2021-11-15T14:23:12.769 INFO:teuthology.orchestra.run.gibba038.stdout: thermald 2021-11-15T14:23:12.802 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-15T14:23:12.803 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:23:12.803 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T14:23:12.803 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T14:23:12.803 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-11-15T14:23:12.804 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T14:23:12.975 INFO:teuthology.orchestra.run.gibba038.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:23:12.975 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 75.6 MB of archives. 2021-11-15T14:23:12.975 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T14:23:12.976 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T14:23:14.135 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T14:23:14.388 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T14:23:15.705 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T14:23:15.705 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T14:23:15.706 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T14:23:16.087 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T14:23:16.125 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T14:23:16.352 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 75.6 MB in 3s (22.8 MB/s) 2021-11-15T14:23:16.509 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T14:23:18.440 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T14:23:18.450 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:23:18.499 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:19.848 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T14:23:19.855 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:23:19.914 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:20.792 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T14:23:20.801 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:23:20.833 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:23.765 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:23:23.893 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:23:24.196 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:23:24.321 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:23:24.666 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T14:23:24.692 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T14:23:24.732 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:23:28.112 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T14:23:28.153 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:23:28.195 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:29.706 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:23:29.834 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:23:30.190 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:23:30.313 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:31.106 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:31.232 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T14:23:31.391 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:32.084 INFO:teuthology.orchestra.run.gibba038.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:23:32.084 INFO:teuthology.orchestra.run.gibba038.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T14:23:32.084 INFO:teuthology.orchestra.run.gibba038.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:23:32.084 INFO:teuthology.orchestra.run.gibba038.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T14:23:32.201 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:32.987 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T14:23:33.113 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T14:23:33.273 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:23:33.407 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T14:23:33.407 INFO:teuthology.orchestra.run.gibba038.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:23:54.295 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T14:23:54.295 INFO:teuthology.orchestra.run.gibba038.stdout:Sourcing file `/etc/default/grub' 2021-11-15T14:23:54.301 INFO:teuthology.orchestra.run.gibba038.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:23:54.319 INFO:teuthology.orchestra.run.gibba038.stdout:Generating grub configuration file ... 2021-11-15T14:23:54.656 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:23:54.695 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:23:55.160 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:23:55.174 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:23:55.299 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:23:55.313 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:23:58.166 INFO:teuthology.orchestra.run.gibba038.stdout:done 2021-11-15T14:23:58.440 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-11-15T14:23:58.474 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-11-15T14:23:58.475 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-11-15T14:23:58.475 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-11-15T14:23:58.475 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-11-15T14:23:58.476 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 18 2021-11-15T14:23:58.476 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:23:58.476 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-11-15T14:23:58.476 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-11-15T14:23:58.476 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 5.4.0.90.94 2021-11-15T14:23:58.477 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:23:58.477 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:23:58.477 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-11-15T14:23:58.477 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-11-15T14:23:58.478 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:23:58.478 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-11-15T14:23:58.478 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T14:23:58.479 DEBUG:teuthology.orchestra.run.gibba032:> uname -r 2021-11-15T14:23:58.487 INFO:teuthology.orchestra.run.gibba032.stdout:5.4.0-88-generic 2021-11-15T14:23:58.488 INFO:teuthology.task.kernel:Running kernel on gibba032: 5.4.0-88-generic 2021-11-15T14:23:58.488 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-get clean 2021-11-15T14:23:58.564 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-get update 2021-11-15T14:23:58.685 INFO:teuthology.orchestra.run.gibba032.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-15T14:23:58.804 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:23:58.887 INFO:teuthology.orchestra.run.gibba032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-15T14:23:58.937 INFO:teuthology.orchestra.run.gibba032.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-15T14:23:58.991 INFO:teuthology.orchestra.run.gibba032.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-15T14:23:59.025 INFO:teuthology.orchestra.run.gibba032.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-15T14:23:59.027 INFO:teuthology.orchestra.run.gibba032.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-15T14:23:59.027 INFO:teuthology.orchestra.run.gibba032.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-15T14:23:59.035 INFO:teuthology.orchestra.run.gibba032.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-15T14:23:59.035 INFO:teuthology.orchestra.run.gibba032.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-15T14:23:59.036 INFO:teuthology.orchestra.run.gibba032.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:23:59.036 INFO:teuthology.orchestra.run.gibba032.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-15T14:23:59.043 INFO:teuthology.orchestra.run.gibba032.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-15T14:23:59.048 INFO:teuthology.orchestra.run.gibba032.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-15T14:23:59.049 INFO:teuthology.orchestra.run.gibba032.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-15T14:23:59.059 INFO:teuthology.orchestra.run.gibba032.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-15T14:23:59.059 INFO:teuthology.orchestra.run.gibba032.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-15T14:23:59.060 INFO:teuthology.orchestra.run.gibba032.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-15T14:23:59.224 INFO:teuthology.orchestra.run.gibba032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-15T14:23:59.315 INFO:teuthology.orchestra.run.gibba032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-15T14:23:59.572 INFO:teuthology.orchestra.run.gibba032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-15T14:23:59.604 INFO:teuthology.orchestra.run.gibba032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-15T14:23:59.622 INFO:teuthology.orchestra.run.gibba032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-15T14:23:59.622 INFO:teuthology.orchestra.run.gibba032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-15T14:23:59.623 INFO:teuthology.orchestra.run.gibba032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-15T14:23:59.651 INFO:teuthology.orchestra.run.gibba032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-15T14:23:59.655 INFO:teuthology.orchestra.run.gibba032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-15T14:23:59.655 INFO:teuthology.orchestra.run.gibba032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-15T14:23:59.682 INFO:teuthology.orchestra.run.gibba032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-15T14:23:59.700 INFO:teuthology.orchestra.run.gibba032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-15T14:23:59.737 INFO:teuthology.orchestra.run.gibba032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-15T14:23:59.737 INFO:teuthology.orchestra.run.gibba032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-15T14:23:59.738 INFO:teuthology.orchestra.run.gibba032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-15T14:23:59.738 INFO:teuthology.orchestra.run.gibba032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-15T14:23:59.739 INFO:teuthology.orchestra.run.gibba032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-15T14:23:59.739 INFO:teuthology.orchestra.run.gibba032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,540 B] 2021-11-15T14:23:59.739 INFO:teuthology.orchestra.run.gibba032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,592 B] 2021-11-15T14:23:59.819 INFO:teuthology.orchestra.run.gibba032.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-15T14:23:59.820 INFO:teuthology.orchestra.run.gibba032.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-15T14:24:01.800 INFO:teuthology.orchestra.run.gibba032.stdout:Fetched 8,407 kB in 1s (6,082 kB/s) 2021-11-15T14:24:02.779 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:24:02.790 DEBUG:teuthology.orchestra.run.gibba032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:24:02.825 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:24:02.928 INFO:teuthology.orchestra.run.gibba032.stdout:Building dependency tree... 2021-11-15T14:24:02.928 INFO:teuthology.orchestra.run.gibba032.stdout:Reading state information... 2021-11-15T14:24:03.010 INFO:teuthology.orchestra.run.gibba032.stdout:The following package was automatically installed and is no longer required: 2021-11-15T14:24:03.010 INFO:teuthology.orchestra.run.gibba032.stdout: libllvm11 2021-11-15T14:24:03.011 INFO:teuthology.orchestra.run.gibba032.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-15T14:24:03.011 INFO:teuthology.orchestra.run.gibba032.stdout:The following additional packages will be installed: 2021-11-15T14:24:03.012 INFO:teuthology.orchestra.run.gibba032.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:24:03.012 INFO:teuthology.orchestra.run.gibba032.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-15T14:24:03.012 INFO:teuthology.orchestra.run.gibba032.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-15T14:24:03.012 INFO:teuthology.orchestra.run.gibba032.stdout:Suggested packages: 2021-11-15T14:24:03.012 INFO:teuthology.orchestra.run.gibba032.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-15T14:24:03.013 INFO:teuthology.orchestra.run.gibba032.stdout:Recommended packages: 2021-11-15T14:24:03.013 INFO:teuthology.orchestra.run.gibba032.stdout: thermald 2021-11-15T14:24:03.027 INFO:teuthology.orchestra.run.gibba032.stdout:The following NEW packages will be installed: 2021-11-15T14:24:03.027 INFO:teuthology.orchestra.run.gibba032.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-15T14:24:03.027 INFO:teuthology.orchestra.run.gibba032.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-15T14:24:03.027 INFO:teuthology.orchestra.run.gibba032.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-15T14:24:03.028 INFO:teuthology.orchestra.run.gibba032.stdout:The following packages will be upgraded: 2021-11-15T14:24:03.028 INFO:teuthology.orchestra.run.gibba032.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-15T14:24:03.213 INFO:teuthology.orchestra.run.gibba032.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:24:03.214 INFO:teuthology.orchestra.run.gibba032.stdout:Need to get 75.6 MB of archives. 2021-11-15T14:24:03.214 INFO:teuthology.orchestra.run.gibba032.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-15T14:24:03.214 INFO:teuthology.orchestra.run.gibba032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-15T14:24:04.435 INFO:teuthology.orchestra.run.gibba032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-15T14:24:04.640 INFO:teuthology.orchestra.run.gibba032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-15T14:24:05.878 INFO:teuthology.orchestra.run.gibba032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-15T14:24:05.879 INFO:teuthology.orchestra.run.gibba032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-15T14:24:05.879 INFO:teuthology.orchestra.run.gibba032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-15T14:24:06.167 INFO:teuthology.orchestra.run.gibba032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-15T14:24:06.207 INFO:teuthology.orchestra.run.gibba032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-15T14:24:06.440 INFO:teuthology.orchestra.run.gibba032.stdout:Fetched 75.6 MB in 3s (23.8 MB/s) 2021-11-15T14:24:06.596 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-15T14:24:08.490 INFO:teuthology.orchestra.run.gibba032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-15T14:24:08.499 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:24:08.579 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:10.061 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-15T14:24:10.069 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:24:10.183 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:11.006 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-15T14:24:11.032 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:24:11.073 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:13.998 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:24:14.142 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:24:14.456 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:24:14.579 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:24:14.924 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-15T14:24:14.933 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-15T14:24:14.973 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:24:18.283 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-15T14:24:18.323 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-15T14:24:18.366 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:19.991 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-15T14:24:20.120 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-15T14:24:20.459 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-15T14:24:20.566 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:21.317 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:21.435 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-15T14:24:21.561 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:22.270 INFO:teuthology.orchestra.run.gibba032.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:24:22.271 INFO:teuthology.orchestra.run.gibba032.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-15T14:24:22.271 INFO:teuthology.orchestra.run.gibba032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:24:22.271 INFO:teuthology.orchestra.run.gibba032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-15T14:24:22.396 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:23.189 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-15T14:24:23.290 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-15T14:24:23.392 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-15T14:24:23.531 INFO:teuthology.orchestra.run.gibba032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-15T14:24:23.531 INFO:teuthology.orchestra.run.gibba032.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:24:44.262 INFO:teuthology.orchestra.run.gibba032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-15T14:24:44.262 INFO:teuthology.orchestra.run.gibba032.stdout:Sourcing file `/etc/default/grub' 2021-11-15T14:24:44.277 INFO:teuthology.orchestra.run.gibba032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:24:44.301 INFO:teuthology.orchestra.run.gibba032.stdout:Generating grub configuration file ... 2021-11-15T14:24:44.722 INFO:teuthology.orchestra.run.gibba032.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:24:44.752 INFO:teuthology.orchestra.run.gibba032.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:24:45.200 INFO:teuthology.orchestra.run.gibba032.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:24:45.214 INFO:teuthology.orchestra.run.gibba032.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:24:45.341 INFO:teuthology.orchestra.run.gibba032.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:24:45.355 INFO:teuthology.orchestra.run.gibba032.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:24:48.239 INFO:teuthology.orchestra.run.gibba032.stdout:done 2021-11-15T14:24:48.586 DEBUG:teuthology.orchestra.run.gibba032:> dpkg -s linux-image-generic 2021-11-15T14:24:48.609 INFO:teuthology.orchestra.run.gibba032.stdout:Package: linux-image-generic 2021-11-15T14:24:48.609 INFO:teuthology.orchestra.run.gibba032.stdout:Status: install ok installed 2021-11-15T14:24:48.610 INFO:teuthology.orchestra.run.gibba032.stdout:Priority: optional 2021-11-15T14:24:48.610 INFO:teuthology.orchestra.run.gibba032.stdout:Section: kernel 2021-11-15T14:24:48.610 INFO:teuthology.orchestra.run.gibba032.stdout:Installed-Size: 18 2021-11-15T14:24:48.610 INFO:teuthology.orchestra.run.gibba032.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:24:48.611 INFO:teuthology.orchestra.run.gibba032.stdout:Architecture: amd64 2021-11-15T14:24:48.611 INFO:teuthology.orchestra.run.gibba032.stdout:Source: linux-meta 2021-11-15T14:24:48.611 INFO:teuthology.orchestra.run.gibba032.stdout:Version: 5.4.0.90.94 2021-11-15T14:24:48.611 INFO:teuthology.orchestra.run.gibba032.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:24:48.612 INFO:teuthology.orchestra.run.gibba032.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:24:48.612 INFO:teuthology.orchestra.run.gibba032.stdout:Recommends: thermald 2021-11-15T14:24:48.612 INFO:teuthology.orchestra.run.gibba032.stdout:Description: Generic Linux kernel image 2021-11-15T14:24:48.612 INFO:teuthology.orchestra.run.gibba032.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:24:48.612 INFO:teuthology.orchestra.run.gibba032.stdout: available. 2021-11-15T14:24:48.613 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-15T14:24:48.613 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-15T14:24:48.613 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T14:24:48.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T14:24:48.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T14:24:48.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-15T14:24:48.615 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-11-15T14:24:48.615 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba035.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T14:24:48.615 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-get clean 2021-11-15T14:24:48.708 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-get update 2021-11-15T14:24:48.792 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:24:48.912 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:24:48.995 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:24:49.078 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:24:49.793 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:24:49.805 DEBUG:teuthology.orchestra.run.gibba035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:24:49.841 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:24:49.941 INFO:teuthology.orchestra.run.gibba035.stdout:Building dependency tree... 2021-11-15T14:24:49.942 INFO:teuthology.orchestra.run.gibba035.stdout:Reading state information... 2021-11-15T14:24:50.019 INFO:teuthology.orchestra.run.gibba035.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T14:24:50.019 INFO:teuthology.orchestra.run.gibba035.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:24:50.020 INFO:teuthology.orchestra.run.gibba035.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:24:50.020 INFO:teuthology.orchestra.run.gibba035.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:24:50.020 INFO:teuthology.orchestra.run.gibba035.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:24:50.020 INFO:teuthology.orchestra.run.gibba035.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:24:50.034 INFO:teuthology.orchestra.run.gibba035.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:24:50.035 DEBUG:teuthology.orchestra.run.gibba035:> dpkg -s linux-image-generic 2021-11-15T14:24:50.089 INFO:teuthology.orchestra.run.gibba035.stdout:Package: linux-image-generic 2021-11-15T14:24:50.090 INFO:teuthology.orchestra.run.gibba035.stdout:Status: install ok installed 2021-11-15T14:24:50.090 INFO:teuthology.orchestra.run.gibba035.stdout:Priority: optional 2021-11-15T14:24:50.090 INFO:teuthology.orchestra.run.gibba035.stdout:Section: kernel 2021-11-15T14:24:50.090 INFO:teuthology.orchestra.run.gibba035.stdout:Installed-Size: 18 2021-11-15T14:24:50.090 INFO:teuthology.orchestra.run.gibba035.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:24:50.091 INFO:teuthology.orchestra.run.gibba035.stdout:Architecture: amd64 2021-11-15T14:24:50.091 INFO:teuthology.orchestra.run.gibba035.stdout:Source: linux-meta 2021-11-15T14:24:50.091 INFO:teuthology.orchestra.run.gibba035.stdout:Version: 5.4.0.90.94 2021-11-15T14:24:50.091 INFO:teuthology.orchestra.run.gibba035.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:24:50.092 INFO:teuthology.orchestra.run.gibba035.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:24:50.092 INFO:teuthology.orchestra.run.gibba035.stdout:Recommends: thermald 2021-11-15T14:24:50.092 INFO:teuthology.orchestra.run.gibba035.stdout:Description: Generic Linux kernel image 2021-11-15T14:24:50.092 INFO:teuthology.orchestra.run.gibba035.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:24:50.092 INFO:teuthology.orchestra.run.gibba035.stdout: available. 2021-11-15T14:24:50.093 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:24:50.097 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.CCZi95RSXp 2021-11-15T14:24:50.098 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CCZi95RSXp 2021-11-15T14:24:50.105 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.CCZi95RSXp 2021-11-15T14:24:50.180 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.CCZi95RSXp is 10KB 2021-11-15T14:24:50.235 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.CCZi95RSXp 2021-11-15T14:24:50.243 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T14:24:50.264 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:24:50.264 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T14:24:50.265 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T14:24:50.356 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T14:24:50.357 DEBUG:teuthology.orchestra.run.gibba035:> sudo update-grub 2021-11-15T14:24:51.550 INFO:teuthology.orchestra.run.gibba035.stderr:Sourcing file `/etc/default/grub' 2021-11-15T14:24:51.565 INFO:teuthology.orchestra.run.gibba035.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:24:51.597 INFO:teuthology.orchestra.run.gibba035.stderr:Generating grub configuration file ... 2021-11-15T14:24:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:24:51.915 INFO:teuthology.orchestra.run.gibba035.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:24:52.362 INFO:teuthology.orchestra.run.gibba035.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:24:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:24:52.501 INFO:teuthology.orchestra.run.gibba035.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:24:52.517 INFO:teuthology.orchestra.run.gibba035.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:24:54.201 INFO:teuthology.orchestra.run.gibba035.stderr:done 2021-11-15T14:24:54.203 DEBUG:teuthology.orchestra.run.gibba035:> sudo shutdown -r now 2021-11-15T14:24:54.206 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-11-15T14:24:54.206 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba019.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T14:24:54.207 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-get clean 2021-11-15T14:24:54.301 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-get update 2021-11-15T14:24:54.516 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:24:54.517 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:24:54.602 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:24:54.674 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:24:55.538 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:24:55.550 DEBUG:teuthology.orchestra.run.gibba019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:24:55.586 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:24:55.690 INFO:teuthology.orchestra.run.gibba019.stdout:Building dependency tree... 2021-11-15T14:24:55.690 INFO:teuthology.orchestra.run.gibba019.stdout:Reading state information... 2021-11-15T14:24:55.768 INFO:teuthology.orchestra.run.gibba019.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T14:24:55.768 INFO:teuthology.orchestra.run.gibba019.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:24:55.768 INFO:teuthology.orchestra.run.gibba019.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:24:55.769 INFO:teuthology.orchestra.run.gibba019.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:24:55.769 INFO:teuthology.orchestra.run.gibba019.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:24:55.769 INFO:teuthology.orchestra.run.gibba019.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:24:55.783 INFO:teuthology.orchestra.run.gibba019.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:24:55.785 DEBUG:teuthology.orchestra.run.gibba019:> dpkg -s linux-image-generic 2021-11-15T14:24:55.794 INFO:teuthology.orchestra.run.gibba019.stdout:Package: linux-image-generic 2021-11-15T14:24:55.795 INFO:teuthology.orchestra.run.gibba019.stdout:Status: install ok installed 2021-11-15T14:24:55.795 INFO:teuthology.orchestra.run.gibba019.stdout:Priority: optional 2021-11-15T14:24:55.795 INFO:teuthology.orchestra.run.gibba019.stdout:Section: kernel 2021-11-15T14:24:55.795 INFO:teuthology.orchestra.run.gibba019.stdout:Installed-Size: 18 2021-11-15T14:24:55.796 INFO:teuthology.orchestra.run.gibba019.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:24:55.796 INFO:teuthology.orchestra.run.gibba019.stdout:Architecture: amd64 2021-11-15T14:24:55.796 INFO:teuthology.orchestra.run.gibba019.stdout:Source: linux-meta 2021-11-15T14:24:55.796 INFO:teuthology.orchestra.run.gibba019.stdout:Version: 5.4.0.90.94 2021-11-15T14:24:55.797 INFO:teuthology.orchestra.run.gibba019.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:24:55.797 INFO:teuthology.orchestra.run.gibba019.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:24:55.797 INFO:teuthology.orchestra.run.gibba019.stdout:Recommends: thermald 2021-11-15T14:24:55.797 INFO:teuthology.orchestra.run.gibba019.stdout:Description: Generic Linux kernel image 2021-11-15T14:24:55.797 INFO:teuthology.orchestra.run.gibba019.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:24:55.798 INFO:teuthology.orchestra.run.gibba019.stdout: available. 2021-11-15T14:24:55.798 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:24:55.839 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.5Acw3MA6hP 2021-11-15T14:24:55.839 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5Acw3MA6hP 2021-11-15T14:24:55.847 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.5Acw3MA6hP 2021-11-15T14:24:55.922 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.5Acw3MA6hP is 10KB 2021-11-15T14:24:55.937 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.5Acw3MA6hP 2021-11-15T14:24:55.941 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T14:24:55.991 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:24:55.992 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T14:24:55.992 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T14:24:56.033 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T14:24:56.033 DEBUG:teuthology.orchestra.run.gibba019:> sudo update-grub 2021-11-15T14:24:57.241 INFO:teuthology.orchestra.run.gibba019.stderr:Sourcing file `/etc/default/grub' 2021-11-15T14:24:57.259 INFO:teuthology.orchestra.run.gibba019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:24:57.279 INFO:teuthology.orchestra.run.gibba019.stderr:Generating grub configuration file ... 2021-11-15T14:24:57.557 INFO:teuthology.orchestra.run.gibba019.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:24:57.571 INFO:teuthology.orchestra.run.gibba019.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:24:57.993 INFO:teuthology.orchestra.run.gibba019.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:24:58.007 INFO:teuthology.orchestra.run.gibba019.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:24:58.120 INFO:teuthology.orchestra.run.gibba019.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:24:58.134 INFO:teuthology.orchestra.run.gibba019.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:24:59.850 INFO:teuthology.orchestra.run.gibba019.stderr:done 2021-11-15T14:24:59.852 DEBUG:teuthology.orchestra.run.gibba019:> sudo shutdown -r now 2021-11-15T14:24:59.855 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-11-15T14:24:59.856 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba038.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T14:24:59.856 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-11-15T14:24:59.969 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-15T14:25:00.071 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:25:00.193 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:25:00.276 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:25:00.359 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:25:01.150 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:25:01.161 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:25:01.197 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:25:01.297 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-15T14:25:01.298 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-15T14:25:01.373 INFO:teuthology.orchestra.run.gibba038.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T14:25:01.374 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:25:01.374 INFO:teuthology.orchestra.run.gibba038.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:25:01.374 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:25:01.374 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:25:01.375 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:25:01.389 INFO:teuthology.orchestra.run.gibba038.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:25:01.390 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-11-15T14:25:01.399 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-11-15T14:25:01.400 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-11-15T14:25:01.400 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-11-15T14:25:01.400 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-11-15T14:25:01.401 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 18 2021-11-15T14:25:01.401 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:25:01.401 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-11-15T14:25:01.401 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-11-15T14:25:01.401 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 5.4.0.90.94 2021-11-15T14:25:01.402 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:25:01.402 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:25:01.402 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-11-15T14:25:01.402 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-11-15T14:25:01.403 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:25:01.403 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-11-15T14:25:01.403 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-11-15T14:25:01.408 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.SSnBXLP0Fr 2021-11-15T14:25:01.408 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SSnBXLP0Fr 2021-11-15T14:25:01.458 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.SSnBXLP0Fr 2021-11-15T14:25:01.485 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.SSnBXLP0Fr is 10KB 2021-11-15T14:25:01.499 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.SSnBXLP0Fr 2021-11-15T14:25:01.508 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T14:25:01.559 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:25:01.559 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T14:25:01.560 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T14:25:01.603 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T14:25:01.603 DEBUG:teuthology.orchestra.run.gibba038:> sudo update-grub 2021-11-15T14:25:02.772 INFO:teuthology.orchestra.run.gibba038.stderr:Sourcing file `/etc/default/grub' 2021-11-15T14:25:02.783 INFO:teuthology.orchestra.run.gibba038.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:25:02.811 INFO:teuthology.orchestra.run.gibba038.stderr:Generating grub configuration file ... 2021-11-15T14:25:03.176 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:25:03.192 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:25:03.656 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:25:03.671 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:25:03.797 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:25:03.812 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:25:05.600 INFO:teuthology.orchestra.run.gibba038.stderr:done 2021-11-15T14:25:05.602 DEBUG:teuthology.orchestra.run.gibba038:> sudo shutdown -r now 2021-11-15T14:25:05.604 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-11-15T14:25:05.604 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba032.front.sepia.ceph.com, path=None, version=distro) 2021-11-15T14:25:05.605 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-get clean 2021-11-15T14:25:05.741 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-get update 2021-11-15T14:25:05.841 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:25:05.955 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:25:06.037 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:25:06.120 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:25:06.828 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:25:06.840 DEBUG:teuthology.orchestra.run.gibba032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-15T14:25:06.920 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:25:07.023 INFO:teuthology.orchestra.run.gibba032.stdout:Building dependency tree... 2021-11-15T14:25:07.024 INFO:teuthology.orchestra.run.gibba032.stdout:Reading state information... 2021-11-15T14:25:07.102 INFO:teuthology.orchestra.run.gibba032.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-15T14:25:07.102 INFO:teuthology.orchestra.run.gibba032.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:25:07.102 INFO:teuthology.orchestra.run.gibba032.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:25:07.103 INFO:teuthology.orchestra.run.gibba032.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:25:07.103 INFO:teuthology.orchestra.run.gibba032.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:25:07.103 INFO:teuthology.orchestra.run.gibba032.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:25:07.117 INFO:teuthology.orchestra.run.gibba032.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-15T14:25:07.118 DEBUG:teuthology.orchestra.run.gibba032:> dpkg -s linux-image-generic 2021-11-15T14:25:07.128 INFO:teuthology.orchestra.run.gibba032.stdout:Package: linux-image-generic 2021-11-15T14:25:07.128 INFO:teuthology.orchestra.run.gibba032.stdout:Status: install ok installed 2021-11-15T14:25:07.129 INFO:teuthology.orchestra.run.gibba032.stdout:Priority: optional 2021-11-15T14:25:07.129 INFO:teuthology.orchestra.run.gibba032.stdout:Section: kernel 2021-11-15T14:25:07.129 INFO:teuthology.orchestra.run.gibba032.stdout:Installed-Size: 18 2021-11-15T14:25:07.129 INFO:teuthology.orchestra.run.gibba032.stdout:Maintainer: Ubuntu Kernel Team 2021-11-15T14:25:07.130 INFO:teuthology.orchestra.run.gibba032.stdout:Architecture: amd64 2021-11-15T14:25:07.130 INFO:teuthology.orchestra.run.gibba032.stdout:Source: linux-meta 2021-11-15T14:25:07.130 INFO:teuthology.orchestra.run.gibba032.stdout:Version: 5.4.0.90.94 2021-11-15T14:25:07.130 INFO:teuthology.orchestra.run.gibba032.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-15T14:25:07.131 INFO:teuthology.orchestra.run.gibba032.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-15T14:25:07.131 INFO:teuthology.orchestra.run.gibba032.stdout:Recommends: thermald 2021-11-15T14:25:07.131 INFO:teuthology.orchestra.run.gibba032.stdout:Description: Generic Linux kernel image 2021-11-15T14:25:07.131 INFO:teuthology.orchestra.run.gibba032.stdout: This package will always depend on the latest generic kernel image 2021-11-15T14:25:07.131 INFO:teuthology.orchestra.run.gibba032.stdout: available. 2021-11-15T14:25:07.132 DEBUG:teuthology.orchestra.run.gibba032:> mktemp 2021-11-15T14:25:07.136 INFO:teuthology.orchestra.run.gibba032.stdout:/tmp/tmp.1PnVYQj9Xn 2021-11-15T14:25:07.136 DEBUG:teuthology.orchestra.run.gibba032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1PnVYQj9Xn 2021-11-15T14:25:07.142 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod 0666 /tmp/tmp.1PnVYQj9Xn 2021-11-15T14:25:07.217 DEBUG:teuthology.orchestra.remote:gibba032:/tmp/tmp.1PnVYQj9Xn is 10KB 2021-11-15T14:25:07.236 DEBUG:teuthology.orchestra.run.gibba032:> rm -fr /tmp/tmp.1PnVYQj9Xn 2021-11-15T14:25:07.244 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-15T14:25:07.307 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:25:07.308 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-15T14:25:07.308 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-15T14:25:07.330 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-15T14:25:07.330 DEBUG:teuthology.orchestra.run.gibba032:> sudo update-grub 2021-11-15T14:25:08.741 INFO:teuthology.orchestra.run.gibba032.stderr:Sourcing file `/etc/default/grub' 2021-11-15T14:25:08.752 INFO:teuthology.orchestra.run.gibba032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-15T14:25:08.776 INFO:teuthology.orchestra.run.gibba032.stderr:Generating grub configuration file ... 2021-11-15T14:25:09.328 INFO:teuthology.orchestra.run.gibba032.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-15T14:25:09.343 INFO:teuthology.orchestra.run.gibba032.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-15T14:25:09.823 INFO:teuthology.orchestra.run.gibba032.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-15T14:25:09.839 INFO:teuthology.orchestra.run.gibba032.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-15T14:25:09.965 INFO:teuthology.orchestra.run.gibba032.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-15T14:25:09.980 INFO:teuthology.orchestra.run.gibba032.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-15T14:25:11.569 INFO:teuthology.orchestra.run.gibba032.stderr:done 2021-11-15T14:25:11.570 DEBUG:teuthology.orchestra.run.gibba032:> sudo shutdown -r now 2021-11-15T14:25:41.573 INFO:teuthology.misc:Re-opening connections... 2021-11-15T14:25:41.574 INFO:teuthology.misc:trying to connect to ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:25:41.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba035.front.sepia.ceph.com' 2021-11-15T14:25:41.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:27:00.012 DEBUG:teuthology.orchestra.remote:timed out 2021-11-15T14:27:00.014 INFO:teuthology.misc:trying to connect to ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:27:00.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-15T14:27:00.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:28:07.084 DEBUG:teuthology.orchestra.remote:timed out 2021-11-15T14:28:07.085 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-11-15T14:28:07.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-15T14:28:07.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:28:07.343 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-15T14:28:07.884 DEBUG:teuthology.misc:waited 146.31004357337952 2021-11-15T14:28:08.885 INFO:teuthology.misc:trying to connect to ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:28:08.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba035.front.sepia.ceph.com' 2021-11-15T14:28:08.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:28:09.069 DEBUG:teuthology.orchestra.run.gibba035:> true 2021-11-15T14:28:09.584 INFO:teuthology.misc:trying to connect to ubuntu@gibba032.front.sepia.ceph.com 2021-11-15T14:28:09.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba032.front.sepia.ceph.com' 2021-11-15T14:28:09.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:28:09.786 DEBUG:teuthology.orchestra.run.gibba032:> true 2021-11-15T14:28:10.349 DEBUG:teuthology.misc:waited 148.775043964386 2021-11-15T14:28:11.350 INFO:teuthology.misc:trying to connect to ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:28:11.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-15T14:28:11.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:28:11.646 DEBUG:teuthology.orchestra.run.gibba019:> true 2021-11-15T14:28:12.207 DEBUG:teuthology.misc:waited 150.6335072517395 2021-11-15T14:28:13.208 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-11-15T14:28:13.209 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-90-generic"... 2021-11-15T14:28:13.209 DEBUG:teuthology.orchestra.run.gibba035:> uname -r 2021-11-15T14:28:13.218 INFO:teuthology.orchestra.run.gibba035.stdout:5.4.0-90-generic 2021-11-15T14:28:13.219 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T14:28:13.219 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T14:28:13.219 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T14:28:13.219 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-11-15T14:28:13.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-90-generic"... 2021-11-15T14:28:13.220 DEBUG:teuthology.orchestra.run.gibba019:> uname -r 2021-11-15T14:28:13.229 INFO:teuthology.orchestra.run.gibba019.stdout:5.4.0-90-generic 2021-11-15T14:28:13.229 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T14:28:13.229 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T14:28:13.230 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T14:28:13.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-11-15T14:28:13.230 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-90-generic"... 2021-11-15T14:28:13.231 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-15T14:28:13.239 INFO:teuthology.orchestra.run.gibba038.stdout:5.4.0-90-generic 2021-11-15T14:28:13.240 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T14:28:13.240 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T14:28:13.240 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T14:28:13.240 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-11-15T14:28:13.241 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-90-generic"... 2021-11-15T14:28:13.241 DEBUG:teuthology.orchestra.run.gibba032:> uname -r 2021-11-15T14:28:13.250 INFO:teuthology.orchestra.run.gibba032.stdout:5.4.0-90-generic 2021-11-15T14:28:13.250 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-15T14:28:13.250 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-15T14:28:13.251 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-15T14:28:14.252 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-11-15T14:28:14.252 DEBUG:teuthology.orchestra.run.gibba035:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T14:28:14.362 INFO:teuthology.orchestra.run.gibba035.stdout:ttyS1 2021-11-15T14:28:14.385 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-11-15T14:28:14.386 DEBUG:teuthology.orchestra.run.gibba019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T14:28:14.444 INFO:teuthology.orchestra.run.gibba019.stdout:ttyS1 2021-11-15T14:28:14.472 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-11-15T14:28:14.472 DEBUG:teuthology.orchestra.run.gibba038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T14:28:14.541 INFO:teuthology.orchestra.run.gibba038.stdout:ttyS1 2021-11-15T14:28:14.579 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-11-15T14:28:14.579 DEBUG:teuthology.orchestra.run.gibba032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-15T14:28:14.664 INFO:teuthology.orchestra.run.gibba032.stdout:ttyS1 2021-11-15T14:28:14.709 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-15T14:28:14.718 INFO:teuthology.task.internal:Creating test directory... 2021-11-15T14:28:14.718 DEBUG:teuthology.orchestra.run.gibba019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T14:28:14.722 DEBUG:teuthology.orchestra.run.gibba032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T14:28:14.726 DEBUG:teuthology.orchestra.run.gibba035:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T14:28:14.729 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-15T14:28:14.738 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-15T14:28:14.757 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-15T14:28:14.821 INFO:teuthology.task.internal:Creating archive directory... 2021-11-15T14:28:14.822 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T14:28:14.825 DEBUG:teuthology.orchestra.run.gibba032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T14:28:14.828 DEBUG:teuthology.orchestra.run.gibba035:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T14:28:14.831 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-15T14:28:14.883 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-15T14:28:14.891 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-15T14:28:14.891 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T14:28:14.894 DEBUG:teuthology.orchestra.run.gibba032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T14:28:14.897 DEBUG:teuthology.orchestra.run.gibba035:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T14:28:14.900 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-15T14:28:14.918 INFO:teuthology.orchestra.run.gibba035.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.921 INFO:teuthology.orchestra.run.gibba032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.922 INFO:teuthology.orchestra.run.gibba035.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.922 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.924 INFO:teuthology.orchestra.run.gibba032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.925 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.948 INFO:teuthology.orchestra.run.gibba019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.952 INFO:teuthology.orchestra.run.gibba019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-15T14:28:14.953 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-15T14:28:14.961 INFO:teuthology.task.internal:Configuring sudo... 2021-11-15T14:28:14.961 DEBUG:teuthology.orchestra.run.gibba019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T14:28:14.964 DEBUG:teuthology.orchestra.run.gibba032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T14:28:14.967 DEBUG:teuthology.orchestra.run.gibba035:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T14:28:14.970 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-15T14:28:14.979 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-15T14:28:15.002 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-15T14:28:15.002 DEBUG:teuthology.orchestra.run.gibba019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T14:28:15.006 DEBUG:teuthology.orchestra.run.gibba032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T14:28:15.009 DEBUG:teuthology.orchestra.run.gibba035:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T14:28:15.012 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-15T14:28:15.032 DEBUG:teuthology.orchestra.run.gibba035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T14:28:15.041 DEBUG:teuthology.orchestra.run.gibba035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T14:28:15.093 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:28:15.093 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T14:28:15.111 DEBUG:teuthology.orchestra.run.gibba019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T14:28:15.120 DEBUG:teuthology.orchestra.run.gibba019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T14:28:15.124 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:28:15.124 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T14:28:15.133 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T14:28:15.143 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T14:28:15.152 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:28:15.152 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T14:28:15.222 DEBUG:teuthology.orchestra.run.gibba032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-15T14:28:15.232 DEBUG:teuthology.orchestra.run.gibba032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-15T14:28:15.236 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:28:15.236 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-15T14:28:15.291 DEBUG:teuthology.orchestra.run.gibba019:> sudo service rsyslog restart 2021-11-15T14:28:15.294 DEBUG:teuthology.orchestra.run.gibba032:> sudo service rsyslog restart 2021-11-15T14:28:15.297 DEBUG:teuthology.orchestra.run.gibba035:> sudo service rsyslog restart 2021-11-15T14:28:15.300 DEBUG:teuthology.orchestra.run.gibba038:> sudo service rsyslog restart 2021-11-15T14:28:15.353 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-15T14:28:15.362 INFO:teuthology.task.internal:Starting timer... 2021-11-15T14:28:15.362 INFO:teuthology.run_tasks:Running task pcp... 2021-11-15T14:28:15.415 INFO:teuthology.run_tasks:Running task selinux... 2021-11-15T14:28:15.451 DEBUG:teuthology.task.selinux:Excluding gibba035: OS 'ubuntu' does not support SELinux 2021-11-15T14:28:15.451 DEBUG:teuthology.task.selinux:Excluding gibba019: OS 'ubuntu' does not support SELinux 2021-11-15T14:28:15.452 DEBUG:teuthology.task.selinux:Excluding gibba038: OS 'ubuntu' does not support SELinux 2021-11-15T14:28:15.452 DEBUG:teuthology.task.selinux:Excluding gibba032: OS 'ubuntu' does not support SELinux 2021-11-15T14:28:15.452 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-15T14:28:15.453 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-11-15T14:28:15.453 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-15T14:28:15.453 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-15T14:28:15.487 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-11-15T14:28:15.488 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-15T14:28:15.507 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-15T14:28:15.508 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba035.front.sepia.ceph.com,gibba019.front.sepia.ceph.com,gibba038.front.sepia.ceph.com,gibba032.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-15T14:28:15.901 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-15T14:28:16.695 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-15T14:28:19.584 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-15T14:28:19.703 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:19 +0000 (0:00:00.135) 0:00:00.135 ******* 2021-11-15T14:28:19.715 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:19 +0000 (0:00:00.011) 0:00:00.147 ******* 2021-11-15T14:28:19.726 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:19 +0000 (0:00:00.011) 0:00:00.158 ******* 2021-11-15T14:28:19.737 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:19 +0000 (0:00:00.011) 0:00:00.169 ******* 2021-11-15T14:28:21.409 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T14:28:21.411 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba038.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba038.front.sepia.ceph.com] 2021-11-15T14:28:21.448 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba035.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-11-15T14:28:21.449 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] 2021-11-15T14:28:21.492 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:01.754) 0:00:01.924 ******* 2021-11-15T14:28:21.502 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba032.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-11-15T14:28:21.504 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] 2021-11-15T14:28:21.547 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.054) 0:00:01.979 ******* 2021-11-15T14:28:21.579 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.031) 0:00:02.011 ******* 2021-11-15T14:28:21.601 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba019.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba019.front.sepia.ceph.com] 2021-11-15T14:28:21.655 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.076) 0:00:02.088 ******* 2021-11-15T14:28:21.695 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-15T14:28:21.697 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T14:28:21.724 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.068) 0:00:02.156 ******* 2021-11-15T14:28:21.747 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.022) 0:00:02.179 ******* 2021-11-15T14:28:21.754 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T14:28:21.780 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.033) 0:00:02.212 ******* 2021-11-15T14:28:21.787 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T14:28:21.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:21 +0000 (0:00:00.032) 0:00:02.245 ******* 2021-11-15T14:28:22.166 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-11-15T14:28:22.168 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [gibba035.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T14:28:22.191 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.378) 0:00:02.623 ******* 2021-11-15T14:28:22.212 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.020) 0:00:02.644 ******* 2021-11-15T14:28:22.219 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T14:28:22.220 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-15T14:28:22.245 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.033) 0:00:02.677 ******* 2021-11-15T14:28:22.266 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.020) 0:00:02.698 ******* 2021-11-15T14:28:22.273 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-11-15T14:28:22.274 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:22.298 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.032) 0:00:02.730 ******* 2021-11-15T14:28:22.305 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:22.329 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.031) 0:00:02.762 ******* 2021-11-15T14:28:22.336 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:22.338 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:22.362 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.031) 0:00:02.794 ******* 2021-11-15T14:28:22.389 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.027) 0:00:02.821 ******* 2021-11-15T14:28:22.469 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-11-15T14:28:22.471 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:22.493 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.104) 0:00:02.925 ******* 2021-11-15T14:28:22.499 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:22.500 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:22.502 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:22.527 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.034) 0:00:02.960 ******* 2021-11-15T14:28:22.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.020) 0:00:02.980 ******* 2021-11-15T14:28:22.568 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:22 +0000 (0:00:00.019) 0:00:03.000 ******* 2021-11-15T14:28:23.116 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-15T14:28:23.118 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T14:28:23.119 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T14:28:23.120 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-15T14:28:23.145 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:23 +0000 (0:00:00.577) 0:00:03.577 ******* 2021-11-15T14:28:23.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:23 +0000 (0:00:00.026) 0:00:03.604 ******* 2021-11-15T14:28:23.193 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:23 +0000 (0:00:00.020) 0:00:03.625 ******* 2021-11-15T14:28:23.213 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:23 +0000 (0:00:00.020) 0:00:03.645 ******* 2021-11-15T14:28:23.598 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-15T14:28:23.600 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-15T14:28:23.601 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-15T14:28:23.634 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-15T14:28:23.636 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-11-15T14:28:23.638 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-11-15T14:28:23.640 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKL 2021-11-15T14:28:23.641 INFO:teuthology.task.ansible.out:wtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-15T14:28:23.767 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-11-15T14:28:23.768 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T14:28:23.784 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 15 November 2021 14:28:23 +0000 (0:00:00.571) 0:00:04.216 ******* 2021-11-15T14:28:24.264 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] 2021-11-15T14:28:24.289 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-15T14:28:24.311 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-15T14:28:24.332 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] 2021-11-15T14:28:24.351 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Monday 15 November 2021 14:28:24 +0000 (0:00:00.567) 0:00:04.784 ******* 2021-11-15T14:28:24.380 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T14:28:24.401 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T14:28:24.423 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T14:28:24.434 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-15T14:28:24.439 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T14:28:24.593 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:24 +0000 (0:00:00.240) 0:00:05.025 ******* 2021-11-15T14:28:24.614 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:24 +0000 (0:00:00.021) 0:00:05.046 ******* 2021-11-15T14:28:24.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:24 +0000 (0:00:00.022) 0:00:05.069 ******* 2021-11-15T14:28:24.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:24 +0000 (0:00:00.020) 0:00:05.090 ******* 2021-11-15T14:28:25.217 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba035.front.sepia.ceph.com] 2021-11-15T14:28:25.279 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Monday 15 November 2021 14:28:25 +0000 (0:00:00.621) 0:00:05.711 ******* 2021-11-15T14:28:25.290 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] 2021-11-15T14:28:25.302 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-15T14:28:25.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:25 +0000 (0:00:00.090) 0:00:05.802 ******* 2021-11-15T14:28:25.396 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:25 +0000 (0:00:00.025) 0:00:05.828 ******* 2021-11-15T14:28:25.412 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-15T14:28:25.474 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:25 +0000 (0:00:00.078) 0:00:05.906 ******* 2021-11-15T14:28:26.103 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-15T14:28:26.104 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.386245", "end": "2021-11-15 14:28:26.084544", "rc": 0, "start": "2021-11-15 14:28:25.698299", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T14:28:26.128 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.653) 0:00:06.560 ******* 2021-11-15T14:28:26.134 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.390607", "end": "2021-11-15 14:28:26.087714", "rc": 0, "start": "2021-11-15 14:28:25.697107", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T14:28:26.136 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.403161", "end": "2021-11-15 14:28:26.101092", "rc": 0, "start": "2021-11-15 14:28:25.697931", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T14:28:26.167 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.038) 0:00:06.599 ******* 2021-11-15T14:28:26.332 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.165) 0:00:06.764 ******* 2021-11-15T14:28:26.340 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-15T14:28:26.341 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010572", "end": "2021-11-15 14:28:26.364580", "failed_when_result": false, "rc": 0, "start": "2021-11-15 14:28:26.354008", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.330231", "end": "2021-11-15 14:28:26.215703", "rc": 0, "start": "2021-11-15 14:28:25.885472", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-15T14:28:26.343 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.005832", "end": "2021-11-15 14:28:26.472829", "failed_when_result": false, "rc": 0, "start": "2021-11-15 14:28:26.466997", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T14:28:26.369 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.036) 0:00:06.801 ******* 2021-11-15T14:28:26.391 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.022) 0:00:06.823 ******* 2021-11-15T14:28:26.415 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.023) 0:00:06.847 ******* 2021-11-15T14:28:26.432 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-15T14:28:26.434 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.044) 0:00:06.891 ******* 2021-11-15T14:28:26.467 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-15T14:28:26.468 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009790", "end": "2021-11-15 14:28:26.586940", "failed_when_result": false, "rc": 0, "start": "2021-11-15 14:28:26.577150", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.494 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:06.927 ******* 2021-11-15T14:28:26.517 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.022) 0:00:06.950 ******* 2021-11-15T14:28:26.524 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-15T14:28:26.526 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007772", "end": "2021-11-15 14:28:26.875403", "failed_when_result": false, "rc": 0, "start": "2021-11-15 14:28:26.867631", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-15T14:28:26.552 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:06.985 ******* 2021-11-15T14:28:26.559 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T14:28:26.561 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.586 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.033) 0:00:07.019 ******* 2021-11-15T14:28:26.593 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-15T14:28:26.595 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.622 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:07.054 ******* 2021-11-15T14:28:26.643 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.021) 0:00:07.076 ******* 2021-11-15T14:28:26.650 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-15T14:28:26.652 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.677 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.033) 0:00:07.109 ******* 2021-11-15T14:28:26.684 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-15T14:28:26.686 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.716 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.039) 0:00:07.149 ******* 2021-11-15T14:28:26.723 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T14:28:26.725 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.752 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:07.184 ******* 2021-11-15T14:28:26.776 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.024) 0:00:07.208 ******* 2021-11-15T14:28:26.785 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-15T14:28:26.787 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.036) 0:00:07.245 ******* 2021-11-15T14:28:26.819 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-15T14:28:26.820 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.820 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.847 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.034) 0:00:07.279 ******* 2021-11-15T14:28:26.871 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.024) 0:00:07.304 ******* 2021-11-15T14:28:26.879 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-15T14:28:26.879 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.880 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-15T14:28:26.880 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.907 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:07.339 ******* 2021-11-15T14:28:26.930 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.023) 0:00:07.362 ******* 2021-11-15T14:28:26.937 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T14:28:26.938 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.939 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:26.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.035) 0:00:07.398 ******* 2021-11-15T14:28:26.989 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:26 +0000 (0:00:00.023) 0:00:07.421 ******* 2021-11-15T14:28:26.995 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T14:28:26.997 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:27.020 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.031) 0:00:07.453 ******* 2021-11-15T14:28:27.027 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-15T14:28:27.028 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:27.052 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.031) 0:00:07.484 ******* 2021-11-15T14:28:27.068 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T14:28:27.070 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:27.097 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.045) 0:00:07.529 ******* 2021-11-15T14:28:27.114 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-15T14:28:27.116 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:27.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.042) 0:00:07.572 ******* 2021-11-15T14:28:27.145 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-15T14:28:27.147 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:27.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.032) 0:00:07.605 ******* 2021-11-15T14:28:27.180 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-15T14:28:27.182 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:27.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.034) 0:00:07.639 ******* 2021-11-15T14:28:27.236 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:27.261 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.054) 0:00:07.694 ******* 2021-11-15T14:28:27.310 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:28:27.336 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:27 +0000 (0:00:00.074) 0:00:07.768 ******* 2021-11-15T14:28:27.342 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-15T14:28:27.343 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T14:28:27.418 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T14:28:27.419 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T14:28:27.451 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T14:28:27.515 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T14:28:27.516 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-15T14:28:27.538 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T14:28:27.550 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T14:28:27.603 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T14:28:27.615 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-15T14:28:27.637 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T14:28:27.639 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T14:28:27.691 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T14:28:27.724 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-15T14:28:27.726 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T14:28:27.728 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T14:28:27.792 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T14:28:27.825 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T14:28:27.826 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T14:28:27.848 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-15T14:28:27.880 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T14:28:27.912 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T14:28:27.934 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-15T14:28:27.946 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T14:28:27.968 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T14:28:28.010 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T14:28:28.032 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-15T14:28:28.044 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T14:28:28.066 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T14:28:28.108 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T14:28:28.130 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T14:28:28.142 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-15T14:28:28.164 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T14:28:28.228 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T14:28:28.230 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-15T14:28:28.242 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T14:28:28.254 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T14:28:28.319 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-15T14:28:28.331 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T14:28:28.333 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T14:28:28.344 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T14:28:28.418 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-15T14:28:28.430 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T14:28:28.441 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T14:28:28.453 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T14:28:28.506 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-15T14:28:28.520 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T14:28:28.542 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T14:28:28.543 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T14:28:28.597 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-15T14:28:28.608 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T14:28:28.631 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T14:28:28.632 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T14:28:28.685 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-15T14:28:28.709 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T14:28:28.732 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T14:28:28.733 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T14:28:28.776 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-15T14:28:28.798 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T14:28:28.820 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T14:28:28.821 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T14:28:28.874 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-15T14:28:28.896 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T14:28:28.908 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T14:28:28.919 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T14:28:28.973 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-15T14:28:28.995 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T14:28:29.006 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T14:28:29.039 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T14:28:29.092 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T14:28:29.093 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T14:28:29.105 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-15T14:28:29.127 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T14:28:29.193 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T14:28:29.204 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-15T14:28:29.228 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T14:28:29.281 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T14:28:29.292 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T14:28:29.304 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-15T14:28:29.315 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T14:28:29.317 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:29.370 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T14:28:29.382 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T14:28:29.393 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-15T14:28:29.447 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T14:28:29.474 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T14:28:29.475 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T14:28:29.487 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-15T14:28:29.541 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T14:28:29.564 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T14:28:29.566 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T14:28:29.589 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-15T14:28:29.632 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T14:28:29.654 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T14:28:29.676 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T14:28:29.678 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-15T14:28:29.721 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T14:28:29.754 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T14:28:29.766 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T14:28:29.768 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-15T14:28:29.821 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T14:28:29.854 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T14:28:29.865 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-15T14:28:29.867 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T14:28:29.920 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T14:28:29.943 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T14:28:29.955 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-15T14:28:29.956 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T14:28:30.010 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T14:28:30.042 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T14:28:30.055 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-15T14:28:30.066 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T14:28:30.109 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T14:28:30.142 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T14:28:30.143 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-15T14:28:30.154 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T14:28:30.208 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T14:28:30.231 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T14:28:30.242 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-15T14:28:30.254 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T14:28:30.307 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T14:28:30.329 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T14:28:30.330 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-15T14:28:30.352 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T14:28:30.415 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T14:28:30.427 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T14:28:30.438 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-15T14:28:30.450 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T14:28:30.504 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:30.515 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T14:28:30.527 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-15T14:28:30.538 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T14:28:30.602 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T14:28:30.614 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T14:28:30.627 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-15T14:28:30.671 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T14:28:30.693 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T14:28:30.716 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T14:28:30.760 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-15T14:28:30.772 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:30.784 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T14:28:30.816 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:30.861 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T14:28:30.862 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:30.875 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T14:28:30.907 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T14:28:30.951 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T14:28:30.952 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-15T14:28:30.964 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T14:28:31.008 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T14:28:31.051 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T14:28:31.052 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-15T14:28:31.064 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T14:28:31.096 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T14:28:31.140 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-15T14:28:31.153 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T14:28:31.155 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T14:28:31.189 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T14:28:31.242 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:31.243 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-15T14:28:31.255 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T14:28:31.299 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T14:28:31.331 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T14:28:31.332 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-15T14:28:31.343 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T14:28:31.386 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T14:28:31.429 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T14:28:31.440 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-15T14:28:31.441 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T14:28:31.484 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T14:28:31.517 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T14:28:31.528 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-15T14:28:31.540 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:31.573 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:31.615 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T14:28:31.626 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:31.638 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T14:28:31.673 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T14:28:31.716 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T14:28:31.718 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-15T14:28:31.739 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T14:28:31.771 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T14:28:31.814 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T14:28:31.815 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-15T14:28:31.827 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T14:28:31.890 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T14:28:31.901 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-15T14:28:31.902 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T14:28:31.914 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T14:28:31.977 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T14:28:31.999 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T14:28:32.000 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-15T14:28:32.012 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T14:28:32.076 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T14:28:32.087 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T14:28:32.088 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-15T14:28:32.112 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T14:28:32.175 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T14:28:32.186 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T14:28:32.208 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T14:28:32.220 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-15T14:28:32.273 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T14:28:32.274 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T14:28:32.306 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T14:28:32.307 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-15T14:28:32.371 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T14:28:32.392 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-15T14:28:32.394 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T14:28:32.395 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T14:28:32.459 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T14:28:32.492 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-15T14:28:32.494 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T14:28:32.558 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T14:28:32.580 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T14:28:32.592 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-15T14:28:32.593 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T14:28:32.646 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T14:28:32.679 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T14:28:32.680 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:32.682 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-15T14:28:32.684 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T14:28:32.738 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T14:28:32.771 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T14:28:32.772 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T14:28:32.804 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-15T14:28:32.837 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T14:28:32.870 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T14:28:32.892 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:32.894 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-15T14:28:32.929 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T14:28:32.962 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T14:28:32.984 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T14:28:32.995 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-15T14:28:33.027 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T14:28:33.049 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T14:28:33.082 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T14:28:33.094 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-15T14:28:33.115 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T14:28:33.148 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:33.180 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T14:28:33.181 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-15T14:28:33.213 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:33.246 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T14:28:33.279 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-15T14:28:33.290 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T14:28:33.314 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T14:28:33.346 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T14:28:33.410 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-15T14:28:33.413 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T14:28:33.435 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T14:28:33.499 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T14:28:33.501 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-15T14:28:33.532 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T14:28:33.544 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T14:28:33.598 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T14:28:33.600 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-15T14:28:33.630 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T14:28:33.631 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T14:28:33.685 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T14:28:33.697 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-15T14:28:33.719 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T14:28:33.731 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T14:28:33.785 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-15T14:28:33.786 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T14:28:33.818 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T14:28:33.850 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T14:28:33.872 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T14:28:33.904 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T14:28:33.905 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-15T14:28:33.938 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T14:28:33.959 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T14:28:34.002 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-15T14:28:34.034 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T14:28:34.035 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T14:28:34.068 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T14:28:34.089 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-15T14:28:34.133 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T14:28:34.134 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T14:28:34.156 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T14:28:34.177 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-15T14:28:34.221 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T14:28:34.222 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T14:28:34.254 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T14:28:34.275 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-15T14:28:34.318 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T14:28:34.319 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T14:28:34.341 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T14:28:34.363 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-15T14:28:34.406 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T14:28:34.408 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T14:28:34.440 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T14:28:34.451 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-15T14:28:34.505 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T14:28:34.507 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T14:28:34.538 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T14:28:34.550 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-15T14:28:34.593 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T14:28:34.615 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T14:28:34.638 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-15T14:28:34.660 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T14:28:34.693 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T14:28:34.704 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T14:28:34.737 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-15T14:28:34.759 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T14:28:34.791 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T14:28:34.803 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T14:28:34.845 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T14:28:34.867 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-15T14:28:34.880 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T14:28:34.891 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T14:28:34.955 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-15T14:28:34.977 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T14:28:34.978 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T14:28:34.980 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T14:28:35.043 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-15T14:28:35.065 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T14:28:35.077 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T14:28:35.110 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T14:28:35.142 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-15T14:28:35.164 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T14:28:35.196 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T14:28:35.197 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T14:28:35.240 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-15T14:28:35.262 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T14:28:35.284 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T14:28:35.295 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T14:28:35.328 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-15T14:28:35.360 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T14:28:35.382 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T14:28:35.394 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T14:28:35.426 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-15T14:28:35.448 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T14:28:35.470 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T14:28:35.482 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T14:28:35.514 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-15T14:28:35.548 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T14:28:35.581 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T14:28:35.603 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T14:28:35.604 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-15T14:28:35.636 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T14:28:35.680 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T14:28:35.702 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T14:28:35.704 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-15T14:28:35.737 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T14:28:35.790 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T14:28:35.802 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T14:28:35.824 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-15T14:28:35.846 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T14:28:35.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T14:28:35.963 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T14:28:35.986 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T14:28:35.987 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-15T14:28:36.030 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T14:28:36.084 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T14:28:36.095 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T14:28:36.128 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-15T14:28:36.129 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T14:28:36.201 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T14:28:36.213 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T14:28:36.246 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-15T14:28:36.257 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T14:28:36.331 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T14:28:36.333 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T14:28:36.355 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-15T14:28:36.377 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T14:28:36.441 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T14:28:36.442 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T14:28:36.475 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T14:28:36.486 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-15T14:28:36.549 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T14:28:36.561 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T14:28:36.584 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-15T14:28:36.585 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T14:28:36.649 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T14:28:36.662 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:36.673 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T14:28:36.674 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-15T14:28:36.738 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:36.749 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T14:28:36.772 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-15T14:28:36.773 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T14:28:36.837 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T14:28:36.859 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-15T14:28:36.860 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:36.882 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T14:28:36.927 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T14:28:36.962 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T14:28:36.985 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T14:28:36.987 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-15T14:28:37.021 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T14:28:37.075 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-15T14:28:37.086 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T14:28:37.087 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T14:28:37.119 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T14:28:37.173 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-15T14:28:37.185 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T14:28:37.186 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T14:28:37.208 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T14:28:37.282 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T14:28:37.283 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T14:28:37.294 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-15T14:28:37.306 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T14:28:37.380 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T14:28:37.381 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T14:28:37.392 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-15T14:28:37.404 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T14:28:37.468 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T14:28:37.469 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T14:28:37.480 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-15T14:28:37.503 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T14:28:37.567 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T14:28:37.568 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T14:28:37.580 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-15T14:28:37.581 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:37.592 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T14:28:37.656 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T14:28:37.657 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T14:28:37.668 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-15T14:28:37.691 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T14:28:37.757 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T14:28:37.758 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:37.760 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-15T14:28:37.792 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T14:28:37.794 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T14:28:37.847 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T14:28:37.848 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-15T14:28:37.891 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T14:28:37.892 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T14:28:37.947 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-15T14:28:37.948 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T14:28:37.981 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T14:28:37.982 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T14:28:38.037 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-15T14:28:38.038 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T14:28:38.081 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T14:28:38.082 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T14:28:38.135 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-15T14:28:38.136 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T14:28:38.169 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T14:28:38.180 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T14:28:38.223 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-15T14:28:38.224 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T14:28:38.267 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T14:28:38.268 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T14:28:38.310 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T14:28:38.322 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-15T14:28:38.354 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T14:28:38.356 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T14:28:38.409 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T14:28:38.411 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-15T14:28:38.443 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T14:28:38.455 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T14:28:38.508 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T14:28:38.540 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-15T14:28:38.541 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T14:28:38.543 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T14:28:38.606 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T14:28:38.639 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T14:28:38.671 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-15T14:28:38.683 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T14:28:38.694 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T14:28:38.737 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T14:28:38.770 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-15T14:28:38.772 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T14:28:38.793 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T14:28:38.825 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T14:28:38.858 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-15T14:28:38.869 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T14:28:38.892 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T14:28:38.914 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T14:28:38.947 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-15T14:28:38.979 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T14:28:38.991 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T14:28:39.013 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T14:28:39.045 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-15T14:28:39.088 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T14:28:39.089 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T14:28:39.121 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T14:28:39.143 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-15T14:28:39.186 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T14:28:39.218 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T14:28:39.230 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T14:28:39.241 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-15T14:28:39.274 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T14:28:39.316 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T14:28:39.317 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T14:28:39.329 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-15T14:28:39.371 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T14:28:39.403 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T14:28:39.415 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T14:28:39.458 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-15T14:28:39.470 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T14:28:39.502 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T14:28:39.503 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T14:28:39.556 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-15T14:28:39.557 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T14:28:39.590 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T14:28:39.601 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T14:28:39.655 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-15T14:28:39.677 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T14:28:39.689 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T14:28:39.700 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T14:28:39.743 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-15T14:28:39.777 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T14:28:39.778 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T14:28:39.790 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T14:28:39.854 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-15T14:28:39.865 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T14:28:39.877 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T14:28:39.878 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T14:28:39.941 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-15T14:28:39.974 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T14:28:39.975 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T14:28:39.987 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T14:28:40.040 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-15T14:28:40.063 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T14:28:40.074 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T14:28:40.086 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T14:28:40.129 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-15T14:28:40.162 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T14:28:40.163 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T14:28:40.175 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T14:28:40.218 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-15T14:28:40.261 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T14:28:40.273 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T14:28:40.295 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T14:28:40.317 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-15T14:28:40.349 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T14:28:40.381 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T14:28:40.403 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T14:28:40.404 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-15T14:28:40.478 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T14:28:40.491 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T14:28:40.502 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T14:28:40.503 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-15T14:28:40.578 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T14:28:40.589 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T14:28:40.612 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-15T14:28:40.614 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T14:28:40.677 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T14:28:40.688 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T14:28:40.700 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-15T14:28:40.711 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T14:28:40.775 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T14:28:40.787 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T14:28:40.799 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-15T14:28:40.800 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T14:28:40.874 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T14:28:40.886 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T14:28:40.887 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T14:28:40.888 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-15T14:28:40.962 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T14:28:40.979 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T14:28:40.991 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T14:28:41.013 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-15T14:28:41.066 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-15T14:28:41.191 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "h 2021-11-15T14:28:41.194 INFO:teuthology.task.ansible.out:ome": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T14:28:41.258 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T14:28:41.260 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-15T14:28:41.292 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T14:28:41.346 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T14:28:41.357 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T14:28:41.389 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-15T14:28:41.401 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T14:28:41.454 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T14:28:41.466 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T14:28:41.498 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T14:28:41.510 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-15T14:28:41.564 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T14:28:41.611 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T14:28:41.612 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T14:28:41.624 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-15T14:28:41.659 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T14:28:41.703 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T14:28:41.716 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-15T14:28:41.717 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T14:28:41.751 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T14:28:41.804 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T14:28:41.816 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T14:28:41.817 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-15T14:28:41.849 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T14:28:41.892 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T14:28:41.914 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T14:28:41.936 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T14:28:41.947 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-15T14:28:41.990 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T14:28:42.011 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T14:28:42.033 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T14:28:42.034 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-15T14:28:42.077 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T14:28:42.109 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T14:28:42.121 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T14:28:42.132 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-15T14:28:42.175 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T14:28:42.197 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T14:28:42.219 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T14:28:42.230 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-15T14:28:42.273 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T14:28:42.295 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T14:28:42.306 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T14:28:42.318 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-15T14:28:42.393 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T14:28:42.395 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T14:28:42.417 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-15T14:28:42.491 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T14:28:42.502 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-15T14:28:42.576 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T14:28:42.598 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-15T14:28:42.693 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-15T14:28:42.839 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T14:28:42.936 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T14:28:42.958 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:42 +0000 (0:00:15.622) 0:00:23.391 ******* 2021-11-15T14:28:43.051 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-15T14:28:43.075 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.116) 0:00:23.507 ******* 2021-11-15T14:28:43.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.020) 0:00:23.527 ******* 2021-11-15T14:28:43.127 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-15T14:28:43.129 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T14:28:43.139 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-15T14:28:43.162 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.067) 0:00:23.595 ******* 2021-11-15T14:28:43.199 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-15T14:28:43.250 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-15T14:28:43.252 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T14:28:43.253 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T14:28:43.255 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T14:28:43.257 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T14:28:43.258 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T14:28:43.260 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T14:28:43.262 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-11-15T14:28:43.262 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T14:28:43.264 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T14:28:43.265 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T14:28:43.267 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T14:28:43.268 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T14:28:43.270 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T14:28:43.271 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-15T14:28:43.272 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T14:28:43.274 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T14:28:43.277 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T14:28:43.279 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T14:28:43.281 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T14:28:43.283 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T14:28:43.285 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-15T14:28:43.285 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T14:28:43.287 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T14:28:43.288 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T14:28:43.290 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T14:28:43.292 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T14:28:43.293 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T14:28:43.295 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432a 2021-11-15T14:28:43.296 INFO:teuthology.task.ansible.out:ac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T14:28:43.297 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T14:28:43.299 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T14:28:43.300 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} TASK [Create all admin users with sudo access.] ******************************** changed: [gibba035.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-15T14:28:43.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.276) 0:00:23.871 ******* 2021-11-15T14:28:43.465 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.026) 0:00:23.897 ******* 2021-11-15T14:28:43.489 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.023) 0:00:23.921 ******* 2021-11-15T14:28:43.580 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-15T14:28:43.608 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.119) 0:00:24.040 ******* 2021-11-15T14:28:43.630 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.021) 0:00:24.062 ******* 2021-11-15T14:28:43.713 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.083) 0:00:24.146 ******* 2021-11-15T14:28:43.743 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-15T14:28:43.745 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T14:28:43.747 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T14:28:43.749 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T14:28:43.751 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T14:28:43.753 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T14:28:43.755 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T14:28:43.756 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-11-15T14:28:43.757 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T14:28:43.759 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T14:28:43.761 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T14:28:43.763 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T14:28:43.764 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T14:28:43.766 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T14:28:43.767 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-15T14:28:43.768 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T14:28:43.769 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T14:28:43.799 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.086) 0:00:24.232 ******* 2021-11-15T14:28:43.825 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-15T14:28:43.826 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-15T14:28:43.828 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-15T14:28:43.830 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-15T14:28:43.831 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-15T14:28:43.833 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-15T14:28:43.834 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-15T14:28:43.836 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-15T14:28:43.838 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-15T14:28:43.839 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-15T14:28:43.841 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432a 2021-11-15T14:28:43.841 INFO:teuthology.task.ansible.out:ac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-15T14:28:43.843 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-15T14:28:43.845 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-15T14:28:43.846 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-15T14:28:43.874 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:43 +0000 (0:00:00.073) 0:00:24.306 ******* 2021-11-15T14:28:44.547 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-15T14:28:44.549 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} ok: [gibba019.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T14:28:44.573 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:44 +0000 (0:00:00.699) 0:00:25.005 ******* 2021-11-15T14:28:44.597 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:44 +0000 (0:00:00.023) 0:00:25.029 ******* 2021-11-15T14:28:44.772 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:28:44.773 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T14:28:44.794 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T14:28:44.847 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-15T14:28:44.848 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T14:28:44.873 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:44 +0000 (0:00:00.276) 0:00:25.305 ******* 2021-11-15T14:28:44.880 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:28:44.881 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T14:28:44.882 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [gibba035.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-15T14:28:44.909 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:44 +0000 (0:00:00.036) 0:00:25.341 ******* 2021-11-15T14:28:44.916 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:28:44.917 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T14:28:44.982 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T14:28:45.004 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T14:28:45.068 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T14:28:45.069 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T14:28:45.070 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T14:28:45.100 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-15T14:28:45.112 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T14:28:45.113 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T14:28:45.165 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T14:28:45.176 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T14:28:45.197 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T14:28:45.209 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-15T14:28:45.263 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T14:28:45.265 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T14:28:45.285 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T14:28:45.297 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T14:28:45.298 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T14:28:45.308 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-15T14:28:45.362 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T14:28:45.364 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:45.395 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T14:28:45.406 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T14:28:45.407 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T14:28:45.417 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-15T14:28:45.419 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-15T14:28:45.459 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T14:28:45.492 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T14:28:45.513 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T14:28:45.524 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-15T14:28:45.557 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T14:28:45.568 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.590 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T14:28:45.601 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.622 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T14:28:45.624 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T14:28:45.633 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-15T14:28:45.635 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-15T14:28:45.676 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T14:28:45.677 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T14:28:45.709 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T14:28:45.711 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T14:28:45.742 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T14:28:45.754 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-15T14:28:45.787 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T14:28:45.789 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.799 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T14:28:45.801 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gE 2021-11-15T14:28:45.803 INFO:teuthology.task.ansible.out:M13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.812 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.857 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T14:28:45.859 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-15T14:28:45.903 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T14:28:45.914 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T14:28:45.957 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T14:28:45.969 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:45.980 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-15T14:28:45.991 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:46.002 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T14:28:46.004 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T14:28:46.034 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T14:28:46.036 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T14:28:46.077 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T14:28:46.079 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T14:28:46.098 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T14:28:46.121 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-15T14:28:46.123 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-15T14:28:46.163 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T14:28:46.175 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T14:28:46.177 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-15T14:28:46.186 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:46.187 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T14:28:46.198 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:46.220 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-15T14:28:46.222 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-15T14:28:46.231 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:46.233 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:28:46.253 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T14:28:46.296 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T14:28:46.328 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T14:28:46.339 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T14:28:46.350 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-15T14:28:46.393 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T14:28:46.394 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T14:28:46.435 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T14:28:46.436 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T14:28:46.456 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T14:28:46.458 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T14:28:46.467 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-15T14:28:46.469 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-15T14:28:46.479 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T14:28:46.481 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T14:28:46.532 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T14:28:46.533 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T14:28:46.553 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T14:28:46.575 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-15T14:28:46.586 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T14:28:46.639 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T14:28:46.681 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T14:28:46.682 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T14:28:46.693 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-15T14:28:46.725 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T14:28:46.778 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T14:28:46.790 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-15T14:28:46.812 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T14:28:46.814 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T14:28:46.834 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T14:28:46.836 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T14:28:46.888 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-15T14:28:46.889 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, 2021-11-15T14:28:46.891 INFO:teuthology.task.ansible.out:"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-15T14:28:46.910 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T14:28:46.931 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T14:28:46.974 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T14:28:46.976 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T14:28:46.985 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-15T14:28:46.987 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-15T14:28:46.997 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T14:28:47.019 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T14:28:47.083 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T14:28:47.084 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-15T14:28:47.096 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T14:28:47.129 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T14:28:47.172 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T14:28:47.184 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-15T14:28:47.195 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T14:28:47.216 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T14:28:47.279 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T14:28:47.281 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T14:28:47.290 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-15T14:28:47.292 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-15T14:28:47.312 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T14:28:47.333 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T14:28:47.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T14:28:47.378 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-15T14:28:47.409 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T14:28:47.410 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T14:28:47.420 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T14:28:47.421 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T14:28:47.465 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T14:28:47.476 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-15T14:28:47.499 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T14:28:47.521 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T14:28:47.566 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T14:28:47.577 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-15T14:28:47.609 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T14:28:47.610 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T14:28:47.664 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T14:28:47.686 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-15T14:28:47.708 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T14:28:47.720 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T14:28:47.752 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T14:28:47.785 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-15T14:28:47.817 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T14:28:47.818 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T14:28:47.860 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T14:28:47.862 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T14:28:47.882 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-15T14:28:47.884 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-15T14:28:47.914 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:47.925 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:47.957 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T14:28:47.979 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-15T14:28:48.011 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T14:28:48.022 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T14:28:48.054 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T14:28:48.075 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-15T14:28:48.098 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T14:28:48.109 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T14:28:48.141 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T14:28:48.183 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-15T14:28:48.204 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T14:28:48.206 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T14:28:48.226 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T14:28:48.228 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T14:28:48.248 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T14:28:48.250 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:48.270 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-15T14:28:48.302 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T14:28:48.304 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T14:28:48.334 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:48.356 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T14:28:48.358 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T14:28:48.367 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:48.400 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T14:28:48.463 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T14:28:48.464 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-15T14:28:48.475 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T14:28:48.528 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T14:28:48.559 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T14:28:48.561 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-15T14:28:48.583 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T14:28:48.636 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T14:28:48.648 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T14:28:48.649 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T14:28:48.660 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-15T14:28:48.661 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-15T14:28:48.681 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T14:28:48.744 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T14:28:48.746 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1H 2021-11-15T14:28:48.748 INFO:teuthology.task.ansible.out:t+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-15T14:28:48.787 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-15T14:28:48.790 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJ 2021-11-15T14:28:48.792 INFO:teuthology.task.ansible.out:nNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:48.841 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T14:28:48.852 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T14:28:48.854 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T14:28:48.855 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T14:28:48.873 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-15T14:28:48.885 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T14:28:48.887 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T14:28:48.889 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T14:28:48.937 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T14:28:48.980 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T14:28:48.981 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T14:28:48.992 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-15T14:28:49.045 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T14:28:49.077 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T14:28:49.088 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T14:28:49.089 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-15T14:28:49.152 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T14:28:49.154 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:49.174 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T14:28:49.185 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T14:28:49.206 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-15T14:28:49.208 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:49.259 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T14:28:49.261 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T14:28:49.263 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T14:28:49.281 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T14:28:49.282 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T14:28:49.303 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-15T14:28:49.305 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-15T14:28:49.307 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-15T14:28:49.346 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T14:28:49.378 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T14:28:49.389 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T14:28:49.400 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-15T14:28:49.442 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T14:28:49.474 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T14:28:49.476 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T14:28:49.485 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T14:28:49.487 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-15T14:28:49.539 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T14:28:49.581 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-15T14:28:49.593 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T14:28:49.593 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T14:28:49.646 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T14:28:49.688 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-15T14:28:49.689 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T14:28:49.711 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T14:28:49.733 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T14:28:49.785 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-15T14:28:49.787 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T14:28:49.789 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T14:28:49.829 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T14:28:49.830 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-15T14:28:49.840 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T14:28:49.841 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T14:28:49.882 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-15T14:28:49.884 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T14:28:49.925 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T14:28:49.926 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T14:28:49.969 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T14:28:50.011 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T14:28:50.012 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-15T14:28:50.023 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T14:28:50.065 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T14:28:50.067 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T14:28:50.108 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T14:28:50.109 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": 2021-11-15T14:28:50.111 INFO:teuthology.task.ansible.out: "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-15T14:28:50.119 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T14:28:50.121 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T14:28:50.162 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T14:28:50.204 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-15T14:28:50.206 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-15T14:28:50.215 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T14:28:50.217 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T14:28:50.259 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T14:28:50.301 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-15T14:28:50.302 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T14:28:50.313 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T14:28:50.345 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T14:28:50.399 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T14:28:50.401 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T14:28:50.410 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-15T14:28:50.411 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T14:28:50.453 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:50.497 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T14:28:50.498 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-15T14:28:50.500 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-15T14:28:50.510 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:50.553 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T14:28:50.585 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T14:28:50.586 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-15T14:28:50.608 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T14:28:50.682 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T14:28:50.684 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T14:28:50.694 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-15T14:28:50.694 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T14:28:50.779 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T14:28:50.781 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:50.791 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-15T14:28:50.792 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T14:28:50.883 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T14:28:50.885 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+ 2021-11-15T14:28:50.887 INFO:teuthology.task.ansible.out:Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-15T14:28:50.896 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T14:28:50.970 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-15T14:28:50.981 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T14:28:50.983 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_cer 2021-11-15T14:28:50.985 INFO:teuthology.task.ansible.out:ts": true} 2021-11-15T14:28:51.068 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T14:28:51.080 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-15T14:28:51.080 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T14:28:51.092 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T14:28:51.165 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T14:28:51.177 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-15T14:28:51.188 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T14:28:51.190 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T14:28:51.264 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T14:28:51.275 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-15T14:28:51.287 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T14:28:51.288 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T14:28:51.363 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-15T14:28:51.365 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T14:28:51.375 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T14:28:51.386 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T14:28:51.461 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-15T14:28:51.462 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T14:28:51.493 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T14:28:51.525 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T14:28:51.558 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-15T14:28:51.559 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T14:28:51.602 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T14:28:51.624 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T14:28:51.645 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T14:28:51.656 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-15T14:28:51.699 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T14:28:51.732 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T14:28:51.743 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T14:28:51.754 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-15T14:28:51.839 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T14:28:51.839 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T14:28:51.861 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-15T14:28:51.862 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T14:28:51.935 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T14:28:51.946 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T14:28:51.968 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T14:28:51.979 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-15T14:28:52.021 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T14:28:52.043 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T14:28:52.064 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T14:28:52.086 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-15T14:28:52.107 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T14:28:52.129 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T14:28:52.161 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T14:28:52.204 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T14:28:52.206 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T14:28:52.226 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T14:28:52.227 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T14:28:52.237 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-15T14:28:52.249 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T14:28:52.291 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T14:28:52.323 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-15T14:28:52.334 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T14:28:52.346 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T14:28:52.389 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T14:28:52.421 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-15T14:28:52.432 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T14:28:52.443 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-15T14:28:52.445 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-15T14:28:52.486 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T14:28:52.519 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-15T14:28:52.521 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T14:28:52.543 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T14:28:52.616 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T14:28:52.618 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95 2021-11-15T14:28:52.620 INFO:teuthology.task.ansible.out:TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item 2021-11-15T14:28:52.621 INFO:teuthology.task.ansible.out:": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnN 2021-11-15T14:28:52.623 INFO:teuthology.task.ansible.out:lQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T14:28:52.629 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T14:28:52.703 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T14:28:52.715 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T14:28:52.726 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-15T14:28:52.728 INFO:teuthology.task.ansible.out: ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T14:28:52.802 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T14:28:52.813 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T14:28:52.824 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T14:28:52.826 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-15T14:28:52.899 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T14:28:52.901 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T14:28:52.922 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T14:28:52.923 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-15T14:28:52.997 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T14:28:53.008 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-15T14:28:53.010 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-15T14:28:53.019 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T14:28:53.030 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T14:28:53.032 INFO:teuthology.task.ansible.out: 2021-11-15T14:28:53.099 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T14:28:53.110 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T14:28:53.112 INFO:teuthology.task.ansible.out: ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-15T14:28:53.175 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T14:28:53.187 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T14:28:53.198 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T14:28:53.219 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-15T14:28:53.283 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T14:28:53.294 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T14:28:53.315 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-15T14:28:53.316 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T14:28:53.380 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T14:28:53.381 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T14:28:53.412 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T14:28:53.412 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-15T14:28:53.424 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T14:28:53.476 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T14:28:53.509 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T14:28:53.510 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-15T14:28:53.521 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T14:28:53.574 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T14:28:53.606 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T14:28:53.608 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T14:28:53.610 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-15T14:28:53.671 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T14:28:53.703 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-15T14:28:53.705 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma" 2021-11-15T14:28:53.707 INFO:teuthology.task.ansible.out:, "validate_certs": true} 2021-11-15T14:28:53.759 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T14:28:53.792 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-15T14:28:53.794 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-15T14:28:53.803 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T14:28:53.804 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T14:28:53.858 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T14:28:53.890 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-15T14:28:53.891 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T14:28:53.903 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T14:28:53.956 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T14:28:53.978 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-15T14:28:53.989 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T14:28:53.990 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T14:28:54.064 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T14:28:54.066 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:54.075 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T14:28:54.086 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T14:28:54.108 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-15T14:28:54.151 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T14:28:54.173 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T14:28:54.175 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T14:28:54.206 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-15T14:28:54.248 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T14:28:54.280 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T14:28:54.282 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:54.302 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-15T14:28:54.302 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T14:28:54.345 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T14:28:54.367 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T14:28:54.389 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T14:28:54.400 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-15T14:28:54.442 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T14:28:54.465 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T14:28:54.486 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T14:28:54.487 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-15T14:28:54.489 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-15T14:28:54.530 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T14:28:54.551 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T14:28:54.573 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T14:28:54.584 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-15T14:28:54.627 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T14:28:54.648 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T14:28:54.670 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-15T14:28:54.681 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T14:28:54.724 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T14:28:54.745 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T14:28:54.767 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-15T14:28:54.768 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T14:28:54.831 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T14:28:54.842 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T14:28:54.864 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-15T14:28:54.865 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T14:28:54.919 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T14:28:54.930 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T14:28:54.962 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-15T14:28:54.963 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T14:28:55.015 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T14:28:55.058 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-15T14:28:55.060 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+ 2021-11-15T14:28:55.061 INFO:teuthology.task.ansible.out:fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T14:28:55.112 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T14:28:55.144 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-15T14:28:55.155 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T14:28:55.156 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T14:28:55.209 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T14:28:55.231 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-15T14:28:55.253 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T14:28:55.264 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T14:28:55.306 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T14:28:55.328 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-15T14:28:55.360 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T14:28:55.361 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T14:28:55.424 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-15T14:28:55.436 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T14:28:55.447 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T14:28:55.458 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T14:28:55.532 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T14:28:55.534 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-15T14:28:55.544 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T14:28:55.556 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T14:28:55.619 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-15T14:28:55.621 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T14:28:55.631 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T14:28:55.642 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T14:28:55.706 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T14:28:55.717 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-15T14:28:55.731 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T14:28:55.740 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T14:28:55.814 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-15T14:28:55.815 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T14:28:55.836 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T14:28:55.838 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T14:28:55.900 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-15T14:28:55.922 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T14:28:55.924 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T14:28:55.976 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T14:28:55.997 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-15T14:28:56.052 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T14:28:56.053 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T14:28:56.063 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T14:28:56.064 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T14:28:56.096 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-15T14:28:56.149 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T14:28:56.171 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T14:28:56.172 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T14:28:56.183 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-15T14:28:56.246 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T14:28:56.268 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T14:28:56.279 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-15T14:28:56.281 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-15T14:28:56.301 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T14:28:56.354 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T14:28:56.375 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T14:28:56.387 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-15T14:28:56.398 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T14:28:56.450 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T14:28:56.462 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T14:28:56.483 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T14:28:56.495 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-15T14:28:56.548 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T14:28:56.559 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T14:28:56.581 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T14:28:56.583 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-15T14:28:56.645 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T14:28:56.656 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T14:28:56.678 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-15T14:28:56.689 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T14:28:56.732 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T14:28:56.754 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T14:28:56.775 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-15T14:28:56.797 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T14:28:56.840 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T14:28:56.862 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T14:28:56.873 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-15T14:28:56.926 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T14:28:56.937 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T14:28:56.959 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T14:28:56.980 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-15T14:28:57.023 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T14:28:57.034 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T14:28:57.045 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T14:28:57.120 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T14:28:57.122 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T14:28:57.123 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-15T14:28:57.135 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T14:28:57.209 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T14:28:57.209 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T14:28:57.231 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T14:28:57.232 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-15T14:28:57.327 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T14:28:57.329 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-15T14:28:57.339 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T14:28:57.341 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T14:28:57.361 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T14:28:57.414 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-15T14:28:57.425 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T14:28:57.436 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T14:28:57.468 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T14:28:57.470 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T14:28:57.511 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-15T14:28:57.532 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T14:28:57.554 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T14:28:57.596 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T14:28:57.628 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-15T14:28:57.630 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-15T14:28:57.661 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T14:28:57.662 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T14:28:57.672 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T14:28:57.694 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T14:28:57.696 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T14:28:57.737 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-15T14:28:57.759 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T14:28:57.801 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T14:28:57.813 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T14:28:57.814 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T14:28:57.845 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-15T14:28:57.856 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T14:28:57.909 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T14:28:57.931 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T14:28:57.943 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-15T14:28:57.944 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-15T14:28:57.975 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T14:28:58.038 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-15T14:28:58.039 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T14:28:58.051 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T14:28:58.062 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T14:28:58.146 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T14:28:58.147 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T14:28:58.158 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T14:28:58.159 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-15T14:28:58.234 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T14:28:58.258 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T14:28:58.259 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T14:28:58.312 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-15T14:28:58.334 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T14:28:58.345 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T14:28:58.367 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T14:28:58.430 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T14:28:58.442 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T14:28:58.453 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T14:28:58.464 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-15T14:28:58.527 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T14:28:58.528 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T14:28:58.550 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T14:28:58.571 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-15T14:28:58.624 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T14:28:58.635 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T14:28:58.647 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T14:28:58.679 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-15T14:28:58.721 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T14:28:58.732 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T14:28:58.745 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T14:28:58.788 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-15T14:28:58.831 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T14:28:58.843 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T14:28:58.854 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T14:28:58.876 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-15T14:28:58.929 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T14:28:58.930 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T14:28:58.963 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T14:28:58.985 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-15T14:28:59.028 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T14:28:59.039 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T14:28:59.071 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T14:28:59.082 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-15T14:28:59.125 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T14:28:59.136 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T14:28:59.169 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T14:28:59.190 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-15T14:28:59.212 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T14:28:59.234 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T14:28:59.267 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T14:28:59.299 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-15T14:28:59.311 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T14:28:59.322 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T14:28:59.375 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T14:28:59.417 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T14:28:59.418 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T14:28:59.420 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-15T14:28:59.482 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T14:28:59.514 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T14:28:59.515 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-15T14:28:59.526 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T14:28:59.611 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T14:28:59.623 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T14:28:59.624 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-15T14:28:59.625 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T14:28:59.709 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-15T14:28:59.720 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T14:28:59.720 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T14:28:59.753 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T14:28:59.816 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T14:28:59.818 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T14:28:59.839 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-15T14:28:59.881 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T14:28:59.903 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T14:28:59.914 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T14:28:59.977 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-15T14:29:00.001 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:28:59 +0000 (0:00:15.091) 0:00:40.433 ******* 2021-11-15T14:29:00.009 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T14:29:00.010 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T14:29:00.046 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-15T14:29:00.080 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T14:29:00.091 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:00.093 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.103 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.105 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.117 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:29:00.119 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T14:29:00.119 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:00.125 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.127 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.145 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:29:00.179 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.180 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:29:00.185 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-15T14:29:00.186 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T14:29:00.236 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-15T14:29:00.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:00 +0000 (0:00:00.259) 0:00:40.693 ******* 2021-11-15T14:29:00.284 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:00 +0000 (0:00:00.023) 0:00:40.716 ******* 2021-11-15T14:29:00.292 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:00.293 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e19 2021-11-15T14:29:00.295 INFO:teuthology.task.ansible.out:02a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.332 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:29:00.333 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-15T14:29:00.343 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:00.345 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.354 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.356 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.366 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.367 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.378 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T14:29:00.378 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.379 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.390 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.391 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfW 2021-11-15T14:29:00.393 INFO:teuthology.task.ansible.out:p7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.403 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.415 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.417 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.427 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.438 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-15T14:29:00.438 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-15T14:29:00.519 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:00.521 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada2 2021-11-15T14:29:00.522 INFO:teuthology.task.ansible.out:8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path" 2021-11-15T14:29:00.523 INFO:teuthology.task.ansible.out:: null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab 2021-11-15T14:29:00.525 INFO:teuthology.task.ansible.out:103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI 2021-11-15T14:29:00.526 INFO:teuthology.task.ansible.out:83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.547 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:00 +0000 (0:00:00.263) 0:00:40.979 ******* 2021-11-15T14:29:00.555 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.556 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T14:29:00.557 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.559 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.559 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148 2021-11-15T14:29:00.561 INFO:teuthology.task.ansible.out:c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehuda 2021-11-15T14:29:00.562 INFO:teuthology.task.ansible.out:sa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.575 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.577 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.588 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.599 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.600 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5 2021-11-15T14:29:00.602 INFO:teuthology.task.ansible.out:aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T14:29:00.611 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.613 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.622 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.633 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.635 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.646 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T14:29:00.647 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.647 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.648 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.659 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.661 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.661 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3 2021-11-15T14:29:00.663 INFO:teuthology.task.ansible.out:332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.672 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.674 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.684 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.686 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.696 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.697 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-15T14:29:00.708 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.710 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.720 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.722 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.732 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.734 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.744 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.746 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== 2021-11-15T14:29:00.747 INFO:teuthology.task.ansible.out:thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@ta 2021-11-15T14:29:00.749 INFO:teuthology.task.ansible.out:mil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.758 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.760 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a8 2021-11-15T14:29:00.761 INFO:teuthology.task.ansible.out:7cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.771 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.772 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.783 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.784 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.785 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.785 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVK 2021-11-15T14:29:00.787 INFO:teuthology.task.ansible.out:qycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-15T14:29:00.796 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.798 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c153907 2021-11-15T14:29:00.799 INFO:teuthology.task.ansible.out:6f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": " 2021-11-15T14:29:00.801 INFO:teuthology.task.ansible.out:item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.810 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.812 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.812 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "it 2021-11-15T14:29:00.814 INFO:teuthology.task.ansible.out:em": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.824 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.826 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f 2021-11-15T14:29:00.828 INFO:teuthology.task.ansible.out:3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.837 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.838 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.839 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.839 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZh 2021-11-15T14:29:00.841 INFO:teuthology.task.ansible.out:mBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.850 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.851 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.862 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.864 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.874 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.887 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.898 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.900 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.900 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "i 2021-11-15T14:29:00.902 INFO:teuthology.task.ansible.out:tem": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-15T14:29:00.911 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.913 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.913 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2021-11-15T14:29:00.915 INFO:teuthology.task.ansible.out:: "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.924 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.925 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.926 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithl 2021-11-15T14:29:00.927 INFO:teuthology.task.ansible.out:e@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.937 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.938 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.939 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.950 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.950 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.951 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.951 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa07 2021-11-15T14:29:00.953 INFO:teuthology.task.ansible.out:8f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.964 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.965 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.966 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.966 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri" 2021-11-15T14:29:00.968 INFO:teuthology.task.ansible.out:, "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.977 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.979 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.979 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.981 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.991 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.993 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.993 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:00.994 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'nam 2021-11-15T14:29:00.995 INFO:teuthology.task.ansible.out:e': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.004 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.005 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.007 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} ok: [gibba035.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r 2021-11-15T14:29:01.009 INFO:teuthology.task.ansible.out:7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.020 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.021 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.022 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.022 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini 2021-11-15T14:29:01.024 INFO:teuthology.task.ansible.out:2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.034 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.035 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.036 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040 2021-11-15T14:29:01.037 INFO:teuthology.task.ansible.out:d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.038 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c 2021-11-15T14:29:01.039 INFO:teuthology.task.ansible.out:2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.050 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.052 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => ( 2021-11-15T14:29:01.054 INFO:teuthology.task.ansible.out:item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.063 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.065 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.065 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH 2021-11-15T14:29:01.067 INFO:teuthology.task.ansible.out:/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.067 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.067 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa 2021-11-15T14:29:01.069 INFO:teuthology.task.ansible.out:6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.078 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.080 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.080 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => ( 2021-11-15T14:29:01.082 INFO:teuthology.task.ansible.out:item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.093 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.095 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.096 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.107 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.109 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.109 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.110 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uU 2021-11-15T14:29:01.111 INFO:teuthology.task.ansible.out:DVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.113 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.124 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.126 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.127 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.128 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.130 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.130 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.137 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.137 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", 2021-11-15T14:29:01.139 INFO:teuthology.task.ansible.out:"ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.149 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.150 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.152 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.154 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.155 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.157 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.158 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.170 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.171 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.172 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.174 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.174 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.176 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.178 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.178 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.180 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.180 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.191 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.192 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.194 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.195 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.196 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.207 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.209 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.209 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.211 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.221 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.223 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.223 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.224 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": 2021-11-15T14:29:01.225 INFO:teuthology.task.ansible.out: false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.226 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => 2021-11-15T14:29:01.227 INFO:teuthology.task.ansible.out: (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.237 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.238 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.239 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.239 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshank 2021-11-15T14:29:01.241 INFO:teuthology.task.ansible.out:ar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.251 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.253 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.254 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.255 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.255 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.256 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ifed0 2021-11-15T14:29:01.257 INFO:teuthology.task.ansible.out:1', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.267 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.268 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.269 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.269 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c 2021-11-15T14:29:01.271 INFO:teuthology.task.ansible.out:7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0f 2021-11-15T14:29:01.272 INFO:teuthology.task.ansible.out:bf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.282 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.283 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.294 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.296 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.296 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.296 INFO:teuthology.task.ansible.out:skipping: [gibba03 2021-11-15T14:29:01.298 INFO:teuthology.task.ansible.out:5.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.308 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.309 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.310 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.310 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035a 2021-11-15T14:29:01.312 INFO:teuthology.task.ansible.out:a3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.312 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.312 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6 2021-11-15T14:29:01.314 INFO:teuthology.task.ansible.out:b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.324 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.326 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.326 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.327 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'} 2021-11-15T14:29:01.328 INFO:teuthology.task.ansible.out:) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.337 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.339 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.339 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.340 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@ 2021-11-15T14:29:01.341 INFO:teuthology.task.ansible.out:laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.351 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.353 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.353 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.354 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsaw 2021-11-15T14:29:01.355 INFO:teuthology.task.ansible.out:aya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.366 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.368 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.368 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7 2021-11-15T14:29:01.370 INFO:teuthology.task.ansible.out:+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.381 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.382 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.383 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.383 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaru 2021-11-15T14:29:01.385 INFO:teuthology.task.ansible.out:na", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.395 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.397 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.397 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.398 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjar 2021-11-15T14:29:01.399 INFO:teuthology.task.ansible.out:a", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.400 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-l 2021-11-15T14:29:01.401 INFO:teuthology.task.ansible.out:aptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.411 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.412 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.413 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.413 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": f 2021-11-15T14:29:01.415 INFO:teuthology.task.ansible.out:alse, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.425 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.426 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.427 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.427 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn" 2021-11-15T14:29:01.429 INFO:teuthology.task.ansible.out:: "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.440 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.441 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.442 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.442 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": fa 2021-11-15T14:29:01.444 INFO:teuthology.task.ansible.out:lse, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.463 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.465 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.465 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.466 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae7 2021-11-15T14:29:01.467 INFO:teuthology.task.ansible.out:7Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88 2021-11-15T14:29:01.469 INFO:teuthology.task.ansible.out:e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.492 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.944) 0:00:41.924 ******* 2021-11-15T14:29:01.500 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.501 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.502 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.503 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.505 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.505 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.506 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.506 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJ 2021-11-15T14:29:01.508 INFO:teuthology.task.ansible.out:FgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.508 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.509 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63 2021-11-15T14:29:01.510 INFO:teuthology.task.ansible.out:iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.521 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.523 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.523 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.525 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.525 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.526 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc 2021-11-15T14:29:01.527 INFO:teuthology.task.ansible.out:4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.538 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.539 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.540 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.540 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "i 2021-11-15T14:29:01.542 INFO:teuthology.task.ansible.out:tem", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.551 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.552 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.553 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.553 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name' 2021-11-15T14:29:01.555 INFO:teuthology.task.ansible.out:: 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.565 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.566 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.568 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.592 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.100) 0:00:42.024 ******* 2021-11-15T14:29:01.600 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.601 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.603 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.603 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.604 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.604 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2021-11-15T14:29:01.606 INFO:teuthology.task.ansible.out:"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.606 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.607 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.607 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 2021-11-15T14:29:01.609 INFO:teuthology.task.ansible.out:'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.609 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db1 2021-11-15T14:29:01.611 INFO:teuthology.task.ansible.out:6d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.621 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.623 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.623 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.623 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {" 2021-11-15T14:29:01.625 INFO:teuthology.task.ansible.out:name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.635 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.637 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.647 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.649 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.649 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.649 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "cha 2021-11-15T14:29:01.651 INFO:teuthology.task.ansible.out:nged": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.661 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.663 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.663 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.664 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "ite 2021-11-15T14:29:01.665 INFO:teuthology.task.ansible.out:m": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.674 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.682 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skippi 2021-11-15T14:29:01.684 INFO:teuthology.task.ansible.out:ng: [gibba032.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.687 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.689 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.714 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.717 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.745 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.747 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.747 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.749 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.749 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "ite 2021-11-15T14:29:01.751 INFO:teuthology.task.ansible.out:m": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.752 INFO:teuthology.task.ansible.out:skipping 2021-11-15T14:29:01.754 INFO:teuthology.task.ansible.out:: [gibba035.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.779 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.186) 0:00:42.211 ******* 2021-11-15T14:29:01.787 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.789 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.790 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.791 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba019.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T14:29:01.793 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.813 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.815 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.816 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.816 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 2021-11-15T14:29:01.818 INFO:teuthology.task.ansible.out:'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.842 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.063) 0:00:42.275 ******* 2021-11-15T14:29:01.849 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.849 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.851 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.853 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-15T14:29:01.853 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.853 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.881 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.038) 0:00:42.313 ******* 2021-11-15T14:29:01.889 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-15T14:29:01.890 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.892 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.892 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.893 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.893 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.895 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.906 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.907 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.052) 0:00:42.366 ******* 2021-11-15T14:29:01.941 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.942 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.944 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:01.974 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba019.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T14:29:02.002 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:01 +0000 (0:00:00.067) 0:00:42.434 ******* 2021-11-15T14:29:02.044 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T14:29:02.045 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T14:29:02.076 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:02.100 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:02 +0000 (0:00:00.098) 0:00:42.532 ******* 2021-11-15T14:29:02.108 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-15T14:29:02.110 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T14:29:02.131 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T14:29:02.132 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T14:29:02.196 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T14:29:02.228 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T14:29:02.230 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T14:29:02.282 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-15T14:29:02.284 INFO:teuthology.task.ansible.out: ok: [gibba038.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T14:29:02.316 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T14:29:02.317 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T14:29:02.380 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T14:29:02.401 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T14:29:02.413 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T14:29:02.424 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-15T14:29:02.466 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T14:29:02.499 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T14:29:02.499 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T14:29:02.511 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-15T14:29:02.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T14:29:02.565 INFO:teuthology.task.ansible.out: 2021-11-15T14:29:02.586 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T14:29:02.588 INFO:teuthology.task.ansible.out: ok: [gibba032.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T14:29:02.590 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-15T14:29:02.674 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T14:29:02.675 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T14:29:02.676 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-15T14:29:02.687 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T14:29:02.760 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T14:29:02.761 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T14:29:02.772 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-15T14:29:02.773 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T14:29:02.847 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T14:29:02.858 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T14:29:02.859 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-15T14:29:02.891 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T14:29:02.955 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T14:29:02.956 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T14:29:02.957 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-15T14:29:02.989 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T14:29:03.042 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T14:29:03.043 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} ok: [gibba035.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-15T14:29:03.075 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T14:29:03.128 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T14:29:03.129 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T14:29:03.140 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-15T14:29:03.163 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T14:29:03.216 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T14:29:03.217 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T14:29:03.239 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-15T14:29:03.250 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T14:29:03.303 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T14:29:03.325 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-15T14:29:03.337 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T14:29:03.337 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T14:29:03.390 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T14:29:03.412 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-15T14:29:03.434 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T14:29:03.435 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T14:29:03.477 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T14:29:03.499 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-15T14:29:03.521 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T14:29:03.563 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T14:29:03.575 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T14:29:03.586 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-15T14:29:03.607 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T14:29:03.661 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T14:29:03.662 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T14:29:03.683 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-15T14:29:03.695 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T14:29:03.749 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T14:29:03.760 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T14:29:03.793 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T14:29:03.825 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-15T14:29:03.836 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T14:29:03.858 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T14:29:03.890 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T14:29:03.912 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-15T14:29:03.924 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T14:29:03.945 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T14:29:03.977 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T14:29:04.009 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T14:29:04.010 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-15T14:29:04.032 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T14:29:04.085 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T14:29:04.096 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-15T14:29:04.097 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T14:29:04.120 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T14:29:04.122 INFO:teuthology.task.ansible.out: 2021-11-15T14:29:04.175 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T14:29:04.186 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-15T14:29:04.197 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T14:29:04.218 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T14:29:04.272 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T14:29:04.283 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-15T14:29:04.294 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T14:29:04.306 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T14:29:04.369 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-15T14:29:04.370 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T14:29:04.382 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T14:29:04.394 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T14:29:04.457 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-15T14:29:04.468 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T14:29:04.490 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T14:29:04.501 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T14:29:04.553 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-15T14:29:04.565 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T14:29:04.576 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T14:29:04.578 INFO:teuthology.task.ansible.out: 2021-11-15T14:29:04.599 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T14:29:04.653 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-15T14:29:04.664 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T14:29:04.665 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T14:29:04.729 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T14:29:04.751 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T14:29:04.762 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T14:29:04.774 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-15T14:29:04.816 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T14:29:04.838 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T14:29:04.849 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T14:29:04.861 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-15T14:29:04.914 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T14:29:04.935 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T14:29:04.937 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T14:29:05.000 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T14:29:05.002 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-15T14:29:05.033 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T14:29:05.035 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T14:29:05.087 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T14:29:05.098 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-15T14:29:05.120 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T14:29:05.122 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T14:29:05.178 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T14:29:05.180 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-15T14:29:05.212 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T14:29:05.223 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T14:29:05.276 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-15T14:29:05.287 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T14:29:05.299 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T14:29:05.310 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T14:29:05.363 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-15T14:29:05.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T14:29:05.387 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T14:29:05.398 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T14:29:05.451 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-15T14:29:05.463 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T14:29:05.485 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T14:29:05.486 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T14:29:05.542 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-15T14:29:05.575 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T14:29:05.576 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T14:29:05.598 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T14:29:05.631 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-15T14:29:05.663 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T14:29:05.665 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T14:29:05.686 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T14:29:05.718 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-15T14:29:05.750 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T14:29:05.761 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T14:29:05.772 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T14:29:05.804 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-15T14:29:05.836 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T14:29:05.848 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T14:29:05.859 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T14:29:05.893 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-15T14:29:05.925 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T14:29:05.936 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T14:29:05.947 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T14:29:05.979 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-15T14:29:06.011 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T14:29:06.022 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T14:29:06.034 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T14:29:06.097 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T14:29:06.108 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-15T14:29:06.119 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T14:29:06.131 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T14:29:06.194 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-15T14:29:06.195 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T14:29:06.206 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T14:29:06.218 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T14:29:06.282 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T14:29:06.282 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-15T14:29:06.294 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T14:29:06.305 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T14:29:06.369 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T14:29:06.380 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-15T14:29:06.381 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T14:29:06.392 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T14:29:06.455 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T14:29:06.466 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-15T14:29:06.478 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T14:29:06.510 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T14:29:06.552 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T14:29:06.553 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-15T14:29:06.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T14:29:06.597 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T14:29:06.640 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T14:29:06.672 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-15T14:29:06.693 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T14:29:06.694 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T14:29:06.726 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T14:29:06.758 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-15T14:29:06.780 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T14:29:06.781 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T14:29:06.814 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T14:29:06.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:06 +0000 (0:00:04.738) 0:00:47.271 ******* 2021-11-15T14:29:06.857 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-15T14:29:06.879 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T14:29:06.901 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T14:29:06.952 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:06 +0000 (0:00:00.112) 0:00:47.384 ******* 2021-11-15T14:29:06.965 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-15T14:29:06.980 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T14:29:07.044 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-15T14:29:07.108 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T14:29:07.210 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-15T14:29:07.276 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T14:29:07.352 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-15T14:29:07.395 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T14:29:07.453 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.501) 0:00:47.885 ******* 2021-11-15T14:29:07.492 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-15T14:29:07.494 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636986546.9238496-29718-125527369191991/source", "state": "file", "uid": 0} changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636986547.0741513-29725-259061919885529/source", "state": "file", "uid": 0} 2021-11-15T14:29:07.526 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.073) 0:00:47.958 ******* 2021-11-15T14:29:07.558 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.031) 0:00:47.990 ******* 2021-11-15T14:29:07.567 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba035.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-15T14:29:07.601 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T14:29:07.603 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => { "msg": "Host gibba019.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T14:29:07.632 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.074) 0:00:48.064 ******* 2021-11-15T14:29:07.642 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => { "msg": "Host gibba032.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T14:29:07.677 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.045) 0:00:48.109 ******* 2021-11-15T14:29:07.687 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-15T14:29:07.689 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-15T14:29:07.757 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.079) 0:00:48.189 ******* 2021-11-15T14:29:07.764 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T14:29:07.767 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} ok: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-15T14:29:07.795 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.037) 0:00:48.227 ******* 2021-11-15T14:29:07.819 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.024) 0:00:48.252 ******* 2021-11-15T14:29:07.869 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-15T14:29:07.871 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636986547.56279-29743-197175386026345/source", "state": "file", "uid": 0} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:07.896 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.076) 0:00:48.328 ******* 2021-11-15T14:29:07.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.025) 0:00:48.354 ******* 2021-11-15T14:29:07.929 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:07.956 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:07 +0000 (0:00:00.034) 0:00:48.389 ******* 2021-11-15T14:29:07.977 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-15T14:29:07.978 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.003 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.046) 0:00:48.436 ******* 2021-11-15T14:29:08.011 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T14:29:08.013 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => { "msg": "Host gibba038.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-15T14:29:08.040 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.036) 0:00:48.472 ******* 2021-11-15T14:29:08.048 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-15T14:29:08.050 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.035) 0:00:48.508 ******* 2021-11-15T14:29:08.084 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T14:29:08.086 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.113 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.036) 0:00:48.545 ******* 2021-11-15T14:29:08.120 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T14:29:08.122 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-15T14:29:08.149 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.035) 0:00:48.581 ******* 2021-11-15T14:29:08.155 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T14:29:08.157 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.182 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.033) 0:00:48.614 ******* 2021-11-15T14:29:08.189 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-15T14:29:08.191 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636986547.8579223-29767-152232786481521/source", "state": "file", "uid": 0} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.219 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.036) 0:00:48.651 ******* 2021-11-15T14:29:08.241 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.022) 0:00:48.673 ******* 2021-11-15T14:29:08.248 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-15T14:29:08.250 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.275 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.034) 0:00:48.708 ******* 2021-11-15T14:29:08.297 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.020) 0:00:48.729 ******* 2021-11-15T14:29:08.305 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T14:29:08.307 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.331 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.034) 0:00:48.764 ******* 2021-11-15T14:29:08.338 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-15T14:29:08.341 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => { "msg": "Host gibba035.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.365 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.033) 0:00:48.797 ******* 2021-11-15T14:29:08.389 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.023) 0:00:48.821 ******* 2021-11-15T14:29:08.396 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-15T14:29:08.398 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.426 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.037) 0:00:48.858 ******* 2021-11-15T14:29:08.433 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-15T14:29:08.434 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.033) 0:00:48.891 ******* 2021-11-15T14:29:08.485 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.025) 0:00:48.917 ******* 2021-11-15T14:29:08.491 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-15T14:29:08.493 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.519 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.034) 0:00:48.951 ******* 2021-11-15T14:29:08.542 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.022) 0:00:48.974 ******* 2021-11-15T14:29:08.547 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-15T14:29:08.549 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.574 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.032) 0:00:49.007 ******* 2021-11-15T14:29:08.597 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.022) 0:00:49.030 ******* 2021-11-15T14:29:08.604 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-15T14:29:08.605 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.630 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.032) 0:00:49.063 ******* 2021-11-15T14:29:08.652 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.021) 0:00:49.085 ******* 2021-11-15T14:29:08.658 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-15T14:29:08.660 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.684 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.032) 0:00:49.117 ******* 2021-11-15T14:29:08.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.022) 0:00:49.139 ******* 2021-11-15T14:29:08.715 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-15T14:29:08.717 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.742 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.034) 0:00:49.174 ******* 2021-11-15T14:29:08.749 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T14:29:08.751 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.782 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.040) 0:00:49.214 ******* 2021-11-15T14:29:08.789 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T14:29:08.791 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba032.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:08.792 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:08.818 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.036) 0:00:49.251 ******* 2021-11-15T14:29:08.841 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.022) 0:00:49.274 ******* 2021-11-15T14:29:08.849 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-15T14:29:08.851 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.876 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.034) 0:00:49.308 ******* 2021-11-15T14:29:08.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.020) 0:00:49.329 ******* 2021-11-15T14:29:08.903 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-15T14:29:08.905 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.930 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.033) 0:00:49.362 ******* 2021-11-15T14:29:08.936 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.938 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.963 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.032) 0:00:49.395 ******* 2021-11-15T14:29:08.985 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:08 +0000 (0:00:00.021) 0:00:49.417 ******* 2021-11-15T14:29:08.992 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-15T14:29:08.993 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:08.993 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T14:29:08.994 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.020 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.035) 0:00:49.453 ******* 2021-11-15T14:29:09.045 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.024) 0:00:49.477 ******* 2021-11-15T14:29:09.055 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.083 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.038) 0:00:49.515 ******* 2021-11-15T14:29:09.102 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-15T14:29:09.104 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.128 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.045) 0:00:49.561 ******* 2021-11-15T14:29:09.137 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-15T14:29:09.139 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.169 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.040) 0:00:49.601 ******* 2021-11-15T14:29:09.176 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-15T14:29:09.178 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.210 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.040) 0:00:49.642 ******* 2021-11-15T14:29:09.217 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-15T14:29:09.219 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:09.244 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.034) 0:00:49.677 ******* 2021-11-15T14:29:09.251 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-15T14:29:09.253 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba038.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:09.279 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.034) 0:00:49.711 ******* 2021-11-15T14:29:09.303 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.023) 0:00:49.735 ******* 2021-11-15T14:29:09.310 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-15T14:29:09.311 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.034) 0:00:49.770 ******* 2021-11-15T14:29:09.359 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.022) 0:00:49.792 ******* 2021-11-15T14:29:09.366 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-15T14:29:09.368 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.397 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.037) 0:00:49.829 ******* 2021-11-15T14:29:09.419 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.022) 0:00:49.851 ******* 2021-11-15T14:29:09.426 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-15T14:29:09.428 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:09.453 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.033) 0:00:49.885 ******* 2021-11-15T14:29:09.460 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-15T14:29:09.462 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.487 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.034) 0:00:49.919 ******* 2021-11-15T14:29:09.623 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-15T14:29:09.625 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.161) 0:00:50.081 ******* 2021-11-15T14:29:09.666 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T14:29:09.668 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.695 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.046) 0:00:50.128 ******* 2021-11-15T14:29:09.703 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T14:29:09.705 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.172) 0:00:50.301 ******* 2021-11-15T14:29:09.876 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-15T14:29:09.877 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.903 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.034) 0:00:50.335 ******* 2021-11-15T14:29:09.926 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.023) 0:00:50.358 ******* 2021-11-15T14:29:09.933 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-15T14:29:09.935 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:09.961 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.035) 0:00:50.394 ******* 2021-11-15T14:29:09.984 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:09 +0000 (0:00:00.022) 0:00:50.416 ******* 2021-11-15T14:29:09.991 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T14:29:09.993 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.017 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.449 ******* 2021-11-15T14:29:10.026 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-15T14:29:10.028 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.029 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.050) 0:00:50.500 ******* 2021-11-15T14:29:10.097 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.029) 0:00:50.529 ******* 2021-11-15T14:29:10.104 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-15T14:29:10.105 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.130 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.563 ******* 2021-11-15T14:29:10.137 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T14:29:10.139 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.164 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.596 ******* 2021-11-15T14:29:10.171 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T14:29:10.173 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.630 ******* 2021-11-15T14:29:10.204 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-15T14:29:10.206 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.231 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.663 ******* 2021-11-15T14:29:10.262 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.030) 0:00:50.694 ******* 2021-11-15T14:29:10.268 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-15T14:29:10.270 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.296 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.728 ******* 2021-11-15T14:29:10.318 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.022) 0:00:50.750 ******* 2021-11-15T14:29:10.326 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-15T14:29:10.328 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.353 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:50.785 ******* 2021-11-15T14:29:10.375 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.022) 0:00:50.807 ******* 2021-11-15T14:29:10.381 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T14:29:10.383 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.033) 0:00:50.841 ******* 2021-11-15T14:29:10.415 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T14:29:10.417 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the releasever] ********************************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.442 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:50.875 ******* 2021-11-15T14:29:10.464 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.021) 0:00:50.896 ******* 2021-11-15T14:29:10.471 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T14:29:10.473 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.499 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:50.931 ******* 2021-11-15T14:29:10.506 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-15T14:29:10.508 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.533 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:50.965 ******* 2021-11-15T14:29:10.540 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-15T14:29:10.542 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.568 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:51.000 ******* 2021-11-15T14:29:10.590 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.021) 0:00:51.022 ******* 2021-11-15T14:29:10.597 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T14:29:10.599 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.631 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.041) 0:00:51.063 ******* 2021-11-15T14:29:10.638 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-15T14:29:10.640 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.666 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:51.098 ******* 2021-11-15T14:29:10.688 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.022) 0:00:51.120 ******* 2021-11-15T14:29:10.696 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-15T14:29:10.698 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.724 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.035) 0:00:51.156 ******* 2021-11-15T14:29:10.746 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.021) 0:00:51.178 ******* 2021-11-15T14:29:10.753 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-15T14:29:10.754 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.780 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:51.212 ******* 2021-11-15T14:29:10.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.021) 0:00:51.234 ******* 2021-11-15T14:29:10.809 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-15T14:29:10.811 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:10.837 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.034) 0:00:51.269 ******* 2021-11-15T14:29:10.845 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T14:29:10.846 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.872 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.035) 0:00:51.305 ******* 2021-11-15T14:29:10.878 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-15T14:29:10.879 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.912 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.039) 0:00:51.345 ******* 2021-11-15T14:29:10.933 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.020) 0:00:51.365 ******* 2021-11-15T14:29:10.940 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-15T14:29:10.942 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:10.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:10 +0000 (0:00:00.032) 0:00:51.398 ******* 2021-11-15T14:29:10.972 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-15T14:29:10.974 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:11.003 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.037) 0:00:51.435 ******* 2021-11-15T14:29:11.010 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-15T14:29:11.012 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.038 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.034) 0:00:51.470 ******* 2021-11-15T14:29:11.060 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.022) 0:00:51.493 ******* 2021-11-15T14:29:11.068 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-15T14:29:11.070 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.095 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.035) 0:00:51.528 ******* 2021-11-15T14:29:11.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.021) 0:00:51.549 ******* 2021-11-15T14:29:11.124 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-15T14:29:11.126 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.152 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.034) 0:00:51.584 ******* 2021-11-15T14:29:11.173 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.021) 0:00:51.605 ******* 2021-11-15T14:29:11.180 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-15T14:29:11.182 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.207 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.033) 0:00:51.639 ******* 2021-11-15T14:29:11.221 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-15T14:29:11.223 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.248 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.041) 0:00:51.680 ******* 2021-11-15T14:29:11.254 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T14:29:11.256 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.281 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.032) 0:00:51.713 ******* 2021-11-15T14:29:11.303 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.021) 0:00:51.735 ******* 2021-11-15T14:29:11.311 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-15T14:29:11.312 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.337 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.034) 0:00:51.770 ******* 2021-11-15T14:29:11.345 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-15T14:29:11.345 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.346 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.376 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.038) 0:00:51.808 ******* 2021-11-15T14:29:11.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.022) 0:00:51.831 ******* 2021-11-15T14:29:11.407 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-15T14:29:11.408 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:11.434 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.035) 0:00:51.866 ******* 2021-11-15T14:29:11.457 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.022) 0:00:51.889 ******* 2021-11-15T14:29:11.464 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-15T14:29:11.465 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.491 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.034) 0:00:51.923 ******* 2021-11-15T14:29:11.513 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.022) 0:00:51.945 ******* 2021-11-15T14:29:11.520 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T14:29:11.521 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.547 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.033) 0:00:51.979 ******* 2021-11-15T14:29:11.570 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.023) 0:00:52.002 ******* 2021-11-15T14:29:11.576 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T14:29:11.578 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.605 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.035) 0:00:52.038 ******* 2021-11-15T14:29:11.613 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-15T14:29:11.615 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.639 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.033) 0:00:52.072 ******* 2021-11-15T14:29:11.645 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T14:29:11.647 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.032) 0:00:52.104 ******* 2021-11-15T14:29:11.696 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.023) 0:00:52.128 ******* 2021-11-15T14:29:11.703 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba019.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.704 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.736 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.040) 0:00:52.169 ******* 2021-11-15T14:29:11.744 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-15T14:29:11.746 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.772 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.035) 0:00:52.204 ******* 2021-11-15T14:29:11.800 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.028) 0:00:52.232 ******* 2021-11-15T14:29:11.807 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-15T14:29:11.809 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.835 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.034) 0:00:52.267 ******* 2021-11-15T14:29:11.861 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.026) 0:00:52.293 ******* 2021-11-15T14:29:11.867 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T14:29:11.869 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.871 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:11.896 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.035) 0:00:52.329 ******* 2021-11-15T14:29:11.920 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.023) 0:00:52.352 ******* 2021-11-15T14:29:11.937 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-15T14:29:11.939 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:11.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:11 +0000 (0:00:00.045) 0:00:52.397 ******* 2021-11-15T14:29:11.983 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T14:29:11.986 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.010 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.045) 0:00:52.442 ******* 2021-11-15T14:29:12.017 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T14:29:12.019 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010673", "end": "2021-11-15 14:29:12.222933", "rc": 0, "start": "2021-11-15 14:29:12.212260", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T14:29:12.044 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.034) 0:00:52.477 ******* 2021-11-15T14:29:12.066 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.021) 0:00:52.498 ******* 2021-11-15T14:29:12.073 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-15T14:29:12.075 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.100 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.033) 0:00:52.532 ******* 2021-11-15T14:29:12.107 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T14:29:12.109 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.142 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.041) 0:00:52.574 ******* 2021-11-15T14:29:12.148 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T14:29:12.150 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.176 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.034) 0:00:52.608 ******* 2021-11-15T14:29:12.199 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.023) 0:00:52.631 ******* 2021-11-15T14:29:12.207 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-15T14:29:12.209 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.234 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.035) 0:00:52.667 ******* 2021-11-15T14:29:12.252 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T14:29:12.253 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.278 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.043) 0:00:52.711 ******* 2021-11-15T14:29:12.375 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 14:29:12 +0000 (0:00:00.033) 0:00:52.744 ******* TASK [common : Get the current timezone] *************************************** ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.011548", "end": "2021-11-15 14:29:12.444777", "rc": 0, "start": "2021-11-15 14:29:12.433229", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Monday 15 November 2021 14:29:12 +0000 (0:00:00.034) 0:00:52.779 ******* Monday 15 November 2021 14:29:12 +0000 (0:00:00.022) 0:00:52.802 ******* 2021-11-15T14:29:12.389 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T14:29:12.391 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.401 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.430 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.060) 0:00:52.862 ******* 2021-11-15T14:29:12.436 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T14:29:12.438 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.461 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.031) 0:00:52.894 ******* 2021-11-15T14:29:12.468 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-15T14:29:12.470 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.495 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.033) 0:00:52.927 ******* 2021-11-15T14:29:12.514 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T14:29:12.516 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.541 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.045) 0:00:52.973 ******* 2021-11-15T14:29:12.547 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T14:29:12.550 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.582 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.040) 0:00:53.014 ******* 2021-11-15T14:29:12.590 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-15T14:29:12.592 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.617 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.036) 0:00:53.050 ******* 2021-11-15T14:29:12.624 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T14:29:12.626 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.652 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.034) 0:00:53.084 ******* 2021-11-15T14:29:12.681 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-15T14:29:12.683 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.055) 0:00:53.140 ******* 2021-11-15T14:29:12.788 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-15T14:29:12.789 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.799 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.824 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.116) 0:00:53.256 ******* 2021-11-15T14:29:12.831 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:12.832 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.007308", "end": "2021-11-15 14:29:13.160216", "rc": 0, "start": "2021-11-15 14:29:13.152908", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T14:29:12.857 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.033) 0:00:53.289 ******* 2021-11-15T14:29:12.895 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-15T14:29:12.897 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.921 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.064) 0:00:53.354 ******* 2021-11-15T14:29:12.929 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:12.930 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-15T14:29:12.932 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:12.932 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:12.932 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-15T14:29:12.959 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:12 +0000 (0:00:00.037) 0:00:53.391 ******* 2021-11-15T14:29:12.998 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-15T14:29:12.999 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.032 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.072) 0:00:53.464 ******* 2021-11-15T14:29:13.039 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T14:29:13.041 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.069 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.036) 0:00:53.501 ******* 2021-11-15T14:29:13.076 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.078 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.079 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "ye 2021-11-15T14:29:13.080 INFO:teuthology.task.ansible.out:s", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.177 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.178 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.190 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:13.191 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012006", "end": "2021-11-15 14:29:13.321378", "rc": 0, "start": "2021-11-15 14:29:13.309372", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-15T14:29:13.214 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.145) 0:00:53.646 ******* 2021-11-15T14:29:13.272 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.274 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-11-15T14:29:13.295 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.299 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.302 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-15T14:29:13.304 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.109) 0:00:53.756 ******* 2021-11-15T14:29:13.346 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.021) 0:00:53.778 ******* 2021-11-15T14:29:13.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.023) 0:00:53.802 ******* 2021-11-15T14:29:13.388 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:13.390 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [gibba038.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.415 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.045) 0:00:53.848 ******* 2021-11-15T14:29:13.422 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:13.424 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.448 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.032) 0:00:53.880 ******* 2021-11-15T14:29:13.455 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-15T14:29:13.456 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.481 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.032) 0:00:53.913 ******* 2021-11-15T14:29:13.487 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-15T14:29:13.489 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.514 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.033) 0:00:53.947 ******* 2021-11-15T14:29:13.521 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.522 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.523 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.033) 0:00:53.981 ******* 2021-11-15T14:29:13.576 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-15T14:29:13.578 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.600 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.052) 0:00:54.033 ******* 2021-11-15T14:29:13.618 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.620 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.632 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-15T14:29:13.634 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.656 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.055) 0:00:54.088 ******* 2021-11-15T14:29:13.685 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.029) 0:00:54.117 ******* 2021-11-15T14:29:13.692 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-15T14:29:13.694 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.719 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.033) 0:00:54.151 ******* 2021-11-15T14:29:13.727 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.727 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-15T14:29:13.739 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-15T14:29:13.741 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.764 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.045) 0:00:54.196 ******* 2021-11-15T14:29:13.771 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:13.773 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.798 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.033) 0:00:54.230 ******* 2021-11-15T14:29:13.804 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T14:29:13.805 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.831 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.033) 0:00:54.263 ******* 2021-11-15T14:29:13.838 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.839 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.840 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.034) 0:00:54.298 ******* 2021-11-15T14:29:13.872 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-15T14:29:13.874 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.898 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.032) 0:00:54.330 ******* 2021-11-15T14:29:13.956 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:13.958 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:13.968 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:13.993 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:13 +0000 (0:00:00.095) 0:00:54.425 ******* 2021-11-15T14:29:14.062 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.086 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.093) 0:00:54.518 ******* 2021-11-15T14:29:14.093 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-15T14:29:14.095 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-15T14:29:14.123 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.036) 0:00:54.555 ******* 2021-11-15T14:29:14.151 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T14:29:14.152 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.052) 0:00:54.607 ******* 2021-11-15T14:29:14.192 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-15T14:29:14.194 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.226 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.050) 0:00:54.658 ******* 2021-11-15T14:29:14.287 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-15T14:29:14.289 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.310 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.084) 0:00:54.743 ******* 2021-11-15T14:29:14.317 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-15T14:29:14.319 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.370112", "end": "2021-11-15 14:29:14.500923", "rc": 0, "start": "2021-11-15 14:29:14.130811", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:14.348 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.037) 0:00:54.780 ******* 2021-11-15T14:29:14.408 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-15T14:29:14.410 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.434 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.085) 0:00:54.866 ******* 2021-11-15T14:29:14.441 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T14:29:14.443 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.468 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.034) 0:00:54.901 ******* 2021-11-15T14:29:14.497 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-15T14:29:14.498 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.523 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.054) 0:00:54.955 ******* 2021-11-15T14:29:14.592 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-15T14:29:14.594 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:14.616 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.093) 0:00:55.049 ******* 2021-11-15T14:29:14.768 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-15T14:29:14.770 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.142836", "end": "2021-11-15 14:29:14.960805", "rc": 0, "start": "2021-11-15 14:29:14.817969", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:14.795 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:14 +0000 (0:00:00.178) 0:00:55.227 ******* 2021-11-15T14:29:15.146 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-15T14:29:15.148 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.877624", "end": "2021-11-15 14:29:15.500941", "rc": 0, "start": "2021-11-15 14:29:14.623317", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.171 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.375) 0:00:55.603 ******* 2021-11-15T14:29:15.251 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T14:29:15.253 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:15.274 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.103) 0:00:55.706 ******* 2021-11-15T14:29:15.363 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-15T14:29:15.365 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.392128", "end": "2021-11-15 14:29:15.502319", "rc": 0, "start": "2021-11-15 14:29:14.110191", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.125) 0:00:55.832 ******* 2021-11-15T14:29:15.410 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.663950", "end": "2021-11-15 14:29:15.500948", "rc": 0, "start": "2021-11-15 14:29:14.836998", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.441 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.041) 0:00:55.873 ******* 2021-11-15T14:29:15.470 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-15T14:29:15.472 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:15.496 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.054) 0:00:55.928 ******* 2021-11-15T14:29:15.514 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:15.539 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.043) 0:00:55.972 ******* 2021-11-15T14:29:15.557 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-15T14:29:15.558 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.132418", "end": "2021-11-15 14:29:15.913013", "rc": 0, "start": "2021-11-15 14:29:15.780595", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.583 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.043) 0:00:56.016 ******* 2021-11-15T14:29:15.768 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.110143", "end": "2021-11-15 14:29:15.894686", "rc": 0, "start": "2021-11-15 14:29:15.784543", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.792 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.208) 0:00:56.224 ******* 2021-11-15T14:29:15.860 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.164065", "end": "2021-11-15 14:29:15.968964", "rc": 0, "start": "2021-11-15 14:29:15.804899", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:15.884 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:15 +0000 (0:00:00.092) 0:00:56.316 ******* 2021-11-15T14:29:18.557 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-15T14:29:18.558 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:29:18.581 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:18 +0000 (0:00:02.696) 0:00:59.013 ******* 2021-11-15T14:29:18.692 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:18.718 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:18 +0000 (0:00:00.137) 0:00:59.150 ******* 2021-11-15T14:29:18.976 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.001 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:18 +0000 (0:00:00.283) 0:00:59.433 ******* 2021-11-15T14:29:19.050 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.074) 0:00:59.508 ******* 2021-11-15T14:29:19.083 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T14:29:19.085 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.111 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.034) 0:00:59.543 ******* 2021-11-15T14:29:19.182 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:19.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.094) 0:00:59.638 ******* 2021-11-15T14:29:19.223 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T14:29:19.225 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.250 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.044) 0:00:59.682 ******* 2021-11-15T14:29:19.323 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:19.348 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.097) 0:00:59.780 ******* 2021-11-15T14:29:19.501 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T14:29:19.503 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T14:29:19.527 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.179) 0:00:59.959 ******* 2021-11-15T14:29:19.534 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-15T14:29:19.536 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.569 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.042) 0:01:00.002 ******* 2021-11-15T14:29:19.579 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:19.607 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.037) 0:01:00.039 ******* 2021-11-15T14:29:19.635 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-15T14:29:19.636 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:19.660 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.053) 0:01:00.093 ******* 2021-11-15T14:29:19.677 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T14:29:19.679 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:19.705 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.044) 0:01:00.137 ******* 2021-11-15T14:29:19.727 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.022) 0:01:00.160 ******* 2021-11-15T14:29:19.943 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-15T14:29:19.945 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T14:29:19.970 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:19 +0000 (0:00:00.242) 0:01:00.402 ******* 2021-11-15T14:29:20.009 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-15T14:29:20.035 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.065) 0:01:00.468 ******* 2021-11-15T14:29:20.064 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T14:29:20.066 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:29:20.090 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.054) 0:01:00.522 ******* 2021-11-15T14:29:20.212 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:20.238 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.147) 0:01:00.670 ******* 2021-11-15T14:29:20.433 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T14:29:20.434 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T14:29:20.444 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-15T14:29:20.446 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:20.469 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.231) 0:01:00.901 ******* 2021-11-15T14:29:20.527 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:20.529 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba038.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T14:29:20.553 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.084) 0:01:00.985 ******* 2021-11-15T14:29:20.675 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T14:29:20.791 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T14:29:20.823 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T14:29:20.877 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-15T14:29:20.899 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T14:29:20.931 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:20 +0000 (0:00:00.377) 0:01:01.363 ******* 2021-11-15T14:29:21.013 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T14:29:21.041 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.110) 0:01:01.473 ******* 2021-11-15T14:29:21.058 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-15T14:29:21.070 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T14:29:21.072 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:29:21.096 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.055) 0:01:01.529 ******* 2021-11-15T14:29:21.175 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T14:29:21.177 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} TASK [common : Create /usr/libexec.] ******************************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:29:21.202 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.105) 0:01:01.634 ******* 2021-11-15T14:29:21.252 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-15T14:29:21.254 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T14:29:21.279 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.077) 0:01:01.712 ******* 2021-11-15T14:29:21.371 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:21.373 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T14:29:21.393 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T14:29:21.395 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba032.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-15T14:29:21.421 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.141) 0:01:01.853 ******* 2021-11-15T14:29:21.442 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.021) 0:01:01.874 ******* 2021-11-15T14:29:21.491 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:21.492 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T14:29:21.534 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-15T14:29:21.536 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:29:21.560 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.117) 0:01:01.992 ******* 2021-11-15T14:29:21.577 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:21.579 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T14:29:21.706 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T14:29:21.729 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T14:29:21.793 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T14:29:21.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.307) 0:01:02.300 ******* 2021-11-15T14:29:21.876 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-15T14:29:21.899 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T14:29:21.901 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:21.924 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.056) 0:01:02.356 ******* 2021-11-15T14:29:21.931 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:21.932 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T14:29:21.943 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T14:29:21.969 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:21 +0000 (0:00:00.045) 0:01:02.401 ******* 2021-11-15T14:29:21.976 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T14:29:21.978 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:22.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.037) 0:01:02.438 ******* 2021-11-15T14:29:22.017 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T14:29:22.018 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:22.046 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.039) 0:01:02.478 ******* 2021-11-15T14:29:22.054 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T14:29:22.056 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.056 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.069 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.070 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.072 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:22.073 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-15T14:29:22.101 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.055) 0:01:02.533 ******* 2021-11-15T14:29:22.107 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T14:29:22.109 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:22.134 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.032) 0:01:02.566 ******* 2021-11-15T14:29:22.141 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T14:29:22.143 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.167 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.033) 0:01:02.600 ******* 2021-11-15T14:29:22.175 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:22.177 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T14:29:22.179 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T14:29:22.181 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.211 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.043) 0:01:02.644 ******* 2021-11-15T14:29:22.219 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.220 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.248 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.036) 0:01:02.680 ******* 2021-11-15T14:29:22.255 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T14:29:22.257 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:22.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.034) 0:01:02.715 ******* 2021-11-15T14:29:22.289 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-15T14:29:22.290 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-15T14:29:22.293 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.318 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.035) 0:01:02.750 ******* 2021-11-15T14:29:22.342 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.024) 0:01:02.775 ******* 2021-11-15T14:29:22.349 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T14:29:22.351 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:22.377 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.034) 0:01:02.809 ******* 2021-11-15T14:29:22.383 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-15T14:29:22.385 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:22.410 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.033) 0:01:02.842 ******* 2021-11-15T14:29:22.422 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T14:29:22.422 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.434 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.436 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.050) 0:01:02.893 ******* 2021-11-15T14:29:22.467 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-15T14:29:22.469 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:22.494 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.033) 0:01:02.926 ******* 2021-11-15T14:29:22.501 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T14:29:22.502 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.528 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.034) 0:01:02.961 ******* 2021-11-15T14:29:22.537 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-15T14:29:22.539 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.550 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.552 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.049) 0:01:03.010 ******* 2021-11-15T14:29:22.606 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-15T14:29:22.608 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:22.631 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.053) 0:01:03.063 ******* 2021-11-15T14:29:22.639 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T14:29:22.641 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:29:22.676 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.044) 0:01:03.108 ******* 2021-11-15T14:29:22.788 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:22.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.140) 0:01:03.248 ******* 2021-11-15T14:29:22.909 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T14:29:22.911 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T14:29:22.935 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:22 +0000 (0:00:00.119) 0:01:03.368 ******* 2021-11-15T14:29:22.984 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T14:29:22.986 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:23.011 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.075) 0:01:03.443 ******* 2021-11-15T14:29:23.060 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T14:29:23.062 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T14:29:23.092 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.081) 0:01:03.524 ******* 2021-11-15T14:29:23.098 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-15T14:29:23.100 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:23.126 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.034) 0:01:03.559 ******* 2021-11-15T14:29:23.207 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T14:29:23.209 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T14:29:23.240 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.113) 0:01:03.673 ******* 2021-11-15T14:29:23.247 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T14:29:23.249 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T14:29:23.276 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.035) 0:01:03.708 ******* 2021-11-15T14:29:23.361 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T14:29:23.363 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T14:29:23.364 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba019.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T14:29:23.391 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.115) 0:01:03.823 ******* 2021-11-15T14:29:23.398 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-15T14:29:23.399 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-15T14:29:23.425 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.034) 0:01:03.858 ******* 2021-11-15T14:29:23.444 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T14:29:23.446 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T14:29:23.476 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.050) 0:01:03.909 ******* 2021-11-15T14:29:23.506 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T14:29:23.508 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:23.531 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.054) 0:01:03.963 ******* 2021-11-15T14:29:23.538 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T14:29:23.540 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T14:29:23.550 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T14:29:23.551 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T14:29:23.585 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.054) 0:01:04.017 ******* 2021-11-15T14:29:23.593 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T14:29:23.595 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:23.619 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.033) 0:01:04.051 ******* 2021-11-15T14:29:23.629 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T14:29:23.631 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T14:29:23.659 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.039) 0:01:04.091 ******* 2021-11-15T14:29:23.677 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-15T14:29:23.678 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:23.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.042) 0:01:04.133 ******* 2021-11-15T14:29:23.709 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T14:29:23.710 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:23.711 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba035.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T14:29:23.712 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-15T14:29:23.712 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-15T14:29:23.739 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.037) 0:01:04.171 ******* 2021-11-15T14:29:23.763 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.024) 0:01:04.195 ******* 2021-11-15T14:29:23.803 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T14:29:23.805 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:23.827 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.064) 0:01:04.260 ******* 2021-11-15T14:29:23.834 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-15T14:29:23.836 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T14:29:23.862 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.035) 0:01:04.295 ******* 2021-11-15T14:29:23.869 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-15T14:29:23.871 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:23.896 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.033) 0:01:04.328 ******* 2021-11-15T14:29:23.902 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T14:29:23.904 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba032.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-15T14:29:23.929 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.033) 0:01:04.361 ******* 2021-11-15T14:29:23.947 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T14:29:23.949 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T14:29:23.973 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:23 +0000 (0:00:00.044) 0:01:04.406 ******* 2021-11-15T14:29:23.980 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T14:29:23.982 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba032.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-15T14:29:24.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.035) 0:01:04.441 ******* 2021-11-15T14:29:24.039 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.030) 0:01:04.471 ******* 2021-11-15T14:29:24.047 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-15T14:29:24.048 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.077 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.037) 0:01:04.509 ******* 2021-11-15T14:29:24.083 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-15T14:29:24.085 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.112 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.035) 0:01:04.545 ******* 2021-11-15T14:29:24.118 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-15T14:29:24.119 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-15T14:29:24.147 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.034) 0:01:04.580 ******* 2021-11-15T14:29:24.154 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T14:29:24.156 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T14:29:24.157 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T14:29:24.158 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:09 UTC", "ActiveEnterTimestampMonotonic": "14729823", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount remote-fs.target systemd-tmpfiles-setup.service system.slice var-run.mount basic.target network.target sysinit.target nss-lookup.target time-sync.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:09 UTC", "AssertTimestampMonotonic": "14719134", "Before": "shutdown.target xdm.service multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", 2021-11-15T14:29:24.159 INFO:teuthology.task.ansible.out: "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:09 UTC", "ConditionTimestampMonotonic": "14719134", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1016", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:09 UTC", "ExecMainStartTimestampMonotonic": "14729715", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 14:27:09 UTC] ; stop_time=[n/a] ; pid=1016 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 14:27:09 UTC] ; stop_time=[n/a] ; pid=1016 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalK 2021-11-15T14:29:24.161 INFO:teuthology.task.ansible.out:illSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:09 UTC", "InactiveExitTimestampMonotonic": "14729823", "InvocationID": "c9f3634740394afc8f2135ec689743d8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "07 2021-11-15T14:29:24.161 INFO:teuthology.task.ansible.out:55", "MainPID": "1016", "MemoryAccounting": "yes", "MemoryCurrent": "1323008", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:09 UTC", "StateChangeTimestampMonotonic": 2021-11-15T14:29:24.163 INFO:teuthology.task.ansible.out: "14729823", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:29:24.188 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.040) 0:01:04.621 ******* 2021-11-15T14:29:24.210 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.021) 0:01:04.642 ******* 2021-11-15T14:29:24.216 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-15T14:29:24.218 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.247 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.036) 0:01:04.679 ******* 2021-11-15T14:29:24.273 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.026) 0:01:04.705 ******* 2021-11-15T14:29:24.280 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-15T14:29:24.282 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.307 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.034) 0:01:04.739 ******* 2021-11-15T14:29:24.336 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T14:29:24.338 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.360 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.053) 0:01:04.792 ******* 2021-11-15T14:29:24.368 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-15T14:29:24.370 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T14:29:24.402 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.041) 0:01:04.834 ******* 2021-11-15T14:29:24.410 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T14:29:24.412 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:12 UTC", "ActiveEnterTimestampMonotonic": "13330224", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target var-run.mount -.mount nss-lookup.target system.slice sysinit.target time-sync.target basic.target systemd-journald.socket remote-fs.target systemd-tmpfiles-setup.service local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:12 UTC", "AssertTimestampMonotonic": "13315034", "Before": "xdm.service shutdown.target multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:12 UTC", "Con 2021-11-15T14:29:24.414 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13315033", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "984", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:12 UTC", "ExecMainStartTimestampMonotonic": "13330113", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 14:27:12 UTC] ; stop_time=[n/a] ; pid=984 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 14:27:12 UTC] ; stop_time=[n/a] ; pid=984 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID 2021-11-15T14:29:24.415 INFO:teuthology.task.ansible.out:": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:12 UTC", "InactiveExitTimestampMonotonic": "13330224", "InvocationID": "7fbe4689994341d9b82d6be96b02dc7c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "984", "MemoryAccounting": "yes", "MemoryCurrent": "1327104", "MemoryDe 2021-11-15T14:29:24.417 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:12 UTC", "StateChangeTimestampMonotonic": "13330224", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-11-15T14:29:24.418 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.441 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.039) 0:01:04.873 ******* 2021-11-15T14:29:24.465 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.024) 0:01:04.897 ******* 2021-11-15T14:29:24.472 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T14:29:24.474 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.499 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.033) 0:01:04.931 ******* 2021-11-15T14:29:24.506 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-15T14:29:24.508 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.508 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-15T14:29:24.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.036) 0:01:04.968 ******* 2021-11-15T14:29:24.559 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.023) 0:01:04.991 ******* 2021-11-15T14:29:24.568 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T14:29:24.570 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.594 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.035) 0:01:05.027 ******* 2021-11-15T14:29:24.602 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T14:29:24.604 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:02 UTC", "ActiveEnterTimestampMonotonic": "14690911", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target sysinit.target system.slice -.mount systemd-tmpfiles-setup.service time-sync.target systemd-journald.socket basic.target network.target remote-fs.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:02 UTC", "AssertTimestampMonotonic": "14671031", "Before": "plymouth-quit.service shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:02 UTC", "Con 2021-11-15T14:29:24.605 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "14671031", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1018", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:02 UTC", "ExecMainStartTimestampMonotonic": "14690811", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 14:27:02 UTC] ; stop_time=[n/a] ; pid=1018 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 14:27:02 UTC] ; stop_time=[n/a] ; pid=1018 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-15T14:29:24.607 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:02 UTC", "InactiveExitTimestampMonotonic": "14690911", "InvocationID": "0bd92be2634441a7a3c6a8e087055520", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1018", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "Memo 2021-11-15T14:29:24.609 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:02 UTC", "StateChangeTimestampMonotonic": "14690911", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-15T14:29:24.610 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.630 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.036) 0:01:05.063 ******* 2021-11-15T14:29:24.653 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.022) 0:01:05.085 ******* 2021-11-15T14:29:24.660 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-15T14:29:24.662 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.686 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.033) 0:01:05.119 ******* 2021-11-15T14:29:24.708 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.021) 0:01:05.141 ******* 2021-11-15T14:29:24.716 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T14:29:24.718 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.720 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-15T14:29:24.720 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:20 UTC", "ActiveEnterTimestampMonotonic": "15272520", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target -.mount remote-fs.target time-sync.target systemd-tmpfiles-setup.service sysinit.target local-fs.target systemd-journald.socket var-run.mount network.target system.slice basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:20 UTC", "AssertTimestampMonotonic": "15222922", "Before": "shutdown.target multi-user.target xdm.service plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", 2021-11-15T14:29:24.722 INFO:teuthology.task.ansible.out: "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:20 UTC", "ConditionTimestampMonotonic": "15222921", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1023", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:20 UTC", "ExecMainStartTimestampMonotonic": "15272411", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-11-15 14:27:20 UTC] ; stop_time=[n/a] ; pid=1023 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-11-15 14:27:20 UTC] ; stop_time=[n/a] ; pid=1023 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalK 2021-11-15T14:29:24.723 INFO:teuthology.task.ansible.out:illSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:20 UTC", "InactiveExitTimestampMonotonic": "15272520", "InvocationID": "2e022f2263aa4fe79d30af33c382014c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "07 2021-11-15T14:29:24.725 INFO:teuthology.task.ansible.out:55", "MainPID": "1023", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:20 UTC", "StateChangeTimestampMonotonic": 2021-11-15T14:29:24.726 INFO:teuthology.task.ansible.out: "15272520", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:29:24.882 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.174) 0:01:05.315 ******* 2021-11-15T14:29:24.905 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.022) 0:01:05.338 ******* 2021-11-15T14:29:24.929 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.023) 0:01:05.361 ******* 2021-11-15T14:29:24.936 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-15T14:29:24.938 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:24.964 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.035) 0:01:05.396 ******* 2021-11-15T14:29:24.986 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:24 +0000 (0:00:00.022) 0:01:05.419 ******* 2021-11-15T14:29:25.009 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.022) 0:01:05.442 ******* 2021-11-15T14:29:25.017 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-15T14:29:25.019 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.044 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.034) 0:01:05.476 ******* 2021-11-15T14:29:25.065 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.021) 0:01:05.498 ******* 2021-11-15T14:29:25.089 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.023) 0:01:05.521 ******* 2021-11-15T14:29:25.094 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-15T14:29:25.096 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:25.097 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.122 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:05.554 ******* 2021-11-15T14:29:25.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.021) 0:01:05.576 ******* 2021-11-15T14:29:25.178 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:05.610 ******* 2021-11-15T14:29:25.184 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T14:29:25.186 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T14:29:25.188 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-15T14:29:25.190 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.218 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.040) 0:01:05.650 ******* 2021-11-15T14:29:25.240 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.022) 0:01:05.672 ******* 2021-11-15T14:29:25.264 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.023) 0:01:05.696 ******* 2021-11-15T14:29:25.270 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.271 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T14:29:25.272 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T14:29:25.273 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.298 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.034) 0:01:05.730 ******* 2021-11-15T14:29:25.319 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.021) 0:01:05.752 ******* 2021-11-15T14:29:25.348 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.028) 0:01:05.780 ******* 2021-11-15T14:29:25.354 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T14:29:25.355 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T14:29:25.356 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T14:29:25.356 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.380 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.032) 0:01:05.812 ******* 2021-11-15T14:29:25.402 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.021) 0:01:05.834 ******* 2021-11-15T14:29:25.424 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.022) 0:01:05.857 ******* 2021-11-15T14:29:25.430 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-15T14:29:25.432 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.456 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.032) 0:01:05.889 ******* 2021-11-15T14:29:25.479 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.022) 0:01:05.911 ******* 2021-11-15T14:29:25.485 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.487 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.512 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.032) 0:01:05.944 ******* 2021-11-15T14:29:25.545 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:05.978 ******* 2021-11-15T14:29:25.572 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.026) 0:01:06.004 ******* 2021-11-15T14:29:25.578 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-15T14:29:25.580 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.605 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.032) 0:01:06.037 ******* 2021-11-15T14:29:25.611 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T14:29:25.613 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.636 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.031) 0:01:06.069 ******* 2021-11-15T14:29:25.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.020) 0:01:06.089 ******* 2021-11-15T14:29:25.663 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-15T14:29:25.665 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T14:29:25.665 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.689 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.031) 0:01:06.121 ******* 2021-11-15T14:29:25.708 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.019) 0:01:06.141 ******* 2021-11-15T14:29:25.728 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.019) 0:01:06.160 ******* 2021-11-15T14:29:25.735 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T14:29:25.736 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T14:29:25.737 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:25.759 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.031) 0:01:06.192 ******* 2021-11-15T14:29:25.779 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.019) 0:01:06.212 ******* 2021-11-15T14:29:25.800 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.020) 0:01:06.232 ******* 2021-11-15T14:29:25.808 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-15T14:29:25.809 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.811 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T14:29:25.835 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.035) 0:01:06.268 ******* 2021-11-15T14:29:25.864 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.028) 0:01:06.296 ******* 2021-11-15T14:29:25.872 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T14:29:25.874 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:06.330 ******* 2021-11-15T14:29:25.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.024) 0:01:06.355 ******* 2021-11-15T14:29:25.930 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-15T14:29:25.932 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:25.955 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:06.388 ******* 2021-11-15T14:29:25.962 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T14:29:25.963 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T14:29:25.965 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T14:29:25.965 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T14:29:25.989 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:25 +0000 (0:00:00.033) 0:01:06.421 ******* 2021-11-15T14:29:26.011 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.021) 0:01:06.443 ******* 2021-11-15T14:29:26.035 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.024) 0:01:06.467 ******* 2021-11-15T14:29:26.042 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-15T14:29:26.044 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.072 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.037) 0:01:06.504 ******* 2021-11-15T14:29:26.081 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-15T14:29:26.083 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T14:29:26.083 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T14:29:26.112 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.040) 0:01:06.545 ******* 2021-11-15T14:29:26.135 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.022) 0:01:06.568 ******* 2021-11-15T14:29:26.143 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-15T14:29:26.144 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-15T14:29:26.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.036) 0:01:06.604 ******* 2021-11-15T14:29:26.180 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-15T14:29:26.181 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T14:29:26.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.036) 0:01:06.641 ******* 2021-11-15T14:29:26.215 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-15T14:29:26.217 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-15T14:29:26.219 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T14:29:26.249 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.040) 0:01:06.681 ******* 2021-11-15T14:29:26.272 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.023) 0:01:06.704 ******* 2021-11-15T14:29:26.280 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-15T14:29:26.282 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T14:29:26.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.036) 0:01:06.740 ******* 2021-11-15T14:29:26.315 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T14:29:26.317 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Including major version specific variables.] ****************** ok: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-15T14:29:26.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.037) 0:01:06.778 ******* 2021-11-15T14:29:26.368 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.022) 0:01:06.800 ******* 2021-11-15T14:29:26.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-15T14:29:26.377 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T14:29:26.402 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.034) 0:01:06.835 ******* 2021-11-15T14:29:26.409 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T14:29:26.411 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba019"}, "changed": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Including version specific variables.] ************************ ok: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-15T14:29:26.437 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.034) 0:01:06.869 ******* 2021-11-15T14:29:26.458 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.021) 0:01:06.891 ******* 2021-11-15T14:29:26.482 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.023) 0:01:06.914 ******* 2021-11-15T14:29:26.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-15T14:29:26.491 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.517 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.035) 0:01:06.949 ******* 2021-11-15T14:29:26.544 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T14:29:26.546 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.568 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.050) 0:01:07.000 ******* 2021-11-15T14:29:26.574 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-15T14:29:26.576 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-15T14:29:26.600 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.032) 0:01:07.032 ******* 2021-11-15T14:29:26.606 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-15T14:29:26.608 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T14:29:26.643 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.042) 0:01:07.075 ******* 2021-11-15T14:29:26.683 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-15T14:29:26.685 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.064) 0:01:07.140 ******* 2021-11-15T14:29:26.714 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T14:29:26.715 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-15T14:29:26.741 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.034) 0:01:07.174 ******* 2021-11-15T14:29:26.764 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.022) 0:01:07.196 ******* 2021-11-15T14:29:26.777 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T14:29:26.778 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.803 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.039) 0:01:07.236 ******* 2021-11-15T14:29:26.810 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-15T14:29:26.811 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.836 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.032) 0:01:07.269 ******* 2021-11-15T14:29:26.863 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-15T14:29:26.865 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:26.887 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.050) 0:01:07.319 ******* 2021-11-15T14:29:26.925 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-15T14:29:26.927 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T14:29:26.951 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:26 +0000 (0:00:00.064) 0:01:07.384 ******* 2021-11-15T14:29:27.010 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-15T14:29:27.035 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.084) 0:01:07.468 ******* 2021-11-15T14:29:27.052 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T14:29:27.053 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T14:29:27.078 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.042) 0:01:07.510 ******* 2021-11-15T14:29:27.085 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T14:29:27.086 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba019.front.sepia.ceph.com", "ansible_hostname": "gibba019", "ansible_nodename": "gibba019"}, "changed": true, "name": "gibba019"} 2021-11-15T14:29:27.110 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.032) 0:01:07.542 ******* 2021-11-15T14:29:27.116 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T14:29:27.118 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba032"}, "changed": false} 2021-11-15T14:29:27.142 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.031) 0:01:07.574 ******* 2021-11-15T14:29:27.283 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-15T14:29:27.284 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-15T14:29:27.317 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.174) 0:01:07.749 ******* 2021-11-15T14:29:27.355 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T14:29:27.357 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba038"}, "changed": false} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T14:29:27.357 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T14:29:27.381 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.064) 0:01:07.813 ******* 2021-11-15T14:29:27.405 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.023) 0:01:07.837 ******* 2021-11-15T14:29:27.429 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.023) 0:01:07.861 ******* 2021-11-15T14:29:27.435 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T14:29:27.437 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba032.front.sepia.ceph.com", "ansible_hostname": "gibba032", "ansible_nodename": "gibba032"}, "changed": true, "name": "gibba032"} 2021-11-15T14:29:27.462 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.033) 0:01:07.894 ******* 2021-11-15T14:29:27.468 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-15T14:29:27.470 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba035"}, "changed": false} 2021-11-15T14:29:27.494 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.032) 0:01:07.926 ******* 2021-11-15T14:29:27.614 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T14:29:27.616 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T14:29:27.639 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.145) 0:01:08.072 ******* 2021-11-15T14:29:27.666 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T14:29:27.668 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba038.front.sepia.ceph.com", "ansible_hostname": "gibba038", "ansible_nodename": "gibba038"}, "changed": true, "name": "gibba038"} 2021-11-15T14:29:27.691 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.051) 0:01:08.123 ******* 2021-11-15T14:29:27.697 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T14:29:27.699 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T14:29:27.722 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.031) 0:01:08.155 ******* 2021-11-15T14:29:27.760 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-15T14:29:27.761 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba035.front.sepia.ceph.com", "ansible_hostname": "gibba035", "ansible_nodename": "gibba035"}, "changed": true, "name": "gibba035"} 2021-11-15T14:29:27.785 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.062) 0:01:08.217 ******* 2021-11-15T14:29:27.937 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T14:29:27.939 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T14:29:27.961 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.176) 0:01:08.394 ******* 2021-11-15T14:29:27.967 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T14:29:27.969 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T14:29:27.995 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:27 +0000 (0:00:00.033) 0:01:08.427 ******* 2021-11-15T14:29:28.074 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-15T14:29:28.076 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-15T14:29:28.106 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.111) 0:01:08.538 ******* 2021-11-15T14:29:28.124 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T14:29:28.126 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-15T14:29:28.150 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.044) 0:01:08.583 ******* 2021-11-15T14:29:28.178 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T14:29:28.180 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.201 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.050) 0:01:08.634 ******* 2021-11-15T14:29:28.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-15T14:29:28.209 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T14:29:28.232 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:08.665 ******* 2021-11-15T14:29:28.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:29:28.239 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.264 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:08.696 ******* 2021-11-15T14:29:28.293 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.316 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.051) 0:01:08.748 ******* 2021-11-15T14:29:28.342 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:29:28.344 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-15T14:29:28.366 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.050) 0:01:08.798 ******* 2021-11-15T14:29:28.391 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.025) 0:01:08.823 ******* 2021-11-15T14:29:28.397 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T14:29:28.398 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.422 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:08.855 ******* 2021-11-15T14:29:28.449 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T14:29:28.451 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.472 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.050) 0:01:08.905 ******* 2021-11-15T14:29:28.499 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T14:29:28.500 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.521 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.048) 0:01:08.954 ******* 2021-11-15T14:29:28.547 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T14:29:28.549 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.570 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.048) 0:01:09.002 ******* 2021-11-15T14:29:28.586 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T14:29:28.588 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-15T14:29:28.616 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.045) 0:01:09.048 ******* 2021-11-15T14:29:28.622 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:29:28.623 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.647 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:09.079 ******* 2021-11-15T14:29:28.653 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T14:29:28.654 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.678 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:09.111 ******* 2021-11-15T14:29:28.684 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T14:29:28.686 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.708 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.030) 0:01:09.141 ******* 2021-11-15T14:29:28.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:29:28.715 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.738 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.029) 0:01:09.170 ******* 2021-11-15T14:29:28.743 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T14:29:28.745 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.767 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.029) 0:01:09.200 ******* 2021-11-15T14:29:28.773 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T14:29:28.774 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.796 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.028) 0:01:09.228 ******* 2021-11-15T14:29:28.802 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T14:29:28.803 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T14:29:28.827 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.030) 0:01:09.259 ******* 2021-11-15T14:29:28.850 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.022) 0:01:09.282 ******* 2021-11-15T14:29:28.856 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:29:28.858 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T14:29:28.882 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.032) 0:01:09.315 ******* 2021-11-15T14:29:28.904 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.021) 0:01:09.336 ******* 2021-11-15T14:29:28.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T14:29:28.912 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T14:29:28.936 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.031) 0:01:09.368 ******* 2021-11-15T14:29:28.962 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.026) 0:01:09.394 ******* 2021-11-15T14:29:28.968 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-15T14:29:28.970 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.970 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:28.996 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:28 +0000 (0:00:00.034) 0:01:09.428 ******* 2021-11-15T14:29:29.019 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.022) 0:01:09.451 ******* 2021-11-15T14:29:29.043 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.024) 0:01:09.475 ******* 2021-11-15T14:29:29.049 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:29:29.050 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.051 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.051 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.053 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.033) 0:01:09.509 ******* 2021-11-15T14:29:29.098 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.021) 0:01:09.530 ******* 2021-11-15T14:29:29.120 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.022) 0:01:09.552 ******* 2021-11-15T14:29:29.127 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-15T14:29:29.128 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.153 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.032) 0:01:09.585 ******* 2021-11-15T14:29:29.175 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.022) 0:01:09.608 ******* 2021-11-15T14:29:29.199 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.023) 0:01:09.631 ******* 2021-11-15T14:29:29.206 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T14:29:29.207 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.208 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.230 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.031) 0:01:09.663 ******* 2021-11-15T14:29:29.251 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:09.683 ******* 2021-11-15T14:29:29.276 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.025) 0:01:09.708 ******* 2021-11-15T14:29:29.282 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:29:29.283 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.308 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.031) 0:01:09.740 ******* 2021-11-15T14:29:29.329 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.021) 0:01:09.761 ******* 2021-11-15T14:29:29.351 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.021) 0:01:09.783 ******* 2021-11-15T14:29:29.363 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:29:29.365 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.388 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.036) 0:01:09.820 ******* 2021-11-15T14:29:29.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:09.840 ******* 2021-11-15T14:29:29.414 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T14:29:29.415 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.416 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.030) 0:01:09.871 ******* 2021-11-15T14:29:29.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.019) 0:01:09.891 ******* 2021-11-15T14:29:29.478 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.019) 0:01:09.911 ******* 2021-11-15T14:29:29.485 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T14:29:29.486 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.031) 0:01:09.942 ******* 2021-11-15T14:29:29.530 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:09.962 ******* 2021-11-15T14:29:29.536 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T14:29:29.538 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.538 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.031) 0:01:09.994 ******* 2021-11-15T14:29:29.586 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.024) 0:01:10.019 ******* 2021-11-15T14:29:29.607 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:10.039 ******* 2021-11-15T14:29:29.615 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T14:29:29.617 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T14:29:29.642 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.035) 0:01:10.075 ******* 2021-11-15T14:29:29.664 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.021) 0:01:10.097 ******* 2021-11-15T14:29:29.687 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.021) 0:01:10.119 ******* 2021-11-15T14:29:29.693 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T14:29:29.695 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T14:29:29.720 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.033) 0:01:10.152 ******* 2021-11-15T14:29:29.740 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:10.172 ******* 2021-11-15T14:29:29.761 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:10.193 ******* 2021-11-15T14:29:29.767 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T14:29:29.769 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.769 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T14:29:29.794 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.032) 0:01:10.226 ******* 2021-11-15T14:29:29.814 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.020) 0:01:10.246 ******* 2021-11-15T14:29:29.837 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.023) 0:01:10.270 ******* 2021-11-15T14:29:29.845 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T14:29:29.846 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.873 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.035) 0:01:10.305 ******* 2021-11-15T14:29:29.902 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.029) 0:01:10.334 ******* 2021-11-15T14:29:29.926 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.023) 0:01:10.358 ******* 2021-11-15T14:29:29.936 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T14:29:29.938 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.938 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.964 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.038) 0:01:10.396 ******* 2021-11-15T14:29:29.989 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:29 +0000 (0:00:00.024) 0:01:10.421 ******* 2021-11-15T14:29:29.996 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.998 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.999 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:29.999 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.025 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.036) 0:01:10.457 ******* 2021-11-15T14:29:30.049 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.023) 0:01:10.481 ******* 2021-11-15T14:29:30.073 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.024) 0:01:10.505 ******* 2021-11-15T14:29:30.080 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:29:30.082 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.107 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:10.539 ******* 2021-11-15T14:29:30.128 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:10.560 ******* 2021-11-15T14:29:30.152 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.023) 0:01:10.584 ******* 2021-11-15T14:29:30.158 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-15T14:29:30.160 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.186 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:10.618 ******* 2021-11-15T14:29:30.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.020) 0:01:10.638 ******* 2021-11-15T14:29:30.231 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.025) 0:01:10.664 ******* 2021-11-15T14:29:30.238 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T14:29:30.240 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.265 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:10.697 ******* 2021-11-15T14:29:30.289 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.023) 0:01:10.721 ******* 2021-11-15T14:29:30.312 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.022) 0:01:10.744 ******* 2021-11-15T14:29:30.317 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:29:30.319 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.345 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:10.777 ******* 2021-11-15T14:29:30.367 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:10.799 ******* 2021-11-15T14:29:30.388 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:10.820 ******* 2021-11-15T14:29:30.394 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T14:29:30.396 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.396 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.422 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.034) 0:01:10.855 ******* 2021-11-15T14:29:30.443 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.020) 0:01:10.875 ******* 2021-11-15T14:29:30.464 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.020) 0:01:10.896 ******* 2021-11-15T14:29:30.469 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-15T14:29:30.471 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.471 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-15T14:29:30.472 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.495 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.031) 0:01:10.928 ******* 2021-11-15T14:29:30.517 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:10.949 ******* 2021-11-15T14:29:30.543 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.026) 0:01:10.975 ******* 2021-11-15T14:29:30.550 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T14:29:30.551 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.577 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:11.009 ******* 2021-11-15T14:29:30.599 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:11.031 ******* 2021-11-15T14:29:30.623 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.024) 0:01:11.055 ******* 2021-11-15T14:29:30.630 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-15T14:29:30.631 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.656 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:11.089 ******* 2021-11-15T14:29:30.679 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.022) 0:01:11.111 ******* 2021-11-15T14:29:30.686 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T14:29:30.687 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T14:29:30.687 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001321", "end": "2021-11-15 14:29:30.882924", "rc": 0, "start": "2021-11-15 14:29:30.881603", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:30.689 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.712 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.033) 0:01:11.144 ******* 2021-11-15T14:29:30.734 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:11.166 ******* 2021-11-15T14:29:30.756 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.022) 0:01:11.188 ******* 2021-11-15T14:29:30.761 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-15T14:29:30.762 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T14:29:30.763 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-15T14:29:30.763 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.786 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.029) 0:01:11.218 ******* 2021-11-15T14:29:30.806 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.019) 0:01:11.238 ******* 2021-11-15T14:29:30.829 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.023) 0:01:11.262 ******* 2021-11-15T14:29:30.836 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T14:29:30.838 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.871 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.041) 0:01:11.303 ******* 2021-11-15T14:29:30.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.026) 0:01:11.330 ******* 2021-11-15T14:29:30.905 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-15T14:29:30.906 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.933 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.035) 0:01:11.365 ******* 2021-11-15T14:29:30.954 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.021) 0:01:11.386 ******* 2021-11-15T14:29:30.960 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-15T14:29:30.962 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:30.985 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:30 +0000 (0:00:00.030) 0:01:11.417 ******* 2021-11-15T14:29:31.007 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.022) 0:01:11.439 ******* 2021-11-15T14:29:31.013 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-15T14:29:31.014 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.041 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.033) 0:01:11.473 ******* 2021-11-15T14:29:31.063 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.021) 0:01:11.495 ******* 2021-11-15T14:29:31.069 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T14:29:31.071 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Install GPG keys] ********************************************* 2021-11-15T14:29:31.071 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.071 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.072 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.073 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.097 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.034) 0:01:11.529 ******* 2021-11-15T14:29:31.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.020) 0:01:11.550 ******* 2021-11-15T14:29:31.138 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.020) 0:01:11.570 ******* 2021-11-15T14:29:31.143 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-15T14:29:31.145 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.168 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.030) 0:01:11.600 ******* 2021-11-15T14:29:31.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.028) 0:01:11.629 ******* 2021-11-15T14:29:31.223 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.025) 0:01:11.655 ******* 2021-11-15T14:29:31.230 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.232 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.036) 0:01:11.692 ******* 2021-11-15T14:29:31.286 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.026) 0:01:11.719 ******* 2021-11-15T14:29:31.292 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-15T14:29:31.294 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.320 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.033) 0:01:11.752 ******* 2021-11-15T14:29:31.344 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.024) 0:01:11.777 ******* 2021-11-15T14:29:31.351 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:29:31.352 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.378 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.033) 0:01:11.810 ******* 2021-11-15T14:29:31.400 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.022) 0:01:11.832 ******* 2021-11-15T14:29:31.407 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-15T14:29:31.409 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.433 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:11.865 ******* 2021-11-15T14:29:31.455 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.022) 0:01:11.888 ******* 2021-11-15T14:29:31.465 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-15T14:29:31.467 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.491 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.035) 0:01:11.924 ******* 2021-11-15T14:29:31.496 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:29:31.498 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.522 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.030) 0:01:11.954 ******* 2021-11-15T14:29:31.529 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-15T14:29:31.530 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.034) 0:01:11.989 ******* 2021-11-15T14:29:31.563 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T14:29:31.565 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001275", "end": "2021-11-15 14:29:31.681507", "rc": 0, "start": "2021-11-15 14:29:31.680232", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.589 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.021 ******* 2021-11-15T14:29:31.610 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.021) 0:01:12.043 ******* 2021-11-15T14:29:31.617 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-15T14:29:31.619 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T14:29:31.643 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.033) 0:01:12.076 ******* 2021-11-15T14:29:31.665 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.021) 0:01:12.098 ******* 2021-11-15T14:29:31.672 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-15T14:29:31.674 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.035) 0:01:12.133 ******* 2021-11-15T14:29:31.707 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-15T14:29:31.708 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.734 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.166 ******* 2021-11-15T14:29:31.739 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-15T14:29:31.741 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.766 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.198 ******* 2021-11-15T14:29:31.772 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T14:29:31.773 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.797 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.030) 0:01:12.229 ******* 2021-11-15T14:29:31.802 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-15T14:29:31.803 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.827 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.030) 0:01:12.260 ******* 2021-11-15T14:29:31.834 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T14:29:31.836 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.860 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.293 ******* 2021-11-15T14:29:31.866 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T14:29:31.868 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T14:29:31.868 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T14:29:31.893 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.326 ******* 2021-11-15T14:29:31.920 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.026) 0:01:12.352 ******* 2021-11-15T14:29:31.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:29:31.929 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:31.953 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.032) 0:01:12.385 ******* 2021-11-15T14:29:31.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:31 +0000 (0:00:00.023) 0:01:12.409 ******* 2021-11-15T14:29:31.985 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T14:29:31.986 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.012 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.035) 0:01:12.444 ******* 2021-11-15T14:29:32.018 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.044 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.476 ******* 2021-11-15T14:29:32.049 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:29:32.051 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.076 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.508 ******* 2021-11-15T14:29:32.081 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T14:29:32.083 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.107 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.540 ******* 2021-11-15T14:29:32.114 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-15T14:29:32.116 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [gibba019.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T14:29:32.142 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.034) 0:01:12.574 ******* 2021-11-15T14:29:32.148 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:32.150 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.174 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.606 ******* 2021-11-15T14:29:32.180 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T14:29:32.181 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.207 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.032) 0:01:12.639 ******* 2021-11-15T14:29:32.215 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-15T14:29:32.216 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.242 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.035) 0:01:12.675 ******* 2021-11-15T14:29:32.250 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:32.251 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.280 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.037) 0:01:12.713 ******* 2021-11-15T14:29:32.288 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-15T14:29:32.290 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.321 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.040) 0:01:12.753 ******* 2021-11-15T14:29:32.327 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-15T14:29:32.329 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.354 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.032) 0:01:12.786 ******* 2021-11-15T14:29:32.361 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-15T14:29:32.363 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.392 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.038) 0:01:12.824 ******* 2021-11-15T14:29:32.399 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-15T14:29:32.401 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.426 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.034) 0:01:12.858 ******* 2021-11-15T14:29:32.432 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-15T14:29:32.433 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.457 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.890 ******* 2021-11-15T14:29:32.463 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-15T14:29:32.465 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.489 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.921 ******* 2021-11-15T14:29:32.495 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-15T14:29:32.496 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.522 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.032) 0:01:12.954 ******* 2021-11-15T14:29:32.528 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-15T14:29:32.529 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.554 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:12.986 ******* 2021-11-15T14:29:32.560 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-15T14:29:32.561 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.585 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.031) 0:01:13.017 ******* 2021-11-15T14:29:32.591 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-15T14:29:32.592 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.617 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.032) 0:01:13.049 ******* 2021-11-15T14:29:32.623 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-15T14:29:32.625 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.032) 0:01:13.082 ******* 2021-11-15T14:29:32.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-15T14:29:32.659 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.684 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.034) 0:01:13.117 ******* 2021-11-15T14:29:32.692 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-15T14:29:32.694 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.724 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.039) 0:01:13.157 ******* 2021-11-15T14:29:32.732 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T14:29:32.734 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T14:29:32.734 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T14:29:32.737 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-15T14:29:32.738 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.768 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.043) 0:01:13.201 ******* 2021-11-15T14:29:32.807 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.038) 0:01:13.239 ******* 2021-11-15T14:29:32.837 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T14:29:32.839 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001318", "end": "2021-11-15 14:29:33.187039", "rc": 0, "start": "2021-11-15 14:29:33.185721", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:32.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.061) 0:01:13.300 ******* 2021-11-15T14:29:32.895 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.026) 0:01:13.327 ******* 2021-11-15T14:29:32.921 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T14:29:32.945 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.050) 0:01:13.377 ******* 2021-11-15T14:29:32.972 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-15T14:29:32.974 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001365", "end": "2021-11-15 14:29:33.103200", "rc": 0, "start": "2021-11-15 14:29:33.101835", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:32.998 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:32 +0000 (0:00:00.052) 0:01:13.430 ******* 2021-11-15T14:29:33.025 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-15T14:29:33.050 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.051) 0:01:13.482 ******* 2021-11-15T14:29:33.203 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-15T14:29:33.205 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T14:29:33.229 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.178) 0:01:13.661 ******* 2021-11-15T14:29:33.255 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-15T14:29:33.257 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:33.278 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.050) 0:01:13.711 ******* 2021-11-15T14:29:33.284 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T14:29:33.286 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} TASK [testnode : Set apt preferences] ****************************************** ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-15T14:29:33.311 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.032) 0:01:13.743 ******* 2021-11-15T14:29:33.332 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.021) 0:01:13.765 ******* 2021-11-15T14:29:33.340 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T14:29:33.374 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.041) 0:01:13.806 ******* 2021-11-15T14:29:33.381 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-15T14:29:33.382 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:33.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.034) 0:01:13.841 ******* 2021-11-15T14:29:33.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T14:29:33.439 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T14:29:33.464 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.055) 0:01:13.897 ******* 2021-11-15T14:29:33.504 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T14:29:33.505 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011463", "end": "2021-11-15 14:29:33.708525", "rc": 0, "start": "2021-11-15 14:29:33.697062", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:33.530 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.065) 0:01:13.962 ******* 2021-11-15T14:29:33.916 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T14:29:33.918 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:33.941 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.411) 0:01:14.373 ******* 2021-11-15T14:29:33.978 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T14:29:34.002 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:33 +0000 (0:00:00.060) 0:01:14.434 ******* 2021-11-15T14:29:34.008 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T14:29:34.010 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T14:29:34.125 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-15T14:29:34.127 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.013259", "end": "2021-11-15 14:29:34.269945", "rc": 0, "start": "2021-11-15 14:29:34.256686", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:34.151 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:34 +0000 (0:00:00.149) 0:01:14.584 ******* 2021-11-15T14:29:34.680 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-15T14:29:34.682 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T14:29:34.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:34 +0000 (0:00:00.555) 0:01:15.139 ******* 2021-11-15T14:29:34.725 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-15T14:29:34.751 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:34 +0000 (0:00:00.044) 0:01:15.184 ******* 2021-11-15T14:29:35.056 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-15T14:29:35.058 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:29:35.086 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.335) 0:01:15.519 ******* 2021-11-15T14:29:35.146 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-15T14:29:35.148 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:35.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.085) 0:01:15.604 ******* 2021-11-15T14:29:35.190 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:35.215 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.043) 0:01:15.647 ******* 2021-11-15T14:29:35.222 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-15T14:29:35.250 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.034) 0:01:15.682 ******* 2021-11-15T14:29:35.284 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.033) 0:01:15.716 ******* 2021-11-15T14:29:35.364 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-15T14:29:35.366 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011533", "end": "2021-11-15 14:29:35.716764", "rc": 0, "start": "2021-11-15 14:29:35.705231", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:35.393 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.109) 0:01:15.825 ******* 2021-11-15T14:29:35.411 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010490", "end": "2021-11-15 14:29:35.530802", "rc": 0, "start": "2021-11-15 14:29:35.520312", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:29:35.438 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:35 +0000 (0:00:00.045) 0:01:15.870 ******* 2021-11-15T14:29:36.261 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-15T14:29:36.263 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:29:36.286 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:36 +0000 (0:00:00.847) 0:01:16.718 ******* 2021-11-15T14:29:36.975 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:29:37.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:37 +0000 (0:00:00.719) 0:01:17.438 ******* 2021-11-15T14:29:37.066 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:29:37.255 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:37 +0000 (0:00:00.249) 0:01:17.688 ******* 2021-11-15T14:29:42.730 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-15T14:29:42.732 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T14:29:42.734 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T14:29:42.736 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T14:29:42.756 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:42 +0000 (0:00:05.501) 0:01:23.189 ******* 2021-11-15T14:29:43.477 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T14:29:43.478 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T14:29:43.480 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T14:29:43.501 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:43 +0000 (0:00:00.744) 0:01:23.933 ******* 2021-11-15T14:29:44.300 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T14:29:44.302 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T14:29:44.303 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T14:29:44.326 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:44 +0000 (0:00:00.824) 0:01:24.758 ******* 2021-11-15T14:29:44.619 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-15T14:29:44.621 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-15T14:29:44.622 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-15T14:29:44.644 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:44 +0000 (0:00:00.318) 0:01:25.077 ******* 2021-11-15T14:29:57.476 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:57.478 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T14:29:57.480 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1130 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T14:29:57.482 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1130 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T14:29:57.483 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T14:29:57.502 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:57 +0000 (0:00:12.857) 0:01:37.934 ******* 2021-11-15T14:29:57.531 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T14:29:57.532 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:57.554 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:57 +0000 (0:00:00.052) 0:01:37.987 ******* 2021-11-15T14:29:57.562 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:57.563 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T14:29:57.564 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1351 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T14:29:57.566 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1351 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T14:29:57.568 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T14:29:57.593 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:57 +0000 (0:00:00.038) 0:01:38.025 ******* 2021-11-15T14:29:57.620 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:57.644 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:57 +0000 (0:00:00.050) 0:01:38.076 ******* 2021-11-15T14:29:58.434 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:58.436 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T14:29:58.438 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1229 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T14:29:58.439 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1229 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T14:29:58.441 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T14:29:58.461 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:58 +0000 (0:00:00.817) 0:01:38.894 ******* 2021-11-15T14:29:58.489 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T14:29:58.491 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:58.513 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:58 +0000 (0:00:00.052) 0:01:38.946 ******* 2021-11-15T14:29:59.502 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:29:59.504 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-15T14:29:59.506 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1233 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-15T14:29:59.507 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1233 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-15T14:29:59.509 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-15T14:29:59.527 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:59 +0000 (0:00:01.013) 0:01:39.959 ******* 2021-11-15T14:29:59.564 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-15T14:29:59.566 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:29:59.588 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:29:59 +0000 (0:00:00.060) 0:01:40.020 ******* 2021-11-15T14:30:08.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:08.302 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T14:30:08.304 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (7753 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T14:30:08.305 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T14:30:08.307 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (7753 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T14:30:08.308 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-15T14:30:08.309 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T14:30:08.334 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:08 +0000 (0:00:08.745) 0:01:48.766 ******* 2021-11-15T14:30:08.562 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T14:30:08.564 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (9455 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T14:30:08.566 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T14:30:08.567 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (9455 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T14:30:08.569 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processin 2021-11-15T14:30:08.569 INFO:teuthology.task.ansible.out:g triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T14:30:08.594 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:08 +0000 (0:00:00.261) 0:01:49.027 ******* 2021-11-15T14:30:08.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T14:30:08.770 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:08.793 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:08 +0000 (0:00:00.198) 0:01:49.225 ******* 2021-11-15T14:30:08.906 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:08.907 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T14:30:08.909 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (7620 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T14:30:08.910 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T14:30:08.912 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (7620 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T14:30:08.914 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-15T14:30:08.914 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T14:30:08.941 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:08 +0000 (0:00:00.147) 0:01:49.373 ******* 2021-11-15T14:30:09.022 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T14:30:09.024 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:09.047 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.106) 0:01:49.479 ******* 2021-11-15T14:30:09.262 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-15T14:30:09.264 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:09.288 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.241) 0:01:49.720 ******* 2021-11-15T14:30:09.358 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T14:30:09.360 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:09.384 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.095) 0:01:49.816 ******* 2021-11-15T14:30:09.402 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T14:30:09.404 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T14:30:09.442 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.058) 0:01:49.875 ******* 2021-11-15T14:30:09.477 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T14:30:09.479 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:09.500 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.058) 0:01:49.933 ******* 2021-11-15T14:30:09.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-15T14:30:09.508 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:09.534 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.033) 0:01:49.967 ******* 2021-11-15T14:30:09.628 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T14:30:09.630 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T14:30:09.660 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.125) 0:01:50.093 ******* 2021-11-15T14:30:09.669 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T14:30:09.670 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T14:30:09.706 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.045) 0:01:50.138 ******* 2021-11-15T14:30:09.736 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T14:30:09.738 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:09.765 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.058) 0:01:50.197 ******* 2021-11-15T14:30:09.890 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T14:30:09.892 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:09.916 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.151) 0:01:50.349 ******* 2021-11-15T14:30:09.940 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:09 +0000 (0:00:00.023) 0:01:50.372 ******* 2021-11-15T14:30:09.988 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T14:30:09.990 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T14:30:10.022 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.081) 0:01:50.454 ******* 2021-11-15T14:30:10.053 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T14:30:10.055 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-15T14:30:10.081 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.058) 0:01:50.513 ******* 2021-11-15T14:30:10.133 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T14:30:10.135 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.163 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.081) 0:01:50.595 ******* 2021-11-15T14:30:10.173 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-15T14:30:10.175 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T14:30:10.206 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.043) 0:01:50.639 ******* 2021-11-15T14:30:10.227 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T14:30:10.228 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T14:30:10.271 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.064) 0:01:50.703 ******* 2021-11-15T14:30:10.323 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T14:30:10.325 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-15T14:30:10.350 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.079) 0:01:50.783 ******* 2021-11-15T14:30:10.359 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-15T14:30:10.361 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:10.387 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.036) 0:01:50.819 ******* 2021-11-15T14:30:10.408 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-15T14:30:10.410 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T14:30:10.435 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.047) 0:01:50.867 ******* 2021-11-15T14:30:10.441 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:10.443 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-15T14:30:10.444 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 2s (8942 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-15T14:30:10.446 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-15T14:30:10.448 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 2s (8942 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-15T14:30:10.449 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-15T14:30:10.450 INFO:teuthology.task.ansible.out: 2021-11-15T14:30:10.478 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.043) 0:01:50.910 ******* 2021-11-15T14:30:10.589 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-15T14:30:10.592 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:10.616 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.138) 0:01:51.048 ******* 2021-11-15T14:30:10.624 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T14:30:10.626 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:29:55 UTC", "ActiveEnterTimestampMonotonic": "170700488", "ActiveExitTimestamp": "Mon 2021-11-15 14:29:55 UTC", "ActiveExitTimestampMonotonic": "170658891", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service systemd-journald.socket basic.target nss-lookup.target remote-fs.target network.target sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:29:55 UTC", "AssertTimestampMonotonic": "170689230", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:29:55 UTC", "ConditionTimestampMonotonic": "170689230", "ConfigurationDirect 2021-11-15T14:30:10.627 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6702", "ExecMainStartTimestamp": "Mon 2021-11-15 14:29:55 UTC", "ExecMainStartTimestampMonotonic": "170700479", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T14:30:10.629 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:29:55 UTC", "InactiveEnterTimestampMonotonic": "170688839", "InactiveExitTimestamp": "Mon 2021-11-15 14:29:55 UTC", "InactiveExitTimestampMonotonic": "170689924", "InvocationID": "e5786ef79b4046629436e502dc8457ca", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6702", "MemoryAccounting": "yes", "MemoryCurrent": "7131136", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T14:30:10.629 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:29:55 UTC", "StateChangeTimestampMonotonic": "170700488", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPri 2021-11-15T14:30:10.630 INFO:teuthology.task.ansible.out:ority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T14:30:10.631 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:30:10.633 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T14:30:10.634 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T14:30:10.658 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.042) 0:01:51.091 ******* 2021-11-15T14:30:10.681 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.022) 0:01:51.113 ******* 2021-11-15T14:30:10.709 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:30:10.711 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.734 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.053) 0:01:51.167 ******* 2021-11-15T14:30:10.761 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T14:30:10.763 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.785 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.050) 0:01:51.218 ******* 2021-11-15T14:30:10.812 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:30:10.814 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.842 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.057) 0:01:51.275 ******* 2021-11-15T14:30:10.850 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T14:30:10.851 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ActiveEnterTimestampMonotonic": "177787383", "ActiveExitTimestamp": "Mon 2021-11-15 14:29:56 UTC", "ActiveExitTimestampMonotonic": "177745527", "ActiveState": "active", "After": "remote-fs.target systemd-journald.socket system.slice basic.target sysinit.target nss-lookup.target network.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:29:57 UTC", "AssertTimestampMonotonic": "177776269", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ConditionTimestampMonotonic": "177776269", "ConfigurationDirect 2021-11-15T14:30:10.853 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6650", "ExecMainStartTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ExecMainStartTimestampMonotonic": "177787374", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T14:30:10.854 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:29:57 UTC", "InactiveEnterTimestampMonotonic": "177775885", "InactiveExitTimestamp": "Mon 2021-11-15 14:29:57 UTC", "InactiveExitTimestampMonotonic": "177776942", "InvocationID": "4f512eddb95040cbad43399a8eff1419", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6650", "MemoryAccounting": "yes", "MemoryCurrent": "7102464", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T14:30:10.856 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:29:57 UTC", "StateChangeTimestampMonotonic": "177787383", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T14:30:10.858 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba019.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T14:30:10.886 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.043) 0:01:51.319 ******* 2021-11-15T14:30:10.926 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.038) 0:01:51.358 ******* 2021-11-15T14:30:10.935 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-15T14:30:10.936 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-15T14:30:10.937 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:30:10.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.039) 0:01:51.397 ******* 2021-11-15T14:30:10.986 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:10 +0000 (0:00:00.020) 0:01:51.418 ******* 2021-11-15T14:30:10.992 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-15T14:30:10.994 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:10.996 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:11.020 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.034) 0:01:51.453 ******* 2021-11-15T14:30:11.043 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.021) 0:01:51.475 ******* 2021-11-15T14:30:11.066 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.023) 0:01:51.499 ******* 2021-11-15T14:30:11.073 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T14:30:11.074 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.099 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.032) 0:01:51.531 ******* 2021-11-15T14:30:11.105 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T14:30:11.107 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.130 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.563 ******* 2021-11-15T14:30:11.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T14:30:11.138 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.162 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.594 ******* 2021-11-15T14:30:11.168 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:30:11.170 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.194 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.626 ******* 2021-11-15T14:30:11.199 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T14:30:11.201 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.229 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.035) 0:01:51.661 ******* 2021-11-15T14:30:11.237 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T14:30:11.238 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:29:56 UTC", "ActiveEnterTimestampMonotonic": "180775499", "ActiveExitTimestamp": "Mon 2021-11-15 14:29:56 UTC", "ActiveExitTimestampMonotonic": "180733613", "ActiveState": "active", "After": "nss-lookup.target systemd-tmpfiles-setup.service remote-fs.target network.target system.slice sysinit.target systemd-journald.socket -.mount basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:29:56 UTC", "AssertTimestampMonotonic": "180764432", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:29:56 UTC", "ConditionTimestampMonotonic": "180764432", "ConfigurationDirect 2021-11-15T14:30:11.240 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6617", "ExecMainStartTimestamp": "Mon 2021-11-15 14:29:56 UTC", "ExecMainStartTimestampMonotonic": "180775489", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T14:30:11.241 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:29:56 UTC", "InactiveEnterTimestampMonotonic": "180764045", "InactiveExitTimestamp": "Mon 2021-11-15 14:29:56 UTC", "InactiveExitTimestampMonotonic": "180765143", "InvocationID": "a087bd6c6e55441ebff5912afe6ae56f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6617", "MemoryAccounting": "yes", "MemoryCurrent": "7200768", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T14:30:11.243 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:29:56 UTC", "StateChangeTimestampMonotonic": "180775499", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T14:30:11.245 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.264 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.034) 0:01:51.696 ******* 2021-11-15T14:30:11.285 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.020) 0:01:51.717 ******* 2021-11-15T14:30:11.291 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:11.293 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.316 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.748 ******* 2021-11-15T14:30:11.336 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.019) 0:01:51.768 ******* 2021-11-15T14:30:11.343 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T14:30:11.344 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.367 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.030) 0:01:51.799 ******* 2021-11-15T14:30:11.387 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.019) 0:01:51.819 ******* 2021-11-15T14:30:11.393 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-15T14:30:11.395 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.419 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.851 ******* 2021-11-15T14:30:11.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.020) 0:01:51.871 ******* 2021-11-15T14:30:11.445 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T14:30:11.447 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.470 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.031) 0:01:51.902 ******* 2021-11-15T14:30:11.490 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.020) 0:01:51.923 ******* 2021-11-15T14:30:11.518 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.027) 0:01:51.950 ******* 2021-11-15T14:30:11.524 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:11.526 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.550 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.032) 0:01:51.982 ******* 2021-11-15T14:30:11.571 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.020) 0:01:52.003 ******* 2021-11-15T14:30:11.577 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T14:30:11.579 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.603 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.032) 0:01:52.036 ******* 2021-11-15T14:30:11.626 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.022) 0:01:52.058 ******* 2021-11-15T14:30:11.633 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-15T14:30:11.634 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.635 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.659 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.033) 0:01:52.092 ******* 2021-11-15T14:30:11.681 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.021) 0:01:52.113 ******* 2021-11-15T14:30:11.707 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.026) 0:01:52.139 ******* 2021-11-15T14:30:11.714 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T14:30:11.715 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.740 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.033) 0:01:52.173 ******* 2021-11-15T14:30:11.762 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.021) 0:01:52.194 ******* 2021-11-15T14:30:11.783 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.020) 0:01:52.215 ******* 2021-11-15T14:30:11.789 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-15T14:30:11.791 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.032) 0:01:52.248 ******* 2021-11-15T14:30:11.844 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.028) 0:01:52.276 ******* 2021-11-15T14:30:11.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.021) 0:01:52.298 ******* 2021-11-15T14:30:11.874 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:11.875 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.901 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.035) 0:01:52.333 ******* 2021-11-15T14:30:11.928 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.026) 0:01:52.360 ******* 2021-11-15T14:30:11.949 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.021) 0:01:52.382 ******* 2021-11-15T14:30:11.956 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:11.958 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:11.982 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:11 +0000 (0:00:00.032) 0:01:52.414 ******* 2021-11-15T14:30:12.003 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.435 ******* 2021-11-15T14:30:12.010 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-15T14:30:12.012 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Remove packages] ********************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.037 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.033) 0:01:52.469 ******* 2021-11-15T14:30:12.058 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.490 ******* 2021-11-15T14:30:12.080 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.512 ******* 2021-11-15T14:30:12.088 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.089 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.114 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.034) 0:01:52.547 ******* 2021-11-15T14:30:12.136 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.568 ******* 2021-11-15T14:30:12.143 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:12.145 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.041) 0:01:52.610 ******* 2021-11-15T14:30:12.205 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.027) 0:01:52.637 ******* 2021-11-15T14:30:12.212 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T14:30:12.213 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.238 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.033) 0:01:52.670 ******* 2021-11-15T14:30:12.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.692 ******* 2021-11-15T14:30:12.267 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:30:12.269 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.293 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.032) 0:01:52.725 ******* 2021-11-15T14:30:12.315 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:52.748 ******* 2021-11-15T14:30:12.322 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T14:30:12.324 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.347 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.032) 0:01:52.780 ******* 2021-11-15T14:30:12.370 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:52.802 ******* 2021-11-15T14:30:12.377 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T14:30:12.379 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-15T14:30:12.379 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-15T14:30:12.404 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.033) 0:01:52.836 ******* 2021-11-15T14:30:12.425 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.020) 0:01:52.857 ******* 2021-11-15T14:30:12.446 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:52.878 ******* 2021-11-15T14:30:12.453 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:12.455 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.481 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.035) 0:01:52.914 ******* 2021-11-15T14:30:12.511 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.030) 0:01:52.944 ******* 2021-11-15T14:30:12.519 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:12.520 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.545 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.033) 0:01:52.977 ******* 2021-11-15T14:30:12.568 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:53.000 ******* 2021-11-15T14:30:12.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T14:30:12.575 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.576 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba035.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-15T14:30:12.577 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.602 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.034) 0:01:53.034 ******* 2021-11-15T14:30:12.623 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:53.056 ******* 2021-11-15T14:30:12.645 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:53.077 ******* 2021-11-15T14:30:12.652 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T14:30:12.654 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.035) 0:01:53.113 ******* 2021-11-15T14:30:12.703 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:53.136 ******* 2021-11-15T14:30:12.725 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:53.157 ******* 2021-11-15T14:30:12.731 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:12.733 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.758 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.033) 0:01:53.190 ******* 2021-11-15T14:30:12.779 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.021) 0:01:53.212 ******* 2021-11-15T14:30:12.786 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:12.788 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:12.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.032) 0:01:53.245 ******* 2021-11-15T14:30:12.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.025) 0:01:53.270 ******* 2021-11-15T14:30:12.861 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:53.293 ******* 2021-11-15T14:30:12.870 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.871 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.036) 0:01:53.329 ******* 2021-11-15T14:30:12.919 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.022) 0:01:53.352 ******* 2021-11-15T14:30:12.928 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:12.930 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:12.956 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.037) 0:01:53.389 ******* 2021-11-15T14:30:12.980 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:12 +0000 (0:00:00.023) 0:01:53.413 ******* 2021-11-15T14:30:12.989 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:12.991 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.017 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.037) 0:01:53.450 ******* 2021-11-15T14:30:13.026 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T14:30:13.027 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.028 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-15T14:30:13.029 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ActiveEnterTimestampMonotonic": "189331083", "ActiveExitTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ActiveExitTimestampMonotonic": "189288921", "ActiveState": "active", "After": "network.target remote-fs.target sysinit.target systemd-tmpfiles-setup.service system.slice -.mount nss-lookup.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:29:57 UTC", "AssertTimestampMonotonic": "189319324", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ConditionTimestampMonotonic": "189319323", "ConfigurationDirect 2021-11-15T14:30:13.031 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6676", "ExecMainStartTimestamp": "Mon 2021-11-15 14:29:57 UTC", "ExecMainStartTimestampMonotonic": "189331074", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-15T14:30:13.033 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:29:57 UTC", "InactiveEnterTimestampMonotonic": "189318935", "InactiveExitTimestamp": "Mon 2021-11-15 14:29:57 UTC", "InactiveExitTimestampMonotonic": "189320008", "InvocationID": "1ab9a571d0094d6a97c28ee439116ec2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6676", "MemoryAccounting": "yes", "MemoryCurrent": "7229440", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-15T14:30:13.034 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:29:57 UTC", "StateChangeTimestampMonotonic": "189331083", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-15T14:30:13.036 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:30:13.056 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.038) 0:01:53.488 ******* 2021-11-15T14:30:13.079 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.022) 0:01:53.511 ******* 2021-11-15T14:30:13.085 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-15T14:30:13.086 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T14:30:13.087 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.114 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.035) 0:01:53.546 ******* 2021-11-15T14:30:13.136 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.022) 0:01:53.568 ******* 2021-11-15T14:30:13.170 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.033) 0:01:53.602 ******* 2021-11-15T14:30:13.180 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T14:30:13.182 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.207 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.036) 0:01:53.639 ******* 2021-11-15T14:30:13.214 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-15T14:30:13.216 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.243 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.036) 0:01:53.675 ******* 2021-11-15T14:30:13.252 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:13.254 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T14:30:13.280 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.037) 0:01:53.713 ******* 2021-11-15T14:30:13.306 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.025) 0:01:53.738 ******* 2021-11-15T14:30:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-15T14:30:13.318 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.346 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.039) 0:01:53.778 ******* 2021-11-15T14:30:13.354 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T14:30:13.356 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.379 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.033) 0:01:53.812 ******* 2021-11-15T14:30:13.385 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:13.387 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.410 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.030) 0:01:53.843 ******* 2021-11-15T14:30:13.431 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.021) 0:01:53.864 ******* 2021-11-15T14:30:13.439 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:13.441 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.464 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.032) 0:01:53.896 ******* 2021-11-15T14:30:13.483 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.019) 0:01:53.916 ******* 2021-11-15T14:30:13.490 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-15T14:30:13.492 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.517 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.033) 0:01:53.949 ******* 2021-11-15T14:30:13.522 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:13.523 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.524 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:13.524 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-15T14:30:13.555 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.037) 0:01:53.987 ******* 2021-11-15T14:30:13.576 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.021) 0:01:54.009 ******* 2021-11-15T14:30:13.582 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-15T14:30:13.584 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.608 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.031) 0:01:54.040 ******* 2021-11-15T14:30:13.614 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T14:30:13.615 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.640 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.031) 0:01:54.072 ******* 2021-11-15T14:30:13.662 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.022) 0:01:54.094 ******* 2021-11-15T14:30:13.670 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-15T14:30:13.672 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.699 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.036) 0:01:54.131 ******* 2021-11-15T14:30:13.713 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:13.714 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.716 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T14:30:13.743 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.044) 0:01:54.175 ******* 2021-11-15T14:30:13.771 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.027) 0:01:54.203 ******* 2021-11-15T14:30:13.781 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-15T14:30:13.782 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.809 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.038) 0:01:54.242 ******* 2021-11-15T14:30:13.817 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-15T14:30:13.819 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.845 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.035) 0:01:54.278 ******* 2021-11-15T14:30:13.853 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.882 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.036) 0:01:54.314 ******* 2021-11-15T14:30:13.911 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:13.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-15T14:30:13.938 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.055) 0:01:54.370 ******* 2021-11-15T14:30:13.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:13 +0000 (0:00:00.034) 0:01:54.404 ******* 2021-11-15T14:30:13.979 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-15T14:30:13.980 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T14:30:14.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.034) 0:01:54.439 ******* 2021-11-15T14:30:14.013 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-15T14:30:14.015 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T14:30:14.042 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.035) 0:01:54.474 ******* 2021-11-15T14:30:14.069 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.026) 0:01:54.501 ******* 2021-11-15T14:30:14.097 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-15T14:30:14.099 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.122 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.053) 0:01:54.554 ******* 2021-11-15T14:30:14.148 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T14:30:14.150 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.172 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.049) 0:01:54.604 ******* 2021-11-15T14:30:14.198 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.200 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T14:30:14.224 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.052) 0:01:54.656 ******* 2021-11-15T14:30:14.246 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.021) 0:01:54.678 ******* 2021-11-15T14:30:14.263 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:14.265 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-15T14:30:14.287 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.041) 0:01:54.719 ******* 2021-11-15T14:30:14.292 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-15T14:30:14.294 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.318 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.031) 0:01:54.751 ******* 2021-11-15T14:30:14.325 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T14:30:14.327 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T14:30:14.350 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.032) 0:01:54.783 ******* 2021-11-15T14:30:14.371 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.020) 0:01:54.803 ******* 2021-11-15T14:30:14.377 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:14.379 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.411 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.040) 0:01:54.843 ******* 2021-11-15T14:30:14.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:14.441 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.463 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.051) 0:01:54.895 ******* 2021-11-15T14:30:14.490 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-15T14:30:14.492 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:14.515 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.052) 0:01:54.947 ******* 2021-11-15T14:30:14.538 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.022) 0:01:54.970 ******* 2021-11-15T14:30:14.544 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-15T14:30:14.546 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.571 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.033) 0:01:55.003 ******* 2021-11-15T14:30:14.591 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.020) 0:01:55.024 ******* 2021-11-15T14:30:14.598 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-15T14:30:14.600 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.625 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.033) 0:01:55.057 ******* 2021-11-15T14:30:14.648 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.022) 0:01:55.080 ******* 2021-11-15T14:30:14.654 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-15T14:30:14.656 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.680 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.031) 0:01:55.112 ******* 2021-11-15T14:30:14.701 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.021) 0:01:55.133 ******* 2021-11-15T14:30:14.707 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-15T14:30:14.708 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:14.709 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.735 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.033) 0:01:55.167 ******* 2021-11-15T14:30:14.756 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.021) 0:01:55.188 ******* 2021-11-15T14:30:14.961 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.029) 0:01:55.218 ******* TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 14:30:14 +0000 (0:00:00.034) 0:01:55.253 ******* Monday 15 November 2021 14:30:14 +0000 (0:00:00.022) 0:01:55.275 ******* TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 14:30:14 +0000 (0:00:00.032) 0:01:55.307 ******* TASK [testnode : set_fact] ***************************************************** ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Stop collectl] ************************************************ skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 15 November 2021 14:30:14 +0000 (0:00:00.032) 0:01:55.340 ******* Monday 15 November 2021 14:30:14 +0000 (0:00:00.021) 0:01:55.362 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.964 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.034) 0:01:55.397 ******* 2021-11-15T14:30:14.971 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-15T14:30:14.973 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba019.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:14.998 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:14 +0000 (0:00:00.033) 0:01:55.430 ******* 2021-11-15T14:30:15.006 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.007 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba019.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.009 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.009 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T14:30:15.034 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.035) 0:01:55.466 ******* 2021-11-15T14:30:15.041 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.043 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba019.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.043 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.043 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.044 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-15T14:30:15.044 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T14:30:15.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.034) 0:01:55.501 ******* 2021-11-15T14:30:15.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.022) 0:01:55.524 ******* 2021-11-15T14:30:15.098 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:15.100 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.100 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.101 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba019.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.103 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T14:30:15.104 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.131 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.039) 0:01:55.563 ******* 2021-11-15T14:30:15.161 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.029) 0:01:55.593 ******* 2021-11-15T14:30:15.184 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.023) 0:01:55.616 ******* 2021-11-15T14:30:15.203 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T14:30:15.227 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.042) 0:01:55.659 ******* 2021-11-15T14:30:15.234 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-15T14:30:15.236 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.261 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.033) 0:01:55.693 ******* 2021-11-15T14:30:15.278 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:15.281 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.290 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.292 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba032.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.315 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.054) 0:01:55.747 ******* 2021-11-15T14:30:15.323 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.325 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [gibba032.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T14:30:15.326 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003225", "end": "2021-11-15 14:30:15.298996", "rc": 0, "start": "2021-11-15 14:30:15.295771", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T14:30:15.326 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba032.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.327 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.356 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.041) 0:01:55.788 ******* 2021-11-15T14:30:15.363 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.365 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.365 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.377 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-15T14:30:15.379 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba032.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.406 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.049) 0:01:55.838 ******* 2021-11-15T14:30:15.428 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.022) 0:01:55.860 ******* 2021-11-15T14:30:15.436 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T14:30:15.437 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-15T14:30:15.467 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.038) 0:01:55.899 ******* 2021-11-15T14:30:15.488 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.021) 0:01:55.921 ******* 2021-11-15T14:30:15.506 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-15T14:30:15.507 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.531 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.043) 0:01:55.964 ******* 2021-11-15T14:30:15.549 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T14:30:15.551 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:15.574 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.042) 0:01:56.006 ******* 2021-11-15T14:30:15.579 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-15T14:30:15.581 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.611 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.037) 0:01:56.044 ******* 2021-11-15T14:30:15.618 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-15T14:30:15.620 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003301", "end": "2021-11-15 14:30:15.587431", "rc": 0, "start": "2021-11-15 14:30:15.584130", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T14:30:15.648 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.037) 0:01:56.081 ******* 2021-11-15T14:30:15.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.023) 0:01:56.105 ******* 2021-11-15T14:30:15.689 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T14:30:15.691 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.714 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.042) 0:01:56.147 ******* 2021-11-15T14:30:15.720 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-15T14:30:15.722 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.747 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.032) 0:01:56.179 ******* 2021-11-15T14:30:15.753 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-15T14:30:15.755 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.779 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.031) 0:01:56.211 ******* 2021-11-15T14:30:15.785 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-15T14:30:15.787 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.812 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.033) 0:01:56.245 ******* 2021-11-15T14:30:15.835 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.022) 0:01:56.267 ******* 2021-11-15T14:30:15.842 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-15T14:30:15.843 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.867 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.032) 0:01:56.299 ******* 2021-11-15T14:30:15.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.021) 0:01:56.321 ******* 2021-11-15T14:30:15.895 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-15T14:30:15.897 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.921 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.032) 0:01:56.353 ******* 2021-11-15T14:30:15.948 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T14:30:15.953 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:15.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:15 +0000 (0:00:00.050) 0:01:56.404 ******* 2021-11-15T14:30:15.998 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:16.000 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T14:30:16.029 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.057) 0:01:56.461 ******* 2021-11-15T14:30:16.035 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-15T14:30:16.036 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:16.062 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.033) 0:01:56.494 ******* 2021-11-15T14:30:16.079 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:16.081 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.091 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.092 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba038.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.115 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.052) 0:01:56.547 ******* 2021-11-15T14:30:16.121 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.123 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [gibba038.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.134 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.136 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:16.136 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.160 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.045) 0:01:56.593 ******* 2021-11-15T14:30:16.170 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.171 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.173 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [gibba019.front.sepia.ceph.com] => (item={'block_used': 14049717, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045391, 'size_available': 925881921536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045391, "block_size": 4096, "block_total": 240095108, "block_used": 14049717, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881921536, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T14:30:16.176 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:16.178 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.048) 0:01:56.641 ******* 2021-11-15T14:30:16.244 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.035) 0:01:56.677 ******* 2021-11-15T14:30:16.293 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-15T14:30:16.294 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:16.319 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.074) 0:01:56.751 ******* 2021-11-15T14:30:16.327 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T14:30:16.328 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002582", "end": "2021-11-15 14:30:16.530102", "rc": 0, "start": "2021-11-15 14:30:16.527520", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:16.353 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.034) 0:01:56.786 ******* 2021-11-15T14:30:16.360 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T14:30:16.361 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.385 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.031) 0:01:56.817 ******* 2021-11-15T14:30:16.392 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T14:30:16.393 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'block_used': 14049717, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045391, 'size_available': 925881921536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045391, "block_size": 4096, "block_total": 240095108, "block_used": 14049717, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881921536, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.428 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.042) 0:01:56.860 ******* 2021-11-15T14:30:16.434 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:16.436 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item={'block_used': 14049702, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045406, 'size_available': 925881982976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045406, "block_size": 4096, "block_total": 240095108, "block_used": 14049702, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881982976, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T14:30:16.437 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003326", "end": "2021-11-15 14:30:16.409296", "rc": 0, "start": "2021-11-15 14:30:16.405970", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T14:30:16.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-15T14:30:16.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.032) 0:01:56.892 ******* 2021-11-15T14:30:16.479 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.019) 0:01:56.912 ******* 2021-11-15T14:30:16.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.029) 0:01:56.941 ******* 2021-11-15T14:30:16.516 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T14:30:16.540 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.031) 0:01:56.973 ******* 2021-11-15T14:30:16.547 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T14:30:16.548 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.575 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.034) 0:01:57.007 ******* 2021-11-15T14:30:16.581 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T14:30:16.582 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002322", "end": "2021-11-15 14:30:16.714812", "rc": 0, "start": "2021-11-15 14:30:16.712490", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:16.607 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.032) 0:01:57.040 ******* 2021-11-15T14:30:16.614 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:16.614 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.616 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.640 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.032) 0:01:57.072 ******* 2021-11-15T14:30:16.656 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T14:30:16.658 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'block_used': 14049702, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045406, 'size_available': 925881982976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045406, "block_size": 4096, "block_total": 240095108, "block_used": 14049702, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881982976, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.681 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.040) 0:01:57.113 ******* 2021-11-15T14:30:16.686 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-15T14:30:16.688 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.710 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.029) 0:01:57.142 ******* 2021-11-15T14:30:16.715 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T14:30:16.741 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.030) 0:01:57.173 ******* 2021-11-15T14:30:16.748 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-15T14:30:16.749 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-15T14:30:16.774 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.032) 0:01:57.206 ******* 2021-11-15T14:30:16.791 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:16.792 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.876 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-15T14:30:16.878 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:16.899 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.125) 0:01:57.332 ******* 2021-11-15T14:30:16.928 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-15T14:30:16.930 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:16.950 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:16 +0000 (0:00:00.050) 0:01:57.382 ******* 2021-11-15T14:30:16.986 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-15T14:30:16.988 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.008 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.058) 0:01:57.441 ******* 2021-11-15T14:30:17.034 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-15T14:30:17.036 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.065 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.056) 0:01:57.497 ******* 2021-11-15T14:30:17.094 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-15T14:30:17.096 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.052) 0:01:57.550 ******* 2021-11-15T14:30:17.134 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-15T14:30:17.136 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:17.158 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.040) 0:01:57.591 ******* 2021-11-15T14:30:17.165 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-15T14:30:17.166 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.190 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.031) 0:01:57.622 ******* 2021-11-15T14:30:17.195 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T14:30:17.197 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.222 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.032) 0:01:57.655 ******* 2021-11-15T14:30:17.228 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:17.229 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-15T14:30:17.255 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.032) 0:01:57.688 ******* 2021-11-15T14:30:17.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:17.265 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049714, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045394, 'size_available': 925881933824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045394, "block_size": 4096, "block_total": 240095108, "block_used": 14049714, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881933824, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T14:30:17.291 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.035) 0:01:57.723 ******* 2021-11-15T14:30:17.308 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-15T14:30:17.310 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.321 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.322 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.332 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.343 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-15T14:30:17.344 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.354 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.356 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.365 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.367 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.376 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.387 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.389 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.416 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.125) 0:01:57.848 ******* 2021-11-15T14:30:17.422 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T14:30:17.424 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002361", "end": "2021-11-15 14:30:17.766445", "rc": 0, "start": "2021-11-15 14:30:17.764084", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:17.448 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.031) 0:01:57.880 ******* 2021-11-15T14:30:17.485 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T14:30:17.486 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049714, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045394, 'size_available': 925881933824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045394, "block_size": 4096, "block_total": 240095108, "block_used": 14049714, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881933824, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.060) 0:01:57.941 ******* 2021-11-15T14:30:17.536 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T14:30:17.560 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.051) 0:01:57.993 ******* 2021-11-15T14:30:17.610 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-15T14:30:17.612 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003205", "end": "2021-11-15 14:30:17.584824", "rc": 0, "start": "2021-11-15 14:30:17.581619", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-15T14:30:17.638 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.077) 0:01:58.071 ******* 2021-11-15T14:30:17.667 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-15T14:30:17.669 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.699 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.060) 0:01:58.131 ******* 2021-11-15T14:30:17.738 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.939 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.240) 0:01:58.371 ******* 2021-11-15T14:30:17.948 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:17.949 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.971 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:17.995 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:17 +0000 (0:00:00.056) 0:01:58.427 ******* 2021-11-15T14:30:18.190 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:18.191 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2B4l1zniuoJAPjlfJQ2ZO32cKFzYwLrCkw'], 'uuids': ['393949cc-b197-4edf-9abb-02ceb9832861']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.507185", "end": "2021-11-15 14:30:18.386741", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2B4l1zniuoJAPjlfJQ2ZO32cKFzYwLrCkw"], "labels": [], "masters": [], "uuids": ["393949cc-b197-4edf-9abb-02ceb9832861"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:16.879556", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:18.203 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.204 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.362 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gye3Tj4CK4yS6yYtzE0JIR1O6xI0JdAGt'], 'uuids': ['d013e602-7330-4dab-939b-3f82c2f32f29']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.487124", "end": "2021-11-15 14:30:18.501724", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gye3Tj4CK4yS6yYtzE0JIR1O6xI0JdAGt"], "labels": [], "masters": [], "uuids": ["d013e602-7330-4dab-939b-3f82c2f32f29"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:17.014600", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:18.374 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.396 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.428 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:30:18.451 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.455) 0:01:58.883 ******* 2021-11-15T14:30:18.489 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-15T14:30:18.491 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.513 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.062) 0:01:58.945 ******* 2021-11-15T14:30:18.560 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:18.562 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item={'block_used': 14049708, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045400, 'size_available': 925881958400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045400, "block_size": 4096, "block_total": 240095108, "block_used": 14049708, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881958400, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-15T14:30:18.584 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.071) 0:01:59.016 ******* 2021-11-15T14:30:18.693 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-15T14:30:18.695 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002500", "end": "2021-11-15 14:30:18.681695", "rc": 0, "start": "2021-11-15 14:30:18.679195", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:18.717 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.132) 0:01:59.149 ******* 2021-11-15T14:30:18.753 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-15T14:30:18.755 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'block_used': 14049708, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045400, 'size_available': 925881958400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045400, "block_size": 4096, "block_total": 240095108, "block_used": 14049708, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881958400, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:18.777 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.060) 0:01:59.209 ******* 2021-11-15T14:30:18.803 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-15T14:30:18.826 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:18 +0000 (0:00:00.049) 0:01:59.258 ******* 2021-11-15T14:30:18.874 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:18.875 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:19.375 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFGQil9dpa5GMZAtkhWm5Alwg8x5SZynt1'], 'uuids': ['48e0e652-0e56-4f2a-8273-dcf96657b2c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.498217", "end": "2021-11-15 14:30:19.721942", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFGQil9dpa5GMZAtkhWm5Alwg8x5SZynt1"], "labels": [], "masters": [], "uuids": ["48e0e652-0e56-4f2a-8273-dcf96657b2c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:18.223725", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:19.387 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:19.388 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:19.400 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BLF5xM1TJPTrObBd2MsxtC16y9bLMFZqP'], 'uuids': ['5ddf56e8-30b0-43da-a417-e938227aab2e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.112314", "end": "2021-11-15 14:30:19.602003", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BLF5xM1TJPTrObBd2MsxtC16y9bLMFZqP"], "labels": [], "masters": [], "uuids": ["5ddf56e8-30b0-43da-a417-e938227aab2e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:18.489689", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:19.411 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'wwn-0x50000399ab9813cb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'wwn-0x50000399ab9813cb-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cb', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JXF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "wwn-0x50000399ab9813cb"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1", "wwn-0x50000399ab9813cb-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JXF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cb"}}, "skip_reason": "Cond 2021-11-15T14:30:19.413 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:19.569 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67grUicBA9M1a8WAgcFJrjTrzJKfgyzLZtU'], 'uuids': ['6e340a83-f3ef-478e-99fb-3379351e0eb4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.089578", "end": "2021-11-15 14:30:19.707389", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67grUicBA9M1a8WAgcFJrjTrzJKfgyzLZtU"], "labels": [], "masters": [], "uuids": ["6e340a83-f3ef-478e-99fb-3379351e0eb4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:18.617811", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:19.581 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF', 'wwn-0x50000399ab801e8b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF-part1', 'wwn-0x50000399ab801e8b-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8b', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PRF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF", "wwn-0x50000399ab801e8b"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF-part1", "wwn-0x50000399ab801e8b-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PRF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8b"}}, "skip_reason": "Cond 2021-11-15T14:30:19.582 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:20.574 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZrInWnlSkTc3kov9w1uqg1mdY8YnhG3Po'], 'uuids': ['e4d14671-4d23-4278-8e8c-47f876e60216']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.600206", "end": "2021-11-15 14:30:20.559434", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZrInWnlSkTc3kov9w1uqg1mdY8YnhG3Po"], "labels": [], "masters": [], "uuids": ["e4d14671-4d23-4278-8e8c-47f876e60216"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:18.959228", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:20.586 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:20.587 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFsJLJQPqW0fhSobTEHl07df0q7jYicgn3'], 'uuids': ['f5d2c317-014c-451c-afc5-efa9fbeee333']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.084059", "end": "2021-11-15 14:30:20.935704", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFsJLJQPqW0fhSobTEHl07df0q7jYicgn3"], "labels": [], "masters": [], "uuids": ["f5d2c317-014c-451c-afc5-efa9fbeee333"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:19.851645", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:20.589 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:20.600 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Cond 2021-11-15T14:30:20.602 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:20.633 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Zq5fiC-ojYe-rTeb-EvtL-hLOa-QMcI-wWvWMU', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A', 'nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.140291", "end": "2021-11-15 14:30:20.833814", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-Zq5fiC-ojYe-rTeb-EvtL-hLOa-QMcI-wWvWMU", "nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A", "nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:19.693523", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T14:30:20.635 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:20.645 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:20.646 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:20.783 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-wdKqeF-RLcR-t8J1-RXcZ-c0up-po88-FpXUcO', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400C3375A', 'nvme-nvme.8086-50484b4d393133343030433333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.118085", "end": "2021-11-15 14:30:20.917249", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-wdKqeF-RLcR-t8J1-RXcZ-c0up-po88-FpXUcO", "nvme-INTEL_SSDPEL1K375GA_PHKM913400C3375A", "nvme-nvme.8086-50484b4d393133343030433333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:19.799164", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T14:30:20.785 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:20.796 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:21.777 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZavdyMEwUCejKaT8Vn7tbjY6JdrV8GqY3'], 'uuids': ['3bf2d5c2-c57d-4e39-b82e-7ea9290d3b36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.089388", "end": "2021-11-15 14:30:21.750704", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZavdyMEwUCejKaT8Vn7tbjY6JdrV8GqY3"], "labels": [], "masters": [], "uuids": ["3bf2d5c2-c57d-4e39-b82e-7ea9290d3b36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:20.661316", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:21.779 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF', 'wwn-0x50000399ab9813f2'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF-part1', 'wwn-0x50000399ab9813f2-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f2', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF", "wwn-0x50000399ab9813f2"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF-part1", "wwn-0x50000399ab9813f2-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f2"}}, "skip_reason": "Cond 2021-11-15T14:30:21.780 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:21.842 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pP1U33-vBRJ-pcgX-FCqS-LUAW-KZ1L-GfQ4fl', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.131979", "end": "2021-11-15 14:30:22.189530", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-pP1U33-vBRJ-pcgX-FCqS-LUAW-KZ1L-GfQ4fl", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:21.057551", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T14:30:21.844 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:21.854 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:21.855 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:21.908 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2Bu18nbH39Lns1EreXng6IeEZDzlrwDhe4'], 'uuids': ['f23c22c0-7ebc-49bd-b598-77c1c571b260']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.138708", "end": "2021-11-15 14:30:22.107899", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2Bu18nbH39Lns1EreXng6IeEZDzlrwDhe4"], "labels": [], "masters": [], "uuids": ["f23c22c0-7ebc-49bd-b598-77c1c571b260"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:20.969191", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:21.920 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:21.921 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:22.005 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67g33g01UA5WjKbReTuqVxqDOreU3SdUaOf'], 'uuids': ['10b7c3eb-2b85-4920-9745-decfc001e815']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.123812", "end": "2021-11-15 14:30:22.142662", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67g33g01UA5WjKbReTuqVxqDOreU3SdUaOf"], "labels": [], "masters": [], "uuids": ["10b7c3eb-2b85-4920-9745-decfc001e815"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:21.018850", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:22.016 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:22.017 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:22.992 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-TAnXXr-OHdh-m11J-F81z-x7IF-Nd4b-726Ys6', 'nvme-INTEL_SSDPEL1K375GA_PHKM92000093375A', 'nvme-nvme.8086-50484b4d393230303030393333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.119077", "end": "2021-11-15 14:30:22.969944", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-TAnXXr-OHdh-m11J-F81z-x7IF-Nd4b-726Ys6", "nvme-INTEL_SSDPEL1K375GA_PHKM92000093375A", "nvme-nvme.8086-50484b4d393230303030393333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:21.850867", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-15T14:30:22.993 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:23.004 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:23.037 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFrKvUkJwmKwebtN5GHFkTbIgX2HbQgx0C'], 'uuids': ['0c5a9c0f-1295-43b0-acb9-4f6ab6929a2d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.094463", "end": "2021-11-15 14:30:23.387322", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFrKvUkJwmKwebtN5GHFkTbIgX2HbQgx0C"], "labels": [], "masters": [], "uuids": ["0c5a9c0f-1295-43b0-acb9-4f6ab6929a2d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:22.292859", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:23.049 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:23.060 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:23.154 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BxI4rWqYffh0uiup0gIjNAWYQXY5w0S5j'], 'uuids': ['4cb20d97-2c59-4c68-ad20-0bbc1b8f7116']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:00.920194", "end": "2021-11-15 14:30:23.132708", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BxI4rWqYffh0uiup0gIjNAWYQXY5w0S5j"], "labels": [], "masters": [], "uuids": ["4cb20d97-2c59-4c68-ad20-0bbc1b8f7116"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:22.212514", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:23.166 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:23.219 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gZpaA8IzTVQjDV2h6Jw563YFNcjfLuwBJ'], 'uuids': ['5a7caa7c-b2cd-4e22-ac0c-859aac867dfa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.109184", "end": "2021-11-15 14:30:23.352598", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gZpaA8IzTVQjDV2h6Jw563YFNcjfLuwBJ"], "labels": [], "masters": [], "uuids": ["5a7caa7c-b2cd-4e22-ac0c-859aac867dfa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:22.243414", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:23.220 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.212 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZybbqE3t5OgNYGTdoYI85AKvCauNTchw1'], 'uuids': ['971bf40b-608a-4e41-b9b7-9193e0a50130']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.124469", "end": "2021-11-15 14:30:24.194583", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZybbqE3t5OgNYGTdoYI85AKvCauNTchw1"], "labels": [], "masters": [], "uuids": ["971bf40b-608a-4e41-b9b7-9193e0a50130"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:23.070114", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:24.224 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.225 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.237 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFn1wbshciiLxWhDqjHchrBn56Qtxplvb1'], 'uuids': ['7d8f8f56-9b39-4de3-b7ed-7a0fe3e9179c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.089252", "end": "2021-11-15 14:30:24.579004", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFn1wbshciiLxWhDqjHchrBn56Qtxplvb1"], "labels": [], "masters": [], "uuids": ["7d8f8f56-9b39-4de3-b7ed-7a0fe3e9179c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:23.489752", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:24.238 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.407 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gn3L7wnnOds6meg9IOcFH1Rc4dpRXUW2w'], 'uuids': ['8b529a68-9457-49c8-ab52-10501932123e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.096299", "end": "2021-11-15 14:30:24.542218", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gn3L7wnnOds6meg9IOcFH1Rc4dpRXUW2w"], "labels": [], "masters": [], "uuids": ["8b529a68-9457-49c8-ab52-10501932123e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:23.445919", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:24.408 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BTgXXHP4Kt02kvgPfytqyqPxzqFKCVoAH'], 'uuids': ['7329e106-4bfc-4630-aaa0-85a5abc2ed8b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.115338", "end": "2021-11-15 14:30:24.383919", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BTgXXHP4Kt02kvgPfytqyqPxzqFKCVoAH"], "labels": [], "masters": [], "uuids": ["7329e106-4bfc-4630-aaa0-85a5abc2ed8b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:23.268581", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:24.455 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:24 +0000 (0:00:05.628) 0:02:04.887 ******* 2021-11-15T14:30:24.483 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:24 +0000 (0:00:00.027) 0:02:04.915 ******* 2021-11-15T14:30:24.504 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:24.506 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.527 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.674 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2B4l1zniuoJAPjlfJQ2ZO32cKFzYwLrCkw'], 'uuids': ['393949cc-b197-4edf-9abb-02ceb9832861']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077788", "end": "2021-11-15 14:30:24.651822", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2B4l1zniuoJAPjlfJQ2ZO32cKFzYwLrCkw"], "labels": [], "masters": [], "uuids": ["393949cc-b197-4edf-9abb-02ceb9832861"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.574034", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0765119 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0765119 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:24.675 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.686 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.698 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gye3Tj4CK4yS6yYtzE0JIR1O6xI0JdAGt'], 'uuids': ['d013e602-7330-4dab-939b-3f82c2f32f29']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077613", "end": "2021-11-15 14:30:24.838037", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gye3Tj4CK4yS6yYtzE0JIR1O6xI0JdAGt"], "labels": [], "masters": [], "uuids": ["d013e602-7330-4dab-939b-3f82c2f32f29"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.760424", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0763906 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0763906 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:24.710 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.711 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:24.857 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BLF5xM1TJPTrObBd2MsxtC16y9bLMFZqP'], 'uuids': ['5ddf56e8-30b0-43da-a417-e938227aab2e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078299", "end": "2021-11-15 14:30:24.839646", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BLF5xM1TJPTrObBd2MsxtC16y9bLMFZqP"], "labels": [], "masters": [], "uuids": ["5ddf56e8-30b0-43da-a417-e938227aab2e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.761347", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770958 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770958 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:24.869 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'wwn-0x50000399ab9813cb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'wwn-0x50000399ab9813cb-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cb', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JXF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "wwn-0x50000399ab9813cb"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1", "wwn-0x50000399ab9813cb-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JXF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cb"}}, "skip_reason": "Cond 2021-11-15T14:30:24.871 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:24.881 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67grUicBA9M1a8WAgcFJrjTrzJKfgyzLZtU'], 'uuids': ['6e340a83-f3ef-478e-99fb-3379351e0eb4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078531", "end": "2021-11-15 14:30:25.023551", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67grUicBA9M1a8WAgcFJrjTrzJKfgyzLZtU"], "labels": [], "masters": [], "uuids": ["6e340a83-f3ef-478e-99fb-3379351e0eb4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.945020", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773136 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773136 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:24.893 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF', 'wwn-0x50000399ab801e8b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF-part1', 'wwn-0x50000399ab801e8b-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8b', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PRF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF", "wwn-0x50000399ab801e8b"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PRF6XF-part1", "wwn-0x50000399ab801e8b-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PRF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8b"}}, "skip_reason": "Cond 2021-11-15T14:30:24.894 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:25.029 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Zq5fiC-ojYe-rTeb-EvtL-hLOa-QMcI-wWvWMU', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A', 'nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025716", "end": "2021-11-15 14:30:25.010212", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-Zq5fiC-ojYe-rTeb-EvtL-hLOa-QMcI-wWvWMU", "nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A", "nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.984496", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0245153 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-15T14:30:25.031 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0245153 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.041 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.042 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.054 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-wdKqeF-RLcR-t8J1-RXcZ-c0up-po88-FpXUcO', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400C3375A', 'nvme-nvme.8086-50484b4d393133343030433333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025342", "end": "2021-11-15 14:30:25.188276", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-wdKqeF-RLcR-t8J1-RXcZ-c0up-po88-FpXUcO", "nvme-INTEL_SSDPEL1K375GA_PHKM913400C3375A", "nvme-nvme.8086-50484b4d393133343030433333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.162934", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0241392 s, 4.8 GB/s", "stderr_lines": ["1 2021-11-15T14:30:25.055 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0241392 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.066 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.213 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2Bu18nbH39Lns1EreXng6IeEZDzlrwDhe4'], 'uuids': ['f23c22c0-7ebc-49bd-b598-77c1c571b260']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078950", "end": "2021-11-15 14:30:25.195348", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2Bu18nbH39Lns1EreXng6IeEZDzlrwDhe4"], "labels": [], "masters": [], "uuids": ["f23c22c0-7ebc-49bd-b598-77c1c571b260"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.116398", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0776837 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0776837 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.225 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67g33g01UA5WjKbReTuqVxqDOreU3SdUaOf'], 'uuids': ['10b7c3eb-2b85-4920-9745-decfc001e815']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077905", "end": "2021-11-15 14:30:25.363785", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67g33g01UA5WjKbReTuqVxqDOreU3SdUaOf"], "labels": [], "masters": [], "uuids": ["10b7c3eb-2b85-4920-9745-decfc001e815"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.285880", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766066 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766066 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.226 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.228 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.239 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.240 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.417 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gZpaA8IzTVQjDV2h6Jw563YFNcjfLuwBJ'], 'uuids': ['5a7caa7c-b2cd-4e22-ac0c-859aac867dfa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077874", "end": "2021-11-15 14:30:25.555354", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gZpaA8IzTVQjDV2h6Jw563YFNcjfLuwBJ"], "labels": [], "masters": [], "uuids": ["5a7caa7c-b2cd-4e22-ac0c-859aac867dfa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.477480", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766939 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766939 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.429 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.431 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:25.431 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFNJaWRcqgWTwJvukFKrgcVkprOdvSO3ah'], 'uuids': ['cccd645f-8598-44e5-a273-d200b77e1e75']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.093020", "end": "2021-11-15 14:30:25.771326", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFNJaWRcqgWTwJvukFKrgcVkprOdvSO3ah"], "labels": [], "masters": [], "uuids": ["cccd645f-8598-44e5-a273-d200b77e1e75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.678306", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now p 2021-11-15T14:30:25.433 INFO:teuthology.task.ansible.out:artition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:25.443 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:25.445 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BxI4rWqYffh0uiup0gIjNAWYQXY5w0S5j'], 'uuids': ['4cb20d97-2c59-4c68-ad20-0bbc1b8f7116']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.079175", "end": "2021-11-15 14:30:25.409103", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BxI4rWqYffh0uiup0gIjNAWYQXY5w0S5j"], "labels": [], "masters": [], "uuids": ["4cb20d97-2c59-4c68-ad20-0bbc1b8f7116"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.329928", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0778769 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0778769 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:25.445 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5Zkd67Vw47enxx1Yj3IN16y8LUUDD2hXeP'], 'uuids': ['ce27974 2021-11-15T14:30:25.447 INFO:teuthology.task.ansible.out:b-e528-4ad1-98fe-3819f66e65a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.119226", "end": "2021-11-15 14:30:25.418203", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5Zkd67Vw47enxx1Yj3IN16y8LUUDD2hXeP"], "labels": [], "masters": [], "uuids": ["ce27974b-e528-4ad1-98fe-3819f66e65a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:24.298977", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': No 2021-11-15T14:30:25.448 INFO:teuthology.task.ansible.out:ne, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.472 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:25 +0000 (0:00:00.989) 0:02:05.904 ******* 2021-11-15T14:30:25.513 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:25.515 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.589 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BTgXXHP4Kt02kvgPfytqyqPxzqFKCVoAH'], 'uuids': ['7329e106-4bfc-4630-aaa0-85a5abc2ed8b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078708", "end": "2021-11-15 14:30:25.574078", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tjTazweKuaLzP5zrUky8OBPgkDY6Cr2BTgXXHP4Kt02kvgPfytqyqPxzqFKCVoAH"], "labels": [], "masters": [], "uuids": ["7329e106-4bfc-4630-aaa0-85a5abc2ed8b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.495370", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0774986 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0774986 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.634 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:25 +0000 (0:00:00.161) 0:02:06.066 ******* 2021-11-15T14:30:25.643 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gn3L7wnnOds6meg9IOcFH1Rc4dpRXUW2w'], 'uuids': ['8b529a68-9457-49c8-ab52-10501932123e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078317", "end": "2021-11-15 14:30:25.779112", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tYF5yi5ZEQNnwO1wLwwNIxcLbPQez67gn3L7wnnOds6meg9IOcFH1Rc4dpRXUW2w"], "labels": [], "masters": [], "uuids": ["8b529a68-9457-49c8-ab52-10501932123e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.700795", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.077076 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.077076 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.691 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:25 +0000 (0:00:00.057) 0:02:06.123 ******* 2021-11-15T14:30:25.699 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFGQil9dpa5GMZAtkhWm5Alwg8x5SZynt1'], 'uuids': ['48e0e652-0e56-4f2a-8273-dcf96657b2c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077708", "end": "2021-11-15 14:30:26.036385", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFGQil9dpa5GMZAtkhWm5Alwg8x5SZynt1"], "labels": [], "masters": [], "uuids": ["48e0e652-0e56-4f2a-8273-dcf96657b2c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.958677", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0765258 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0765258 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.701 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.713 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.860 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFsJLJQPqW0fhSobTEHl07df0q7jYicgn3'], 'uuids': ['f5d2c317-014c-451c-afc5-efa9fbeee333']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078997", "end": "2021-11-15 14:30:26.212211", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFsJLJQPqW0fhSobTEHl07df0q7jYicgn3"], "labels": [], "masters": [], "uuids": ["f5d2c317-014c-451c-afc5-efa9fbeee333"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.133214", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0777341 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0777341 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.872 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Cond 2021-11-15T14:30:25.873 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-15T14:30:25.956 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T14:30:25.964 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.218908", "end": "2021-11-15 14:30:25.936098", "rc": 0, "start": "2021-11-15 14:30:25.717190", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.985 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:25 +0000 (0:00:00.294) 0:02:06.417 ******* 2021-11-15T14:30:25.993 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:25.994 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pP1U33-vBRJ-pcgX-FCqS-LUAW-KZ1L-GfQ4fl', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.026099", "end": "2021-11-15 14:30:26.326172", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-pP1U33-vBRJ-pcgX-FCqS-LUAW-KZ1L-GfQ4fl", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.300073", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.024926 s, 4.6 GB/s", "stderr_lines": ["11 2021-11-15T14:30:25.996 INFO:teuthology.task.ansible.out:0+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.024926 s, 4.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:25.996 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:25.998 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.009 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T14:30:26.011 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.154214", "end": "2021-11-15 14:30:26.132949", "rc": 0, "start": "2021-11-15 14:30:25.978735", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.034 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.048) 0:02:06.466 ******* 2021-11-15T14:30:26.144 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:26.146 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFrKvUkJwmKwebtN5GHFkTbIgX2HbQgx0C'], 'uuids': ['0c5a9c0f-1295-43b0-acb9-4f6ab6929a2d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078663", "end": "2021-11-15 14:30:26.500722", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFrKvUkJwmKwebtN5GHFkTbIgX2HbQgx0C"], "labels": [], "masters": [], "uuids": ["0c5a9c0f-1295-43b0-acb9-4f6ab6929a2d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.422059", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0774099 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0774099 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.157 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.168 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.169 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T14:30:26.170 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.087984", "end": "2021-11-15 14:30:26.151844", "rc": 0, "start": "2021-11-15 14:30:26.063860", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.197 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.162) 0:02:06.629 ******* 2021-11-15T14:30:26.216 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.074576", "end": "2021-11-15 14:30:26.348931", "rc": 0, "start": "2021-11-15 14:30:26.274355", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.239 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.042) 0:02:06.672 ******* 2021-11-15T14:30:26.245 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T14:30:26.270 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:06.703 ******* 2021-11-15T14:30:26.302 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:06.735 ******* 2021-11-15T14:30:26.309 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T14:30:26.310 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.334 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.032) 0:02:06.767 ******* 2021-11-15T14:30:26.341 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.368 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.033) 0:02:06.801 ******* 2021-11-15T14:30:26.375 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T14:30:26.376 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.400 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:06.832 ******* 2021-11-15T14:30:26.406 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:26.407 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFn1wbshciiLxWhDqjHchrBn56Qtxplvb1'], 'uuids': ['7d8f8f56-9b39-4de3-b7ed-7a0fe3e9179c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078935", "end": "2021-11-15 14:30:26.728712", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFn1wbshciiLxWhDqjHchrBn56Qtxplvb1"], "labels": [], "masters": [], "uuids": ["7d8f8f56-9b39-4de3-b7ed-7a0fe3e9179c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.649777", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0777241 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0777241 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.408 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.410 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.432 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:06.864 ******* 2021-11-15T14:30:26.437 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T14:30:26.439 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.463 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:06.895 ******* 2021-11-15T14:30:26.469 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.496 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.032) 0:02:06.928 ******* 2021-11-15T14:30:26.501 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T14:30:26.503 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.039) 0:02:06.968 ******* 2021-11-15T14:30:26.541 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.576 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.041) 0:02:07.009 ******* 2021-11-15T14:30:26.586 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:26.587 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFNJaWRcqgWTwJvukFKrgcVkprOdvSO3ah'], 'uuids': ['cccd645f-8598-44e5-a273-d200b77e1e75']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078462", "end": "2021-11-15 14:30:26.908530", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wa8lMLCiTfLJ9QSoFDqNYv2kkacDF1SFNJaWRcqgWTwJvukFKrgcVkprOdvSO3ah"], "labels": [], "masters": [], "uuids": ["cccd645f-8598-44e5-a273-d200b77e1e75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.830068", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772527 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772527 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.626 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.049) 0:02:07.058 ******* 2021-11-15T14:30:26.634 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T14:30:26.635 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:26.662 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.035) 0:02:07.094 ******* 2021-11-15T14:30:26.670 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-15T14:30:26.671 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZNavk7Mf6paUWw0qae3PBwqGqMAZuUGCu'], 'uuids': ['f3638b0b-cdd6-4144-a1e2-71bfe20543fd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.116358", "end": "2021-11-15 14:30:26.644626", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZNavk7Mf6paUWw0qae3PBwqGqMAZuUGCu"], "labels": [], "masters": [], "uuids": ["f3638b0b-cdd6-4144-a1e2-71bfe20543fd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:25.528268", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-15T14:30:26.688 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T14:30:26.689 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:26.711 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.049) 0:02:07.144 ******* 2021-11-15T14:30:26.731 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.019) 0:02:07.163 ******* 2021-11-15T14:30:26.739 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:26.740 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'block_used': 14049717, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045391, 'size_available': 925881921536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045391, "block_size": 4096, "block_total": 240095108, "block_used": 14049717, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881921536, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.767 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.036) 0:02:07.200 ******* 2021-11-15T14:30:26.775 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'block_used': 14049702, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045406, 'size_available': 925881982976, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187092, 'block_size': 4096, 'inode_available': 60867884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045406, "block_size": 4096, "block_total": 240095108, "block_used": 14049702, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867884, "inode_total": 61054976, "inode_used": 187092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881982976, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.034) 0:02:07.234 ******* 2021-11-15T14:30:26.809 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:26.809 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.811 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.836 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.033) 0:02:07.268 ******* 2021-11-15T14:30:26.842 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.030) 0:02:07.298 ******* 2021-11-15T14:30:26.872 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:26.873 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.902 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.035) 0:02:07.334 ******* 2021-11-15T14:30:26.908 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.934 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.031) 0:02:07.366 ******* 2021-11-15T14:30:26.940 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:26.942 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "-1 day, 23:59:59.806878", "end": "2021-11-15 14:30:26.893389", "rc": 0, "start": "2021-11-15 14:30:27.086511", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.944 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:26.944 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZrInWnlSkTc3kov9w1uqg1mdY8YnhG3Po'], 'uuids': ['e4d14671-4d23-4278-8e8c-47f876e60216']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078381", "end": "2021-11-15 14:30:26.933027", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZrInWnlSkTc3kov9w1uqg1mdY8YnhG3Po"], "labels": [], "masters": [], "uuids": ["e4d14671-4d23-4278-8e8c-47f876e60216"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:26.854646", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771447 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771447 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:26.968 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.034) 0:02:07.401 ******* 2021-11-15T14:30:26.990 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:26 +0000 (0:00:00.021) 0:02:07.423 ******* 2021-11-15T14:30:26.998 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:26.999 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:26.999 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.000 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:27.000 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.026 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.035) 0:02:07.459 ******* 2021-11-15T14:30:27.049 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.021) 0:02:07.481 ******* 2021-11-15T14:30:27.056 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T14:30:27.058 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.083 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.034) 0:02:07.516 ******* 2021-11-15T14:30:27.090 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T14:30:27.091 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.118 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.034) 0:02:07.550 ******* 2021-11-15T14:30:27.138 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T14:30:27.139 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZavdyMEwUCejKaT8Vn7tbjY6JdrV8GqY3'], 'uuids': ['3bf2d5c2-c57d-4e39-b82e-7ea9290d3b36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078759", "end": "2021-11-15 14:30:27.121806", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZavdyMEwUCejKaT8Vn7tbjY6JdrV8GqY3"], "labels": [], "masters": [], "uuids": ["3bf2d5c2-c57d-4e39-b82e-7ea9290d3b36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:27.043047", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0775411 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0775411 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.165 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.046) 0:02:07.597 ******* 2021-11-15T14:30:27.173 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF', 'wwn-0x50000399ab9813f2'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF-part1', 'wwn-0x50000399ab9813f2-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f2', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF", "wwn-0x50000399ab9813f2"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L0F6XF-part1", "wwn-0x50000399ab9813f2-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f2"}}, "skip_reason": "Cond 2021-11-15T14:30:27.175 INFO:teuthology.task.ansible.out:itional result was False"} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.201 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.036) 0:02:07.633 ******* 2021-11-15T14:30:27.209 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T14:30:27.211 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.101453", "end": "2021-11-15 14:30:27.169771", "rc": 0, "start": "2021-11-15 14:30:27.068318", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.243 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.042) 0:02:07.675 ******* 2021-11-15T14:30:27.251 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T14:30:27.253 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.277 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.034) 0:02:07.710 ******* 2021-11-15T14:30:27.285 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:27.286 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-TAnXXr-OHdh-m11J-F81z-x7IF-Nd4b-726Ys6', 'nvme-INTEL_SSDPEL1K375GA_PHKM92000093375A', 'nvme-nvme.8086-50484b4d393230303030393333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.026020", "end": "2021-11-15 14:30:27.242309", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-TAnXXr-OHdh-m11J-F81z-x7IF-Nd4b-726Ys6", "nvme-INTEL_SSDPEL1K375GA_PHKM92000093375A", "nvme-nvme.8086-50484b4d393230303030393333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:27.216289", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0247775 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-15T14:30:27.287 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0247775 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.288 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.288 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T14:30:27.289 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", " 2021-11-15T14:30:27.291 INFO:teuthology.task.ansible.out:sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.046) 0:02:07.756 ******* 2021-11-15T14:30:27.361 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-15T14:30:27.363 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.386 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.062) 0:02:07.818 ******* 2021-11-15T14:30:27.412 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T14:30:27.414 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.435 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.049) 0:02:07.868 ******* 2021-11-15T14:30:27.442 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:27.443 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZybbqE3t5OgNYGTdoYI85AKvCauNTchw1'], 'uuids': ['971bf40b-608a-4e41-b9b7-9193e0a50130']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078070", "end": "2021-11-15 14:30:27.424499", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZybbqE3t5OgNYGTdoYI85AKvCauNTchw1"], "labels": [], "masters": [], "uuids": ["971bf40b-608a-4e41-b9b7-9193e0a50130"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:27.346429", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768303 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768303 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.456 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.457 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.468 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T14:30:27.470 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.493 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.057) 0:02:07.925 ******* 2021-11-15T14:30:27.519 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T14:30:27.521 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.543 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.050) 0:02:07.976 ******* 2021-11-15T14:30:27.625 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:27.627 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5Zkd67Vw47enxx1Yj3IN16y8LUUDD2hXeP'], 'uuids': ['ce27974b-e528-4ad1-98fe-3819f66e65a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078533", "end": "2021-11-15 14:30:27.609185", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5Zkd67Vw47enxx1Yj3IN16y8LUUDD2hXeP"], "labels": [], "masters": [], "uuids": ["ce27974b-e528-4ad1-98fe-3819f66e65a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:27.530652", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772883 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772883 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.637 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.651 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T14:30:27.653 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:27.676 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.132) 0:02:08.109 ******* 2021-11-15T14:30:27.726 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:27.728 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049714, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045394, 'size_available': 925881933824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045394, "block_size": 4096, "block_total": 240095108, "block_used": 14049714, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881933824, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.751 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.074) 0:02:08.183 ******* 2021-11-15T14:30:27.778 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T14:30:27.779 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.803 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.051) 0:02:08.235 ******* 2021-11-15T14:30:27.828 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-15T14:30:27.830 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZNavk7Mf6paUWw0qae3PBwqGqMAZuUGCu'], 'uuids': ['f3638b0b-cdd6-4144-a1e2-71bfe20543fd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078371", "end": "2021-11-15 14:30:27.796973", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-cQwyAexo4B8ZlQfAavquy091pYmM5f5ZNavk7Mf6paUWw0qae3PBwqGqMAZuUGCu"], "labels": [], "masters": [], "uuids": ["f3638b0b-cdd6-4144-a1e2-71bfe20543fd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-15 14:30:27.718602", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771576 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771576 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:27.841 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T14:30:27.842 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T14:30:27.844 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:27.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.063) 0:02:08.299 ******* 2021-11-15T14:30:27.897 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.030) 0:02:08.329 ******* 2021-11-15T14:30:27.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.025) 0:02:08.354 ******* 2021-11-15T14:30:27.946 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.023) 0:02:08.378 ******* 2021-11-15T14:30:27.977 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:27.978 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.000 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:27 +0000 (0:00:00.055) 0:02:08.433 ******* 2021-11-15T14:30:28.027 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T14:30:28.028 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.052 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.051) 0:02:08.485 ******* 2021-11-15T14:30:28.078 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T14:30:28.080 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.103 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.050) 0:02:08.535 ******* 2021-11-15T14:30:28.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.166 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.062) 0:02:08.598 ******* 2021-11-15T14:30:28.214 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-15T14:30:28.216 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.176882", "end": "2021-11-15 14:30:28.185734", "rc": 0, "start": "2021-11-15 14:30:28.008852", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:28.240 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.074) 0:02:08.672 ******* 2021-11-15T14:30:28.320 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:28.322 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:28.332 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:28.406 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-15T14:30:28.408 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.072044", "end": "2021-11-15 14:30:28.397328", "rc": 0, "start": "2021-11-15 14:30:28.325284", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:28.431 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.190) 0:02:08.863 ******* 2021-11-15T14:30:28.460 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-15T14:30:28.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.053) 0:02:08.916 ******* 2021-11-15T14:30:28.510 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.050) 0:02:08.967 ******* 2021-11-15T14:30:28.561 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-15T14:30:28.562 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.584 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.048) 0:02:09.016 ******* 2021-11-15T14:30:28.610 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T14:30:28.612 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.642 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.057) 0:02:09.074 ******* 2021-11-15T14:30:28.659 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T14:30:28.661 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T14:30:28.683 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.041) 0:02:09.115 ******* 2021-11-15T14:30:28.689 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-15T14:30:28.690 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.716 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.033) 0:02:09.149 ******* 2021-11-15T14:30:28.724 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:28.726 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:28.736 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:28.821 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-15T14:30:28.823 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-15T14:30:28.849 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.132) 0:02:09.281 ******* 2021-11-15T14:30:28.889 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-15T14:30:28.891 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'block_used': 14049708, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045400, 'size_available': 925881958400, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045400, "block_size": 4096, "block_total": 240095108, "block_used": 14049708, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881958400, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.914 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.064) 0:02:09.346 ******* 2021-11-15T14:30:28.943 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-15T14:30:28.945 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:28.969 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:28 +0000 (0:00:00.055) 0:02:09.401 ******* 2021-11-15T14:30:28.997 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:29.022 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.053) 0:02:09.455 ******* 2021-11-15T14:30:29.062 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:29.064 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:29.088 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.065) 0:02:09.520 ******* 2021-11-15T14:30:29.097 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:29.098 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.111 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.123 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-15T14:30:29.124 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:29.160 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.072) 0:02:09.592 ******* 2021-11-15T14:30:29.192 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-15T14:30:29.194 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:29.230 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.069) 0:02:09.662 ******* 2021-11-15T14:30:29.261 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-15T14:30:29.262 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:29.294 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.064) 0:02:09.727 ******* 2021-11-15T14:30:29.437 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:29.439 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.459 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.512 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.775 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.810 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.516) 0:02:10.243 ******* 2021-11-15T14:30:29.818 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.821 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-15T14:30:29.822 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-15T14:30:29.855 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.044) 0:02:10.288 ******* 2021-11-15T14:30:29.879 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.023) 0:02:10.311 ******* 2021-11-15T14:30:29.886 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:29.888 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:29.919 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T14:30:29.921 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T14:30:29.944 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.065) 0:02:10.377 ******* 2021-11-15T14:30:29.961 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T14:30:29.986 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:29 +0000 (0:00:00.041) 0:02:10.418 ******* 2021-11-15T14:30:30.087 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:30.089 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.099 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.174 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.186 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:30.231 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:30.251 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:30.253 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.274 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.286 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:30.288 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:30.339 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:30.341 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.351 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.355 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:30.379 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.393) 0:02:10.812 ******* 2021-11-15T14:30:30.388 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.417 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.038) 0:02:10.850 ******* 2021-11-15T14:30:30.425 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T14:30:30.427 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.452 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.034) 0:02:10.885 ******* 2021-11-15T14:30:30.460 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.487 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.034) 0:02:10.919 ******* 2021-11-15T14:30:30.493 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T14:30:30.495 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.523 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.036) 0:02:10.955 ******* 2021-11-15T14:30:30.529 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:30.556 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.033) 0:02:10.989 ******* 2021-11-15T14:30:30.564 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:30.564 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:30.604 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.047) 0:02:11.036 ******* 2021-11-15T14:30:30.633 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T14:30:30.635 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:30.660 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.055) 0:02:11.092 ******* 2021-11-15T14:30:30.667 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:30.669 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:30.679 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T14:30:30.681 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:30.704 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.043) 0:02:11.136 ******* 2021-11-15T14:30:30.710 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T14:30:30.712 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T14:30:30.738 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.034) 0:02:11.170 ******* 2021-11-15T14:30:30.745 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T14:30:30.771 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.033) 0:02:11.204 ******* 2021-11-15T14:30:30.777 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-15T14:30:30.779 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T14:30:30.805 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:30 +0000 (0:00:00.033) 0:02:11.237 ******* 2021-11-15T14:30:30.938 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:30.940 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:31.024 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:31.026 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:31.035 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:31.037 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:31.110 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:31.174 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T14:30:31.176 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true} 2021-11-15T14:30:31.201 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.395) 0:02:11.633 ******* 2021-11-15T14:30:31.209 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true} 2021-11-15T14:30:31.209 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:31.210 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:31.211 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.237 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.036) 0:02:11.670 ******* 2021-11-15T14:30:31.259 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.021) 0:02:11.691 ******* 2021-11-15T14:30:31.286 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T14:30:31.288 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.317 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.058) 0:02:11.749 ******* 2021-11-15T14:30:31.354 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T14:30:31.356 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.378 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.061) 0:02:11.810 ******* 2021-11-15T14:30:31.459 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-15T14:30:31.461 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:31.492 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T14:30:31.493 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:31.516 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.138) 0:02:11.948 ******* 2021-11-15T14:30:31.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T14:30:31.555 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T14:30:31.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.062) 0:02:12.010 ******* 2021-11-15T14:30:31.607 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T14:30:31.609 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T14:30:31.635 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.056) 0:02:12.067 ******* 2021-11-15T14:30:31.644 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T14:30:31.671 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.035) 0:02:12.103 ******* 2021-11-15T14:30:31.679 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T14:30:31.679 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.704 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.033) 0:02:12.137 ******* 2021-11-15T14:30:31.712 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.738 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.033) 0:02:12.170 ******* 2021-11-15T14:30:31.746 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T14:30:31.748 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true} 2021-11-15T14:30:31.749 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-15T14:30:31.774 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.036) 0:02:12.207 ******* 2021-11-15T14:30:31.796 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.021) 0:02:12.228 ******* 2021-11-15T14:30:31.816 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.020) 0:02:12.248 ******* 2021-11-15T14:30:31.822 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T14:30:31.824 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.849 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.032) 0:02:12.281 ******* 2021-11-15T14:30:31.885 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.035) 0:02:12.317 ******* 2021-11-15T14:30:31.892 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:31.918 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.033) 0:02:12.350 ******* 2021-11-15T14:30:31.925 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T14:30:31.927 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-15T14:30:31.953 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.034) 0:02:12.385 ******* 2021-11-15T14:30:31.977 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:31 +0000 (0:00:00.024) 0:02:12.409 ******* 2021-11-15T14:30:31.985 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T14:30:31.986 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T14:30:32.013 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.035) 0:02:12.445 ******* 2021-11-15T14:30:32.037 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.023) 0:02:12.469 ******* 2021-11-15T14:30:32.067 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T14:30:32.067 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T14:30:32.068 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.092 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.055) 0:02:12.524 ******* 2021-11-15T14:30:32.115 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.023) 0:02:12.548 ******* 2021-11-15T14:30:32.123 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:32.124 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:32.136 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T14:30:32.138 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:32.162 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.046) 0:02:12.594 ******* 2021-11-15T14:30:32.169 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T14:30:32.171 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.196 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.034) 0:02:12.628 ******* 2021-11-15T14:30:32.202 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:32.204 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:32.237 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T14:30:32.239 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.262 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.066) 0:02:12.694 ******* 2021-11-15T14:30:32.285 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.022) 0:02:12.717 ******* 2021-11-15T14:30:32.292 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:32.294 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T14:30:32.294 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:32.327 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.042) 0:02:12.759 ******* 2021-11-15T14:30:32.335 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T14:30:32.337 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.364 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.036) 0:02:12.796 ******* 2021-11-15T14:30:32.371 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-15T14:30:32.372 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-15T14:30:32.373 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.404 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.040) 0:02:12.836 ******* 2021-11-15T14:30:32.446 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-15T14:30:32.447 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:32.470 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.065) 0:02:12.902 ******* 2021-11-15T14:30:32.487 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T14:30:32.489 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:32.512 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.042) 0:02:12.945 ******* 2021-11-15T14:30:32.519 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-15T14:30:32.521 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T14:30:32.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.035) 0:02:12.980 ******* 2021-11-15T14:30:32.571 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.023) 0:02:13.003 ******* 2021-11-15T14:30:32.621 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T14:30:32.622 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T14:30:32.623 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:32.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.077) 0:02:13.081 ******* 2021-11-15T14:30:32.672 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.022) 0:02:13.104 ******* 2021-11-15T14:30:32.690 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-15T14:30:32.691 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:32.716 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.043) 0:02:13.148 ******* 2021-11-15T14:30:32.763 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-15T14:30:32.765 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-15T14:30:32.787 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.071) 0:02:13.219 ******* 2021-11-15T14:30:32.856 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T14:30:32.858 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T14:30:32.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:32 +0000 (0:00:00.102) 0:02:13.321 ******* 2021-11-15T14:30:32.981 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T14:30:33.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.117) 0:02:13.439 ******* 2021-11-15T14:30:33.013 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-15T14:30:33.015 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T14:30:33.041 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.034) 0:02:13.474 ******* 2021-11-15T14:30:33.068 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.026) 0:02:13.500 ******* 2021-11-15T14:30:33.201 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-15T14:30:33.203 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-15T14:30:33.227 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.159) 0:02:13.660 ******* 2021-11-15T14:30:33.254 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-15T14:30:33.256 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.280 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.052) 0:02:13.712 ******* 2021-11-15T14:30:33.307 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-15T14:30:33.309 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.332 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.052) 0:02:13.764 ******* 2021-11-15T14:30:33.339 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T14:30:33.340 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T14:30:33.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:33.368 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.035) 0:02:13.800 ******* 2021-11-15T14:30:33.389 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.021) 0:02:13.821 ******* 2021-11-15T14:30:33.395 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T14:30:33.397 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.421 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.032) 0:02:13.854 ******* 2021-11-15T14:30:33.439 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-15T14:30:33.441 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:33.466 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.044) 0:02:13.898 ******* 2021-11-15T14:30:33.472 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-15T14:30:33.474 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.497 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.030) 0:02:13.929 ******* 2021-11-15T14:30:33.618 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-15T14:30:33.620 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:33.653 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.155) 0:02:14.085 ******* 2021-11-15T14:30:33.660 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T14:30:33.661 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.158019", "end": "2021-11-15 14:30:33.770813", "rc": 0, "start": "2021-11-15 14:30:33.612794", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T14:30:33.689 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.036) 0:02:14.122 ******* 2021-11-15T14:30:33.708 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.110081", "end": "2021-11-15 14:30:33.682667", "rc": 0, "start": "2021-11-15 14:30:33.572586", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T14:30:33.733 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.043) 0:02:14.165 ******* 2021-11-15T14:30:33.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T14:30:33.743 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.036) 0:02:14.201 ******* 2021-11-15T14:30:33.776 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.777 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-15T14:30:33.777 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:33.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.032) 0:02:14.234 ******* 2021-11-15T14:30:33.824 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.022) 0:02:14.257 ******* 2021-11-15T14:30:33.831 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-15T14:30:33.832 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:33.833 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:33.860 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.035) 0:02:14.292 ******* 2021-11-15T14:30:33.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.029) 0:02:14.321 ******* 2021-11-15T14:30:33.914 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:33 +0000 (0:00:00.024) 0:02:14.346 ******* 2021-11-15T14:30:34.152 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-15T14:30:34.154 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-15T14:30:34.178 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.264) 0:02:14.610 ******* 2021-11-15T14:30:34.185 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T14:30:34.187 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.112123", "end": "2021-11-15 14:30:34.131718", "rc": 0, "start": "2021-11-15 14:30:34.019595", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T14:30:34.212 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.034) 0:02:14.645 ******* 2021-11-15T14:30:34.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T14:30:34.252 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.282 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.069) 0:02:14.715 ******* 2021-11-15T14:30:34.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T14:30:34.302 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:34.324 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.042) 0:02:14.757 ******* 2021-11-15T14:30:34.332 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:34.333 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-15T14:30:34.333 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.357 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.032) 0:02:14.789 ******* 2021-11-15T14:30:34.378 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.020) 0:02:14.810 ******* 2021-11-15T14:30:34.383 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T14:30:34.384 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.410 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.032) 0:02:14.843 ******* 2021-11-15T14:30:34.419 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.420 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-15T14:30:34.420 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-15T14:30:34.449 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.038) 0:02:14.881 ******* 2021-11-15T14:30:34.478 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.028) 0:02:14.910 ******* 2021-11-15T14:30:34.665 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T14:30:34.667 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T14:30:34.692 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.213) 0:02:15.124 ******* 2021-11-15T14:30:34.700 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T14:30:34.724 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.032) 0:02:15.157 ******* 2021-11-15T14:30:34.730 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T14:30:34.732 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.754 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.029) 0:02:15.186 ******* 2021-11-15T14:30:34.760 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.785 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.030) 0:02:15.217 ******* 2021-11-15T14:30:34.801 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T14:30:34.802 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:34.826 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.041) 0:02:15.258 ******* 2021-11-15T14:30:34.853 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-15T14:30:34.854 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:34.883 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.057) 0:02:15.315 ******* 2021-11-15T14:30:34.911 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-15T14:30:34.912 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T14:30:34.914 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:07 UTC", "ActiveEnterTimestampMonotonic": "12366069", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target sysinit.target -.mount systemd-tmpfiles-setup.service system.slice network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:07 UTC", "AssertTimestampMonotonic": "12246881", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:07 UTC", "ConditionTimestampMonotonic": "12246880", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-15T14:30:34.915 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "950", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:07 UTC", "ExecMainStartTimestampMonotonic": "12366059", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:07 UTC", "InactiveExitTimestampMonotonic": "12247557", "InvocationID": "e0b4957a2a8244fcba9469b05209b0c3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T14:30:34.917 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "950", "MemoryAccounting": "yes", "MemoryCurrent": "3919872", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requir 2021-11-15T14:30:34.919 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:07 UTC", "StateChangeTimestampMonotonic": "12366069", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:30:34.940 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.057) 0:02:15.373 ******* 2021-11-15T14:30:34.963 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.022) 0:02:15.395 ******* 2021-11-15T14:30:34.971 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:18 UTC", "ActiveEnterTimestampMonotonic": "12748667", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket basic.target systemd-tmpfiles-setup.service sysinit.target system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:17 UTC", "AssertTimestampMonotonic": "12586615", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:17 UTC", "ConditionTimestampMonotonic": "12586614", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-15T14:30:34.973 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "953", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:18 UTC", "ExecMainStartTimestampMonotonic": "12748658", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:17 UTC", "InactiveExitTimestampMonotonic": "12587250", "InvocationID": "7999d88576244414a0e55ada853611b0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T14:30:34.974 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "953", "MemoryAccounting": "yes", "MemoryCurrent": "3665920", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-11-15T14:30:34.976 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:18 UTC", "StateChangeTimestampMonotonic": "12748667", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : set_fact] ***************************************************** ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T14:30:35.000 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:34 +0000 (0:00:00.037) 0:02:15.432 ******* 2021-11-15T14:30:35.022 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.022) 0:02:15.455 ******* 2021-11-15T14:30:35.040 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:35.042 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : set_fact] ***************************************************** ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T14:30:35.064 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.042) 0:02:15.497 ******* 2021-11-15T14:30:35.085 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.020) 0:02:15.517 ******* 2021-11-15T14:30:35.091 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T14:30:35.092 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.117 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.032) 0:02:15.549 ******* 2021-11-15T14:30:35.124 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:35.126 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T14:30:35.152 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.034) 0:02:15.584 ******* 2021-11-15T14:30:35.161 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T14:30:35.161 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-15T14:30:35.188 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.036) 0:02:15.621 ******* 2021-11-15T14:30:35.193 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T14:30:35.195 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.219 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.031) 0:02:15.652 ******* 2021-11-15T14:30:35.226 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T14:30:35.228 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.261 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.041) 0:02:15.693 ******* 2021-11-15T14:30:35.267 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-15T14:30:35.269 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.174351", "end": "2021-11-15 14:30:35.234715", "rc": 0, "start": "2021-11-15 14:30:35.060364", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-15T14:30:35.296 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.035) 0:02:15.728 ******* 2021-11-15T14:30:35.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-15T14:30:35.337 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.359 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.063) 0:02:15.791 ******* 2021-11-15T14:30:35.385 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.408 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.049) 0:02:15.841 ******* 2021-11-15T14:30:35.426 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T14:30:35.428 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:12 UTC", "ActiveEnterTimestampMonotonic": "12939970", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket -.mount network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:12 UTC", "AssertTimestampMonotonic": "12835242", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:12 UTC", "ConditionTimestampMonotonic": "12835241", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-15T14:30:35.430 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "954", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:12 UTC", "ExecMainStartTimestampMonotonic": "12939961", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:12 UTC", "InactiveExitTimestampMonotonic": "12836450", "InvocationID": "4d327ea0fc0e4ccf87fa6859e1182efb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T14:30:35.431 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "954", "MemoryAccounting": "yes", "MemoryCurrent": "3940352", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requir 2021-11-15T14:30:35.433 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:12 UTC", "StateChangeTimestampMonotonic": "12939970", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:30:35.454 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.046) 0:02:15.887 ******* 2021-11-15T14:30:35.480 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:35.482 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T14:30:35.505 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.050) 0:02:15.937 ******* 2021-11-15T14:30:35.543 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:35.545 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T14:30:35.570 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.064) 0:02:16.002 ******* 2021-11-15T14:30:35.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T14:30:35.600 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.634 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.064) 0:02:16.067 ******* 2021-11-15T14:30:35.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-15T14:30:35.837 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:30:35.868 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.233) 0:02:16.300 ******* 2021-11-15T14:30:35.897 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:35.923 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:35 +0000 (0:00:00.054) 0:02:16.355 ******* 2021-11-15T14:30:36.129 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T14:30:36.130 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:36.162 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.239) 0:02:16.594 ******* 2021-11-15T14:30:36.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-15T14:30:36.192 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:36.228 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.065) 0:02:16.660 ******* 2021-11-15T14:30:36.254 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.026) 0:02:16.686 ******* 2021-11-15T14:30:36.260 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T14:30:36.262 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:36.286 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.032) 0:02:16.719 ******* 2021-11-15T14:30:36.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-15T14:30:36.294 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:36.323 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.037) 0:02:16.756 ******* 2021-11-15T14:30:36.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T14:30:36.331 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:36.355 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.031) 0:02:16.787 ******* 2021-11-15T14:30:36.365 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T14:30:36.366 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:36.399 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.044) 0:02:16.831 ******* 2021-11-15T14:30:36.481 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-15T14:30:36.482 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:27:00 UTC", "ActiveEnterTimestampMonotonic": "12711001", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket -.mount basic.target sysinit.target network.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:27:00 UTC", "AssertTimestampMonotonic": "12586773", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:27:00 UTC", "ConditionTimestampMonotonic": "12586772", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-15T14:30:36.484 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "949", "ExecMainStartTimestamp": "Mon 2021-11-15 14:27:00 UTC", "ExecMainStartTimestampMonotonic": "12710992", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-11-15 14:27:00 UTC", "InactiveExitTimestampMonotonic": "12587374", "InvocationID": "eb5d5309d67a41e892da156b8f43b458", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-15T14:30:36.485 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "949", "MemoryAccounting": "yes", "MemoryCurrent": "4050944", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-11-15T14:30:36.487 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:27:00 UTC", "StateChangeTimestampMonotonic": "12711001", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:30:36.509 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.110) 0:02:16.942 ******* 2021-11-15T14:30:36.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T14:30:36.517 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:36.541 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.031) 0:02:16.973 ******* 2021-11-15T14:30:36.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.020) 0:02:16.994 ******* 2021-11-15T14:30:36.568 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:36.570 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-15T14:30:36.594 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.032) 0:02:17.026 ******* 2021-11-15T14:30:36.601 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:36.625 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.030) 0:02:17.057 ******* 2021-11-15T14:30:36.631 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:36.633 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-15T14:30:36.665 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.040) 0:02:17.097 ******* 2021-11-15T14:30:36.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-15T14:30:36.694 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:36.715 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.049) 0:02:17.147 ******* 2021-11-15T14:30:36.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T14:30:36.743 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T14:30:36.767 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.052) 0:02:17.200 ******* 2021-11-15T14:30:36.775 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T14:30:36.776 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:36.802 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.034) 0:02:17.234 ******* 2021-11-15T14:30:36.883 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T14:30:36.885 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T14:30:36.910 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:36 +0000 (0:00:00.108) 0:02:17.342 ******* 2021-11-15T14:30:37.138 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T14:30:37.171 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:37 +0000 (0:00:00.260) 0:02:17.603 ******* 2021-11-15T14:30:37.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-15T14:30:37.633 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:30:37.657 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:37 +0000 (0:00:00.486) 0:02:18.090 ******* 2021-11-15T14:30:37.685 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-15T14:30:37.686 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:37.709 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:37 +0000 (0:00:00.052) 0:02:18.142 ******* 2021-11-15T14:30:37.841 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-15T14:30:37.843 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-15T14:30:37.866 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:37 +0000 (0:00:00.156) 0:02:18.298 ******* 2021-11-15T14:30:38.180 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-15T14:30:38.182 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-15T14:30:38.203 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:38 +0000 (0:00:00.337) 0:02:18.636 ******* 2021-11-15T14:30:38.688 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T14:30:38.690 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T14:30:38.712 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:38 +0000 (0:00:00.508) 0:02:19.144 ******* 2021-11-15T14:30:38.740 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T14:30:38.766 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:38 +0000 (0:00:00.053) 0:02:19.198 ******* 2021-11-15T14:30:38.794 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T14:30:38.820 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:38 +0000 (0:00:00.054) 0:02:19.253 ******* 2021-11-15T14:30:39.056 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T14:30:39.058 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false} 2021-11-15T14:30:39.082 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.261) 0:02:19.514 ******* 2021-11-15T14:30:39.108 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T14:30:39.110 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T14:30:39.133 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.051) 0:02:19.566 ******* 2021-11-15T14:30:39.141 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-15T14:30:39.142 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false} 2021-11-15T14:30:39.168 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.034) 0:02:19.601 ******* 2021-11-15T14:30:39.196 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T14:30:39.198 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} TASK [testnode : Purge resolvconf] ********************************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false} 2021-11-15T14:30:39.221 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.052) 0:02:19.653 ******* 2021-11-15T14:30:39.244 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.022) 0:02:19.676 ******* 2021-11-15T14:30:39.262 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T14:30:39.263 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986027.467429, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636986027.463429, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636986027.463429, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:30:39.288 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.043) 0:02:19.720 ******* 2021-11-15T14:30:39.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-15T14:30:39.298 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T14:30:39.323 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.035) 0:02:19.755 ******* 2021-11-15T14:30:39.352 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T14:30:39.354 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986026.4226398, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636986026.4146397, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636986026.4146397, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:30:39.380 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.057) 0:02:19.813 ******* 2021-11-15T14:30:39.463 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986023.6664057, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636986023.6624057, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636986023.6624057, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:30:39.498 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.117) 0:02:19.930 ******* 2021-11-15T14:30:39.652 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-15T14:30:39.654 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T14:30:39.677 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.179) 0:02:20.110 ******* 2021-11-15T14:30:39.702 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.023) 0:02:20.134 ******* 2021-11-15T14:30:39.709 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T14:30:39.710 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T14:30:39.737 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.035) 0:02:20.169 ******* 2021-11-15T14:30:39.760 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.023) 0:02:20.193 ******* 2021-11-15T14:30:39.767 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T14:30:39.768 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T14:30:39.768 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:39.794 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.033) 0:02:20.226 ******* 2021-11-15T14:30:39.817 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.022) 0:02:20.249 ******* 2021-11-15T14:30:39.824 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-15T14:30:39.826 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T14:30:39.861 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.043) 0:02:20.293 ******* 2021-11-15T14:30:39.869 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T14:30:39.870 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:39.895 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.034) 0:02:20.327 ******* 2021-11-15T14:30:39.902 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:39.938 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.042) 0:02:20.370 ******* 2021-11-15T14:30:39.945 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T14:30:39.947 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T14:30:39.972 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:39 +0000 (0:00:00.034) 0:02:20.405 ******* 2021-11-15T14:30:39.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-15T14:30:39.981 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-15T14:30:40.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.033) 0:02:20.439 ******* 2021-11-15T14:30:40.054 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-15T14:30:40.056 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T14:30:40.089 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.082) 0:02:20.521 ******* 2021-11-15T14:30:40.097 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T14:30:40.123 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.034) 0:02:20.555 ******* 2021-11-15T14:30:40.151 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T14:30:40.153 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T14:30:40.177 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.053) 0:02:20.609 ******* 2021-11-15T14:30:40.204 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T14:30:40.206 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.227 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.050) 0:02:20.660 ******* 2021-11-15T14:30:40.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T14:30:40.235 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T14:30:40.260 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.032) 0:02:20.692 ******* 2021-11-15T14:30:40.268 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T14:30:40.270 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.280 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.282 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.283 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.307 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.046) 0:02:20.739 ******* 2021-11-15T14:30:40.330 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.022) 0:02:20.762 ******* 2021-11-15T14:30:40.338 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-15T14:30:40.339 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T14:30:40.366 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.036) 0:02:20.798 ******* 2021-11-15T14:30:40.372 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T14:30:40.374 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.374 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.374 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.375 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T14:30:40.375 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.376 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] **************** 2021-11-15T14:30:40.377 INFO:teuthology.task.ansible.out:****************** skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.387 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T14:30:40.389 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.390 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba032.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.391 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.392 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [gibba035.front.sepia.ceph.com] => {"changed": false} 2021-11-15T14:30:40.393 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-15T14:30:40.393 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.416 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.050) 0:02:20.849 ******* 2021-11-15T14:30:40.439 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.022) 0:02:20.871 ******* 2021-11-15T14:30:40.460 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.021) 0:02:20.893 ******* 2021-11-15T14:30:40.484 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.023) 0:02:20.917 ******* 2021-11-15T14:30:40.490 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:40.492 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.494 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.494 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-15T14:30:40.530 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.046) 0:02:20.963 ******* 2021-11-15T14:30:40.555 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.024) 0:02:20.987 ******* 2021-11-15T14:30:40.562 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T14:30:40.563 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba032.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.565 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T14:30:40.567 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.567 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.567 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.569 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.597 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.041) 0:02:21.029 ******* 2021-11-15T14:30:40.627 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.030) 0:02:21.059 ******* 2021-11-15T14:30:40.658 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.030) 0:02:21.090 ******* 2021-11-15T14:30:40.667 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T14:30:40.669 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.705 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.046) 0:02:21.136 ******* 2021-11-15T14:30:40.739 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.034) 0:02:21.171 ******* 2021-11-15T14:30:40.749 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-15T14:30:40.754 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986028.5104191, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636986028.5064192, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636986028.5064192, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "it 2021-11-15T14:30:40.756 INFO:teuthology.task.ansible.out:em": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.757 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T14:30:40.758 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.786 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.047) 0:02:21.218 ******* 2021-11-15T14:30:40.814 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.027) 0:02:21.246 ******* 2021-11-15T14:30:40.841 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.027) 0:02:21.273 ******* 2021-11-15T14:30:40.850 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T14:30:40.851 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.890 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.049) 0:02:21.323 ******* 2021-11-15T14:30:40.919 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.028) 0:02:21.351 ******* 2021-11-15T14:30:40.927 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:40.929 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:40.965 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:40 +0000 (0:00:00.046) 0:02:21.398 ******* 2021-11-15T14:30:41.144 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.178) 0:02:21.576 ******* 2021-11-15T14:30:41.151 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T14:30:41.153 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-15T14:30:41.154 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.184 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.039) 0:02:21.616 ******* 2021-11-15T14:30:41.208 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.024) 0:02:21.640 ******* 2021-11-15T14:30:41.236 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.028) 0:02:21.668 ******* 2021-11-15T14:30:41.243 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T14:30:41.244 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.245 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T14:30:41.247 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.271 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.035) 0:02:21.704 ******* 2021-11-15T14:30:41.299 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.027) 0:02:21.731 ******* 2021-11-15T14:30:41.326 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.026) 0:02:21.758 ******* 2021-11-15T14:30:41.334 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-15T14:30:41.358 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.032) 0:02:21.790 ******* 2021-11-15T14:30:41.363 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T14:30:41.365 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.392 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.033) 0:02:21.824 ******* 2021-11-15T14:30:41.417 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.025) 0:02:21.849 ******* 2021-11-15T14:30:41.423 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-15T14:30:41.425 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba019.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002547", "end": "2021-11-15 14:30:41.389464", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 14:30:41.386917", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:41.449 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.032) 0:02:21.881 ******* 2021-11-15T14:30:41.456 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T14:30:41.457 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.485 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.035) 0:02:21.917 ******* 2021-11-15T14:30:41.523 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.038) 0:02:21.956 ******* 2021-11-15T14:30:41.531 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:41.532 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001732", "end": "2021-11-15 14:30:41.494251", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 14:30:41.492519", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.561 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.037) 0:02:21.993 ******* 2021-11-15T14:30:41.568 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T14:30:41.570 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.595 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.034) 0:02:22.028 ******* 2021-11-15T14:30:41.601 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T14:30:41.603 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-15T14:30:41.628 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.032) 0:02:22.060 ******* 2021-11-15T14:30:41.649 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.020) 0:02:22.081 ******* 2021-11-15T14:30:41.655 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:41.657 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001682", "end": "2021-11-15 14:30:41.599828", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 14:30:41.598146", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.687 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.037) 0:02:22.119 ******* 2021-11-15T14:30:41.726 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-15T14:30:41.727 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.752 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.064) 0:02:22.184 ******* 2021-11-15T14:30:41.758 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:41.759 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030351", "end": "2021-11-15 14:30:41.729380", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 14:30:41.699029", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:41.786 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.034) 0:02:22.219 ******* 2021-11-15T14:30:41.793 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002465", "end": "2021-11-15 14:30:41.743505", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 14:30:41.741040", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:41.794 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.795 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [gibba035.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-15T14:30:41.818 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.031) 0:02:22.250 ******* 2021-11-15T14:30:41.838 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.019) 0:02:22.270 ******* 2021-11-15T14:30:41.843 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T14:30:41.845 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.869 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.030) 0:02:22.301 ******* 2021-11-15T14:30:41.891 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:41 +0000 (0:00:00.022) 0:02:22.324 ******* 2021-11-15T14:30:41.898 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:41.900 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001724", "end": "2021-11-15 14:30:41.848742", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 14:30:41.847018", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.946 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-15T14:30:41.948 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.969 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.971 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.981 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-15T14:30:41.982 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba032.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001709", "end": "2021-11-15 14:30:41.950016", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 14:30:41.948307", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:41.984 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002470", "end": "2021-11-15 14:30:41.950306", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 14:30:41.947836", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.006 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.114) 0:02:22.438 ******* 2021-11-15T14:30:42.045 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-15T14:30:42.046 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.057 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.058 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.069 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.094 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.088) 0:02:22.526 ******* 2021-11-15T14:30:42.101 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:42.102 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001672", "end": "2021-11-15 14:30:42.053764", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 14:30:42.052092", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.123 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-15T14:30:42.125 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba032.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028436", "end": "2021-11-15 14:30:42.079632", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 14:30:42.051196", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.151 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.056) 0:02:22.583 ******* 2021-11-15T14:30:42.178 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.027) 0:02:22.610 ******* 2021-11-15T14:30:42.184 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T14:30:42.185 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:42.185 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001687", "end": "2021-11-15 14:30:42.160521", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 14:30:42.158834", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.211 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.033) 0:02:22.643 ******* 2021-11-15T14:30:42.217 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-15T14:30:42.219 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.244 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.032) 0:02:22.676 ******* 2021-11-15T14:30:42.249 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T14:30:42.251 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.275 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-15T14:30:42.277 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.312 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.068) 0:02:22.744 ******* 2021-11-15T14:30:42.339 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-15T14:30:42.341 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba038.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.039375", "end": "2021-11-15 14:30:42.302120", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 14:30:42.262745", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.366 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.054) 0:02:22.799 ******* 2021-11-15T14:30:42.396 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.029) 0:02:22.828 ******* 2021-11-15T14:30:42.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-15T14:30:42.403 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.429 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.033) 0:02:22.861 ******* 2021-11-15T14:30:42.436 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T14:30:42.459 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.030) 0:02:22.892 ******* 2021-11-15T14:30:42.466 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T14:30:42.467 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.493 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.033) 0:02:22.925 ******* 2021-11-15T14:30:42.499 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T14:30:42.501 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.525 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.548 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.055) 0:02:22.981 ******* 2021-11-15T14:30:42.580 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-15T14:30:42.582 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:42.602 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:42 +0000 (0:00:00.053) 0:02:23.034 ******* 2021-11-15T14:30:42.742 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-15T14:30:42.744 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002513", "end": "2021-11-15 14:30:42.722952", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-15 14:30:42.720439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.847 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001795", "end": "2021-11-15 14:30:42.828313", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-15 14:30:42.826518", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:42.941 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001629", "end": "2021-11-15 14:30:42.927077", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-15 14:30:42.925448", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:43.066 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026043", "end": "2021-11-15 14:30:43.048818", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-15 14:30:43.022775", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:30:43.091 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.489) 0:02:23.523 ******* 2021-11-15T14:30:43.117 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-15T14:30:43.139 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.048) 0:02:23.572 ******* 2021-11-15T14:30:43.166 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-15T14:30:43.168 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:43.245 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-15T14:30:43.265 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.125) 0:02:23.698 ******* 2021-11-15T14:30:43.287 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.021) 0:02:23.719 ******* 2021-11-15T14:30:43.309 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.021) 0:02:23.741 ******* 2021-11-15T14:30:43.333 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:43 +0000 (0:00:00.024) 0:02:23.766 ******* 2021-11-15T14:30:44.049 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba019.front.sepia.ceph.com] 2021-11-15T14:30:44.103 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.769) 0:02:24.535 ******* 2021-11-15T14:30:44.117 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] 2021-11-15T14:30:44.129 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] 2021-11-15T14:30:44.173 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:44.174 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T14:30:44.196 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.093) 0:02:24.628 ******* 2021-11-15T14:30:44.223 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.027) 0:02:24.656 ******* 2021-11-15T14:30:44.243 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.019) 0:02:24.676 ******* 2021-11-15T14:30:44.254 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba038.front.sepia.ceph.com] 2021-11-15T14:30:44.262 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:44.264 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : set_fact] *********************************************** ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T14:30:44.290 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.046) 0:02:24.722 ******* 2021-11-15T14:30:44.313 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.022) 0:02:24.745 ******* 2021-11-15T14:30:44.339 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T14:30:44.341 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:44.363 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.049) 0:02:24.795 ******* 2021-11-15T14:30:44.385 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.021) 0:02:24.817 ******* 2021-11-15T14:30:44.412 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.027) 0:02:24.844 ******* 2021-11-15T14:30:44.438 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.026) 0:02:24.870 ******* 2021-11-15T14:30:44.444 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T14:30:44.446 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T14:30:44.477 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.038) 0:02:24.909 ******* 2021-11-15T14:30:44.484 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:44.486 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : set_fact] *********************************************** ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-15T14:30:44.512 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.035) 0:02:24.945 ******* 2021-11-15T14:30:44.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.022) 0:02:24.967 ******* 2021-11-15T14:30:44.553 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T14:30:44.554 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T14:30:44.578 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.043) 0:02:25.010 ******* 2021-11-15T14:30:44.585 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:44.586 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:44.614 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.035) 0:02:25.046 ******* 2021-11-15T14:30:44.664 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-15T14:30:44.665 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-15T14:30:44.689 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:44 +0000 (0:00:00.075) 0:02:25.121 ******* 2021-11-15T14:30:57.634 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T14:30:57.636 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T14:30:57.638 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T14:30:57.658 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:12.969) 0:02:38.090 ******* 2021-11-15T14:30:57.686 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:57.687 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:57.708 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.050) 0:02:38.141 ******* 2021-11-15T14:30:57.746 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:57.747 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T14:30:57.769 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.060) 0:02:38.201 ******* 2021-11-15T14:30:57.797 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T14:30:57.799 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T14:30:57.800 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T14:30:57.823 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.054) 0:02:38.256 ******* 2021-11-15T14:30:57.831 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.8 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T14:30:57.833 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.8 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-15T14:30:57.856 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.032) 0:02:38.288 ******* 2021-11-15T14:30:57.863 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:57.864 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:57.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.033) 0:02:38.322 ******* 2021-11-15T14:30:57.895 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-15T14:30:57.896 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-15T14:30:57.898 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} TASK [container-host : set_fact] *********************************************** skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": 2021-11-15T14:30:57.900 INFO:teuthology.task.ansible.out: "Conditional result was False"} 2021-11-15T14:30:57.922 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.032) 0:02:38.355 ******* 2021-11-15T14:30:57.946 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.023) 0:02:38.378 ******* 2021-11-15T14:30:57.953 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:57.955 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [gibba019.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:57.956 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba032.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T14:30:57.980 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.034) 0:02:38.412 ******* 2021-11-15T14:30:58.002 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:57 +0000 (0:00:00.021) 0:02:38.434 ******* 2021-11-15T14:30:58.010 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:58.012 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:30:58.037 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.035) 0:02:38.470 ******* 2021-11-15T14:30:58.066 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T14:30:58.068 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.092 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.055) 0:02:38.525 ******* 2021-11-15T14:30:58.103 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-15T14:30:58.104 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-15T14:30:58.129 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.036) 0:02:38.561 ******* 2021-11-15T14:30:58.136 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T14:30:58.138 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.161 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.234 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.262 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.133) 0:02:38.694 ******* 2021-11-15T14:30:58.290 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.319 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.056) 0:02:38.751 ******* 2021-11-15T14:30:58.326 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.412 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-15T14:30:58.414 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.424 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-15T14:30:58.425 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-15T14:30:58.450 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.131) 0:02:38.883 ******* 2021-11-15T14:30:58.614 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-15T14:30:58.616 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.647 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.691 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.727 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.276) 0:02:39.159 ******* 2021-11-15T14:30:58.819 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.862 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.889 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.162) 0:02:39.322 ******* 2021-11-15T14:30:58.939 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:58.967 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:58 +0000 (0:00:00.077) 0:02:39.399 ******* 2021-11-15T14:30:59.131 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-15T14:30:59.159 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:59 +0000 (0:00:00.192) 0:02:39.591 ******* 2021-11-15T14:30:59.219 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-15T14:30:59.220 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"cache_update_time": 1636986138, "cache_updated": false, "changed": false} 2021-11-15T14:30:59.245 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:59 +0000 (0:00:00.085) 0:02:39.677 ******* 2021-11-15T14:30:59.388 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"cache_update_time": 1636986240, "cache_updated": false, "changed": false} 2021-11-15T14:30:59.414 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:59 +0000 (0:00:00.168) 0:02:39.846 ******* 2021-11-15T14:30:59.494 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636986189, "cache_updated": false, "changed": false} 2021-11-15T14:30:59.520 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:59 +0000 (0:00:00.106) 0:02:39.952 ******* 2021-11-15T14:30:59.684 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"cache_update_time": 1636986087, "cache_updated": false, "changed": false} 2021-11-15T14:30:59.709 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:30:59 +0000 (0:00:00.189) 0:02:40.142 ******* 2021-11-15T14:31:02.674 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T14:31:02.676 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-7ljb8dc5\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-7ljb8dc5"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-7ljb8dc5\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8\n Stored in directory: /tmp/pip-ephem-wheel-cache-4kiyi6l7/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T14:31:02.677 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-7ljb8dc5", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8", " Stored in directory: /tmp/pip-ephem-wheel-cache-4kiyi6l7/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T14:31:02.700 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:02 +0000 (0:00:02.991) 0:02:43.133 ******* 2021-11-15T14:31:02.814 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-0in21l67\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-0in21l67"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-0in21l67\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8\n Stored in directory: /tmp/pip-ephem-wheel-cache-9bxj1bv_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T14:31:02.816 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-0in21l67", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8", " Stored in directory: /tmp/pip-ephem-wheel-cache-9bxj1bv_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T14:31:02.841 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:02 +0000 (0:00:00.140) 0:02:43.274 ******* 2021-11-15T14:31:02.893 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T14:31:02.895 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986015.358608, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:31:02.924 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:02 +0000 (0:00:00.082) 0:02:43.356 ******* 2021-11-15T14:31:02.961 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T14:31:02.962 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:31:02.984 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:02 +0000 (0:00:00.060) 0:02:43.417 ******* 2021-11-15T14:31:03.001 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T14:31:03.002 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-pqg5i9wu\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-pqg5i9wu"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-pqg5i9wu\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8\n Stored in directory: /tmp/pip-ephem-wheel-cache-8zukd9j8/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T14:31:03.004 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-pqg5i9wu", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=5d246727d4e2d47f6e7b7e92975d13be36525f6fe1b68eb4a90b3d06bfb515c8", " Stored in directory: /tmp/pip-ephem-wheel-cache-8zukd9j8/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T14:31:03.027 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.042) 0:02:43.459 ******* 2021-11-15T14:31:03.033 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T14:31:03.035 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986015.7073948, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:31:03.060 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.032) 0:02:43.492 ******* 2021-11-15T14:31:03.099 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T14:31:03.100 INFO:teuthology.task.ansible.out:skipping: [gibba032.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:31:03.121 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.061) 0:02:43.553 ******* 2021-11-15T14:31:03.178 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-15T14:31:03.180 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.059779", "end": "2021-11-15 14:31:03.157437", "rc": 0, "start": "2021-11-15 14:31:03.097658", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:31:03.203 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.081) 0:02:43.635 ******* 2021-11-15T14:31:03.210 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T14:31:03.211 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986012.766374, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:31:03.244 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.041) 0:02:43.676 ******* 2021-11-15T14:31:03.252 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-15T14:31:03.253 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-bud6uwi3\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-bud6uwi3"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-bud6uwi3\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=04095b7b295d08afe44673b0023e8d307101925961186e7276755bc8463ff273\n Stored in directory: /tmp/pip-ephem-wheel-cache-uh8urkfz/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-15T14:31:03.255 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-bud6uwi3", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=04095b7b295d08afe44673b0023e8d307101925961186e7276755bc8463ff273", " Stored in directory: /tmp/pip-ephem-wheel-cache-uh8urkfz/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-15T14:31:03.279 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.035) 0:02:43.712 ******* 2021-11-15T14:31:03.286 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T14:31:03.288 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:31:03.314 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.034) 0:02:43.746 ******* 2021-11-15T14:31:03.352 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-15T14:31:03.354 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.086347", "end": "2021-11-15 14:31:03.325214", "rc": 0, "start": "2021-11-15 14:31:03.238867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:31:03.383 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.069) 0:02:43.815 ******* 2021-11-15T14:31:03.466 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-15T14:31:03.468 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636986015.8383822, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-15T14:31:03.493 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.110) 0:02:43.925 ******* 2021-11-15T14:31:03.511 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-15T14:31:03.513 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.051903", "end": "2021-11-15 14:31:03.489723", "rc": 0, "start": "2021-11-15 14:31:03.437820", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:31:03.535 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.042) 0:02:43.967 ******* 2021-11-15T14:31:03.540 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-15T14:31:03.542 INFO:teuthology.task.ansible.out:skipping: [gibba035.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-15T14:31:03.566 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.030) 0:02:43.998 ******* 2021-11-15T14:31:03.751 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-15T14:31:03.753 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.048562", "end": "2021-11-15 14:31:03.739364", "rc": 0, "start": "2021-11-15 14:31:03.690802", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-15T14:31:03.774 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:03 +0000 (0:00:00.207) 0:02:44.206 ******* 2021-11-15T14:31:04.944 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-15T14:31:04.946 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:30:55 UTC", "ActiveEnterTimestampMonotonic": "230342512", "ActiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ActiveExitTimestampMonotonic": "229396011", "ActiveState": "active", "After": "network-online.target containerd.service systemd-journald.socket docker.socket system.slice firewalld.service sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:30:54 UTC", "AssertTimestampMonotonic": "229401090", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ConditionTimestampMonotonic": "229401090", "ConfigurationDirectoryMode": "0755", 2021-11-15T14:31:04.947 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8505", "ExecMainStartTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ExecMainStartTimestampMonotonic": "229401462", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T14:31:04.949 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveEnterTimestampMonotonic": "229398565", "InactiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveExitTimestampMonotonic": "229401702", "InvocationID": "61b229c88b9f4354817632deca1d56ad", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8505", "MemoryAccounting": "yes", "MemoryCurrent": "46977024", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T14:31:04.951 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:30:55 UTC", "StateChangeTimestampMonotonic": "230342512", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "25", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T14:31:04.952 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:31:04.975 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:30:55 UTC", "ActiveEnterTimestampMonotonic": "240316237", "ActiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ActiveExitTimestampMonotonic": "239495612", "ActiveState": "active", "After": "network-online.target sysinit.target docker.socket basic.target containerd.service system.slice firewalld.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:30:54 UTC", "AssertTimestampMonotonic": "239500620", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ConditionTimestampMonotonic": "239500620", "ConfigurationDirectoryMode": "0755", 2021-11-15T14:31:04.977 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8417", "ExecMainStartTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ExecMainStartTimestampMonotonic": "239500969", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T14:31:04.978 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveEnterTimestampMonotonic": "239498250", "InactiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveExitTimestampMonotonic": "239501253", "InvocationID": "d93ea32ae36a411494f5ad743e35c885", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8417", "MemoryAccounting": "yes", "MemoryCurrent": "49836032", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T14:31:04.980 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:30:55 UTC", "StateChangeTimestampMonotonic": "240316237", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "23", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T14:31:04.982 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-15T14:31:04.982 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:31:05.071 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:30:55 UTC", "ActiveEnterTimestampMonotonic": "236442630", "ActiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ActiveExitTimestampMonotonic": "235645327", "ActiveState": "active", "After": "sysinit.target system.slice systemd-journald.socket network-online.target basic.target containerd.service docker.socket firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:30:54 UTC", "AssertTimestampMonotonic": "235650205", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ConditionTimestampMonotonic": "235650205", "ConfigurationDirectoryMode": "0755", 2021-11-15T14:31:05.072 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8458", "ExecMainStartTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ExecMainStartTimestampMonotonic": "235650577", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T14:31:05.074 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveEnterTimestampMonotonic": "235648008", "InactiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveExitTimestampMonotonic": "235650753", "InvocationID": "e2a2236b0be74bf2abd231a6dcaed390", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8458", "MemoryAccounting": "yes", "MemoryCurrent": "47599616", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T14:31:05.076 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:30:55 UTC", "StateChangeTimestampMonotonic": "236442630", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "23", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartU 2021-11-15T14:31:05.076 INFO:teuthology.task.ansible.out:Sec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T14:31:05.078 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:31:05.432 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-11-15 14:30:55 UTC", "ActiveEnterTimestampMonotonic": "247271488", "ActiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ActiveExitTimestampMonotonic": "246426325", "ActiveState": "active", "After": "firewalld.service systemd-journald.socket docker.socket containerd.service system.slice sysinit.target network-online.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-11-15 14:30:54 UTC", "AssertTimestampMonotonic": "246431081", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ConditionTimestampMonotonic": "246431080", "ConfigurationDirectoryMode": "0755", 2021-11-15T14:31:05.434 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8482", "ExecMainStartTimestamp": "Mon 2021-11-15 14:30:54 UTC", "ExecMainStartTimestampMonotonic": "246431444", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-15T14:31:05.436 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveEnterTimestampMonotonic": "246428744", "InactiveExitTimestamp": "Mon 2021-11-15 14:30:54 UTC", "InactiveExitTimestampMonotonic": "246431697", "InvocationID": "fa9a98ecf0f840ca89907bb23d30ca46", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8482", "MemoryAccounting": "yes", "MemoryCurrent": "48668672", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-15T14:31:05.437 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-11-15 14:30:55 UTC", "StateChangeTimestampMonotonic": "247271488", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "26", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-15T14:31:05.439 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-15T14:31:05.439 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-15T14:31:05.510 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-15T14:31:05.511 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-15T14:31:05.513 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-11-15T14:31:05.514 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-15T14:31:05.528 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-15T14:31:05.530 INFO:teuthology.task.ansible.out:Monday 15 November 2021 14:31:05 +0000 (0:00:01.754) 0:02:45.961 ******* 2021-11-15T14:31:06.306 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-15T14:31:06.328 INFO:teuthology.task.ansible.out:ok: [gibba032.front.sepia.ceph.com] 2021-11-15T14:31:06.380 INFO:teuthology.task.ansible.out:ok: [gibba035.front.sepia.ceph.com] 2021-11-15T14:31:06.403 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-15T14:31:06.423 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Monday 15 November 2021 14:31:06 +0000 (0:00:00.894) 0:02:46.855 ******* 2021-11-15T14:31:06.552 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T14:31:06.574 INFO:teuthology.task.ansible.out:changed: [gibba032.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T14:31:06.595 INFO:teuthology.task.ansible.out:changed: [gibba035.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T14:31:06.638 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-15T14:31:06.640 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-11-15T14:31:06.642 INFO:teuthology.task.ansible.out:gibba019.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba032.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba035.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba038.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Monday 15 November 2021 14:31:06 +0000 (0:00:00.217) 0:02:47.073 ******* =============================================================================== Create all admin users with sudo access. ------------------------------- 15.62s users : Update authorized_keys using the keys repo --------------------- 15.09s container-host : Install container packages ---------------------------- 12.97s testnode : Upgrade packages -------------------------------------------- 12.86s testnode : Install packages --------------------------------------------- 8.75s testnode : Zap all non-root disks --------------------------------------- 5.63s testnode : Ensure packages are not present. ----------------------------- 5.50s Remove revoked users ---------------------------------------------------- 4.74s container-host : Install registries-conf-ctl ---------------------------- 2.99s common : Update apt cache ----------------------------------------------- 2.70s Gathering Facts --------------------------------------------------------- 1.75s container-host : Restart docker service --------------------------------- 1.75s users : Update authorized_keys for each user with literal keys ---------- 0.94s Gathering Facts --------------------------------------------------------- 0.89s testnode : Update apt cache. -------------------------------------------- 0.85s Gathering Facts --------------------------------------------------------- 0.77s users : Clone the keys repo ---------------------- 2021-11-15T14:31:06.644 INFO:teuthology.task.ansible.out:----------------------- 0.70s users : Check keys_repo HEAD sha1 --------------------------------------- 0.65s Gathering Facts --------------------------------------------------------- 0.62s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.58s 2021-11-15T14:31:06.991 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba035.front.sepia.ceph.com'), Remote(name='ubuntu@gibba019.front.sepia.ceph.com'), Remote(name='ubuntu@gibba038.front.sepia.ceph.com'), Remote(name='ubuntu@gibba032.front.sepia.ceph.com')] 2021-11-15T14:31:06.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba035.front.sepia.ceph.com' 2021-11-15T14:31:06.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:31:07.029 DEBUG:teuthology.orchestra.run.gibba035:> true 2021-11-15T14:31:07.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-15T14:31:07.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:31:07.154 DEBUG:teuthology.orchestra.run.gibba019:> true 2021-11-15T14:31:07.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-15T14:31:07.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:31:07.264 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-15T14:31:07.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba032.front.sepia.ceph.com' 2021-11-15T14:31:07.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-15T14:31:07.382 DEBUG:teuthology.orchestra.run.gibba032:> true 2021-11-15T14:31:07.467 INFO:teuthology.run_tasks:Running task clock... 2021-11-15T14:31:07.478 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-15T14:31:07.478 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T14:31:07.479 DEBUG:teuthology.orchestra.run.gibba035:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T14:31:07.499 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T14:31:07.499 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Command line: ntpd -gq 2021-11-15T14:31:07.499 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: proto: precision = 0.034 usec (-25) 2021-11-15T14:31:07.499 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:07.500 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:07.500 INFO:teuthology.orchestra.run.gibba035.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:07.500 INFO:teuthology.orchestra.run.gibba035.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:07.501 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T14:31:07.501 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T14:31:07.502 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T14:31:07.502 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen normally on 3 enp1s0f0 172.21.2.135:123 2021-11-15T14:31:07.502 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen normally on 4 lo [::1]:123 2021-11-15T14:31:07.502 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8dd2%4]:123 2021-11-15T14:31:07.502 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:07 ntpd[9906]: Listening on routing socket on fd #22 for interface updates 2021-11-15T14:31:08.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:08.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:08.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:08.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:08.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:08.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:08.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:08.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:08 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:10.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:10.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:10.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:10.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:10.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:10.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:10.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:10.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:10 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:11.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:11.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:11.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:11.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:11.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:11.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:11 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:12.503 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.505 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.506 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.507 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.507 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.508 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:12.508 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:12.510 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.510 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.511 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:12.512 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:12.513 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:12.513 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:12.514 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:12.514 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:12 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:13.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:13.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:13.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:13.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:13.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:13.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:13 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:14.500 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:14.503 INFO:teuthology.orchestra.run.gibba035.stdout:15 Nov 14:31:14 ntpd[9906]: ntpd: time slew -0.004273 s 2021-11-15T14:31:14.503 INFO:teuthology.orchestra.run.gibba035.stdout:ntpd: time slew -0.004273s 2021-11-15T14:31:14.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T14:31:14.504 INFO:teuthology.orchestra.run.gibba035.stderr:15 Nov 14:31:14 ntpd[9906]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T14:31:14.541 INFO:teuthology.orchestra.run.gibba035.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T14:31:14.542 INFO:teuthology.orchestra.run.gibba035.stdout:============================================================================== 2021-11-15T14:31:14.542 INFO:teuthology.orchestra.run.gibba035.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:14.542 INFO:teuthology.orchestra.run.gibba035.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:14.542 INFO:teuthology.orchestra.run.gibba035.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:14.543 INFO:teuthology.orchestra.run.gibba035.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:14.543 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T14:31:14.543 DEBUG:teuthology.orchestra.run.gibba019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T14:31:14.564 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T14:31:14.564 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Command line: ntpd -gq 2021-11-15T14:31:14.564 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: proto: precision = 0.033 usec (-25) 2021-11-15T14:31:14.565 INFO:teuthology.orchestra.run.gibba019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:14.565 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:14.566 INFO:teuthology.orchestra.run.gibba019.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:14.567 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:14.567 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T14:31:14.567 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T14:31:14.567 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T14:31:14.568 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen normally on 3 enp1s0f0 172.21.2.119:123 2021-11-15T14:31:14.568 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen normally on 4 lo [::1]:123 2021-11-15T14:31:14.568 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8c52%4]:123 2021-11-15T14:31:14.568 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:14 ntpd[9835]: Listening on routing socket on fd #22 for interface updates 2021-11-15T14:31:15.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:15.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:15.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:15.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:15.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:15.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:15 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:16.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:16.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:16.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:16.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:16.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:16.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:16.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:16.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:16.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:16.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:16.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:16.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:16 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:17.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:17.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:17.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:17.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:17.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:17.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:17 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:18.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:18.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:18.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:18.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:18.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:18.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:18.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:18.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:18 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:19.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:19.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:19.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:19.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:19.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:19.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:19 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:20.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:20.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:20.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:20.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:20.569 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:20.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:20.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:20.570 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:20 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:21.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:21.565 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:21.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:21.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:21.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:21.566 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:21.567 INFO:teuthology.orchestra.run.gibba019.stdout:15 Nov 14:31:21 ntpd[9835]: ntpd: time slew +0.005499 s 2021-11-15T14:31:21.567 INFO:teuthology.orchestra.run.gibba019.stdout:ntpd: time slew +0.005499s 2021-11-15T14:31:21.567 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T14:31:21.568 INFO:teuthology.orchestra.run.gibba019.stderr:15 Nov 14:31:21 ntpd[9835]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T14:31:21.628 INFO:teuthology.orchestra.run.gibba019.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T14:31:21.629 INFO:teuthology.orchestra.run.gibba019.stdout:============================================================================== 2021-11-15T14:31:21.629 INFO:teuthology.orchestra.run.gibba019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:21.629 INFO:teuthology.orchestra.run.gibba019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:21.629 INFO:teuthology.orchestra.run.gibba019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:21.630 INFO:teuthology.orchestra.run.gibba019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:21.631 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T14:31:21.631 DEBUG:teuthology.orchestra.run.gibba038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T14:31:21.651 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T14:31:21.651 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Command line: ntpd -gq 2021-11-15T14:31:21.651 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: proto: precision = 0.036 usec (-25) 2021-11-15T14:31:21.652 INFO:teuthology.orchestra.run.gibba038.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:21.652 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:21.653 INFO:teuthology.orchestra.run.gibba038.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T14:31:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T14:31:21.654 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T14:31:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen normally on 3 enp1s0f0 172.21.2.138:123 2021-11-15T14:31:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen normally on 4 lo [::1]:123 2021-11-15T14:31:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9112%4]:123 2021-11-15T14:31:21.655 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:21 ntpd[9883]: Listening on routing socket on fd #22 for interface updates 2021-11-15T14:31:22.652 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:22.652 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:22.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:22.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:22.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:22.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:22 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:23.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:23.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:23.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:23.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:23.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:23.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:23.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:23.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:23.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:23.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:23.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:23.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:23 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:24.652 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:24.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:24.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:24.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:24.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:24.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:24 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:25.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:25.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:25.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:25.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:25.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:25.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:25.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:25.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:25.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:25.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:25.656 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:25.656 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:25 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:26.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:26.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:26.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:26.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:26.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:26.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:26.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:26.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:26.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:26.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:26.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:26.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:26 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:27.652 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:27.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:27.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:27.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:27.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:27.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:27.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:27.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:27.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:27.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:27.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:27.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:27 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:28.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:28.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:28.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:28.653 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:28.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:28.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:28.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:28.654 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:28.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:28.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:28.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:28.655 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:28.656 INFO:teuthology.orchestra.run.gibba038.stdout:15 Nov 14:31:28 ntpd[9883]: ntpd: time slew -0.002529 s 2021-11-15T14:31:28.656 INFO:teuthology.orchestra.run.gibba038.stdout:ntpd: time slew -0.002529s 2021-11-15T14:31:28.656 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T14:31:28.657 INFO:teuthology.orchestra.run.gibba038.stderr:15 Nov 14:31:28 ntpd[9883]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T14:31:28.701 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T14:31:28.701 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-11-15T14:31:28.701 INFO:teuthology.orchestra.run.gibba038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:28.701 INFO:teuthology.orchestra.run.gibba038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:28.702 INFO:teuthology.orchestra.run.gibba038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:28.702 INFO:teuthology.orchestra.run.gibba038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:28.703 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-15T14:31:28.703 DEBUG:teuthology.orchestra.run.gibba032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T14:31:28.723 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-15T14:31:28.724 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Command line: ntpd -gq 2021-11-15T14:31:28.724 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: proto: precision = 0.034 usec (-25) 2021-11-15T14:31:28.724 INFO:teuthology.orchestra.run.gibba032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:28.725 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-15T14:31:28.725 INFO:teuthology.orchestra.run.gibba032.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:28.726 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: restrict ::: KOD does nothing without LIMITED. 2021-11-15T14:31:28.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen and drop on 0 v6wildcard [::]:123 2021-11-15T14:31:28.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-15T14:31:28.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen normally on 2 lo 127.0.0.1:123 2021-11-15T14:31:28.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen normally on 3 enp1s0f0 172.21.2.132:123 2021-11-15T14:31:28.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen normally on 4 lo [::1]:123 2021-11-15T14:31:28.728 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9240%4]:123 2021-11-15T14:31:28.728 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:28 ntpd[9931]: Listening on routing socket on fd #22 for interface updates 2021-11-15T14:31:29.724 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:29.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:29.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:29.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:29.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:29.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:29.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:29.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:29.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:29.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:29.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:29.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:29 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:30.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:30.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:30.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:30.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:30.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:30.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:30 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:31.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:31.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:31.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:31.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:31.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:31.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:31.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:31.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:31.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:31.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:31.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:31.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:31 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:32.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:32.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:32.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:32.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:32.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:32.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:32.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:32.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:32.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:32.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:32.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:32.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:32 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:33.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:33.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:33.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:33.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:33.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:33.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:33.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:33.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:33.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:33.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:33.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:33.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:33 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:34.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:34.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:34.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:34.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:34.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:34.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:34.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:34.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:34.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:34.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:34.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:34.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:34 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:35.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:35.725 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:35.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:35.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:35.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-15T14:31:35.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: can't open /var/log/ntpstats/rawstats.20211115: Permission denied 2021-11-15T14:31:35.726 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-15T14:31:35.727 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: can't open /var/log/ntpstats/peerstats.20211115: Permission denied 2021-11-15T14:31:35.727 INFO:teuthology.orchestra.run.gibba032.stdout:15 Nov 14:31:35 ntpd[9931]: ntpd: time slew +0.001204 s 2021-11-15T14:31:35.727 INFO:teuthology.orchestra.run.gibba032.stdout:ntpd: time slew +0.001204s 2021-11-15T14:31:35.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-15T14:31:35.728 INFO:teuthology.orchestra.run.gibba032.stderr:15 Nov 14:31:35 ntpd[9931]: can't open /var/log/ntpstats/loopstats.20211115: Permission denied 2021-11-15T14:31:35.783 INFO:teuthology.orchestra.run.gibba032.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T14:31:35.783 INFO:teuthology.orchestra.run.gibba032.stdout:============================================================================== 2021-11-15T14:31:35.784 INFO:teuthology.orchestra.run.gibba032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:35.784 INFO:teuthology.orchestra.run.gibba032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:35.784 INFO:teuthology.orchestra.run.gibba032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:35.784 INFO:teuthology.orchestra.run.gibba032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-15T14:31:35.786 INFO:teuthology.run_tasks:Running task install... 2021-11-15T14:31:35.795 DEBUG:teuthology.task.install:project ceph 2021-11-15T14:31:35.796 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}} 2021-11-15T14:31:35.796 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'} 2021-11-15T14:31:35.796 INFO:teuthology.task.install:Using flavor: default 2021-11-15T14:31:35.802 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-15T14:31:35.802 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-11-15T14:31:35.803 DEBUG:teuthology.orchestra.run.gibba035:> sudo lsb_release -is 2021-11-15T14:31:35.830 INFO:teuthology.orchestra.run.gibba035.stdout:Ubuntu 2021-11-15T14:31:35.833 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.833 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-15T14:31:35.834 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-key list | grep Ceph 2021-11-15T14:31:35.860 INFO:teuthology.orchestra.run.gibba019.stdout:Ubuntu 2021-11-15T14:31:35.862 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.863 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-15T14:31:35.863 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-key list | grep Ceph 2021-11-15T14:31:35.866 INFO:teuthology.orchestra.run.gibba035.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T14:31:35.890 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-15T14:31:35.890 INFO:teuthology.orchestra.run.gibba035.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T14:31:35.891 INFO:teuthology.orchestra.run.gibba035.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T14:31:35.892 DEBUG:teuthology.orchestra.run.gibba035:> sudo lsb_release -is 2021-11-15T14:31:35.893 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.893 DEBUG:teuthology.orchestra.run.gibba032:> sudo lsb_release -is 2021-11-15T14:31:35.894 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-key list | grep Ceph 2021-11-15T14:31:35.895 INFO:teuthology.orchestra.run.gibba019.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T14:31:35.920 INFO:teuthology.orchestra.run.gibba019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T14:31:35.920 INFO:teuthology.orchestra.run.gibba019.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T14:31:35.920 INFO:teuthology.orchestra.run.gibba032.stdout:Ubuntu 2021-11-15T14:31:35.921 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-15T14:31:35.923 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.923 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-key list | grep Ceph 2021-11-15T14:31:35.926 INFO:teuthology.orchestra.run.gibba038.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T14:31:35.949 INFO:teuthology.orchestra.run.gibba019.stdout:Ubuntu 2021-11-15T14:31:35.951 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.952 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T14:31:35.952 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T14:31:35.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:31:35.958 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T14:31:35.959 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T14:31:35.959 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-15T14:31:35.960 INFO:teuthology.orchestra.run.gibba035.stdout:Ubuntu 2021-11-15T14:31:35.963 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:35.964 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T14:31:35.964 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T14:31:35.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:31:36.019 INFO:teuthology.orchestra.run.gibba032.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-15T14:31:36.025 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-15T14:31:36.029 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:36.029 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T14:31:36.029 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T14:31:36.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:31:36.039 INFO:teuthology.orchestra.run.gibba032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-15T14:31:36.039 INFO:teuthology.orchestra.run.gibba032.stdout:uid [ unknown] Ceph.com (release key) 2021-11-15T14:31:36.040 DEBUG:teuthology.orchestra.run.gibba032:> sudo lsb_release -is 2021-11-15T14:31:36.076 INFO:teuthology.orchestra.run.gibba032.stdout:Ubuntu 2021-11-15T14:31:36.086 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:31:36.086 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-15T14:31:36.087 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-15T14:31:36.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:31:36.214 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T14:31:36.215 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:36.239 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T14:31:36.239 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:36.278 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T14:31:36.278 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:36.356 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default/ 2021-11-15T14:31:36.357 INFO:teuthology.task.install.deb:Package version is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:36.426 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:31:36.426 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T14:31:36.436 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:31:36.436 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T14:31:36.438 DEBUG:teuthology.orchestra.run.gibba019:> sudo apt-get update 2021-11-15T14:31:36.449 DEBUG:teuthology.orchestra.run.gibba035:> sudo apt-get update 2021-11-15T14:31:36.478 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:31:36.478 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T14:31:36.489 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-15T14:31:36.570 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:31:36.570 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-15T14:31:36.582 DEBUG:teuthology.orchestra.run.gibba032:> sudo apt-get update 2021-11-15T14:31:36.592 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:31:36.602 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:31:36.690 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T14:31:36.692 INFO:teuthology.orchestra.run.gibba019.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T14:31:36.715 INFO:teuthology.orchestra.run.gibba035.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T14:31:36.724 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:31:36.725 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:31:36.728 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T14:31:36.729 INFO:teuthology.orchestra.run.gibba019.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T14:31:36.732 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:31:36.733 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:31:36.758 INFO:teuthology.orchestra.run.gibba035.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T14:31:36.766 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T14:31:36.768 INFO:teuthology.orchestra.run.gibba019.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T14:31:36.803 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T14:31:36.806 INFO:teuthology.orchestra.run.gibba019.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T14:31:36.810 INFO:teuthology.orchestra.run.gibba035.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T14:31:36.811 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:31:36.820 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:31:36.821 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:31:36.830 INFO:teuthology.orchestra.run.gibba032.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal InRelease 2021-11-15T14:31:36.847 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-15T14:31:36.847 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-15T14:31:36.853 INFO:teuthology.orchestra.run.gibba035.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T14:31:36.857 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T14:31:36.858 INFO:teuthology.orchestra.run.gibba019.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T14:31:36.868 INFO:teuthology.orchestra.run.gibba032.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-15T14:31:36.897 INFO:teuthology.orchestra.run.gibba019.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:31:36.898 INFO:teuthology.orchestra.run.gibba035.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:31:36.898 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:31:36.907 INFO:teuthology.orchestra.run.gibba032.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal Release.gpg 2021-11-15T14:31:36.910 INFO:teuthology.orchestra.run.gibba035.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T14:31:36.925 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-15T14:31:36.944 INFO:teuthology.orchestra.run.gibba032.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main i386 Packages [3,052 B] 2021-11-15T14:31:37.009 INFO:teuthology.orchestra.run.gibba032.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-15T14:31:37.011 INFO:teuthology.orchestra.run.gibba032.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-15T14:31:37.053 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 26.5 kB in 0s (56.2 kB/s) 2021-11-15T14:31:37.183 INFO:teuthology.orchestra.run.gibba032.stdout:Fetched 26.5 kB in 0s (56.5 kB/s) 2021-11-15T14:31:37.198 INFO:teuthology.orchestra.run.gibba019.stdout:Fetched 26.5 kB in 1s (43.1 kB/s) 2021-11-15T14:31:37.235 INFO:teuthology.orchestra.run.gibba035.stdout:Fetched 26.5 kB in 1s (44.0 kB/s) 2021-11-15T14:31:37.583 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:31:37.594 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:37.630 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:31:37.704 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:31:37.715 DEBUG:teuthology.orchestra.run.gibba032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:37.720 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:31:37.731 DEBUG:teuthology.orchestra.run.gibba019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:37.734 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-15T14:31:37.734 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-15T14:31:37.751 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:31:37.752 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:31:37.763 DEBUG:teuthology.orchestra.run.gibba035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-32-gb0aaed0f-1focal cephadm=15.2.15-32-gb0aaed0f-1focal ceph-mds=15.2.15-32-gb0aaed0f-1focal ceph-mgr=15.2.15-32-gb0aaed0f-1focal ceph-common=15.2.15-32-gb0aaed0f-1focal ceph-fuse=15.2.15-32-gb0aaed0f-1focal ceph-test=15.2.15-32-gb0aaed0f-1focal radosgw=15.2.15-32-gb0aaed0f-1focal python3-rados=15.2.15-32-gb0aaed0f-1focal python3-rgw=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal python3-rbd=15.2.15-32-gb0aaed0f-1focal libcephfs2=15.2.15-32-gb0aaed0f-1focal libcephfs-dev=15.2.15-32-gb0aaed0f-1focal librados2=15.2.15-32-gb0aaed0f-1focal librbd1=15.2.15-32-gb0aaed0f-1focal rbd-fuse=15.2.15-32-gb0aaed0f-1focal python3-cephfs=15.2.15-32-gb0aaed0f-1focal cephfs-shell=15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:31:37.767 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:31:37.799 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:31:37.811 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:31:37.811 INFO:teuthology.orchestra.run.gibba038.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:31:37.811 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:31:37.812 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:31:37.813 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:31:37.813 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:31:37.813 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-11-15T14:31:37.814 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.814 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.814 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T14:31:37.814 INFO:teuthology.orchestra.run.gibba038.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T14:31:37.815 INFO:teuthology.orchestra.run.gibba038.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T14:31:37.815 INFO:teuthology.orchestra.run.gibba038.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T14:31:37.815 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T14:31:37.815 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T14:31:37.815 INFO:teuthology.orchestra.run.gibba038.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T14:31:37.816 INFO:teuthology.orchestra.run.gibba038.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T14:31:37.816 INFO:teuthology.orchestra.run.gibba038.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T14:31:37.816 INFO:teuthology.orchestra.run.gibba038.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T14:31:37.816 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T14:31:37.817 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T14:31:37.817 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T14:31:37.817 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T14:31:37.817 INFO:teuthology.orchestra.run.gibba038.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T14:31:37.817 INFO:teuthology.orchestra.run.gibba038.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T14:31:37.818 INFO:teuthology.orchestra.run.gibba038.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T14:31:37.818 INFO:teuthology.orchestra.run.gibba038.stdout: xmlstarlet 2021-11-15T14:31:37.818 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-15T14:31:37.818 INFO:teuthology.orchestra.run.gibba038.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T14:31:37.818 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T14:31:37.819 INFO:teuthology.orchestra.run.gibba038.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T14:31:37.819 INFO:teuthology.orchestra.run.gibba038.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T14:31:37.819 INFO:teuthology.orchestra.run.gibba038.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T14:31:37.819 INFO:teuthology.orchestra.run.gibba038.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T14:31:37.819 INFO:teuthology.orchestra.run.gibba038.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T14:31:37.820 INFO:teuthology.orchestra.run.gibba038.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T14:31:37.820 INFO:teuthology.orchestra.run.gibba038.stdout:Recommended packages: 2021-11-15T14:31:37.820 INFO:teuthology.orchestra.run.gibba038.stdout: btrfs-tools 2021-11-15T14:31:37.851 INFO:teuthology.orchestra.run.gibba032.stdout:Building dependency tree... 2021-11-15T14:31:37.851 INFO:teuthology.orchestra.run.gibba032.stdout:Reading state information... 2021-11-15T14:31:37.864 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-15T14:31:37.864 INFO:teuthology.orchestra.run.gibba038.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T14:31:37.864 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.865 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.865 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T14:31:37.865 INFO:teuthology.orchestra.run.gibba038.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T14:31:37.865 INFO:teuthology.orchestra.run.gibba038.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T14:31:37.865 INFO:teuthology.orchestra.run.gibba038.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T14:31:37.866 INFO:teuthology.orchestra.run.gibba038.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T14:31:37.866 INFO:teuthology.orchestra.run.gibba038.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T14:31:37.866 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T14:31:37.866 INFO:teuthology.orchestra.run.gibba038.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T14:31:37.867 INFO:teuthology.orchestra.run.gibba038.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T14:31:37.867 INFO:teuthology.orchestra.run.gibba038.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T14:31:37.867 INFO:teuthology.orchestra.run.gibba038.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T14:31:37.867 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T14:31:37.867 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T14:31:37.868 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T14:31:37.868 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T14:31:37.868 INFO:teuthology.orchestra.run.gibba038.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T14:31:37.868 INFO:teuthology.orchestra.run.gibba038.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T14:31:37.868 INFO:teuthology.orchestra.run.gibba038.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T14:31:37.869 INFO:teuthology.orchestra.run.gibba038.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T14:31:37.869 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-11-15T14:31:37.869 INFO:teuthology.orchestra.run.gibba038.stdout: librados2 librbd1 2021-11-15T14:31:37.870 INFO:teuthology.orchestra.run.gibba019.stdout:Building dependency tree... 2021-11-15T14:31:37.870 INFO:teuthology.orchestra.run.gibba019.stdout:Reading state information... 2021-11-15T14:31:37.898 INFO:teuthology.orchestra.run.gibba035.stdout:Building dependency tree... 2021-11-15T14:31:37.899 INFO:teuthology.orchestra.run.gibba035.stdout:Reading state information... 2021-11-15T14:31:37.929 INFO:teuthology.orchestra.run.gibba032.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:31:37.929 INFO:teuthology.orchestra.run.gibba032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:31:37.929 INFO:teuthology.orchestra.run.gibba032.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:31:37.930 INFO:teuthology.orchestra.run.gibba032.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:31:37.930 INFO:teuthology.orchestra.run.gibba032.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:31:37.930 INFO:teuthology.orchestra.run.gibba032.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:31:37.930 INFO:teuthology.orchestra.run.gibba032.stdout:The following additional packages will be installed: 2021-11-15T14:31:37.931 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.931 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.931 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T14:31:37.931 INFO:teuthology.orchestra.run.gibba032.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T14:31:37.931 INFO:teuthology.orchestra.run.gibba032.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T14:31:37.932 INFO:teuthology.orchestra.run.gibba032.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T14:31:37.932 INFO:teuthology.orchestra.run.gibba032.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T14:31:37.932 INFO:teuthology.orchestra.run.gibba032.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T14:31:37.932 INFO:teuthology.orchestra.run.gibba032.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T14:31:37.932 INFO:teuthology.orchestra.run.gibba032.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T14:31:37.933 INFO:teuthology.orchestra.run.gibba032.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T14:31:37.933 INFO:teuthology.orchestra.run.gibba032.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T14:31:37.933 INFO:teuthology.orchestra.run.gibba032.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T14:31:37.933 INFO:teuthology.orchestra.run.gibba032.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T14:31:37.934 INFO:teuthology.orchestra.run.gibba032.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T14:31:37.934 INFO:teuthology.orchestra.run.gibba032.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T14:31:37.934 INFO:teuthology.orchestra.run.gibba032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T14:31:37.934 INFO:teuthology.orchestra.run.gibba032.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T14:31:37.934 INFO:teuthology.orchestra.run.gibba032.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T14:31:37.935 INFO:teuthology.orchestra.run.gibba032.stdout: xmlstarlet 2021-11-15T14:31:37.935 INFO:teuthology.orchestra.run.gibba032.stdout:Suggested packages: 2021-11-15T14:31:37.935 INFO:teuthology.orchestra.run.gibba032.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T14:31:37.935 INFO:teuthology.orchestra.run.gibba032.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T14:31:37.935 INFO:teuthology.orchestra.run.gibba032.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T14:31:37.936 INFO:teuthology.orchestra.run.gibba032.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T14:31:37.936 INFO:teuthology.orchestra.run.gibba032.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T14:31:37.936 INFO:teuthology.orchestra.run.gibba032.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T14:31:37.936 INFO:teuthology.orchestra.run.gibba032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T14:31:37.936 INFO:teuthology.orchestra.run.gibba032.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T14:31:37.937 INFO:teuthology.orchestra.run.gibba032.stdout:Recommended packages: 2021-11-15T14:31:37.937 INFO:teuthology.orchestra.run.gibba032.stdout: btrfs-tools 2021-11-15T14:31:37.950 INFO:teuthology.orchestra.run.gibba019.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:31:37.950 INFO:teuthology.orchestra.run.gibba019.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:31:37.950 INFO:teuthology.orchestra.run.gibba019.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:31:37.951 INFO:teuthology.orchestra.run.gibba019.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:31:37.951 INFO:teuthology.orchestra.run.gibba019.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:31:37.951 INFO:teuthology.orchestra.run.gibba019.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:31:37.951 INFO:teuthology.orchestra.run.gibba019.stdout:The following additional packages will be installed: 2021-11-15T14:31:37.952 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.952 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.952 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T14:31:37.952 INFO:teuthology.orchestra.run.gibba019.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T14:31:37.952 INFO:teuthology.orchestra.run.gibba019.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T14:31:37.953 INFO:teuthology.orchestra.run.gibba019.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T14:31:37.953 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T14:31:37.953 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T14:31:37.953 INFO:teuthology.orchestra.run.gibba019.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T14:31:37.953 INFO:teuthology.orchestra.run.gibba019.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T14:31:37.954 INFO:teuthology.orchestra.run.gibba019.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T14:31:37.954 INFO:teuthology.orchestra.run.gibba019.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T14:31:37.954 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T14:31:37.954 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T14:31:37.954 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T14:31:37.955 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T14:31:37.955 INFO:teuthology.orchestra.run.gibba019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T14:31:37.955 INFO:teuthology.orchestra.run.gibba019.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T14:31:37.955 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T14:31:37.956 INFO:teuthology.orchestra.run.gibba019.stdout: xmlstarlet 2021-11-15T14:31:37.956 INFO:teuthology.orchestra.run.gibba019.stdout:Suggested packages: 2021-11-15T14:31:37.956 INFO:teuthology.orchestra.run.gibba019.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T14:31:37.957 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T14:31:37.957 INFO:teuthology.orchestra.run.gibba019.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T14:31:37.957 INFO:teuthology.orchestra.run.gibba019.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T14:31:37.957 INFO:teuthology.orchestra.run.gibba019.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T14:31:37.957 INFO:teuthology.orchestra.run.gibba019.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T14:31:37.958 INFO:teuthology.orchestra.run.gibba019.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T14:31:37.958 INFO:teuthology.orchestra.run.gibba019.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T14:31:37.958 INFO:teuthology.orchestra.run.gibba019.stdout:Recommended packages: 2021-11-15T14:31:37.958 INFO:teuthology.orchestra.run.gibba019.stdout: btrfs-tools 2021-11-15T14:31:37.976 INFO:teuthology.orchestra.run.gibba035.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:31:37.976 INFO:teuthology.orchestra.run.gibba035.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:31:37.976 INFO:teuthology.orchestra.run.gibba035.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:31:37.977 INFO:teuthology.orchestra.run.gibba035.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:31:37.978 INFO:teuthology.orchestra.run.gibba035.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:31:37.978 INFO:teuthology.orchestra.run.gibba035.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:31:37.978 INFO:teuthology.orchestra.run.gibba035.stdout:The following additional packages will be installed: 2021-11-15T14:31:37.979 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.979 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.979 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-15T14:31:37.979 INFO:teuthology.orchestra.run.gibba035.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-15T14:31:37.979 INFO:teuthology.orchestra.run.gibba035.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-15T14:31:37.980 INFO:teuthology.orchestra.run.gibba035.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-15T14:31:37.980 INFO:teuthology.orchestra.run.gibba035.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-15T14:31:37.980 INFO:teuthology.orchestra.run.gibba035.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-15T14:31:37.980 INFO:teuthology.orchestra.run.gibba035.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-15T14:31:37.981 INFO:teuthology.orchestra.run.gibba035.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-15T14:31:37.981 INFO:teuthology.orchestra.run.gibba035.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-15T14:31:37.981 INFO:teuthology.orchestra.run.gibba035.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-15T14:31:37.981 INFO:teuthology.orchestra.run.gibba035.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-15T14:31:37.982 INFO:teuthology.orchestra.run.gibba035.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-15T14:31:37.982 INFO:teuthology.orchestra.run.gibba035.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-15T14:31:37.982 INFO:teuthology.orchestra.run.gibba035.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-15T14:31:37.982 INFO:teuthology.orchestra.run.gibba035.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-15T14:31:37.982 INFO:teuthology.orchestra.run.gibba035.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-15T14:31:37.983 INFO:teuthology.orchestra.run.gibba035.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-15T14:31:37.983 INFO:teuthology.orchestra.run.gibba035.stdout: xmlstarlet 2021-11-15T14:31:37.983 INFO:teuthology.orchestra.run.gibba035.stdout:Suggested packages: 2021-11-15T14:31:37.983 INFO:teuthology.orchestra.run.gibba035.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-15T14:31:37.983 INFO:teuthology.orchestra.run.gibba035.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-15T14:31:37.984 INFO:teuthology.orchestra.run.gibba035.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-15T14:31:37.984 INFO:teuthology.orchestra.run.gibba035.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-15T14:31:37.984 INFO:teuthology.orchestra.run.gibba035.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-15T14:31:37.984 INFO:teuthology.orchestra.run.gibba035.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-15T14:31:37.984 INFO:teuthology.orchestra.run.gibba035.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-15T14:31:37.985 INFO:teuthology.orchestra.run.gibba035.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-15T14:31:37.985 INFO:teuthology.orchestra.run.gibba035.stdout:Recommended packages: 2021-11-15T14:31:37.985 INFO:teuthology.orchestra.run.gibba035.stdout: btrfs-tools 2021-11-15T14:31:37.986 INFO:teuthology.orchestra.run.gibba032.stdout:The following NEW packages will be installed: 2021-11-15T14:31:37.987 INFO:teuthology.orchestra.run.gibba032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T14:31:37.987 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:37.987 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:37.987 INFO:teuthology.orchestra.run.gibba032.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T14:31:37.988 INFO:teuthology.orchestra.run.gibba032.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T14:31:37.988 INFO:teuthology.orchestra.run.gibba032.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T14:31:37.988 INFO:teuthology.orchestra.run.gibba032.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T14:31:37.988 INFO:teuthology.orchestra.run.gibba032.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T14:31:37.988 INFO:teuthology.orchestra.run.gibba032.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T14:31:37.989 INFO:teuthology.orchestra.run.gibba032.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T14:31:37.989 INFO:teuthology.orchestra.run.gibba032.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T14:31:37.989 INFO:teuthology.orchestra.run.gibba032.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T14:31:37.989 INFO:teuthology.orchestra.run.gibba032.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T14:31:37.990 INFO:teuthology.orchestra.run.gibba032.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T14:31:37.990 INFO:teuthology.orchestra.run.gibba032.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T14:31:37.990 INFO:teuthology.orchestra.run.gibba032.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T14:31:37.990 INFO:teuthology.orchestra.run.gibba032.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T14:31:37.990 INFO:teuthology.orchestra.run.gibba032.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T14:31:37.991 INFO:teuthology.orchestra.run.gibba032.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T14:31:37.991 INFO:teuthology.orchestra.run.gibba032.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T14:31:37.991 INFO:teuthology.orchestra.run.gibba032.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T14:31:37.991 INFO:teuthology.orchestra.run.gibba032.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T14:31:37.991 INFO:teuthology.orchestra.run.gibba032.stdout:The following packages will be upgraded: 2021-11-15T14:31:37.992 INFO:teuthology.orchestra.run.gibba032.stdout: librados2 librbd1 2021-11-15T14:31:38.002 INFO:teuthology.orchestra.run.gibba019.stdout:The following NEW packages will be installed: 2021-11-15T14:31:38.002 INFO:teuthology.orchestra.run.gibba019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T14:31:38.002 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:38.002 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:38.003 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T14:31:38.003 INFO:teuthology.orchestra.run.gibba019.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T14:31:38.003 INFO:teuthology.orchestra.run.gibba019.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T14:31:38.003 INFO:teuthology.orchestra.run.gibba019.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T14:31:38.003 INFO:teuthology.orchestra.run.gibba019.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T14:31:38.004 INFO:teuthology.orchestra.run.gibba019.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T14:31:38.004 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T14:31:38.004 INFO:teuthology.orchestra.run.gibba019.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T14:31:38.004 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T14:31:38.005 INFO:teuthology.orchestra.run.gibba019.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T14:31:38.005 INFO:teuthology.orchestra.run.gibba019.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T14:31:38.005 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T14:31:38.005 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T14:31:38.005 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T14:31:38.006 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T14:31:38.006 INFO:teuthology.orchestra.run.gibba019.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T14:31:38.006 INFO:teuthology.orchestra.run.gibba019.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T14:31:38.006 INFO:teuthology.orchestra.run.gibba019.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T14:31:38.006 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T14:31:38.007 INFO:teuthology.orchestra.run.gibba019.stdout:The following packages will be upgraded: 2021-11-15T14:31:38.007 INFO:teuthology.orchestra.run.gibba019.stdout: librados2 librbd1 2021-11-15T14:31:38.031 INFO:teuthology.orchestra.run.gibba035.stdout:The following NEW packages will be installed: 2021-11-15T14:31:38.031 INFO:teuthology.orchestra.run.gibba035.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-15T14:31:38.031 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-15T14:31:38.031 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-15T14:31:38.032 INFO:teuthology.orchestra.run.gibba035.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-15T14:31:38.032 INFO:teuthology.orchestra.run.gibba035.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-15T14:31:38.032 INFO:teuthology.orchestra.run.gibba035.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-15T14:31:38.032 INFO:teuthology.orchestra.run.gibba035.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-15T14:31:38.033 INFO:teuthology.orchestra.run.gibba035.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-15T14:31:38.033 INFO:teuthology.orchestra.run.gibba035.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-15T14:31:38.033 INFO:teuthology.orchestra.run.gibba035.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-15T14:31:38.033 INFO:teuthology.orchestra.run.gibba035.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-15T14:31:38.033 INFO:teuthology.orchestra.run.gibba035.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-15T14:31:38.034 INFO:teuthology.orchestra.run.gibba035.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-15T14:31:38.034 INFO:teuthology.orchestra.run.gibba035.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-15T14:31:38.034 INFO:teuthology.orchestra.run.gibba035.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-15T14:31:38.034 INFO:teuthology.orchestra.run.gibba035.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-15T14:31:38.034 INFO:teuthology.orchestra.run.gibba035.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-15T14:31:38.035 INFO:teuthology.orchestra.run.gibba035.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-15T14:31:38.035 INFO:teuthology.orchestra.run.gibba035.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-15T14:31:38.035 INFO:teuthology.orchestra.run.gibba035.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-15T14:31:38.035 INFO:teuthology.orchestra.run.gibba035.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-15T14:31:38.036 INFO:teuthology.orchestra.run.gibba035.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-15T14:31:38.036 INFO:teuthology.orchestra.run.gibba035.stdout:The following packages will be upgraded: 2021-11-15T14:31:38.036 INFO:teuthology.orchestra.run.gibba035.stdout: librados2 librbd1 2021-11-15T14:31:38.051 INFO:teuthology.orchestra.run.gibba038.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:31:38.051 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 153 MB of archives. 2021-11-15T14:31:38.051 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T14:31:38.051 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T14:31:38.100 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T14:31:38.143 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T14:31:38.172 INFO:teuthology.orchestra.run.gibba032.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:31:38.172 INFO:teuthology.orchestra.run.gibba032.stdout:Need to get 153 MB of archives. 2021-11-15T14:31:38.172 INFO:teuthology.orchestra.run.gibba032.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T14:31:38.173 INFO:teuthology.orchestra.run.gibba032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T14:31:38.175 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T14:31:38.192 INFO:teuthology.orchestra.run.gibba019.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:31:38.193 INFO:teuthology.orchestra.run.gibba019.stdout:Need to get 153 MB of archives. 2021-11-15T14:31:38.193 INFO:teuthology.orchestra.run.gibba019.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T14:31:38.193 INFO:teuthology.orchestra.run.gibba019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T14:31:38.204 INFO:teuthology.orchestra.run.gibba032.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T14:31:38.221 INFO:teuthology.orchestra.run.gibba035.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:31:38.221 INFO:teuthology.orchestra.run.gibba035.stdout:Need to get 153 MB of archives. 2021-11-15T14:31:38.221 INFO:teuthology.orchestra.run.gibba035.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-15T14:31:38.222 INFO:teuthology.orchestra.run.gibba035.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-15T14:31:38.225 INFO:teuthology.orchestra.run.gibba019.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T14:31:38.255 INFO:teuthology.orchestra.run.gibba035.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-32-gb0aaed0f-1focal [1,694 kB] 2021-11-15T14:31:38.265 INFO:teuthology.orchestra.run.gibba032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T14:31:38.272 INFO:teuthology.orchestra.run.gibba032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T14:31:38.272 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T14:31:38.288 INFO:teuthology.orchestra.run.gibba019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T14:31:38.296 INFO:teuthology.orchestra.run.gibba019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T14:31:38.314 INFO:teuthology.orchestra.run.gibba035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-15T14:31:38.359 INFO:teuthology.orchestra.run.gibba035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-15T14:31:38.395 INFO:teuthology.orchestra.run.gibba032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T14:31:38.397 INFO:teuthology.orchestra.run.gibba019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T14:31:38.420 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T14:31:38.466 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T14:31:38.478 INFO:teuthology.orchestra.run.gibba035.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-15T14:31:38.479 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T14:31:38.490 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T14:31:38.585 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T14:31:38.595 INFO:teuthology.orchestra.run.gibba032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T14:31:38.602 INFO:teuthology.orchestra.run.gibba032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T14:31:38.608 INFO:teuthology.orchestra.run.gibba019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T14:31:38.615 INFO:teuthology.orchestra.run.gibba032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T14:31:38.616 INFO:teuthology.orchestra.run.gibba019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T14:31:38.621 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T14:31:38.627 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T14:31:38.631 INFO:teuthology.orchestra.run.gibba019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T14:31:38.636 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T14:31:38.636 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T14:31:38.636 INFO:teuthology.orchestra.run.gibba035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-15T14:31:38.639 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T14:31:38.641 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T14:31:38.652 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T14:31:38.654 INFO:teuthology.orchestra.run.gibba035.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-15T14:31:38.662 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T14:31:38.666 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T14:31:38.678 INFO:teuthology.orchestra.run.gibba035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-15T14:31:38.687 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T14:31:38.692 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T14:31:38.697 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T14:31:38.720 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T14:31:38.721 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T14:31:38.722 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T14:31:38.725 INFO:teuthology.orchestra.run.gibba019.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T14:31:38.749 INFO:teuthology.orchestra.run.gibba032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T14:31:38.767 INFO:teuthology.orchestra.run.gibba019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T14:31:38.768 INFO:teuthology.orchestra.run.gibba032.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T14:31:38.775 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T14:31:38.779 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T14:31:38.780 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T14:31:38.785 INFO:teuthology.orchestra.run.gibba032.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T14:31:38.791 INFO:teuthology.orchestra.run.gibba032.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T14:31:38.804 INFO:teuthology.orchestra.run.gibba019.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T14:31:38.806 INFO:teuthology.orchestra.run.gibba035.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-15T14:31:38.811 INFO:teuthology.orchestra.run.gibba019.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T14:31:38.821 INFO:teuthology.orchestra.run.gibba038.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T14:31:38.827 INFO:teuthology.orchestra.run.gibba032.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T14:31:38.835 INFO:teuthology.orchestra.run.gibba032.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T14:31:38.837 INFO:teuthology.orchestra.run.gibba032.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T14:31:38.839 INFO:teuthology.orchestra.run.gibba038.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T14:31:38.840 INFO:teuthology.orchestra.run.gibba035.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-15T14:31:38.841 INFO:teuthology.orchestra.run.gibba019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T14:31:38.845 INFO:teuthology.orchestra.run.gibba019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T14:31:38.847 INFO:teuthology.orchestra.run.gibba035.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-15T14:31:38.848 INFO:teuthology.orchestra.run.gibba019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T14:31:38.857 INFO:teuthology.orchestra.run.gibba032.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T14:31:38.857 INFO:teuthology.orchestra.run.gibba032.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T14:31:38.858 INFO:teuthology.orchestra.run.gibba032.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T14:31:38.863 INFO:teuthology.orchestra.run.gibba038.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T14:31:38.867 INFO:teuthology.orchestra.run.gibba019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T14:31:38.869 INFO:teuthology.orchestra.run.gibba019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T14:31:38.872 INFO:teuthology.orchestra.run.gibba019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T14:31:38.878 INFO:teuthology.orchestra.run.gibba035.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-15T14:31:38.881 INFO:teuthology.orchestra.run.gibba038.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T14:31:38.883 INFO:teuthology.orchestra.run.gibba035.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-15T14:31:38.885 INFO:teuthology.orchestra.run.gibba038.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T14:31:38.887 INFO:teuthology.orchestra.run.gibba035.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-15T14:31:38.887 INFO:teuthology.orchestra.run.gibba038.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T14:31:38.891 INFO:teuthology.orchestra.run.gibba038.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T14:31:38.894 INFO:teuthology.orchestra.run.gibba038.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T14:31:38.895 INFO:teuthology.orchestra.run.gibba038.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T14:31:38.908 INFO:teuthology.orchestra.run.gibba035.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-15T14:31:38.909 INFO:teuthology.orchestra.run.gibba035.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-15T14:31:38.911 INFO:teuthology.orchestra.run.gibba035.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-15T14:31:38.913 INFO:teuthology.orchestra.run.gibba038.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T14:31:38.914 INFO:teuthology.orchestra.run.gibba032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T14:31:38.918 INFO:teuthology.orchestra.run.gibba032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T14:31:38.918 INFO:teuthology.orchestra.run.gibba032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T14:31:38.926 INFO:teuthology.orchestra.run.gibba019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T14:31:38.930 INFO:teuthology.orchestra.run.gibba019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T14:31:38.931 INFO:teuthology.orchestra.run.gibba019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T14:31:38.955 INFO:teuthology.orchestra.run.gibba035.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-15T14:31:38.960 INFO:teuthology.orchestra.run.gibba035.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-15T14:31:38.961 INFO:teuthology.orchestra.run.gibba035.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-15T14:31:38.983 INFO:teuthology.orchestra.run.gibba038.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T14:31:38.984 INFO:teuthology.orchestra.run.gibba038.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T14:31:38.985 INFO:teuthology.orchestra.run.gibba038.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T14:31:39.015 INFO:teuthology.orchestra.run.gibba032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T14:31:39.019 INFO:teuthology.orchestra.run.gibba032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T14:31:39.020 INFO:teuthology.orchestra.run.gibba032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T14:31:39.027 INFO:teuthology.orchestra.run.gibba032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T14:31:39.029 INFO:teuthology.orchestra.run.gibba019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T14:31:39.033 INFO:teuthology.orchestra.run.gibba032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T14:31:39.034 INFO:teuthology.orchestra.run.gibba019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T14:31:39.035 INFO:teuthology.orchestra.run.gibba032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T14:31:39.036 INFO:teuthology.orchestra.run.gibba019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T14:31:39.042 INFO:teuthology.orchestra.run.gibba019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T14:31:39.047 INFO:teuthology.orchestra.run.gibba019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T14:31:39.048 INFO:teuthology.orchestra.run.gibba019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T14:31:39.064 INFO:teuthology.orchestra.run.gibba035.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-15T14:31:39.067 INFO:teuthology.orchestra.run.gibba032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T14:31:39.069 INFO:teuthology.orchestra.run.gibba035.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-15T14:31:39.071 INFO:teuthology.orchestra.run.gibba035.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-15T14:31:39.077 INFO:teuthology.orchestra.run.gibba035.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-15T14:31:39.078 INFO:teuthology.orchestra.run.gibba019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T14:31:39.081 INFO:teuthology.orchestra.run.gibba035.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-15T14:31:39.083 INFO:teuthology.orchestra.run.gibba035.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-15T14:31:39.094 INFO:teuthology.orchestra.run.gibba038.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T14:31:39.103 INFO:teuthology.orchestra.run.gibba038.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T14:31:39.109 INFO:teuthology.orchestra.run.gibba038.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T14:31:39.109 INFO:teuthology.orchestra.run.gibba035.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-15T14:31:39.110 INFO:teuthology.orchestra.run.gibba038.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T14:31:39.113 INFO:teuthology.orchestra.run.gibba038.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T14:31:39.117 INFO:teuthology.orchestra.run.gibba038.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T14:31:39.121 INFO:teuthology.orchestra.run.gibba038.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T14:31:39.127 INFO:teuthology.orchestra.run.gibba032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T14:31:39.128 INFO:teuthology.orchestra.run.gibba032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T14:31:39.129 INFO:teuthology.orchestra.run.gibba032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T14:31:39.139 INFO:teuthology.orchestra.run.gibba019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T14:31:39.140 INFO:teuthology.orchestra.run.gibba019.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T14:31:39.141 INFO:teuthology.orchestra.run.gibba019.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T14:31:39.169 INFO:teuthology.orchestra.run.gibba035.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-15T14:31:39.170 INFO:teuthology.orchestra.run.gibba035.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-15T14:31:39.172 INFO:teuthology.orchestra.run.gibba035.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-15T14:31:39.183 INFO:teuthology.orchestra.run.gibba035.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-32-gb0aaed0f-1focal [3,244 kB] 2021-11-15T14:31:39.196 INFO:teuthology.orchestra.run.gibba038.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T14:31:39.197 INFO:teuthology.orchestra.run.gibba038.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T14:31:39.234 INFO:teuthology.orchestra.run.gibba032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T14:31:39.244 INFO:teuthology.orchestra.run.gibba032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T14:31:39.248 INFO:teuthology.orchestra.run.gibba032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T14:31:39.249 INFO:teuthology.orchestra.run.gibba032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T14:31:39.250 INFO:teuthology.orchestra.run.gibba019.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T14:31:39.254 INFO:teuthology.orchestra.run.gibba032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T14:31:39.258 INFO:teuthology.orchestra.run.gibba032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T14:31:39.261 INFO:teuthology.orchestra.run.gibba019.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T14:31:39.263 INFO:teuthology.orchestra.run.gibba032.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T14:31:39.265 INFO:teuthology.orchestra.run.gibba019.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T14:31:39.266 INFO:teuthology.orchestra.run.gibba019.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T14:31:39.270 INFO:teuthology.orchestra.run.gibba019.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T14:31:39.274 INFO:teuthology.orchestra.run.gibba019.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T14:31:39.278 INFO:teuthology.orchestra.run.gibba019.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T14:31:39.289 INFO:teuthology.orchestra.run.gibba035.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-15T14:31:39.297 INFO:teuthology.orchestra.run.gibba035.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-15T14:31:39.302 INFO:teuthology.orchestra.run.gibba035.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-15T14:31:39.302 INFO:teuthology.orchestra.run.gibba035.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-15T14:31:39.306 INFO:teuthology.orchestra.run.gibba035.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-15T14:31:39.310 INFO:teuthology.orchestra.run.gibba035.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-15T14:31:39.313 INFO:teuthology.orchestra.run.gibba035.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-15T14:31:39.350 INFO:teuthology.orchestra.run.gibba032.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T14:31:39.351 INFO:teuthology.orchestra.run.gibba032.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T14:31:39.358 INFO:teuthology.orchestra.run.gibba019.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T14:31:39.367 INFO:teuthology.orchestra.run.gibba019.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T14:31:39.369 INFO:teuthology.orchestra.run.gibba019.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T14:31:39.413 INFO:teuthology.orchestra.run.gibba035.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-15T14:31:39.526 INFO:teuthology.orchestra.run.gibba019.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T14:31:39.528 INFO:teuthology.orchestra.run.gibba019.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T14:31:39.528 INFO:teuthology.orchestra.run.gibba019.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T14:31:39.529 INFO:teuthology.orchestra.run.gibba019.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T14:31:39.530 INFO:teuthology.orchestra.run.gibba019.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T14:31:39.530 INFO:teuthology.orchestra.run.gibba035.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-15T14:31:39.565 INFO:teuthology.orchestra.run.gibba032.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T14:31:39.577 INFO:teuthology.orchestra.run.gibba019.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T14:31:39.650 INFO:teuthology.orchestra.run.gibba032.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T14:31:39.848 INFO:teuthology.orchestra.run.gibba032.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T14:31:39.849 INFO:teuthology.orchestra.run.gibba032.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T14:31:39.849 INFO:teuthology.orchestra.run.gibba032.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T14:31:39.850 INFO:teuthology.orchestra.run.gibba032.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T14:31:39.896 INFO:teuthology.orchestra.run.gibba032.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T14:31:39.942 INFO:teuthology.orchestra.run.gibba038.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T14:31:40.170 INFO:teuthology.orchestra.run.gibba038.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T14:31:40.172 INFO:teuthology.orchestra.run.gibba038.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T14:31:40.205 INFO:teuthology.orchestra.run.gibba019.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T14:31:40.208 INFO:teuthology.orchestra.run.gibba032.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T14:31:40.243 INFO:teuthology.orchestra.run.gibba038.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T14:31:40.244 INFO:teuthology.orchestra.run.gibba038.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T14:31:40.244 INFO:teuthology.orchestra.run.gibba038.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T14:31:40.245 INFO:teuthology.orchestra.run.gibba038.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T14:31:40.245 INFO:teuthology.orchestra.run.gibba038.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T14:31:40.246 INFO:teuthology.orchestra.run.gibba038.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T14:31:40.246 INFO:teuthology.orchestra.run.gibba038.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T14:31:40.254 INFO:teuthology.orchestra.run.gibba032.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T14:31:40.256 INFO:teuthology.orchestra.run.gibba032.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T14:31:40.269 INFO:teuthology.orchestra.run.gibba035.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-15T14:31:40.279 INFO:teuthology.orchestra.run.gibba019.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T14:31:40.314 INFO:teuthology.orchestra.run.gibba019.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T14:31:40.317 INFO:teuthology.orchestra.run.gibba019.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T14:31:40.326 INFO:teuthology.orchestra.run.gibba035.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-15T14:31:40.329 INFO:teuthology.orchestra.run.gibba019.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T14:31:40.330 INFO:teuthology.orchestra.run.gibba035.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-15T14:31:40.348 INFO:teuthology.orchestra.run.gibba032.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T14:31:40.348 INFO:teuthology.orchestra.run.gibba032.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T14:31:40.348 INFO:teuthology.orchestra.run.gibba032.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T14:31:40.349 INFO:teuthology.orchestra.run.gibba032.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T14:31:40.349 INFO:teuthology.orchestra.run.gibba032.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T14:31:40.350 INFO:teuthology.orchestra.run.gibba032.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T14:31:40.350 INFO:teuthology.orchestra.run.gibba032.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T14:31:40.352 INFO:teuthology.orchestra.run.gibba038.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T14:31:40.353 INFO:teuthology.orchestra.run.gibba038.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T14:31:40.353 INFO:teuthology.orchestra.run.gibba038.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T14:31:40.356 INFO:teuthology.orchestra.run.gibba038.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T14:31:40.358 INFO:teuthology.orchestra.run.gibba038.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T14:31:40.359 INFO:teuthology.orchestra.run.gibba038.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T14:31:40.360 INFO:teuthology.orchestra.run.gibba038.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T14:31:40.365 INFO:teuthology.orchestra.run.gibba038.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T14:31:40.396 INFO:teuthology.orchestra.run.gibba035.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T14:31:40.396 INFO:teuthology.orchestra.run.gibba035.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T14:31:40.397 INFO:teuthology.orchestra.run.gibba035.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T14:31:40.398 INFO:teuthology.orchestra.run.gibba035.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T14:31:40.398 INFO:teuthology.orchestra.run.gibba035.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T14:31:40.400 INFO:teuthology.orchestra.run.gibba035.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T14:31:40.401 INFO:teuthology.orchestra.run.gibba035.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T14:31:40.402 INFO:teuthology.orchestra.run.gibba032.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T14:31:40.402 INFO:teuthology.orchestra.run.gibba032.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T14:31:40.407 INFO:teuthology.orchestra.run.gibba038.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T14:31:40.416 INFO:teuthology.orchestra.run.gibba019.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-15T14:31:40.417 INFO:teuthology.orchestra.run.gibba019.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-15T14:31:40.418 INFO:teuthology.orchestra.run.gibba019.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-15T14:31:40.418 INFO:teuthology.orchestra.run.gibba019.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-15T14:31:40.419 INFO:teuthology.orchestra.run.gibba019.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-15T14:31:40.420 INFO:teuthology.orchestra.run.gibba019.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-15T14:31:40.421 INFO:teuthology.orchestra.run.gibba019.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-15T14:31:40.423 INFO:teuthology.orchestra.run.gibba019.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T14:31:40.457 INFO:teuthology.orchestra.run.gibba035.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T14:31:40.458 INFO:teuthology.orchestra.run.gibba035.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T14:31:40.465 INFO:teuthology.orchestra.run.gibba038.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T14:31:40.466 INFO:teuthology.orchestra.run.gibba038.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T14:31:40.485 INFO:teuthology.orchestra.run.gibba032.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T14:31:40.492 INFO:teuthology.orchestra.run.gibba038.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T14:31:40.493 INFO:teuthology.orchestra.run.gibba032.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T14:31:40.498 INFO:teuthology.orchestra.run.gibba032.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T14:31:40.502 INFO:teuthology.orchestra.run.gibba038.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T14:31:40.502 INFO:teuthology.orchestra.run.gibba038.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T14:31:40.503 INFO:teuthology.orchestra.run.gibba032.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T14:31:40.504 INFO:teuthology.orchestra.run.gibba038.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T14:31:40.505 INFO:teuthology.orchestra.run.gibba032.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T14:31:40.505 INFO:teuthology.orchestra.run.gibba038.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T14:31:40.506 INFO:teuthology.orchestra.run.gibba019.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-15T14:31:40.506 INFO:teuthology.orchestra.run.gibba019.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-15T14:31:40.508 INFO:teuthology.orchestra.run.gibba038.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T14:31:40.513 INFO:teuthology.orchestra.run.gibba032.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T14:31:40.514 INFO:teuthology.orchestra.run.gibba032.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T14:31:40.515 INFO:teuthology.orchestra.run.gibba032.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T14:31:40.529 INFO:teuthology.orchestra.run.gibba038.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T14:31:40.529 INFO:teuthology.orchestra.run.gibba038.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T14:31:40.546 INFO:teuthology.orchestra.run.gibba035.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T14:31:40.549 INFO:teuthology.orchestra.run.gibba035.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T14:31:40.550 INFO:teuthology.orchestra.run.gibba035.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T14:31:40.551 INFO:teuthology.orchestra.run.gibba035.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T14:31:40.552 INFO:teuthology.orchestra.run.gibba035.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T14:31:40.555 INFO:teuthology.orchestra.run.gibba035.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T14:31:40.556 INFO:teuthology.orchestra.run.gibba035.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T14:31:40.562 INFO:teuthology.orchestra.run.gibba035.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T14:31:40.572 INFO:teuthology.orchestra.run.gibba032.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T14:31:40.578 INFO:teuthology.orchestra.run.gibba038.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T14:31:40.578 INFO:teuthology.orchestra.run.gibba038.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T14:31:40.581 INFO:teuthology.orchestra.run.gibba032.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T14:31:40.588 INFO:teuthology.orchestra.run.gibba019.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-15T14:31:40.599 INFO:teuthology.orchestra.run.gibba019.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-15T14:31:40.604 INFO:teuthology.orchestra.run.gibba019.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-15T14:31:40.611 INFO:teuthology.orchestra.run.gibba019.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-15T14:31:40.613 INFO:teuthology.orchestra.run.gibba019.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-15T14:31:40.624 INFO:teuthology.orchestra.run.gibba019.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-15T14:31:40.630 INFO:teuthology.orchestra.run.gibba035.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T14:31:40.633 INFO:teuthology.orchestra.run.gibba019.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-15T14:31:40.635 INFO:teuthology.orchestra.run.gibba035.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T14:31:40.647 INFO:teuthology.orchestra.run.gibba019.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-15T14:31:40.658 INFO:teuthology.orchestra.run.gibba032.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T14:31:40.659 INFO:teuthology.orchestra.run.gibba032.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T14:31:40.660 INFO:teuthology.orchestra.run.gibba032.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T14:31:40.663 INFO:teuthology.orchestra.run.gibba032.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T14:31:40.666 INFO:teuthology.orchestra.run.gibba038.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T14:31:40.668 INFO:teuthology.orchestra.run.gibba038.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T14:31:40.669 INFO:teuthology.orchestra.run.gibba038.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T14:31:40.673 INFO:teuthology.orchestra.run.gibba038.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T14:31:40.680 INFO:teuthology.orchestra.run.gibba019.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-15T14:31:40.683 INFO:teuthology.orchestra.run.gibba032.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T14:31:40.684 INFO:teuthology.orchestra.run.gibba032.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T14:31:40.684 INFO:teuthology.orchestra.run.gibba032.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T14:31:40.684 INFO:teuthology.orchestra.run.gibba032.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T14:31:40.692 INFO:teuthology.orchestra.run.gibba019.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-15T14:31:40.713 INFO:teuthology.orchestra.run.gibba035.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T14:31:40.714 INFO:teuthology.orchestra.run.gibba035.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T14:31:40.714 INFO:teuthology.orchestra.run.gibba035.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T14:31:40.715 INFO:teuthology.orchestra.run.gibba035.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T14:31:40.741 INFO:teuthology.orchestra.run.gibba035.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T14:31:40.742 INFO:teuthology.orchestra.run.gibba035.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T14:31:40.743 INFO:teuthology.orchestra.run.gibba035.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T14:31:40.743 INFO:teuthology.orchestra.run.gibba035.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T14:31:40.752 INFO:teuthology.orchestra.run.gibba032.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T14:31:40.753 INFO:teuthology.orchestra.run.gibba032.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T14:31:40.762 INFO:teuthology.orchestra.run.gibba019.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-15T14:31:40.763 INFO:teuthology.orchestra.run.gibba019.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-15T14:31:40.763 INFO:teuthology.orchestra.run.gibba019.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-15T14:31:40.766 INFO:teuthology.orchestra.run.gibba035.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-32-gb0aaed0f-1focal [463 kB] 2021-11-15T14:31:40.767 INFO:teuthology.orchestra.run.gibba019.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-15T14:31:40.797 INFO:teuthology.orchestra.run.gibba035.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T14:31:40.798 INFO:teuthology.orchestra.run.gibba035.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T14:31:40.826 INFO:teuthology.orchestra.run.gibba019.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-15T14:31:40.828 INFO:teuthology.orchestra.run.gibba019.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-15T14:31:40.830 INFO:teuthology.orchestra.run.gibba019.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-15T14:31:40.831 INFO:teuthology.orchestra.run.gibba019.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-15T14:31:40.839 INFO:teuthology.orchestra.run.gibba032.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T14:31:40.844 INFO:teuthology.orchestra.run.gibba032.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T14:31:40.846 INFO:teuthology.orchestra.run.gibba032.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T14:31:40.849 INFO:teuthology.orchestra.run.gibba019.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-15T14:31:40.851 INFO:teuthology.orchestra.run.gibba019.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-15T14:31:40.877 INFO:teuthology.orchestra.run.gibba032.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T14:31:40.880 INFO:teuthology.orchestra.run.gibba035.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T14:31:40.885 INFO:teuthology.orchestra.run.gibba035.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T14:31:40.933 INFO:teuthology.orchestra.run.gibba019.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-15T14:31:40.938 INFO:teuthology.orchestra.run.gibba019.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-15T14:31:40.945 INFO:teuthology.orchestra.run.gibba038.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T14:31:40.946 INFO:teuthology.orchestra.run.gibba035.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-32-gb0aaed0f-1focal [365 kB] 2021-11-15T14:31:40.964 INFO:teuthology.orchestra.run.gibba038.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T14:31:40.969 INFO:teuthology.orchestra.run.gibba032.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T14:31:41.082 INFO:teuthology.orchestra.run.gibba038.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T14:31:41.082 INFO:teuthology.orchestra.run.gibba035.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-32-gb0aaed0f-1focal [20.8 kB] 2021-11-15T14:31:41.086 INFO:teuthology.orchestra.run.gibba035.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-32-gb0aaed0f-1focal [156 kB] 2021-11-15T14:31:41.151 INFO:teuthology.orchestra.run.gibba035.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-32-gb0aaed0f-1focal [29.4 kB] 2021-11-15T14:31:41.156 INFO:teuthology.orchestra.run.gibba035.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-32-gb0aaed0f-1focal [363 kB] 2021-11-15T14:31:41.291 INFO:teuthology.orchestra.run.gibba035.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-32-gb0aaed0f-1focal [3,138 kB] 2021-11-15T14:31:41.611 INFO:teuthology.orchestra.run.gibba038.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T14:31:42.370 INFO:teuthology.orchestra.run.gibba035.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-32-gb0aaed0f-1focal [115 kB] 2021-11-15T14:31:42.410 INFO:teuthology.orchestra.run.gibba035.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-32-gb0aaed0f-1focal [361 kB] 2021-11-15T14:31:42.528 INFO:teuthology.orchestra.run.gibba035.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-32-gb0aaed0f-1focal [20.0 MB] 2021-11-15T14:31:43.840 INFO:teuthology.orchestra.run.gibba038.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T14:31:43.841 INFO:teuthology.orchestra.run.gibba038.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T14:31:43.856 INFO:teuthology.orchestra.run.gibba038.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T14:31:44.033 INFO:teuthology.orchestra.run.gibba038.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T14:31:44.035 INFO:teuthology.orchestra.run.gibba038.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T14:31:44.038 INFO:teuthology.orchestra.run.gibba038.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T14:31:44.253 INFO:teuthology.orchestra.run.gibba019.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T14:31:44.361 INFO:teuthology.orchestra.run.gibba038.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T14:31:44.362 INFO:teuthology.orchestra.run.gibba038.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T14:31:45.154 INFO:teuthology.orchestra.run.gibba038.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T14:31:45.155 INFO:teuthology.orchestra.run.gibba038.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T14:31:45.187 INFO:teuthology.orchestra.run.gibba019.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T14:31:45.225 INFO:teuthology.orchestra.run.gibba019.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T14:31:45.475 INFO:teuthology.orchestra.run.gibba019.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T14:31:45.520 INFO:teuthology.orchestra.run.gibba032.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T14:31:46.611 INFO:teuthology.orchestra.run.gibba019.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T14:31:46.622 INFO:teuthology.orchestra.run.gibba032.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T14:31:46.666 INFO:teuthology.orchestra.run.gibba032.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T14:31:46.946 INFO:teuthology.orchestra.run.gibba032.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T14:31:48.329 INFO:teuthology.orchestra.run.gibba032.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T14:31:48.431 INFO:teuthology.orchestra.run.gibba035.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-32-gb0aaed0f-1focal [5,334 kB] 2021-11-15T14:31:49.643 INFO:teuthology.orchestra.run.gibba038.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T14:31:49.644 INFO:teuthology.orchestra.run.gibba038.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T14:31:49.645 INFO:teuthology.orchestra.run.gibba038.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T14:31:49.749 INFO:teuthology.orchestra.run.gibba035.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-32-gb0aaed0f-1focal [162 kB] 2021-11-15T14:31:49.789 INFO:teuthology.orchestra.run.gibba035.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-32-gb0aaed0f-1focal [1,402 kB] 2021-11-15T14:31:50.131 INFO:teuthology.orchestra.run.gibba035.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-32-gb0aaed0f-1focal [6,173 kB] 2021-11-15T14:31:50.604 INFO:teuthology.orchestra.run.gibba038.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T14:31:50.937 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 153 MB in 13s (12.0 MB/s) 2021-11-15T14:31:51.011 INFO:teuthology.orchestra.run.gibba019.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T14:31:51.012 INFO:teuthology.orchestra.run.gibba019.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T14:31:51.025 INFO:teuthology.orchestra.run.gibba019.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T14:31:51.083 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T14:31:51.155 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T14:31:51.159 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T14:31:51.198 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T14:31:51.330 INFO:teuthology.orchestra.run.gibba035.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-32-gb0aaed0f-1focal [23.9 MB] 2021-11-15T14:31:51.357 INFO:teuthology.orchestra.run.gibba019.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T14:31:51.359 INFO:teuthology.orchestra.run.gibba019.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T14:31:51.369 INFO:teuthology.orchestra.run.gibba019.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T14:31:51.509 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T14:31:51.540 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T14:31:51.584 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:31:51.829 INFO:teuthology.orchestra.run.gibba019.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T14:31:51.830 INFO:teuthology.orchestra.run.gibba019.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T14:31:51.937 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T14:31:51.947 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T14:31:51.986 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:31:52.256 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T14:31:52.288 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T14:31:52.381 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:31:52.565 INFO:teuthology.orchestra.run.gibba032.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T14:31:52.566 INFO:teuthology.orchestra.run.gibba032.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T14:31:52.596 INFO:teuthology.orchestra.run.gibba032.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T14:31:52.682 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:52.801 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:31:52.805 INFO:teuthology.orchestra.run.gibba032.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T14:31:52.837 INFO:teuthology.orchestra.run.gibba032.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T14:31:52.858 INFO:teuthology.orchestra.run.gibba032.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T14:31:52.859 INFO:teuthology.orchestra.run.gibba019.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T14:31:52.859 INFO:teuthology.orchestra.run.gibba019.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T14:31:53.212 INFO:teuthology.orchestra.run.gibba032.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T14:31:53.213 INFO:teuthology.orchestra.run.gibba032.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T14:31:53.345 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:53.472 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:31:54.025 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T14:31:54.057 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:54.091 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:54.299 INFO:teuthology.orchestra.run.gibba032.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T14:31:54.300 INFO:teuthology.orchestra.run.gibba032.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T14:31:54.352 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rados. 2021-11-15T14:31:54.383 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:54.426 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:54.751 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T14:31:54.760 INFO:teuthology.orchestra.run.gibba035.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-32-gb0aaed0f-1focal [4,016 B] 2021-11-15T14:31:54.761 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:31:54.761 INFO:teuthology.orchestra.run.gibba035.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-32-gb0aaed0f-1focal [538 kB] 2021-11-15T14:31:54.776 INFO:teuthology.orchestra.run.gibba035.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-32-gb0aaed0f-1focal [2,007 kB] 2021-11-15T14:31:54.802 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:55.021 INFO:teuthology.orchestra.run.gibba035.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-32-gb0aaed0f-1focal [53.2 kB] 2021-11-15T14:31:55.052 INFO:teuthology.orchestra.run.gibba035.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-32-gb0aaed0f-1focal [58.2 kB] 2021-11-15T14:31:55.080 INFO:teuthology.orchestra.run.gibba035.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-32-gb0aaed0f-1focal [3,208 kB] 2021-11-15T14:31:55.138 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T14:31:55.170 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:55.213 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:55.549 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T14:31:55.559 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:31:55.598 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:55.608 INFO:teuthology.orchestra.run.gibba035.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-32-gb0aaed0f-1focal [34.4 kB] 2021-11-15T14:31:55.609 INFO:teuthology.orchestra.run.gibba035.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-32-gb0aaed0f-1focal [7,875 kB] 2021-11-15T14:31:55.876 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T14:31:55.908 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T14:31:55.943 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T14:31:56.154 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T14:31:56.185 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:56.220 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:56.631 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T14:31:56.641 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T14:31:56.680 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:31:56.852 INFO:teuthology.orchestra.run.gibba035.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-32-gb0aaed0f-1focal [4,132 B] 2021-11-15T14:31:56.853 INFO:teuthology.orchestra.run.gibba035.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-32-gb0aaed0f-1focal [39.8 MB] 2021-11-15T14:31:57.025 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T14:31:57.057 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T14:31:57.117 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:31:57.419 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librgw2. 2021-11-15T14:31:57.428 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:57.460 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:57.955 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T14:31:57.986 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:58.021 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:58.340 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T14:31:58.350 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T14:31:58.390 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:31:58.689 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liboath0. 2021-11-15T14:31:58.720 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T14:31:58.755 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T14:31:59.050 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T14:31:59.114 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:59.132 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:31:59.577 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-common. 2021-11-15T14:31:59.587 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:31:59.627 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:00.197 INFO:teuthology.orchestra.run.gibba032.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T14:32:00.198 INFO:teuthology.orchestra.run.gibba032.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T14:32:00.199 INFO:teuthology.orchestra.run.gibba032.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T14:32:00.341 INFO:teuthology.orchestra.run.gibba019.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T14:32:00.341 INFO:teuthology.orchestra.run.gibba019.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T14:32:00.343 INFO:teuthology.orchestra.run.gibba019.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T14:32:01.399 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-base. 2021-11-15T14:32:01.430 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:01.487 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:01.528 INFO:teuthology.orchestra.run.gibba032.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T14:32:01.847 INFO:teuthology.orchestra.run.gibba032.stdout:Fetched 153 MB in 24s (6,492 kB/s) 2021-11-15T14:32:01.951 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T14:32:02.022 INFO:teuthology.orchestra.run.gibba032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T14:32:02.025 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T14:32:02.066 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T14:32:02.270 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T14:32:02.302 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T14:32:02.338 INFO:teuthology.orchestra.run.gibba019.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T14:32:02.344 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:32:02.369 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T14:32:02.400 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T14:32:02.443 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:32:02.655 INFO:teuthology.orchestra.run.gibba019.stdout:Fetched 153 MB in 24s (6,281 kB/s) 2021-11-15T14:32:02.764 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T14:32:02.788 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T14:32:02.798 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T14:32:02.836 INFO:teuthology.orchestra.run.gibba019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T14:32:02.837 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:32:02.840 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T14:32:02.840 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T14:32:02.851 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T14:32:02.879 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T14:32:02.889 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T14:32:03.132 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T14:32:03.143 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T14:32:03.164 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T14:32:03.175 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:03.207 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T14:32:03.217 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T14:32:03.218 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:03.232 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:32:03.348 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:32:03.526 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:03.530 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T14:32:03.534 INFO:teuthology.orchestra.run.gibba035.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-32-gb0aaed0f-1focal [15.9 kB] 2021-11-15T14:32:03.535 INFO:teuthology.orchestra.run.gibba035.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-32-gb0aaed0f-1focal [18.1 kB] 2021-11-15T14:32:03.536 INFO:teuthology.orchestra.run.gibba035.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-32-gb0aaed0f-1focal [9,717 kB] 2021-11-15T14:32:03.562 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T14:32:03.596 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:03.644 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:03.693 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T14:32:03.725 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T14:32:03.768 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:32:03.954 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T14:32:03.964 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T14:32:04.012 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:32:04.129 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T14:32:04.138 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T14:32:04.171 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:04.204 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:32:04.298 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:04.349 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T14:32:04.381 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T14:32:04.424 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:04.538 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:04.640 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:04.777 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T14:32:04.787 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T14:32:04.826 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T14:32:04.852 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T14:32:04.884 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:04.918 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:05.073 INFO:teuthology.orchestra.run.gibba035.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-32-gb0aaed0f-1focal [61.1 kB] 2021-11-15T14:32:05.138 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T14:32:05.161 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:05.169 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T14:32:05.221 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-rados. 2021-11-15T14:32:05.231 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:05.237 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:05.270 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:05.286 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:05.394 INFO:teuthology.orchestra.run.gibba035.stdout:Fetched 153 MB in 27s (5,652 kB/s) 2021-11-15T14:32:05.521 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-15T14:32:05.557 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-mako. 2021-11-15T14:32:05.566 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T14:32:05.592 INFO:teuthology.orchestra.run.gibba035.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-15T14:32:05.595 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-15T14:32:05.606 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:32:05.615 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T14:32:05.644 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-15T14:32:05.647 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:05.690 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:05.927 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T14:32:05.931 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T14:32:05.942 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:05.956 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-15T14:32:05.958 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T14:32:05.981 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:05.987 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-15T14:32:05.992 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T14:32:06.001 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:06.001 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:32:06.030 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:32:06.041 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:06.259 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-rados. 2021-11-15T14:32:06.283 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-cmd2. 2021-11-15T14:32:06.290 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:06.314 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-15T14:32:06.321 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T14:32:06.331 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T14:32:06.333 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:06.370 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:32:06.386 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:32:06.618 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T14:32:06.629 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:06.728 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:06.731 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webob. 2021-11-15T14:32:06.738 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T14:32:06.744 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-15T14:32:06.753 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-15T14:32:06.780 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T14:32:06.793 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T14:32:06.803 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:06.842 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:06.860 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:32:06.989 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T14:32:07.021 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T14:32:07.055 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T14:32:07.109 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T14:32:07.118 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T14:32:07.128 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T14:32:07.160 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:07.190 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:32:07.195 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:07.237 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../004-librbd1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:07.316 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T14:32:07.348 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:07.364 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking librbd1 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:07.391 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:07.540 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T14:32:07.572 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:07.615 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:07.744 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T14:32:07.753 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T14:32:07.793 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:07.866 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../005-librados2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:07.959 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T14:32:07.967 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T14:32:07.993 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking librados2 (15.2.15-32-gb0aaed0f-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-15T14:32:08.008 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T14:32:08.139 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T14:32:08.171 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T14:32:08.213 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:32:08.286 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T14:32:08.318 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:08.361 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:08.533 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T14:32:08.541 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T14:32:08.568 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package librgw2. 2021-11-15T14:32:08.577 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:08.595 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T14:32:08.617 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:08.621 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libcephfs2. 2021-11-15T14:32:08.631 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:08.670 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:08.748 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T14:32:08.779 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T14:32:08.814 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:08.973 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-rados. 2021-11-15T14:32:08.974 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T14:32:09.005 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../007-python3-rados_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:09.005 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T14:32:09.048 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:09.052 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T14:32:09.095 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T14:32:09.127 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:09.162 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:09.183 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T14:32:09.193 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T14:32:09.241 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:32:09.393 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-15T14:32:09.393 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T14:32:09.403 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:09.404 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T14:32:09.442 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:09.443 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T14:32:09.482 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T14:32:09.492 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T14:32:09.531 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:09.619 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package librgw2. 2021-11-15T14:32:09.650 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:09.694 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:09.754 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-paste. 2021-11-15T14:32:09.758 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-cephfs. 2021-11-15T14:32:09.786 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T14:32:09.790 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:09.828 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:32:09.833 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:09.884 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package liboath0. 2021-11-15T14:32:09.916 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T14:32:09.959 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:10.103 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-15T14:32:10.113 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:10.151 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T14:32:10.152 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:10.183 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T14:32:10.213 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T14:32:10.226 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:10.245 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:10.287 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T14:32:10.287 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:10.318 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:10.366 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:10.480 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-prettytable. 2021-11-15T14:32:10.512 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-15T14:32:10.537 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T14:32:10.548 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T14:32:10.555 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-15T14:32:10.587 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:32:10.625 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T14:32:10.635 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T14:32:10.676 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:10.819 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-common. 2021-11-15T14:32:10.829 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:10.857 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-rbd. 2021-11-15T14:32:10.868 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:10.889 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:10.932 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T14:32:10.932 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:10.964 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T14:32:11.006 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T14:32:11.044 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package liboath0. 2021-11-15T14:32:11.076 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T14:32:11.118 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:11.318 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-15T14:32:11.328 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-15T14:32:11.350 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T14:32:11.359 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T14:32:11.368 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:11.400 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:32:11.655 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-15T14:32:11.686 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-15T14:32:11.705 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T14:32:11.721 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:32:11.737 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T14:32:11.780 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:32:12.183 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T14:32:12.193 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.232 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:12.280 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T14:32:12.289 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.329 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:12.640 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package librgw2. 2021-11-15T14:32:12.650 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../015-librgw2_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.702 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T14:32:12.706 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:12.712 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.725 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-common. 2021-11-15T14:32:12.752 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:12.756 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.791 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:12.859 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-base. 2021-11-15T14:32:12.870 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:12.912 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:13.198 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-rgw. 2021-11-15T14:32:13.230 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:13.273 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:13.634 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-15T14:32:13.644 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-15T14:32:13.664 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T14:32:13.674 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:13.683 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:13.714 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:13.789 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T14:32:13.799 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T14:32:13.838 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:32:14.046 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package liboath0. 2021-11-15T14:32:14.077 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-15T14:32:14.120 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:14.142 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T14:32:14.152 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T14:32:14.191 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T14:32:14.439 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libradosstriper1. 2021-11-15T14:32:14.450 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:14.461 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T14:32:14.489 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:14.493 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:14.517 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-base. 2021-11-15T14:32:14.536 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:14.550 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:14.631 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:14.840 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T14:32:14.871 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T14:32:14.906 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:14.950 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-common. 2021-11-15T14:32:14.960 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../020-ceph-common_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:15.033 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:15.210 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T14:32:15.220 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T14:32:15.259 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:32:15.414 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T14:32:15.445 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T14:32:15.480 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:32:15.572 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T14:32:15.604 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T14:32:15.646 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:15.727 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph. 2021-11-15T14:32:15.737 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:15.776 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:15.833 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T14:32:15.865 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T14:32:15.900 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T14:32:15.967 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T14:32:15.975 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T14:32:16.016 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T14:32:16.122 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T14:32:16.154 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:16.169 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T14:32:16.196 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:16.201 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:16.235 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:16.327 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T14:32:16.359 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T14:32:16.402 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:16.591 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T14:32:16.601 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:16.612 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T14:32:16.622 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T14:32:16.640 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:16.661 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:16.697 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-base. 2021-11-15T14:32:16.729 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../021-ceph-base_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:16.738 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-mako. 2021-11-15T14:32:16.748 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T14:32:16.777 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:16.796 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:32:16.981 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T14:32:17.013 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T14:32:17.056 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:32:17.101 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package cephadm. 2021-11-15T14:32:17.108 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T14:32:17.111 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:17.140 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T14:32:17.159 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:17.174 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:32:17.417 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T14:32:17.427 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T14:32:17.466 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:17.470 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T14:32:17.494 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T14:32:17.503 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T14:32:17.504 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T14:32:17.544 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:32:17.546 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:17.585 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-cryptography. 2021-11-15T14:32:17.617 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-15T14:32:17.651 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:32:17.804 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T14:32:17.836 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T14:32:17.840 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-webob. 2021-11-15T14:32:17.865 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T14:32:17.872 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T14:32:17.874 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:17.878 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T14:32:17.914 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T14:32:17.915 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:18.055 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-openssl. 2021-11-15T14:32:18.064 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-15T14:32:18.138 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-15T14:32:18.206 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T14:32:18.215 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T14:32:18.243 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T14:32:18.253 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T14:32:18.256 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:18.268 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T14:32:18.299 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T14:32:18.325 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:32:18.342 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:18.366 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-15T14:32:18.398 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:18.432 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:18.592 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-mako. 2021-11-15T14:32:18.612 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T14:32:18.624 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T14:32:18.629 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T14:32:18.643 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T14:32:18.661 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T14:32:18.666 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:32:18.686 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:32:18.703 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T14:32:18.795 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-15T14:32:18.804 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-15T14:32:18.878 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:18.997 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T14:32:19.007 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T14:32:19.012 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T14:32:19.022 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T14:32:19.046 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:32:19.061 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:32:19.065 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T14:32:19.075 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T14:32:19.115 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T14:32:19.189 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-15T14:32:19.221 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-15T14:32:19.272 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:32:19.349 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-routes. 2021-11-15T14:32:19.382 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T14:32:19.423 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T14:32:19.442 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T14:32:19.443 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T14:32:19.455 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T14:32:19.476 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T14:32:19.498 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:32:19.518 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T14:32:19.596 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-jwt. 2021-11-15T14:32:19.606 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-15T14:32:19.671 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:19.786 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T14:32:19.796 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:19.829 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-paste. 2021-11-15T14:32:19.834 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:19.839 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T14:32:19.859 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-webob. 2021-11-15T14:32:19.869 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T14:32:19.878 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:32:19.909 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T14:32:19.966 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-logutils. 2021-11-15T14:32:19.998 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-15T14:32:20.049 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-15T14:32:20.202 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T14:32:20.233 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T14:32:20.262 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T14:32:20.276 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:20.293 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T14:32:20.335 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-15T14:32:20.345 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-15T14:32:20.353 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:32:20.417 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:20.533 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T14:32:20.567 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:20.608 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:20.621 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T14:32:20.631 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T14:32:20.679 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:32:20.716 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T14:32:20.724 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T14:32:20.729 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-mako. 2021-11-15T14:32:20.761 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-15T14:32:20.764 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T14:32:20.811 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:32:20.952 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T14:32:20.962 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T14:32:20.999 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T14:32:21.001 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:21.031 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T14:32:21.074 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T14:32:21.123 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-15T14:32:21.132 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-15T14:32:21.184 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T14:32:21.192 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T14:32:21.197 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:32:21.235 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T14:32:21.313 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T14:32:21.345 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T14:32:21.387 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:32:21.393 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T14:32:21.402 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T14:32:21.442 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:32:21.493 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-15T14:32:21.525 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-15T14:32:21.571 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T14:32:21.584 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:32:21.602 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T14:32:21.645 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T14:32:21.714 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T14:32:21.724 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T14:32:21.734 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T14:32:21.746 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T14:32:21.773 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T14:32:21.806 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:32:21.943 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-webob. 2021-11-15T14:32:21.954 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-15T14:32:21.976 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-paste. 2021-11-15T14:32:21.986 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T14:32:22.001 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-15T14:32:22.025 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:32:22.143 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T14:32:22.151 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:22.192 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:22.362 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T14:32:22.371 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-15T14:32:22.393 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T14:32:22.403 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-15T14:32:22.436 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:22.445 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:32:22.621 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T14:32:22.653 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:22.695 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:22.714 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T14:32:22.748 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T14:32:22.781 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-bs4. 2021-11-15T14:32:22.792 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-15T14:32:22.798 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T14:32:22.805 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T14:32:22.823 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:22.831 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-15T14:32:22.847 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:32:23.184 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T14:32:23.216 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T14:32:23.258 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T14:32:23.260 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-waitress. 2021-11-15T14:32:23.292 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-15T14:32:23.293 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T14:32:23.303 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T14:32:23.339 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-15T14:32:23.351 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T14:32:23.603 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T14:32:23.607 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T14:32:23.613 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T14:32:23.639 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:23.652 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:32:23.682 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:23.696 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-tempita. 2021-11-15T14:32:23.706 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-15T14:32:23.712 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T14:32:23.745 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T14:32:23.745 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-15T14:32:23.787 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:24.015 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T14:32:24.047 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T14:32:24.065 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-paste. 2021-11-15T14:32:24.090 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:32:24.097 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-15T14:32:24.131 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:32:24.387 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T14:32:24.420 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:24.461 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:24.468 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-15T14:32:24.500 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-15T14:32:24.502 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T14:32:24.511 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:24.534 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:24.576 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:24.882 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-15T14:32:24.887 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-15T14:32:24.929 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:32:25.005 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T14:32:25.016 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:25.054 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:25.249 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-webtest. 2021-11-15T14:32:25.280 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-15T14:32:25.323 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-15T14:32:25.439 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T14:32:25.472 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T14:32:25.531 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:25.651 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pecan. 2021-11-15T14:32:25.660 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-15T14:32:25.700 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:32:25.704 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph. 2021-11-15T14:32:25.736 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:25.778 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:25.800 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T14:32:25.833 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T14:32:25.867 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:32:25.883 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T14:32:25.892 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:25.932 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:26.063 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-15T14:32:26.095 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-15T14:32:26.115 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T14:32:26.125 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:26.128 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T14:32:26.152 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:32:26.161 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T14:32:26.163 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:26.203 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:32:26.489 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T14:32:26.521 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T14:32:26.543 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T14:32:26.558 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr. 2021-11-15T14:32:26.563 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T14:32:26.569 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:26.574 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:26.615 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:26.617 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:26.900 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T14:32:26.909 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T14:32:26.949 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T14:32:27.094 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mon. 2021-11-15T14:32:27.104 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:27.112 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package cephadm. 2021-11-15T14:32:27.122 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:27.150 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:27.170 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:27.261 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T14:32:27.294 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T14:32:27.336 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:32:27.490 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T14:32:27.522 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T14:32:27.564 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:27.689 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T14:32:27.699 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T14:32:27.746 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:32:27.876 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T14:32:27.886 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:27.905 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph. 2021-11-15T14:32:27.925 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:27.937 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:27.971 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:28.031 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-osd. 2021-11-15T14:32:28.063 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:28.075 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T14:32:28.105 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:28.108 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T14:32:28.149 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:32:28.254 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T14:32:28.286 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T14:32:28.307 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T14:32:28.317 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:28.328 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:28.356 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:28.486 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T14:32:28.496 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T14:32:28.535 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:32:28.573 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T14:32:28.605 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T14:32:28.639 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:32:28.751 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T14:32:28.784 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:28.859 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:28.880 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T14:32:28.912 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T14:32:28.925 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T14:32:28.954 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:32:28.957 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T14:32:29.000 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:32:29.271 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package cephadm. 2021-11-15T14:32:29.280 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:29.312 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:29.319 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-routes. 2021-11-15T14:32:29.329 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T14:32:29.367 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T14:32:29.368 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T14:32:29.400 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:29.441 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:29.657 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T14:32:29.689 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T14:32:29.689 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T14:32:29.721 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:29.731 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:29.763 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:29.778 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T14:32:29.789 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T14:32:29.836 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:32:30.051 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph. 2021-11-15T14:32:30.059 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../047-ceph_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:30.075 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T14:32:30.085 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:30.093 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:30.125 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:30.194 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T14:32:30.322 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:30.322 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:30.379 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-fuse. 2021-11-15T14:32:30.411 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:30.438 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T14:32:30.445 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:30.470 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T14:32:30.504 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:30.533 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package jq. 2021-11-15T14:32:30.565 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:30.607 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:30.612 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T14:32:30.646 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:30.687 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:30.756 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T14:32:30.789 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T14:32:30.823 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:32:30.857 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mds. 2021-11-15T14:32:30.867 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:30.901 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package socat. 2021-11-15T14:32:30.906 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:30.934 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T14:32:30.976 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T14:32:31.015 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T14:32:31.025 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T14:32:31.073 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:31.075 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T14:32:31.107 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T14:32:31.158 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:32:31.384 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T14:32:31.401 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package cephadm. 2021-11-15T14:32:31.411 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../050-cephadm_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:31.417 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T14:32:31.432 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T14:32:31.442 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T14:32:31.450 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:31.458 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:32:31.489 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:32:31.507 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-routes. 2021-11-15T14:32:31.516 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T14:32:31.560 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T14:32:31.770 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T14:32:31.779 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-jinja2. 2021-11-15T14:32:31.780 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T14:32:31.793 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T14:32:31.811 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-15T14:32:31.819 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T14:32:31.825 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T14:32:31.845 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:31.867 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:32:31.914 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T14:32:31.946 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:31.989 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:32.182 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-15T14:32:32.192 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:32.231 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:32.232 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-test. 2021-11-15T14:32:32.242 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:32.281 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:32.534 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-15T14:32:32.566 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-15T14:32:32.600 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:32.804 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T14:32:32.828 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libjs-underscore. 2021-11-15T14:32:32.828 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T14:32:32.838 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T14:32:32.860 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-15T14:32:32.861 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:32.878 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:32.902 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:32:32.903 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:33.180 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-15T14:32:33.212 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-15T14:32:33.256 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T14:32:33.266 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T14:32:33.279 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:32:33.306 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:33.332 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T14:32:33.342 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T14:32:33.381 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T14:32:33.600 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-routes. 2021-11-15T14:32:33.608 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-15T14:32:33.659 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T14:32:33.673 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-15T14:32:33.691 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T14:32:33.710 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T14:32:33.733 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:32:33.742 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T14:32:33.784 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:34.043 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-15T14:32:34.075 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:34.094 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T14:32:34.103 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T14:32:34.118 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:34.143 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T14:32:34.367 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T14:32:34.402 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:34.442 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:34.857 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-15T14:32:34.868 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:34.914 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:34.994 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T14:32:35.027 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T14:32:35.068 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:35.169 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T14:32:35.180 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T14:32:35.218 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:35.268 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-decorator. 2021-11-15T14:32:35.300 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-15T14:32:35.338 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T14:32:35.343 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:35.372 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:35.388 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T14:32:35.397 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T14:32:35.413 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:35.437 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:35.687 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-15T14:32:35.696 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-15T14:32:35.705 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T14:32:35.707 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T14:32:35.716 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T14:32:35.731 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T14:32:35.736 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:32:35.740 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:35.762 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T14:32:35.764 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T14:32:35.782 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:35.814 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:32:36.056 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-scipy. 2021-11-15T14:32:36.089 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-15T14:32:36.127 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T14:32:36.130 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-15T14:32:36.134 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T14:32:36.136 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T14:32:36.151 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T14:32:36.160 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T14:32:36.166 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T14:32:36.182 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:36.209 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:32:36.233 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:36.512 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T14:32:36.540 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T14:32:36.544 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T14:32:36.574 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T14:32:36.586 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T14:32:36.615 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:36.774 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T14:32:36.783 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:36.823 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:36.923 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T14:32:36.935 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T14:32:36.942 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-attr. 2021-11-15T14:32:36.953 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T14:32:36.973 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T14:32:36.991 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T14:32:37.064 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-15T14:32:37.074 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-15T14:32:37.121 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:37.293 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T14:32:37.312 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T14:32:37.326 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T14:32:37.344 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T14:32:37.367 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:32:37.386 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:37.608 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-joblib. 2021-11-15T14:32:37.641 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-15T14:32:37.691 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-15T14:32:37.695 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T14:32:37.704 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T14:32:37.714 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T14:32:37.724 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T14:32:37.744 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:32:37.763 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T14:32:37.961 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T14:32:37.971 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T14:32:38.018 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:38.034 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T14:32:38.067 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T14:32:38.108 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:32:38.346 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T14:32:38.379 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T14:32:38.391 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T14:32:38.400 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T14:32:38.420 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:32:38.440 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:32:38.503 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T14:32:38.513 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T14:32:38.540 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-sklearn. 2021-11-15T14:32:38.549 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-15T14:32:38.552 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T14:32:38.636 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:38.751 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T14:32:38.785 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T14:32:38.790 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T14:32:38.801 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T14:32:38.814 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T14:32:38.826 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:32:38.839 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:32:38.848 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T14:32:38.889 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T14:32:39.163 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T14:32:39.173 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T14:32:39.193 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-15T14:32:39.194 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T14:32:39.203 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:39.209 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T14:32:39.226 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T14:32:39.242 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T14:32:39.252 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:39.253 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:32:39.268 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T14:32:39.393 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T14:32:39.596 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T14:32:39.606 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T14:32:39.645 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T14:32:39.701 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T14:32:39.734 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:39.775 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:39.953 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T14:32:39.985 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T14:32:39.998 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T14:32:40.008 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T14:32:40.027 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:40.047 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:32:40.111 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T14:32:40.120 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T14:32:40.155 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-cachetools. 2021-11-15T14:32:40.160 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:32:40.164 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-15T14:32:40.204 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:40.376 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T14:32:40.381 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-py. 2021-11-15T14:32:40.391 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T14:32:40.409 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T14:32:40.430 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:40.450 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:32:40.506 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T14:32:40.532 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-15T14:32:40.538 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:40.540 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-15T14:32:40.572 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:40.581 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:32:40.726 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T14:32:40.759 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T14:32:40.800 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:40.804 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T14:32:40.815 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T14:32:40.833 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package jq. 2021-11-15T14:32:40.862 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:32:40.867 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:40.884 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-15T14:32:40.908 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:40.917 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-15T14:32:40.959 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:32:41.162 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T14:32:41.172 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T14:32:41.194 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package socat. 2021-11-15T14:32:41.198 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T14:32:41.204 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T14:32:41.219 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T14:32:41.231 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T14:32:41.243 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T14:32:41.273 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:32:41.312 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-rsa. 2021-11-15T14:32:41.323 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-15T14:32:41.362 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-15T14:32:41.548 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T14:32:41.580 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T14:32:41.609 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T14:32:41.619 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T14:32:41.622 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:41.641 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T14:32:41.658 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:32:41.675 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T14:32:41.699 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-google-auth. 2021-11-15T14:32:41.716 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:32:41.731 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-15T14:32:41.798 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-15T14:32:41.994 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T14:32:42.027 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T14:32:42.068 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package radosgw. 2021-11-15T14:32:42.068 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:32:42.077 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:42.101 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-blinker. 2021-11-15T14:32:42.125 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:42.134 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-15T14:32:42.200 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:32:42.205 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T14:32:42.238 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:42.280 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:42.347 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package ceph-test. 2021-11-15T14:32:42.380 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:42.422 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:42.520 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-15T14:32:42.530 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-15T14:32:42.594 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:32:42.641 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T14:32:42.651 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T14:32:42.690 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:32:42.915 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-15T14:32:42.947 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-15T14:32:42.989 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:32:43.046 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T14:32:43.068 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T14:32:43.079 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:43.101 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:43.120 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:43.292 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-websocket. 2021-11-15T14:32:43.301 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-15T14:32:43.375 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:32:43.447 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T14:32:43.491 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:43.725 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:43.736 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-15T14:32:43.769 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-15T14:32:43.804 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package jq. 2021-11-15T14:32:43.810 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:32:43.837 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:43.851 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:43.879 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:43.977 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:44.153 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:44.173 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package socat. 2021-11-15T14:32:44.183 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T14:32:44.222 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T14:32:44.274 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-15T14:32:44.307 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:44.348 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:44.701 INFO:teuthology.orchestra.run.gibba038.stdout:Adding system user cephadm....done 2021-11-15T14:32:44.709 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-15T14:32:44.711 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T14:32:44.717 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-15T14:32:44.722 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T14:32:44.758 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:32:44.769 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:32:44.859 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T14:32:45.082 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T14:32:45.114 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T14:32:45.118 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:45.135 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T14:32:45.153 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-15T14:32:45.156 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:32:45.169 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T14:32:45.186 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:45.210 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:45.248 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:45.361 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:45.462 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:45.480 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T14:32:45.513 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:45.523 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package jq. 2021-11-15T14:32:45.532 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-15T14:32:45.554 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:45.561 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package ceph-test. 2021-11-15T14:32:45.572 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:45.572 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:45.610 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:45.671 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T14:32:45.824 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T14:32:45.857 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:45.858 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package socat. 2021-11-15T14:32:45.891 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-15T14:32:45.898 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:45.932 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-15T14:32:46.023 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:46.210 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T14:32:46.221 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T14:32:46.266 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:46.283 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:46.430 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-15T14:32:46.440 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-15T14:32:46.487 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:32:46.517 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:46.616 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T14:32:46.649 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T14:32:46.690 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:46.768 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:46.808 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package xmlstarlet. 2021-11-15T14:32:46.840 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-15T14:32:46.883 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:32:47.003 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:47.010 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-attr. 2021-11-15T14:32:47.021 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T14:32:47.068 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T14:32:47.212 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:47.237 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package ceph-test. 2021-11-15T14:32:47.246 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../083-ceph-test_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:47.286 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:47.363 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T14:32:47.396 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T14:32:47.429 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:47.438 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:47.539 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T14:32:47.691 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T14:32:47.723 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T14:32:47.765 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T14:32:47.766 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:48.008 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:48.127 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T14:32:48.136 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T14:32:48.176 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:32:48.209 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:48.324 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T14:32:48.335 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T14:32:48.373 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:48.477 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:48.588 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T14:32:48.622 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T14:32:48.663 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T14:32:48.676 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T14:32:48.709 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:48.720 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:48.751 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:48.983 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T14:32:48.992 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T14:32:49.005 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:49.032 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T14:32:49.062 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T14:32:49.072 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:49.111 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:49.214 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:49.328 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T14:32:49.360 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T14:32:49.402 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T14:32:49.431 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T14:32:49.532 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T14:32:49.542 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T14:32:49.597 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:49.657 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T14:32:49.764 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T14:32:49.774 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T14:32:49.813 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:49.928 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T14:32:49.933 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:49.961 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T14:32:50.027 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:50.058 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-colorama. 2021-11-15T14:32:50.059 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:32:50.065 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-15T14:32:50.100 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:50.149 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-py. 2021-11-15T14:32:50.172 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T14:32:50.207 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:50.261 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:32:50.339 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-attr. 2021-11-15T14:32:50.350 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T14:32:50.361 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package cephfs-shell. 2021-11-15T14:32:50.394 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-32-gb0aaed0f-1focal_all.deb ... 2021-11-15T14:32:50.413 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T14:32:50.435 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:50.528 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T14:32:50.538 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T14:32:50.563 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:32:50.577 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:50.735 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T14:32:50.747 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-15T14:32:50.758 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:50.768 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T14:32:50.797 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:50.799 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:32:50.809 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:50.880 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T14:32:50.914 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T14:32:50.955 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T14:32:51.107 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:32:51.150 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T14:32:51.160 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T14:32:51.207 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package nvme-cli. 2021-11-15T14:32:51.210 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T14:32:51.217 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-15T14:32:51.262 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:51.284 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T14:32:51.294 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T14:32:51.333 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:51.342 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T14:32:51.469 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:51.564 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T14:32:51.587 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-15T14:32:51.597 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T14:32:51.620 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-15T14:32:51.638 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:32:51.653 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:51.686 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T14:32:51.771 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package radosgw. 2021-11-15T14:32:51.781 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:51.820 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:51.923 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-attr. 2021-11-15T14:32:51.954 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:32:51.955 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-15T14:32:51.989 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-15T14:32:52.055 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T14:32:52.084 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T14:32:52.095 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T14:32:52.133 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T14:32:52.281 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:32:52.300 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-webencodings. 2021-11-15T14:32:52.309 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-15T14:32:52.349 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:52.382 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:32:52.470 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T14:32:52.502 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T14:32:52.544 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T14:32:52.658 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:32:52.686 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-html5lib. 2021-11-15T14:32:52.690 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T14:32:52.719 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-15T14:32:52.724 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:52.761 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-15T14:32:52.764 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:52.901 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T14:32:52.906 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T14:32:52.916 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T14:32:52.955 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T14:32:53.109 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T14:32:53.114 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-15T14:32:53.124 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-15T14:32:53.153 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:32:53.163 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:32:53.279 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:32:53.284 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T14:32:53.317 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T14:32:53.359 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:53.386 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:53.471 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T14:32:53.495 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:53.591 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-packaging. 2021-11-15T14:32:53.621 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:53.624 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-15T14:32:53.666 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-15T14:32:53.697 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:32:53.703 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-py. 2021-11-15T14:32:53.713 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T14:32:53.761 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:53.823 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:53.965 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:32:54.011 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pastescript. 2021-11-15T14:32:54.021 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-15T14:32:54.083 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-15T14:32:54.107 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T14:32:54.139 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T14:32:54.181 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:54.340 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T14:32:54.371 INFO:teuthology.orchestra.run.gibba032.stdout:Adding system user cephadm....done 2021-11-15T14:32:54.406 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pluggy. 2021-11-15T14:32:54.439 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-15T14:32:54.492 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:32:54.513 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-15T14:32:54.521 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T14:32:54.542 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T14:32:54.550 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T14:32:54.618 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:32:54.624 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T14:32:54.805 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:54.854 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-psutil. 2021-11-15T14:32:54.865 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-15T14:32:54.903 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:32:54.907 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:54.962 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T14:32:54.995 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T14:32:55.045 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:55.065 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:55.191 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:55.205 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:32:55.262 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-py. 2021-11-15T14:32:55.295 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-15T14:32:55.306 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:32:55.344 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:55.407 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T14:32:55.417 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T14:32:55.515 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package radosgw. 2021-11-15T14:32:55.526 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:55.573 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:55.616 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:32:55.681 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-15T14:32:55.691 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-15T14:32:55.730 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:55.752 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:55.842 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:55.960 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T14:32:56.004 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:56.049 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-pytest. 2021-11-15T14:32:56.083 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-15T14:32:56.124 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-15T14:32:56.230 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T14:32:56.468 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T14:32:56.469 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package python3-simplejson. 2021-11-15T14:32:56.473 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:32:56.479 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-15T14:32:56.500 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:56.518 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:56.568 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:56.715 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:32:56.868 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T14:32:56.967 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:56.972 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package radosgw. 2021-11-15T14:32:56.981 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../101-radosgw_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:57.006 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:57.021 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:57.108 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:32:57.155 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:57.217 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:57.234 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T14:32:57.256 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:57.344 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T14:32:57.391 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:57.493 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T14:32:57.553 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:32:57.567 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:57.752 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:32:57.804 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:32:57.975 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package rbd-fuse. 2021-11-15T14:32:57.996 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T14:32:58.008 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-32-gb0aaed0f-1focal_amd64.deb ... 2021-11-15T14:32:58.030 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:32:58.049 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:58.213 INFO:teuthology.orchestra.run.gibba019.stdout:Adding system user cephadm....done 2021-11-15T14:32:58.230 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:58.332 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:32:58.332 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:32:58.364 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T14:32:58.374 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-15T14:32:58.541 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:58.550 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:32:58.615 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T14:32:58.629 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-15T14:32:58.642 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:32:58.772 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-15T14:32:58.851 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:32:58.867 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T14:32:58.898 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-15T14:32:58.918 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:32:58.968 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:32:59.093 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T14:32:59.124 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:59.261 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T14:32:59.328 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T14:32:59.538 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T14:32:59.621 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:32:59.707 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:32:59.781 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:32:59.803 INFO:teuthology.orchestra.run.gibba035.stdout:Adding system user cephadm....done 2021-11-15T14:32:59.827 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:32:59.872 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T14:32:59.907 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:32:59.934 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:32:59.963 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-15T14:33:00.035 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:33:00.106 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T14:33:00.125 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:33:00.230 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-15T14:33:00.236 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:00.333 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:33:00.362 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T14:33:00.401 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:33:00.474 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-15T14:33:00.542 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:33:00.613 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T14:33:00.633 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-15T14:33:00.660 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:33:00.785 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:00.873 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:00.909 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-15T14:33:00.962 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:33:00.985 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:33:00.991 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:01.132 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:01.132 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:01.135 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T14:33:01.244 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-15T14:33:01.549 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:01.550 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:33:01.550 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-15T14:33:01.551 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T14:33:01.551 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:01.551 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:33:01.589 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:33:01.641 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T14:33:01.705 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-15T14:33:01.752 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T14:33:01.808 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:33:01.901 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:33:01.973 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-15T14:33:02.027 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T14:33:02.045 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:33:02.092 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:33:02.224 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-15T14:33:02.278 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:33:02.318 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:33:02.339 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:02.404 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:33:02.466 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:02.475 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-ceph-argparse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:02.602 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:33:02.616 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:02.631 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:33:02.742 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T14:33:02.759 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-15T14:33:02.836 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T14:33:02.865 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T14:33:02.868 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-15T14:33:03.019 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T14:33:03.066 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:33:03.090 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-15T14:33:03.122 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T14:33:03.193 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:33:03.262 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:03.270 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-15T14:33:03.373 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T14:33:03.388 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:03.435 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T14:33:03.529 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-15T14:33:03.631 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:03.657 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:33:03.695 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:33:03.758 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:33:03.758 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:33:03.823 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-15T14:33:03.912 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:33:03.942 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:33:04.091 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-15T14:33:04.244 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:33:04.375 INFO:teuthology.orchestra.run.gibba032.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T14:33:04.400 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-15T14:33:04.427 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:04.495 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:33:04.532 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:33:04.643 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-15T14:33:04.658 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:33:04.755 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:33:04.910 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-15T14:33:04.926 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:33:04.965 INFO:teuthology.orchestra.run.gibba038.stdout:Adding group ceph....done 2021-11-15T14:33:05.057 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T14:33:05.136 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-15T14:33:05.158 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:05.177 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:33:05.303 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:33:05.324 INFO:teuthology.orchestra.run.gibba038.stdout:Adding system user ceph....done 2021-11-15T14:33:05.359 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T14:33:05.362 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-15T14:33:05.446 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T14:33:05.463 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-15T14:33:05.484 INFO:teuthology.orchestra.run.gibba038.stdout:Setting system user ceph properties....done 2021-11-15T14:33:05.497 INFO:teuthology.orchestra.run.gibba038.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T14:33:05.570 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T14:33:05.669 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:33:05.680 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:33:05.698 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-15T14:33:05.762 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T14:33:05.820 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T14:33:05.931 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:06.020 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:33:06.033 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-15T14:33:06.053 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:06.058 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T14:33:06.179 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:06.180 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:33:06.242 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-15T14:33:06.382 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:06.382 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:06.448 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:33:06.552 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-15T14:33:06.691 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T14:33:06.814 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:06.829 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-15T14:33:06.930 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:06.967 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:33:07.013 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T14:33:07.085 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:33:07.104 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:07.147 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-15T14:33:07.247 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:07.277 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T14:33:07.299 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:07.373 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T14:33:07.433 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-15T14:33:07.486 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:07.487 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:07.545 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:33:07.584 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-15T14:33:07.634 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T14:33:07.762 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:33:07.784 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:07.785 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-15T14:33:07.885 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:33:07.927 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-15T14:33:07.966 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:07.967 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:08.094 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T14:33:08.170 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-15T14:33:08.213 INFO:teuthology.orchestra.run.gibba019.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T14:33:08.277 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:08.354 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-15T14:33:08.357 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:33:08.379 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:08.411 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:08.505 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:33:08.516 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:33:08.589 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-15T14:33:08.723 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-15T14:33:08.740 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:08.742 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:33:08.825 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:08.825 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:08.965 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-15T14:33:09.010 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:33:09.122 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:09.137 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:33:09.256 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:09.258 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:33:09.285 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-15T14:33:09.296 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T14:33:09.374 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:09.467 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:33:09.521 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:33:09.558 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:09.559 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:09.805 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:09.859 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:09.877 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-15T14:33:09.932 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T14:33:10.018 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:10.144 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:10.264 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:10.320 INFO:teuthology.orchestra.run.gibba035.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-15T14:33:10.365 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:33:10.462 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-15T14:33:10.466 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:33:10.544 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T14:33:10.576 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:33:10.588 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-15T14:33:10.802 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:10.881 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-15T14:33:10.921 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:10.928 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T14:33:11.012 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:11.137 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T14:33:11.172 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:11.182 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-15T14:33:11.297 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T14:33:11.308 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-15T14:33:11.389 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:11.459 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-15T14:33:11.506 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:11.573 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T14:33:11.669 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-15T14:33:11.696 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:11.697 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:11.833 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:33:11.894 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up librados2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:11.991 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:12.020 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-15T14:33:12.068 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T14:33:12.092 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:33:12.285 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T14:33:12.378 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:12.504 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:33:12.553 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:33:12.564 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:12.730 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:12.847 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:12.856 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:33:12.948 INFO:teuthology.orchestra.run.gibba038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:12.950 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T14:33:12.973 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.031 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-15T14:33:13.074 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.108 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up librgw2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.115 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:33:13.136 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-15T14:33:13.136 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-15T14:33:13.175 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T14:33:13.216 INFO:teuthology.orchestra.run.gibba038.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T14:33:13.216 INFO:teuthology.orchestra.run.gibba038.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T14:33:13.216 INFO:teuthology.orchestra.run.gibba038.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T14:33:13.217 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:33:13.217 INFO:teuthology.orchestra.run.gibba038.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:33:13.217 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:33:13.217 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:33:13.217 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:33:13.218 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:33:13.218 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-15T14:33:13.219 INFO:teuthology.orchestra.run.gibba038.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T14:33:13.228 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-15T14:33:13.229 INFO:teuthology.orchestra.run.gibba038.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T14:33:13.229 INFO:teuthology.orchestra.run.gibba038.stdout: libssl-dev 2021-11-15T14:33:13.235 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:13.370 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-15T14:33:13.464 INFO:teuthology.orchestra.run.gibba038.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:33:13.465 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 2,913 kB of archives. 2021-11-15T14:33:13.465 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T14:33:13.465 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T14:33:13.469 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T14:33:13.629 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-15T14:33:13.721 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.847 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.888 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:13.913 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-15T14:33:14.013 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:33:14.074 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T14:33:14.097 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:14.122 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-15T14:33:14.247 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T14:33:14.249 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:33:14.256 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T14:33:14.270 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T14:33:14.290 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T14:33:14.292 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T14:33:14.328 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T14:33:14.328 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T14:33:14.329 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-15T14:33:14.432 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libcephfs2 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:14.537 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:33:14.575 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-15T14:33:14.663 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 2,913 kB in 1s (2,339 kB/s) 2021-11-15T14:33:14.748 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:33:14.764 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package flex. 2021-11-15T14:33:14.776 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libradosstriper1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:14.835 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T14:33:14.838 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:14.869 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:14.877 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T14:33:14.911 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-15T14:33:14.975 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:15.134 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T14:33:15.185 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-15T14:33:15.357 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package bison. 2021-11-15T14:33:15.368 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T14:33:15.408 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:15.410 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T14:33:15.432 INFO:teuthology.orchestra.run.gibba032.stdout:Adding group ceph....done 2021-11-15T14:33:15.611 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:15.729 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:15.783 INFO:teuthology.orchestra.run.gibba032.stdout:Adding system user ceph....done 2021-11-15T14:33:15.786 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T14:33:15.819 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T14:33:15.953 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:15.954 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:15.958 INFO:teuthology.orchestra.run.gibba032.stdout:Setting system user ceph properties....done 2021-11-15T14:33:15.974 INFO:teuthology.orchestra.run.gibba032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T14:33:16.010 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:16.033 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up librbd1 (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:16.054 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T14:33:16.136 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-15T14:33:16.235 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-15T14:33:16.251 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T14:33:16.263 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:16.336 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-15T14:33:16.390 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:33:16.414 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package dump. 2021-11-15T14:33:16.447 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-15T14:33:16.480 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T14:33:16.570 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:16.588 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-15T14:33:16.607 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T14:33:16.696 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:16.714 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-15T14:33:16.750 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package indent. 2021-11-15T14:33:16.784 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-15T14:33:16.817 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T14:33:16.875 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:33:16.898 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:16.899 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:16.956 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-15T14:33:17.070 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T14:33:17.103 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T14:33:17.145 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:17.168 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.216 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-modules-core (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.287 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.331 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.342 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.430 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.464 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T14:33:17.475 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T14:33:17.514 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:17.534 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:17.535 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-15T14:33:17.555 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T14:33:17.574 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T14:33:17.817 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T14:33:17.826 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libcephfs-dev (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.851 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:17.866 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:17.874 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T14:33:17.883 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:17.985 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-15T14:33:18.029 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:18.029 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:18.117 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.136 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T14:33:18.168 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:18.195 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-15T14:33:18.203 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:18.243 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.309 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.439 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T14:33:18.463 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-15T14:33:18.472 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-15T14:33:18.473 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:18.474 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:18.513 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:18.527 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.654 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:33:18.740 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-rados (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.777 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.867 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-rbd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.904 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:18.961 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T14:33:18.992 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up rbd-fuse (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.068 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:19.135 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-15T14:33:19.168 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:19.269 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:19.279 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:19.280 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:19.290 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.404 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:19.428 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-15T14:33:19.522 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:19.564 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.648 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T14:33:19.673 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.713 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-rgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.746 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T14:33:19.807 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:19.808 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.845 INFO:teuthology.orchestra.run.gibba019.stdout:Adding group ceph....done 2021-11-15T14:33:19.865 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-cephfs (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:19.898 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T14:33:19.959 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T14:33:20.009 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:20.009 INFO:teuthology.orchestra.run.gibba032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:20.074 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up cephfs-shell (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:20.093 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:20.179 INFO:teuthology.orchestra.run.gibba019.stdout:Adding system user ceph....done 2021-11-15T14:33:20.195 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:20.200 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-15T14:33:20.292 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:20.321 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:20.330 INFO:teuthology.orchestra.run.gibba019.stdout:Setting system user ceph properties....done 2021-11-15T14:33:20.357 INFO:teuthology.orchestra.run.gibba019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T14:33:20.426 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:20.431 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T14:33:20.553 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:20.617 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T14:33:20.680 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T14:33:20.872 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:20.877 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-common (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:20.899 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:21.026 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:21.255 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:21.255 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:21.449 INFO:teuthology.orchestra.run.gibba035.stdout:Adding group ceph....done 2021-11-15T14:33:21.650 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T14:33:21.652 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:21.833 INFO:teuthology.orchestra.run.gibba035.stdout:Adding system user ceph....done 2021-11-15T14:33:21.889 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T14:33:21.971 INFO:teuthology.orchestra.run.gibba035.stdout:Setting system user ceph properties....done 2021-11-15T14:33:21.981 INFO:teuthology.orchestra.run.gibba035.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-15T14:33:22.057 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-15T14:33:22.179 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:22.258 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-15T14:33:22.333 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:22.333 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:22.350 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:22.383 INFO:teuthology.orchestra.run.gibba038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:22.385 DEBUG:teuthology.parallel:result is None 2021-11-15T14:33:22.570 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-test (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:22.606 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:22.683 INFO:teuthology.orchestra.run.gibba032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:22.684 DEBUG:teuthology.orchestra.run.gibba032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T14:33:22.696 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up radosgw (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:22.720 INFO:teuthology.orchestra.run.gibba032.stdout:Reading package lists... 2021-11-15T14:33:22.799 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:22.799 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:22.825 INFO:teuthology.orchestra.run.gibba032.stdout:Building dependency tree... 2021-11-15T14:33:22.826 INFO:teuthology.orchestra.run.gibba032.stdout:Reading state information... 2021-11-15T14:33:22.898 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:22.898 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-15T14:33:22.905 INFO:teuthology.orchestra.run.gibba032.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T14:33:22.906 INFO:teuthology.orchestra.run.gibba032.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T14:33:22.906 INFO:teuthology.orchestra.run.gibba032.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T14:33:22.906 INFO:teuthology.orchestra.run.gibba032.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:33:22.906 INFO:teuthology.orchestra.run.gibba032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:33:22.907 INFO:teuthology.orchestra.run.gibba032.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:33:22.907 INFO:teuthology.orchestra.run.gibba032.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:33:22.907 INFO:teuthology.orchestra.run.gibba032.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:33:22.907 INFO:teuthology.orchestra.run.gibba032.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:33:22.908 INFO:teuthology.orchestra.run.gibba032.stdout:Suggested packages: 2021-11-15T14:33:22.908 INFO:teuthology.orchestra.run.gibba032.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T14:33:22.918 INFO:teuthology.orchestra.run.gibba032.stdout:The following NEW packages will be installed: 2021-11-15T14:33:22.919 INFO:teuthology.orchestra.run.gibba032.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T14:33:22.919 INFO:teuthology.orchestra.run.gibba032.stdout: libssl-dev 2021-11-15T14:33:23.132 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:23.135 INFO:teuthology.orchestra.run.gibba032.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:33:23.136 INFO:teuthology.orchestra.run.gibba032.stdout:Need to get 2,913 kB of archives. 2021-11-15T14:33:23.136 INFO:teuthology.orchestra.run.gibba032.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T14:33:23.136 INFO:teuthology.orchestra.run.gibba032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T14:33:23.266 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:23.340 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-base (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:23.587 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-15T14:33:23.662 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:23.662 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:23.781 INFO:teuthology.orchestra.run.gibba032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T14:33:23.875 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mds (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:23.968 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:23.969 INFO:teuthology.orchestra.run.gibba032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T14:33:23.979 INFO:teuthology.orchestra.run.gibba032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T14:33:24.005 INFO:teuthology.orchestra.run.gibba032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T14:33:24.014 INFO:teuthology.orchestra.run.gibba032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T14:33:24.015 INFO:teuthology.orchestra.run.gibba032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T14:33:24.023 INFO:teuthology.orchestra.run.gibba032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T14:33:24.025 INFO:teuthology.orchestra.run.gibba032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T14:33:24.025 INFO:teuthology.orchestra.run.gibba032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-15T14:33:24.026 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:24.026 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-15T14:33:24.095 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.262 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.310 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.356 INFO:teuthology.orchestra.run.gibba032.stdout:Fetched 2,913 kB in 1s (2,334 kB/s) 2021-11-15T14:33:24.454 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:24.454 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-15T14:33:24.455 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:24.456 INFO:teuthology.orchestra.run.gibba019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:24.481 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package flex. 2021-11-15T14:33:24.553 INFO:teuthology.orchestra.run.gibba032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T14:33:24.557 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:24.620 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T14:33:24.711 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.721 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.849 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.853 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-osd (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:24.950 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:25.101 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T14:33:25.240 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:25.241 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-15T14:33:25.284 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package bison. 2021-11-15T14:33:25.293 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:25.316 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T14:33:25.356 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:25.530 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-k8sevents (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:25.665 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:25.680 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T14:33:25.713 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T14:33:25.796 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:25.799 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mon (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:25.958 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:25.959 INFO:teuthology.orchestra.run.gibba035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-15T14:33:26.133 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package dump. 2021-11-15T14:33:26.144 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-15T14:33:26.182 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T14:33:26.234 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-cephadm (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:26.418 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:26.470 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package indent. 2021-11-15T14:33:26.503 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-15T14:33:26.536 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T14:33:26.544 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up ceph-mgr-dashboard (15.2.15-32-gb0aaed0f-1focal) ... 2021-11-15T14:33:26.663 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-15T14:33:26.780 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T14:33:26.813 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T14:33:26.846 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:26.847 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:26.862 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:27.134 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T14:33:27.167 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T14:33:27.180 INFO:teuthology.orchestra.run.gibba019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:27.181 DEBUG:teuthology.orchestra.run.gibba019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T14:33:27.208 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:27.219 INFO:teuthology.orchestra.run.gibba019.stdout:Reading package lists... 2021-11-15T14:33:27.320 INFO:teuthology.orchestra.run.gibba019.stdout:Building dependency tree... 2021-11-15T14:33:27.321 INFO:teuthology.orchestra.run.gibba019.stdout:Reading state information... 2021-11-15T14:33:27.399 INFO:teuthology.orchestra.run.gibba019.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T14:33:27.399 INFO:teuthology.orchestra.run.gibba019.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T14:33:27.399 INFO:teuthology.orchestra.run.gibba019.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T14:33:27.400 INFO:teuthology.orchestra.run.gibba019.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:33:27.400 INFO:teuthology.orchestra.run.gibba019.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:33:27.400 INFO:teuthology.orchestra.run.gibba019.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:33:27.400 INFO:teuthology.orchestra.run.gibba019.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:33:27.401 INFO:teuthology.orchestra.run.gibba019.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:33:27.401 INFO:teuthology.orchestra.run.gibba019.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:33:27.401 INFO:teuthology.orchestra.run.gibba019.stdout:Suggested packages: 2021-11-15T14:33:27.402 INFO:teuthology.orchestra.run.gibba019.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T14:33:27.411 INFO:teuthology.orchestra.run.gibba019.stdout:The following NEW packages will be installed: 2021-11-15T14:33:27.412 INFO:teuthology.orchestra.run.gibba019.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T14:33:27.412 INFO:teuthology.orchestra.run.gibba019.stdout: libssl-dev 2021-11-15T14:33:27.562 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T14:33:27.572 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:27.611 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:27.641 INFO:teuthology.orchestra.run.gibba019.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:33:27.642 INFO:teuthology.orchestra.run.gibba019.stdout:Need to get 2,913 kB of archives. 2021-11-15T14:33:27.642 INFO:teuthology.orchestra.run.gibba019.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T14:33:27.642 INFO:teuthology.orchestra.run.gibba019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T14:33:27.822 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T14:33:27.855 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:27.888 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:28.142 INFO:teuthology.orchestra.run.gibba032.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T14:33:28.165 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:28.176 INFO:teuthology.orchestra.run.gibba032.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-15T14:33:28.217 INFO:teuthology.orchestra.run.gibba032.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:28.228 INFO:teuthology.orchestra.run.gibba019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T14:33:28.414 INFO:teuthology.orchestra.run.gibba019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T14:33:28.423 INFO:teuthology.orchestra.run.gibba019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T14:33:28.447 INFO:teuthology.orchestra.run.gibba019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T14:33:28.459 INFO:teuthology.orchestra.run.gibba019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T14:33:28.459 INFO:teuthology.orchestra.run.gibba019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T14:33:28.465 INFO:teuthology.orchestra.run.gibba019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T14:33:28.466 INFO:teuthology.orchestra.run.gibba019.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T14:33:28.467 INFO:teuthology.orchestra.run.gibba019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-15T14:33:28.499 INFO:teuthology.orchestra.run.gibba035.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:28.500 DEBUG:teuthology.orchestra.run.gibba035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-15T14:33:28.535 INFO:teuthology.orchestra.run.gibba035.stdout:Reading package lists... 2021-11-15T14:33:28.639 INFO:teuthology.orchestra.run.gibba035.stdout:Building dependency tree... 2021-11-15T14:33:28.639 INFO:teuthology.orchestra.run.gibba035.stdout:Reading state information... 2021-11-15T14:33:28.665 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T14:33:28.718 INFO:teuthology.orchestra.run.gibba035.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-15T14:33:28.719 INFO:teuthology.orchestra.run.gibba035.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-15T14:33:28.719 INFO:teuthology.orchestra.run.gibba035.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-15T14:33:28.719 INFO:teuthology.orchestra.run.gibba035.stdout:The following packages were automatically installed and are no longer required: 2021-11-15T14:33:28.719 INFO:teuthology.orchestra.run.gibba035.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-15T14:33:28.719 INFO:teuthology.orchestra.run.gibba035.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-15T14:33:28.720 INFO:teuthology.orchestra.run.gibba035.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-15T14:33:28.720 INFO:teuthology.orchestra.run.gibba035.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-15T14:33:28.720 INFO:teuthology.orchestra.run.gibba035.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-15T14:33:28.721 INFO:teuthology.orchestra.run.gibba035.stdout:Suggested packages: 2021-11-15T14:33:28.721 INFO:teuthology.orchestra.run.gibba035.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-15T14:33:28.731 INFO:teuthology.orchestra.run.gibba035.stdout:The following NEW packages will be installed: 2021-11-15T14:33:28.732 INFO:teuthology.orchestra.run.gibba035.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-15T14:33:28.732 INFO:teuthology.orchestra.run.gibba035.stdout: libssl-dev 2021-11-15T14:33:28.788 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:28.791 INFO:teuthology.orchestra.run.gibba019.stdout:Fetched 2,913 kB in 1s (2,446 kB/s) 2021-11-15T14:33:28.914 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:28.927 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package flex. 2021-11-15T14:33:28.960 INFO:teuthology.orchestra.run.gibba035.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-15T14:33:28.961 INFO:teuthology.orchestra.run.gibba035.stdout:Need to get 2,913 kB of archives. 2021-11-15T14:33:28.961 INFO:teuthology.orchestra.run.gibba035.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-15T14:33:28.961 INFO:teuthology.orchestra.run.gibba035.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-15T14:33:29.003 INFO:teuthology.orchestra.run.gibba019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T14:33:29.007 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:29.039 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:29.041 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T14:33:29.166 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:29.284 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:29.385 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T14:33:29.466 INFO:teuthology.orchestra.run.gibba032.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T14:33:29.505 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package bison. 2021-11-15T14:33:29.515 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T14:33:29.519 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:29.556 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:29.578 INFO:teuthology.orchestra.run.gibba035.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-15T14:33:29.594 INFO:teuthology.orchestra.run.gibba032.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T14:33:29.663 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T14:33:29.780 INFO:teuthology.orchestra.run.gibba035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-15T14:33:29.788 INFO:teuthology.orchestra.run.gibba032.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:29.797 INFO:teuthology.orchestra.run.gibba035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-15T14:33:29.827 INFO:teuthology.orchestra.run.gibba035.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-15T14:33:29.837 INFO:teuthology.orchestra.run.gibba035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-15T14:33:29.838 INFO:teuthology.orchestra.run.gibba035.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-15T14:33:29.841 INFO:teuthology.orchestra.run.gibba035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-15T14:33:29.842 INFO:teuthology.orchestra.run.gibba035.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-15T14:33:29.843 INFO:teuthology.orchestra.run.gibba035.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-15T14:33:29.949 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:29.995 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T14:33:30.005 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T14:33:30.160 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:30.202 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:30.246 INFO:teuthology.orchestra.run.gibba035.stdout:Fetched 2,913 kB in 1s (2,200 kB/s) 2021-11-15T14:33:30.455 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package flex. 2021-11-15T14:33:30.529 INFO:teuthology.orchestra.run.gibba035.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-15T14:33:30.533 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:30.603 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-15T14:33:30.629 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package dump. 2021-11-15T14:33:30.638 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-15T14:33:30.678 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T14:33:30.940 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package indent. 2021-11-15T14:33:30.973 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-15T14:33:31.006 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T14:33:31.024 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package bison. 2021-11-15T14:33:31.034 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-15T14:33:31.075 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:31.284 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T14:33:31.304 INFO:teuthology.orchestra.run.gibba032.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T14:33:31.316 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T14:33:31.351 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:31.495 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-15T14:33:31.527 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-15T14:33:31.628 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:31.712 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T14:33:31.722 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T14:33:31.762 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:31.997 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package dump. 2021-11-15T14:33:32.008 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-15T14:33:32.037 INFO:teuthology.orchestra.run.gibba032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:32.039 DEBUG:teuthology.parallel:result is None 2021-11-15T14:33:32.046 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking dump (0.4b46-6) ... 2021-11-15T14:33:32.099 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T14:33:32.131 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:32.165 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:32.342 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package indent. 2021-11-15T14:33:32.375 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-15T14:33:32.588 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking indent (2.2.12-1) ... 2021-11-15T14:33:32.588 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T14:33:32.588 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:32.589 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:32.728 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-15T14:33:32.729 INFO:teuthology.orchestra.run.gibba019.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T14:33:32.761 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-15T14:33:32.762 INFO:teuthology.orchestra.run.gibba019.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-15T14:33:32.803 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:32.804 INFO:teuthology.orchestra.run.gibba019.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:33.214 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-15T14:33:33.223 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-15T14:33:33.263 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T14:33:33.313 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:33.391 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:33.550 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:33.676 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:33.692 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-15T14:33:33.701 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:33.741 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:33.803 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:33.962 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:34.002 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-15T14:33:34.034 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-15T14:33:34.088 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T14:33:34.093 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:34.186 INFO:teuthology.orchestra.run.gibba019.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T14:33:34.281 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:34.363 INFO:teuthology.orchestra.run.gibba035.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-15T14:33:34.372 INFO:teuthology.orchestra.run.gibba019.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T14:33:34.396 INFO:teuthology.orchestra.run.gibba035.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-15T14:33:34.441 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T14:33:34.463 INFO:teuthology.orchestra.run.gibba035.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:34.567 INFO:teuthology.orchestra.run.gibba019.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:34.727 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:34.861 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:34.944 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-15T14:33:35.067 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-15T14:33:35.226 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-15T14:33:35.436 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-15T14:33:35.563 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-15T14:33:35.705 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:35.831 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up dump (0.4b46-6) ... 2021-11-15T14:33:35.929 INFO:teuthology.orchestra.run.gibba035.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-15T14:33:36.024 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-15T14:33:36.074 INFO:teuthology.orchestra.run.gibba019.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T14:33:36.115 INFO:teuthology.orchestra.run.gibba035.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-15T14:33:36.184 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up indent (2.2.12-1) ... 2021-11-15T14:33:36.310 INFO:teuthology.orchestra.run.gibba035.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-15T14:33:36.461 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-15T14:33:36.604 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-15T14:33:36.875 INFO:teuthology.orchestra.run.gibba019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:36.876 DEBUG:teuthology.parallel:result is None 2021-11-15T14:33:37.707 INFO:teuthology.orchestra.run.gibba035.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-15T14:33:38.532 INFO:teuthology.orchestra.run.gibba035.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-15T14:33:38.533 DEBUG:teuthology.parallel:result is None 2021-11-15T14:33:38.534 DEBUG:teuthology.orchestra.run.gibba035:> sudo lsb_release -is 2021-11-15T14:33:38.596 INFO:teuthology.orchestra.run.gibba035.stdout:Ubuntu 2021-11-15T14:33:38.599 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:33:38.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:33:38.957 DEBUG:teuthology.orchestra.run.gibba035:> dpkg-query -W -f '${Version}' ceph 2021-11-15T14:33:38.973 INFO:teuthology.orchestra.run.gibba035.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:38.974 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:38.974 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T14:33:38.975 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-15T14:33:39.002 INFO:teuthology.orchestra.run.gibba019.stdout:Ubuntu 2021-11-15T14:33:39.005 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:33:39.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:33:39.352 DEBUG:teuthology.orchestra.run.gibba019:> dpkg-query -W -f '${Version}' ceph 2021-11-15T14:33:39.367 INFO:teuthology.orchestra.run.gibba019.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:39.367 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:39.368 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T14:33:39.368 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-15T14:33:39.396 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-15T14:33:39.398 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:33:39.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:33:39.771 DEBUG:teuthology.orchestra.run.gibba038:> dpkg-query -W -f '${Version}' ceph 2021-11-15T14:33:39.787 INFO:teuthology.orchestra.run.gibba038.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:39.787 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:39.788 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T14:33:39.788 DEBUG:teuthology.orchestra.run.gibba032:> sudo lsb_release -is 2021-11-15T14:33:39.816 INFO:teuthology.orchestra.run.gibba032.stdout:Ubuntu 2021-11-15T14:33:39.819 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-15T14:33:39.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-15T14:33:40.153 DEBUG:teuthology.orchestra.run.gibba032:> dpkg-query -W -f '${Version}' ceph 2021-11-15T14:33:40.196 INFO:teuthology.orchestra.run.gibba032.stdout:15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:40.196 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32-gb0aaed0f-1focal 2021-11-15T14:33:40.197 INFO:teuthology.task.install:The correct ceph version 15.2.15-32-gb0aaed0f-1focal is installed. 2021-11-15T14:33:40.197 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-15T14:33:40.198 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:40.198 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T14:33:40.210 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:40.210 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T14:33:40.222 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:40.223 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T14:33:40.233 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:40.234 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-15T14:33:40.259 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-15T14:33:40.260 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:40.260 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T14:33:40.268 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T14:33:40.277 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:40.277 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T14:33:40.286 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T14:33:40.350 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:40.350 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T14:33:40.371 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T14:33:40.383 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:40.383 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/usr/bin/daemon-helper 2021-11-15T14:33:40.404 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-15T14:33:40.467 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-15T14:33:40.468 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:40.469 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T14:33:40.480 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T14:33:40.486 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:40.486 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T14:33:40.507 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T14:33:40.570 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:40.571 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T14:33:40.592 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T14:33:40.645 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:40.645 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-15T14:33:40.657 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-15T14:33:40.663 INFO:teuthology.run_tasks:Running task ceph... 2021-11-15T14:33:40.725 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-11-15T14:33:40.725 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 777 /var/log/ceph 2021-11-15T14:33:40.729 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod 777 /var/log/ceph 2021-11-15T14:33:40.732 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 777 /var/log/ceph 2021-11-15T14:33:40.735 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 777 /var/log/ceph 2021-11-15T14:33:40.755 INFO:tasks.ceph:Disabling ceph logrotate... 2021-11-15T14:33:40.755 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T14:33:40.792 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T14:33:40.796 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T14:33:40.799 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-15T14:33:40.813 INFO:tasks.ceph:Creating extra log directories... 2021-11-15T14:33:40.813 DEBUG:teuthology.orchestra.run.gibba019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T14:33:40.817 DEBUG:teuthology.orchestra.run.gibba032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T14:33:40.820 DEBUG:teuthology.orchestra.run.gibba035:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T14:33:40.822 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-15T14:33:40.838 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-11-15T14:33:40.839 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-11-15T14:33:40.839 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-11-15T14:33:40.840 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:40.840 DEBUG:teuthology.orchestra.run.gibba035:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T14:33:40.875 DEBUG:teuthology.orchestra.run.gibba035:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T14:33:40.893 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:40.893 DEBUG:teuthology.orchestra.run.gibba019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T14:33:40.902 DEBUG:teuthology.orchestra.run.gibba019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T14:33:40.965 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:40.965 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T14:33:40.974 DEBUG:teuthology.orchestra.run.gibba038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T14:33:41.016 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:41.017 DEBUG:teuthology.orchestra.run.gibba032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-15T14:33:41.026 DEBUG:teuthology.orchestra.run.gibba032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-15T14:33:41.086 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-11-15T14:33:41.086 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-15T14:33:41.087 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6498751', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'gibba', 'name': 'teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (4, 'gibba')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'd4737010a85099043cf081dc05b4069d301b23fb', 'timestamp': '2021-11-12_04:10:03', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.gibba.12707', 'targets': {'gibba035.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdoQrdhmFWU8Ip3YPNeNsqlVGcDQ2m2e7YNfDKDfsb25hWm5R2l6NHnh3iRBpvu1ufUSXejUSOZe0FzeBcjZaMRZRxkja67D8P5LT1SqUNddzor3sOPyGVx9z5Ikso9OfENHPGkS8d/mr6S2PnUpkuyfqUbF31lTQ8EHoRqIop+ANuIu5lumaMEYVpLzuVIXujSIg3mT14gg/cIUpe1tae/VJnTNAUfdFI316fvtXb+N2fjFtyzVJYoC2miiRKGmMclqqB6lff9OjluM6e+tp3SC2r6b1QDfdl8Y8xRQNLC9Z/M5DfLpr7gsnHf0ZClIa16LE0tQc7Z+vBn8i5rbYFP/RfersIg3pXzT21ath8/mwczES05l/ik0Q2WEnOH9WpO5ibQL37EMouh1h/yxGuinaiC5S4Khv8Eo7l5HiafaNa+sFyja8iYdihQgWOMVe9vYlnoAMakhekMWjhBS7rnUe7nepjtVzWN+FgAqjtUY4GLvGu1ZsznDFqc8EaS0c=', 'gibba019.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9GAfH3aAd5lecXVRByaCaWgGApMHWxlHFV78zSMnj/Jf1ox3vgcx4dkspa6vxQ9pQVvqC0U30Bgy1AktOkN9qCoiLysH4OysYU5UkYHPbEsWmV8FKcHptiam2UDqN4KtH6V3HK4NLJvrNVj0R/1AA3s84zgWNog2oUz1JG9vG6CS+5vr73SYmEwm2ygpfBpzeXrBWup6qYcBR5ZphecskX92/sbpyyHduflw3wp4m9oLblyyagcWH4cCucPS405WgpfKvIODOUd8ioRBmKNvNsAv42zYHs1E7CkSlrg+yugCb0R3aUb48w4tbLVUkD3WvkU8rUihKOnCrv7GBBNuS5LARwsxE6zps94mc4ZBeKB/fUjvLUKpjqiTctqHkogXUtXmt2nHcRDKs/udG/s5vHXfrQ2+9KOlFSk1BI8ISRuJK43b0lN2/IwFBdgJeF2ftdUNwlMf1QviOc/xfR9XDthDr62gH6IAkSznkHJvRsU2pWAhoGHXby+NLfVYiHxU=', 'gibba038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7m7IpvKkSkTn1LiQ6OWNKReM0vhqPVKkIN/bRrCWCdTjsY0mTk6T/DKv3TrM+NXxNOOGg/LN+uFy286fo6M+pF8eP84kdnq7uYFOYc01B66apkb+HwhvcriNLVRvQkPIpZZF6Y+L3y7UF63u74Wk+bkrGqmT17DRnaD6Vgy8NlRLw7ln/tyQBFNwZUTuEaK6ZqWXhlkxfVFV8mcWLoReyqPXwcxJ8PUsNeBsvlt9MjiuQm9+TZ8Z2ioqmMBLYDyV9ruWU7fJ+BuVN30uAESTFf7CJfkSI+yjAd4rUL4OUEf7Bs16EnRuBmQ5ZEywSTRNPckWt2TkrhV2XWGVy8s0Q0sMqa97P+j22O8+WMMJVKBROzS7ufbK3H7Zog5uyK+idy5cmbCX0js2DsPMfSkMx6TuaTgP2USxaJaeTbQa8sLX0lpBP2FZ+nTu3LJFJoeeXVazNgh8uofvP6QyY1CvbbGkjfCERdxPcqJzzN+7oRg9MjmhBLR/9LYg36s79SeM=', 'gibba032.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5su0/SP3ZNSDHsIsz7Q+CSzkusG/RcGCFLSx3rwZUiK6Ob6C3WppsEGG9KzwPqPIwpZ6cjUXbm7D/qc2q+GgO0b/vmHQlHjxBz2PzycytYiKcLk1O6kWOZteYbtcryKnyQcKn/LD8nWOFxEFKgczY/Iap3v39M6S2ac9x3SC18IFizXhQ42nhwFLg/FVFRC2rQWFPSFZYnPSl3k6Bp8EyJhuAH5sqQcV88HA0rcv3UifYQ6RKkTIqIBt2JfmigADcVn6qmPIHB/rwpE7ig9aLA4hlDItZ9TR3mSz50K0gAaLXLeHEta7WUB1ap55rsQ5PgZBh2Ctbe/Y96DJ7rp6M9MUNmt+SnNBXi5tF4sMLhIi/XNZm0neldMF3cfOo+npK/qEv+WBPkQ0LzJ7JJfWX/k9cJg1+zKDdFJXiH5OUqUse6bk8FzrPf9Iko8R0AdnL1mM11MECGU+K9V3S9+Ryi78rzAXIH3c7xBPgqVHPFMp7WbubAMZGvzO8HWcmyIM='}} 2021-11-15T14:33:41.088 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T14:33:41.091 DEBUG:teuthology.orchestra.run.gibba032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T14:33:41.093 DEBUG:teuthology.orchestra.run.gibba035:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T14:33:41.097 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-15T14:33:41.104 DEBUG:teuthology.orchestra.run.gibba019:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T14:33:41.107 DEBUG:teuthology.orchestra.run.gibba032:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T14:33:41.109 DEBUG:teuthology.orchestra.run.gibba035:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T14:33:41.148 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/run/ceph 2021-11-15T14:33:41.171 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:41.171 DEBUG:teuthology.orchestra.run.gibba035:> dd if=/scratch_devs of=/dev/stdout 2021-11-15T14:33:41.180 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-15T14:33:41.181 DEBUG:teuthology.orchestra.run.gibba035:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-15T14:33:41.231 INFO:teuthology.orchestra.run.gibba035.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-15T14:33:41.231 INFO:teuthology.orchestra.run.gibba035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.232 INFO:teuthology.orchestra.run.gibba035.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-11-15T14:33:41.232 INFO:teuthology.orchestra.run.gibba035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.232 INFO:teuthology.orchestra.run.gibba035.stdout:Access: 2021-11-15 14:30:30.365147300 +0000 2021-11-15T14:33:41.232 INFO:teuthology.orchestra.run.gibba035.stdout:Modify: 2021-11-15 14:30:30.237146930 +0000 2021-11-15T14:33:41.232 INFO:teuthology.orchestra.run.gibba035.stdout:Change: 2021-11-15 14:30:30.237146930 +0000 2021-11-15T14:33:41.233 INFO:teuthology.orchestra.run.gibba035.stdout: Birth: - 2021-11-15T14:33:41.238 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records in 2021-11-15T14:33:41.238 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records out 2021-11-15T14:33:41.238 INFO:teuthology.orchestra.run.gibba035.stderr:512 bytes copied, 0.000179883 s, 2.8 MB/s 2021-11-15T14:33:41.240 DEBUG:teuthology.orchestra.run.gibba035:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-15T14:33:41.243 INFO:teuthology.orchestra.run.gibba035.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-15T14:33:41.243 INFO:teuthology.orchestra.run.gibba035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.244 INFO:teuthology.orchestra.run.gibba035.stdout:Device: 6h/6d Inode: 374 Links: 1 2021-11-15T14:33:41.244 INFO:teuthology.orchestra.run.gibba035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.244 INFO:teuthology.orchestra.run.gibba035.stdout:Access: 2021-11-15 14:30:30.733148361 +0000 2021-11-15T14:33:41.244 INFO:teuthology.orchestra.run.gibba035.stdout:Modify: 2021-11-15 14:30:30.589147946 +0000 2021-11-15T14:33:41.245 INFO:teuthology.orchestra.run.gibba035.stdout:Change: 2021-11-15 14:30:30.589147946 +0000 2021-11-15T14:33:41.245 INFO:teuthology.orchestra.run.gibba035.stdout: Birth: - 2021-11-15T14:33:41.246 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records in 2021-11-15T14:33:41.246 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records out 2021-11-15T14:33:41.246 INFO:teuthology.orchestra.run.gibba035.stderr:512 bytes copied, 0.000165386 s, 3.1 MB/s 2021-11-15T14:33:41.247 DEBUG:teuthology.orchestra.run.gibba035:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-15T14:33:41.251 INFO:teuthology.orchestra.run.gibba035.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-15T14:33:41.251 INFO:teuthology.orchestra.run.gibba035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.251 INFO:teuthology.orchestra.run.gibba035.stdout:Device: 6h/6d Inode: 383 Links: 1 2021-11-15T14:33:41.252 INFO:teuthology.orchestra.run.gibba035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.252 INFO:teuthology.orchestra.run.gibba035.stdout:Access: 2021-11-15 14:30:31.149149559 +0000 2021-11-15T14:33:41.252 INFO:teuthology.orchestra.run.gibba035.stdout:Modify: 2021-11-15 14:30:30.993149110 +0000 2021-11-15T14:33:41.252 INFO:teuthology.orchestra.run.gibba035.stdout:Change: 2021-11-15 14:30:30.993149110 +0000 2021-11-15T14:33:41.252 INFO:teuthology.orchestra.run.gibba035.stdout: Birth: - 2021-11-15T14:33:41.254 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records in 2021-11-15T14:33:41.254 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records out 2021-11-15T14:33:41.254 INFO:teuthology.orchestra.run.gibba035.stderr:512 bytes copied, 0.000161073 s, 3.2 MB/s 2021-11-15T14:33:41.255 DEBUG:teuthology.orchestra.run.gibba035:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-15T14:33:41.259 INFO:teuthology.orchestra.run.gibba035.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-15T14:33:41.259 INFO:teuthology.orchestra.run.gibba035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.260 INFO:teuthology.orchestra.run.gibba035.stdout:Device: 6h/6d Inode: 387 Links: 1 2021-11-15T14:33:41.260 INFO:teuthology.orchestra.run.gibba035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.260 INFO:teuthology.orchestra.run.gibba035.stdout:Access: 2021-11-15 14:30:31.533150666 +0000 2021-11-15T14:33:41.260 INFO:teuthology.orchestra.run.gibba035.stdout:Modify: 2021-11-15 14:30:31.433150378 +0000 2021-11-15T14:33:41.261 INFO:teuthology.orchestra.run.gibba035.stdout:Change: 2021-11-15 14:30:31.433150378 +0000 2021-11-15T14:33:41.261 INFO:teuthology.orchestra.run.gibba035.stdout: Birth: - 2021-11-15T14:33:41.262 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records in 2021-11-15T14:33:41.263 INFO:teuthology.orchestra.run.gibba035.stderr:1+0 records out 2021-11-15T14:33:41.263 INFO:teuthology.orchestra.run.gibba035.stderr:512 bytes copied, 0.000233711 s, 2.2 MB/s 2021-11-15T14:33:41.264 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:41.265 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:41.265 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/scratch_devs of=/dev/stdout 2021-11-15T14:33:41.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-15T14:33:41.275 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-15T14:33:41.283 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-15T14:33:41.284 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.284 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-11-15T14:33:41.284 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.284 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-15 14:30:28.398833488 +0000 2021-11-15T14:33:41.284 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-15 14:30:28.266833102 +0000 2021-11-15T14:33:41.285 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-15 14:30:28.266833102 +0000 2021-11-15T14:33:41.285 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-15T14:33:41.291 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-15T14:33:41.291 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-15T14:33:41.292 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000247316 s, 2.1 MB/s 2021-11-15T14:33:41.293 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-15T14:33:41.296 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-15T14:33:41.297 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.297 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-11-15T14:33:41.297 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.297 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-15 14:30:28.802834669 +0000 2021-11-15T14:33:41.298 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-15 14:30:28.642834201 +0000 2021-11-15T14:33:41.298 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-15 14:30:28.642834201 +0000 2021-11-15T14:33:41.298 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-15T14:33:41.299 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-15T14:33:41.299 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-15T14:33:41.300 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000233052 s, 2.2 MB/s 2021-11-15T14:33:41.301 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-15T14:33:41.346 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-15T14:33:41.347 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.347 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-11-15T14:33:41.347 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.347 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-15 14:30:29.170835743 +0000 2021-11-15T14:33:41.348 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-15 14:30:29.050835394 +0000 2021-11-15T14:33:41.348 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-15 14:30:29.050835394 +0000 2021-11-15T14:33:41.348 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-15T14:33:41.351 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-15T14:33:41.351 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-15T14:33:41.351 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000284474 s, 1.8 MB/s 2021-11-15T14:33:41.354 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-15T14:33:41.359 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-15T14:33:41.360 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-15T14:33:41.360 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-11-15T14:33:41.360 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-15T14:33:41.360 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-15 14:30:29.514836750 +0000 2021-11-15T14:33:41.360 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-15 14:30:29.418836468 +0000 2021-11-15T14:33:41.361 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-15 14:30:29.418836468 +0000 2021-11-15T14:33:41.361 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-15T14:33:41.367 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-15T14:33:41.367 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-15T14:33:41.367 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000348704 s, 1.5 MB/s 2021-11-15T14:33:41.371 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:41.372 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba035.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba019.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-15T14:33:41.372 INFO:tasks.ceph:Generating config... 2021-11-15T14:33:41.374 INFO:tasks.ceph:[client] client mount timeout = 600 2021-11-15T14:33:41.374 INFO:tasks.ceph:[client] debug client = 20 2021-11-15T14:33:41.374 INFO:tasks.ceph:[client] debug ms = 1 2021-11-15T14:33:41.375 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-11-15T14:33:41.375 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-11-15T14:33:41.375 INFO:tasks.ceph:[mds] debug mds = 20 2021-11-15T14:33:41.375 INFO:tasks.ceph:[mds] debug ms = 1 2021-11-15T14:33:41.376 INFO:tasks.ceph:[mds] mds bal frag = True 2021-11-15T14:33:41.376 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-11-15T14:33:41.376 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-11-15T14:33:41.377 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-11-15T14:33:41.377 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-11-15T14:33:41.377 INFO:tasks.ceph:[mds] mds debug frag = True 2021-11-15T14:33:41.378 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-11-15T14:33:41.378 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-11-15T14:33:41.378 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-11-15T14:33:41.378 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-11-15T14:33:41.379 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-11-15T14:33:41.379 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-11-15T14:33:41.379 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-15T14:33:41.380 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-15T14:33:41.380 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-15T14:33:41.380 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-15T14:33:41.380 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-15T14:33:41.381 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-11-15T14:33:41.381 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-15T14:33:41.381 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-11-15T14:33:41.382 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-15T14:33:41.382 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-11-15T14:33:41.382 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-11-15T14:33:41.382 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-15T14:33:41.383 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-15T14:33:41.383 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-11-15T14:33:41.383 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-15T14:33:41.384 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-15T14:33:41.384 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-15T14:33:41.384 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-15T14:33:41.384 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-15T14:33:41.385 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-11-15T14:33:41.385 INFO:tasks.ceph:Setting up mon.a... 2021-11-15T14:33:41.385 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-11-15T14:33:41.427 INFO:teuthology.orchestra.run.gibba035.stdout:creating /etc/ceph/ceph.keyring 2021-11-15T14:33:41.429 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-11-15T14:33:41.450 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T14:33:41.500 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.2.135'), ('mon.b', '172.21.2.119'), ('mon.c', '[v2:172.21.2.119:3301,v1:172.21.2.119:6790]')] 2021-11-15T14:33:41.501 DEBUG:teuthology.orchestra.run.gibba035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.135 --add b 172.21.2.119 --addv c '[v2:172.21.2.119:3301,v1:172.21.2.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.520 INFO:teuthology.orchestra.run.gibba035.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.520 INFO:teuthology.orchestra.run.gibba035.stdout:monmaptool: generated fsid aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.520 INFO:teuthology.orchestra.run.gibba035.stdout:epoch 0 2021-11-15T14:33:41.520 INFO:teuthology.orchestra.run.gibba035.stdout:fsid aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.521 INFO:teuthology.orchestra.run.gibba035.stdout:last_changed 2021-11-15T14:33:41.521483+0000 2021-11-15T14:33:41.521 INFO:teuthology.orchestra.run.gibba035.stdout:created 2021-11-15T14:33:41.521483+0000 2021-11-15T14:33:41.521 INFO:teuthology.orchestra.run.gibba035.stdout:min_mon_release 0 (unknown) 2021-11-15T14:33:41.521 INFO:teuthology.orchestra.run.gibba035.stdout:0: [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] mon.a 2021-11-15T14:33:41.522 INFO:teuthology.orchestra.run.gibba035.stdout:1: [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] mon.b 2021-11-15T14:33:41.522 INFO:teuthology.orchestra.run.gibba035.stdout:2: [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] mon.c 2021-11-15T14:33:41.522 INFO:teuthology.orchestra.run.gibba035.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-11-15T14:33:41.523 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aa03efb2-9530-4b02-8a4e-1fb04db0e3e8... 2021-11-15T14:33:41.525 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:33:41.528 DEBUG:teuthology.orchestra.run.gibba032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:33:41.531 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:33:41.534 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:33:41.543 INFO:teuthology.orchestra.run.gibba035.stdout:[global] 2021-11-15T14:33:41.543 INFO:teuthology.orchestra.run.gibba035.stdout: chdir = "" 2021-11-15T14:33:41.543 INFO:teuthology.orchestra.run.gibba035.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:33:41.543 INFO:teuthology.orchestra.run.gibba035.stdout: auth supported = cephx 2021-11-15T14:33:41.544 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.544 INFO:teuthology.orchestra.run.gibba035.stdout: filestore xattr use omap = true 2021-11-15T14:33:41.544 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.544 INFO:teuthology.orchestra.run.gibba035.stdout: mon clock drift allowed = 1.000 2021-11-15T14:33:41.545 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.545 INFO:teuthology.orchestra.run.gibba035.stdout: osd crush chooseleaf type = 0 2021-11-15T14:33:41.545 INFO:teuthology.orchestra.run.gibba035.stdout: auth debug = true 2021-11-15T14:33:41.545 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.545 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on old message = true 2021-11-15T14:33:41.546 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on bug = true 2021-11-15T14:33:41.546 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.546 INFO:teuthology.orchestra.run.gibba035.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:33:41.546 INFO:teuthology.orchestra.run.gibba035.stdout: mon pg warn max object skew = 0 2021-11-15T14:33:41.547 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.547 INFO:teuthology.orchestra.run.gibba035.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:33:41.547 INFO:teuthology.orchestra.run.gibba035.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:33:41.547 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.548 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default size = 2 2021-11-15T14:33:41.548 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.548 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow primary affinity = true 2021-11-15T14:33:41.548 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow pg remap = true 2021-11-15T14:33:41.548 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:33:41.549 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:33:41.549 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on no sortbitwise = false 2021-11-15T14:33:41.549 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:33:41.549 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on too few osds = false 2021-11-15T14:33:41.550 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:33:41.550 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:33:41.550 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.550 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:33:41.550 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.551 INFO:teuthology.orchestra.run.gibba035.stdout: osd default data pool replay window = 5 2021-11-15T14:33:41.551 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.551 INFO:teuthology.orchestra.run.gibba035.stdout: mon allow pool delete = true 2021-11-15T14:33:41.551 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.552 INFO:teuthology.orchestra.run.gibba035.stdout: mon cluster log file level = debug 2021-11-15T14:33:41.552 INFO:teuthology.orchestra.run.gibba035.stdout: debug asserts on shutdown = true 2021-11-15T14:33:41.552 INFO:teuthology.orchestra.run.gibba035.stdout: mon health detail to clog = false 2021-11-15T14:33:41.552 INFO:teuthology.orchestra.run.gibba035.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:33:41.552 INFO:teuthology.orchestra.run.gibba035.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.553 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.553 INFO:teuthology.orchestra.run.gibba035.stdout:[osd] 2021-11-15T14:33:41.553 INFO:teuthology.orchestra.run.gibba035.stdout: osd journal size = 100 2021-11-15T14:33:41.553 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.553 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub load threshold = 5.0 2021-11-15T14:33:41.554 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub max interval = 600 2021-11-15T14:33:41.554 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.554 INFO:teuthology.orchestra.run.gibba035.stdout: osd recover clone overlap = true 2021-11-15T14:33:41.554 INFO:teuthology.orchestra.run.gibba035.stdout: osd recovery max chunk = 1048576 2021-11-15T14:33:41.555 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.555 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug shutdown = true 2021-11-15T14:33:41.555 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug op order = true 2021-11-15T14:33:41.555 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug verify stray on activate = true 2021-11-15T14:33:41.555 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.556 INFO:teuthology.orchestra.run.gibba035.stdout: osd open classes on start = true 2021-11-15T14:33:41.556 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug pg log writeout = true 2021-11-15T14:33:41.556 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.556 INFO:teuthology.orchestra.run.gibba035.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:33:41.557 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.557 INFO:teuthology.orchestra.run.gibba035.stdout: osd map max advance = 10 2021-11-15T14:33:41.557 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.557 INFO:teuthology.orchestra.run.gibba035.stdout: journal zero on create = true 2021-11-15T14:33:41.557 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.558 INFO:teuthology.orchestra.run.gibba035.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:33:41.558 INFO:teuthology.orchestra.run.gibba035.stdout: filestore apply finisher threads = 3 2021-11-15T14:33:41.558 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.558 INFO:teuthology.orchestra.run.gibba035.stdout: bdev debug aio = true 2021-11-15T14:33:41.559 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug misdirected ops = true 2021-11-15T14:33:41.559 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore block size = 96636764160 2021-11-15T14:33:41.559 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore compression mode = aggressive 2021-11-15T14:33:41.559 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore fsck on mount = True 2021-11-15T14:33:41.559 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluefs = 20 2021-11-15T14:33:41.560 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluestore = 20 2021-11-15T14:33:41.560 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:33:41.560 INFO:teuthology.orchestra.run.gibba035.stdout: debug osd = 20 2021-11-15T14:33:41.560 INFO:teuthology.orchestra.run.gibba035.stdout: debug rocksdb = 10 2021-11-15T14:33:41.561 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:33:41.561 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd full ratio = 0.9 2021-11-15T14:33:41.561 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:33:41.561 INFO:teuthology.orchestra.run.gibba035.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:33:41.561 INFO:teuthology.orchestra.run.gibba035.stdout: osd objectstore = bluestore 2021-11-15T14:33:41.562 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:33:41.562 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.562 INFO:teuthology.orchestra.run.gibba035.stdout:[mgr] 2021-11-15T14:33:41.562 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:33:41.562 INFO:teuthology.orchestra.run.gibba035.stdout: debug mgr = 20 2021-11-15T14:33:41.563 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:33:41.563 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:33:41.563 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.563 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.564 INFO:teuthology.orchestra.run.gibba035.stdout: mgr/telemetry/nag = false 2021-11-15T14:33:41.564 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.564 INFO:teuthology.orchestra.run.gibba035.stdout:[mon] 2021-11-15T14:33:41.564 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:33:41.564 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:33:41.565 INFO:teuthology.orchestra.run.gibba035.stdout: debug paxos = 20 2021-11-15T14:33:41.565 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:33:41.565 INFO:teuthology.orchestra.run.gibba035.stdout: mon data avail warn = 5 2021-11-15T14:33:41.565 INFO:teuthology.orchestra.run.gibba035.stdout: mon mgr mkfs grace = 240 2021-11-15T14:33:41.566 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.566 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd reporter subtree level = osd 2021-11-15T14:33:41.566 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd prime pg temp = true 2021-11-15T14:33:41.566 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.567 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.567 INFO:teuthology.orchestra.run.gibba035.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:33:41.567 INFO:teuthology.orchestra.run.gibba035.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:33:41.567 INFO:teuthology.orchestra.run.gibba035.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:33:41.567 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.568 INFO:teuthology.orchestra.run.gibba035.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:33:41.568 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:33:41.568 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:33:41.568 INFO:teuthology.orchestra.run.gibba035.stdout: mon op complaint time = 120 2021-11-15T14:33:41.569 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:33:41.569 INFO:teuthology.orchestra.run.gibba035.stdout:[client] 2021-11-15T14:33:41.569 INFO:teuthology.orchestra.run.gibba035.stdout: rgw cache enabled = true 2021-11-15T14:33:41.569 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable ops log = true 2021-11-15T14:33:41.569 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable usage log = true 2021-11-15T14:33:41.570 INFO:teuthology.orchestra.run.gibba035.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:33:41.570 INFO:teuthology.orchestra.run.gibba035.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:33:41.570 INFO:teuthology.orchestra.run.gibba035.stdout: client mount timeout = 600 2021-11-15T14:33:41.570 INFO:teuthology.orchestra.run.gibba035.stdout: debug client = 20 2021-11-15T14:33:41.571 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:33:41.571 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.571 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.571 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.a] 2021-11-15T14:33:41.571 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.b] 2021-11-15T14:33:41.572 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.c] 2021-11-15T14:33:41.572 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.a] 2021-11-15T14:33:41.572 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.c] 2021-11-15T14:33:41.572 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.b] 2021-11-15T14:33:41.572 INFO:teuthology.orchestra.run.gibba035.stdout:[mds] 2021-11-15T14:33:41.573 INFO:teuthology.orchestra.run.gibba035.stdout: debug mds = 20 2021-11-15T14:33:41.573 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:33:41.573 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal frag = True 2021-11-15T14:33:41.573 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal fragment size max = 10000 2021-11-15T14:33:41.574 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal merge size = 5 2021-11-15T14:33:41.574 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split bits = 3 2021-11-15T14:33:41.574 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split size = 100 2021-11-15T14:33:41.574 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug frag = True 2021-11-15T14:33:41.574 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug scatterstat = True 2021-11-15T14:33:41.575 INFO:teuthology.orchestra.run.gibba035.stdout: mds op complaint time = 180 2021-11-15T14:33:41.575 INFO:teuthology.orchestra.run.gibba035.stdout: mds verify scatter = True 2021-11-15T14:33:41.575 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:33:41.575 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.576 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.578 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-15T14:33:41.579 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-15T14:33:41.579 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:33:41.579 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-15T14:33:41.579 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.580 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-15T14:33:41.580 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.580 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-15T14:33:41.580 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.580 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-15T14:33:41.581 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-15T14:33:41.581 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.581 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-15T14:33:41.581 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-15T14:33:41.582 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.582 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:33:41.582 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-15T14:33:41.582 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.582 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:33:41.583 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:33:41.583 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.583 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-15T14:33:41.583 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-15T14:33:41.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-15T14:33:41.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:33:41.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:33:41.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-15T14:33:41.585 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:33:41.585 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-15T14:33:41.585 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:33:41.585 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:33:41.586 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.586 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:33:41.586 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.586 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-15T14:33:41.586 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.587 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-15T14:33:41.587 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.587 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-15T14:33:41.587 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-15T14:33:41.588 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-15T14:33:41.588 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:33:41.588 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.588 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.588 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-15T14:33:41.589 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-15T14:33:41.589 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.589 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-15T14:33:41.589 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-15T14:33:41.589 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.590 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-15T14:33:41.590 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-15T14:33:41.590 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.590 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-15T14:33:41.591 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-15T14:33:41.591 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-15T14:33:41.591 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.591 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-15T14:33:41.591 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-15T14:33:41.592 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.592 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:33:41.592 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.592 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-15T14:33:41.593 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.593 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-15T14:33:41.593 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.593 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:33:41.593 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-15T14:33:41.594 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.594 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-15T14:33:41.594 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-15T14:33:41.594 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-15T14:33:41.595 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-15T14:33:41.595 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-15T14:33:41.595 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-15T14:33:41.595 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-15T14:33:41.595 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:33:41.596 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-15T14:33:41.596 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-15T14:33:41.596 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:33:41.596 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-15T14:33:41.597 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:33:41.597 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:33:41.597 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-15T14:33:41.597 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:33:41.597 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.598 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-15T14:33:41.598 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:33:41.598 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-15T14:33:41.598 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:33:41.598 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:33:41.599 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.599 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.599 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-15T14:33:41.599 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.600 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-15T14:33:41.600 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:33:41.600 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:33:41.600 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-15T14:33:41.600 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:33:41.601 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-15T14:33:41.601 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-15T14:33:41.601 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.601 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-15T14:33:41.601 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-15T14:33:41.602 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.602 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.602 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:33:41.602 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:33:41.603 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:33:41.603 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.603 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:33:41.603 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:33:41.604 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:33:41.604 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-15T14:33:41.604 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:33:41.604 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-15T14:33:41.604 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-15T14:33:41.605 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-15T14:33:41.605 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-15T14:33:41.605 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:33:41.605 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:33:41.606 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-15T14:33:41.606 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-15T14:33:41.606 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:33:41.606 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.606 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.607 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-15T14:33:41.607 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-15T14:33:41.607 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-15T14:33:41.607 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-15T14:33:41.608 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.c] 2021-11-15T14:33:41.608 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-15T14:33:41.608 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-15T14:33:41.608 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-15T14:33:41.608 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:33:41.609 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-15T14:33:41.609 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-15T14:33:41.609 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-15T14:33:41.609 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-15T14:33:41.610 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-15T14:33:41.610 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-15T14:33:41.610 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-15T14:33:41.610 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-15T14:33:41.610 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-15T14:33:41.611 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:33:41.611 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.611 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.611 INFO:teuthology.orchestra.run.gibba032.stdout:[global] 2021-11-15T14:33:41.612 INFO:teuthology.orchestra.run.gibba032.stdout: chdir = "" 2021-11-15T14:33:41.612 INFO:teuthology.orchestra.run.gibba032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:33:41.612 INFO:teuthology.orchestra.run.gibba032.stdout: auth supported = cephx 2021-11-15T14:33:41.612 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.612 INFO:teuthology.orchestra.run.gibba032.stdout: filestore xattr use omap = true 2021-11-15T14:33:41.613 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.613 INFO:teuthology.orchestra.run.gibba032.stdout: mon clock drift allowed = 1.000 2021-11-15T14:33:41.613 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.613 INFO:teuthology.orchestra.run.gibba032.stdout: osd crush chooseleaf type = 0 2021-11-15T14:33:41.614 INFO:teuthology.orchestra.run.gibba032.stdout: auth debug = true 2021-11-15T14:33:41.614 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.614 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on old message = true 2021-11-15T14:33:41.614 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on bug = true 2021-11-15T14:33:41.614 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.615 INFO:teuthology.orchestra.run.gibba032.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:33:41.615 INFO:teuthology.orchestra.run.gibba032.stdout: mon pg warn max object skew = 0 2021-11-15T14:33:41.615 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.615 INFO:teuthology.orchestra.run.gibba032.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:33:41.616 INFO:teuthology.orchestra.run.gibba032.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:33:41.616 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.616 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default size = 2 2021-11-15T14:33:41.616 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.616 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow primary affinity = true 2021-11-15T14:33:41.617 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow pg remap = true 2021-11-15T14:33:41.617 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:33:41.617 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:33:41.617 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on no sortbitwise = false 2021-11-15T14:33:41.617 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:33:41.618 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on too few osds = false 2021-11-15T14:33:41.618 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:33:41.618 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:33:41.618 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.619 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:33:41.619 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.619 INFO:teuthology.orchestra.run.gibba032.stdout: osd default data pool replay window = 5 2021-11-15T14:33:41.619 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.619 INFO:teuthology.orchestra.run.gibba032.stdout: mon allow pool delete = true 2021-11-15T14:33:41.620 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.620 INFO:teuthology.orchestra.run.gibba032.stdout: mon cluster log file level = debug 2021-11-15T14:33:41.620 INFO:teuthology.orchestra.run.gibba032.stdout: debug asserts on shutdown = true 2021-11-15T14:33:41.620 INFO:teuthology.orchestra.run.gibba032.stdout: mon health detail to clog = false 2021-11-15T14:33:41.621 INFO:teuthology.orchestra.run.gibba032.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:33:41.621 INFO:teuthology.orchestra.run.gibba032.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.621 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.621 INFO:teuthology.orchestra.run.gibba032.stdout:[osd] 2021-11-15T14:33:41.621 INFO:teuthology.orchestra.run.gibba032.stdout: osd journal size = 100 2021-11-15T14:33:41.622 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.622 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub load threshold = 5.0 2021-11-15T14:33:41.622 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub max interval = 600 2021-11-15T14:33:41.622 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.623 INFO:teuthology.orchestra.run.gibba032.stdout: osd recover clone overlap = true 2021-11-15T14:33:41.623 INFO:teuthology.orchestra.run.gibba032.stdout: osd recovery max chunk = 1048576 2021-11-15T14:33:41.623 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.623 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug shutdown = true 2021-11-15T14:33:41.623 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug op order = true 2021-11-15T14:33:41.624 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug verify stray on activate = true 2021-11-15T14:33:41.624 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.624 INFO:teuthology.orchestra.run.gibba032.stdout: osd open classes on start = true 2021-11-15T14:33:41.624 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug pg log writeout = true 2021-11-15T14:33:41.625 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.625 INFO:teuthology.orchestra.run.gibba032.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:33:41.625 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.625 INFO:teuthology.orchestra.run.gibba032.stdout: osd map max advance = 10 2021-11-15T14:33:41.625 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.626 INFO:teuthology.orchestra.run.gibba032.stdout: journal zero on create = true 2021-11-15T14:33:41.626 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.626 INFO:teuthology.orchestra.run.gibba032.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:33:41.626 INFO:teuthology.orchestra.run.gibba032.stdout: filestore apply finisher threads = 3 2021-11-15T14:33:41.627 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.627 INFO:teuthology.orchestra.run.gibba032.stdout: bdev debug aio = true 2021-11-15T14:33:41.627 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug misdirected ops = true 2021-11-15T14:33:41.627 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore block size = 96636764160 2021-11-15T14:33:41.627 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore compression mode = aggressive 2021-11-15T14:33:41.628 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore fsck on mount = True 2021-11-15T14:33:41.628 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluefs = 20 2021-11-15T14:33:41.628 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluestore = 20 2021-11-15T14:33:41.628 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:33:41.629 INFO:teuthology.orchestra.run.gibba032.stdout: debug osd = 20 2021-11-15T14:33:41.629 INFO:teuthology.orchestra.run.gibba032.stdout: debug rocksdb = 10 2021-11-15T14:33:41.629 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:33:41.629 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd full ratio = 0.9 2021-11-15T14:33:41.630 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:33:41.630 INFO:teuthology.orchestra.run.gibba032.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:33:41.630 INFO:teuthology.orchestra.run.gibba032.stdout: osd objectstore = bluestore 2021-11-15T14:33:41.630 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:33:41.631 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.631 INFO:teuthology.orchestra.run.gibba032.stdout:[mgr] 2021-11-15T14:33:41.631 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:33:41.631 INFO:teuthology.orchestra.run.gibba032.stdout: debug mgr = 20 2021-11-15T14:33:41.631 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:33:41.632 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:33:41.632 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.632 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.632 INFO:teuthology.orchestra.run.gibba032.stdout: mgr/telemetry/nag = false 2021-11-15T14:33:41.633 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.633 INFO:teuthology.orchestra.run.gibba032.stdout:[mon] 2021-11-15T14:33:41.633 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:33:41.633 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:33:41.633 INFO:teuthology.orchestra.run.gibba032.stdout: debug paxos = 20 2021-11-15T14:33:41.634 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:33:41.634 INFO:teuthology.orchestra.run.gibba032.stdout: mon data avail warn = 5 2021-11-15T14:33:41.634 INFO:teuthology.orchestra.run.gibba032.stdout: mon mgr mkfs grace = 240 2021-11-15T14:33:41.634 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.635 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd reporter subtree level = osd 2021-11-15T14:33:41.635 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd prime pg temp = true 2021-11-15T14:33:41.635 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.635 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.635 INFO:teuthology.orchestra.run.gibba032.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:33:41.636 INFO:teuthology.orchestra.run.gibba032.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:33:41.636 INFO:teuthology.orchestra.run.gibba032.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:33:41.636 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.636 INFO:teuthology.orchestra.run.gibba032.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:33:41.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:33:41.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:33:41.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon op complaint time = 120 2021-11-15T14:33:41.637 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:33:41.637 INFO:teuthology.orchestra.run.gibba032.stdout:[client] 2021-11-15T14:33:41.638 INFO:teuthology.orchestra.run.gibba032.stdout: rgw cache enabled = true 2021-11-15T14:33:41.638 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable ops log = true 2021-11-15T14:33:41.638 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable usage log = true 2021-11-15T14:33:41.638 INFO:teuthology.orchestra.run.gibba032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:33:41.639 INFO:teuthology.orchestra.run.gibba032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:33:41.639 INFO:teuthology.orchestra.run.gibba032.stdout: client mount timeout = 600 2021-11-15T14:33:41.639 INFO:teuthology.orchestra.run.gibba032.stdout: debug client = 20 2021-11-15T14:33:41.639 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:33:41.639 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.640 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.640 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.a] 2021-11-15T14:33:41.640 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.b] 2021-11-15T14:33:41.640 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.c] 2021-11-15T14:33:41.641 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.a] 2021-11-15T14:33:41.641 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.c] 2021-11-15T14:33:41.641 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.b] 2021-11-15T14:33:41.641 INFO:teuthology.orchestra.run.gibba032.stdout:[mds] 2021-11-15T14:33:41.641 INFO:teuthology.orchestra.run.gibba032.stdout: debug mds = 20 2021-11-15T14:33:41.642 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:33:41.642 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal frag = True 2021-11-15T14:33:41.642 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal fragment size max = 10000 2021-11-15T14:33:41.642 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal merge size = 5 2021-11-15T14:33:41.642 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split bits = 3 2021-11-15T14:33:41.643 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split size = 100 2021-11-15T14:33:41.643 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug frag = True 2021-11-15T14:33:41.643 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug scatterstat = True 2021-11-15T14:33:41.643 INFO:teuthology.orchestra.run.gibba032.stdout: mds op complaint time = 180 2021-11-15T14:33:41.644 INFO:teuthology.orchestra.run.gibba032.stdout: mds verify scatter = True 2021-11-15T14:33:41.644 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:33:41.644 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.644 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.645 INFO:teuthology.orchestra.run.gibba019.stdout:[global] 2021-11-15T14:33:41.645 INFO:teuthology.orchestra.run.gibba019.stdout: chdir = "" 2021-11-15T14:33:41.645 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:33:41.645 INFO:teuthology.orchestra.run.gibba019.stdout: auth supported = cephx 2021-11-15T14:33:41.645 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.646 INFO:teuthology.orchestra.run.gibba019.stdout: filestore xattr use omap = true 2021-11-15T14:33:41.646 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.646 INFO:teuthology.orchestra.run.gibba019.stdout: mon clock drift allowed = 1.000 2021-11-15T14:33:41.646 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.646 INFO:teuthology.orchestra.run.gibba019.stdout: osd crush chooseleaf type = 0 2021-11-15T14:33:41.647 INFO:teuthology.orchestra.run.gibba019.stdout: auth debug = true 2021-11-15T14:33:41.647 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.647 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on old message = true 2021-11-15T14:33:41.647 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on bug = true 2021-11-15T14:33:41.648 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.648 INFO:teuthology.orchestra.run.gibba019.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:33:41.648 INFO:teuthology.orchestra.run.gibba019.stdout: mon pg warn max object skew = 0 2021-11-15T14:33:41.648 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.648 INFO:teuthology.orchestra.run.gibba019.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:33:41.649 INFO:teuthology.orchestra.run.gibba019.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:33:41.649 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.649 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default size = 2 2021-11-15T14:33:41.649 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.649 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow primary affinity = true 2021-11-15T14:33:41.650 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow pg remap = true 2021-11-15T14:33:41.650 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:33:41.650 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:33:41.650 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on no sortbitwise = false 2021-11-15T14:33:41.650 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:33:41.651 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on too few osds = false 2021-11-15T14:33:41.651 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:33:41.651 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:33:41.651 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.652 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:33:41.652 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.652 INFO:teuthology.orchestra.run.gibba019.stdout: osd default data pool replay window = 5 2021-11-15T14:33:41.652 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.652 INFO:teuthology.orchestra.run.gibba019.stdout: mon allow pool delete = true 2021-11-15T14:33:41.653 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.653 INFO:teuthology.orchestra.run.gibba019.stdout: mon cluster log file level = debug 2021-11-15T14:33:41.653 INFO:teuthology.orchestra.run.gibba019.stdout: debug asserts on shutdown = true 2021-11-15T14:33:41.653 INFO:teuthology.orchestra.run.gibba019.stdout: mon health detail to clog = false 2021-11-15T14:33:41.653 INFO:teuthology.orchestra.run.gibba019.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:33:41.654 INFO:teuthology.orchestra.run.gibba019.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:33:41.654 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.654 INFO:teuthology.orchestra.run.gibba019.stdout:[osd] 2021-11-15T14:33:41.654 INFO:teuthology.orchestra.run.gibba019.stdout: osd journal size = 100 2021-11-15T14:33:41.655 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.655 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub load threshold = 5.0 2021-11-15T14:33:41.655 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub max interval = 600 2021-11-15T14:33:41.655 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.655 INFO:teuthology.orchestra.run.gibba019.stdout: osd recover clone overlap = true 2021-11-15T14:33:41.656 INFO:teuthology.orchestra.run.gibba019.stdout: osd recovery max chunk = 1048576 2021-11-15T14:33:41.656 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.656 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug shutdown = true 2021-11-15T14:33:41.656 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug op order = true 2021-11-15T14:33:41.657 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug verify stray on activate = true 2021-11-15T14:33:41.657 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.657 INFO:teuthology.orchestra.run.gibba019.stdout: osd open classes on start = true 2021-11-15T14:33:41.657 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug pg log writeout = true 2021-11-15T14:33:41.657 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.658 INFO:teuthology.orchestra.run.gibba019.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:33:41.658 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.658 INFO:teuthology.orchestra.run.gibba019.stdout: osd map max advance = 10 2021-11-15T14:33:41.658 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.659 INFO:teuthology.orchestra.run.gibba019.stdout: journal zero on create = true 2021-11-15T14:33:41.659 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.659 INFO:teuthology.orchestra.run.gibba019.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:33:41.659 INFO:teuthology.orchestra.run.gibba019.stdout: filestore apply finisher threads = 3 2021-11-15T14:33:41.659 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.660 INFO:teuthology.orchestra.run.gibba019.stdout: bdev debug aio = true 2021-11-15T14:33:41.660 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug misdirected ops = true 2021-11-15T14:33:41.660 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore block size = 96636764160 2021-11-15T14:33:41.660 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore compression mode = aggressive 2021-11-15T14:33:41.661 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore fsck on mount = True 2021-11-15T14:33:41.661 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluefs = 20 2021-11-15T14:33:41.661 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluestore = 20 2021-11-15T14:33:41.661 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:33:41.661 INFO:teuthology.orchestra.run.gibba019.stdout: debug osd = 20 2021-11-15T14:33:41.662 INFO:teuthology.orchestra.run.gibba019.stdout: debug rocksdb = 10 2021-11-15T14:33:41.662 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:33:41.662 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd full ratio = 0.9 2021-11-15T14:33:41.662 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:33:41.662 INFO:teuthology.orchestra.run.gibba019.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:33:41.663 INFO:teuthology.orchestra.run.gibba019.stdout: osd objectstore = bluestore 2021-11-15T14:33:41.663 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:33:41.663 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.663 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr] 2021-11-15T14:33:41.664 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:33:41.664 INFO:teuthology.orchestra.run.gibba019.stdout: debug mgr = 20 2021-11-15T14:33:41.664 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:33:41.664 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:33:41.664 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.665 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.665 INFO:teuthology.orchestra.run.gibba019.stdout: mgr/telemetry/nag = false 2021-11-15T14:33:41.665 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.665 INFO:teuthology.orchestra.run.gibba019.stdout:[mon] 2021-11-15T14:33:41.665 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:33:41.666 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:33:41.666 INFO:teuthology.orchestra.run.gibba019.stdout: debug paxos = 20 2021-11-15T14:33:41.666 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:33:41.666 INFO:teuthology.orchestra.run.gibba019.stdout: mon data avail warn = 5 2021-11-15T14:33:41.667 INFO:teuthology.orchestra.run.gibba019.stdout: mon mgr mkfs grace = 240 2021-11-15T14:33:41.667 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:33:41.667 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd reporter subtree level = osd 2021-11-15T14:33:41.667 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd prime pg temp = true 2021-11-15T14:33:41.667 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:33:41.668 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.668 INFO:teuthology.orchestra.run.gibba019.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:33:41.668 INFO:teuthology.orchestra.run.gibba019.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:33:41.668 INFO:teuthology.orchestra.run.gibba019.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:33:41.668 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.669 INFO:teuthology.orchestra.run.gibba019.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:33:41.669 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:33:41.669 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:33:41.669 INFO:teuthology.orchestra.run.gibba019.stdout: mon op complaint time = 120 2021-11-15T14:33:41.669 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:33:41.670 INFO:teuthology.orchestra.run.gibba019.stdout:[client] 2021-11-15T14:33:41.670 INFO:teuthology.orchestra.run.gibba019.stdout: rgw cache enabled = true 2021-11-15T14:33:41.670 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable ops log = true 2021-11-15T14:33:41.670 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable usage log = true 2021-11-15T14:33:41.671 INFO:teuthology.orchestra.run.gibba019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:33:41.671 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:33:41.671 INFO:teuthology.orchestra.run.gibba019.stdout: client mount timeout = 600 2021-11-15T14:33:41.671 INFO:teuthology.orchestra.run.gibba019.stdout: debug client = 20 2021-11-15T14:33:41.671 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:33:41.672 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.672 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.672 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.a] 2021-11-15T14:33:41.672 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.b] 2021-11-15T14:33:41.673 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.c] 2021-11-15T14:33:41.673 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.a] 2021-11-15T14:33:41.673 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.c] 2021-11-15T14:33:41.673 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.b] 2021-11-15T14:33:41.673 INFO:teuthology.orchestra.run.gibba019.stdout:[mds] 2021-11-15T14:33:41.674 INFO:teuthology.orchestra.run.gibba019.stdout: debug mds = 20 2021-11-15T14:33:41.674 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:33:41.674 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal frag = True 2021-11-15T14:33:41.674 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal fragment size max = 10000 2021-11-15T14:33:41.675 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal merge size = 5 2021-11-15T14:33:41.675 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split bits = 3 2021-11-15T14:33:41.675 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split size = 100 2021-11-15T14:33:41.675 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug frag = True 2021-11-15T14:33:41.675 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug scatterstat = True 2021-11-15T14:33:41.676 INFO:teuthology.orchestra.run.gibba019.stdout: mds op complaint time = 180 2021-11-15T14:33:41.676 INFO:teuthology.orchestra.run.gibba019.stdout: mds verify scatter = True 2021-11-15T14:33:41.676 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:33:41.676 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:33:41.677 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:33:41.677 INFO:tasks.ceph:Creating admin key on mon.a... 2021-11-15T14:33:41.677 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-11-15T14:33:41.704 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-15T14:33:41.712 DEBUG:teuthology.orchestra.remote:gibba035:/etc/ceph/ceph.keyring is 206B 2021-11-15T14:33:41.773 DEBUG:teuthology.orchestra.remote:gibba035:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-11-15T14:33:41.789 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:33:41.789 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:41.790 DEBUG:teuthology.orchestra.run.gibba035:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T14:33:41.790 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T14:33:41.807 DEBUG:teuthology.orchestra.run.gibba035:> set -ex 2021-11-15T14:33:41.807 DEBUG:teuthology.orchestra.run.gibba035:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.854 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:33:41.854 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:41.854 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T14:33:41.855 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T14:33:41.873 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-15T14:33:41.873 DEBUG:teuthology.orchestra.run.gibba019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.877 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba038.front.sepia.ceph.com 2021-11-15T14:33:41.878 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:41.878 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T14:33:41.878 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T14:33:41.894 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-15T14:33:41.894 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.900 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba032.front.sepia.ceph.com 2021-11-15T14:33:41.900 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:41.900 DEBUG:teuthology.orchestra.run.gibba032:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-15T14:33:41.901 DEBUG:teuthology.orchestra.run.gibba032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-15T14:33:41.918 DEBUG:teuthology.orchestra.run.gibba032:> set -ex 2021-11-15T14:33:41.918 DEBUG:teuthology.orchestra.run.gibba032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:41.963 INFO:tasks.ceph:Setting up mon nodes... 2021-11-15T14:33:41.963 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-15T14:33:41.964 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-11-15T14:33:41.999 INFO:teuthology.orchestra.run.gibba035.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-11-15T14:33:42.000 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-11-15T14:33:42.041 INFO:teuthology.orchestra.run.gibba019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-11-15T14:33:42.042 INFO:tasks.ceph:Setting up mds nodes... 2021-11-15T14:33:42.043 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-11-15T14:33:42.078 INFO:teuthology.orchestra.run.gibba035.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-11-15T14:33:42.081 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-11-15T14:33:42.143 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-11-15T14:33:42.166 INFO:teuthology.orchestra.run.gibba035.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-11-15T14:33:42.167 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-11-15T14:33:42.172 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-11-15T14:33:42.207 INFO:teuthology.orchestra.run.gibba019.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-11-15T14:33:42.209 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-11-15T14:33:42.215 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-15T14:33:42.215 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-11-15T14:33:42.260 INFO:teuthology.orchestra.run.gibba038.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-11-15T14:33:42.265 DEBUG:teuthology.orchestra.run.gibba032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-11-15T14:33:42.316 INFO:teuthology.orchestra.run.gibba032.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-11-15T14:33:42.321 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-15T14:33:42.321 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba035.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba019.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-15T14:33:42.322 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-11-15T14:33:42.343 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:42.343 INFO:tasks.ceph:role: osd.0 2021-11-15T14:33:42.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:33:42.344 DEBUG:teuthology.orchestra.run.gibba035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-15T14:33:42.389 INFO:teuthology.orchestra.run.gibba035.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:42.389 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:42.389 INFO:teuthology.orchestra.run.gibba035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:42.389 INFO:teuthology.orchestra.run.gibba035.stdout: = reflink=1 2021-11-15T14:33:42.390 INFO:teuthology.orchestra.run.gibba035.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:42.390 INFO:teuthology.orchestra.run.gibba035.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:42.390 INFO:teuthology.orchestra.run.gibba035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:42.390 INFO:teuthology.orchestra.run.gibba035.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:42.391 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:42.391 INFO:teuthology.orchestra.run.gibba035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:42.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba035.front.sepia.ceph.com -o noatime 2021-11-15T14:33:42.392 DEBUG:teuthology.orchestra.run.gibba035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-11-15T14:33:42.465 DEBUG:teuthology.orchestra.run.gibba035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-11-15T14:33:42.480 INFO:teuthology.orchestra.run.gibba035.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:42.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:42.482 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-11-15T14:33:42.503 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:42.503 INFO:tasks.ceph:role: osd.1 2021-11-15T14:33:42.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:33:42.504 DEBUG:teuthology.orchestra.run.gibba035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-15T14:33:42.604 INFO:teuthology.orchestra.run.gibba035.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: = reflink=1 2021-11-15T14:33:42.605 INFO:teuthology.orchestra.run.gibba035.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:42.605 INFO:teuthology.orchestra.run.gibba035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:42.605 INFO:teuthology.orchestra.run.gibba035.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:42.606 INFO:teuthology.orchestra.run.gibba035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:42.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba035.front.sepia.ceph.com -o noatime 2021-11-15T14:33:42.607 DEBUG:teuthology.orchestra.run.gibba035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-11-15T14:33:42.623 DEBUG:teuthology.orchestra.run.gibba035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-11-15T14:33:42.681 INFO:teuthology.orchestra.run.gibba035.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:42.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:42.682 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-11-15T14:33:42.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:42.704 INFO:tasks.ceph:role: osd.2 2021-11-15T14:33:42.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:33:42.705 DEBUG:teuthology.orchestra.run.gibba035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-15T14:33:42.763 INFO:teuthology.orchestra.run.gibba035.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:42.763 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:42.763 INFO:teuthology.orchestra.run.gibba035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:42.764 INFO:teuthology.orchestra.run.gibba035.stdout: = reflink=1 2021-11-15T14:33:42.764 INFO:teuthology.orchestra.run.gibba035.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:42.764 INFO:teuthology.orchestra.run.gibba035.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:42.764 INFO:teuthology.orchestra.run.gibba035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:42.765 INFO:teuthology.orchestra.run.gibba035.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:42.765 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:42.765 INFO:teuthology.orchestra.run.gibba035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:42.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba035.front.sepia.ceph.com -o noatime 2021-11-15T14:33:42.767 DEBUG:teuthology.orchestra.run.gibba035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-11-15T14:33:42.782 DEBUG:teuthology.orchestra.run.gibba035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-11-15T14:33:42.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:42.787 INFO:teuthology.orchestra.run.gibba035.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:42.787 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-11-15T14:33:42.793 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:42.793 INFO:tasks.ceph:role: osd.3 2021-11-15T14:33:42.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T14:33:42.794 DEBUG:teuthology.orchestra.run.gibba035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-15T14:33:42.834 INFO:teuthology.orchestra.run.gibba035.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:42.835 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:42.835 INFO:teuthology.orchestra.run.gibba035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:42.835 INFO:teuthology.orchestra.run.gibba035.stdout: = reflink=1 2021-11-15T14:33:42.836 INFO:teuthology.orchestra.run.gibba035.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:42.836 INFO:teuthology.orchestra.run.gibba035.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:42.836 INFO:teuthology.orchestra.run.gibba035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:42.836 INFO:teuthology.orchestra.run.gibba035.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:42.836 INFO:teuthology.orchestra.run.gibba035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:42.837 INFO:teuthology.orchestra.run.gibba035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:42.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba035.front.sepia.ceph.com -o noatime 2021-11-15T14:33:42.838 DEBUG:teuthology.orchestra.run.gibba035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-11-15T14:33:42.913 DEBUG:teuthology.orchestra.run.gibba035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-11-15T14:33:42.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:42.918 INFO:teuthology.orchestra.run.gibba035.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:42.919 DEBUG:teuthology.orchestra.run.gibba035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:43.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:42.997+0000 7f3fe8d4bd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-11-15T14:33:43.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:42.997+0000 7f3fe8d4bd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-11-15T14:33:43.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:42.997+0000 7f3fe8d4bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-15T14:33:43.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:42.997+0000 7f3fe8d4bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-15T14:33:43.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:42.997+0000 7f3fe8d4bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-15T14:33:43.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:43.001+0000 7f3fe8d4bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-11-15T14:33:43.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:43.013+0000 7f3fe8d4bd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:45.475 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-11-15T14:33:45.481 DEBUG:teuthology.orchestra.run.gibba035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:45.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-11-15T14:33:45.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-11-15T14:33:45.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-15T14:33:45.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-15T14:33:45.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-15T14:33:45.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.497+0000 7f6acd301d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-11-15T14:33:45.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:45.505+0000 7f6acd301d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:47.968 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-11-15T14:33:47.979 DEBUG:teuthology.orchestra.run.gibba035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:48.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.037+0000 7f700da12d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-11-15T14:33:48.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.037+0000 7f700da12d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-11-15T14:33:48.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.037+0000 7f700da12d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-15T14:33:48.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.037+0000 7f700da12d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-15T14:33:48.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.037+0000 7f700da12d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-15T14:33:48.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.041+0000 7f700da12d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-11-15T14:33:48.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:48.045+0000 7f700da12d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:50.507 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-11-15T14:33:50.518 DEBUG:teuthology.orchestra.run.gibba035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:50.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-11-15T14:33:50.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-11-15T14:33:50.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-15T14:33:50.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-15T14:33:50.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-15T14:33:50.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.533+0000 7f303274fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-11-15T14:33:50.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:33:50.541+0000 7f303274fd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:53.011 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-11-15T14:33:53.022 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-11-15T14:33:53.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:53.035 INFO:tasks.ceph:role: osd.4 2021-11-15T14:33:53.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:33:53.035 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-15T14:33:53.075 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:53.075 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:53.076 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:53.076 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-15T14:33:53.076 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:53.076 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:53.077 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:53.077 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:53.077 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:53.077 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:53.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-15T14:33:53.079 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-11-15T14:33:53.137 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-11-15T14:33:53.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:53.143 INFO:teuthology.orchestra.run.gibba019.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:53.143 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-11-15T14:33:53.150 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:53.150 INFO:tasks.ceph:role: osd.5 2021-11-15T14:33:53.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:33:53.151 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-15T14:33:53.232 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:53.232 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:53.232 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:53.233 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-15T14:33:53.233 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:53.233 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:53.233 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:53.234 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:53.234 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:53.234 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:53.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-15T14:33:53.237 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-11-15T14:33:53.252 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-11-15T14:33:53.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:53.304 INFO:teuthology.orchestra.run.gibba019.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:53.304 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-11-15T14:33:53.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:53.311 INFO:tasks.ceph:role: osd.6 2021-11-15T14:33:53.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:33:53.312 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-15T14:33:53.352 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:53.353 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:53.353 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:53.353 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-15T14:33:53.353 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:53.354 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:53.354 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:53.354 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:53.355 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:53.355 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:53.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-15T14:33:53.356 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-11-15T14:33:53.428 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-11-15T14:33:53.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:53.434 INFO:teuthology.orchestra.run.gibba019.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:53.435 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-11-15T14:33:53.441 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-15T14:33:53.442 INFO:tasks.ceph:role: osd.7 2021-11-15T14:33:53.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T14:33:53.442 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-15T14:33:53.526 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-15T14:33:53.526 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-15T14:33:53.526 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-15T14:33:53.527 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-15T14:33:53.527 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-15T14:33:53.527 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-15T14:33:53.527 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-15T14:33:53.528 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-15T14:33:53.528 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-15T14:33:53.528 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-15T14:33:53.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-15T14:33:53.529 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-11-15T14:33:53.545 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-11-15T14:33:53.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:33:53.550 INFO:teuthology.orchestra.run.gibba019.stderr:sudo: /sbin/restorecon: command not found 2021-11-15T14:33:53.550 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:53.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-11-15T14:33:53.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-11-15T14:33:53.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-15T14:33:53.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-15T14:33:53.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-15T14:33:53.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.696+0000 7f7774fc7d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-11-15T14:33:53.710 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:53.708+0000 7f7774fc7d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:56.175 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-11-15T14:33:56.182 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:56.247 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-11-15T14:33:56.247 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-11-15T14:33:56.248 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-15T14:33:56.248 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-15T14:33:56.248 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-15T14:33:56.249 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.248+0000 7f7116a08d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-11-15T14:33:56.256 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:56.256+0000 7f7116a08d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:33:58.712 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-11-15T14:33:58.728 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:33:58.795 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.792+0000 7f771850cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-11-15T14:33:58.795 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.792+0000 7f771850cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-11-15T14:33:58.796 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.792+0000 7f771850cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-15T14:33:58.796 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.792+0000 7f771850cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-15T14:33:58.796 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.792+0000 7f771850cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-15T14:33:58.797 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.796+0000 7f771850cd80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-11-15T14:33:58.802 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:33:58.804+0000 7f771850cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:34:01.267 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-11-15T14:34:01.320 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:34:01.336 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-11-15T14:34:01.337 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-11-15T14:34:01.337 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-15T14:34:01.337 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-15T14:34:01.337 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-15T14:34:01.338 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.336+0000 7fca71acbd80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-11-15T14:34:01.345 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:01.344+0000 7fca71acbd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-15T14:34:03.823 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-11-15T14:34:03.957 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-15T14:34:03.958 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:03.972 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.nVuYVW6u2m 2021-11-15T14:34:03.973 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.nVuYVW6u2m 2021-11-15T14:34:04.024 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.nVuYVW6u2m 2021-11-15T14:34:04.101 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.nVuYVW6u2m is 56B 2021-11-15T14:34:04.138 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.nVuYVW6u2m 2021-11-15T14:34:04.149 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:04.161 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.5xV6TtCmZb 2021-11-15T14:34:04.161 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.5xV6TtCmZb 2021-11-15T14:34:04.233 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.5xV6TtCmZb 2021-11-15T14:34:04.369 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.5xV6TtCmZb is 56B 2021-11-15T14:34:04.403 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.5xV6TtCmZb 2021-11-15T14:34:04.415 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:04.469 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.RD1WXPg7lA 2021-11-15T14:34:04.469 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.RD1WXPg7lA 2021-11-15T14:34:04.493 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.RD1WXPg7lA 2021-11-15T14:34:04.573 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.RD1WXPg7lA is 56B 2021-11-15T14:34:04.588 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.RD1WXPg7lA 2021-11-15T14:34:04.592 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:04.638 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.8gq8fEWrSG 2021-11-15T14:34:04.639 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.8gq8fEWrSG 2021-11-15T14:34:04.651 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.8gq8fEWrSG 2021-11-15T14:34:04.682 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.8gq8fEWrSG is 56B 2021-11-15T14:34:04.701 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.8gq8fEWrSG 2021-11-15T14:34:04.709 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:04.758 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.PRZtA5ZGbQ 2021-11-15T14:34:04.758 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.PRZtA5ZGbQ 2021-11-15T14:34:04.780 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.PRZtA5ZGbQ 2021-11-15T14:34:04.857 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.PRZtA5ZGbQ is 56B 2021-11-15T14:34:04.875 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.PRZtA5ZGbQ 2021-11-15T14:34:04.883 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:04.934 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.iDFUfK0D8U 2021-11-15T14:34:04.934 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.iDFUfK0D8U 2021-11-15T14:34:04.955 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.iDFUfK0D8U 2021-11-15T14:34:04.987 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.iDFUfK0D8U is 56B 2021-11-15T14:34:04.997 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.iDFUfK0D8U 2021-11-15T14:34:05.000 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:05.046 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.aEPk8gPDki 2021-11-15T14:34:05.046 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.aEPk8gPDki 2021-11-15T14:34:05.055 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.aEPk8gPDki 2021-11-15T14:34:05.069 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.aEPk8gPDki is 56B 2021-11-15T14:34:05.120 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.aEPk8gPDki 2021-11-15T14:34:05.125 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.134 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.5nbHDDD3yb 2021-11-15T14:34:05.134 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.5nbHDDD3yb 2021-11-15T14:34:05.186 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.5nbHDDD3yb 2021-11-15T14:34:05.203 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.5nbHDDD3yb is 56B 2021-11-15T14:34:05.216 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.5nbHDDD3yb 2021-11-15T14:34:05.220 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.266 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.12tgbNUcb4 2021-11-15T14:34:05.267 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.12tgbNUcb4 2021-11-15T14:34:05.276 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.12tgbNUcb4 2021-11-15T14:34:05.333 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.12tgbNUcb4 is 56B 2021-11-15T14:34:05.345 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.12tgbNUcb4 2021-11-15T14:34:05.351 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.402 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.Sqte2Kp5qE 2021-11-15T14:34:05.402 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Sqte2Kp5qE 2021-11-15T14:34:05.409 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.Sqte2Kp5qE 2021-11-15T14:34:05.465 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.Sqte2Kp5qE is 56B 2021-11-15T14:34:05.477 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.Sqte2Kp5qE 2021-11-15T14:34:05.483 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.534 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.Q6x3Ghah0c 2021-11-15T14:34:05.534 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.Q6x3Ghah0c 2021-11-15T14:34:05.556 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.Q6x3Ghah0c 2021-11-15T14:34:05.586 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.Q6x3Ghah0c is 56B 2021-11-15T14:34:05.601 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.Q6x3Ghah0c 2021-11-15T14:34:05.608 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.658 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.1Zztui2iCn 2021-11-15T14:34:05.659 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.1Zztui2iCn 2021-11-15T14:34:05.680 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.1Zztui2iCn 2021-11-15T14:34:05.758 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.1Zztui2iCn is 56B 2021-11-15T14:34:05.777 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.1Zztui2iCn 2021-11-15T14:34:05.786 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:05.834 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.5Qm6w1yCkw 2021-11-15T14:34:05.834 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.5Qm6w1yCkw 2021-11-15T14:34:05.856 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.5Qm6w1yCkw 2021-11-15T14:34:05.933 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.5Qm6w1yCkw is 56B 2021-11-15T14:34:05.953 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.5Qm6w1yCkw 2021-11-15T14:34:05.974 DEBUG:teuthology.orchestra.remote:gibba038:/etc/ceph/ceph.client.0.keyring is 59B 2021-11-15T14:34:06.038 DEBUG:teuthology.orchestra.remote:gibba032:/etc/ceph/ceph.client.1.keyring is 59B 2021-11-15T14:34:06.048 INFO:tasks.ceph:Adding keys to all mons... 2021-11-15T14:34:06.048 DEBUG:teuthology.orchestra.run.gibba019:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-15T14:34:06.051 DEBUG:teuthology.orchestra.run.gibba035:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-15T14:34:06.062 INFO:teuthology.orchestra.run.gibba035.stdout:[mgr.y] 2021-11-15T14:34:06.062 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA== 2021-11-15T14:34:06.063 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.a] 2021-11-15T14:34:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg== 2021-11-15T14:34:06.063 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.c] 2021-11-15T14:34:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ== 2021-11-15T14:34:06.063 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.0] 2021-11-15T14:34:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA== 2021-11-15T14:34:06.064 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.1] 2021-11-15T14:34:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ== 2021-11-15T14:34:06.064 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.2] 2021-11-15T14:34:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw== 2021-11-15T14:34:06.065 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.3] 2021-11-15T14:34:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA== 2021-11-15T14:34:06.065 INFO:teuthology.orchestra.run.gibba035.stdout:[mgr.x] 2021-11-15T14:34:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ== 2021-11-15T14:34:06.066 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.b] 2021-11-15T14:34:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA== 2021-11-15T14:34:06.066 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.4] 2021-11-15T14:34:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg== 2021-11-15T14:34:06.067 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.5] 2021-11-15T14:34:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA== 2021-11-15T14:34:06.067 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.6] 2021-11-15T14:34:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA== 2021-11-15T14:34:06.068 INFO:teuthology.orchestra.run.gibba035.stdout:[osd.7] 2021-11-15T14:34:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw== 2021-11-15T14:34:06.068 INFO:teuthology.orchestra.run.gibba035.stdout:[client.0] 2021-11-15T14:34:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg== 2021-11-15T14:34:06.068 INFO:teuthology.orchestra.run.gibba035.stdout:[client.1] 2021-11-15T14:34:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: key = AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA== 2021-11-15T14:34:06.070 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr.y] 2021-11-15T14:34:06.071 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA== 2021-11-15T14:34:06.071 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.a] 2021-11-15T14:34:06.071 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg== 2021-11-15T14:34:06.071 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.c] 2021-11-15T14:34:06.072 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ== 2021-11-15T14:34:06.072 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.0] 2021-11-15T14:34:06.072 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA== 2021-11-15T14:34:06.072 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.1] 2021-11-15T14:34:06.072 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ== 2021-11-15T14:34:06.073 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.2] 2021-11-15T14:34:06.073 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw== 2021-11-15T14:34:06.073 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.3] 2021-11-15T14:34:06.073 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA== 2021-11-15T14:34:06.074 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr.x] 2021-11-15T14:34:06.074 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ== 2021-11-15T14:34:06.074 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.b] 2021-11-15T14:34:06.074 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA== 2021-11-15T14:34:06.074 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.4] 2021-11-15T14:34:06.075 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg== 2021-11-15T14:34:06.075 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.5] 2021-11-15T14:34:06.075 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA== 2021-11-15T14:34:06.075 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.6] 2021-11-15T14:34:06.076 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA== 2021-11-15T14:34:06.076 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.7] 2021-11-15T14:34:06.076 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw== 2021-11-15T14:34:06.076 INFO:teuthology.orchestra.run.gibba019.stdout:[client.0] 2021-11-15T14:34:06.077 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg== 2021-11-15T14:34:06.077 INFO:teuthology.orchestra.run.gibba019.stdout:[client.1] 2021-11-15T14:34:06.077 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA== 2021-11-15T14:34:06.077 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T14:34:06.116 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T14:34:06.150 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.153 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.177 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.216 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.254 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.257 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.291 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.328 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.386 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.388 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.479 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.482 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.523 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T14:34:06.568 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-15T14:34:06.612 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.614 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-15T14:34:06.717 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.721 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.787 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.789 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.815 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.817 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.911 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.914 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-15T14:34:06.978 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T14:34:06.981 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T14:34:07.021 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T14:34:07.048 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-15T14:34:07.085 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-15T14:34:07.085 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-11-15T14:34:07.092 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T14:34:07.123 DEBUG:teuthology.orchestra.run.gibba035:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-11-15T14:34:07.187 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-11-15T14:34:07.198 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T14:34:07.293 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-11-15T14:34:07.303 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-11-15T14:34:07.309 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-15T14:34:07.338 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-11-15T14:34:07.392 DEBUG:teuthology.orchestra.run.gibba019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:34:07.395 DEBUG:teuthology.orchestra.run.gibba035:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-15T14:34:07.403 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-11-15T14:34:07.404 INFO:tasks.ceph.mon.a:Restarting daemon 2021-11-15T14:34:07.404 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-11-15T14:34:07.448 INFO:tasks.ceph.mon.a:Started 2021-11-15T14:34:07.449 INFO:tasks.ceph.mon.b:Restarting daemon 2021-11-15T14:34:07.449 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-11-15T14:34:07.452 INFO:tasks.ceph.mon.b:Started 2021-11-15T14:34:07.453 INFO:tasks.ceph.mon.c:Restarting daemon 2021-11-15T14:34:07.453 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-11-15T14:34:07.455 INFO:tasks.ceph.mon.c:Started 2021-11-15T14:34:07.456 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-11-15T14:34:07.456 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-11-15T14:34:07.457 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-11-15T14:34:07.459 INFO:tasks.ceph.mgr.y:Started 2021-11-15T14:34:07.460 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-11-15T14:34:07.460 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-11-15T14:34:07.462 INFO:tasks.ceph.mgr.x:Started 2021-11-15T14:34:07.463 INFO:tasks.ceph:Setting crush tunables to default 2021-11-15T14:34:07.463 DEBUG:teuthology.orchestra.run.gibba035:> sudo ceph --cluster ceph osd crush tunables default 2021-11-15T14:34:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 Processor -- start 2021-11-15T14:34:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 -- start start 2021-11-15T14:34:07.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:07.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:07.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63340aa520 con 0x7f63340af440 2021-11-15T14:34:07.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b14d0 con 0x7f633405c5e0 2021-11-15T14:34:07.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6338eb0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340af820 con 0x7f6334060220 2021-11-15T14:34:07.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:07.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:35586/0 (socket says 172.21.2.135:35586) 2021-11-15T14:34:07.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 learned_addr learned my addr 172.21.2.135:0/189563449 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:07.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:07.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T14:34:07.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:07.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:07.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T14:34:07.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T14:34:07.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:07.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:07.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.513+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T14:34:07.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:07.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:07.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T14:34:07.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:07.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:07.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T14:34:07.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T14:34:07.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:07.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:07.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:07.717+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T14:34:08.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:08.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T14:34:08.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:08.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:08.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T14:34:08.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.117+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:08.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.121+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T14:34:08.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.121+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:08.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.121+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:08.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.121+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T14:34:08.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:08.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-11-15T14:34:08.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:08.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:08.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T14:34:08.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:08.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-15T14:34:08.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:08.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:08.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:08.921+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T14:34:10.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f63340b0d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T14:34:10.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f63340b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:10.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 msgr2=0x7f63340a8c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T14:34:10.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.135:3300/0 conn(0x7f633405c5e0 0x7f63340a8c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:10.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 -- 172.21.2.135:0/189563449 >> v1:172.21.2.135:6789/0 conn(0x7f63340af440 legacy=0x7f63341444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:10.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:10.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 -- 172.21.2.135:0/189563449 --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633405fc00 con 0x7f6318005e50 2021-11-15T14:34:10.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63317fa700 1 -- 172.21.2.135:0/189563449 --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b14d0 con 0x7f63180033f0 2021-11-15T14:34:10.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:10.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T14:34:10.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:10.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:10.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.513+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-15T14:34:10.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.717+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:10.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.717+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T14:34:10.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.717+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:10.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.717+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:10.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:10.717+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-11-15T14:34:11.090 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:11.093 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:11.097 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:11.102 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:11.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.117+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:11.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.121+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T14:34:11.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.121+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:11.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.121+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:11.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.121+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-11-15T14:34:11.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.921+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:11.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.921+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-15T14:34:11.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.921+0000 7f63337fe700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-15T14:34:11.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.921+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-15T14:34:11.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:11.925+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-11-15T14:34:12.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202027470 0 0) 0x7f633405fc00 con 0x7f6318005e50 2021-11-15T14:34:12.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6314003260 con 0x7f6318005e50 2021-11-15T14:34:12.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.0 v1:172.21.2.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184110981 0 0) 0x7f6314003260 con 0x7f6318005e50 2021-11-15T14:34:12.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 msgr2=0x7f6318005850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-15T14:34:12.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 --2- 172.21.2.135:0/189563449 >> v2:172.21.2.119:3300/0 conn(0x7f63180033f0 0x7f6318005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 --> v1:172.21.2.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631800abd0 con 0x7f6318005e50 2021-11-15T14:34:12.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.0 v1:172.21.2.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f632400d3b0 con 0x7f6318005e50 2021-11-15T14:34:12.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 >> v1:172.21.2.119:6789/0 conn(0x7f6318005e50 legacy=0x7f63180082f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:12.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f6314003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 0x7f6314004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6333fff700 1 -- 172.21.2.135:0/189563449 reap_dead start 2021-11-15T14:34:12.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f6314004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340b14d0 con 0x7f6314003750 2021-11-15T14:34:12.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631400b830 con 0x7f6314004500 2021-11-15T14:34:12.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631400b9f0 con 0x7f6334060220 2021-11-15T14:34:12.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 0x7f6314004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6333fff700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f6314004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f6314003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 msgr2=0x7f6314004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:12.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f6314004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 msgr2=0x7f6314003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:12.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f6314003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 -- 172.21.2.135:0/189563449 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314003260 con 0x7f6314004500 2021-11-15T14:34:12.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63337fe700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f6314003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:12.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6332ffd700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 0x7f6314004980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6324000b60 tx=0x7f6324008040).ready entity=mon.1 client_cookie=4dc143b4df8487ad server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:12.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6324013e50 con 0x7f6314004500 2021-11-15T14:34:12.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324016460 con 0x7f6314004500 2021-11-15T14:34:12.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f63327fc700 1 -- 172.21.2.135:0/189563449 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63240167c0 con 0x7f6314004500 2021-11-15T14:34:12.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 -- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 msgr2=0x7f6314004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:12.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 0x7f6314004980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6324000b60 tx=0x7f6324008040).stop 2021-11-15T14:34:12.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 -- 172.21.2.135:0/189563449 shutdown_connections 2021-11-15T14:34:12.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f6314003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6314004500 0x7f6314004980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 --2- 172.21.2.135:0/189563449 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6334060220 0x7f6314004f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 -- 172.21.2.135:0/189563449 >> 172.21.2.135:0/189563449 conn(0x7f63340611c0 msgr2=0x7f6334062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:12.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 -- 172.21.2.135:0/189563449 shutdown_connections 2021-11-15T14:34:12.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.813+0000 7f6338eb0700 1 -- 172.21.2.135:0/189563449 wait complete. 2021-11-15T14:34:12.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 Processor -- start 2021-11-15T14:34:12.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- start start 2021-11-15T14:34:12.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 0x7f633413fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6334060220 0x7f63341400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:12.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63341405d0 con 0x7f6314003750 2021-11-15T14:34:12.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633413f4b0 con 0x7f6334060220 2021-11-15T14:34:12.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334064600 con 0x7f6314004500 2021-11-15T14:34:12.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:47916/0 (socket says 172.21.2.135:47916) 2021-11-15T14:34:12.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 -- 172.21.2.135:0/3487442410 learned_addr learned my addr 172.21.2.135:0/3487442410 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:12.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6333fff700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6334060220 0x7f63341400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6332ffd700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 0x7f633413fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:12.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 -- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 msgr2=0x7f633413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:12.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 0x7f633413fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 -- 172.21.2.135:0/3487442410 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6334060220 msgr2=0x7f63341400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:12.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6334060220 0x7f63341400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 -- 172.21.2.135:0/3487442410 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633405f730 con 0x7f6314003750 2021-11-15T14:34:12.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6332ffd700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 0x7f633413fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:12.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f63337fe700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f631c00b000 tx=0x7f631c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:12.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c018660 con 0x7f6314003750 2021-11-15T14:34:12.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c0187c0 con 0x7f6314003750 2021-11-15T14:34:12.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c018b20 con 0x7f6314003750 2021-11-15T14:34:12.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340648a0 con 0x7f6314003750 2021-11-15T14:34:12.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6334064fe0 con 0x7f6314003750 2021-11-15T14:34:12.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f631c022460 con 0x7f6314003750 2021-11-15T14:34:12.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f631c017740 con 0x7f6314003750 2021-11-15T14:34:12.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633405f960 con 0x7f6314003750 2021-11-15T14:34:12.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.817+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f631c018e50 con 0x7f6314003750 2021-11-15T14:34:12.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.865+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f63340573d0 con 0x7f6314003750 2021-11-15T14:34:12.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.869+0000 7f6330ff9700 1 -- 172.21.2.135:0/3487442410 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f631c022ba0 con 0x7f6314003750 2021-11-15T14:34:12.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 msgr2=0x7f633413a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:12.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f631c00b000 tx=0x7f631c009040).stop 2021-11-15T14:34:12.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 shutdown_connections 2021-11-15T14:34:12.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6334060220 0x7f63341400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6314004500 0x7f633413fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 --2- 172.21.2.135:0/3487442410 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6314003750 0x7f633413a4d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:12.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 >> 172.21.2.135:0/3487442410 conn(0x7f63340611c0 msgr2=0x7f63340b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 shutdown_connections 2021-11-15T14:34:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:12.873+0000 7f6338eb0700 1 -- 172.21.2.135:0/3487442410 wait complete. 2021-11-15T14:34:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:adjusted tunables profile to default 2021-11-15T14:34:12.881 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-11-15T14:34:12.881 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:12.885 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.Gakv9eMRdF 2021-11-15T14:34:12.885 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.Gakv9eMRdF 2021-11-15T14:34:12.892 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.Gakv9eMRdF 2021-11-15T14:34:12.947 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.Gakv9eMRdF is 37B 2021-11-15T14:34:12.957 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.Gakv9eMRdF 2021-11-15T14:34:12.961 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:13.010 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.wydt6VBgd7 2021-11-15T14:34:13.010 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.wydt6VBgd7 2021-11-15T14:34:13.032 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.wydt6VBgd7 2021-11-15T14:34:13.110 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.wydt6VBgd7 is 37B 2021-11-15T14:34:13.125 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.wydt6VBgd7 2021-11-15T14:34:13.129 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:13.173 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.FBhQzPHqZL 2021-11-15T14:34:13.174 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.FBhQzPHqZL 2021-11-15T14:34:13.182 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.FBhQzPHqZL 2021-11-15T14:34:13.249 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.FBhQzPHqZL is 37B 2021-11-15T14:34:13.270 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.FBhQzPHqZL 2021-11-15T14:34:13.280 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T14:34:13.330 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.Ei98u9dYKY 2021-11-15T14:34:13.330 DEBUG:teuthology.orchestra.run.gibba035:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.Ei98u9dYKY 2021-11-15T14:34:13.353 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.Ei98u9dYKY 2021-11-15T14:34:13.433 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.Ei98u9dYKY is 37B 2021-11-15T14:34:13.452 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.Ei98u9dYKY 2021-11-15T14:34:13.461 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:13.465 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.E2wsT86qfL 2021-11-15T14:34:13.466 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.E2wsT86qfL 2021-11-15T14:34:13.475 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.E2wsT86qfL 2021-11-15T14:34:13.489 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.E2wsT86qfL is 37B 2021-11-15T14:34:13.496 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.E2wsT86qfL 2021-11-15T14:34:13.499 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:13.545 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.D4DIx5Ejdg 2021-11-15T14:34:13.545 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.D4DIx5Ejdg 2021-11-15T14:34:13.551 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.D4DIx5Ejdg 2021-11-15T14:34:13.562 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.D4DIx5Ejdg is 37B 2021-11-15T14:34:13.611 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.D4DIx5Ejdg 2021-11-15T14:34:13.614 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:13.617 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.P0PM6XjYZ4 2021-11-15T14:34:13.618 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.P0PM6XjYZ4 2021-11-15T14:34:13.664 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.P0PM6XjYZ4 2021-11-15T14:34:13.676 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.P0PM6XjYZ4 is 37B 2021-11-15T14:34:13.688 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.P0PM6XjYZ4 2021-11-15T14:34:13.691 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T14:34:13.737 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.taT6wrM3gy 2021-11-15T14:34:13.737 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.taT6wrM3gy 2021-11-15T14:34:13.742 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.taT6wrM3gy 2021-11-15T14:34:13.797 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.taT6wrM3gy is 37B 2021-11-15T14:34:13.806 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.taT6wrM3gy 2021-11-15T14:34:13.809 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new 8ff250b9-d13b-4150-b168-54ab0adafaf0 0 2021-11-15T14:34:13.899 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 Processor -- start 2021-11-15T14:34:13.899 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- start start 2021-11-15T14:34:13.902 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:13.902 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcf340b3950 0x7fcf34065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:13.902 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340b2430 con 0x7fcf340b2ca0 2021-11-15T14:34:13.902 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf34065770 con 0x7fcf340b3950 2021-11-15T14:34:13.903 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340b26d0 con 0x7fcf34060040 2021-11-15T14:34:13.903 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:13.903 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42798/0 (socket says 172.21.2.119:42798) 2021-11-15T14:34:13.903 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 -- 172.21.2.119:0/4062785219 learned_addr learned my addr 172.21.2.119:0/4062785219 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:13.903 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf337fe700 1 --2- 172.21.2.119:0/4062785219 >> v2:172.21.2.135:3300/0 conn(0x7fcf340b3950 0x7fcf34065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:13.904 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 -- 172.21.2.119:0/4062785219 >> v2:172.21.2.135:3300/0 conn(0x7fcf340b3950 msgr2=0x7fcf34065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:13.904 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 --2- 172.21.2.119:0/4062785219 >> v2:172.21.2.135:3300/0 conn(0x7fcf340b3950 0x7fcf34065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.904 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 -- 172.21.2.119:0/4062785219 >> v1:172.21.2.135:6789/0 conn(0x7fcf340b2ca0 legacy=0x7fcf340b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:13.904 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 -- 172.21.2.119:0/4062785219 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340b2970 con 0x7fcf34060040 2021-11-15T14:34:13.905 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf33fff700 1 --2- 172.21.2.119:0/4062785219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fcf1c002f70 tx=0x7fcf1c006eb0).ready entity=mon.2 client_cookie=25a94da905ae97c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:13.905 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf32ffd700 1 -- 172.21.2.119:0/4062785219 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c00d570 con 0x7fcf34060040 2021-11-15T14:34:13.905 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf32ffd700 1 -- 172.21.2.119:0/4062785219 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c000e90 con 0x7fcf34060040 2021-11-15T14:34:13.905 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf32ffd700 1 -- 172.21.2.119:0/4062785219 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c00d900 con 0x7fcf34060040 2021-11-15T14:34:13.905 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/4062785219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 msgr2=0x7fcf34064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:13.906 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/4062785219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fcf1c002f70 tx=0x7fcf1c006eb0).stop 2021-11-15T14:34:13.906 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/4062785219 shutdown_connections 2021-11-15T14:34:13.906 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/4062785219 >> v2:172.21.2.135:3300/0 conn(0x7fcf340b3950 0x7fcf34065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.906 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/4062785219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf34064d90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.907 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/4062785219 >> 172.21.2.119:0/4062785219 conn(0x7fcf3405cfe0 msgr2=0x7fcf3405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:13.907 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/4062785219 shutdown_connections 2021-11-15T14:34:13.907 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.900+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/4062785219 wait complete. 2021-11-15T14:34:13.909 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 Processor -- start 2021-11-15T14:34:13.909 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- start start 2021-11-15T14:34:13.910 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:13.910 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcf340b2ca0 0x7fcf34153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:13.910 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 0x7fcf34153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:13.910 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340abec0 con 0x7fcf340b3950 2021-11-15T14:34:13.911 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340ab9d0 con 0x7fcf340b2ca0 2021-11-15T14:34:13.911 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340ab490 con 0x7fcf34060040 2021-11-15T14:34:13.911 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:13.911 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf38c5a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 0x7fcf34153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:13.912 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42804/0 (socket says 172.21.2.119:42804) 2021-11-15T14:34:13.912 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 -- 172.21.2.119:0/1964784457 learned_addr learned my addr 172.21.2.119:0/1964784457 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:13.912 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf337fe700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcf340b2ca0 0x7fcf34153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:13.912 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 -- 172.21.2.119:0/1964784457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcf340b2ca0 msgr2=0x7fcf34153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:13.912 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcf340b2ca0 0x7fcf34153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.913 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 -- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 msgr2=0x7fcf34153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:13.913 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 0x7fcf34153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.913 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 -- 172.21.2.119:0/1964784457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c00b1e0 con 0x7fcf34060040 2021-11-15T14:34:13.913 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf38c5a700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 0x7fcf34153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:13.913 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf33fff700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fcf1c002f70 tx=0x7fcf1c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:13.914 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c0068b0 con 0x7fcf34060040 2021-11-15T14:34:13.914 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00de20 con 0x7fcf34060040 2021-11-15T14:34:13.914 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c011d70 con 0x7fcf34060040 2021-11-15T14:34:13.914 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf340ab730 con 0x7fcf34060040 2021-11-15T14:34:13.915 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34154480 con 0x7fcf34060040 2021-11-15T14:34:13.915 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fcf1c01a040 con 0x7fcf34060040 2021-11-15T14:34:13.915 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fcf1c0273f0 con 0x7fcf34060040 2021-11-15T14:34:13.915 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf340ac030 con 0x7fcf34060040 2021-11-15T14:34:13.915 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.904+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fcf1c023070 con 0x7fcf34060040 2021-11-15T14:34:13.951 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.952+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", "id": 0} v 0) v1 -- 0x7fcf340648f0 con 0x7fcf34060040 2021-11-15T14:34:13.955 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf317fa700 1 -- 172.21.2.119:0/1964784457 <== mon.2 v2:172.21.2.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf1c0275b0 con 0x7fcf34060040 2021-11-15T14:34:13.956 INFO:teuthology.orchestra.run.gibba019.stdout:0 2021-11-15T14:34:13.956 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 msgr2=0x7fcf3413e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:13.957 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fcf1c002f70 tx=0x7fcf1c015000).stop 2021-11-15T14:34:13.957 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 shutdown_connections 2021-11-15T14:34:13.957 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcf340b3950 0x7fcf34153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.957 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcf340b2ca0 0x7fcf34153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.958 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 --2- 172.21.2.119:0/1964784457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcf34060040 0x7fcf3413e3d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:13.958 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 >> 172.21.2.119:0/1964784457 conn(0x7fcf3405cfe0 msgr2=0x7fcf340b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:13.958 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 shutdown_connections 2021-11-15T14:34:13.958 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:13.956+0000 7fcf3a6bd700 1 -- 172.21.2.119:0/1964784457 wait complete. 2021-11-15T14:34:13.962 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new ef743c61-c920-4fca-94c1-ac8a1976d803 1 2021-11-15T14:34:14.013 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 Processor -- start 2021-11-15T14:34:14.013 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 -- start start 2021-11-15T14:34:14.015 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9a881469d0 0x7f9a881402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.015 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9a880b4200 0x7f9a881407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.016 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a880b4710 0x7f9a880b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.016 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a88147590 con 0x7f9a881469d0 2021-11-15T14:34:14.016 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a88143be0 con 0x7f9a880b4200 2021-11-15T14:34:14.016 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8fa55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88143e80 con 0x7f9a880b4710 2021-11-15T14:34:14.017 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9a881469d0 0x7f9a881402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.017 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9a881469d0 0x7f9a881402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38784/0 (socket says 172.21.2.119:38784) 2021-11-15T14:34:14.017 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/194841820 learned_addr learned my addr 172.21.2.119:0/194841820 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.017 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8dff2700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a880b4710 0x7f9a880b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.017 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a880b4710 msgr2=0x7f9a880b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.018 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a880b4710 0x7f9a880b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.018 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/194841820 >> v2:172.21.2.135:3300/0 conn(0x7f9a880b4200 msgr2=0x7f9a881407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.018 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/194841820 >> v2:172.21.2.135:3300/0 conn(0x7f9a880b4200 0x7f9a881407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:14.018 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.012+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/194841820 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880b0d10 con 0x7f9a881469d0 2021-11-15T14:34:14.019 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a881469d0 0x7f9a881402b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9a7c002f70 tx=0x7f9a7c006eb0).ready entity=mon.0 client_cookie=26fcc9aba045b95d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.019 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7bfff700 1 -- 172.21.2.119:0/194841820 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7c00d570 con 0x7f9a881469d0 2021-11-15T14:34:14.019 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7bfff700 1 -- 172.21.2.119:0/194841820 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c000e90 con 0x7f9a881469d0 2021-11-15T14:34:14.019 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7bfff700 1 -- 172.21.2.119:0/194841820 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7c00d900 con 0x7f9a881469d0 2021-11-15T14:34:14.019 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a881469d0 msgr2=0x7f9a881402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.020 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a881469d0 0x7f9a881402b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9a7c002f70 tx=0x7f9a7c006eb0).stop 2021-11-15T14:34:14.020 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/194841820 shutdown_connections 2021-11-15T14:34:14.020 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a880b4710 0x7f9a880b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.020 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/194841820 >> v2:172.21.2.135:3300/0 conn(0x7f9a880b4200 0x7f9a881407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:14.020 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/194841820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a881469d0 0x7f9a881402b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.021 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/194841820 >> 172.21.2.119:0/194841820 conn(0x7f9a8805c510 msgr2=0x7f9a8805c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.021 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/194841820 shutdown_connections 2021-11-15T14:34:14.021 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/194841820 wait complete. 2021-11-15T14:34:14.023 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 Processor -- start 2021-11-15T14:34:14.023 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- start start 2021-11-15T14:34:14.024 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.024 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9a880b4710 0x7f9a881523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.024 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a881469d0 0x7f9a881528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.024 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881559b0 con 0x7f9a880b4200 2021-11-15T14:34:14.025 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88155be0 con 0x7f9a880b4710 2021-11-15T14:34:14.025 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88155e80 con 0x7f9a881469d0 2021-11-15T14:34:14.025 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.025 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38790/0 (socket says 172.21.2.119:38790) 2021-11-15T14:34:14.025 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/532114358 learned_addr learned my addr 172.21.2.119:0/532114358 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.026 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8dff2700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a881469d0 0x7f9a881528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.026 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a881469d0 msgr2=0x7f9a881528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.026 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a881469d0 0x7f9a881528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.026 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/532114358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9a880b4710 msgr2=0x7f9a881523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.027 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9a880b4710 0x7f9a881523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:14.027 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 -- 172.21.2.119:0/532114358 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c00b1e0 con 0x7f9a880b4200 2021-11-15T14:34:14.027 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8d7f1700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9a7c002f70 tx=0x7f9a7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.027 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7c006be0 con 0x7f9a880b4200 2021-11-15T14:34:14.027 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c0068b0 con 0x7f9a880b4200 2021-11-15T14:34:14.028 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a88156120 con 0x7f9a880b4200 2021-11-15T14:34:14.028 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7c011e20 con 0x7f9a880b4200 2021-11-15T14:34:14.028 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a881567e0 con 0x7f9a880b4200 2021-11-15T14:34:14.028 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9a7c01a040 con 0x7f9a880b4200 2021-11-15T14:34:14.028 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f9a7c01e970 con 0x7f9a880b4200 2021-11-15T14:34:14.029 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.016+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a881562b0 con 0x7f9a880b4200 2021-11-15T14:34:14.029 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.020+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9a7c023070 con 0x7f9a880b4200 2021-11-15T14:34:14.063 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.064+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", "id": 1} v 0) v1 -- 0x7f9a880573d0 con 0x7f9a880b4200 2021-11-15T14:34:14.067 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a7a7fc700 1 -- 172.21.2.119:0/532114358 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a7c01eb80 con 0x7f9a880b4200 2021-11-15T14:34:14.068 INFO:teuthology.orchestra.run.gibba019.stdout:1 2021-11-15T14:34:14.069 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 msgr2=0x7f9a880aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.069 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f9a7c002f70 tx=0x7f9a7c015000).stop 2021-11-15T14:34:14.070 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 shutdown_connections 2021-11-15T14:34:14.070 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9a881469d0 0x7f9a881528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.070 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9a880b4710 0x7f9a881523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:14.071 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 --2- 172.21.2.119:0/532114358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9a880b4200 0x7f9a880aded0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.071 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 >> 172.21.2.119:0/532114358 conn(0x7f9a8805c510 msgr2=0x7f9a8813b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.072 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 shutdown_connections 2021-11-15T14:34:14.072 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.068+0000 7f9a8fa55700 1 -- 172.21.2.119:0/532114358 wait complete. 2021-11-15T14:34:14.074 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new 4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1 2 2021-11-15T14:34:14.130 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 Processor -- start 2021-11-15T14:34:14.131 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 -- start start 2021-11-15T14:34:14.131 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2de0060040 0x7f2de0064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.132 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b2ca0 0x7f2de0065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.132 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de00b2430 con 0x7f2de00b3950 2021-11-15T14:34:14.133 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de0065770 con 0x7f2de0060040 2021-11-15T14:34:14.133 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2de5357700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00b26d0 con 0x7f2de00b2ca0 2021-11-15T14:34:14.133 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2de0060040 0x7f2de0064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.134 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2de0060040 0x7f2de0064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38796/0 (socket says 172.21.2.119:38796) 2021-11-15T14:34:14.134 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 -- 172.21.2.119:0/927767584 learned_addr learned my addr 172.21.2.119:0/927767584 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.135 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddf7fe700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b2ca0 0x7f2de0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.135 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 -- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b2ca0 msgr2=0x7f2de0065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.136 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b2ca0 0x7f2de0065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.136 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 -- 172.21.2.119:0/927767584 >> v1:172.21.2.135:6789/0 conn(0x7f2de00b3950 legacy=0x7f2de00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.137 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 -- 172.21.2.119:0/927767584 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00b2970 con 0x7f2de0060040 2021-11-15T14:34:14.137 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2ddeffd700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de0064d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2de005d4e0 tx=0x7f2dd0006eb0).ready entity=mon.0 client_cookie=b9ac3f70d0457f4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.137 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2dddffb700 1 -- 172.21.2.119:0/927767584 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd000d570 con 0x7f2de0060040 2021-11-15T14:34:14.138 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2dddffb700 1 -- 172.21.2.119:0/927767584 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0000e90 con 0x7f2de0060040 2021-11-15T14:34:14.138 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.124+0000 7f2dddffb700 1 -- 172.21.2.119:0/927767584 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd000d900 con 0x7f2de0060040 2021-11-15T14:34:14.139 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 msgr2=0x7f2de0064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.139 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de0064d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2de005d4e0 tx=0x7f2dd0006eb0).stop 2021-11-15T14:34:14.140 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/927767584 shutdown_connections 2021-11-15T14:34:14.140 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b2ca0 0x7f2de0065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.140 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- 172.21.2.119:0/927767584 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de0064d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.141 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/927767584 >> 172.21.2.119:0/927767584 conn(0x7f2de005cfe0 msgr2=0x7f2de005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.141 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/927767584 shutdown_connections 2021-11-15T14:34:14.142 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/927767584 wait complete. 2021-11-15T14:34:14.142 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 Processor -- start 2021-11-15T14:34:14.142 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- start start 2021-11-15T14:34:14.143 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de00b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.143 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2de00b2ca0 0x7f2de01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.144 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.144 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00ad5a0 con 0x7f2de0060040 2021-11-15T14:34:14.144 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00ad840 con 0x7f2de00b2ca0 2021-11-15T14:34:14.145 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00ae920 con 0x7f2de00b3950 2021-11-15T14:34:14.145 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddf7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.146 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de00b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.146 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddf7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42830/0 (socket says 172.21.2.119:42830) 2021-11-15T14:34:14.146 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddf7fe700 1 -- 172.21.2.119:0/4168674437 learned_addr learned my addr 172.21.2.119:0/4168674437 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.147 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dde7fc700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2de00b2ca0 0x7f2de01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.147 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 -- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 msgr2=0x7f2de00aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.148 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.148 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 -- 172.21.2.119:0/4168674437 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2de00b2ca0 msgr2=0x7f2de01569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.148 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2de00b2ca0 0x7f2de01569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.149 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 -- 172.21.2.119:0/4168674437 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd000b1e0 con 0x7f2de0060040 2021-11-15T14:34:14.149 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddf7fe700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:14.150 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2ddeffd700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de00b6800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2de005d4e0 tx=0x7f2dd0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.150 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd0002f70 con 0x7f2de0060040 2021-11-15T14:34:14.151 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd00068b0 con 0x7f2de0060040 2021-11-15T14:34:14.151 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00ad200 con 0x7f2de0060040 2021-11-15T14:34:14.151 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd0011e20 con 0x7f2de0060040 2021-11-15T14:34:14.152 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de00add00 con 0x7f2de0060040 2021-11-15T14:34:14.152 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f2dd001a040 con 0x7f2de0060040 2021-11-15T14:34:14.153 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f2dd000de40 con 0x7f2de0060040 2021-11-15T14:34:14.153 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.128+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de00ae780 con 0x7f2de0060040 2021-11-15T14:34:14.154 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.132+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f2de00ae780 con 0x7f2de0060040 2021-11-15T14:34:14.176 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.176+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", "id": 2} v 0) v1 -- 0x7f2de00aeae0 con 0x7f2de0060040 2021-11-15T14:34:14.181 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2dd7fff700 1 -- 172.21.2.119:0/4168674437 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dd0023070 con 0x7f2de0060040 2021-11-15T14:34:14.181 INFO:teuthology.orchestra.run.gibba019.stdout:2 2021-11-15T14:34:14.183 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 msgr2=0x7f2de00b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.183 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de00b6800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2de005d4e0 tx=0x7f2dd0015000).stop 2021-11-15T14:34:14.184 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 shutdown_connections 2021-11-15T14:34:14.184 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2de00b3950 0x7f2de00aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.185 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2de00b2ca0 0x7f2de01569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.185 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 --2- 172.21.2.119:0/4168674437 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2de0060040 0x7f2de00b6800 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.185 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 >> 172.21.2.119:0/4168674437 conn(0x7f2de005cfe0 msgr2=0x7f2de00b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.186 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 shutdown_connections 2021-11-15T14:34:14.186 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.180+0000 7f2de5357700 1 -- 172.21.2.119:0/4168674437 wait complete. 2021-11-15T14:34:14.188 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new d21a02d0-717e-4155-acfd-c9fcc0a575c8 3 2021-11-15T14:34:14.240 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 Processor -- start 2021-11-15T14:34:14.240 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- start start 2021-11-15T14:34:14.247 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f577c0b0630 0x7f577c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.248 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.248 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c1439a0 con 0x7f577c13dac0 2021-11-15T14:34:14.249 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c143c40 con 0x7f577c0b0630 2021-11-15T14:34:14.249 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c143ee0 con 0x7f577c0b3790 2021-11-15T14:34:14.249 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f577c0b0630 0x7f577c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.250 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f577c0b0630 0x7f577c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38806/0 (socket says 172.21.2.119:38806) 2021-11-15T14:34:14.250 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 -- 172.21.2.119:0/2316614283 learned_addr learned my addr 172.21.2.119:0/2316614283 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.251 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5779d9b700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.251 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 -- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 msgr2=0x7f577c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.251 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c13d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.252 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 -- 172.21.2.119:0/2316614283 >> v1:172.21.2.119:6789/0 conn(0x7f577c13dac0 legacy=0x7f577c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.252 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 -- 172.21.2.119:0/2316614283 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c144180 con 0x7f577c0b0630 2021-11-15T14:34:14.253 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577a59c700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c0b0a10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f576c002f70 tx=0x7f576c006f40).ready entity=mon.0 client_cookie=7ca50d777d9bd324 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.253 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577959a700 1 -- 172.21.2.119:0/2316614283 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c00da80 con 0x7f577c0b0630 2021-11-15T14:34:14.253 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577959a700 1 -- 172.21.2.119:0/2316614283 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c000e90 con 0x7f577c0b0630 2021-11-15T14:34:14.254 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f577959a700 1 -- 172.21.2.119:0/2316614283 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c00de10 con 0x7f577c0b0630 2021-11-15T14:34:14.254 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 msgr2=0x7f577c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.254 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c0b0a10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f576c002f70 tx=0x7f576c006f40).stop 2021-11-15T14:34:14.255 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- 172.21.2.119:0/2316614283 shutdown_connections 2021-11-15T14:34:14.255 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.256 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 --2- 172.21.2.119:0/2316614283 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c0b0a10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.256 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- 172.21.2.119:0/2316614283 >> 172.21.2.119:0/2316614283 conn(0x7f577c060840 msgr2=0x7f577c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.256 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- 172.21.2.119:0/2316614283 shutdown_connections 2021-11-15T14:34:14.257 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- 172.21.2.119:0/2316614283 wait complete. 2021-11-15T14:34:14.257 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 Processor -- start 2021-11-15T14:34:14.257 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.240+0000 7f5780e07700 1 -- start start 2021-11-15T14:34:14.258 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.258 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c0ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.259 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 0x7f577c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.259 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c065fc0 con 0x7f577c0b0630 2021-11-15T14:34:14.259 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c066760 con 0x7f577c13dac0 2021-11-15T14:34:14.260 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c066220 con 0x7f577c0b3790 2021-11-15T14:34:14.260 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.261 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38812/0 (socket says 172.21.2.119:38812) 2021-11-15T14:34:14.261 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 -- 172.21.2.119:0/2581505823 learned_addr learned my addr 172.21.2.119:0/2581505823 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.261 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5779d9b700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c0ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.262 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577ad9d700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 0x7f577c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.262 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 -- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 msgr2=0x7f577c0ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.263 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c0ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.263 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 -- 172.21.2.119:0/2581505823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 msgr2=0x7f577c0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.263 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 0x7f577c0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.264 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 -- 172.21.2.119:0/2581505823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c00b460 con 0x7f577c0b0630 2021-11-15T14:34:14.264 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577ad9d700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 0x7f577c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:14.264 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f577a59c700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f576c002f70 tx=0x7f577c1410a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.265 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c01f070 con 0x7f577c0b0630 2021-11-15T14:34:14.265 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c010e80 con 0x7f577c0b0630 2021-11-15T14:34:14.265 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c0664c0 con 0x7f577c0b0630 2021-11-15T14:34:14.266 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c065790 con 0x7f577c0b0630 2021-11-15T14:34:14.266 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c018600 con 0x7f577c0b0630 2021-11-15T14:34:14.267 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f576c018970 con 0x7f577c0b0630 2021-11-15T14:34:14.267 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f576c00f890 con 0x7f577c0b0630 2021-11-15T14:34:14.267 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c143620 con 0x7f577c0b0630 2021-11-15T14:34:14.268 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.244+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f576c00f5e0 con 0x7f577c0b0630 2021-11-15T14:34:14.290 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", "id": 3} v 0) v1 -- 0x7f577c0573d0 con 0x7f577c0b0630 2021-11-15T14:34:14.294 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f57737fe700 1 -- 172.21.2.119:0/2581505823 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f576c006a40 con 0x7f577c0b0630 2021-11-15T14:34:14.294 INFO:teuthology.orchestra.run.gibba019.stdout:3 2021-11-15T14:34:14.296 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 msgr2=0x7f577c067180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.296 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f576c002f70 tx=0x7f577c1410a0).stop 2021-11-15T14:34:14.297 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 shutdown_connections 2021-11-15T14:34:14.297 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f577c13dac0 0x7f577c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.297 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f577c0b3790 0x7f577c0ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.298 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 --2- 172.21.2.119:0/2581505823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f577c0b0630 0x7f577c067180 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.298 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.292+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 >> 172.21.2.119:0/2581505823 conn(0x7f577c060840 msgr2=0x7f577c13cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.299 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.296+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 shutdown_connections 2021-11-15T14:34:14.299 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.296+0000 7f5780e07700 1 -- 172.21.2.119:0/2581505823 wait complete. 2021-11-15T14:34:14.301 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new d92b907a-4fe9-46a1-bee8-e17e6ff11b94 4 2021-11-15T14:34:14.352 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 Processor -- start 2021-11-15T14:34:14.352 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- start start 2021-11-15T14:34:14.358 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f40080b3950 0x7f4008144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.358 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080b2430 con 0x7f40080654a0 2021-11-15T14:34:14.359 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080b26d0 con 0x7f4008060040 2021-11-15T14:34:14.359 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080b2970 con 0x7f40080b3950 2021-11-15T14:34:14.360 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f40077fe700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f40080654a0 0x7f40081444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.119:53788/0 (socket says 172.21.2.119:53788) 2021-11-15T14:34:14.360 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f40077fe700 1 -- 172.21.2.119:0/1049631361 learned_addr learned my addr 172.21.2.119:0/1049631361 (peer_addr_for_me v1:172.21.2.119:0/0) 2021-11-15T14:34:14.360 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400cce5700 1 --2- 172.21.2.119:0/1049631361 >> v2:172.21.2.119:3300/0 conn(0x7f40080b3950 0x7f4008144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.361 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400cce5700 1 -- 172.21.2.119:0/1049631361 >> v1:172.21.2.135:6789/0 conn(0x7f4008060040 legacy=0x7f4008064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.361 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400cce5700 1 -- 172.21.2.119:0/1049631361 >> v1:172.21.2.119:6789/0 conn(0x7f40080654a0 legacy=0x7f40081444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.362 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400cce5700 1 -- 172.21.2.119:0/1049631361 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080648f0 con 0x7f40080b3950 2021-11-15T14:34:14.362 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400cce5700 1 --2- 172.21.2.119:0/1049631361 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f4008144bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f400805d4e0 tx=0x7f40000091d0).ready entity=mon.0 client_cookie=8a6ca1f39a48c46b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.362 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f4006ffd700 1 -- 172.21.2.119:0/1049631361 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4000009ea0 con 0x7f40080b3950 2021-11-15T14:34:14.363 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f4006ffd700 1 -- 172.21.2.119:0/1049631361 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000b860 con 0x7f40080b3950 2021-11-15T14:34:14.363 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f4006ffd700 1 -- 172.21.2.119:0/1049631361 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f400000b9d0 con 0x7f40080b3950 2021-11-15T14:34:14.363 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- 172.21.2.119:0/1049631361 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 msgr2=0x7f4008144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.364 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 --2- 172.21.2.119:0/1049631361 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f4008144bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f400805d4e0 tx=0x7f40000091d0).stop 2021-11-15T14:34:14.364 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- 172.21.2.119:0/1049631361 shutdown_connections 2021-11-15T14:34:14.365 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 --2- 172.21.2.119:0/1049631361 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f4008144bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.365 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- 172.21.2.119:0/1049631361 >> 172.21.2.119:0/1049631361 conn(0x7f400805cfe0 msgr2=0x7f400805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.365 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- 172.21.2.119:0/1049631361 shutdown_connections 2021-11-15T14:34:14.366 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.352+0000 7f400e748700 1 -- 172.21.2.119:0/1049631361 wait complete. 2021-11-15T14:34:14.366 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 Processor -- start 2021-11-15T14:34:14.367 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- start start 2021-11-15T14:34:14.367 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4008060040 0x7f4008155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.368 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40080654a0 0x7f40081306f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.368 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.369 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40081419d0 con 0x7f40080b3950 2021-11-15T14:34:14.369 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008141490 con 0x7f4008060040 2021-11-15T14:34:14.369 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4008141730 con 0x7f40080654a0 2021-11-15T14:34:14.370 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.370 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.119:38826/0 (socket says 172.21.2.119:38826) 2021-11-15T14:34:14.371 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 -- 172.21.2.119:0/436380689 learned_addr learned my addr 172.21.2.119:0/436380689 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.371 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40077fe700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40080654a0 0x7f40081306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.371 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f4007fff700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4008060040 0x7f4008155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.372 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 -- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40080654a0 msgr2=0x7f40081306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.372 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40080654a0 0x7f40081306f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.373 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 -- 172.21.2.119:0/436380689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4008060040 msgr2=0x7f4008155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.373 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4008060040 0x7f4008155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.374 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 -- 172.21.2.119:0/436380689 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009470 con 0x7f40080b3950 2021-11-15T14:34:14.374 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400cce5700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f400805d4e0 tx=0x7f4000016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.374 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4000009ea0 con 0x7f40080b3950 2021-11-15T14:34:14.375 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000032f0 con 0x7f40080b3950 2021-11-15T14:34:14.375 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080ad9a0 con 0x7f40080b3950 2021-11-15T14:34:14.376 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f400001f5e0 con 0x7f40080b3950 2021-11-15T14:34:14.376 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4008140ff0 con 0x7f40080b3950 2021-11-15T14:34:14.376 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4000026030 con 0x7f40080b3950 2021-11-15T14:34:14.377 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f40000288e0 con 0x7f40080b3950 2021-11-15T14:34:14.377 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40080adb30 con 0x7f40080b3950 2021-11-15T14:34:14.378 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.356+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4000024070 con 0x7f40080b3950 2021-11-15T14:34:14.403 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.404+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", "id": 4} v 0) v1 -- 0x7f4008060420 con 0x7f40080b3950 2021-11-15T14:34:14.407 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f40057fa700 1 -- 172.21.2.119:0/436380689 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f400001b040 con 0x7f40080b3950 2021-11-15T14:34:14.407 INFO:teuthology.orchestra.run.gibba019.stdout:4 2021-11-15T14:34:14.409 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 msgr2=0x7f40080ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.410 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f400805d4e0 tx=0x7f4000016000).stop 2021-11-15T14:34:14.410 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 shutdown_connections 2021-11-15T14:34:14.411 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40080b3950 0x7f40080ade40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.411 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40080654a0 0x7f40081306f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.411 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 --2- 172.21.2.119:0/436380689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4008060040 0x7f4008155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.412 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 >> 172.21.2.119:0/436380689 conn(0x7f400805cfe0 msgr2=0x7f4008144cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.412 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 shutdown_connections 2021-11-15T14:34:14.413 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.408+0000 7f400e748700 1 -- 172.21.2.119:0/436380689 wait complete. 2021-11-15T14:34:14.414 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new 1ff30a62-5ccd-4e1a-9a17-ceb30614052f 5 2021-11-15T14:34:14.467 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 Processor -- start 2021-11-15T14:34:14.467 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- start start 2021-11-15T14:34:14.468 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef100654a0 0x7fef101444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.468 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100b2430 con 0x7fef10060040 2021-11-15T14:34:14.468 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100b26d0 con 0x7fef100b3950 2021-11-15T14:34:14.468 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef100b2970 con 0x7fef100654a0 2021-11-15T14:34:14.469 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef15abb700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fef10060040 0x7fef10064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.119:53796/0 (socket says 172.21.2.119:53796) 2021-11-15T14:34:14.469 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef15abb700 1 -- 172.21.2.119:0/113312583 learned_addr learned my addr 172.21.2.119:0/113312583 (peer_addr_for_me v1:172.21.2.119:0/0) 2021-11-15T14:34:14.473 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef152ba700 1 --2- 172.21.2.119:0/113312583 >> v2:172.21.2.135:3300/0 conn(0x7fef100654a0 0x7fef101444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.473 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853800396 0 0) 0x7fef100b2430 con 0x7fef10060040 2021-11-15T14:34:14.473 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef8003260 con 0x7fef10060040 2021-11-15T14:34:14.473 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v1:172.21.2.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911491453 0 0) 0x7feef8003260 con 0x7fef10060040 2021-11-15T14:34:14.474 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 >> v2:172.21.2.135:3300/0 conn(0x7fef100654a0 msgr2=0x7fef101444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.474 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 --2- 172.21.2.119:0/113312583 >> v2:172.21.2.135:3300/0 conn(0x7fef100654a0 0x7fef101444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.474 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 >> v1:172.21.2.135:6789/0 conn(0x7fef100b3950 legacy=0x7fef101449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.474 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 --> v1:172.21.2.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100648f0 con 0x7fef10060040 2021-11-15T14:34:14.475 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v1:172.21.2.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fef0c001660 con 0x7fef10060040 2021-11-15T14:34:14.475 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 >> v1:172.21.2.119:6789/0 conn(0x7fef10060040 legacy=0x7fef10064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.475 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feef80037a0 0x7feef8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.475 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feef8004500 0x7feef8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.476 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7feef800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.476 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100b2970 con 0x7feef8004e70 2021-11-15T14:34:14.476 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef800bda0 con 0x7feef80037a0 2021-11-15T14:34:14.476 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef800bf60 con 0x7feef8004500 2021-11-15T14:34:14.476 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7feef800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.477 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef152ba700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feef8004500 0x7feef8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.477 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef15abb700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feef80037a0 0x7feef8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.477 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 -- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feef8004500 msgr2=0x7feef8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.477 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feef8004500 0x7feef8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.478 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 -- 172.21.2.119:0/113312583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feef80037a0 msgr2=0x7feef8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.478 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feef80037a0 0x7feef8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.478 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 -- 172.21.2.119:0/113312583 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8003260 con 0x7feef8004e70 2021-11-15T14:34:14.478 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef152ba700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feef8004500 0x7feef8004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:14.478 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 -- 172.21.2.119:0/113312583 reap_dead start 2021-11-15T14:34:14.479 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef162bc700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7feef800b750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fef1005d4e0 tx=0x7fef08007d80).ready entity=mon.0 client_cookie=35417574e4078cbf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.479 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef08001620 con 0x7feef8004e70 2021-11-15T14:34:14.479 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08006890 con 0x7feef8004e70 2021-11-15T14:34:14.479 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef14ab9700 1 -- 172.21.2.119:0/113312583 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef08006bf0 con 0x7feef8004e70 2021-11-15T14:34:14.480 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 msgr2=0x7feef800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.480 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7feef800b750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fef1005d4e0 tx=0x7fef08007d80).stop 2021-11-15T14:34:14.480 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- 172.21.2.119:0/113312583 shutdown_connections 2021-11-15T14:34:14.480 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 --2- 172.21.2.119:0/113312583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7feef800b750 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.480 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- 172.21.2.119:0/113312583 >> 172.21.2.119:0/113312583 conn(0x7fef1005cfe0 msgr2=0x7fef1005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.481 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- 172.21.2.119:0/113312583 shutdown_connections 2021-11-15T14:34:14.481 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- 172.21.2.119:0/113312583 wait complete. 2021-11-15T14:34:14.481 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 Processor -- start 2021-11-15T14:34:14.481 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.468+0000 7fef17d1f700 1 -- start start 2021-11-15T14:34:14.482 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7fef1014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.482 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 0x7fef1013c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.483 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef100b1140 0x7fef1014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.483 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1014e730 con 0x7feef8004e70 2021-11-15T14:34:14.484 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1013ece0 con 0x7fef100b1140 2021-11-15T14:34:14.484 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1013ef80 con 0x7fef1013d430 2021-11-15T14:34:14.484 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef152ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 0x7fef1013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.485 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef152ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 0x7fef1013c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42870/0 (socket says 172.21.2.119:42870) 2021-11-15T14:34:14.485 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7fef1014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.485 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef152ba700 1 -- 172.21.2.119:0/452357600 learned_addr learned my addr 172.21.2.119:0/452357600 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.486 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef162bc700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef100b1140 0x7fef1014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.486 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 -- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 msgr2=0x7fef1013c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.486 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 0x7fef1013c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.486 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 -- 172.21.2.119:0/452357600 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef100b1140 msgr2=0x7fef1014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.486 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef100b1140 0x7fef1014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.487 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 -- 172.21.2.119:0/452357600 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1013c580 con 0x7feef8004e70 2021-11-15T14:34:14.487 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef15abb700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7fef1014e240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef0c00d000 tx=0x7fef10064a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.487 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c0116b0 con 0x7feef8004e70 2021-11-15T14:34:14.487 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c011810 con 0x7feef8004e70 2021-11-15T14:34:14.487 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1013d1b0 con 0x7feef8004e70 2021-11-15T14:34:14.488 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1009e930 con 0x7feef8004e70 2021-11-15T14:34:14.488 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c011b70 con 0x7feef8004e70 2021-11-15T14:34:14.488 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fef0c01b030 con 0x7feef8004e70 2021-11-15T14:34:14.488 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fef0c01d960 con 0x7feef8004e70 2021-11-15T14:34:14.489 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef100674f0 con 0x7feef8004e70 2021-11-15T14:34:14.489 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.472+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fef0c019070 con 0x7feef8004e70 2021-11-15T14:34:14.518 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.520+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", "id": 5} v 0) v1 -- 0x7fef100573d0 con 0x7feef8004e70 2021-11-15T14:34:14.522 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.520+0000 7fef02ffd700 1 -- 172.21.2.119:0/452357600 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fef0c01dbc0 con 0x7feef8004e70 2021-11-15T14:34:14.522 INFO:teuthology.orchestra.run.gibba019.stdout:5 2021-11-15T14:34:14.523 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 msgr2=0x7fef1014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.523 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7fef1014e240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef0c00d000 tx=0x7fef10064a80).stop 2021-11-15T14:34:14.524 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 shutdown_connections 2021-11-15T14:34:14.524 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef100b1140 0x7fef1014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.524 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef1013d430 0x7fef1013c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.524 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 --2- 172.21.2.119:0/452357600 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feef8004e70 0x7fef1014e240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.524 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 >> 172.21.2.119:0/452357600 conn(0x7fef1005cfe0 msgr2=0x7fef101407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.525 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 shutdown_connections 2021-11-15T14:34:14.525 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.524+0000 7fef17d1f700 1 -- 172.21.2.119:0/452357600 wait complete. 2021-11-15T14:34:14.529 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26 6 2021-11-15T14:34:14.580 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 Processor -- start 2021-11-15T14:34:14.580 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- start start 2021-11-15T14:34:14.582 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f16bc0b4710 0x7f16bc1409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.582 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc143be0 con 0x7f16bc0b4200 2021-11-15T14:34:14.583 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16bc143e80 con 0x7f16bc1469d0 2021-11-15T14:34:14.583 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16bc147590 con 0x7f16bc0b4710 2021-11-15T14:34:14.583 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16bb7fe700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f16bc0b4200 0x7f16bc0b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.119:53816/0 (socket says 172.21.2.119:53816) 2021-11-15T14:34:14.583 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16bb7fe700 1 -- 172.21.2.119:0/1360769179 learned_addr learned my addr 172.21.2.119:0/1360769179 (peer_addr_for_me v1:172.21.2.119:0/0) 2021-11-15T14:34:14.583 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c0898700 1 --2- 172.21.2.119:0/1360769179 >> v2:172.21.2.119:3300/0 conn(0x7f16bc0b4710 0x7f16bc1409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.584 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16baffd700 1 -- 172.21.2.119:0/1360769179 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54031352 0 0) 0x7f16bc143be0 con 0x7f16bc0b4200 2021-11-15T14:34:14.584 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16baffd700 1 -- 172.21.2.119:0/1360769179 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c003260 con 0x7f16bc0b4200 2021-11-15T14:34:14.584 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c0898700 1 -- 172.21.2.119:0/1360769179 >> v1:172.21.2.135:6789/0 conn(0x7f16bc1469d0 legacy=0x7f16bc1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.584 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c0898700 1 -- 172.21.2.119:0/1360769179 >> v1:172.21.2.119:6789/0 conn(0x7f16bc0b4200 legacy=0x7f16bc0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.585 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c0898700 1 -- 172.21.2.119:0/1360769179 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0b0d10 con 0x7f16bc0b4710 2021-11-15T14:34:14.585 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c0898700 1 --2- 172.21.2.119:0/1360769179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4710 0x7f16bc1409c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f16a4001110 tx=0x7f16b40091d0).ready entity=mon.0 client_cookie=8d58ad0d3c320949 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.585 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16baffd700 1 -- 172.21.2.119:0/1360769179 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b400b640 con 0x7f16bc0b4710 2021-11-15T14:34:14.585 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16baffd700 1 -- 172.21.2.119:0/1360769179 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400b7a0 con 0x7f16bc0b4710 2021-11-15T14:34:14.585 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16baffd700 1 -- 172.21.2.119:0/1360769179 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b400b910 con 0x7f16bc0b4710 2021-11-15T14:34:14.586 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- 172.21.2.119:0/1360769179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4710 msgr2=0x7f16bc1409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.586 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 --2- 172.21.2.119:0/1360769179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4710 0x7f16bc1409c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f16a4001110 tx=0x7f16b40091d0).stop 2021-11-15T14:34:14.586 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- 172.21.2.119:0/1360769179 shutdown_connections 2021-11-15T14:34:14.586 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 --2- 172.21.2.119:0/1360769179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4710 0x7f16bc1409c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.586 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- 172.21.2.119:0/1360769179 >> 172.21.2.119:0/1360769179 conn(0x7f16bc05c510 msgr2=0x7f16bc05c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.587 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- 172.21.2.119:0/1360769179 shutdown_connections 2021-11-15T14:34:14.587 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.580+0000 7f16c22fb700 1 -- 172.21.2.119:0/1360769179 wait complete. 2021-11-15T14:34:14.589 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 Processor -- start 2021-11-15T14:34:14.589 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- start start 2021-11-15T14:34:14.589 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4200 0x7f16bc0b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.589 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.590 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 0x7f16bc0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.590 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc144c30 con 0x7f16bc0b4200 2021-11-15T14:34:14.590 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc1455b0 con 0x7f16bc1469d0 2021-11-15T14:34:14.590 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc145850 con 0x7f16bc0b4710 2021-11-15T14:34:14.590 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.591 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42880/0 (socket says 172.21.2.119:42880) 2021-11-15T14:34:14.591 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 -- 172.21.2.119:0/805977718 learned_addr learned my addr 172.21.2.119:0/805977718 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.591 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bbfff700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4200 0x7f16bc0b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.591 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 -- 172.21.2.119:0/805977718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 msgr2=0x7f16bc0b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.592 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c0898700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 0x7f16bc0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.592 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 0x7f16bc0b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.592 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 -- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4200 msgr2=0x7f16bc0b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.592 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4200 0x7f16bc0b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.592 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 -- 172.21.2.119:0/805977718 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009470 con 0x7f16bc0b4710 2021-11-15T14:34:14.593 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c0898700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 0x7f16bc0b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:14.593 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16bb7fe700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f16a4000ed0 tx=0x7f16a4007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.593 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a400ce70 con 0x7f16bc0b4710 2021-11-15T14:34:14.593 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40072e0 con 0x7f16bc0b4710 2021-11-15T14:34:14.593 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a4005800 con 0x7f16bc0b4710 2021-11-15T14:34:14.594 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc145af0 con 0x7f16bc0b4710 2021-11-15T14:34:14.594 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc146040 con 0x7f16bc0b4710 2021-11-15T14:34:14.594 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f16a4010070 con 0x7f16bc0b4710 2021-11-15T14:34:14.594 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f16a4005b90 con 0x7f16bc0b4710 2021-11-15T14:34:14.595 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc0573d0 con 0x7f16bc0b4710 2021-11-15T14:34:14.595 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.584+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f16a4005e30 con 0x7f16bc0b4710 2021-11-15T14:34:14.630 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.632+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", "id": 6} v 0) v1 -- 0x7f16bc069960 con 0x7f16bc0b4710 2021-11-15T14:34:14.634 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.632+0000 7f16b97fa700 1 -- 172.21.2.119:0/805977718 <== mon.2 v2:172.21.2.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16a4013450 con 0x7f16bc0b4710 2021-11-15T14:34:14.635 INFO:teuthology.orchestra.run.gibba019.stdout:6 2021-11-15T14:34:14.636 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 msgr2=0x7f16bc0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.636 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f16a4000ed0 tx=0x7f16a4007ad0).stop 2021-11-15T14:34:14.636 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 shutdown_connections 2021-11-15T14:34:14.636 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16bc1469d0 0x7f16bc0b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.637 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16bc0b4710 0x7f16bc0b56e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.637 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 --2- 172.21.2.119:0/805977718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16bc0b4200 0x7f16bc0b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.637 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 >> 172.21.2.119:0/805977718 conn(0x7f16bc05c510 msgr2=0x7f16bc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.637 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 shutdown_connections 2021-11-15T14:34:14.637 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.636+0000 7f16c22fb700 1 -- 172.21.2.119:0/805977718 wait complete. 2021-11-15T14:34:14.641 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster ceph osd new d052682a-32ba-4d00-91cd-285e266cf789 7 2021-11-15T14:34:14.692 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 Processor -- start 2021-11-15T14:34:14.692 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- start start 2021-11-15T14:34:14.695 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 0x7f64ac1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.695 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f64ac0b4200 0x7f64ac1407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.695 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac143be0 con 0x7f64ac0b4710 2021-11-15T14:34:14.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac147590 con 0x7f64ac0b4200 2021-11-15T14:34:14.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac143e80 con 0x7f64ac1469d0 2021-11-15T14:34:14.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b0f51700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f64ac0b4710 0x7f64ac0b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.119:53828/0 (socket says 172.21.2.119:53828) 2021-11-15T14:34:14.696 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b0f51700 1 -- 172.21.2.119:0/2225779367 learned_addr learned my addr 172.21.2.119:0/2225779367 (peer_addr_for_me v1:172.21.2.119:0/0) 2021-11-15T14:34:14.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/2225779367 >> v2:172.21.2.119:3300/0 conn(0x7f64ac0b4200 0x7f64ac1407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64abfff700 1 --2- 172.21.2.119:0/2225779367 >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 0x7f64ac1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64aaffd700 1 -- 172.21.2.119:0/2225779367 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504450139 0 0) 0x7f64ac143be0 con 0x7f64ac0b4710 2021-11-15T14:34:14.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64aaffd700 1 -- 172.21.2.119:0/2225779367 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f648c003260 con 0x7f64ac0b4710 2021-11-15T14:34:14.697 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 -- 172.21.2.119:0/2225779367 >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 msgr2=0x7f64ac1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:14.698 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/2225779367 >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 0x7f64ac1402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.698 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 -- 172.21.2.119:0/2225779367 >> v1:172.21.2.119:6789/0 conn(0x7f64ac0b4710 legacy=0x7f64ac0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.698 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 -- 172.21.2.119:0/2225779367 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0b0d10 con 0x7f64ac0b4200 2021-11-15T14:34:14.698 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64abfff700 1 --2- 172.21.2.119:0/2225779367 >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 0x7f64ac1402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:14.699 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/2225779367 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac1407a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6494002f70 tx=0x7f6494006df0).ready entity=mon.0 client_cookie=25b7aea365768e1a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.699 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64aaffd700 1 -- 172.21.2.119:0/2225779367 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400d570 con 0x7f64ac0b4200 2021-11-15T14:34:14.699 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64aaffd700 1 -- 172.21.2.119:0/2225779367 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494000e90 con 0x7f64ac0b4200 2021-11-15T14:34:14.699 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64aaffd700 1 -- 172.21.2.119:0/2225779367 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400d8c0 con 0x7f64ac0b4200 2021-11-15T14:34:14.699 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- 172.21.2.119:0/2225779367 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 msgr2=0x7f64ac1407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.700 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 --2- 172.21.2.119:0/2225779367 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac1407a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6494002f70 tx=0x7f6494006df0).stop 2021-11-15T14:34:14.700 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- 172.21.2.119:0/2225779367 shutdown_connections 2021-11-15T14:34:14.700 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 --2- 172.21.2.119:0/2225779367 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac1407a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.700 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 --2- 172.21.2.119:0/2225779367 >> v2:172.21.2.135:3300/0 conn(0x7f64ac1469d0 0x7f64ac1402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.700 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- 172.21.2.119:0/2225779367 >> 172.21.2.119:0/2225779367 conn(0x7f64ac05c510 msgr2=0x7f64ac05c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.701 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- 172.21.2.119:0/2225779367 shutdown_connections 2021-11-15T14:34:14.701 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.692+0000 7f64b29b4700 1 -- 172.21.2.119:0/2225779367 wait complete. 2021-11-15T14:34:14.701 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 Processor -- start 2021-11-15T14:34:14.701 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- start start 2021-11-15T14:34:14.701 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac0b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.702 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.702 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64ac1469d0 0x7f64ac1459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:14.702 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0ad920 con 0x7f64ac0b4200 2021-11-15T14:34:14.702 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac153120 con 0x7f64ac1469d0 2021-11-15T14:34:14.703 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0adfd0 con 0x7f64ac0b4710 2021-11-15T14:34:14.703 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.703 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64abfff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac0b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.703 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.119:42892/0 (socket says 172.21.2.119:42892) 2021-11-15T14:34:14.703 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 -- 172.21.2.119:0/3122630571 learned_addr learned my addr 172.21.2.119:0/3122630571 (peer_addr_for_me v2:172.21.2.119:0/0) 2021-11-15T14:34:14.704 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b0f51700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64ac1469d0 0x7f64ac1459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:14.705 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 -- 172.21.2.119:0/3122630571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64ac1469d0 msgr2=0x7f64ac1459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.705 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64ac1469d0 0x7f64ac1459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.706 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 -- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 msgr2=0x7f64ac0b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.706 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac0b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.706 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 -- 172.21.2.119:0/3122630571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649400b180 con 0x7f64ac0b4710 2021-11-15T14:34:14.706 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64abfff700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac0b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:14.707 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64ab7fe700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6494002f70 tx=0x7f6494014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:14.707 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6494016070 con 0x7f64ac0b4710 2021-11-15T14:34:14.707 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649400de60 con 0x7f64ac0b4710 2021-11-15T14:34:14.707 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6494006b20 con 0x7f64ac0b4710 2021-11-15T14:34:14.707 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0adb50 con 0x7f64ac0b4710 2021-11-15T14:34:14.708 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac152b80 con 0x7f64ac0b4710 2021-11-15T14:34:14.708 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f6494025030 con 0x7f64ac0b4710 2021-11-15T14:34:14.708 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f649401e620 con 0x7f64ac0b4710 2021-11-15T14:34:14.708 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac0573d0 con 0x7f64ac0b4710 2021-11-15T14:34:14.709 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.696+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f6494023070 con 0x7f64ac0b4710 2021-11-15T14:34:14.743 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.744+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", "id": 7} v 0) v1 -- 0x7f64ac0aef10 con 0x7f64ac0b4710 2021-11-15T14:34:14.747 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64a97fa700 1 -- 172.21.2.119:0/3122630571 <== mon.2 v2:172.21.2.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f649401ea30 con 0x7f64ac0b4710 2021-11-15T14:34:14.747 INFO:teuthology.orchestra.run.gibba019.stdout:7 2021-11-15T14:34:14.748 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 msgr2=0x7f64ac1454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:14.748 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6494002f70 tx=0x7f6494014000).stop 2021-11-15T14:34:14.748 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 shutdown_connections 2021-11-15T14:34:14.749 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64ac1469d0 0x7f64ac1459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.749 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64ac0b4710 0x7f64ac1454d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.749 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 --2- 172.21.2.119:0/3122630571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64ac0b4200 0x7f64ac0b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:14.749 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 >> 172.21.2.119:0/3122630571 conn(0x7f64ac05c510 msgr2=0x7f64ac0b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:14.749 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 shutdown_connections 2021-11-15T14:34:14.750 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-15T14:34:14.748+0000 7f64b29b4700 1 -- 172.21.2.119:0/3122630571 wait complete. 2021-11-15T14:34:14.754 INFO:tasks.ceph.osd.0:Restarting daemon 2021-11-15T14:34:14.754 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-11-15T14:34:14.756 INFO:tasks.ceph.osd.0:Started 2021-11-15T14:34:14.757 INFO:tasks.ceph.osd.1:Restarting daemon 2021-11-15T14:34:14.757 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-11-15T14:34:14.759 INFO:tasks.ceph.osd.1:Started 2021-11-15T14:34:14.759 INFO:tasks.ceph.osd.2:Restarting daemon 2021-11-15T14:34:14.759 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-11-15T14:34:14.761 INFO:tasks.ceph.osd.2:Started 2021-11-15T14:34:14.761 INFO:tasks.ceph.osd.3:Restarting daemon 2021-11-15T14:34:14.762 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-11-15T14:34:14.763 INFO:tasks.ceph.osd.3:Started 2021-11-15T14:34:14.764 INFO:tasks.ceph.osd.4:Restarting daemon 2021-11-15T14:34:14.764 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-11-15T14:34:14.766 INFO:tasks.ceph.osd.4:Started 2021-11-15T14:34:14.766 INFO:tasks.ceph.osd.5:Restarting daemon 2021-11-15T14:34:14.767 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-11-15T14:34:14.768 INFO:tasks.ceph.osd.5:Started 2021-11-15T14:34:14.769 INFO:tasks.ceph.osd.6:Restarting daemon 2021-11-15T14:34:14.769 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-11-15T14:34:14.771 INFO:tasks.ceph.osd.6:Started 2021-11-15T14:34:14.772 INFO:tasks.ceph.osd.7:Restarting daemon 2021-11-15T14:34:14.772 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-11-15T14:34:14.774 INFO:tasks.ceph.osd.7:Started 2021-11-15T14:34:14.775 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-15T14:34:15.099 INFO:tasks.ceph.osd.2.gibba035.stderr:2021-11-15T14:34:15.097+0000 7fc26d994d80 -1 Falling back to public interface 2021-11-15T14:34:15.193 INFO:tasks.ceph.osd.6.gibba019.stderr:2021-11-15T14:34:15.192+0000 7f5c8706fd80 -1 Falling back to public interface 2021-11-15T14:34:15.327 INFO:tasks.ceph.osd.3.gibba035.stderr:2021-11-15T14:34:15.325+0000 7fa083732d80 -1 Falling back to public interface 2021-11-15T14:34:15.330 INFO:tasks.ceph.osd.0.gibba035.stderr:2021-11-15T14:34:15.329+0000 7fa47c57ad80 -1 Falling back to public interface 2021-11-15T14:34:15.350 INFO:tasks.ceph.osd.1.gibba035.stderr:2021-11-15T14:34:15.349+0000 7fbf40fe5d80 -1 Falling back to public interface 2021-11-15T14:34:15.369 INFO:tasks.ceph.osd.4.gibba019.stderr:2021-11-15T14:34:15.368+0000 7f92ccc1dd80 -1 Falling back to public interface 2021-11-15T14:34:15.373 INFO:tasks.ceph.osd.5.gibba019.stderr:2021-11-15T14:34:15.372+0000 7f744879fd80 -1 Falling back to public interface 2021-11-15T14:34:15.373 INFO:tasks.ceph.osd.7.gibba019.stderr:2021-11-15T14:34:15.372+0000 7f2b5e1b0d80 -1 Falling back to public interface 2021-11-15T14:34:15.582 DEBUG:teuthology.orchestra.run.gibba035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:15.629 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.625+0000 7fdf1cde2700 1 Processor -- start 2021-11-15T14:34:15.630 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.625+0000 7fdf1cde2700 1 -- start start 2021-11-15T14:34:15.631 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf180b3a20 0x7fdf180b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:15.631 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdf1805c1c0 0x7fdf1814af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:15.631 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180b0ed0 con 0x7fdf1805d1c0 2021-11-15T14:34:15.631 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf180b3e00 con 0x7fdf1805c1c0 2021-11-15T14:34:15.632 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf18067c10 con 0x7fdf180b3a20 2021-11-15T14:34:15.632 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf180b3a20 0x7fdf180b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:15.632 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf180b3a20 0x7fdf180b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54144/0 (socket says 172.21.2.135:54144) 2021-11-15T14:34:15.632 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/1088337775 learned_addr learned my addr 172.21.2.135:0/1088337775 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:15.635 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/1088337775 >> v2:172.21.2.119:3300/0 conn(0x7fdf1805c1c0 msgr2=0x7fdf1814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:15.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- 172.21.2.135:0/1088337775 >> v2:172.21.2.119:3300/0 conn(0x7fdf1805c1c0 0x7fdf1814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/1088337775 >> v1:172.21.2.135:6789/0 conn(0x7fdf1805d1c0 legacy=0x7fdf180ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:15.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/1088337775 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf180b1100 con 0x7fdf180b3a20 2021-11-15T14:34:15.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- 172.21.2.135:0/1088337775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf180b3a20 0x7fdf180b1dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdf08002f70 tx=0x7fdf08006eb0).ready entity=mon.1 client_cookie=2a8525ccecd5832c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:15.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1559a700 1 -- 172.21.2.135:0/1088337775 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf0800d610 con 0x7fdf180b3a20 2021-11-15T14:34:15.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1559a700 1 -- 172.21.2.135:0/1088337775 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf08000e90 con 0x7fdf180b3a20 2021-11-15T14:34:15.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1559a700 1 -- 172.21.2.135:0/1088337775 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf0800d9a0 con 0x7fdf180b3a20 2021-11-15T14:34:15.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- 172.21.2.135:0/1088337775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf180b3a20 msgr2=0x7fdf180b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:15.638 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/1088337775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf180b3a20 0x7fdf180b1dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdf08002f70 tx=0x7fdf08006eb0).stop 2021-11-15T14:34:15.638 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- 172.21.2.135:0/1088337775 shutdown_connections 2021-11-15T14:34:15.638 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/1088337775 >> v2:172.21.2.119:3300/0 conn(0x7fdf1805c1c0 0x7fdf1814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.638 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/1088337775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf180b3a20 0x7fdf180b1dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:15.639 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- 172.21.2.135:0/1088337775 >> 172.21.2.135:0/1088337775 conn(0x7fdf180b7000 msgr2=0x7fdf180b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:15.639 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- 172.21.2.135:0/1088337775 shutdown_connections 2021-11-15T14:34:15.639 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- 172.21.2.135:0/1088337775 wait complete. 2021-11-15T14:34:15.639 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 Processor -- start 2021-11-15T14:34:15.640 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- start start 2021-11-15T14:34:15.640 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:15.640 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf1805d1c0 0x7fdf1814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:15.640 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf180b3a20 0x7fdf1814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:15.640 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1809f4e0 con 0x7fdf1805d1c0 2021-11-15T14:34:15.641 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1809ffd0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.641 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1cde2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18066d50 con 0x7fdf180b3a20 2021-11-15T14:34:15.641 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:15.641 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54148/0 (socket says 172.21.2.135:54148) 2021-11-15T14:34:15.642 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/3934368128 learned_addr learned my addr 172.21.2.135:0/3934368128 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:15.642 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf180b3a20 msgr2=0x7fdf1814a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:15.642 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf180b3a20 0x7fdf1814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.642 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf1805d1c0 msgr2=0x7fdf1814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:15.643 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf1805d1c0 0x7fdf1814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.643 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 -- 172.21.2.135:0/3934368128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0800b1e0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.643 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.629+0000 7fdf1659c700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf18067020 tx=0x7fdf08015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:15.643 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf0800d290 con 0x7fdf1805c1c0 2021-11-15T14:34:15.644 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf08006b60 con 0x7fdf1805c1c0 2021-11-15T14:34:15.644 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf18065da0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.644 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf08011e90 con 0x7fdf1805c1c0 2021-11-15T14:34:15.644 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1814aa00 con 0x7fdf1805c1c0 2021-11-15T14:34:15.644 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7fdf08025030 con 0x7fdf1805c1c0 2021-11-15T14:34:15.645 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fdf0803b5f0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.645 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf180659c0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.645 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.633+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fdf08023020 con 0x7fdf1805c1c0 2021-11-15T14:34:15.674 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf180b13a0 con 0x7fdf1805c1c0 2021-11-15T14:34:15.675 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf077fe700 1 -- 172.21.2.135:0/3934368128 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7fdf08023020 con 0x7fdf1805c1c0 2021-11-15T14:34:15.675 INFO:teuthology.misc.health.gibba035.stdout: 2021-11-15T14:34:15.676 INFO:teuthology.misc.health.gibba035.stdout:{"epoch":10,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:14.747857+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:15.677 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 msgr2=0x7fdf180ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:15.677 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdf18067020 tx=0x7fdf08015000).stop 2021-11-15T14:34:15.677 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 shutdown_connections 2021-11-15T14:34:15.677 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf180b3a20 0x7fdf1814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.678 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf1805d1c0 0x7fdf1814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:15.678 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 --2- 172.21.2.135:0/3934368128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf1805c1c0 0x7fdf180ac790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:15.678 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 >> 172.21.2.135:0/3934368128 conn(0x7fdf180b7000 msgr2=0x7fdf1805fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:15.678 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 shutdown_connections 2021-11-15T14:34:15.679 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:15.673+0000 7fdf1cde2700 1 -- 172.21.2.135:0/3934368128 wait complete. 2021-11-15T14:34:15.682 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-11-15T14:34:16.235 INFO:tasks.ceph.osd.3.gibba035.stderr:2021-11-15T14:34:16.233+0000 7fa083732d80 -1 osd.3 0 log_to_monitors {default=true} 2021-11-15T14:34:16.303 INFO:tasks.ceph.osd.2.gibba035.stderr:2021-11-15T14:34:16.301+0000 7fc26d994d80 -1 osd.2 0 log_to_monitors {default=true} 2021-11-15T14:34:16.388 INFO:tasks.ceph.osd.6.gibba019.stderr:2021-11-15T14:34:16.388+0000 7f5c8706fd80 -1 osd.6 0 log_to_monitors {default=true} 2021-11-15T14:34:16.524 INFO:tasks.ceph.osd.5.gibba019.stderr:2021-11-15T14:34:16.524+0000 7f744879fd80 -1 osd.5 0 log_to_monitors {default=true} 2021-11-15T14:34:16.530 INFO:tasks.ceph.osd.0.gibba035.stderr:2021-11-15T14:34:16.529+0000 7fa47c57ad80 -1 osd.0 0 log_to_monitors {default=true} 2021-11-15T14:34:16.544 INFO:tasks.ceph.osd.1.gibba035.stderr:2021-11-15T14:34:16.541+0000 7fbf40fe5d80 -1 osd.1 0 log_to_monitors {default=true} 2021-11-15T14:34:16.612 INFO:tasks.ceph.osd.4.gibba019.stderr:2021-11-15T14:34:16.613+0000 7f92ccc1dd80 -1 osd.4 0 log_to_monitors {default=true} 2021-11-15T14:34:16.628 INFO:tasks.ceph.osd.7.gibba019.stderr:2021-11-15T14:34:16.629+0000 7f2b5e1b0d80 -1 osd.7 0 log_to_monitors {default=true} 2021-11-15T14:34:18.076 INFO:tasks.ceph.osd.1.gibba035.stderr:2021-11-15T14:34:18.073+0000 7fbf3308c700 -1 osd.1 0 waiting for initial osdmap 2021-11-15T14:34:18.077 INFO:tasks.ceph.osd.5.gibba019.stderr:2021-11-15T14:34:18.077+0000 7f743a846700 -1 osd.5 0 waiting for initial osdmap 2021-11-15T14:34:18.078 INFO:tasks.ceph.osd.7.gibba019.stderr:2021-11-15T14:34:18.077+0000 7f2b50257700 -1 osd.7 0 waiting for initial osdmap 2021-11-15T14:34:18.078 INFO:tasks.ceph.osd.4.gibba019.stderr:2021-11-15T14:34:18.077+0000 7f92becc4700 -1 osd.4 0 waiting for initial osdmap 2021-11-15T14:34:18.079 INFO:tasks.ceph.osd.6.gibba019.stderr:2021-11-15T14:34:18.077+0000 7f5c79116700 -1 osd.6 0 waiting for initial osdmap 2021-11-15T14:34:18.079 INFO:tasks.ceph.osd.3.gibba035.stderr:2021-11-15T14:34:18.073+0000 7fa0757d9700 -1 osd.3 0 waiting for initial osdmap 2021-11-15T14:34:18.080 INFO:tasks.ceph.osd.2.gibba035.stderr:2021-11-15T14:34:18.073+0000 7fc25fa3b700 -1 osd.2 0 waiting for initial osdmap 2021-11-15T14:34:18.080 INFO:tasks.ceph.osd.0.gibba035.stderr:2021-11-15T14:34:18.077+0000 7fa46e621700 -1 osd.0 0 waiting for initial osdmap 2021-11-15T14:34:18.081 INFO:tasks.ceph.osd.6.gibba019.stderr:2021-11-15T14:34:18.081+0000 7f5c80592700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.082 INFO:tasks.ceph.osd.1.gibba035.stderr:2021-11-15T14:34:18.077+0000 7fbf3a508700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.083 INFO:tasks.ceph.osd.3.gibba035.stderr:2021-11-15T14:34:18.081+0000 7fa07cc55700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.083 INFO:tasks.ceph.osd.0.gibba035.stderr:2021-11-15T14:34:18.081+0000 7fa475a9d700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.083 INFO:tasks.ceph.osd.2.gibba035.stderr:2021-11-15T14:34:18.081+0000 7fc266eb7700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.084 INFO:tasks.ceph.osd.5.gibba019.stderr:2021-11-15T14:34:18.081+0000 7f7441cc2700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.084 INFO:tasks.ceph.osd.7.gibba019.stderr:2021-11-15T14:34:18.081+0000 7f2b576d3700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:18.085 INFO:tasks.ceph.osd.4.gibba019.stderr:2021-11-15T14:34:18.085+0000 7f92c6140700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-15T14:34:22.490 DEBUG:teuthology.orchestra.run.gibba035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:22.543 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 Processor -- start 2021-11-15T14:34:22.543 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- start start 2021-11-15T14:34:22.544 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.545 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5ccc05c1c0 0x7f5ccc1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.545 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ccc05c920 0x7f5ccc144740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.545 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0b1770 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.545 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0609e0 con 0x7f5ccc05c920 2021-11-15T14:34:22.545 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0ad780 con 0x7f5ccc060600 2021-11-15T14:34:22.546 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ccc05c920 0x7f5ccc144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.546 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ccc05c920 0x7f5ccc144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54318/0 (socket says 172.21.2.135:54318) 2021-11-15T14:34:22.546 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 -- 172.21.2.135:0/2417668286 learned_addr learned my addr 172.21.2.135:0/2417668286 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:22.546 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 -- 172.21.2.135:0/2417668286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 msgr2=0x7f5ccc1474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:22.547 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 --2- 172.21.2.135:0/2417668286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.547 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 -- 172.21.2.135:0/2417668286 >> v2:172.21.2.119:3300/0 conn(0x7f5ccc05c1c0 msgr2=0x7f5ccc1479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:22.547 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 --2- 172.21.2.135:0/2417668286 >> v2:172.21.2.119:3300/0 conn(0x7f5ccc05c1c0 0x7f5ccc1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.547 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 -- 172.21.2.135:0/2417668286 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc147ed0 con 0x7f5ccc05c920 2021-11-15T14:34:22.550 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5ccb59e700 1 --2- 172.21.2.135:0/2417668286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c920 0x7f5ccc144740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5cc40032f0 tx=0x7f5cc4009290).ready entity=mon.1 client_cookie=bca28949b33f5c13 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.550 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cc9d9b700 1 -- 172.21.2.135:0/2417668286 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc400b870 con 0x7f5ccc05c920 2021-11-15T14:34:22.550 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cc9d9b700 1 -- 172.21.2.135:0/2417668286 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc400b9d0 con 0x7f5ccc05c920 2021-11-15T14:34:22.550 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cc9d9b700 1 -- 172.21.2.135:0/2417668286 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc400bb40 con 0x7f5ccc05c920 2021-11-15T14:34:22.551 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- 172.21.2.135:0/2417668286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c920 msgr2=0x7f5ccc144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.551 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2417668286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c920 0x7f5ccc144740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5cc40032f0 tx=0x7f5cc4009290).stop 2021-11-15T14:34:22.551 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- 172.21.2.135:0/2417668286 shutdown_connections 2021-11-15T14:34:22.551 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2417668286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c920 0x7f5ccc144740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:22.552 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2417668286 >> v2:172.21.2.119:3300/0 conn(0x7f5ccc05c1c0 0x7f5ccc1479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.552 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2417668286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.552 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- 172.21.2.135:0/2417668286 >> 172.21.2.135:0/2417668286 conn(0x7f5ccc0b53c0 msgr2=0x7f5ccc0b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:22.552 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- 172.21.2.135:0/2417668286 shutdown_connections 2021-11-15T14:34:22.552 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.541+0000 7f5cd1103700 1 -- 172.21.2.135:0/2417668286 wait complete. 2021-11-15T14:34:22.553 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 Processor -- start 2021-11-15T14:34:22.553 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- start start 2021-11-15T14:34:22.553 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.553 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ccc05c920 0x7f5ccc156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.553 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.554 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc1568c0 con 0x7f5ccc05c920 2021-11-15T14:34:22.554 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc146160 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.554 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc146390 con 0x7f5ccc060600 2021-11-15T14:34:22.554 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.555 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54326/0 (socket says 172.21.2.135:54326) 2021-11-15T14:34:22.555 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 -- 172.21.2.135:0/2012037075 learned_addr learned my addr 172.21.2.135:0/2012037075 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:22.555 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 -- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 msgr2=0x7f5ccc1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.555 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.555 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 -- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ccc05c920 msgr2=0x7f5ccc156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.556 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ccc05c920 0x7f5ccc156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.556 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 -- 172.21.2.135:0/2012037075 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009530 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.556 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5ccad9d700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5cbc002f70 tx=0x7f5cbc006e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.556 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc00e470 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.556 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00e5d0 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.557 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc00e930 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.557 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc146630 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.557 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc146b70 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.557 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc14abd0 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.558 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5cbc018030 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.558 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 0x7f5ca8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.558 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4896+0+0 (secure 0 0 0) 0x7f5cbc06a960 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.558 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cca59c700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 0x7f5ca8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.558 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.545+0000 7f5cca59c700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 0x7f5ca8055a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5cc0002f70 tx=0x7f5cc00069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.559 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.549+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5cbc042010 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.633 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.629+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ccc0573d0 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.633 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.629+0000 7f5cbbfff700 1 -- 172.21.2.135:0/2012037075 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f5cbc022e30 con 0x7f5ccc05c1c0 2021-11-15T14:34:22.634 INFO:teuthology.misc.health.gibba035.stdout: 2021-11-15T14:34:22.634 INFO:teuthology.misc.health.gibba035.stdout:{"epoch":16,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:21.108605+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:22.635 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 msgr2=0x7f5ca8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.635 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 0x7f5ca8055a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5cc0002f70 tx=0x7f5cc00069e0).stop 2021-11-15T14:34:22.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 msgr2=0x7f5ccc0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5cbc002f70 tx=0x7f5cbc006e50).stop 2021-11-15T14:34:22.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 shutdown_connections 2021-11-15T14:34:22.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ca80535d0 0x7f5ca8055a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:22.636 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ccc060600 0x7f5ccc1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ccc05c920 0x7f5ccc156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 --2- 172.21.2.135:0/2012037075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ccc05c1c0 0x7f5ccc0aec90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:22.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 >> 172.21.2.135:0/2012037075 conn(0x7f5ccc0b53c0 msgr2=0x7f5ccc1439c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:22.637 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 shutdown_connections 2021-11-15T14:34:22.638 INFO:teuthology.misc.health.gibba035.stderr:2021-11-15T14:34:22.633+0000 7f5cd1103700 1 -- 172.21.2.135:0/2012037075 wait complete. 2021-11-15T14:34:22.641 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-11-15T14:34:22.642 INFO:tasks.ceph:Creating RBD pool 2021-11-15T14:34:22.642 DEBUG:teuthology.orchestra.run.gibba035:> sudo ceph --cluster ceph osd pool create rbd 8 2021-11-15T14:34:22.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 Processor -- start 2021-11-15T14:34:22.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 -- start start 2021-11-15T14:34:22.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7be81469d0 0x7f7be81402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7be80b4200 0x7f7be81407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4710 0x7f7be80b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8147590 con 0x7f7be80b4200 2021-11-15T14:34:22.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8143be0 con 0x7f7be81469d0 2021-11-15T14:34:22.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bef3fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8143e80 con 0x7f7be80b4710 2021-11-15T14:34:22.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7be81469d0 0x7f7be81402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7be81469d0 0x7f7be81402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54332/0 (socket says 172.21.2.135:54332) 2021-11-15T14:34:22.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 -- 172.21.2.135:0/3982722606 learned_addr learned my addr 172.21.2.135:0/3982722606 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:22.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 -- 172.21.2.135:0/3982722606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4710 msgr2=0x7f7be80b4f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:22.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 --2- 172.21.2.135:0/3982722606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4710 0x7f7be80b4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 -- 172.21.2.135:0/3982722606 >> v2:172.21.2.119:3300/0 conn(0x7f7be80b4200 msgr2=0x7f7be81407a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:22.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 --2- 172.21.2.135:0/3982722606 >> v2:172.21.2.119:3300/0 conn(0x7f7be80b4200 0x7f7be81407a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 -- 172.21.2.135:0/3982722606 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80b0d10 con 0x7f7be81469d0 2021-11-15T14:34:22.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bed198700 1 --2- 172.21.2.135:0/3982722606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be81402b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7be4002f70 tx=0x7f7be4006eb0).ready entity=mon.1 client_cookie=233a085261090522 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bdbfff700 1 -- 172.21.2.135:0/3982722606 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be400d570 con 0x7f7be81469d0 2021-11-15T14:34:22.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bdbfff700 1 -- 172.21.2.135:0/3982722606 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4000e90 con 0x7f7be81469d0 2021-11-15T14:34:22.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.689+0000 7f7bdbfff700 1 -- 172.21.2.135:0/3982722606 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be400d900 con 0x7f7be81469d0 2021-11-15T14:34:22.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/3982722606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 msgr2=0x7f7be81402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/3982722606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be81402b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7be4002f70 tx=0x7f7be4006eb0).stop 2021-11-15T14:34:22.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/3982722606 shutdown_connections 2021-11-15T14:34:22.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/3982722606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4710 0x7f7be80b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/3982722606 >> v2:172.21.2.119:3300/0 conn(0x7f7be80b4200 0x7f7be81407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/3982722606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be81402b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:22.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/3982722606 >> 172.21.2.135:0/3982722606 conn(0x7f7be805c510 msgr2=0x7f7be805c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:22.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/3982722606 shutdown_connections 2021-11-15T14:34:22.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/3982722606 wait complete. 2021-11-15T14:34:22.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 Processor -- start 2021-11-15T14:34:22.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- start start 2021-11-15T14:34:22.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4200 0x7f7be8144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7be80b4710 0x7f7be80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80af480 con 0x7f7be80b4710 2021-11-15T14:34:22.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80b7610 con 0x7f7be81469d0 2021-11-15T14:34:22.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80b78b0 con 0x7f7be80b4200 2021-11-15T14:34:22.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54340/0 (socket says 172.21.2.135:54340) 2021-11-15T14:34:22.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 -- 172.21.2.135:0/2717972150 learned_addr learned my addr 172.21.2.135:0/2717972150 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:22.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 -- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4200 msgr2=0x7f7be8144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4200 0x7f7be8144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 -- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7be80b4710 msgr2=0x7f7be80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:22.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7be80b4710 0x7f7be80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:22.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 -- 172.21.2.135:0/2717972150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be400b1e0 con 0x7f7be81469d0 2021-11-15T14:34:22.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bed999700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7be0003270 tx=0x7f7be00090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be000d4a0 con 0x7f7be81469d0 2021-11-15T14:34:22.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000d600 con 0x7f7be81469d0 2021-11-15T14:34:22.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be000d960 con 0x7f7be81469d0 2021-11-15T14:34:22.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be80b7b50 con 0x7f7be81469d0 2021-11-15T14:34:22.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be80b9d00 con 0x7f7be81469d0 2021-11-15T14:34:22.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be80573d0 con 0x7f7be81469d0 2021-11-15T14:34:22.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7be0018030 con 0x7f7be81469d0 2021-11-15T14:34:22.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 0x7f7bc8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:22.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.693+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4896+0+0 (secure 0 0 0) 0x7f7be006ae20 con 0x7f7be81469d0 2021-11-15T14:34:22.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.697+0000 7f7bed198700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 0x7f7bc8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:22.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.697+0000 7f7bed198700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 0x7f7bc8055b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7be4002f70 tx=0x7f7be4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:22.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.697+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7be00423c0 con 0x7f7be81469d0 2021-11-15T14:34:22.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:22.777+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7be80b70a0 con 0x7f7be81469d0 2021-11-15T14:34:23.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.529+0000 7f7bda7fc700 1 -- 172.21.2.135:0/2717972150 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7be00459e0 con 0x7f7be81469d0 2021-11-15T14:34:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 msgr2=0x7f7bc8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 0x7f7bc8055b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7be4002f70 tx=0x7f7be4015000).stop 2021-11-15T14:34:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 msgr2=0x7f7be80b9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7be0003270 tx=0x7f7be00090f0).stop 2021-11-15T14:34:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 shutdown_connections 2021-11-15T14:34:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7bc80536a0 0x7f7bc8055b60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7be81469d0 0x7f7be80b9060 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7be80b4710 0x7f7be80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 --2- 172.21.2.135:0/2717972150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7be80b4200 0x7f7be8144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 >> 172.21.2.135:0/2717972150 conn(0x7f7be805c510 msgr2=0x7f7be813e340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 shutdown_connections 2021-11-15T14:34:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.533+0000 7f7bef3fc700 1 -- 172.21.2.135:0/2717972150 wait complete. 2021-11-15T14:34:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'rbd' created 2021-11-15T14:34:23.542 DEBUG:teuthology.orchestra.run.gibba035:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-15T14:34:23.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 Processor -- start 2021-11-15T14:34:23.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- start start 2021-11-15T14:34:23.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b8067380 0x7f52b8143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f52b8143e60 0x7f52b814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b80aac30 con 0x7f52b8060180 2021-11-15T14:34:23.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b8060560 con 0x7f52b8143e60 2021-11-15T14:34:23.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8066f20 con 0x7f52b8067380 2021-11-15T14:34:23.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b7fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f52b8060180 0x7f52b80b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:41934/0 (socket says 172.21.2.135:41934) 2021-11-15T14:34:23.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b7fff700 1 -- 172.21.2.135:0/902418142 learned_addr learned my addr 172.21.2.135:0/902418142 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:23.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166904966 0 0) 0x7f52b80aac30 con 0x7f52b8060180 2021-11-15T14:34:23.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5298003260 con 0x7f52b8060180 2021-11-15T14:34:23.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b77fe700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b8067380 0x7f52b8143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:23.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> v2:172.21.2.119:3300/0 conn(0x7f52b8143e60 0x7f52b814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:23.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2816113373 0 0) 0x7f5298003260 con 0x7f52b8060180 2021-11-15T14:34:23.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b8067380 msgr2=0x7f52b8143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:23.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b8067380 0x7f52b8143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:23.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 >> v2:172.21.2.119:3300/0 conn(0x7f52b8143e60 msgr2=0x7f52b814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:23.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 --2- 172.21.2.135:0/902418142 >> v2:172.21.2.119:3300/0 conn(0x7f52b8143e60 0x7f52b814b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:23.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80b3430 con 0x7f52b8060180 2021-11-15T14:34:23.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f52a0001660 con 0x7f52b8060180 2021-11-15T14:34:23.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> v2:172.21.2.119:3300/0 conn(0x7f52b8143e60 0x7f52b814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:23.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 >> v1:172.21.2.135:6789/0 conn(0x7f52b8060180 legacy=0x7f52b80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52980037d0 0x7f5298003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5298004500 0x7f5298004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f529800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8060560 con 0x7f5298004500 2021-11-15T14:34:23.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8066f20 con 0x7f5298004f90 2021-11-15T14:34:23.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529800be50 con 0x7f52980037d0 2021-11-15T14:34:23.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f529800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:23.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 -- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52980037d0 msgr2=0x7f5298003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:23.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52980037d0 0x7f5298003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 -- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5298004500 msgr2=0x7f5298004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:23.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5298004500 0x7f5298004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 -- 172.21.2.135:0/902418142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298003260 con 0x7f5298004f90 2021-11-15T14:34:23.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f529800b750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f52b0007000 tx=0x7f52b0008040).ready entity=mon.1 client_cookie=1df7d705fcac9a20 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:23.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b000c710 con 0x7f5298004f90 2021-11-15T14:34:23.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000c870 con 0x7f5298004f90 2021-11-15T14:34:23.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52b6ffd700 1 -- 172.21.2.135:0/902418142 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b000c9e0 con 0x7f5298004f90 2021-11-15T14:34:23.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- 172.21.2.135:0/902418142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 msgr2=0x7f529800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 --2- 172.21.2.135:0/902418142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f529800b750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f52b0007000 tx=0x7f52b0008040).stop 2021-11-15T14:34:23.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52bcbfa700 1 -- 172.21.2.135:0/902418142 reap_dead start 2021-11-15T14:34:23.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- 172.21.2.135:0/902418142 shutdown_connections 2021-11-15T14:34:23.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- 172.21.2.135:0/902418142 >> 172.21.2.135:0/902418142 conn(0x7f52b805cfb0 msgr2=0x7f52b805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:23.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- 172.21.2.135:0/902418142 shutdown_connections 2021-11-15T14:34:23.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.593+0000 7f52be65d700 1 -- 172.21.2.135:0/902418142 wait complete. 2021-11-15T14:34:23.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 Processor -- start 2021-11-15T14:34:23.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- start start 2021-11-15T14:34:23.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52b813a340 0x7f52b80ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b80acc10 0x7f52b80ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8063560 con 0x7f52b813a340 2021-11-15T14:34:23.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80af9b0 con 0x7f5298004f90 2021-11-15T14:34:23.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80afc50 con 0x7f52b80acc10 2021-11-15T14:34:23.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:23.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54358/0 (socket says 172.21.2.135:54358) 2021-11-15T14:34:23.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 -- 172.21.2.135:0/1944892029 learned_addr learned my addr 172.21.2.135:0/1944892029 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:23.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 -- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b80acc10 msgr2=0x7f52b80ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b80acc10 0x7f52b80ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 -- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52b813a340 msgr2=0x7f52b80ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:23.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52b813a340 0x7f52b80ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:23.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 -- 172.21.2.135:0/1944892029 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80afef0 con 0x7f5298004f90 2021-11-15T14:34:23.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b7fff700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f52a0001370 tx=0x7f52a0001b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:23.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a0007170 con 0x7f5298004f90 2021-11-15T14:34:23.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a00072d0 con 0x7f5298004f90 2021-11-15T14:34:23.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b814cb00 con 0x7f5298004f90 2021-11-15T14:34:23.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52a0004920 con 0x7f5298004f90 2021-11-15T14:34:23.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b80af630 con 0x7f5298004f90 2021-11-15T14:34:23.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80573d0 con 0x7f5298004f90 2021-11-15T14:34:23.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52a001b070 con 0x7f5298004f90 2021-11-15T14:34:23.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 0x7f529c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:23.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f52a006b070 con 0x7f5298004f90 2021-11-15T14:34:23.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b77fe700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 0x7f529c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:23.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.597+0000 7f52b77fe700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 0x7f529c055b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f52a800a000 tx=0x7f52a8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:23.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.601+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52a0042410 con 0x7f5298004f90 2021-11-15T14:34:23.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:23.681+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f52b80b0080 con 0x7f5298004f90 2021-11-15T14:34:24.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52b57fa700 1 -- 172.21.2.135:0/1944892029 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f52a0001c70 con 0x7f5298004f90 2021-11-15T14:34:24.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 msgr2=0x7f529c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 0x7f529c055b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f52a800a000 tx=0x7f52a8008040).stop 2021-11-15T14:34:24.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 msgr2=0x7f52b8139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f52a0001370 tx=0x7f52a0001b30).stop 2021-11-15T14:34:24.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 shutdown_connections 2021-11-15T14:34:24.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f529c053640 0x7f529c055b00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52b80acc10 0x7f52b80ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52b813a340 0x7f52b80ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 --2- 172.21.2.135:0/1944892029 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5298004f90 0x7f52b8139e50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 >> 172.21.2.135:0/1944892029 conn(0x7f52b805cfb0 msgr2=0x7f52b80b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 shutdown_connections 2021-11-15T14:34:24.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.537+0000 7f52be65d700 1 -- 172.21.2.135:0/1944892029 wait complete. 2021-11-15T14:34:24.544 INFO:teuthology.orchestra.run.gibba035.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-15T14:34:24.548 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-11-15T14:34:24.548 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:34:24.549 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:34:24.550 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:34:24.551 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:34:24.551 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:34:24.553 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:34:24.553 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:34:24.553 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:34:24.555 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:34:24.556 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-11-15T14:34:24.556 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:24.587 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:34:24.589 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:34:24.592 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:34:24.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 Processor -- start 2021-11-15T14:34:24.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- start start 2021-11-15T14:34:24.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f956c0aa1a0 0x7f956c0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0b2b70 con 0x7f956c0b0900 2021-11-15T14:34:24.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c0b27f0 con 0x7f956c0aa1a0 2021-11-15T14:34:24.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0b2da0 con 0x7f956c0b0520 2021-11-15T14:34:24.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f956c0aa1a0 0x7f956c0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f956c0aa1a0 0x7f956c0ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54452/0 (socket says 172.21.2.135:54452) 2021-11-15T14:34:24.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 -- 172.21.2.135:0/3206145135 learned_addr learned my addr 172.21.2.135:0/3206145135 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:24.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 -- 172.21.2.135:0/3206145135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 msgr2=0x7f956c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 --2- 172.21.2.135:0/3206145135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 -- 172.21.2.135:0/3206145135 >> v1:172.21.2.119:6789/0 conn(0x7f956c0b0900 legacy=0x7f956c143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 -- 172.21.2.135:0/3206145135 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0a9bf0 con 0x7f956c0aa1a0 2021-11-15T14:34:24.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95710a5700 1 --2- 172.21.2.135:0/3206145135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0aa1a0 0x7f956c0ae2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f956c0ad450 tx=0x7f955c006eb0).ready entity=mon.1 client_cookie=eb79f2f478971bda server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95708a4700 1 -- 172.21.2.135:0/3206145135 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f955c00d570 con 0x7f956c0aa1a0 2021-11-15T14:34:24.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95708a4700 1 -- 172.21.2.135:0/3206145135 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c000e90 con 0x7f956c0aa1a0 2021-11-15T14:34:24.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f95708a4700 1 -- 172.21.2.135:0/3206145135 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f955c00d8c0 con 0x7f956c0aa1a0 2021-11-15T14:34:24.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- 172.21.2.135:0/3206145135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0aa1a0 msgr2=0x7f956c0ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 --2- 172.21.2.135:0/3206145135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0aa1a0 0x7f956c0ae2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f956c0ad450 tx=0x7f955c006eb0).stop 2021-11-15T14:34:24.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- 172.21.2.135:0/3206145135 shutdown_connections 2021-11-15T14:34:24.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 --2- 172.21.2.135:0/3206145135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0aa1a0 0x7f956c0ae2a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 --2- 172.21.2.135:0/3206145135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.609+0000 7f9573b0a700 1 -- 172.21.2.135:0/3206145135 >> 172.21.2.135:0/3206145135 conn(0x7f956c060840 msgr2=0x7f956c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- 172.21.2.135:0/3206145135 shutdown_connections 2021-11-15T14:34:24.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- 172.21.2.135:0/3206145135 wait complete. 2021-11-15T14:34:24.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 Processor -- start 2021-11-15T14:34:24.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- start start 2021-11-15T14:34:24.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f956c0aa1a0 0x7f956c0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c066350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c153cb0 con 0x7f956c0aa1a0 2021-11-15T14:34:24.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0ae9f0 con 0x7f956c0b0900 2021-11-15T14:34:24.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0654b0 con 0x7f956c0b0520 2021-11-15T14:34:24.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54454/0 (socket says 172.21.2.135:54454) 2021-11-15T14:34:24.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 -- 172.21.2.135:0/2004827704 learned_addr learned my addr 172.21.2.135:0/2004827704 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:24.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95718a6700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f956c0aa1a0 0x7f956c0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95710a5700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c066350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 -- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 msgr2=0x7f956c066350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c066350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 -- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f956c0aa1a0 msgr2=0x7f956c0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f956c0aa1a0 0x7f956c0adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 -- 172.21.2.135:0/2004827704 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c00b1e0 con 0x7f956c0b0900 2021-11-15T14:34:24.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95720a7700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f956c064260 tx=0x7f95640090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956400e470 con 0x7f956c0b0900 2021-11-15T14:34:24.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956400e5d0 con 0x7f956c0b0900 2021-11-15T14:34:24.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c152d70 con 0x7f956c0b0900 2021-11-15T14:34:24.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956400e930 con 0x7f956c0b0900 2021-11-15T14:34:24.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c065210 con 0x7f956c0b0900 2021-11-15T14:34:24.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c0644e0 con 0x7f956c0b0900 2021-11-15T14:34:24.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9564018030 con 0x7f956c0b0900 2021-11-15T14:34:24.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 0x7f9554055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f956406acf0 con 0x7f956c0b0900 2021-11-15T14:34:24.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95718a6700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 0x7f9554055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.613+0000 7f95718a6700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 0x7f9554055ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f956800c000 tx=0x7f9568008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.617+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9564042230 con 0x7f956c0b0900 2021-11-15T14:34:24.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956c0573d0 con 0x7f956c0b0900 2021-11-15T14:34:24.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9562ffd700 1 -- 172.21.2.135:0/2004827704 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f95640233a0 con 0x7f956c0b0900 2021-11-15T14:34:24.708 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:24.708 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":18,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:24.530043+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:24.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 msgr2=0x7f9554055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 0x7f9554055ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f956800c000 tx=0x7f9568008040).stop 2021-11-15T14:34:24.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 msgr2=0x7f956c13f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f956c064260 tx=0x7f95640090f0).stop 2021-11-15T14:34:24.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 shutdown_connections 2021-11-15T14:34:24.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9554053610 0x7f9554055ad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f956c0b0900 0x7f956c13f610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f956c0b0520 0x7f956c066350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 --2- 172.21.2.135:0/2004827704 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f956c0aa1a0 0x7f956c0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 >> 172.21.2.135:0/2004827704 conn(0x7f956c060840 msgr2=0x7f956c140970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 shutdown_connections 2021-11-15T14:34:24.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.705+0000 7f9573b0a700 1 -- 172.21.2.135:0/2004827704 wait complete. 2021-11-15T14:34:24.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:34:24.716 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:24.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 Processor -- start 2021-11-15T14:34:24.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- start start 2021-11-15T14:34:24.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f08a80b0630 0x7f08a80b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a81439a0 con 0x7f08a80b3790 2021-11-15T14:34:24.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8143c40 con 0x7f08a80a9c90 2021-11-15T14:34:24.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a8143ee0 con 0x7f08a80b0630 2021-11-15T14:34:24.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f08a80a9c90 0x7f08a80b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42054/0 (socket says 172.21.2.135:42054) 2021-11-15T14:34:24.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a77fe700 1 -- 172.21.2.135:0/2255731150 learned_addr learned my addr 172.21.2.135:0/2255731150 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:24.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590039529 0 0) 0x7f08a8143c40 con 0x7f08a80a9c90 2021-11-15T14:34:24.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0888003260 con 0x7f08a80a9c90 2021-11-15T14:34:24.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a6ffd700 1 --2- 172.21.2.135:0/2255731150 >> v2:172.21.2.119:3300/0 conn(0x7f08a80b0630 0x7f08a80b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502606258 0 0) 0x7f0888003260 con 0x7f08a80a9c90 2021-11-15T14:34:24.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 >> v2:172.21.2.119:3300/0 conn(0x7f08a80b0630 msgr2=0x7f08a80b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 --2- 172.21.2.135:0/2255731150 >> v2:172.21.2.119:3300/0 conn(0x7f08a80b0630 0x7f08a80b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 >> v1:172.21.2.119:6789/0 conn(0x7f08a80b3790 legacy=0x7f08a813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8144180 con 0x7f08a80a9c90 2021-11-15T14:34:24.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f08a00019e0 con 0x7f08a80a9c90 2021-11-15T14:34:24.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 >> v1:172.21.2.135:6789/0 conn(0x7f08a80a9c90 legacy=0x7f08a80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888003820 0x7f0888003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 0x7f0888004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0888004f70 0x7f088800d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8143ee0 con 0x7f0888004f70 2021-11-15T14:34:24.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888009770 con 0x7f0888004500 2021-11-15T14:34:24.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0888009930 con 0x7f0888003820 2021-11-15T14:34:24.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 0x7f0888004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a6ffd700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888003820 0x7f0888003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 -- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888003820 msgr2=0x7f0888003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888003820 0x7f0888003c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 -- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0888004f70 msgr2=0x7f088800d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0888004f70 0x7f088800d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 -- 172.21.2.135:0/2255731150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888003260 con 0x7f0888004500 2021-11-15T14:34:24.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a77fe700 1 -- 172.21.2.135:0/2255731150 reap_dead start 2021-11-15T14:34:24.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a67fc700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 0x7f0888004980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0898001fa0 tx=0x7f0898007a00).ready entity=mon.1 client_cookie=fa055e1904b7d0d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0898007030 con 0x7f0888004500 2021-11-15T14:34:24.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898002e90 con 0x7f0888004500 2021-11-15T14:34:24.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08a5ffb700 1 -- 172.21.2.135:0/2255731150 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0898007380 con 0x7f0888004500 2021-11-15T14:34:24.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 msgr2=0x7f0888004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 0x7f0888004980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0898001fa0 tx=0x7f0898007a00).stop 2021-11-15T14:34:24.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2255731150 shutdown_connections 2021-11-15T14:34:24.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2255731150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0888004500 0x7f0888004980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2255731150 >> 172.21.2.135:0/2255731150 conn(0x7f08a8060840 msgr2=0x7f08a8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2255731150 shutdown_connections 2021-11-15T14:34:24.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.825+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2255731150 wait complete. 2021-11-15T14:34:24.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 Processor -- start 2021-11-15T14:34:24.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- start start 2021-11-15T14:34:24.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888004500 0x7f08a8063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a8064340 0x7f08a8140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a814f1c0 con 0x7f08a8064340 2021-11-15T14:34:24.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80aa9d0 con 0x7f08a813df30 2021-11-15T14:34:24.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a814ed90 con 0x7f0888004500 2021-11-15T14:34:24.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54476/0 (socket says 172.21.2.135:54476) 2021-11-15T14:34:24.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 -- 172.21.2.135:0/2296657058 learned_addr learned my addr 172.21.2.135:0/2296657058 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:24.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 -- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888004500 msgr2=0x7f08a8063950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888004500 0x7f08a8063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 -- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a8064340 msgr2=0x7f08a8140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a8064340 0x7f08a8140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 -- 172.21.2.135:0/2296657058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8067680 con 0x7f08a813df30 2021-11-15T14:34:24.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a77fe700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08a81435a0 tx=0x7f08a8143dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a0004ab0 con 0x7f08a813df30 2021-11-15T14:34:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0004c10 con 0x7f08a813df30 2021-11-15T14:34:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a8063e40 con 0x7f08a813df30 2021-11-15T14:34:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a00070d0 con 0x7f08a813df30 2021-11-15T14:34:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a8067920 con 0x7f08a813df30 2021-11-15T14:34:24.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08a001a070 con 0x7f08a813df30 2021-11-15T14:34:24.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a80aa740 con 0x7f08a813df30 2021-11-15T14:34:24.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 0x7f088c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f08a006a930 con 0x7f08a813df30 2021-11-15T14:34:24.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.829+0000 7f08a6ffd700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 0x7f088c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.833+0000 7f08a6ffd700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 0x7f088c0559b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0890008000 tx=0x7f0890008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.833+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08a0041dc0 con 0x7f08a813df30 2021-11-15T14:34:24.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f08a8143620 con 0x7f08a813df30 2021-11-15T14:34:24.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f089ffff700 1 -- 172.21.2.135:0/2296657058 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f08a00453e0 con 0x7f08a813df30 2021-11-15T14:34:24.923 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:24.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 msgr2=0x7f088c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 0x7f088c0559b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0890008000 tx=0x7f0890008040).stop 2021-11-15T14:34:24.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 msgr2=0x7f08a813e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08a81435a0 tx=0x7f08a8143dd0).stop 2021-11-15T14:34:24.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 shutdown_connections 2021-11-15T14:34:24.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f088c0534f0 0x7f088c0559b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08a813df30 0x7f08a813e3b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a8064340 0x7f08a8140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 --2- 172.21.2.135:0/2296657058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0888004500 0x7f08a8063950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 >> 172.21.2.135:0/2296657058 conn(0x7f08a8060840 msgr2=0x7f08a80b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 shutdown_connections 2021-11-15T14:34:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.921+0000 7f08ad5d6700 1 -- 172.21.2.135:0/2296657058 wait complete. 2021-11-15T14:34:24.930 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:24.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.977+0000 7f4096c06700 1 Processor -- start 2021-11-15T14:34:24.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.977+0000 7f4096c06700 1 -- start start 2021-11-15T14:34:24.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f40900a99e0 0x7f40900b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900ac2e0 0x7f40900ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900b1ce0 con 0x7f40900b0740 2021-11-15T14:34:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900a9dc0 con 0x7f40900a99e0 2021-11-15T14:34:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b29c0 con 0x7f40900ac2e0 2021-11-15T14:34:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f40900a99e0 0x7f40900b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f40900a99e0 0x7f40900b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54482/0 (socket says 172.21.2.135:54482) 2021-11-15T14:34:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 -- 172.21.2.135:0/4116867440 learned_addr learned my addr 172.21.2.135:0/4116867440 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900ac2e0 0x7f40900ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 -- 172.21.2.135:0/4116867440 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900ac2e0 msgr2=0x7f40900ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900ac2e0 0x7f40900ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 -- 172.21.2.135:0/4116867440 >> v1:172.21.2.119:6789/0 conn(0x7f40900b0740 legacy=0x7f40900aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 -- 172.21.2.135:0/4116867440 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900b0140 con 0x7f40900a99e0 2021-11-15T14:34:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f40949a2700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900a99e0 0x7f40900b17f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f40900b0480 tx=0x7f4080006eb0).ready entity=mon.1 client_cookie=c761cd40ae51fb7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408f7fe700 1 -- 172.21.2.135:0/4116867440 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408000d570 con 0x7f40900a99e0 2021-11-15T14:34:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408f7fe700 1 -- 172.21.2.135:0/4116867440 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080000e90 con 0x7f40900a99e0 2021-11-15T14:34:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408f7fe700 1 -- 172.21.2.135:0/4116867440 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408000d8c0 con 0x7f40900a99e0 2021-11-15T14:34:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/4116867440 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900a99e0 msgr2=0x7f40900b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900a99e0 0x7f40900b17f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f40900b0480 tx=0x7f4080006eb0).stop 2021-11-15T14:34:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/4116867440 shutdown_connections 2021-11-15T14:34:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900ac2e0 0x7f40900ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- 172.21.2.135:0/4116867440 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900a99e0 0x7f40900b17f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:24.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/4116867440 >> 172.21.2.135:0/4116867440 conn(0x7f409005f730 msgr2=0x7f409005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:24.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/4116867440 shutdown_connections 2021-11-15T14:34:24.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/4116867440 wait complete. 2021-11-15T14:34:24.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 Processor -- start 2021-11-15T14:34:24.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- start start 2021-11-15T14:34:24.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40900a99e0 0x7f40900b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900b0740 0x7f409013c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900648f0 con 0x7f40900a99e0 2021-11-15T14:34:24.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4090143ee0 con 0x7f40900ac2e0 2021-11-15T14:34:24.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4090064660 con 0x7f40900b0740 2021-11-15T14:34:24.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54490/0 (socket says 172.21.2.135:54490) 2021-11-15T14:34:24.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 -- 172.21.2.135:0/217672788 learned_addr learned my addr 172.21.2.135:0/217672788 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:24.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 -- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900b0740 msgr2=0x7f409013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900b0740 0x7f409013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 -- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40900a99e0 msgr2=0x7f40900b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:24.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40900a99e0 0x7f40900b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:24.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 -- 172.21.2.135:0/217672788 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408000b1e0 con 0x7f40900ac2e0 2021-11-15T14:34:24.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408ffff700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4078007000 tx=0x7f4078008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078010580 con 0x7f40900ac2e0 2021-11-15T14:34:24.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780106e0 con 0x7f40900ac2e0 2021-11-15T14:34:24.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078010a40 con 0x7f40900ac2e0 2021-11-15T14:34:24.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.981+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090065350 con 0x7f40900ac2e0 2021-11-15T14:34:24.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4090065890 con 0x7f40900ac2e0 2021-11-15T14:34:24.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40900573d0 con 0x7f40900ac2e0 2021-11-15T14:34:24.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4078010ba0 con 0x7f40900ac2e0 2021-11-15T14:34:24.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f408dffb700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 0x7f4074055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:24.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f407806b7a0 con 0x7f40900ac2e0 2021-11-15T14:34:24.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f40949a2700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 0x7f4074055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:24.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f40949a2700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 0x7f4074055b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f40900b0480 tx=0x7f4080015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:24.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:24.985+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4078042c30 con 0x7f40900ac2e0 2021-11-15T14:34:25.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4090067d20 con 0x7f40900ac2e0 2021-11-15T14:34:25.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f408dffb700 1 -- 172.21.2.135:0/217672788 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4078046250 con 0x7f40900ac2e0 2021-11-15T14:34:25.072 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:25.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 msgr2=0x7f4074055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 0x7f4074055b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f40900b0480 tx=0x7f4080015000).stop 2021-11-15T14:34:25.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 msgr2=0x7f4090064170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4078007000 tx=0x7f4078008040).stop 2021-11-15T14:34:25.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 shutdown_connections 2021-11-15T14:34:25.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4074053640 0x7f4074055b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40900b0740 0x7f409013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40900ac2e0 0x7f4090064170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 --2- 172.21.2.135:0/217672788 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40900a99e0 0x7f40900b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 >> 172.21.2.135:0/217672788 conn(0x7f409005f730 msgr2=0x7f40901426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 shutdown_connections 2021-11-15T14:34:25.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.069+0000 7f4096c06700 1 -- 172.21.2.135:0/217672788 wait complete. 2021-11-15T14:34:25.079 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:34:25.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 Processor -- start 2021-11-15T14:34:25.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 -- start start 2021-11-15T14:34:25.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f73080b6600 0x7f73080b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73080b4440 0x7f73080b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7308144130 con 0x7f7308061db0 2021-11-15T14:34:25.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080b6ed0 con 0x7f73080b6600 2021-11-15T14:34:25.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730fc72700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7308143bf0 con 0x7f73080b4440 2021-11-15T14:34:25.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730e20f700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7308061db0 0x7f7308146740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42084/0 (socket says 172.21.2.135:42084) 2021-11-15T14:34:25.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730e20f700 1 -- 172.21.2.135:0/2042360900 learned_addr learned my addr 172.21.2.135:0/2042360900 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:25.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882869811 0 0) 0x7f7308144130 con 0x7f7308061db0 2021-11-15T14:34:25.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.125+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f0003260 con 0x7f7308061db0 2021-11-15T14:34:25.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284709375 0 0) 0x7f72f0003260 con 0x7f7308061db0 2021-11-15T14:34:25.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73080b4440 msgr2=0x7f73080b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73080b4440 0x7f73080b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 >> v2:172.21.2.119:3300/0 conn(0x7f73080b6600 msgr2=0x7f73080b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 --2- 172.21.2.135:0/2042360900 >> v2:172.21.2.119:3300/0 conn(0x7f73080b6600 0x7f73080b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308143e90 con 0x7f7308061db0 2021-11-15T14:34:25.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f73000019e0 con 0x7f7308061db0 2021-11-15T14:34:25.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 >> v1:172.21.2.135:6789/0 conn(0x7f7308061db0 legacy=0x7f7308146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72f00037d0 0x7f72f0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72f0004500 0x7f72f0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72f0005070 0x7f72f000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080b6ed0 con 0x7f72f00037d0 2021-11-15T14:34:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308143bf0 con 0x7f72f0005070 2021-11-15T14:34:25.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f000bf00 con 0x7f72f0004500 2021-11-15T14:34:25.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72f0005070 0x7f72f000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 -- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72f0004500 msgr2=0x7f72f0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72f0004500 0x7f72f0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72f00037d0 0x7f72f0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 -- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72f00037d0 msgr2=0x7f72f0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72f00037d0 0x7f72f0003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 -- 172.21.2.135:0/2042360900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0003260 con 0x7f72f0005070 2021-11-15T14:34:25.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72f0005070 0x7f72f000b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f73000016f0 tx=0x7f73080b7010).ready entity=mon.1 client_cookie=8f44a13188554b4f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730000cc70 con 0x7f72f0005070 2021-11-15T14:34:25.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000cdd0 con 0x7f72f0005070 2021-11-15T14:34:25.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730ca0c700 1 -- 172.21.2.135:0/2042360900 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7300005b80 con 0x7f72f0005070 2021-11-15T14:34:25.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/2042360900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72f0005070 msgr2=0x7f72f000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 --2- 172.21.2.135:0/2042360900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72f0005070 0x7f72f000b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f73000016f0 tx=0x7f73080b7010).stop 2021-11-15T14:34:25.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730e20f700 1 -- 172.21.2.135:0/2042360900 reap_dead start 2021-11-15T14:34:25.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/2042360900 shutdown_connections 2021-11-15T14:34:25.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/2042360900 >> 172.21.2.135:0/2042360900 conn(0x7f730805c510 msgr2=0x7f730805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/2042360900 shutdown_connections 2021-11-15T14:34:25.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/2042360900 wait complete. 2021-11-15T14:34:25.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 Processor -- start 2021-11-15T14:34:25.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- start start 2021-11-15T14:34:25.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73080b2920 0x7f7308156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7308157100 0x7f7308147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308156860 con 0x7f73080b2920 2021-11-15T14:34:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730815ad10 con 0x7f730812a7b0 2021-11-15T14:34:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730812ab90 con 0x7f7308157100 2021-11-15T14:34:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54512/0 (socket says 172.21.2.135:54512) 2021-11-15T14:34:25.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 -- 172.21.2.135:0/1323326826 learned_addr learned my addr 172.21.2.135:0/1323326826 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:25.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 -- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7308157100 msgr2=0x7f7308147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7308157100 0x7f7308147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 -- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73080b2920 msgr2=0x7f7308156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73080b2920 0x7f7308156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 -- 172.21.2.135:0/1323326826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730815a2a0 con 0x7f730812a7b0 2021-11-15T14:34:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730da0e700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f72fc007000 tx=0x7f72fc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72fc00e440 con 0x7f730812a7b0 2021-11-15T14:34:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00c030 con 0x7f730812a7b0 2021-11-15T14:34:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72fc00e790 con 0x7f730812a7b0 2021-11-15T14:34:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730815a530 con 0x7f730812a7b0 2021-11-15T14:34:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.129+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730815aa70 con 0x7f730812a7b0 2021-11-15T14:34:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73081569b0 con 0x7f730812a7b0 2021-11-15T14:34:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72fc00e8f0 con 0x7f730812a7b0 2021-11-15T14:34:25.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f72faffd700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 0x7f72e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f72fc06b820 con 0x7f730812a7b0 2021-11-15T14:34:25.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f730d20d700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 0x7f72e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f730d20d700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 0x7f72e8055b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7304000b60 tx=0x7f7304006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.133+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72fc042ba0 con 0x7f730812a7b0 2021-11-15T14:34:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.217+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7308061670 con 0x7f730812a7b0 2021-11-15T14:34:25.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.217+0000 7f72faffd700 1 -- 172.21.2.135:0/1323326826 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f72fc0461c0 con 0x7f730812a7b0 2021-11-15T14:34:25.222 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:25.222 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:34:25.223 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:25.223 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:34:25.223 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:34:25.223 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:25.223 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:25.224 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:34:25.224 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:34:25.224 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:25.224 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:34:25.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 msgr2=0x7f72e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 0x7f72e8055b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7304000b60 tx=0x7f7304006a00).stop 2021-11-15T14:34:25.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 msgr2=0x7f7308159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f72fc007000 tx=0x7f72fc008040).stop 2021-11-15T14:34:25.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 shutdown_connections 2021-11-15T14:34:25.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72e80536a0 0x7f72e8055b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7308157100 0x7f7308147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73080b2920 0x7f7308156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 --2- 172.21.2.135:0/1323326826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f730812a7b0 0x7f7308159db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 >> 172.21.2.135:0/1323326826 conn(0x7f730805c510 msgr2=0x7f7308129800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 shutdown_connections 2021-11-15T14:34:25.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.221+0000 7f730fc72700 1 -- 172.21.2.135:0/1323326826 wait complete. 2021-11-15T14:34:25.229 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:34:25.229 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:34:25.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 Processor -- start 2021-11-15T14:34:25.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 -- start start 2021-11-15T14:34:25.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3b580b1350 0x7f3b580b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b580b2320 0x7f3b581412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580a7850 con 0x7f3b580b1f40 2021-11-15T14:34:25.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580b17c0 con 0x7f3b580b1350 2021-11-15T14:34:25.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5f3b9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580b06d0 con 0x7f3b580b2320 2021-11-15T14:34:25.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b580b2320 0x7f3b581412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b580b2320 0x7f3b581412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54516/0 (socket says 172.21.2.135:54516) 2021-11-15T14:34:25.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 -- 172.21.2.135:0/1100208594 learned_addr learned my addr 172.21.2.135:0/1100208594 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:25.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 -- 172.21.2.135:0/1100208594 >> v2:172.21.2.119:3300/0 conn(0x7f3b580b1350 msgr2=0x7f3b580b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 --2- 172.21.2.135:0/1100208594 >> v2:172.21.2.119:3300/0 conn(0x7f3b580b1350 0x7f3b580b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 -- 172.21.2.135:0/1100208594 >> v1:172.21.2.119:6789/0 conn(0x7f3b580b1f40 legacy=0x7f3b580a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 -- 172.21.2.135:0/1100208594 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580b0970 con 0x7f3b580b2320 2021-11-15T14:34:25.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b5d956700 1 --2- 172.21.2.135:0/1100208594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b581412d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3b580ad350 tx=0x7f3b50009290).ready entity=mon.1 client_cookie=2393f02d7cab5d72 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b47fff700 1 -- 172.21.2.135:0/1100208594 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5000b830 con 0x7f3b580b2320 2021-11-15T14:34:25.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b47fff700 1 -- 172.21.2.135:0/1100208594 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000b990 con 0x7f3b580b2320 2021-11-15T14:34:25.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.277+0000 7f3b47fff700 1 -- 172.21.2.135:0/1100208594 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5000bb40 con 0x7f3b580b2320 2021-11-15T14:34:25.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/1100208594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 msgr2=0x7f3b581412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/1100208594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b581412d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3b580ad350 tx=0x7f3b50009290).stop 2021-11-15T14:34:25.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/1100208594 shutdown_connections 2021-11-15T14:34:25.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/1100208594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b581412d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/1100208594 >> v2:172.21.2.119:3300/0 conn(0x7f3b580b1350 0x7f3b580b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/1100208594 >> 172.21.2.135:0/1100208594 conn(0x7f3b5805f730 msgr2=0x7f3b5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/1100208594 shutdown_connections 2021-11-15T14:34:25.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/1100208594 wait complete. 2021-11-15T14:34:25.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 Processor -- start 2021-11-15T14:34:25.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- start start 2021-11-15T14:34:25.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b580b1350 0x7f3b58148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b580b1f40 0x7f3b580aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5814b240 con 0x7f3b580b1f40 2021-11-15T14:34:25.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580afff0 con 0x7f3b580b2320 2021-11-15T14:34:25.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580ae680 con 0x7f3b580b1350 2021-11-15T14:34:25.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54522/0 (socket says 172.21.2.135:54522) 2021-11-15T14:34:25.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 -- 172.21.2.135:0/704901442 learned_addr learned my addr 172.21.2.135:0/704901442 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:25.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 -- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b580b1350 msgr2=0x7f3b58148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b580b1350 0x7f3b58148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 -- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b580b1f40 msgr2=0x7f3b580aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b580b1f40 0x7f3b580aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 -- 172.21.2.135:0/704901442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009530 con 0x7f3b580b2320 2021-11-15T14:34:25.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5d956700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3b580ad350 tx=0x7f3b50016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5000bdb0 con 0x7f3b580b2320 2021-11-15T14:34:25.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50020430 con 0x7f3b580b2320 2021-11-15T14:34:25.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580ae920 con 0x7f3b580b2320 2021-11-15T14:34:25.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580abbd0 con 0x7f3b580b2320 2021-11-15T14:34:25.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b50020790 con 0x7f3b580b2320 2021-11-15T14:34:25.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b580aeab0 con 0x7f3b580b2320 2021-11-15T14:34:25.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b5000f070 con 0x7f3b580b2320 2021-11-15T14:34:25.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 0x7f3b38055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.281+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3b5006c5c0 con 0x7f3b580b2320 2021-11-15T14:34:25.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.285+0000 7f3b5d155700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 0x7f3b38055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.285+0000 7f3b5d155700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 0x7f3b38055b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b48002f90 tx=0x7f3b480069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.285+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b50043980 con 0x7f3b580b2320 2021-11-15T14:34:25.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.369+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3b580573d0 con 0x7f3b580b2320 2021-11-15T14:34:25.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.553+0000 7f3b467fc700 1 -- 172.21.2.135:0/704901442 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3b50015030 con 0x7f3b580b2320 2021-11-15T14:34:25.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.553+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 msgr2=0x7f3b38055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.553+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 0x7f3b38055b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b48002f90 tx=0x7f3b480069b0).stop 2021-11-15T14:34:25.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.553+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 msgr2=0x7f3b58139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.553+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3b580ad350 tx=0x7f3b50016000).stop 2021-11-15T14:34:25.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 shutdown_connections 2021-11-15T14:34:25.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b38053660 0x7f3b38055b20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b580b2320 0x7f3b58139960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b580b1f40 0x7f3b580aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 --2- 172.21.2.135:0/704901442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b580b1350 0x7f3b58148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 >> 172.21.2.135:0/704901442 conn(0x7f3b5805f730 msgr2=0x7f3b580b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 shutdown_connections 2021-11-15T14:34:25.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.557+0000 7f3b5f3b9700 1 -- 172.21.2.135:0/704901442 wait complete. 2021-11-15T14:34:25.561 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:34:25.564 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-11-15T14:34:25.565 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-11-15T14:34:25.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 Processor -- start 2021-11-15T14:34:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- start start 2021-11-15T14:34:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f97f4060180 0x7f97f40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f97f40b4cc0 0x7f97f414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40aac30 con 0x7f97f4067380 2021-11-15T14:34:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f4060560 con 0x7f97f40b4cc0 2021-11-15T14:34:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f4066f20 con 0x7f97f4060180 2021-11-15T14:34:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f97f4060180 0x7f97f40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f97f4060180 0x7f97f40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54530/0 (socket says 172.21.2.135:54530) 2021-11-15T14:34:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 -- 172.21.2.135:0/4261769369 learned_addr learned my addr 172.21.2.135:0/4261769369 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 -- 172.21.2.135:0/4261769369 >> v2:172.21.2.119:3300/0 conn(0x7f97f40b4cc0 msgr2=0x7f97f414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 --2- 172.21.2.135:0/4261769369 >> v2:172.21.2.119:3300/0 conn(0x7f97f40b4cc0 0x7f97f414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 -- 172.21.2.135:0/4261769369 >> v1:172.21.2.119:6789/0 conn(0x7f97f4067380 legacy=0x7f97f4143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:25.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 -- 172.21.2.135:0/4261769369 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40b3430 con 0x7f97f4060180 2021-11-15T14:34:25.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f2ffd700 1 --2- 172.21.2.135:0/4261769369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f4060180 0x7f97f40b47d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f97f405f260 tx=0x7f97e4006eb0).ready entity=mon.1 client_cookie=5c657afb2345a493 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f1ffb700 1 -- 172.21.2.135:0/4261769369 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e400d5c0 con 0x7f97f4060180 2021-11-15T14:34:25.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f1ffb700 1 -- 172.21.2.135:0/4261769369 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4000e90 con 0x7f97f4060180 2021-11-15T14:34:25.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f1ffb700 1 -- 172.21.2.135:0/4261769369 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e400d910 con 0x7f97f4060180 2021-11-15T14:34:25.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- 172.21.2.135:0/4261769369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f4060180 msgr2=0x7f97f40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 --2- 172.21.2.135:0/4261769369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f4060180 0x7f97f40b47d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f97f405f260 tx=0x7f97e4006eb0).stop 2021-11-15T14:34:25.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- 172.21.2.135:0/4261769369 shutdown_connections 2021-11-15T14:34:25.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 --2- 172.21.2.135:0/4261769369 >> v2:172.21.2.119:3300/0 conn(0x7f97f40b4cc0 0x7f97f414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 --2- 172.21.2.135:0/4261769369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f4060180 0x7f97f40b47d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:25.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- 172.21.2.135:0/4261769369 >> 172.21.2.135:0/4261769369 conn(0x7f97f405cfb0 msgr2=0x7f97f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:25.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- 172.21.2.135:0/4261769369 shutdown_connections 2021-11-15T14:34:25.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.625+0000 7f97f9294700 1 -- 172.21.2.135:0/4261769369 wait complete. 2021-11-15T14:34:25.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 Processor -- start 2021-11-15T14:34:25.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- start start 2021-11-15T14:34:25.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97f4060180 0x7f97f4060840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97f4067380 0x7f97f40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40b7170 con 0x7f97f4060180 2021-11-15T14:34:25.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4061f60 con 0x7f97f40b4cc0 2021-11-15T14:34:25.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4062200 con 0x7f97f4067380 2021-11-15T14:34:25.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54540/0 (socket says 172.21.2.135:54540) 2021-11-15T14:34:25.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 -- 172.21.2.135:0/2398534334 learned_addr learned my addr 172.21.2.135:0/2398534334 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:25.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 -- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97f4067380 msgr2=0x7f97f40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97f4067380 0x7f97f40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 -- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97f4060180 msgr2=0x7f97f4060840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:25.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97f4060180 0x7f97f4060840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:25.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 -- 172.21.2.135:0/2398534334 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e400b1e0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f37fe700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f97ec0032f0 tx=0x7f97ec0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97ec00d4a0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00d600 con 0x7f97f40b4cc0 2021-11-15T14:34:25.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f4152ac0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97ec00d960 con 0x7f97f40b4cc0 2021-11-15T14:34:25.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f4061be0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f4152c50 con 0x7f97f40b4cc0 2021-11-15T14:34:25.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97ec018030 con 0x7f97f40b4cc0 2021-11-15T14:34:25.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 0x7f97d8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:25.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5603+0+0 (secure 0 0 0) 0x7f97ec06b0d0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.629+0000 7f97f2ffd700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 0x7f97d8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:25.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.633+0000 7f97f2ffd700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 0x7f97d8055b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f97f405f260 tx=0x7f97e4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:25.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.633+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97ec0424b0 con 0x7f97f40b4cc0 2021-11-15T14:34:25.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:25.721+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f97f40573d0 con 0x7f97f40b4cc0 2021-11-15T14:34:26.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.565+0000 7f97ebfff700 1 -- 172.21.2.135:0/2398534334 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7f97ec045ad0 con 0x7f97f40b4cc0 2021-11-15T14:34:26.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 msgr2=0x7f97d8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 0x7f97d8055b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f97f405f260 tx=0x7f97e4015000).stop 2021-11-15T14:34:26.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 msgr2=0x7f97f4152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f97ec0032f0 tx=0x7f97ec0091a0).stop 2021-11-15T14:34:26.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 shutdown_connections 2021-11-15T14:34:26.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97d8053660 0x7f97d8055b20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:26.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97f40b4cc0 0x7f97f4152f60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:26.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97f4067380 0x7f97f40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:26.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 --2- 172.21.2.135:0/2398534334 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97f4060180 0x7f97f4060840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:26.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 >> 172.21.2.135:0/2398534334 conn(0x7f97f405cfb0 msgr2=0x7f97f4144830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:26.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 shutdown_connections 2021-11-15T14:34:26.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.569+0000 7f97f9294700 1 -- 172.21.2.135:0/2398534334 wait complete. 2021-11-15T14:34:26.578 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-11-15T14:34:26.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.625+0000 7f06ce573700 1 Processor -- start 2021-11-15T14:34:26.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.625+0000 7f06ce573700 1 -- start start 2021-11-15T14:34:26.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f06c80b9760 0x7f06c80aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f06c8140070 0x7f06c8140500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c8067580 con 0x7f06c80671a0 2021-11-15T14:34:26.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8143100 con 0x7f06c80b9760 2021-11-15T14:34:26.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80af550 con 0x7f06c8140070 2021-11-15T14:34:26.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c7fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f06c80671a0 0x7f06c8143a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42132/0 (socket says 172.21.2.135:42132) 2021-11-15T14:34:26.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c7fff700 1 -- 172.21.2.135:0/1304812764 learned_addr learned my addr 172.21.2.135:0/1304812764 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:26.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- 172.21.2.135:0/1304812764 >> v2:172.21.2.135:3300/0 conn(0x7f06c8140070 0x7f06c8140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:26.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c77fe700 1 --2- 172.21.2.135:0/1304812764 >> v2:172.21.2.119:3300/0 conn(0x7f06c80b9760 0x7f06c80aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:26.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c6ffd700 1 -- 172.21.2.135:0/1304812764 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118474355 0 0) 0x7f06c8067580 con 0x7f06c80671a0 2021-11-15T14:34:26.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c6ffd700 1 -- 172.21.2.135:0/1304812764 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003260 con 0x7f06c80671a0 2021-11-15T14:34:26.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/1304812764 >> v2:172.21.2.119:3300/0 conn(0x7f06c80b9760 msgr2=0x7f06c80aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:26.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- 172.21.2.135:0/1304812764 >> v2:172.21.2.119:3300/0 conn(0x7f06c80b9760 0x7f06c80aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:26.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/1304812764 >> v1:172.21.2.135:6789/0 conn(0x7f06c80671a0 legacy=0x7f06c8143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/1304812764 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c81432f0 con 0x7f06c8140070 2021-11-15T14:34:26.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- 172.21.2.135:0/1304812764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8140500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c00091d0).ready entity=mon.1 client_cookie=71e181f450b16b3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:26.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c6ffd700 1 -- 172.21.2.135:0/1304812764 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c000b680 con 0x7f06c8140070 2021-11-15T14:34:26.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c6ffd700 1 -- 172.21.2.135:0/1304812764 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000b7e0 con 0x7f06c8140070 2021-11-15T14:34:26.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06c6ffd700 1 -- 172.21.2.135:0/1304812764 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c000b950 con 0x7f06c8140070 2021-11-15T14:34:26.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- 172.21.2.135:0/1304812764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 msgr2=0x7f06c8140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- 172.21.2.135:0/1304812764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8140500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c00091d0).stop 2021-11-15T14:34:26.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- 172.21.2.135:0/1304812764 shutdown_connections 2021-11-15T14:34:26.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- 172.21.2.135:0/1304812764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8140500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:26.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- 172.21.2.135:0/1304812764 >> v2:172.21.2.119:3300/0 conn(0x7f06c80b9760 0x7f06c80aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:26.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- 172.21.2.135:0/1304812764 >> 172.21.2.135:0/1304812764 conn(0x7f06c805fa70 msgr2=0x7f06c8061720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:26.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- 172.21.2.135:0/1304812764 shutdown_connections 2021-11-15T14:34:26.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- 172.21.2.135:0/1304812764 wait complete. 2021-11-15T14:34:26.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 Processor -- start 2021-11-15T14:34:26.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- start start 2021-11-15T14:34:26.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06c80671a0 0x7f06c8140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c80b9760 0x7f06c81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8156640 con 0x7f06c80671a0 2021-11-15T14:34:26.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8155bd0 con 0x7f06c8140070 2021-11-15T14:34:26.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ce573700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8155e60 con 0x7f06c80b9760 2021-11-15T14:34:26.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:26.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54554/0 (socket says 172.21.2.135:54554) 2021-11-15T14:34:26.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/901542207 learned_addr learned my addr 172.21.2.135:0/901542207 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:26.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c80b9760 msgr2=0x7f06c81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c80b9760 0x7f06c81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:26.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06c80671a0 msgr2=0x7f06c8140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:26.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06c80671a0 0x7f06c8140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.629+0000 7f06ccb10700 1 -- 172.21.2.135:0/901542207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009470 con 0x7f06c8140070 2021-11-15T14:34:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06ccb10700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c000b680 con 0x7f06c8140070 2021-11-15T14:34:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0021440 con 0x7f06c8140070 2021-11-15T14:34:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c8156100 con 0x7f06c8140070 2021-11-15T14:34:26.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c00217a0 con 0x7f06c8140070 2021-11-15T14:34:26.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c81455d0 con 0x7f06c8140070 2021-11-15T14:34:26.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8143590 con 0x7f06c8140070 2021-11-15T14:34:26.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06c000f070 con 0x7f06c8140070 2021-11-15T14:34:26.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 0x7f06ac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:26.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5859+0+0 (secure 0 0 0) 0x7f06c006cfd0 con 0x7f06c8140070 2021-11-15T14:34:26.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c7fff700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 0x7f06ac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:26.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c7fff700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 0x7f06ac055a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f06b8001110 tx=0x7f06b80076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:26.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.633+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06c0044200 con 0x7f06c8140070 2021-11-15T14:34:26.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:26.721+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f06c80573d0 con 0x7f06c8140070 2021-11-15T14:34:28.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.581+0000 7f06c57fa700 1 -- 172.21.2.135:0/901542207 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7f06c00150e0 con 0x7f06c8140070 2021-11-15T14:34:28.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 msgr2=0x7f06ac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 0x7f06ac055a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f06b8001110 tx=0x7f06b80076c0).stop 2021-11-15T14:34:28.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 msgr2=0x7f06c8152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c0016000).stop 2021-11-15T14:34:28.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 shutdown_connections 2021-11-15T14:34:28.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06ac053580 0x7f06ac055a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:28.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c8140070 0x7f06c8152490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:28.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c80b9760 0x7f06c81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 --2- 172.21.2.135:0/901542207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06c80671a0 0x7f06c8140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 >> 172.21.2.135:0/901542207 conn(0x7f06c805fa70 msgr2=0x7f06c80b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:28.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 shutdown_connections 2021-11-15T14:34:28.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.585+0000 7f06ce573700 1 -- 172.21.2.135:0/901542207 wait complete. 2021-11-15T14:34:28.591 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:34:28.595 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-11-15T14:34:28.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 Processor -- start 2021-11-15T14:34:28.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 -- start start 2021-11-15T14:34:28.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f669013d480 0x7f6690146860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6690147460 con 0x7f66900b67e0 2021-11-15T14:34:28.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66900ac5d0 con 0x7f66900aa100 2021-11-15T14:34:28.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900ac870 con 0x7f669013d480 2021-11-15T14:34:28.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f66951bc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f66900aa100 0x7f6690146d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42148/0 (socket says 172.21.2.135:42148) 2021-11-15T14:34:28.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f66951bc700 1 -- 172.21.2.135:0/1723163861 learned_addr learned my addr 172.21.2.135:0/1723163861 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:28.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391416055 0 0) 0x7f66900ac5d0 con 0x7f66900aa100 2021-11-15T14:34:28.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f667c003260 con 0x7f66900aa100 2021-11-15T14:34:28.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 --2- 172.21.2.135:0/1723163861 >> v2:172.21.2.119:3300/0 conn(0x7f669013d480 0x7f6690146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:28.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800588021 0 0) 0x7f667c003260 con 0x7f66900aa100 2021-11-15T14:34:28.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 >> v2:172.21.2.119:3300/0 conn(0x7f669013d480 msgr2=0x7f6690146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:28.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 --2- 172.21.2.135:0/1723163861 >> v2:172.21.2.119:3300/0 conn(0x7f669013d480 0x7f6690146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:28.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 >> v1:172.21.2.119:6789/0 conn(0x7f66900b67e0 legacy=0x7f669013cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:28.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900acb10 con 0x7f66900aa100 2021-11-15T14:34:28.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6680001660 con 0x7f66900aa100 2021-11-15T14:34:28.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 >> v1:172.21.2.135:6789/0 conn(0x7f66900aa100 legacy=0x7f6690146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c003820 0x7f667c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 0x7f667c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f667c004f70 0x7f667c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900ac870 con 0x7f667c003820 2021-11-15T14:34:28.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c00be50 con 0x7f667c004500 2021-11-15T14:34:28.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c00c010 con 0x7f667c004f70 2021-11-15T14:34:28.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 0x7f667c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:28.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 -- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f667c004f70 msgr2=0x7f667c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:28.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f667c004f70 0x7f667c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 -- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c003820 msgr2=0x7f667c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:28.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c003820 0x7f667c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f66951bc700 1 -- 172.21.2.135:0/1723163861 reap_dead start 2021-11-15T14:34:28.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 -- 172.21.2.135:0/1723163861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c003260 con 0x7f667c004500 2021-11-15T14:34:28.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668ffff700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 0x7f667c004980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f668400a000 tx=0x7f6684008040).ready entity=mon.1 client_cookie=471073b5f5f8e41a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:28.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6684013670 con 0x7f667c004500 2021-11-15T14:34:28.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66840137d0 con 0x7f667c004500 2021-11-15T14:34:28.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f668f7fe700 1 -- 172.21.2.135:0/1723163861 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6684013b30 con 0x7f667c004500 2021-11-15T14:34:28.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 -- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 msgr2=0x7f667c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.645+0000 7f6696c1f700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 0x7f667c004980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f668400a000 tx=0x7f6684008040).stop 2021-11-15T14:34:28.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/1723163861 shutdown_connections 2021-11-15T14:34:28.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 --2- 172.21.2.135:0/1723163861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f667c004500 0x7f667c004980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:28.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/1723163861 >> 172.21.2.135:0/1723163861 conn(0x7f66900b3500 msgr2=0x7f66900b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:28.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/1723163861 shutdown_connections 2021-11-15T14:34:28.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/1723163861 wait complete. 2021-11-15T14:34:28.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 Processor -- start 2021-11-15T14:34:28.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- start start 2021-11-15T14:34:28.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c004500 0x7f66900b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f669013f0a0 0x7f669013f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66901473a0 con 0x7f667c004500 2021-11-15T14:34:28.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669013dc90 con 0x7f669013fb60 2021-11-15T14:34:28.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669013d9f0 con 0x7f669013f0a0 2021-11-15T14:34:28.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:28.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54570/0 (socket says 172.21.2.135:54570) 2021-11-15T14:34:28.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 -- 172.21.2.135:0/2258428281 learned_addr learned my addr 172.21.2.135:0/2258428281 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:28.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 -- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f669013f0a0 msgr2=0x7f669013f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f669013f0a0 0x7f669013f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 -- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c004500 msgr2=0x7f66900b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:28.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c004500 0x7f66900b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:28.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 -- 172.21.2.135:0/2258428281 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669013dfb0 con 0x7f669013fb60 2021-11-15T14:34:28.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668ffff700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f668400a000 tx=0x7f6684008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:28.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6684012d40 con 0x7f669013fb60 2021-11-15T14:34:28.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684000e90 con 0x7f669013fb60 2021-11-15T14:34:28.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6684012ea0 con 0x7f669013fb60 2021-11-15T14:34:28.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669013e250 con 0x7f669013fb60 2021-11-15T14:34:28.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6690146690 con 0x7f669013fb60 2021-11-15T14:34:28.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66900aad40 con 0x7f669013fb60 2021-11-15T14:34:28.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f668401d600 con 0x7f669013fb60 2021-11-15T14:34:28.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 0x7f6670055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:28.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f668406d3b0 con 0x7f669013fb60 2021-11-15T14:34:28.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.649+0000 7f66949bb700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 0x7f6670055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:28.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.653+0000 7f66949bb700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 0x7f6670055be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6688002320 tx=0x7f6688007b70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:28.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.653+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66840442b0 con 0x7f669013fb60 2021-11-15T14:34:28.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:28.737+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f669013e3e0 con 0x7f669013fb60 2021-11-15T14:34:29.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f668dffb700 1 -- 172.21.2.135:0/2258428281 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6684013e60 con 0x7f669013fb60 2021-11-15T14:34:29.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 msgr2=0x7f6670055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 0x7f6670055be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6688002320 tx=0x7f6688007b70).stop 2021-11-15T14:34:29.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 msgr2=0x7f669013ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f668400a000 tx=0x7f6684008040).stop 2021-11-15T14:34:29.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 shutdown_connections 2021-11-15T14:34:29.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6670053720 0x7f6670055be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f669013f0a0 0x7f669013f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f669013fb60 0x7f669013ebb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 --2- 172.21.2.135:0/2258428281 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f667c004500 0x7f66900b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 >> 172.21.2.135:0/2258428281 conn(0x7f66900b3500 msgr2=0x7f6690141bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:29.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 shutdown_connections 2021-11-15T14:34:29.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.589+0000 7f6696c1f700 1 -- 172.21.2.135:0/2258428281 wait complete. 2021-11-15T14:34:29.599 INFO:teuthology.orchestra.run.gibba035.stderr:set pool 4 allow_ec_overwrites to true 2021-11-15T14:34:29.602 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:34:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 Processor -- start 2021-11-15T14:34:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- start start 2021-11-15T14:34:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f42980acdd0 0x7f429814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980b6d60 con 0x7f4298060990 2021-11-15T14:34:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4298061260 con 0x7f42980b6980 2021-11-15T14:34:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4298061500 con 0x7f42980acdd0 2021-11-15T14:34:29.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429d348700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f42980b6980 0x7f42980a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42166/0 (socket says 172.21.2.135:42166) 2021-11-15T14:34:29.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429d348700 1 -- 172.21.2.135:0/3547404150 learned_addr learned my addr 172.21.2.135:0/3547404150 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:29.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 --2- 172.21.2.135:0/3547404150 >> v2:172.21.2.119:3300/0 conn(0x7f42980acdd0 0x7f429814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410924141 0 0) 0x7f4298061260 con 0x7f42980b6980 2021-11-15T14:34:29.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4280003260 con 0x7f42980b6980 2021-11-15T14:34:29.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057491627 0 0) 0x7f4280003260 con 0x7f42980b6980 2021-11-15T14:34:29.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 >> v2:172.21.2.119:3300/0 conn(0x7f42980acdd0 msgr2=0x7f429814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:29.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 --2- 172.21.2.135:0/3547404150 >> v2:172.21.2.119:3300/0 conn(0x7f42980acdd0 0x7f429814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 >> v1:172.21.2.119:6789/0 conn(0x7f4298060990 legacy=0x7f42980aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:29.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980617a0 con 0x7f42980b6980 2021-11-15T14:34:29.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f4288001660 con 0x7f42980b6980 2021-11-15T14:34:29.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 >> v1:172.21.2.135:6789/0 conn(0x7f42980b6980 legacy=0x7f42980a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4280003820 0x7f4280003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4280004500 0x7f4280004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f428000c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298061500 con 0x7f4280004500 2021-11-15T14:34:29.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428000cee0 con 0x7f4280004ee0 2021-11-15T14:34:29.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428000d0a0 con 0x7f4280003820 2021-11-15T14:34:29.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f428000c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429cb47700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4280004500 0x7f4280004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429d348700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4280003820 0x7f4280003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 -- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4280003820 msgr2=0x7f4280003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:29.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4280003820 0x7f4280003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 -- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4280004500 msgr2=0x7f4280004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:29.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4280004500 0x7f4280004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 -- 172.21.2.135:0/3547404150 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280003260 con 0x7f4280004ee0 2021-11-15T14:34:29.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429d348700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4280003820 0x7f4280003c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:29.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 -- 172.21.2.135:0/3547404150 reap_dead start 2021-11-15T14:34:29.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429db49700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f428000c860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f42800054d0 tx=0x7f42900091d0).ready entity=mon.1 client_cookie=aeb33d5238337017 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429000e7e0 con 0x7f4280004ee0 2021-11-15T14:34:29.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000e940 con 0x7f4280004ee0 2021-11-15T14:34:29.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f4287fff700 1 -- 172.21.2.135:0/3547404150 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f429000eca0 con 0x7f4280004ee0 2021-11-15T14:34:29.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 msgr2=0x7f428000c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f428000c860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f42800054d0 tx=0x7f42900091d0).stop 2021-11-15T14:34:29.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- 172.21.2.135:0/3547404150 shutdown_connections 2021-11-15T14:34:29.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 --2- 172.21.2.135:0/3547404150 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f428000c860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- 172.21.2.135:0/3547404150 >> 172.21.2.135:0/3547404150 conn(0x7f42980b3500 msgr2=0x7f42980b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:29.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- 172.21.2.135:0/3547404150 shutdown_connections 2021-11-15T14:34:29.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- 172.21.2.135:0/3547404150 wait complete. 2021-11-15T14:34:29.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 Processor -- start 2021-11-15T14:34:29.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.661+0000 7f429f5ac700 1 -- start start 2021-11-15T14:34:29.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f429814ece0 0x7f4298142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42980ad4f0 0x7f4298141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429814f180 con 0x7f42980ad4f0 2021-11-15T14:34:29.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981426e0 con 0x7f4280004ee0 2021-11-15T14:34:29.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4298142980 con 0x7f429814ece0 2021-11-15T14:34:29.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429cb47700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f429814ece0 0x7f4298142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54590/0 (socket says 172.21.2.135:54590) 2021-11-15T14:34:29.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 -- 172.21.2.135:0/918072299 learned_addr learned my addr 172.21.2.135:0/918072299 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:29.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429db49700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42980ad4f0 0x7f4298141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 -- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f429814ece0 msgr2=0x7f4298142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f429814ece0 0x7f4298142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 -- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42980ad4f0 msgr2=0x7f4298141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42980ad4f0 0x7f4298141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 -- 172.21.2.135:0/918072299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298143310 con 0x7f4280004ee0 2021-11-15T14:34:29.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429d348700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f42880011f0 tx=0x7f4288009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4288007170 con 0x7f4280004ee0 2021-11-15T14:34:29.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42880072d0 con 0x7f4280004ee0 2021-11-15T14:34:29.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4288004920 con 0x7f4280004ee0 2021-11-15T14:34:29.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4298142090 con 0x7f4280004ee0 2021-11-15T14:34:29.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4298151960 con 0x7f4280004ee0 2021-11-15T14:34:29.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4298142b40 con 0x7f4280004ee0 2021-11-15T14:34:29.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4288004a80 con 0x7f4280004ee0 2021-11-15T14:34:29.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 0x7f4278055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f428806b5c0 con 0x7f4280004ee0 2021-11-15T14:34:29.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429cb47700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 0x7f4278055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.665+0000 7f429cb47700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 0x7f4278055b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f429400d000 tx=0x7f429400c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.669+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4288042630 con 0x7f4280004ee0 2021-11-15T14:34:29.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.777+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4298061a40 con 0x7f4280004ee0 2021-11-15T14:34:29.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f42867fc700 1 -- 172.21.2.135:0/918072299 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4288045c50 con 0x7f4280004ee0 2021-11-15T14:34:29.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 msgr2=0x7f4278055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 0x7f4278055b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f429400d000 tx=0x7f429400c040).stop 2021-11-15T14:34:29.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 msgr2=0x7f42980b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f42880011f0 tx=0x7f4288009040).stop 2021-11-15T14:34:29.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 shutdown_connections 2021-11-15T14:34:29.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4278053640 0x7f4278055b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42980ad4f0 0x7f4298141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f429814ece0 0x7f4298142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 --2- 172.21.2.135:0/918072299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4280004ee0 0x7f42980b0440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 >> 172.21.2.135:0/918072299 conn(0x7f42980b3500 msgr2=0x7f4298137670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:29.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 shutdown_connections 2021-11-15T14:34:29.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.789+0000 7f429f5ac700 1 -- 172.21.2.135:0/918072299 wait complete. 2021-11-15T14:34:29.797 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 3 and data pool 4 2021-11-15T14:34:29.800 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:29.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 Processor -- start 2021-11-15T14:34:29.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 -- start start 2021-11-15T14:34:29.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd3c0060990 0x7fd3c00acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd3c00aa650 0x7fd3c005c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00b6d60 con 0x7fd3c00b6980 2021-11-15T14:34:29.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c0061260 con 0x7fd3c00aa650 2021-11-15T14:34:29.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3c671b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c0061500 con 0x7fd3c0060990 2021-11-15T14:34:29.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd3c00b6980 0x7fd3c00a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42196/0 (socket says 172.21.2.135:42196) 2021-11-15T14:34:29.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bffff700 1 -- 172.21.2.135:0/1384596144 learned_addr learned my addr 172.21.2.135:0/1384596144 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:29.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 --2- 172.21.2.135:0/1384596144 >> v2:172.21.2.135:3300/0 conn(0x7fd3c0060990 0x7fd3c00acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 -- 172.21.2.135:0/1384596144 >> v2:172.21.2.119:3300/0 conn(0x7fd3c00aa650 msgr2=0x7fd3c005c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:29.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 --2- 172.21.2.135:0/1384596144 >> v2:172.21.2.119:3300/0 conn(0x7fd3c00aa650 0x7fd3c005c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 -- 172.21.2.135:0/1384596144 >> v1:172.21.2.135:6789/0 conn(0x7fd3c00b6980 legacy=0x7fd3c00a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3beffd700 1 -- 172.21.2.135:0/1384596144 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328987972 0 0) 0x7fd3c00b6d60 con 0x7fd3c00b6980 2021-11-15T14:34:29.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 -- 172.21.2.135:0/1384596144 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00617a0 con 0x7fd3c0060990 2021-11-15T14:34:29.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3bf7fe700 1 --2- 172.21.2.135:0/1384596144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00acdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd3a8002f70 tx=0x7fd3a8006df0).ready entity=mon.1 client_cookie=b88bb5f2d680bbbb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3beffd700 1 -- 172.21.2.135:0/1384596144 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a800d5c0 con 0x7fd3c0060990 2021-11-15T14:34:29.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3beffd700 1 -- 172.21.2.135:0/1384596144 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8000e90 con 0x7fd3c0060990 2021-11-15T14:34:29.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.849+0000 7fd3beffd700 1 -- 172.21.2.135:0/1384596144 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a800d910 con 0x7fd3c0060990 2021-11-15T14:34:29.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/1384596144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 msgr2=0x7fd3c00acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- 172.21.2.135:0/1384596144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00acdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd3a8002f70 tx=0x7fd3a8006df0).stop 2021-11-15T14:34:29.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/1384596144 shutdown_connections 2021-11-15T14:34:29.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- 172.21.2.135:0/1384596144 >> v2:172.21.2.119:3300/0 conn(0x7fd3c00aa650 0x7fd3c005c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- 172.21.2.135:0/1384596144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00acdd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/1384596144 >> 172.21.2.135:0/1384596144 conn(0x7fd3c00b3500 msgr2=0x7fd3c00b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:29.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/1384596144 shutdown_connections 2021-11-15T14:34:29.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/1384596144 wait complete. 2021-11-15T14:34:29.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 Processor -- start 2021-11-15T14:34:29.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- start start 2021-11-15T14:34:29.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3c00aa650 0x7fd3c013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3c00b6980 0x7fd3c012fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0156770 con 0x7fd3c00b6980 2021-11-15T14:34:29.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0156a10 con 0x7fd3c0060990 2021-11-15T14:34:29.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00ada20 con 0x7fd3c00aa650 2021-11-15T14:34:29.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54618/0 (socket says 172.21.2.135:54618) 2021-11-15T14:34:29.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 -- 172.21.2.135:0/3231721450 learned_addr learned my addr 172.21.2.135:0/3231721450 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:29.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 -- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3c00aa650 msgr2=0x7fd3c013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3c00aa650 0x7fd3c013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 -- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3c00b6980 msgr2=0x7fd3c012fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3c00b6980 0x7fd3c012fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 -- 172.21.2.135:0/3231721450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a800b180 con 0x7fd3c0060990 2021-11-15T14:34:29.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bffff700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd3b0000ed0 tx=0x7fd3b0007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b000ce50 con 0x7fd3c0060990 2021-11-15T14:34:29.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b00072e0 con 0x7fd3c0060990 2021-11-15T14:34:29.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b0005780 con 0x7fd3c0060990 2021-11-15T14:34:29.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c00adcc0 con 0x7fd3c0060990 2021-11-15T14:34:29.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c01300b0 con 0x7fd3c0060990 2021-11-15T14:34:29.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0140e80 con 0x7fd3c0060990 2021-11-15T14:34:29.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3b0010070 con 0x7fd3c0060990 2021-11-15T14:34:29.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 0x7fd3a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:29.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd3b006b350 con 0x7fd3c0060990 2021-11-15T14:34:29.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.853+0000 7fd3bf7fe700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 0x7fd3a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:29.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.857+0000 7fd3bf7fe700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 0x7fd3a4055ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd3a8002f70 tx=0x7fd3a8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:29.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.857+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3c0140e80 con 0x7fd3c0060990 2021-11-15T14:34:29.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.941+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3c0140e80 con 0x7fd3c0060990 2021-11-15T14:34:29.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.941+0000 7fd3bd7fa700 1 -- 172.21.2.135:0/3231721450 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7fd3c0140e80 con 0x7fd3c0060990 2021-11-15T14:34:29.946 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:29.946 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":24,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:29.784377+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:29.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 msgr2=0x7fd3a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 0x7fd3a4055ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd3a8002f70 tx=0x7fd3a8014000).stop 2021-11-15T14:34:29.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 msgr2=0x7fd3c00afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:29.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd3b0000ed0 tx=0x7fd3b0007aa0).stop 2021-11-15T14:34:29.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 shutdown_connections 2021-11-15T14:34:29.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3a4053610 0x7fd3a4055ad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3c00b6980 0x7fd3c012fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3c00aa650 0x7fd3c013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:29.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 --2- 172.21.2.135:0/3231721450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3c0060990 0x7fd3c00afe30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:29.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 >> 172.21.2.135:0/3231721450 conn(0x7fd3c00b3500 msgr2=0x7fd3c00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:29.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 shutdown_connections 2021-11-15T14:34:29.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:29.945+0000 7fd3c671b700 1 -- 172.21.2.135:0/3231721450 wait complete. 2021-11-15T14:34:29.953 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:30.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 Processor -- start 2021-11-15T14:34:30.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- start start 2021-11-15T14:34:30.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4244067380 0x7f4244143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4244143e60 0x7f424414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440aac30 con 0x7f4244060180 2021-11-15T14:34:30.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4244060560 con 0x7f4244143e60 2021-11-15T14:34:30.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4244066f20 con 0x7f4244067380 2021-11-15T14:34:30.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f4242ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f4244060180 0x7f42440b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42210/0 (socket says 172.21.2.135:42210) 2021-11-15T14:34:30.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f4242ffd700 1 -- 172.21.2.135:0/1734015669 learned_addr learned my addr 172.21.2.135:0/1734015669 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:30.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 --2- 172.21.2.135:0/1734015669 >> v2:172.21.2.135:3300/0 conn(0x7f4244067380 0x7f4244143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 -- 172.21.2.135:0/1734015669 >> v2:172.21.2.119:3300/0 conn(0x7f4244143e60 msgr2=0x7f424414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 --2- 172.21.2.135:0/1734015669 >> v2:172.21.2.119:3300/0 conn(0x7f4244143e60 0x7f424414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 -- 172.21.2.135:0/1734015669 >> v1:172.21.2.135:6789/0 conn(0x7f4244060180 legacy=0x7f42440b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 -- 172.21.2.135:0/1734015669 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440b3430 con 0x7f4244067380 2021-11-15T14:34:30.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42427fc700 1 --2- 172.21.2.135:0/1734015669 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244067380 0x7f4244143970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4234002f70 tx=0x7f4234006df0).ready entity=mon.1 client_cookie=51c88eec451db05a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f4241ffb700 1 -- 172.21.2.135:0/1734015669 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423400d5c0 con 0x7f4244067380 2021-11-15T14:34:30.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f4241ffb700 1 -- 172.21.2.135:0/1734015669 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234000e90 con 0x7f4244067380 2021-11-15T14:34:30.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f4241ffb700 1 -- 172.21.2.135:0/1734015669 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423400d910 con 0x7f4244067380 2021-11-15T14:34:30.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- 172.21.2.135:0/1734015669 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244067380 msgr2=0x7f4244143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 --2- 172.21.2.135:0/1734015669 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244067380 0x7f4244143970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4234002f70 tx=0x7f4234006df0).stop 2021-11-15T14:34:30.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- 172.21.2.135:0/1734015669 shutdown_connections 2021-11-15T14:34:30.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 --2- 172.21.2.135:0/1734015669 >> v2:172.21.2.119:3300/0 conn(0x7f4244143e60 0x7f424414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 --2- 172.21.2.135:0/1734015669 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244067380 0x7f4244143970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- 172.21.2.135:0/1734015669 >> 172.21.2.135:0/1734015669 conn(0x7f424405cfb0 msgr2=0x7f424405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- 172.21.2.135:0/1734015669 shutdown_connections 2021-11-15T14:34:30.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.001+0000 7f42498b6700 1 -- 172.21.2.135:0/1734015669 wait complete. 2021-11-15T14:34:30.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 Processor -- start 2021-11-15T14:34:30.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- start start 2021-11-15T14:34:30.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4244060180 0x7f42440b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4244067380 0x7f4244151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440aec50 con 0x7f4244060180 2021-11-15T14:34:30.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244151640 con 0x7f4244143e60 2021-11-15T14:34:30.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440acec0 con 0x7f4244067380 2021-11-15T14:34:30.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54630/0 (socket says 172.21.2.135:54630) 2021-11-15T14:34:30.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 -- 172.21.2.135:0/871751697 learned_addr learned my addr 172.21.2.135:0/871751697 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:30.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 -- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4244067380 msgr2=0x7f4244151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4244067380 0x7f4244151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 -- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4244060180 msgr2=0x7f42440b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4244060180 0x7f42440b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 -- 172.21.2.135:0/871751697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423400b180 con 0x7f4244143e60 2021-11-15T14:34:30.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42437fe700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f423c0032f0 tx=0x7f423c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c00d4a0 con 0x7f4244143e60 2021-11-15T14:34:30.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00d600 con 0x7f4244143e60 2021-11-15T14:34:30.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4244150a10 con 0x7f4244143e60 2021-11-15T14:34:30.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4244150700 con 0x7f4244143e60 2021-11-15T14:34:30.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c00d960 con 0x7f4244143e60 2021-11-15T14:34:30.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440573d0 con 0x7f4244143e60 2021-11-15T14:34:30.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f423c018030 con 0x7f4244143e60 2021-11-15T14:34:30.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 0x7f4228055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f423c06b4a0 con 0x7f4244143e60 2021-11-15T14:34:30.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.005+0000 7f4242ffd700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 0x7f4228055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.009+0000 7f4242ffd700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 0x7f4228055ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f424405f260 tx=0x7f422c0077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.009+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f423c042440 con 0x7f4244143e60 2021-11-15T14:34:30.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4244069960 con 0x7f4244143e60 2021-11-15T14:34:30.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f423bfff700 1 -- 172.21.2.135:0/871751697 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7f423c023fd0 con 0x7f4244143e60 2021-11-15T14:34:30.095 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:30.096 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":24,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:29.784377+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:30.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 msgr2=0x7f4228055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 0x7f4228055ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f424405f260 tx=0x7f422c0077d0).stop 2021-11-15T14:34:30.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 msgr2=0x7f42440ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f423c0032f0 tx=0x7f423c0091a0).stop 2021-11-15T14:34:30.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 shutdown_connections 2021-11-15T14:34:30.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4228053610 0x7f4228055ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4244143e60 0x7f42440ad990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4244067380 0x7f4244151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 --2- 172.21.2.135:0/871751697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4244060180 0x7f42440b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 >> 172.21.2.135:0/871751697 conn(0x7f424405cfb0 msgr2=0x7f424413e870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 shutdown_connections 2021-11-15T14:34:30.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.093+0000 7f42498b6700 1 -- 172.21.2.135:0/871751697 wait complete. 2021-11-15T14:34:30.102 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:34:30.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 Processor -- start 2021-11-15T14:34:30.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 -- start start 2021-11-15T14:34:30.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa2ec0b1f40 0x7fa2ec0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 0x7fa2ec0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec0b04a0 con 0x7fa2ec0a7140 2021-11-15T14:34:30.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b2810 con 0x7fa2ec0b1f40 2021-11-15T14:34:30.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f3561700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b06d0 con 0x7fa2ec0b0030 2021-11-15T14:34:30.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f1afe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa2ec0a7140 0x7fa2ec1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42224/0 (socket says 172.21.2.135:42224) 2021-11-15T14:34:30.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2f1afe700 1 -- 172.21.2.135:0/2742024738 learned_addr learned my addr 172.21.2.135:0/2742024738 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:30.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330445321 0 0) 0x7fa2ec0b04a0 con 0x7fa2ec0a7140 2021-11-15T14:34:30.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.153+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d4003260 con 0x7fa2ec0a7140 2021-11-15T14:34:30.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679704041 0 0) 0x7fa2d4003260 con 0x7fa2ec0a7140 2021-11-15T14:34:30.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 msgr2=0x7fa2ec0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 0x7fa2ec0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 >> v2:172.21.2.119:3300/0 conn(0x7fa2ec0b1f40 msgr2=0x7fa2ec0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 --2- 172.21.2.135:0/2742024738 >> v2:172.21.2.119:3300/0 conn(0x7fa2ec0b1f40 0x7fa2ec0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0b0970 con 0x7fa2ec0a7140 2021-11-15T14:34:30.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa2e40019e0 con 0x7fa2ec0a7140 2021-11-15T14:34:30.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 >> v1:172.21.2.135:6789/0 conn(0x7fa2ec0a7140 legacy=0x7fa2ec1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 0x7fa2d40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2d4003ee0 0x7fa2d4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2d4004bf0 0x7fa2d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b2810 con 0x7fa2d4003ee0 2021-11-15T14:34:30.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b06d0 con 0x7fa2d4004bf0 2021-11-15T14:34:30.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40053a0 con 0x7fa2ec0b0030 2021-11-15T14:34:30.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2d4004bf0 0x7fa2d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 -- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 msgr2=0x7fa2d40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2ec0b0030 0x7fa2d40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 -- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2d4003ee0 msgr2=0x7fa2d4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2d4003ee0 0x7fa2d4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 -- 172.21.2.135:0/2742024738 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4003260 con 0x7fa2d4004bf0 2021-11-15T14:34:30.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2d4004bf0 0x7fa2d400b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa2e40016f0 tx=0x7fa2ec0b2950).ready entity=mon.1 client_cookie=c6ea9e0b8eb4ee5a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e400cc70 con 0x7fa2d4004bf0 2021-11-15T14:34:30.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400cdd0 con 0x7fa2d4004bf0 2021-11-15T14:34:30.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2dbfff700 1 -- 172.21.2.135:0/2742024738 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e4005b80 con 0x7fa2d4004bf0 2021-11-15T14:34:30.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/2742024738 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2d4004bf0 msgr2=0x7fa2d400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 --2- 172.21.2.135:0/2742024738 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2d4004bf0 0x7fa2d400b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa2e40016f0 tx=0x7fa2ec0b2950).stop 2021-11-15T14:34:30.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 -- 172.21.2.135:0/2742024738 reap_dead start 2021-11-15T14:34:30.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/2742024738 shutdown_connections 2021-11-15T14:34:30.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/2742024738 >> 172.21.2.135:0/2742024738 conn(0x7fa2ec05f730 msgr2=0x7fa2ec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/2742024738 shutdown_connections 2021-11-15T14:34:30.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/2742024738 wait complete. 2021-11-15T14:34:30.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 Processor -- start 2021-11-15T14:34:30.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- start start 2021-11-15T14:34:30.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2d4004bf0 0x7fa2ec0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2ec1599d0 0x7fa2ec159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec14a030 con 0x7fa2ec1599d0 2021-11-15T14:34:30.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b6020 con 0x7fa2ec0b5990 2021-11-15T14:34:30.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b62c0 con 0x7fa2d4004bf0 2021-11-15T14:34:30.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54652/0 (socket says 172.21.2.135:54652) 2021-11-15T14:34:30.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 -- 172.21.2.135:0/144285891 learned_addr learned my addr 172.21.2.135:0/144285891 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:30.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f1afe700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2ec1599d0 0x7fa2ec159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f12fd700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2d4004bf0 0x7fa2ec0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 -- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2d4004bf0 msgr2=0x7fa2ec0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2d4004bf0 0x7fa2ec0b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 -- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2ec1599d0 msgr2=0x7fa2ec159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2ec1599d0 0x7fa2ec159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 -- 172.21.2.135:0/144285891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0b5680 con 0x7fa2ec0b5990 2021-11-15T14:34:30.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f0afc700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa2e8002f70 tx=0x7fa2e8006e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e8009e50 con 0x7fa2ec0b5990 2021-11-15T14:34:30.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8013460 con 0x7fa2ec0b5990 2021-11-15T14:34:30.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e80137c0 con 0x7fa2ec0b5990 2021-11-15T14:34:30.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec149ab0 con 0x7fa2ec0b5990 2021-11-15T14:34:30.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.157+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec158470 con 0x7fa2ec0b5990 2021-11-15T14:34:30.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec0b0c10 con 0x7fa2ec0b5990 2021-11-15T14:34:30.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2e800f070 con 0x7fa2ec0b5990 2021-11-15T14:34:30.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2da7fc700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 0x7fa2cc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa2e806b270 con 0x7fa2ec0b5990 2021-11-15T14:34:30.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2f12fd700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 0x7fa2cc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2f12fd700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 0x7fa2cc055b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa2dc00a000 tx=0x7fa2dc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.161+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2e8042210 con 0x7fa2ec0b5990 2021-11-15T14:34:30.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.273+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa2ec14a1a0 con 0x7fa2ec0b5990 2021-11-15T14:34:30.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.793+0000 7fa2da7fc700 1 -- 172.21.2.135:0/144285891 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa2ec14a1a0 con 0x7fa2ec0b5990 2021-11-15T14:34:30.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 msgr2=0x7fa2cc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 0x7fa2cc055b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa2dc00a000 tx=0x7fa2dc008040).stop 2021-11-15T14:34:30.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 msgr2=0x7fa2ec1594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa2e8002f70 tx=0x7fa2e8006e70).stop 2021-11-15T14:34:30.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 shutdown_connections 2021-11-15T14:34:30.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2cc053640 0x7fa2cc055b00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2ec1599d0 0x7fa2ec159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2ec0b5990 0x7fa2ec1594e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 --2- 172.21.2.135:0/144285891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2d4004bf0 0x7fa2ec0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 >> 172.21.2.135:0/144285891 conn(0x7fa2ec05f730 msgr2=0x7fa2ec140620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 shutdown_connections 2021-11-15T14:34:30.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.797+0000 7fa2f3561700 1 -- 172.21.2.135:0/144285891 wait complete. 2021-11-15T14:34:30.805 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:30.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 Processor -- start 2021-11-15T14:34:30.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 -- start start 2021-11-15T14:34:30.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc21c060990 0x7fc21c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0b6d60 con 0x7fc21c0b6980 2021-11-15T14:34:30.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c061260 con 0x7fc21c0aa650 2021-11-15T14:34:30.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc2247b5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c061500 con 0x7fc21c060990 2021-11-15T14:34:30.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc21c0aa650 0x7fc21c13c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42246/0 (socket says 172.21.2.135:42246) 2021-11-15T14:34:30.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 -- 172.21.2.135:0/1596514486 learned_addr learned my addr 172.21.2.135:0/1596514486 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:30.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114696504 0 0) 0x7fc21c061260 con 0x7fc21c0aa650 2021-11-15T14:34:30.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc204003260 con 0x7fc21c0aa650 2021-11-15T14:34:30.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804652869 0 0) 0x7fc204003260 con 0x7fc21c0aa650 2021-11-15T14:34:30.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 >> v2:172.21.2.119:3300/0 conn(0x7fc21c060990 msgr2=0x7fc21c0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 --2- 172.21.2.135:0/1596514486 >> v2:172.21.2.119:3300/0 conn(0x7fc21c060990 0x7fc21c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 >> v1:172.21.2.119:6789/0 conn(0x7fc21c0b6980 legacy=0x7fc21c0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0617a0 con 0x7fc21c0aa650 2021-11-15T14:34:30.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc2140019e0 con 0x7fc21c0aa650 2021-11-15T14:34:30.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 >> v1:172.21.2.135:6789/0 conn(0x7fc21c0aa650 legacy=0x7fc21c13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc204003820 0x7fc204003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204004500 0x7fc204004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 0x7fc204005740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c061500 con 0x7fc204004500 2021-11-15T14:34:30.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc204005f30 con 0x7fc204005070 2021-11-15T14:34:30.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040060f0 con 0x7fc204003820 2021-11-15T14:34:30.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 0x7fc204005740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 -- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc204003820 msgr2=0x7fc204003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc204003820 0x7fc204003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 -- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204004500 msgr2=0x7fc204004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:30.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204004500 0x7fc204004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 -- 172.21.2.135:0/1596514486 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204003260 con 0x7fc204005070 2021-11-15T14:34:30.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 -- 172.21.2.135:0/1596514486 reap_dead start 2021-11-15T14:34:30.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.853+0000 7fc222d52700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 0x7fc204005740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc21c060380 tx=0x7fc21c060e00).ready entity=mon.1 client_cookie=4cc4177108aeef01 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc21400cb80 con 0x7fc204005070 2021-11-15T14:34:30.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400cce0 con 0x7fc204005070 2021-11-15T14:34:30.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc22154f700 1 -- 172.21.2.135:0/1596514486 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc214005b80 con 0x7fc204005070 2021-11-15T14:34:30.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 msgr2=0x7fc204005740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 0x7fc204005740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc21c060380 tx=0x7fc21c060e00).stop 2021-11-15T14:34:30.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1596514486 shutdown_connections 2021-11-15T14:34:30.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1596514486 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc204005070 0x7fc204005740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1596514486 >> 172.21.2.135:0/1596514486 conn(0x7fc21c0b3500 msgr2=0x7fc21c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1596514486 shutdown_connections 2021-11-15T14:34:30.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1596514486 wait complete. 2021-11-15T14:34:30.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 Processor -- start 2021-11-15T14:34:30.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- start start 2021-11-15T14:34:30.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 0x7fc21c13e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc21c13e6f0 0x7fc21c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c13ef00 con 0x7fc204005070 2021-11-15T14:34:30.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b1e70 con 0x7fc21c13b5e0 2021-11-15T14:34:30.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b1320 con 0x7fc21c13e6f0 2021-11-15T14:34:30.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54672/0 (socket says 172.21.2.135:54672) 2021-11-15T14:34:30.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 -- 172.21.2.135:0/1861990605 learned_addr learned my addr 172.21.2.135:0/1861990605 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:30.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222551700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 0x7fc21c13e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 -- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc21c13e6f0 msgr2=0x7fc21c13b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc21c13e6f0 0x7fc21c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 -- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 msgr2=0x7fc21c13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 0x7fc21c13e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 -- 172.21.2.135:0/1861990605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c13ec60 con 0x7fc21c13b5e0 2021-11-15T14:34:30.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222551700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 0x7fc21c13e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:30.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc222d52700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc21c060380 tx=0x7fc214013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc214017070 con 0x7fc21c13b5e0 2021-11-15T14:34:30.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214001f00 con 0x7fc21c13b5e0 2021-11-15T14:34:30.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0b1bd0 con 0x7fc21c13b5e0 2021-11-15T14:34:30.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2140074d0 con 0x7fc21c13b5e0 2021-11-15T14:34:30.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c13ba60 con 0x7fc21c13b5e0 2021-11-15T14:34:30.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c061a40 con 0x7fc21c13b5e0 2021-11-15T14:34:30.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc214010070 con 0x7fc21c13b5e0 2021-11-15T14:34:30.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 0x7fc1fc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:30.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.857+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc21401a040 con 0x7fc21c13b5e0 2021-11-15T14:34:30.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.861+0000 7fc222551700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 0x7fc1fc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:30.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.861+0000 7fc222551700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 0x7fc1fc055b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc20c007000 tx=0x7fc20c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:30.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.861+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc214043790 con 0x7fc21c13b5e0 2021-11-15T14:34:30.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.969+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc21c0573d0 con 0x7fc21c13b5e0 2021-11-15T14:34:30.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.969+0000 7fc20b7fe700 1 -- 172.21.2.135:0/1861990605 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7fc214046d30 con 0x7fc21c13b5e0 2021-11-15T14:34:30.974 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:30.974 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:30.789816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2579658836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2579658836},{"type":"v1","addr":"172.21.2.135:6835","nonce":2579658836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:30.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.969+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 msgr2=0x7fc1fc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.969+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 0x7fc1fc055b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc20c007000 tx=0x7fc20c008040).stop 2021-11-15T14:34:30.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 msgr2=0x7fc21c159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:30.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc21c060380 tx=0x7fc214013000).stop 2021-11-15T14:34:30.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 shutdown_connections 2021-11-15T14:34:30.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1fc0536a0 0x7fc1fc055b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc21c13b5e0 0x7fc21c159e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc21c13e6f0 0x7fc21c13b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:30.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 --2- 172.21.2.135:0/1861990605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc204005070 0x7fc21c13e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:30.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 >> 172.21.2.135:0/1861990605 conn(0x7fc21c0b3500 msgr2=0x7fc21c0b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:30.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 shutdown_connections 2021-11-15T14:34:30.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:30.973+0000 7fc2247b5700 1 -- 172.21.2.135:0/1861990605 wait complete. 2021-11-15T14:34:30.978 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 6 2021-11-15T14:34:30.981 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:31.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 Processor -- start 2021-11-15T14:34:31.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- start start 2021-11-15T14:34:31.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f70ac0b0520 0x7f70ac0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f70ac0b0900 0x7f70ac140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac0b2b70 con 0x7f70ac0aa1a0 2021-11-15T14:34:31.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0b27f0 con 0x7f70ac0b0900 2021-11-15T14:34:31.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0b2da0 con 0x7f70ac0b0520 2021-11-15T14:34:31.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70a9d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f70ac0aa1a0 0x7f70ac0ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42266/0 (socket says 172.21.2.135:42266) 2021-11-15T14:34:31.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70a9d9b700 1 -- 172.21.2.135:0/234649332 learned_addr learned my addr 172.21.2.135:0/234649332 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:31.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 --2- 172.21.2.135:0/234649332 >> v2:172.21.2.135:3300/0 conn(0x7f70ac0b0520 0x7f70ac0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 -- 172.21.2.135:0/234649332 >> v2:172.21.2.119:3300/0 conn(0x7f70ac0b0900 msgr2=0x7f70ac140620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:31.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 --2- 172.21.2.135:0/234649332 >> v2:172.21.2.119:3300/0 conn(0x7f70ac0b0900 0x7f70ac140620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 -- 172.21.2.135:0/234649332 >> v1:172.21.2.135:6789/0 conn(0x7f70ac0aa1a0 legacy=0x7f70ac0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 -- 172.21.2.135:0/234649332 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0a9bf0 con 0x7f70ac0b0520 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70aa59c700 1 --2- 172.21.2.135:0/234649332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0520 0x7f70ac0addb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006e80).ready entity=mon.1 client_cookie=fa747e27823e80f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70a959a700 1 -- 172.21.2.135:0/234649332 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709400ba40 con 0x7f70ac0b0520 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70a959a700 1 -- 172.21.2.135:0/234649332 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094000e90 con 0x7f70ac0b0520 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70a959a700 1 -- 172.21.2.135:0/234649332 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709400bdd0 con 0x7f70ac0b0520 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- 172.21.2.135:0/234649332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0520 msgr2=0x7f70ac0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 --2- 172.21.2.135:0/234649332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0520 0x7f70ac0addb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006e80).stop 2021-11-15T14:34:31.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- 172.21.2.135:0/234649332 shutdown_connections 2021-11-15T14:34:31.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 --2- 172.21.2.135:0/234649332 >> v2:172.21.2.119:3300/0 conn(0x7f70ac0b0900 0x7f70ac140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 --2- 172.21.2.135:0/234649332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0520 0x7f70ac0addb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- 172.21.2.135:0/234649332 >> 172.21.2.135:0/234649332 conn(0x7f70ac060840 msgr2=0x7f70ac060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- 172.21.2.135:0/234649332 shutdown_connections 2021-11-15T14:34:31.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- 172.21.2.135:0/234649332 wait complete. 2021-11-15T14:34:31.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 Processor -- start 2021-11-15T14:34:31.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.029+0000 7f70b0817700 1 -- start start 2021-11-15T14:34:31.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f70ac0aa1a0 0x7f70ac141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70ac0b0520 0x7f70ac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac13cec0 con 0x7f70ac0aa1a0 2021-11-15T14:34:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac13d160 con 0x7f70ac0b0900 2021-11-15T14:34:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac13d400 con 0x7f70ac0b0520 2021-11-15T14:34:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54686/0 (socket says 172.21.2.135:54686) 2021-11-15T14:34:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 -- 172.21.2.135:0/1798482516 learned_addr learned my addr 172.21.2.135:0/1798482516 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 -- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70ac0b0520 msgr2=0x7f70ac13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70ac0b0520 0x7f70ac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 -- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f70ac0aa1a0 msgr2=0x7f70ac141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f70ac0aa1a0 0x7f70ac141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 -- 172.21.2.135:0/1798482516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709400d410 con 0x7f70ac0b0900 2021-11-15T14:34:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aad9d700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f70a4003270 tx=0x7f70a4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a400d4a0 con 0x7f70ac0b0900 2021-11-15T14:34:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400d600 con 0x7f70ac0b0900 2021-11-15T14:34:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a400d9a0 con 0x7f70ac0b0900 2021-11-15T14:34:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac13bb40 con 0x7f70ac0b0900 2021-11-15T14:34:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac13dae0 con 0x7f70ac0b0900 2021-11-15T14:34:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac0573d0 con 0x7f70ac0b0900 2021-11-15T14:34:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f70a4018030 con 0x7f70ac0b0900 2021-11-15T14:34:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 0x7f7090055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f70a406b530 con 0x7f70ac0b0900 2021-11-15T14:34:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.033+0000 7f70aa59c700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 0x7f7090055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.037+0000 7f70aa59c700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 0x7f7090055a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006e80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.037+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70a40424d0 con 0x7f70ac0b0900 2021-11-15T14:34:31.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.117+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70ac0446d0 con 0x7f70ac0b0900 2021-11-15T14:34:31.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70a37fe700 1 -- 172.21.2.135:0/1798482516 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f70a4016020 con 0x7f70ac0b0900 2021-11-15T14:34:31.123 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:31.123 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:31.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 msgr2=0x7f7090055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 0x7f7090055a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7094002f70 tx=0x7f7094006e80).stop 2021-11-15T14:34:31.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 msgr2=0x7f70ac13b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f70a4003270 tx=0x7f70a4009060).stop 2021-11-15T14:34:31.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 shutdown_connections 2021-11-15T14:34:31.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70900535d0 0x7f7090055a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70ac0b0900 0x7f70ac13b650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70ac0b0520 0x7f70ac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 --2- 172.21.2.135:0/1798482516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f70ac0aa1a0 0x7f70ac141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 >> 172.21.2.135:0/1798482516 conn(0x7f70ac060840 msgr2=0x7f70ac060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 shutdown_connections 2021-11-15T14:34:31.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.121+0000 7f70b0817700 1 -- 172.21.2.135:0/1798482516 wait complete. 2021-11-15T14:34:31.131 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:31.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-15T14:34:31.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 Processor -- start 2021-11-15T14:34:31.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 -- start start 2021-11-15T14:34:31.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff7fc0b1e30 0x7ff7fc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff7fc0a7140 0x7ff7fc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0a9140 con 0x7ff7fc0b1e30 2021-11-15T14:34:31.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0b03d0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0b0670 con 0x7ff7fc148420 2021-11-15T14:34:31.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff7fc0a7140 0x7ff7fc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff7fc0a7140 0x7ff7fc1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54694/0 (socket says 172.21.2.135:54694) 2021-11-15T14:34:31.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 -- 172.21.2.135:0/391398619 learned_addr learned my addr 172.21.2.135:0/391398619 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 -- 172.21.2.135:0/391398619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 msgr2=0x7ff7fc0b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 --2- 172.21.2.135:0/391398619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 -- 172.21.2.135:0/391398619 >> v2:172.21.2.119:3300/0 conn(0x7ff7fc0b1e30 msgr2=0x7ff7fc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 --2- 172.21.2.135:0/391398619 >> v2:172.21.2.119:3300/0 conn(0x7ff7fc0b1e30 0x7ff7fc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 -- 172.21.2.135:0/391398619 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0b0910 con 0x7ff7fc0a7140 2021-11-15T14:34:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff800fc3700 1 --2- 172.21.2.135:0/391398619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc1447a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff7f40032f0 tx=0x7ff7f4009290).ready entity=mon.1 client_cookie=deb2abb6cd87bcd2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff7faffd700 1 -- 172.21.2.135:0/391398619 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f400b870 con 0x7ff7fc0a7140 2021-11-15T14:34:31.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff7faffd700 1 -- 172.21.2.135:0/391398619 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400b9d0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff7faffd700 1 -- 172.21.2.135:0/391398619 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f400bb40 con 0x7ff7fc0a7140 2021-11-15T14:34:31.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 -- 172.21.2.135:0/391398619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 msgr2=0x7ff7fc1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.177+0000 7ff802a26700 1 --2- 172.21.2.135:0/391398619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc1447a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff7f40032f0 tx=0x7ff7f4009290).stop 2021-11-15T14:34:31.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/391398619 shutdown_connections 2021-11-15T14:34:31.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- 172.21.2.135:0/391398619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc1447a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- 172.21.2.135:0/391398619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- 172.21.2.135:0/391398619 >> v2:172.21.2.119:3300/0 conn(0x7ff7fc0b1e30 0x7ff7fc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/391398619 >> 172.21.2.135:0/391398619 conn(0x7ff7fc05f730 msgr2=0x7ff7fc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/391398619 shutdown_connections 2021-11-15T14:34:31.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/391398619 wait complete. 2021-11-15T14:34:31.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 Processor -- start 2021-11-15T14:34:31.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- start start 2021-11-15T14:34:31.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7fc0b1e30 0x7ff7fc0abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0ac9d0 con 0x7ff7fc0b1e30 2021-11-15T14:34:31.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc149c70 con 0x7ff7fc0a7140 2021-11-15T14:34:31.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc14a9e0 con 0x7ff7fc148420 2021-11-15T14:34:31.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54698/0 (socket says 172.21.2.135:54698) 2021-11-15T14:34:31.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 -- 172.21.2.135:0/1382755691 learned_addr learned my addr 172.21.2.135:0/1382755691 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 -- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 msgr2=0x7ff7fc0ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 -- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7fc0b1e30 msgr2=0x7ff7fc0abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7fc0b1e30 0x7ff7fc0abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 -- 172.21.2.135:0/1382755691 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4009530 con 0x7ff7fc0a7140 2021-11-15T14:34:31.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7fbfff700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff7fc0acb10 tx=0x7ff7e4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e4013460 con 0x7ff7fc0a7140 2021-11-15T14:34:31.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40135c0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e4013920 con 0x7ff7fc0a7140 2021-11-15T14:34:31.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc149ea0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc0ab210 con 0x7ff7fc0a7140 2021-11-15T14:34:31.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc0b0bb0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.181+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7e400f070 con 0x7ff7fc0a7140 2021-11-15T14:34:31.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.185+0000 7ff7f97fa700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 0x7ff7e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.185+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff7e406b4d0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.185+0000 7ff7fb7fe700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 0x7ff7e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.185+0000 7ff7fb7fe700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 0x7ff7e0055b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff7ec002f70 tx=0x7ff7ec006970).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.185+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7e40423c0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7fc0573d0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff7f97fa700 1 -- 172.21.2.135:0/1382755691 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff7e40459e0 con 0x7ff7fc0a7140 2021-11-15T14:34:31.271 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:31.271 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:31.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 msgr2=0x7ff7e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 0x7ff7e0055b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff7ec002f70 tx=0x7ff7ec006970).stop 2021-11-15T14:34:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 msgr2=0x7ff7fc0ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff7fc0acb10 tx=0x7ff7e4006ec0).stop 2021-11-15T14:34:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 shutdown_connections 2021-11-15T14:34:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7e00536d0 0x7ff7e0055b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7fc148420 0x7ff7fc0ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7fc0b1e30 0x7ff7fc0abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 --2- 172.21.2.135:0/1382755691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7fc0a7140 0x7ff7fc0ae220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 >> 172.21.2.135:0/1382755691 conn(0x7ff7fc05f730 msgr2=0x7ff7fc144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 shutdown_connections 2021-11-15T14:34:31.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.269+0000 7ff802a26700 1 -- 172.21.2.135:0/1382755691 wait complete. 2021-11-15T14:34:31.279 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:31.279 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:31.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 Processor -- start 2021-11-15T14:34:31.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- start start 2021-11-15T14:34:31.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4198060040 0x7f4198064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41980b3950 0x7f4198065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41980b2430 con 0x7f41980b2ca0 2021-11-15T14:34:31.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4198065770 con 0x7f4198060040 2021-11-15T14:34:31.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41980b26d0 con 0x7f41980b3950 2021-11-15T14:34:31.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41980b3950 0x7f4198065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41980b3950 0x7f4198065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54708/0 (socket says 172.21.2.135:54708) 2021-11-15T14:34:31.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 -- 172.21.2.135:0/4211341473 learned_addr learned my addr 172.21.2.135:0/4211341473 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 -- 172.21.2.135:0/4211341473 >> v2:172.21.2.119:3300/0 conn(0x7f4198060040 msgr2=0x7f4198064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 --2- 172.21.2.135:0/4211341473 >> v2:172.21.2.119:3300/0 conn(0x7f4198060040 0x7f4198064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 -- 172.21.2.135:0/4211341473 >> v1:172.21.2.119:6789/0 conn(0x7f41980b2ca0 legacy=0x7f41980b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 -- 172.21.2.135:0/4211341473 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980b2970 con 0x7f41980b3950 2021-11-15T14:34:31.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419cd12700 1 --2- 172.21.2.135:0/4211341473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41980b3950 0x7f4198065280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f419813b870 tx=0x7f418c006eb0).ready entity=mon.1 client_cookie=aaaab515b00514f7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f418bfff700 1 -- 172.21.2.135:0/4211341473 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418c00d5c0 con 0x7f41980b3950 2021-11-15T14:34:31.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f418bfff700 1 -- 172.21.2.135:0/4211341473 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c000e90 con 0x7f41980b3950 2021-11-15T14:34:31.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f418bfff700 1 -- 172.21.2.135:0/4211341473 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418c00d910 con 0x7f41980b3950 2021-11-15T14:34:31.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- 172.21.2.135:0/4211341473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41980b3950 msgr2=0x7f4198065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 --2- 172.21.2.135:0/4211341473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41980b3950 0x7f4198065280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f419813b870 tx=0x7f418c006eb0).stop 2021-11-15T14:34:31.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- 172.21.2.135:0/4211341473 shutdown_connections 2021-11-15T14:34:31.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 --2- 172.21.2.135:0/4211341473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41980b3950 0x7f4198065280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 --2- 172.21.2.135:0/4211341473 >> v2:172.21.2.119:3300/0 conn(0x7f4198060040 0x7f4198064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- 172.21.2.135:0/4211341473 >> 172.21.2.135:0/4211341473 conn(0x7f419805cfe0 msgr2=0x7f419805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- 172.21.2.135:0/4211341473 shutdown_connections 2021-11-15T14:34:31.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- 172.21.2.135:0/4211341473 wait complete. 2021-11-15T14:34:31.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 Processor -- start 2021-11-15T14:34:31.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.329+0000 7f419f777700 1 -- start start 2021-11-15T14:34:31.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41980b2ca0 0x7f41980afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41980b3950 0x7f4198151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b0060 con 0x7f41980b3950 2021-11-15T14:34:31.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980ae840 con 0x7f4198060040 2021-11-15T14:34:31.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b66a0 con 0x7f41980b2ca0 2021-11-15T14:34:31.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54710/0 (socket says 172.21.2.135:54710) 2021-11-15T14:34:31.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 -- 172.21.2.135:0/1196254782 learned_addr learned my addr 172.21.2.135:0/1196254782 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 -- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41980b2ca0 msgr2=0x7f41980afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41980b2ca0 0x7f41980afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 -- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41980b3950 msgr2=0x7f4198151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41980b3950 0x7f4198151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 -- 172.21.2.135:0/1196254782 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c00b1e0 con 0x7f4198060040 2021-11-15T14:34:31.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419d513700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4194002f70 tx=0x7f4194006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4194013460 con 0x7f4198060040 2021-11-15T14:34:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940135c0 con 0x7f4198060040 2021-11-15T14:34:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4194013920 con 0x7f4198060040 2021-11-15T14:34:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41980b6940 con 0x7f4198060040 2021-11-15T14:34:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4198140930 con 0x7f4198060040 2021-11-15T14:34:31.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41980aea00 con 0x7f4198060040 2021-11-15T14:34:31.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f419401a060 con 0x7f4198060040 2021-11-15T14:34:31.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 0x7f4178055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f419406b690 con 0x7f4198060040 2021-11-15T14:34:31.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.333+0000 7f419cd12700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 0x7f4178055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.337+0000 7f419cd12700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 0x7f4178055b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f419813b870 tx=0x7f418c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.337+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41980aea00 con 0x7f4198060040 2021-11-15T14:34:31.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41980ae9d0 con 0x7f4198060040 2021-11-15T14:34:31.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f418a7fc700 1 -- 172.21.2.135:0/1196254782 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4194018070 con 0x7f4198060040 2021-11-15T14:34:31.421 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:31.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 msgr2=0x7f4178055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 0x7f4178055b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f419813b870 tx=0x7f418c015000).stop 2021-11-15T14:34:31.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 msgr2=0x7f4198141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.417+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4194002f70 tx=0x7f4194006ec0).stop 2021-11-15T14:34:31.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 shutdown_connections 2021-11-15T14:34:31.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4178053690 0x7f4178055b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41980b3950 0x7f4198151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41980b2ca0 0x7f41980afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 --2- 172.21.2.135:0/1196254782 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4198060040 0x7f4198141ff0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 >> 172.21.2.135:0/1196254782 conn(0x7f419805cfe0 msgr2=0x7f419805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 shutdown_connections 2021-11-15T14:34:31.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.421+0000 7f419f777700 1 -- 172.21.2.135:0/1196254782 wait complete. 2021-11-15T14:34:31.428 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:31.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 Processor -- start 2021-11-15T14:34:31.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- start start 2021-11-15T14:34:31.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a00654a0 0x7f99a01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99a00b3950 0x7f99a01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00b2430 con 0x7f99a0060040 2021-11-15T14:34:31.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00b26d0 con 0x7f99a00b3950 2021-11-15T14:34:31.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00b2970 con 0x7f99a00654a0 2021-11-15T14:34:31.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99a00b3950 0x7f99a01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99a00b3950 0x7f99a01449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54718/0 (socket says 172.21.2.135:54718) 2021-11-15T14:34:31.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 -- 172.21.2.135:0/2978793693 learned_addr learned my addr 172.21.2.135:0/2978793693 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 -- 172.21.2.135:0/2978793693 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a00654a0 msgr2=0x7f99a01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 --2- 172.21.2.135:0/2978793693 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a00654a0 0x7f99a01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 -- 172.21.2.135:0/2978793693 >> v1:172.21.2.119:6789/0 conn(0x7f99a0060040 legacy=0x7f99a0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 -- 172.21.2.135:0/2978793693 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00648f0 con 0x7f99a00b3950 2021-11-15T14:34:31.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a4b30700 1 --2- 172.21.2.135:0/2978793693 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01449b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f99a0064c70 tx=0x7f9998009290).ready entity=mon.1 client_cookie=a848cf5ae72a3b1d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f999effd700 1 -- 172.21.2.135:0/2978793693 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999800b860 con 0x7f99a00b3950 2021-11-15T14:34:31.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f999effd700 1 -- 172.21.2.135:0/2978793693 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800b9c0 con 0x7f99a00b3950 2021-11-15T14:34:31.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f999effd700 1 -- 172.21.2.135:0/2978793693 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999800bb70 con 0x7f99a00b3950 2021-11-15T14:34:31.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- 172.21.2.135:0/2978793693 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 msgr2=0x7f99a01449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 --2- 172.21.2.135:0/2978793693 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01449b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f99a0064c70 tx=0x7f9998009290).stop 2021-11-15T14:34:31.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- 172.21.2.135:0/2978793693 shutdown_connections 2021-11-15T14:34:31.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 --2- 172.21.2.135:0/2978793693 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01449b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 --2- 172.21.2.135:0/2978793693 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a00654a0 0x7f99a01444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- 172.21.2.135:0/2978793693 >> 172.21.2.135:0/2978793693 conn(0x7f99a005cfe0 msgr2=0x7f99a005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- 172.21.2.135:0/2978793693 shutdown_connections 2021-11-15T14:34:31.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- 172.21.2.135:0/2978793693 wait complete. 2021-11-15T14:34:31.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 Processor -- start 2021-11-15T14:34:31.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.477+0000 7f99a6593700 1 -- start start 2021-11-15T14:34:31.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a0060040 0x7f99a0142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99a00654a0 0x7f99a01571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00aff40 con 0x7f99a00654a0 2021-11-15T14:34:31.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0156b30 con 0x7f99a00b3950 2021-11-15T14:34:31.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00ac940 con 0x7f99a0060040 2021-11-15T14:34:31.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54724/0 (socket says 172.21.2.135:54724) 2021-11-15T14:34:31.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 -- 172.21.2.135:0/2329019101 learned_addr learned my addr 172.21.2.135:0/2329019101 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 -- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a0060040 msgr2=0x7f99a0142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a0060040 0x7f99a0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 -- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99a00654a0 msgr2=0x7f99a01571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99a00654a0 0x7f99a01571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 -- 172.21.2.135:0/2329019101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009530 con 0x7f99a00b3950 2021-11-15T14:34:31.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a4b30700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f99a0064c70 tx=0x7f9998016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999800b860 con 0x7f99a00b3950 2021-11-15T14:34:31.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998020620 con 0x7f99a00b3950 2021-11-15T14:34:31.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00ab6a0 con 0x7f99a00b3950 2021-11-15T14:34:31.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998020980 con 0x7f99a00b3950 2021-11-15T14:34:31.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0156d20 con 0x7f99a00b3950 2021-11-15T14:34:31.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0156ee0 con 0x7f99a00b3950 2021-11-15T14:34:31.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9998026020 con 0x7f99a00b3950 2021-11-15T14:34:31.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 0x7f9984055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f999806c8e0 con 0x7f99a00b3950 2021-11-15T14:34:31.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.481+0000 7f999ffff700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 0x7f9984055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.485+0000 7f999ffff700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 0x7f9984055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9988002f90 tx=0x7f99880069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.485+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9998043960 con 0x7f99a00b3950 2021-11-15T14:34:31.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99a00674f0 con 0x7f99a00b3950 2021-11-15T14:34:31.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f999d7fa700 1 -- 172.21.2.135:0/2329019101 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99980150a0 con 0x7f99a00b3950 2021-11-15T14:34:31.572 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:31.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 msgr2=0x7f9984055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 0x7f9984055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9988002f90 tx=0x7f99880069b0).stop 2021-11-15T14:34:31.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 msgr2=0x7f99a01576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f99a0064c70 tx=0x7f9998016000).stop 2021-11-15T14:34:31.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 shutdown_connections 2021-11-15T14:34:31.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9984053610 0x7f9984055ad0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99a00b3950 0x7f99a01576b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99a00654a0 0x7f99a01571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 --2- 172.21.2.135:0/2329019101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99a0060040 0x7f99a0142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 >> 172.21.2.135:0/2329019101 conn(0x7f99a005cfe0 msgr2=0x7f99a00ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 shutdown_connections 2021-11-15T14:34:31.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.569+0000 7f99a6593700 1 -- 172.21.2.135:0/2329019101 wait complete. 2021-11-15T14:34:31.579 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 Processor -- start 2021-11-15T14:34:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 -- start start 2021-11-15T14:34:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e740654a0 0x7f7e741444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b2430 con 0x7f7e740b3950 2021-11-15T14:34:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b26d0 con 0x7f7e74060040 2021-11-15T14:34:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e7afd6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740b2970 con 0x7f7e740654a0 2021-11-15T14:34:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e78d72700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7e74060040 0x7f7e74064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42320/0 (socket says 172.21.2.135:42320) 2021-11-15T14:34:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e78d72700 1 -- 172.21.2.135:0/646861711 learned_addr learned my addr 172.21.2.135:0/646861711 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143278786 0 0) 0x7f7e740b26d0 con 0x7f7e74060040 2021-11-15T14:34:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e54003260 con 0x7f7e74060040 2021-11-15T14:34:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 --2- 172.21.2.135:0/646861711 >> v2:172.21.2.119:3300/0 conn(0x7f7e740654a0 0x7f7e741444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076173600 0 0) 0x7f7e54003260 con 0x7f7e74060040 2021-11-15T14:34:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 >> v2:172.21.2.119:3300/0 conn(0x7f7e740654a0 msgr2=0x7f7e741444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 --2- 172.21.2.135:0/646861711 >> v2:172.21.2.119:3300/0 conn(0x7f7e740654a0 0x7f7e741444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 >> v1:172.21.2.119:6789/0 conn(0x7f7e740b3950 legacy=0x7f7e741449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740648f0 con 0x7f7e74060040 2021-11-15T14:34:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7e5c001660 con 0x7f7e74060040 2021-11-15T14:34:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 >> v1:172.21.2.135:6789/0 conn(0x7f7e74060040 legacy=0x7f7e74064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e54003820 0x7f7e54003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 0x7f7e54004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54005050 0x7f7e5400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740b2970 con 0x7f7e54003820 2021-11-15T14:34:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5400bf40 con 0x7f7e54004500 2021-11-15T14:34:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5400c100 con 0x7f7e54005050 2021-11-15T14:34:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 0x7f7e54004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 -- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54005050 msgr2=0x7f7e5400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54005050 0x7f7e5400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 -- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e54003820 msgr2=0x7f7e54003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e54003820 0x7f7e54003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 -- 172.21.2.135:0/646861711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54003260 con 0x7f7e54004500 2021-11-15T14:34:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e79573700 1 -- 172.21.2.135:0/646861711 reap_dead start 2021-11-15T14:34:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e73fff700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 0x7f7e54004980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7e64007000 tx=0x7f7e64008040).ready entity=mon.1 client_cookie=6036c100d498b694 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e64012470 con 0x7f7e54004500 2021-11-15T14:34:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400c030 con 0x7f7e54004500 2021-11-15T14:34:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.629+0000 7f7e737fe700 1 -- 172.21.2.135:0/646861711 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e640127c0 con 0x7f7e54004500 2021-11-15T14:34:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 msgr2=0x7f7e54004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 0x7f7e54004980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7e64007000 tx=0x7f7e64008040).stop 2021-11-15T14:34:31.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/646861711 shutdown_connections 2021-11-15T14:34:31.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/646861711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e54004500 0x7f7e54004980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/646861711 >> 172.21.2.135:0/646861711 conn(0x7f7e7405cfe0 msgr2=0x7f7e7405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/646861711 shutdown_connections 2021-11-15T14:34:31.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/646861711 wait complete. 2021-11-15T14:34:31.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 Processor -- start 2021-11-15T14:34:31.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- start start 2021-11-15T14:34:31.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54004500 0x7f7e740b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e740ac4c0 0x7f7e740ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740ab290 con 0x7f7e740ac4c0 2021-11-15T14:34:31.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740abdf0 con 0x7f7e7413b8b0 2021-11-15T14:34:31.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740b6fd0 con 0x7f7e54004500 2021-11-15T14:34:31.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54748/0 (socket says 172.21.2.135:54748) 2021-11-15T14:34:31.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 -- 172.21.2.135:0/47574358 learned_addr learned my addr 172.21.2.135:0/47574358 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 -- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54004500 msgr2=0x7f7e740b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54004500 0x7f7e740b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 -- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e740ac4c0 msgr2=0x7f7e740ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e740ac4c0 0x7f7e740ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 -- 172.21.2.135:0/47574358 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740aad50 con 0x7f7e7413b8b0 2021-11-15T14:34:31.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e79573700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7e7413bce0 tx=0x7f7e6c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6c004850 con 0x7f7e7413b8b0 2021-11-15T14:34:31.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c0049b0 con 0x7f7e7413b8b0 2021-11-15T14:34:31.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6c004d10 con 0x7f7e7413b8b0 2021-11-15T14:34:31.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740aaff0 con 0x7f7e7413b8b0 2021-11-15T14:34:31.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740b53d0 con 0x7f7e7413b8b0 2021-11-15T14:34:31.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e740b6e30 con 0x7f7e7413b8b0 2021-11-15T14:34:31.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e6c01c070 con 0x7f7e7413b8b0 2021-11-15T14:34:31.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 0x7f7e580559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.633+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f7e6c06ab70 con 0x7f7e7413b8b0 2021-11-15T14:34:31.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.637+0000 7f7e78d72700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 0x7f7e580559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.637+0000 7f7e78d72700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 0x7f7e580559e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7e7413b870 tx=0x7f7e74064a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.637+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e740b6e30 con 0x7f7e7413b8b0 2021-11-15T14:34:31.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.721+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e740b6e30 con 0x7f7e7413b8b0 2021-11-15T14:34:31.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.721+0000 7f7e71ffb700 1 -- 172.21.2.135:0/47574358 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7e740b6e30 con 0x7f7e7413b8b0 2021-11-15T14:34:31.726 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:31.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 msgr2=0x7f7e580559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 0x7f7e580559e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7e7413b870 tx=0x7f7e74064a80).stop 2021-11-15T14:34:31.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 msgr2=0x7f7e740adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7e7413bce0 tx=0x7f7e6c007dc0).stop 2021-11-15T14:34:31.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 shutdown_connections 2021-11-15T14:34:31.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e58053520 0x7f7e580559e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e7413b8b0 0x7f7e740adcb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e740ac4c0 0x7f7e740ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 --2- 172.21.2.135:0/47574358 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e54004500 0x7f7e740b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 >> 172.21.2.135:0/47574358 conn(0x7f7e7405cfe0 msgr2=0x7f7e7413ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 shutdown_connections 2021-11-15T14:34:31.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.725+0000 7f7e7afd6700 1 -- 172.21.2.135:0/47574358 wait complete. 2021-11-15T14:34:31.733 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:31.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 Processor -- start 2021-11-15T14:34:31.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 -- start start 2021-11-15T14:34:31.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5eb41469d0 0x7f5eb41402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5eb40b4710 0x7f5eb40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb4143be0 con 0x7f5eb40b4200 2021-11-15T14:34:31.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb4147590 con 0x7f5eb41469d0 2021-11-15T14:34:31.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.781+0000 7f5ebb3f9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb4143e80 con 0x7f5eb40b4710 2021-11-15T14:34:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb8994700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5eb40b4200 0x7f5eb41407a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42342/0 (socket says 172.21.2.135:42342) 2021-11-15T14:34:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb8994700 1 -- 172.21.2.135:0/2674209665 learned_addr learned my addr 172.21.2.135:0/2674209665 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/2674209665 >> v2:172.21.2.135:3300/0 conn(0x7f5eb40b4710 0x7f5eb40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/2674209665 >> v2:172.21.2.119:3300/0 conn(0x7f5eb41469d0 msgr2=0x7f5eb41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/2674209665 >> v2:172.21.2.119:3300/0 conn(0x7f5eb41469d0 0x7f5eb41402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/2674209665 >> v1:172.21.2.135:6789/0 conn(0x7f5eb40b4200 legacy=0x7f5eb41407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/2674209665 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40b0d10 con 0x7f5eb40b4710 2021-11-15T14:34:31.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/2674209665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb40b4710 0x7f5eb40b4f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5eb0001110 tx=0x7f5eac0091d0).ready entity=mon.1 client_cookie=d85066962bc01961 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea3fff700 1 -- 172.21.2.135:0/2674209665 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eac009ea0 con 0x7f5eb40b4710 2021-11-15T14:34:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea3fff700 1 -- 172.21.2.135:0/2674209665 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac00b730 con 0x7f5eb40b4710 2021-11-15T14:34:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea3fff700 1 -- 172.21.2.135:0/2674209665 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eac00b8a0 con 0x7f5eb40b4710 2021-11-15T14:34:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/2674209665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb40b4710 msgr2=0x7f5eb40b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/2674209665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb40b4710 0x7f5eb40b4f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5eb0001110 tx=0x7f5eac0091d0).stop 2021-11-15T14:34:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/2674209665 shutdown_connections 2021-11-15T14:34:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/2674209665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb40b4710 0x7f5eb40b4f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/2674209665 >> v2:172.21.2.119:3300/0 conn(0x7f5eb41469d0 0x7f5eb41402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/2674209665 >> 172.21.2.135:0/2674209665 conn(0x7f5eb405c510 msgr2=0x7f5eb405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/2674209665 shutdown_connections 2021-11-15T14:34:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/2674209665 wait complete. 2021-11-15T14:34:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 Processor -- start 2021-11-15T14:34:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- start start 2021-11-15T14:34:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5eb40b4200 0x7f5eb40aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5eb40b4710 0x7f5eb414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb41503e0 con 0x7f5eb40b4710 2021-11-15T14:34:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb40b8990 con 0x7f5eb41469d0 2021-11-15T14:34:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4152fd0 con 0x7f5eb40b4200 2021-11-15T14:34:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54762/0 (socket says 172.21.2.135:54762) 2021-11-15T14:34:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/60529475 learned_addr learned my addr 172.21.2.135:0/60529475 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5eb40b4200 msgr2=0x7f5eb40aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5eb40b4200 0x7f5eb40aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5eb40b4710 msgr2=0x7f5eb414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5eb40b4710 0x7f5eb414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 -- 172.21.2.135:0/60529475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009470 con 0x7f5eb41469d0 2021-11-15T14:34:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5eb9996700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5eb40b8ad0 tx=0x7f5eac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eac006ea0 con 0x7f5eb41469d0 2021-11-15T14:34:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac021440 con 0x7f5eb41469d0 2021-11-15T14:34:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb4153240 con 0x7f5eb41469d0 2021-11-15T14:34:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eac009ea0 con 0x7f5eb41469d0 2021-11-15T14:34:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.785+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb40b84f0 con 0x7f5eb41469d0 2021-11-15T14:34:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb40573d0 con 0x7f5eb41469d0 2021-11-15T14:34:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5eac027020 con 0x7f5eb41469d0 2021-11-15T14:34:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5ea27fc700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 0x7f5e94055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5eac06cdb0 con 0x7f5eb41469d0 2021-11-15T14:34:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5eb9195700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 0x7f5e94055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5eb9195700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 0x7f5e94055a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ea4002f70 tx=0x7f5ea4006a90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.789+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5eac043ca0 con 0x7f5eb41469d0 2021-11-15T14:34:31.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.873+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eb40b70a0 con 0x7f5eb41469d0 2021-11-15T14:34:31.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.873+0000 7f5ea27fc700 1 -- 172.21.2.135:0/60529475 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5eac015020 con 0x7f5eb41469d0 2021-11-15T14:34:31.878 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 msgr2=0x7f5e94055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 0x7f5e94055a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ea4002f70 tx=0x7f5ea4006a90).stop 2021-11-15T14:34:31.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 msgr2=0x7f5eb414fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5eb40b8ad0 tx=0x7f5eac016000).stop 2021-11-15T14:34:31.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 shutdown_connections 2021-11-15T14:34:31.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e940535b0 0x7f5e94055a70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5eb41469d0 0x7f5eb414fef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5eb40b4710 0x7f5eb414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 --2- 172.21.2.135:0/60529475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5eb40b4200 0x7f5eb40aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 >> 172.21.2.135:0/60529475 conn(0x7f5eb405c510 msgr2=0x7f5eb413b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 shutdown_connections 2021-11-15T14:34:31.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.877+0000 7f5ebb3f9700 1 -- 172.21.2.135:0/60529475 wait complete. 2021-11-15T14:34:31.885 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-11-15T14:34:31.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-11-15T14:34:31.886 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-11-15T14:34:31.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 Processor -- start 2021-11-15T14:34:31.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 -- start start 2021-11-15T14:34:31.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa5f80ad150 0x7fa5f813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80b04b0 con 0x7fa5f80afca0 2021-11-15T14:34:31.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80ad530 con 0x7fa5f805d7e0 2021-11-15T14:34:31.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa600267700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80b57d0 con 0x7fa5f80ad150 2021-11-15T14:34:31.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa5f805d7e0 0x7fa5f813c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42358/0 (socket says 172.21.2.135:42358) 2021-11-15T14:34:31.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 -- 172.21.2.135:0/2691860802 learned_addr learned my addr 172.21.2.135:0/2691860802 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:31.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453033082 0 0) 0x7fa5f80ad530 con 0x7fa5f805d7e0 2021-11-15T14:34:31.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e0004370 con 0x7fa5f805d7e0 2021-11-15T14:34:31.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243793073 0 0) 0x7fa5e0004370 con 0x7fa5f805d7e0 2021-11-15T14:34:31.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 >> v2:172.21.2.119:3300/0 conn(0x7fa5f80ad150 msgr2=0x7fa5f813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 --2- 172.21.2.135:0/2691860802 >> v2:172.21.2.119:3300/0 conn(0x7fa5f80ad150 0x7fa5f813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 >> v1:172.21.2.119:6789/0 conn(0x7fa5f80afca0 legacy=0x7fa5f813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f80b06e0 con 0x7fa5f805d7e0 2021-11-15T14:34:31.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa5f00019e0 con 0x7fa5f805d7e0 2021-11-15T14:34:31.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 >> v1:172.21.2.135:6789/0 conn(0x7fa5f805d7e0 legacy=0x7fa5f813c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5e0004930 0x7fa5e0004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0005610 0x7fa5e0005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 0x7fa5e0003260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80b57d0 con 0x7fa5e0005610 2021-11-15T14:34:31.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0003a50 con 0x7fa5e0006160 2021-11-15T14:34:31.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0003c10 con 0x7fa5e0004930 2021-11-15T14:34:31.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 0x7fa5e0003260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 -- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5e0004930 msgr2=0x7fa5e0004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5e0004930 0x7fa5e0004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 -- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0005610 msgr2=0x7fa5e0005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:31.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0005610 0x7fa5e0005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 -- 172.21.2.135:0/2691860802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0004370 con 0x7fa5e0006160 2021-11-15T14:34:31.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 -- 172.21.2.135:0/2691860802 reap_dead start 2021-11-15T14:34:31.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.933+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 0x7fa5e0003260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa5f80b00d0 tx=0x7fa5f80b0870).ready entity=mon.1 client_cookie=f48a5eb7fe7b5629 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f000cbb0 con 0x7fa5e0006160 2021-11-15T14:34:31.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000cd10 con 0x7fa5e0006160 2021-11-15T14:34:31.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fd001700 1 -- 172.21.2.135:0/2691860802 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0005b80 con 0x7fa5e0006160 2021-11-15T14:34:31.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 msgr2=0x7fa5e0003260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 0x7fa5e0003260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa5f80b00d0 tx=0x7fa5f80b0870).stop 2021-11-15T14:34:31.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2691860802 shutdown_connections 2021-11-15T14:34:31.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 --2- 172.21.2.135:0/2691860802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5e0006160 0x7fa5e0003260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:31.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2691860802 >> 172.21.2.135:0/2691860802 conn(0x7fa5f8062cb0 msgr2=0x7fa5f8063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:31.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2691860802 shutdown_connections 2021-11-15T14:34:31.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2691860802 wait complete. 2021-11-15T14:34:31.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 Processor -- start 2021-11-15T14:34:31.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- start start 2021-11-15T14:34:31.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0006160 0x7fa5f8143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f8145a20 0x7fa5f81448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f814de40 con 0x7fa5e0006160 2021-11-15T14:34:31.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f814e0e0 con 0x7fa5f81437a0 2021-11-15T14:34:31.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f814e380 con 0x7fa5f8145a20 2021-11-15T14:34:31.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54780/0 (socket says 172.21.2.135:54780) 2021-11-15T14:34:31.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 -- 172.21.2.135:0/2288699197 learned_addr learned my addr 172.21.2.135:0/2288699197 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:31.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 -- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f8145a20 msgr2=0x7fa5f81448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f8145a20 0x7fa5f81448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 -- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0006160 msgr2=0x7fa5f8143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:31.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0006160 0x7fa5f8143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:31.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 -- 172.21.2.135:0/2288699197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f814e620 con 0x7fa5f81437a0 2021-11-15T14:34:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5fe804700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa5f80b00d0 tx=0x7fa5f0013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa5f81437a0 2021-11-15T14:34:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00074d0 con 0x7fa5f81437a0 2021-11-15T14:34:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f81443f0 con 0x7fa5f81437a0 2021-11-15T14:34:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0007830 con 0x7fa5f81437a0 2021-11-15T14:34:31.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f8141980 con 0x7fa5f81437a0 2021-11-15T14:34:31.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f814e7b0 con 0x7fa5f81437a0 2021-11-15T14:34:31.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa5f0010070 con 0x7fa5f81437a0 2021-11-15T14:34:31.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 0x7fa5d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:31.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.937+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa5f001a040 con 0x7fa5f81437a0 2021-11-15T14:34:31.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.941+0000 7fa5fe003700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 0x7fa5d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.941+0000 7fa5fe003700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 0x7fa5d8055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5ec002f70 tx=0x7fa5ec006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:31.941+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5f0043670 con 0x7fa5f81437a0 2021-11-15T14:34:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.045+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa5f80b5a30 con 0x7fa5f81437a0 2021-11-15T14:34:32.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.045+0000 7fa5eb7fe700 1 -- 172.21.2.135:0/2288699197 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+131253 (secure 0 0 0) 0x7fa5f0046c90 con 0x7fa5f81437a0 2021-11-15T14:34:32.051 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:32.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 msgr2=0x7fa5d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 0x7fa5d8055ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5ec002f70 tx=0x7fa5ec006a00).stop 2021-11-15T14:34:32.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 msgr2=0x7fa5f8144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa5f80b00d0 tx=0x7fa5f0013000).stop 2021-11-15T14:34:32.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 shutdown_connections 2021-11-15T14:34:32.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d8053610 0x7fa5d8055ad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f81437a0 0x7fa5f8144dd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f8145a20 0x7fa5f81448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 --2- 172.21.2.135:0/2288699197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5e0006160 0x7fa5f8143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 >> 172.21.2.135:0/2288699197 conn(0x7fa5f8062cb0 msgr2=0x7fa5f81387c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 shutdown_connections 2021-11-15T14:34:32.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.049+0000 7fa600267700 1 -- 172.21.2.135:0/2288699197 wait complete. 2021-11-15T14:34:32.057 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6800","nonce":14716},{"type":"v1","addr":"172.21.2.119:6801","nonce":14716}]},"active_addr":"172.21.2.119:6801/14716","active_change":"2021-11-15T14:34:15.047626+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.119:0","nonce":1049960189}]},{"addrvec":[{"type":"v2","addr":"172.21.2.119:0","nonce":3992817183}]},{"addrvec":[{"type":"v2","addr":"172.21.2.119:0","nonce":562876999}]}]}} 2021-11-15T14:34:32.062 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-11-15T14:34:32.062 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-11-15T14:34:32.062 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:32.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 Processor -- start 2021-11-15T14:34:32.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 -- start start 2021-11-15T14:34:32.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 0x7f07040b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 0x7f07041447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040b03d0 con 0x7f0704148420 2021-11-15T14:34:32.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040a9140 con 0x7f07040b1e30 2021-11-15T14:34:32.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.109+0000 7f0709ce0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040b0670 con 0x7f07040a7140 2021-11-15T14:34:32.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f07037fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 0x7f07040b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0702ffd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f0704148420 0x7f07040b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:51792/0 (socket says 172.21.2.135:51792) 2021-11-15T14:34:32.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0702ffd700 1 -- 172.21.2.135:0/1058854361 learned_addr learned my addr 172.21.2.135:0/1058854361 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 --2- 172.21.2.135:0/1058854361 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 0x7f07041447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 -- 172.21.2.135:0/1058854361 >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 msgr2=0x7f07040b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 --2- 172.21.2.135:0/1058854361 >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 0x7f07040b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 -- 172.21.2.135:0/1058854361 >> v1:172.21.2.119:6789/0 conn(0x7f0704148420 legacy=0x7f07040b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 -- 172.21.2.135:0/1058854361 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040b0910 con 0x7f07040a7140 2021-11-15T14:34:32.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f07037fe700 1 --2- 172.21.2.135:0/1058854361 >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 0x7f07040b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:32.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0703fff700 1 --2- 172.21.2.135:0/1058854361 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 0x7f07041447a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f07041477b0 tx=0x7f06fc0091d0).ready entity=mon.2 client_cookie=2e461bf14091196d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f07027fc700 1 -- 172.21.2.135:0/1058854361 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06fc00b680 con 0x7f07040a7140 2021-11-15T14:34:32.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f07027fc700 1 -- 172.21.2.135:0/1058854361 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00b7e0 con 0x7f07040a7140 2021-11-15T14:34:32.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f07027fc700 1 -- 172.21.2.135:0/1058854361 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06fc00b950 con 0x7f07040a7140 2021-11-15T14:34:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- 172.21.2.135:0/1058854361 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 msgr2=0x7f07041447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1058854361 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 0x7f07041447a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f07041477b0 tx=0x7f06fc0091d0).stop 2021-11-15T14:34:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- 172.21.2.135:0/1058854361 shutdown_connections 2021-11-15T14:34:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1058854361 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040a7140 0x7f07041447a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1058854361 >> v2:172.21.2.119:3300/0 conn(0x7f07040b1e30 0x7f07040b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- 172.21.2.135:0/1058854361 >> 172.21.2.135:0/1058854361 conn(0x7f070405f730 msgr2=0x7f070405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- 172.21.2.135:0/1058854361 shutdown_connections 2021-11-15T14:34:32.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- 172.21.2.135:0/1058854361 wait complete. 2021-11-15T14:34:32.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 Processor -- start 2021-11-15T14:34:32.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.113+0000 7f0709ce0700 1 -- start start 2021-11-15T14:34:32.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040b1e30 0x7f07040abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0704148420 0x7f07040adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040ac400 con 0x7f0704148420 2021-11-15T14:34:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704149760 con 0x7f07040a7140 2021-11-15T14:34:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040aa0c0 con 0x7f07040b1e30 2021-11-15T14:34:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54792/0 (socket says 172.21.2.135:54792) 2021-11-15T14:34:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 -- 172.21.2.135:0/1934602267 learned_addr learned my addr 172.21.2.135:0/1934602267 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 -- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040b1e30 msgr2=0x7f07040abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040b1e30 0x7f07040abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 -- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0704148420 msgr2=0x7f07040adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0704148420 0x7f07040adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 -- 172.21.2.135:0/1934602267 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec00b180 con 0x7f07040a7140 2021-11-15T14:34:32.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f07037fe700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f06ec00c000 tx=0x7f06ec006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec00ca40 con 0x7f07040a7140 2021-11-15T14:34:32.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00cba0 con 0x7f07040a7140 2021-11-15T14:34:32.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc009470 con 0x7f07040a7140 2021-11-15T14:34:32.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040aa910 con 0x7f07040a7140 2021-11-15T14:34:32.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec0123f0 con 0x7f07040a7140 2021-11-15T14:34:32.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0704157110 con 0x7f07040a7140 2021-11-15T14:34:32.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06ec012550 con 0x7f07040a7140 2021-11-15T14:34:32.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f06ec06c200 con 0x7f07040a7140 2021-11-15T14:34:32.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0702ffd700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.117+0000 7f0702ffd700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f07040b31f0 tx=0x7f06f4007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.121+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06ec043090 con 0x7f07040a7140 2021-11-15T14:34:32.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0704157470 con 0x7f07040a7140 2021-11-15T14:34:32.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0700ff9700 1 -- 172.21.2.135:0/1934602267 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f06ec0466b0 con 0x7f07040a7140 2021-11-15T14:34:32.208 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:32.208 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:32.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 msgr2=0x7f06e8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f07040b31f0 tx=0x7f06f4007800).stop 2021-11-15T14:34:32.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 msgr2=0x7f0704156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f06ec00c000 tx=0x7f06ec006df0).stop 2021-11-15T14:34:32.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 shutdown_connections 2021-11-15T14:34:32.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0704148420 0x7f07040adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07040b1e30 0x7f07040abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 --2- 172.21.2.135:0/1934602267 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07040a7140 0x7f0704156c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 >> 172.21.2.135:0/1934602267 conn(0x7f070405f730 msgr2=0x7f07041448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 shutdown_connections 2021-11-15T14:34:32.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.205+0000 7f0709ce0700 1 -- 172.21.2.135:0/1934602267 wait complete. 2021-11-15T14:34:32.215 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-11-15T14:34:32.215 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.261+0000 7f77b9d10700 1 Processor -- start 2021-11-15T14:34:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.261+0000 7f77b9d10700 1 -- start start 2021-11-15T14:34:32.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f77b40b6600 0x7f77b40b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b4144130 con 0x7f77b40b4440 2021-11-15T14:34:32.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b4143bf0 con 0x7f77b40b69e0 2021-11-15T14:34:32.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b4143e90 con 0x7f77b40b6600 2021-11-15T14:34:32.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b3fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f77b40b69e0 0x7f77b412ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42392/0 (socket says 172.21.2.135:42392) 2021-11-15T14:34:32.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b3fff700 1 -- 172.21.2.135:0/2971191689 learned_addr learned my addr 172.21.2.135:0/2971191689 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- 172.21.2.135:0/2971191689 >> v2:172.21.2.135:3300/0 conn(0x7f77b40b6600 0x7f77b40b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/2971191689 >> v1:172.21.2.135:6789/0 conn(0x7f77b40b69e0 legacy=0x7f77b412ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/2971191689 >> v1:172.21.2.119:6789/0 conn(0x7f77b40b4440 legacy=0x7f77b4061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/2971191689 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4061670 con 0x7f77b40b6600 2021-11-15T14:34:32.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- 172.21.2.135:0/2971191689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b6600 0x7f77b40b5c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f77b41431a0 tx=0x7f77a4006df0).ready entity=mon.1 client_cookie=25bc6b1bd346b274 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b27fc700 1 -- 172.21.2.135:0/2971191689 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a400d5c0 con 0x7f77b40b6600 2021-11-15T14:34:32.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b27fc700 1 -- 172.21.2.135:0/2971191689 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4000e90 con 0x7f77b40b6600 2021-11-15T14:34:32.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b27fc700 1 -- 172.21.2.135:0/2971191689 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a400d910 con 0x7f77b40b6600 2021-11-15T14:34:32.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- 172.21.2.135:0/2971191689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b6600 msgr2=0x7f77b40b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- 172.21.2.135:0/2971191689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b6600 0x7f77b40b5c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f77b41431a0 tx=0x7f77a4006df0).stop 2021-11-15T14:34:32.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- 172.21.2.135:0/2971191689 shutdown_connections 2021-11-15T14:34:32.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- 172.21.2.135:0/2971191689 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b6600 0x7f77b40b5c70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- 172.21.2.135:0/2971191689 >> 172.21.2.135:0/2971191689 conn(0x7f77b405c510 msgr2=0x7f77b405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- 172.21.2.135:0/2971191689 shutdown_connections 2021-11-15T14:34:32.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- 172.21.2.135:0/2971191689 wait complete. 2021-11-15T14:34:32.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 Processor -- start 2021-11-15T14:34:32.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- start start 2021-11-15T14:34:32.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40b6600 0x7f77b412b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b69e0 0x7f77b41404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b412c880 con 0x7f77b40b6600 2021-11-15T14:34:32.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4126aa0 con 0x7f77b40b4440 2021-11-15T14:34:32.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b9d10700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4126d40 con 0x7f77b40b69e0 2021-11-15T14:34:32.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54806/0 (socket says 172.21.2.135:54806) 2021-11-15T14:34:32.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/3950206213 learned_addr learned my addr 172.21.2.135:0/3950206213 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b69e0 msgr2=0x7f77b41404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b69e0 0x7f77b41404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40b6600 msgr2=0x7f77b412b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40b6600 0x7f77b412b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 -- 172.21.2.135:0/3950206213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a400b180 con 0x7f77b40b4440 2021-11-15T14:34:32.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.265+0000 7f77b37fe700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f77b41431a0 tx=0x7f77a4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a4002f70 con 0x7f77b40b4440 2021-11-15T14:34:32.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b40b3080 con 0x7f77b40b4440 2021-11-15T14:34:32.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b412c370 con 0x7f77b40b4440 2021-11-15T14:34:32.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a401e400 con 0x7f77b40b4440 2021-11-15T14:34:32.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a401e760 con 0x7f77b40b4440 2021-11-15T14:34:32.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b412b4d0 con 0x7f77b40b4440 2021-11-15T14:34:32.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f77a4025030 con 0x7f77b40b4440 2021-11-15T14:34:32.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 0x7f7798055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f77a406ca70 con 0x7f77b40b4440 2021-11-15T14:34:32.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b2ffd700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 0x7f7798055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b2ffd700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 0x7f7798055ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f779c002f90 tx=0x7f779c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.269+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77a4043a70 con 0x7f77b40b4440 2021-11-15T14:34:32.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77b4061910 con 0x7f77b40b4440 2021-11-15T14:34:32.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b0ff9700 1 -- 172.21.2.135:0/3950206213 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f77a4023090 con 0x7f77b40b4440 2021-11-15T14:34:32.356 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:32.356 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 msgr2=0x7f7798055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 0x7f7798055ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f779c002f90 tx=0x7f779c0069b0).stop 2021-11-15T14:34:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 msgr2=0x7f77b4141760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f77b41431a0 tx=0x7f77a4014000).stop 2021-11-15T14:34:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 shutdown_connections 2021-11-15T14:34:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053610 0x7f7798055ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b69e0 0x7f77b41404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40b6600 0x7f77b412b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 --2- 172.21.2.135:0/3950206213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b4440 0x7f77b4141760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 >> 172.21.2.135:0/3950206213 conn(0x7f77b405c510 msgr2=0x7f77b41431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 shutdown_connections 2021-11-15T14:34:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.353+0000 7f77b9d10700 1 -- 172.21.2.135:0/3950206213 wait complete. 2021-11-15T14:34:32.363 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-11-15T14:34:32.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.409+0000 7fecb8cd8700 1 Processor -- start 2021-11-15T14:34:32.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.409+0000 7fecb8cd8700 1 -- start start 2021-11-15T14:34:32.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fecb40b6600 0x7fecb40b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fecb40b69e0 0x7fecb412ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb4144130 con 0x7fecb40b4440 2021-11-15T14:34:32.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb4143bf0 con 0x7fecb40b6600 2021-11-15T14:34:32.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb4143e90 con 0x7fecb40b69e0 2021-11-15T14:34:32.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fecb40b69e0 0x7fecb412ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb1d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fecb40b4440 0x7fecb4061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42404/0 (socket says 172.21.2.135:42404) 2021-11-15T14:34:32.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb1d9b700 1 -- 172.21.2.135:0/4925496 learned_addr learned my addr 172.21.2.135:0/4925496 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 -- 172.21.2.135:0/4925496 >> v2:172.21.2.119:3300/0 conn(0x7fecb40b6600 msgr2=0x7fecb40b5c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:32.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 --2- 172.21.2.135:0/4925496 >> v2:172.21.2.119:3300/0 conn(0x7fecb40b6600 0x7fecb40b5c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 -- 172.21.2.135:0/4925496 >> v1:172.21.2.135:6789/0 conn(0x7fecb40b4440 legacy=0x7fecb4061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 -- 172.21.2.135:0/4925496 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4061670 con 0x7fecb40b69e0 2021-11-15T14:34:32.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb2d9d700 1 --2- 172.21.2.135:0/4925496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b69e0 0x7fecb412ba80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fecb41431a0 tx=0x7feca40091d0).ready entity=mon.1 client_cookie=39ee595ab6a02407 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb159a700 1 -- 172.21.2.135:0/4925496 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca4009ea0 con 0x7fecb40b69e0 2021-11-15T14:34:32.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb159a700 1 -- 172.21.2.135:0/4925496 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400b860 con 0x7fecb40b69e0 2021-11-15T14:34:32.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb159a700 1 -- 172.21.2.135:0/4925496 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca400ba10 con 0x7fecb40b69e0 2021-11-15T14:34:32.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/4925496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b69e0 msgr2=0x7fecb412ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/4925496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b69e0 0x7fecb412ba80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fecb41431a0 tx=0x7feca40091d0).stop 2021-11-15T14:34:32.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/4925496 shutdown_connections 2021-11-15T14:34:32.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/4925496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b69e0 0x7fecb412ba80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/4925496 >> v2:172.21.2.119:3300/0 conn(0x7fecb40b6600 0x7fecb40b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/4925496 >> 172.21.2.135:0/4925496 conn(0x7fecb405c510 msgr2=0x7fecb405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/4925496 shutdown_connections 2021-11-15T14:34:32.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/4925496 wait complete. 2021-11-15T14:34:32.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 Processor -- start 2021-11-15T14:34:32.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- start start 2021-11-15T14:34:32.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 0x7fecb4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fecb40b6600 0x7fecb40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fecb40b69e0 0x7fecb412ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4153560 con 0x7fecb40b69e0 2021-11-15T14:34:32.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ad740 con 0x7fecb40b4440 2021-11-15T14:34:32.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ad9e0 con 0x7fecb40b6600 2021-11-15T14:34:32.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 0x7fecb4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 0x7fecb4153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54820/0 (socket says 172.21.2.135:54820) 2021-11-15T14:34:32.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 -- 172.21.2.135:0/2655245475 learned_addr learned my addr 172.21.2.135:0/2655245475 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 -- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fecb40b6600 msgr2=0x7fecb40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fecb40b6600 0x7fecb40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 -- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fecb40b69e0 msgr2=0x7fecb412ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fecb40b69e0 0x7fecb412ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009470 con 0x7fecb40b4440 2021-11-15T14:34:32.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb259c700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 0x7fecb4153070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fecb41536a0 tx=0x7fec9c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec9c013460 con 0x7fecb40b4440 2021-11-15T14:34:32.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0135c0 con 0x7fecb40b4440 2021-11-15T14:34:32.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec9c013920 con 0x7fecb40b4440 2021-11-15T14:34:32.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40adc80 con 0x7fecb40b4440 2021-11-15T14:34:32.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb4126e10 con 0x7fecb40b4440 2021-11-15T14:34:32.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.413+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecb4125040 con 0x7fecb40b4440 2021-11-15T14:34:32.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec9c00f070 con 0x7fecb40b4440 2021-11-15T14:34:32.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fec980536d0 0x7fec98055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fec9c06b180 con 0x7fecb40b4440 2021-11-15T14:34:32.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7fec9805b150 0x7fec9805d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec9805db30 con 0x7fec9805b150 2021-11-15T14:34:32.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec9c06d810 con 0x7fecb40b4440 2021-11-15T14:34:32.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecb2d9d700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7fec9805b150 0x7fec9805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecb1d9b700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fec980536d0 0x7fec98055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecb2d9d700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7fec9805b150 0x7fec9805d570 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== osd.0 v2:172.21.2.135:6816/14883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fec9805db30 con 0x7fec9805b150 2021-11-15T14:34:32.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.417+0000 7fecb1d9b700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fec980536d0 0x7fec98055b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fecb40b1d00 tx=0x7fecac0077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 --> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecb4061910 con 0x7fec9805b150 2021-11-15T14:34:32.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecab7fe700 1 -- 172.21.2.135:0/2655245475 <== osd.0 v2:172.21.2.135:6816/14883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecb4061910 con 0x7fec9805b150 2021-11-15T14:34:32.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7fec9805b150 msgr2=0x7fec9805d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7fec9805b150 0x7fec9805d570 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fec980536d0 msgr2=0x7fec98055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fec980536d0 0x7fec98055b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fecb40b1d00 tx=0x7fecac0077d0).stop 2021-11-15T14:34:32.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 msgr2=0x7fecb4153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 --2- 172.21.2.135:0/2655245475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fecb40b4440 0x7fecb4153070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fecb41536a0 tx=0x7fec9c006df0).stop 2021-11-15T14:34:32.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb2d9d700 1 -- 172.21.2.135:0/2655245475 reap_dead start 2021-11-15T14:34:32.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 shutdown_connections 2021-11-15T14:34:32.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 >> 172.21.2.135:0/2655245475 conn(0x7fecb405c510 msgr2=0x7fecb41431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 shutdown_connections 2021-11-15T14:34:32.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.425+0000 7fecb8cd8700 1 -- 172.21.2.135:0/2655245475 wait complete. 2021-11-15T14:34:32.435 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:32.435 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-11-15T14:34:32.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.481+0000 7fc17288e700 1 Processor -- start 2021-11-15T14:34:32.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.481+0000 7fc17288e700 1 -- start start 2021-11-15T14:34:32.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc16c060180 0x7fc16c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc16c067380 0x7fc16c143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c0b4cc0 0x7fc16c143e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c0aac30 con 0x7fc16c067380 2021-11-15T14:34:32.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c060560 con 0x7fc16c060180 2021-11-15T14:34:32.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c066f20 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc16c060180 0x7fc16c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc16c060180 0x7fc16c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54828/0 (socket says 172.21.2.135:54828) 2021-11-15T14:34:32.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 -- 172.21.2.135:0/633666008 learned_addr learned my addr 172.21.2.135:0/633666008 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 -- 172.21.2.135:0/633666008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c0b4cc0 msgr2=0x7fc16c143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 --2- 172.21.2.135:0/633666008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c0b4cc0 0x7fc16c143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 -- 172.21.2.135:0/633666008 >> v2:172.21.2.119:3300/0 conn(0x7fc16c067380 msgr2=0x7fc16c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 --2- 172.21.2.135:0/633666008 >> v2:172.21.2.119:3300/0 conn(0x7fc16c067380 0x7fc16c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 -- 172.21.2.135:0/633666008 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c144350 con 0x7fc16c060180 2021-11-15T14:34:32.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16bfff700 1 --2- 172.21.2.135:0/633666008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c060180 0x7fc16c0b47d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c006eb0).ready entity=mon.1 client_cookie=b514c50078d2fa94 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16affd700 1 -- 172.21.2.135:0/633666008 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc15c010b60 con 0x7fc16c060180 2021-11-15T14:34:32.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16affd700 1 -- 172.21.2.135:0/633666008 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c000e90 con 0x7fc16c060180 2021-11-15T14:34:32.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc16affd700 1 -- 172.21.2.135:0/633666008 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc15c0183d0 con 0x7fc16c060180 2021-11-15T14:34:32.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/633666008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c060180 msgr2=0x7fc16c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- 172.21.2.135:0/633666008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c060180 0x7fc16c0b47d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c006eb0).stop 2021-11-15T14:34:32.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/633666008 shutdown_connections 2021-11-15T14:34:32.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- 172.21.2.135:0/633666008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c0b4cc0 0x7fc16c143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- 172.21.2.135:0/633666008 >> v2:172.21.2.119:3300/0 conn(0x7fc16c067380 0x7fc16c143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- 172.21.2.135:0/633666008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c060180 0x7fc16c0b47d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/633666008 >> 172.21.2.135:0/633666008 conn(0x7fc16c05cfb0 msgr2=0x7fc16c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/633666008 shutdown_connections 2021-11-15T14:34:32.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/633666008 wait complete. 2021-11-15T14:34:32.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 Processor -- start 2021-11-15T14:34:32.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- start start 2021-11-15T14:34:32.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc16c060180 0x7fc16c13f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c067380 0x7fc16c061ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 0x7fc16c0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0ad500 con 0x7fc16c060180 2021-11-15T14:34:32.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0ab5a0 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0ae9c0 con 0x7fc16c067380 2021-11-15T14:34:32.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 0x7fc16c0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 0x7fc16c0abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54836/0 (socket says 172.21.2.135:54836) 2021-11-15T14:34:32.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 -- 172.21.2.135:0/3447245063 learned_addr learned my addr 172.21.2.135:0/3447245063 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 -- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c067380 msgr2=0x7fc16c061ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc16c067380 0x7fc16c061ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 -- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc16c060180 msgr2=0x7fc16c13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc16c060180 0x7fc16c13f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c00b1e0 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc170e2b700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 0x7fc16c0abab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc16c0ae790 tx=0x7fc1640091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164005c30 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164005d90 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c13fb60 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164006220 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.485+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c0b0af0 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc16c0ae840 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc16400f030 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc150053660 0x7fc150055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc16406bc50 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc15005b160 0x7fc15005d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc15005db40 con 0x7fc15005b160 2021-11-15T14:34:32.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc16406e260 con 0x7fc16c0b4cc0 2021-11-15T14:34:32.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc16b7fe700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc15005b160 0x7fc15005d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc16bfff700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc150053660 0x7fc150055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc16b7fe700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc15005b160 0x7fc15005d580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== osd.1 v2:172.21.2.135:6824/14884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc15005db40 con 0x7fc15005b160 2021-11-15T14:34:32.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.489+0000 7fc16bfff700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc150053660 0x7fc150055b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 --> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc16c0aeb80 con 0x7fc15005b160 2021-11-15T14:34:32.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc1697fa700 1 -- 172.21.2.135:0/3447245063 <== osd.1 v2:172.21.2.135:6824/14884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc16c0aeb80 con 0x7fc15005b160 2021-11-15T14:34:32.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc15005b160 msgr2=0x7fc15005d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc15005b160 0x7fc15005d580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc150053660 msgr2=0x7fc150055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc150053660 0x7fc150055b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc15c002f70 tx=0x7fc15c017000).stop 2021-11-15T14:34:32.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 msgr2=0x7fc16c0abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 --2- 172.21.2.135:0/3447245063 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc16c0b4cc0 0x7fc16c0abab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc16c0ae790 tx=0x7fc1640091a0).stop 2021-11-15T14:34:32.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc170e2b700 1 -- 172.21.2.135:0/3447245063 reap_dead start 2021-11-15T14:34:32.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 shutdown_connections 2021-11-15T14:34:32.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 >> 172.21.2.135:0/3447245063 conn(0x7fc16c05cfb0 msgr2=0x7fc16c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 shutdown_connections 2021-11-15T14:34:32.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.497+0000 7fc17288e700 1 -- 172.21.2.135:0/3447245063 wait complete. 2021-11-15T14:34:32.507 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:32.508 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-11-15T14:34:32.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 Processor -- start 2021-11-15T14:34:32.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- start start 2021-11-15T14:34:32.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f08040b6600 0x7f08040b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08040b69e0 0x7f080412ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804144130 con 0x7f08040b4440 2021-11-15T14:34:32.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0804143bf0 con 0x7f08040b6600 2021-11-15T14:34:32.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0804143e90 con 0x7f08040b69e0 2021-11-15T14:34:32.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f08037fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f08040b4440 0x7f0804061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42434/0 (socket says 172.21.2.135:42434) 2021-11-15T14:34:32.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f08037fe700 1 -- 172.21.2.135:0/4078865706 learned_addr learned my addr 172.21.2.135:0/4078865706 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 --2- 172.21.2.135:0/4078865706 >> v2:172.21.2.135:3300/0 conn(0x7f08040b69e0 0x7f080412ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0802ffd700 1 -- 172.21.2.135:0/4078865706 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155874757 0 0) 0x7f0804144130 con 0x7f08040b4440 2021-11-15T14:34:32.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0802ffd700 1 -- 172.21.2.135:0/4078865706 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4003260 con 0x7f08040b4440 2021-11-15T14:34:32.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 -- 172.21.2.135:0/4078865706 >> v2:172.21.2.119:3300/0 conn(0x7f08040b6600 msgr2=0x7f08040b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 --2- 172.21.2.135:0/4078865706 >> v2:172.21.2.119:3300/0 conn(0x7f08040b6600 0x7f08040b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 -- 172.21.2.135:0/4078865706 >> v1:172.21.2.135:6789/0 conn(0x7f08040b4440 legacy=0x7f0804061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 -- 172.21.2.135:0/4078865706 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804061670 con 0x7f08040b69e0 2021-11-15T14:34:32.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0808af9700 1 --2- 172.21.2.135:0/4078865706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b69e0 0x7f080412ba80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f08041431a0 tx=0x7f07fc0091d0).ready entity=mon.1 client_cookie=e887879191906536 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0802ffd700 1 -- 172.21.2.135:0/4078865706 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc00b640 con 0x7f08040b69e0 2021-11-15T14:34:32.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0802ffd700 1 -- 172.21.2.135:0/4078865706 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc00b7a0 con 0x7f08040b69e0 2021-11-15T14:34:32.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0802ffd700 1 -- 172.21.2.135:0/4078865706 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc00b910 con 0x7f08040b69e0 2021-11-15T14:34:32.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- 172.21.2.135:0/4078865706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b69e0 msgr2=0x7f080412ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- 172.21.2.135:0/4078865706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b69e0 0x7f080412ba80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f08041431a0 tx=0x7f07fc0091d0).stop 2021-11-15T14:34:32.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- 172.21.2.135:0/4078865706 shutdown_connections 2021-11-15T14:34:32.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- 172.21.2.135:0/4078865706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b69e0 0x7f080412ba80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- 172.21.2.135:0/4078865706 >> v2:172.21.2.119:3300/0 conn(0x7f08040b6600 0x7f08040b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- 172.21.2.135:0/4078865706 >> 172.21.2.135:0/4078865706 conn(0x7f080405c510 msgr2=0x7f080405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- 172.21.2.135:0/4078865706 shutdown_connections 2021-11-15T14:34:32.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- 172.21.2.135:0/4078865706 wait complete. 2021-11-15T14:34:32.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 Processor -- start 2021-11-15T14:34:32.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- start start 2021-11-15T14:34:32.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 0x7f08041273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08040b6600 0x7f08040b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08040b69e0 0x7f0804155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040b1c50 con 0x7f08040b69e0 2021-11-15T14:34:32.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804148940 con 0x7f08040b4440 2021-11-15T14:34:32.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f080a55c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804148be0 con 0x7f08040b6600 2021-11-15T14:34:32.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 0x7f08041273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 0x7f08041273c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54850/0 (socket says 172.21.2.135:54850) 2021-11-15T14:34:32.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 -- 172.21.2.135:0/4187551003 learned_addr learned my addr 172.21.2.135:0/4187551003 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 -- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08040b6600 msgr2=0x7f08040b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08040b6600 0x7f08040b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 -- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08040b69e0 msgr2=0x7f0804155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08040b69e0 0x7f0804155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc009470 con 0x7f08040b4440 2021-11-15T14:34:32.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f0803fff700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 0x7f08041273c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f07ec002f70 tx=0x7f07ec006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.557+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec013460 con 0x7f08040b4440 2021-11-15T14:34:32.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0135c0 con 0x7f08040b4440 2021-11-15T14:34:32.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080412ace0 con 0x7f08040b4440 2021-11-15T14:34:32.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec013920 con 0x7f08040b4440 2021-11-15T14:34:32.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804148390 con 0x7f08040b4440 2021-11-15T14:34:32.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08040b2250 con 0x7f08040b4440 2021-11-15T14:34:32.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07ec00f070 con 0x7f08040b4440 2021-11-15T14:34:32.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07e80536a0 0x7f07e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f07ec06b410 con 0x7f08040b4440 2021-11-15T14:34:32.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7f07e805b120 0x7f07e805d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07e805db00 con 0x7f07e805b120 2021-11-15T14:34:32.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07ec06daa0 con 0x7f08040b4440 2021-11-15T14:34:32.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f0808af9700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7f07e805b120 0x7f07e805d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08037fe700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07e80536a0 0x7f07e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f0808af9700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7f07e805b120 0x7f07e805d540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08037fe700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07e80536a0 0x7f07e8055b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f07f4000ed0 tx=0x7f07f40076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.561+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== osd.2 v2:172.21.2.135:6800/14885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f07e805db00 con 0x7f07e805b120 2021-11-15T14:34:32.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 --> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08040b1dc0 con 0x7f07e805b120 2021-11-15T14:34:32.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f08017fa700 1 -- 172.21.2.135:0/4187551003 <== osd.2 v2:172.21.2.135:6800/14885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08040b1dc0 con 0x7f07e805b120 2021-11-15T14:34:32.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7f07e805b120 msgr2=0x7f07e805d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7f07e805b120 0x7f07e805d540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07e80536a0 msgr2=0x7f07e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07e80536a0 0x7f07e8055b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f07f4000ed0 tx=0x7f07f40076c0).stop 2021-11-15T14:34:32.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 msgr2=0x7f08041273c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 --2- 172.21.2.135:0/4187551003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08040b4440 0x7f08041273c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f07ec002f70 tx=0x7f07ec006ec0).stop 2021-11-15T14:34:32.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f0808af9700 1 -- 172.21.2.135:0/4187551003 reap_dead start 2021-11-15T14:34:32.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 shutdown_connections 2021-11-15T14:34:32.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 >> 172.21.2.135:0/4187551003 conn(0x7f080405c510 msgr2=0x7f08041431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 shutdown_connections 2021-11-15T14:34:32.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.569+0000 7f080a55c700 1 -- 172.21.2.135:0/4187551003 wait complete. 2021-11-15T14:34:32.580 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:32.580 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-11-15T14:34:32.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 Processor -- start 2021-11-15T14:34:32.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 -- start start 2021-11-15T14:34:32.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2a940b1e30 0x7f2a940b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940b03d0 con 0x7f2a940a7140 2021-11-15T14:34:32.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940b0670 con 0x7f2a94148420 2021-11-15T14:34:32.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940a9140 con 0x7f2a940b1e30 2021-11-15T14:34:32.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a991f1700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2a94148420 0x7f2a940b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42448/0 (socket says 172.21.2.135:42448) 2021-11-15T14:34:32.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a991f1700 1 -- 172.21.2.135:0/2745223200 learned_addr learned my addr 172.21.2.135:0/2745223200 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550888404 0 0) 0x7f2a940b0670 con 0x7f2a94148420 2021-11-15T14:34:32.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a7c003260 con 0x7f2a94148420 2021-11-15T14:34:32.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 --2- 172.21.2.135:0/2745223200 >> v2:172.21.2.119:3300/0 conn(0x7f2a940b1e30 0x7f2a940b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906739201 0 0) 0x7f2a7c003260 con 0x7f2a94148420 2021-11-15T14:34:32.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 >> v2:172.21.2.119:3300/0 conn(0x7f2a940b1e30 msgr2=0x7f2a940b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 --2- 172.21.2.135:0/2745223200 >> v2:172.21.2.119:3300/0 conn(0x7f2a940b1e30 0x7f2a940b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 >> v1:172.21.2.119:6789/0 conn(0x7f2a940a7140 legacy=0x7f2a941447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940b0910 con 0x7f2a94148420 2021-11-15T14:34:32.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2a88001660 con 0x7f2a94148420 2021-11-15T14:34:32.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 >> v1:172.21.2.135:6789/0 conn(0x7f2a94148420 legacy=0x7f2a940b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 0x7f2a7c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c004500 0x7f2a7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a7c004f70 0x7f2a7c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c00be20 con 0x7f2a7c004f70 2021-11-15T14:34:32.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c00bf90 con 0x7f2a7c003820 2021-11-15T14:34:32.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c00c150 con 0x7f2a7c004500 2021-11-15T14:34:32.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 0x7f2a7c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 -- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c004500 msgr2=0x7f2a7c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c004500 0x7f2a7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 -- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a7c004f70 msgr2=0x7f2a7c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a7c004f70 0x7f2a7c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 -- 172.21.2.135:0/2745223200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c003260 con 0x7f2a7c003820 2021-11-15T14:34:32.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9a1f3700 1 -- 172.21.2.135:0/2745223200 reap_dead start 2021-11-15T14:34:32.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a999f2700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 0x7f2a7c003c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2a9000a000 tx=0x7f2a90008040).ready entity=mon.1 client_cookie=2e69684fdad9ca08 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a90013670 con 0x7f2a7c003820 2021-11-15T14:34:32.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a900137d0 con 0x7f2a7c003820 2021-11-15T14:34:32.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a989f0700 1 -- 172.21.2.135:0/2745223200 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a90013b30 con 0x7f2a7c003820 2021-11-15T14:34:32.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.629+0000 7f2a9bc56700 1 -- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 msgr2=0x7f2a7c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 0x7f2a7c003c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2a9000a000 tx=0x7f2a90008040).stop 2021-11-15T14:34:32.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/2745223200 shutdown_connections 2021-11-15T14:34:32.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 --2- 172.21.2.135:0/2745223200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a7c003820 0x7f2a7c003c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/2745223200 >> 172.21.2.135:0/2745223200 conn(0x7f2a9405f730 msgr2=0x7f2a9405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/2745223200 shutdown_connections 2021-11-15T14:34:32.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/2745223200 wait complete. 2021-11-15T14:34:32.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 Processor -- start 2021-11-15T14:34:32.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- start start 2021-11-15T14:34:32.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c003820 0x7f2a940ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 0x7f2a940abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a940ac000 0x7f2a94159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940ab900 con 0x7f2a940ac000 2021-11-15T14:34:32.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9414b1c0 con 0x7f2a9414b730 2021-11-15T14:34:32.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9414b460 con 0x7f2a7c003820 2021-11-15T14:34:32.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 0x7f2a940abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 0x7f2a940abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54872/0 (socket says 172.21.2.135:54872) 2021-11-15T14:34:32.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 -- 172.21.2.135:0/475928763 learned_addr learned my addr 172.21.2.135:0/475928763 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 -- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c003820 msgr2=0x7f2a940ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a7c003820 0x7f2a940ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 -- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a940ac000 msgr2=0x7f2a94159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a940ac000 0x7f2a94159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940a9360 con 0x7f2a9414b730 2021-11-15T14:34:32.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a991f1700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 0x7f2a940abb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2a941477b0 tx=0x7f2a940b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a88007170 con 0x7f2a9414b730 2021-11-15T14:34:32.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880072d0 con 0x7f2a9414b730 2021-11-15T14:34:32.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a88004920 con 0x7f2a9414b730 2021-11-15T14:34:32.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940a9600 con 0x7f2a9414b730 2021-11-15T14:34:32.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a940a9aa0 con 0x7f2a9414b730 2021-11-15T14:34:32.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a9414b050 con 0x7f2a9414b730 2021-11-15T14:34:32.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a8801b070 con 0x7f2a9414b730 2021-11-15T14:34:32.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a74053580 0x7f2a74055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f2a8806b190 con 0x7f2a9414b730 2021-11-15T14:34:32.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7f2a7405af80 0x7f2a7405d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a7405da00 con 0x7f2a7405af80 2021-11-15T14:34:32.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a88042130 con 0x7f2a9414b730 2021-11-15T14:34:32.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9a1f3700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7f2a7405af80 0x7f2a7405d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a999f2700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a74053580 0x7f2a74055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.633+0000 7f2a9a1f3700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7f2a7405af80 0x7f2a7405d3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.637+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== osd.3 v2:172.21.2.135:6808/14886 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f2a7405da00 con 0x7f2a7405af80 2021-11-15T14:34:32.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.637+0000 7f2a999f2700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a74053580 0x7f2a74055a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2a9000a000 tx=0x7f2a90008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 --> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a940b4f20 con 0x7f2a7405af80 2021-11-15T14:34:32.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a86ffd700 1 -- 172.21.2.135:0/475928763 <== osd.3 v2:172.21.2.135:6808/14886 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a940b4f20 con 0x7f2a7405af80 2021-11-15T14:34:32.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7f2a7405af80 msgr2=0x7f2a7405d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7f2a7405af80 0x7f2a7405d3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a74053580 msgr2=0x7f2a74055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a74053580 0x7f2a74055a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f2a9000a000 tx=0x7f2a90008040).stop 2021-11-15T14:34:32.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 msgr2=0x7f2a940abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 --2- 172.21.2.135:0/475928763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a9414b730 0x7f2a940abb10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2a941477b0 tx=0x7f2a940b0aa0).stop 2021-11-15T14:34:32.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9a1f3700 1 -- 172.21.2.135:0/475928763 reap_dead start 2021-11-15T14:34:32.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 shutdown_connections 2021-11-15T14:34:32.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 >> 172.21.2.135:0/475928763 conn(0x7f2a9405f730 msgr2=0x7f2a940b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 shutdown_connections 2021-11-15T14:34:32.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.645+0000 7f2a9bc56700 1 -- 172.21.2.135:0/475928763 wait complete. 2021-11-15T14:34:32.657 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:32.657 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-11-15T14:34:32.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 Processor -- start 2021-11-15T14:34:32.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 -- start start 2021-11-15T14:34:32.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a840b1e30 0x7f1a840b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1a84148420 0x7f1a840b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840b03d0 con 0x7f1a840a7140 2021-11-15T14:34:32.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840a9140 con 0x7f1a840b1e30 2021-11-15T14:34:32.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a8aa9f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840b0670 con 0x7f1a84148420 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1a84148420 0x7f1a840b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1a84148420 0x7f1a840b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54884/0 (socket says 172.21.2.135:54884) 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 -- 172.21.2.135:0/2667132795 learned_addr learned my addr 172.21.2.135:0/2667132795 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 -- 172.21.2.135:0/2667132795 >> v2:172.21.2.119:3300/0 conn(0x7f1a840b1e30 msgr2=0x7f1a840b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 --2- 172.21.2.135:0/2667132795 >> v2:172.21.2.119:3300/0 conn(0x7f1a840b1e30 0x7f1a840b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 -- 172.21.2.135:0/2667132795 >> v1:172.21.2.119:6789/0 conn(0x7f1a840a7140 legacy=0x7f1a841447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:32.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 -- 172.21.2.135:0/2667132795 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840b0910 con 0x7f1a84148420 2021-11-15T14:34:32.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.753+0000 7f1a83fff700 1 --2- 172.21.2.135:0/2667132795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a84148420 0x7f1a840b2210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1a840acee0 tx=0x7f1a6c006eb0).ready entity=mon.1 client_cookie=b9cd0a4b218c681a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a837fe700 1 -- 172.21.2.135:0/2667132795 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6c00d5c0 con 0x7f1a84148420 2021-11-15T14:34:32.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a837fe700 1 -- 172.21.2.135:0/2667132795 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c000e90 con 0x7f1a84148420 2021-11-15T14:34:32.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a837fe700 1 -- 172.21.2.135:0/2667132795 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a6c00d950 con 0x7f1a84148420 2021-11-15T14:34:32.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2667132795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a84148420 msgr2=0x7f1a840b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2667132795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a84148420 0x7f1a840b2210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1a840acee0 tx=0x7f1a6c006eb0).stop 2021-11-15T14:34:32.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2667132795 shutdown_connections 2021-11-15T14:34:32.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2667132795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a84148420 0x7f1a840b2210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2667132795 >> v2:172.21.2.119:3300/0 conn(0x7f1a840b1e30 0x7f1a840b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2667132795 >> 172.21.2.135:0/2667132795 conn(0x7f1a8405f730 msgr2=0x7f1a8405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2667132795 shutdown_connections 2021-11-15T14:34:32.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2667132795 wait complete. 2021-11-15T14:34:32.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 Processor -- start 2021-11-15T14:34:32.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- start start 2021-11-15T14:34:32.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 0x7f1a8414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a840b1e30 0x7f1a84156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a84148420 0x7f1a840ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8414bbd0 con 0x7f1a840b1e30 2021-11-15T14:34:32.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aebd0 con 0x7f1a840a7140 2021-11-15T14:34:32.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aee70 con 0x7f1a84148420 2021-11-15T14:34:32.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 0x7f1a8414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 0x7f1a8414a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54886/0 (socket says 172.21.2.135:54886) 2021-11-15T14:34:32.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 -- 172.21.2.135:0/2844213234 learned_addr learned my addr 172.21.2.135:0/2844213234 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 -- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a84148420 msgr2=0x7f1a840ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a84148420 0x7f1a840ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 -- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a840b1e30 msgr2=0x7f1a84156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a840b1e30 0x7f1a84156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c00b1e0 con 0x7f1a840a7140 2021-11-15T14:34:32.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8883b700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 0x7f1a8414a700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1a74002fb0 tx=0x7f1a74006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a74013460 con 0x7f1a840a7140 2021-11-15T14:34:32.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a740135c0 con 0x7f1a840a7140 2021-11-15T14:34:32.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840ab930 con 0x7f1a840a7140 2021-11-15T14:34:32.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840ae6c0 con 0x7f1a840a7140 2021-11-15T14:34:32.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a74013920 con 0x7f1a840a7140 2021-11-15T14:34:32.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a84157420 con 0x7f1a840a7140 2021-11-15T14:34:32.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a7400f070 con 0x7f1a840a7140 2021-11-15T14:34:32.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a68053660 0x7f1a68055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.757+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1a7406b680 con 0x7f1a840a7140 2021-11-15T14:34:32.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a81ffb700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f1a6805b1e0 0x7f1a6805d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a6805dbc0 con 0x7f1a6805b1e0 2021-11-15T14:34:32.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a7406dc40 con 0x7f1a840a7140 2021-11-15T14:34:32.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a8903c700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f1a6805b1e0 0x7f1a6805d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a83fff700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a68053660 0x7f1a68055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a8903c700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f1a6805b1e0 0x7f1a6805d600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.761+0000 7f1a83fff700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a68053660 0x7f1a68055b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1a840acee0 tx=0x7f1a6c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.765+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== osd.4 v2:172.21.2.119:6810/15090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f1a6805dbc0 con 0x7f1a6805b1e0 2021-11-15T14:34:32.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 --> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a840abac0 con 0x7f1a6805b1e0 2021-11-15T14:34:32.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a81ffb700 1 -- 172.21.2.135:0/2844213234 <== osd.4 v2:172.21.2.119:6810/15090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a840abac0 con 0x7f1a6805b1e0 2021-11-15T14:34:32.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f1a6805b1e0 msgr2=0x7f1a6805d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f1a6805b1e0 0x7f1a6805d600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a68053660 msgr2=0x7f1a68055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a68053660 0x7f1a68055b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1a840acee0 tx=0x7f1a6c015000).stop 2021-11-15T14:34:32.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 msgr2=0x7f1a8414a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 --2- 172.21.2.135:0/2844213234 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a840a7140 0x7f1a8414a700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1a74002fb0 tx=0x7f1a74006df0).stop 2021-11-15T14:34:32.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8903c700 1 -- 172.21.2.135:0/2844213234 reap_dead start 2021-11-15T14:34:32.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 shutdown_connections 2021-11-15T14:34:32.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 >> 172.21.2.135:0/2844213234 conn(0x7f1a8405f730 msgr2=0x7f1a841477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 shutdown_connections 2021-11-15T14:34:32.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.773+0000 7f1a8aa9f700 1 -- 172.21.2.135:0/2844213234 wait complete. 2021-11-15T14:34:32.783 INFO:teuthology.orchestra.run.gibba035.stdout:60129542148 2021-11-15T14:34:32.784 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-11-15T14:34:32.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 Processor -- start 2021-11-15T14:34:32.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 -- start start 2021-11-15T14:34:32.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0060180 0x7f35e00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f35e0067380 0x7f35e0143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35e00b4cc0 0x7f35e0143e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e00aac30 con 0x7f35e0067380 2021-11-15T14:34:32.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e0060560 con 0x7f35e00b4cc0 2021-11-15T14:34:32.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e6b24700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0066f20 con 0x7f35e0060180 2021-11-15T14:34:32.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35e00b4cc0 0x7f35e0143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35e00b4cc0 0x7f35e0143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54896/0 (socket says 172.21.2.135:54896) 2021-11-15T14:34:32.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 -- 172.21.2.135:0/563679692 learned_addr learned my addr 172.21.2.135:0/563679692 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35dffff700 1 --2- 172.21.2.135:0/563679692 >> v2:172.21.2.119:3300/0 conn(0x7f35e0067380 0x7f35e0143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e48c0700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0060180 0x7f35e00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 -- 172.21.2.135:0/563679692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0060180 msgr2=0x7f35e00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0060180 0x7f35e00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 -- 172.21.2.135:0/563679692 >> v2:172.21.2.119:3300/0 conn(0x7f35e0067380 msgr2=0x7f35e0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 --2- 172.21.2.135:0/563679692 >> v2:172.21.2.119:3300/0 conn(0x7f35e0067380 0x7f35e0143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 -- 172.21.2.135:0/563679692 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0144350 con 0x7f35e00b4cc0 2021-11-15T14:34:32.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.833+0000 7f35e50c1700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e00b4cc0 0x7f35e0143e60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f35d80032f0 tx=0x7f35d8009290).ready entity=mon.1 client_cookie=639fa7847ee0e83c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35df7fe700 1 -- 172.21.2.135:0/563679692 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d800b870 con 0x7f35e00b4cc0 2021-11-15T14:34:32.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35df7fe700 1 -- 172.21.2.135:0/563679692 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d800b9d0 con 0x7f35e00b4cc0 2021-11-15T14:34:32.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35df7fe700 1 -- 172.21.2.135:0/563679692 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d800bb40 con 0x7f35e00b4cc0 2021-11-15T14:34:32.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/563679692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e00b4cc0 msgr2=0x7f35e0143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e00b4cc0 0x7f35e0143e60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f35d80032f0 tx=0x7f35d8009290).stop 2021-11-15T14:34:32.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/563679692 shutdown_connections 2021-11-15T14:34:32.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e00b4cc0 0x7f35e0143e60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- 172.21.2.135:0/563679692 >> v2:172.21.2.119:3300/0 conn(0x7f35e0067380 0x7f35e0143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- 172.21.2.135:0/563679692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0060180 0x7f35e00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/563679692 >> 172.21.2.135:0/563679692 conn(0x7f35e005cfb0 msgr2=0x7f35e005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/563679692 shutdown_connections 2021-11-15T14:34:32.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/563679692 wait complete. 2021-11-15T14:34:32.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 Processor -- start 2021-11-15T14:34:32.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- start start 2021-11-15T14:34:32.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 0x7f35e015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0067380 0x7f35e00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35e00b4cc0 0x7f35e009f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00ae140 con 0x7f35e00b4cc0 2021-11-15T14:34:32.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e009fde0 con 0x7f35e0060180 2021-11-15T14:34:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e009ee80 con 0x7f35e0067380 2021-11-15T14:34:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 0x7f35e015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 0x7f35e015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54904/0 (socket says 172.21.2.135:54904) 2021-11-15T14:34:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 -- 172.21.2.135:0/3195475412 learned_addr learned my addr 172.21.2.135:0/3195475412 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35dffff700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0067380 0x7f35e00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e50c1700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35e00b4cc0 0x7f35e009f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 -- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0067380 msgr2=0x7f35e00ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35e0067380 0x7f35e00ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 -- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35e00b4cc0 msgr2=0x7f35e009f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35e00b4cc0 0x7f35e009f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009530 con 0x7f35e0060180 2021-11-15T14:34:32.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e48c0700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 0x7f35e015a130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f35c800a000 tx=0x7f35c8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c8011780 con 0x7f35e0060180 2021-11-15T14:34:32.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c80118e0 con 0x7f35e0060180 2021-11-15T14:34:32.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c8011c40 con 0x7f35e0060180 2021-11-15T14:34:32.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e00adea0 con 0x7f35e0060180 2021-11-15T14:34:32.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e00aebb0 con 0x7f35e0060180 2021-11-15T14:34:32.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.837+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35e009f040 con 0x7f35e0060180 2021-11-15T14:34:32.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35c8012420 con 0x7f35e0060180 2021-11-15T14:34:32.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35c4053640 0x7f35c4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f35c806b7a0 con 0x7f35e0060180 2021-11-15T14:34:32.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f35c405b0c0 0x7f35c405d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35c405daa0 con 0x7f35c405b0c0 2021-11-15T14:34:32.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c8070240 con 0x7f35e0060180 2021-11-15T14:34:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35dffff700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35c4053640 0x7f35c4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35e50c1700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f35c405b0c0 0x7f35c405d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35dffff700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35c4053640 0x7f35c4055b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f35d000c000 tx=0x7f35d0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35e50c1700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f35c405b0c0 0x7f35c405d4e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.841+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== osd.5 v2:172.21.2.119:6817/15091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f35c405daa0 con 0x7f35c405b0c0 2021-11-15T14:34:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.849+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 --> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35e00573d0 con 0x7f35c405b0c0 2021-11-15T14:34:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.849+0000 7f35ddffb700 1 -- 172.21.2.135:0/3195475412 <== osd.5 v2:172.21.2.119:6817/15091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35e00573d0 con 0x7f35c405b0c0 2021-11-15T14:34:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f35c405b0c0 msgr2=0x7f35c405d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f35c405b0c0 0x7f35c405d4e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35c4053640 msgr2=0x7f35c4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35c4053640 0x7f35c4055b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f35d000c000 tx=0x7f35d0008040).stop 2021-11-15T14:34:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 msgr2=0x7f35e015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 --2- 172.21.2.135:0/3195475412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35e0060180 0x7f35e015a130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f35c800a000 tx=0x7f35c8008040).stop 2021-11-15T14:34:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e50c1700 1 -- 172.21.2.135:0/3195475412 reap_dead start 2021-11-15T14:34:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 shutdown_connections 2021-11-15T14:34:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 >> 172.21.2.135:0/3195475412 conn(0x7f35e005cfb0 msgr2=0x7f35e0064ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 shutdown_connections 2021-11-15T14:34:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.853+0000 7f35e6b24700 1 -- 172.21.2.135:0/3195475412 wait complete. 2021-11-15T14:34:32.860 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:32.861 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-11-15T14:34:32.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 Processor -- start 2021-11-15T14:34:32.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- start start 2021-11-15T14:34:32.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc56c0b6980 0x7fc56c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc56c060990 0x7fc56c0a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0b6d60 con 0x7fc56c0aa430 2021-11-15T14:34:32.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c061260 con 0x7fc56c060990 2021-11-15T14:34:32.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c061500 con 0x7fc56c0b6980 2021-11-15T14:34:32.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc570af4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc56c0aa430 0x7fc56c0b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42502/0 (socket says 172.21.2.135:42502) 2021-11-15T14:34:32.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc570af4700 1 -- 172.21.2.135:0/1687217162 learned_addr learned my addr 172.21.2.135:0/1687217162 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 --2- 172.21.2.135:0/1687217162 >> v2:172.21.2.135:3300/0 conn(0x7fc56c0b6980 0x7fc56c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 -- 172.21.2.135:0/1687217162 >> v2:172.21.2.119:3300/0 conn(0x7fc56c060990 msgr2=0x7fc56c0a9f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:32.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 --2- 172.21.2.135:0/1687217162 >> v2:172.21.2.119:3300/0 conn(0x7fc56c060990 0x7fc56c0a9f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 -- 172.21.2.135:0/1687217162 >> v1:172.21.2.135:6789/0 conn(0x7fc56c0aa430 legacy=0x7fc56c0b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 -- 172.21.2.135:0/1687217162 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0617a0 con 0x7fc56c0b6980 2021-11-15T14:34:32.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56bfff700 1 --2- 172.21.2.135:0/1687217162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c0b6980 0x7fc56c0acdd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fc560002f70 tx=0x7fc560007f00).ready entity=mon.1 client_cookie=cb2b5622e79e3002 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56affd700 1 -- 172.21.2.135:0/1687217162 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc560010510 con 0x7fc56c0b6980 2021-11-15T14:34:32.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56affd700 1 -- 172.21.2.135:0/1687217162 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560000e90 con 0x7fc56c0b6980 2021-11-15T14:34:32.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc56affd700 1 -- 172.21.2.135:0/1687217162 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5600106b0 con 0x7fc56c0b6980 2021-11-15T14:34:32.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- 172.21.2.135:0/1687217162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c0b6980 msgr2=0x7fc56c0acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 --2- 172.21.2.135:0/1687217162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c0b6980 0x7fc56c0acdd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fc560002f70 tx=0x7fc560007f00).stop 2021-11-15T14:34:32.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- 172.21.2.135:0/1687217162 shutdown_connections 2021-11-15T14:34:32.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 --2- 172.21.2.135:0/1687217162 >> v2:172.21.2.119:3300/0 conn(0x7fc56c060990 0x7fc56c0a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 --2- 172.21.2.135:0/1687217162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c0b6980 0x7fc56c0acdd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- 172.21.2.135:0/1687217162 >> 172.21.2.135:0/1687217162 conn(0x7fc56c0b3500 msgr2=0x7fc56c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- 172.21.2.135:0/1687217162 shutdown_connections 2021-11-15T14:34:32.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.909+0000 7fc572557700 1 -- 172.21.2.135:0/1687217162 wait complete. 2021-11-15T14:34:32.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 Processor -- start 2021-11-15T14:34:32.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- start start 2021-11-15T14:34:32.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 0x7fc56c1390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc56c0aa430 0x7fc56c144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc56c0b6980 0x7fc56c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c13c6c0 con 0x7fc56c0b6980 2021-11-15T14:34:32.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c13a3f0 con 0x7fc56c060990 2021-11-15T14:34:32.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c13e740 con 0x7fc56c0aa430 2021-11-15T14:34:32.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 0x7fc56c1390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 0x7fc56c1390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54916/0 (socket says 172.21.2.135:54916) 2021-11-15T14:34:32.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 -- 172.21.2.135:0/324517470 learned_addr learned my addr 172.21.2.135:0/324517470 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:32.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 -- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc56c0aa430 msgr2=0x7fc56c144690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:32.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc56c0aa430 0x7fc56c144690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 -- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc56c0b6980 msgr2=0x7fc56c144b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:32.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc56c0b6980 0x7fc56c144b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56000c200 con 0x7fc56c060990 2021-11-15T14:34:32.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56bfff700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 0x7fc56c1390c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc560002f70 tx=0x7fc560017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc560012ce0 con 0x7fc56c060990 2021-11-15T14:34:32.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560012e40 con 0x7fc56c060990 2021-11-15T14:34:32.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c13f300 con 0x7fc56c060990 2021-11-15T14:34:32.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c13b510 con 0x7fc56c060990 2021-11-15T14:34:32.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5600072c0 con 0x7fc56c060990 2021-11-15T14:34:32.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc56c13a270 con 0x7fc56c060990 2021-11-15T14:34:32.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc560010070 con 0x7fc56c060990 2021-11-15T14:34:32.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc54c053660 0x7fc54c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc56006ede0 con 0x7fc56c060990 2021-11-15T14:34:32.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fc54c05b1e0 0x7fc54c05d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc54c05dbc0 con 0x7fc54c05b1e0 2021-11-15T14:34:32.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5600713a0 con 0x7fc56c060990 2021-11-15T14:34:32.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc56b7fe700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc54c053660 0x7fc54c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.913+0000 7fc570af4700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fc54c05b1e0 0x7fc54c05d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.917+0000 7fc570af4700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fc54c05b1e0 0x7fc54c05d600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.917+0000 7fc56b7fe700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc54c053660 0x7fc54c055b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc55c002ef0 tx=0x7fc55c006890).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.917+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== osd.6 v2:172.21.2.119:6802/15092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc54c05dbc0 con 0x7fc54c05b1e0 2021-11-15T14:34:32.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.925+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 --> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc56c13c830 con 0x7fc54c05b1e0 2021-11-15T14:34:32.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc5697fa700 1 -- 172.21.2.135:0/324517470 <== osd.6 v2:172.21.2.119:6802/15092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc56c13c830 con 0x7fc54c05b1e0 2021-11-15T14:34:32.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fc54c05b1e0 msgr2=0x7fc54c05d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fc54c05b1e0 0x7fc54c05d600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc54c053660 msgr2=0x7fc54c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc54c053660 0x7fc54c055b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc55c002ef0 tx=0x7fc55c006890).stop 2021-11-15T14:34:32.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 msgr2=0x7fc56c1390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 --2- 172.21.2.135:0/324517470 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc56c060990 0x7fc56c1390c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc560002f70 tx=0x7fc560017000).stop 2021-11-15T14:34:32.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc570af4700 1 -- 172.21.2.135:0/324517470 reap_dead start 2021-11-15T14:34:32.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 shutdown_connections 2021-11-15T14:34:32.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 >> 172.21.2.135:0/324517470 conn(0x7fc56c0b3500 msgr2=0x7fc56c136210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:32.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 shutdown_connections 2021-11-15T14:34:32.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.929+0000 7fc572557700 1 -- 172.21.2.135:0/324517470 wait complete. 2021-11-15T14:34:32.937 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:32.938 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-11-15T14:34:32.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 Processor -- start 2021-11-15T14:34:32.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 -- start start 2021-11-15T14:34:32.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f374c0b6600 0x7f374c0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c144130 con 0x7f374c0b69e0 2021-11-15T14:34:32.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c143bf0 con 0x7f374c0b4440 2021-11-15T14:34:32.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f37519ff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c143e90 con 0x7f374c0b6600 2021-11-15T14:34:32.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f374a7fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f374c0b4440 0x7f374c061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42518/0 (socket says 172.21.2.135:42518) 2021-11-15T14:34:32.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f374a7fc700 1 -- 172.21.2.135:0/161209800 learned_addr learned my addr 172.21.2.135:0/161209800 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:32.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969439990 0 0) 0x7f374c143bf0 con 0x7f374c0b4440 2021-11-15T14:34:32.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c003260 con 0x7f374c0b4440 2021-11-15T14:34:32.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410706819 0 0) 0x7f372c003260 con 0x7f374c0b4440 2021-11-15T14:34:32.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 >> v2:172.21.2.119:3300/0 conn(0x7f374c0b6600 msgr2=0x7f374c0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 --2- 172.21.2.135:0/161209800 >> v2:172.21.2.119:3300/0 conn(0x7f374c0b6600 0x7f374c0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 >> v1:172.21.2.119:6789/0 conn(0x7f374c0b69e0 legacy=0x7f374c12ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c061670 con 0x7f374c0b4440 2021-11-15T14:34:32.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.985+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f373c001660 con 0x7f374c0b4440 2021-11-15T14:34:32.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 >> v1:172.21.2.135:6789/0 conn(0x7f374c0b4440 legacy=0x7f374c061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f372c003750 0x7f372c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f372c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f372c004f90 0x7f372c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:32.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c143e90 con 0x7f372c003750 2021-11-15T14:34:32.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c00be80 con 0x7f372c004500 2021-11-15T14:34:32.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c00c040 con 0x7f372c004f90 2021-11-15T14:34:32.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f372c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:32.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 -- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f372c004f90 msgr2=0x7f372c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f372c004f90 0x7f372c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 -- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f372c003750 msgr2=0x7f372c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:32.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f372c003750 0x7f372c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:32.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 -- 172.21.2.135:0/161209800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c003260 con 0x7f372c004500 2021-11-15T14:34:32.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374b7fe700 1 -- 172.21.2.135:0/161209800 reap_dead start 2021-11-15T14:34:32.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374a7fc700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f372c004980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f374c1431a0 tx=0x7f374c061800).ready entity=mon.1 client_cookie=2d7c9a4ae8f9aca3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:32.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c0070d0 con 0x7f372c004500 2021-11-15T14:34:32.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c007230 con 0x7f372c004500 2021-11-15T14:34:32.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3749ffb700 1 -- 172.21.2.135:0/161209800 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c00c990 con 0x7f372c004500 2021-11-15T14:34:32.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 msgr2=0x7f372c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:32.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f372c004980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f374c1431a0 tx=0x7f374c061800).stop 2021-11-15T14:34:32.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/161209800 shutdown_connections 2021-11-15T14:34:32.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 --2- 172.21.2.135:0/161209800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f372c004980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:32.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/161209800 >> 172.21.2.135:0/161209800 conn(0x7f374c05c510 msgr2=0x7f374c05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:33.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/161209800 shutdown_connections 2021-11-15T14:34:33.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/161209800 wait complete. 2021-11-15T14:34:33.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 Processor -- start 2021-11-15T14:34:33.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- start start 2021-11-15T14:34:33.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f374c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f374c0af6c0 0x7f374c0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f374c0b0030 0x7f374c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b3330 con 0x7f374c0b0030 2021-11-15T14:34:33.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b29d0 con 0x7f372c004500 2021-11-15T14:34:33.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c12b3b0 con 0x7f374c0af6c0 2021-11-15T14:34:33.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f374c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f374c0b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54938/0 (socket says 172.21.2.135:54938) 2021-11-15T14:34:33.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 -- 172.21.2.135:0/2869821855 learned_addr learned my addr 172.21.2.135:0/2869821855 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:33.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 -- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f374c0af6c0 msgr2=0x7f374c0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f374c0af6c0 0x7f374c0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 -- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f374c0b0030 msgr2=0x7f374c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f374c0b0030 0x7f374c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0b2730 con 0x7f372c004500 2021-11-15T14:34:33.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f374affd700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f374c0b2080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f374c126e40 tx=0x7f3734006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3734009e70 con 0x7f372c004500 2021-11-15T14:34:33.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734013460 con 0x7f372c004500 2021-11-15T14:34:33.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c12b040 con 0x7f372c004500 2021-11-15T14:34:33.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c12b690 con 0x7f372c004500 2021-11-15T14:34:33.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37340137c0 con 0x7f372c004500 2021-11-15T14:34:33.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f374c12a490 con 0x7f372c004500 2021-11-15T14:34:33.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f373401a060 con 0x7f372c004500 2021-11-15T14:34:33.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37300536f0 0x7f3730055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.989+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f373406b510 con 0x7f372c004500 2021-11-15T14:34:33.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f3743fff700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f373005b270 0x7f373005d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f373005dc50 con 0x7f373005b270 2021-11-15T14:34:33.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f373406dad0 con 0x7f372c004500 2021-11-15T14:34:33.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f374b7fe700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f373005b270 0x7f373005d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f374a7fc700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37300536f0 0x7f3730055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f374b7fe700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f373005b270 0x7f373005d690 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f374a7fc700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37300536f0 0x7f3730055bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f374c1431a0 tx=0x7f373c013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:32.993+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== osd.7 v2:172.21.2.119:6819/15101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f373005dc50 con 0x7f373005b270 2021-11-15T14:34:33.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 --> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f374c0b2570 con 0x7f373005b270 2021-11-15T14:34:33.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f3743fff700 1 -- 172.21.2.135:0/2869821855 <== osd.7 v2:172.21.2.119:6819/15101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f374c0b2570 con 0x7f373005b270 2021-11-15T14:34:33.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f373005b270 msgr2=0x7f373005d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f373005b270 0x7f373005d690 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:33.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37300536f0 msgr2=0x7f3730055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37300536f0 0x7f3730055bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f374c1431a0 tx=0x7f373c013000).stop 2021-11-15T14:34:33.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 msgr2=0x7f374c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 --2- 172.21.2.135:0/2869821855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f372c004500 0x7f374c0b2080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f374c126e40 tx=0x7f3734006de0).stop 2021-11-15T14:34:33.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f374b7fe700 1 -- 172.21.2.135:0/2869821855 reap_dead start 2021-11-15T14:34:33.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 shutdown_connections 2021-11-15T14:34:33.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 >> 172.21.2.135:0/2869821855 conn(0x7f374c05c510 msgr2=0x7f374c142070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:33.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 shutdown_connections 2021-11-15T14:34:33.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.009+0000 7f37519ff700 1 -- 172.21.2.135:0/2869821855 wait complete. 2021-11-15T14:34:33.020 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:33.020 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-15T14:34:33.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 Processor -- start 2021-11-15T14:34:33.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- start start 2021-11-15T14:34:33.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d940b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5d940b4440 0x7f5d940b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d94144130 con 0x7f5d94061db0 2021-11-15T14:34:33.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940b6ed0 con 0x7f5d940b4440 2021-11-15T14:34:33.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d94143bf0 con 0x7f5d940b6600 2021-11-15T14:34:33.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5d940b4440 0x7f5d940b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d98849700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5d94061db0 0x7f5d94146740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42540/0 (socket says 172.21.2.135:42540) 2021-11-15T14:34:33.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d98849700 1 -- 172.21.2.135:0/2251522369 learned_addr learned my addr 172.21.2.135:0/2251522369 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:33.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 -- 172.21.2.135:0/2251522369 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 msgr2=0x7f5d940b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:33.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 --2- 172.21.2.135:0/2251522369 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d940b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 -- 172.21.2.135:0/2251522369 >> v1:172.21.2.135:6789/0 conn(0x7f5d94061db0 legacy=0x7f5d94146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 -- 172.21.2.135:0/2251522369 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d94143e90 con 0x7f5d940b4440 2021-11-15T14:34:33.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d937fe700 1 --2- 172.21.2.135:0/2251522369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d940b4440 0x7f5d940b69e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5d7c002f70 tx=0x7f5d7c006df0).ready entity=mon.1 client_cookie=dc05079f2c5e44c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d92ffd700 1 -- 172.21.2.135:0/2251522369 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7c00d570 con 0x7f5d940b4440 2021-11-15T14:34:33.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d92ffd700 1 -- 172.21.2.135:0/2251522369 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c000e90 con 0x7f5d940b4440 2021-11-15T14:34:33.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d92ffd700 1 -- 172.21.2.135:0/2251522369 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7c00d8c0 con 0x7f5d940b4440 2021-11-15T14:34:33.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/2251522369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d940b4440 msgr2=0x7f5d940b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/2251522369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d940b4440 0x7f5d940b69e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5d7c002f70 tx=0x7f5d7c006df0).stop 2021-11-15T14:34:33.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/2251522369 shutdown_connections 2021-11-15T14:34:33.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/2251522369 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d940b4440 0x7f5d940b69e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:33.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/2251522369 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d940b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/2251522369 >> 172.21.2.135:0/2251522369 conn(0x7f5d9405c510 msgr2=0x7f5d9405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:33.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/2251522369 shutdown_connections 2021-11-15T14:34:33.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/2251522369 wait complete. 2021-11-15T14:34:33.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 Processor -- start 2021-11-15T14:34:33.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.069+0000 7f5d9a2ac700 1 -- start start 2021-11-15T14:34:33.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d940b4440 0x7f5d94125f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d94142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d94124530 con 0x7f5d940b4440 2021-11-15T14:34:33.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941247d0 con 0x7f5d94061db0 2021-11-15T14:34:33.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d94125100 con 0x7f5d940b6600 2021-11-15T14:34:33.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54958/0 (socket says 172.21.2.135:54958) 2021-11-15T14:34:33.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 -- 172.21.2.135:0/3797464576 learned_addr learned my addr 172.21.2.135:0/3797464576 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:33.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 -- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 msgr2=0x7f5d94142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d94142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 -- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d940b4440 msgr2=0x7f5d94125f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d940b4440 0x7f5d94125f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 -- 172.21.2.135:0/3797464576 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c00b180 con 0x7f5d94061db0 2021-11-15T14:34:33.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d93fff700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84013460 con 0x7f5d94061db0 2021-11-15T14:34:33.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840135c0 con 0x7f5d94061db0 2021-11-15T14:34:33.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d84013920 con 0x7f5d94061db0 2021-11-15T14:34:33.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d941253a0 con 0x7f5d94061db0 2021-11-15T14:34:33.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d94142e30 con 0x7f5d94061db0 2021-11-15T14:34:33.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d94061670 con 0x7f5d94061db0 2021-11-15T14:34:33.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d8400f070 con 0x7f5d94061db0 2021-11-15T14:34:33.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 0x7f5d78055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:33.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5d8406b550 con 0x7f5d94061db0 2021-11-15T14:34:33.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d937fe700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 0x7f5d78055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:33.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.073+0000 7f5d937fe700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 0x7f5d78055b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5d7c002f70 tx=0x7f5d7c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:33.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.077+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d84042440 con 0x7f5d94061db0 2021-11-15T14:34:33.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.157+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d940573d0 con 0x7f5d94061db0 2021-11-15T14:34:33.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d917fa700 1 -- 172.21.2.135:0/3797464576 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d84045a60 con 0x7f5d94061db0 2021-11-15T14:34:33.163 INFO:teuthology.orchestra.run.gibba035.stdout:60129542148 2021-11-15T14:34:33.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 msgr2=0x7f5d78055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 0x7f5d78055b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5d7c002f70 tx=0x7f5d7c015000).stop 2021-11-15T14:34:33.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 msgr2=0x7f5d94125960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:33.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5d84002f70 tx=0x7f5d84006ec0).stop 2021-11-15T14:34:33.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 shutdown_connections 2021-11-15T14:34:33.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d780536a0 0x7f5d78055b60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:33.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d940b6600 0x7f5d94142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d940b4440 0x7f5d94125f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:33.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 --2- 172.21.2.135:0/3797464576 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d94061db0 0x7f5d94125960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:33.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 >> 172.21.2.135:0/3797464576 conn(0x7f5d9405c510 msgr2=0x7f5d9412af60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:33.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 shutdown_connections 2021-11-15T14:34:33.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:33.161+0000 7f5d9a2ac700 1 -- 172.21.2.135:0/3797464576 wait complete. 2021-11-15T14:34:33.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2021-11-15T14:34:34.171 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-15T14:34:34.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 Processor -- start 2021-11-15T14:34:34.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- start start 2021-11-15T14:34:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0dc0ad220 0x7fa0dc0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0afad0 con 0x7fa0dc0af6f0 2021-11-15T14:34:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0ae6b0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0ae950 con 0x7fa0dc0ad220 2021-11-15T14:34:34.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e15eb700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa0dc0b0770 0x7fa0dc1477b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42550/0 (socket says 172.21.2.135:42550) 2021-11-15T14:34:34.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e15eb700 1 -- 172.21.2.135:0/1080447461 learned_addr learned my addr 172.21.2.135:0/1080447461 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:34.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0dbfff700 1 --2- 172.21.2.135:0/1080447461 >> v2:172.21.2.135:3300/0 conn(0x7fa0dc0ad220 0x7fa0dc0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0db7fe700 1 -- 172.21.2.135:0/1080447461 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073799177 0 0) 0x7fa0dc0ae6b0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0db7fe700 1 -- 172.21.2.135:0/1080447461 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003260 con 0x7fa0dc0b0770 2021-11-15T14:34:34.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0dbfff700 1 -- 172.21.2.135:0/1080447461 >> v1:172.21.2.135:6789/0 conn(0x7fa0dc0b0770 legacy=0x7fa0dc1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0dbfff700 1 -- 172.21.2.135:0/1080447461 >> v1:172.21.2.119:6789/0 conn(0x7fa0dc0af6f0 legacy=0x7fa0dc0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0dbfff700 1 -- 172.21.2.135:0/1080447461 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0aebf0 con 0x7fa0dc0ad220 2021-11-15T14:34:34.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0dbfff700 1 --2- 172.21.2.135:0/1080447461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0ad220 0x7fa0dc0b2a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa0dc0ad650 tx=0x7fa0c4006df0).ready entity=mon.1 client_cookie=2804ad1375ebae7c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0db7fe700 1 -- 172.21.2.135:0/1080447461 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c400d5c0 con 0x7fa0dc0ad220 2021-11-15T14:34:34.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0db7fe700 1 -- 172.21.2.135:0/1080447461 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4000e90 con 0x7fa0dc0ad220 2021-11-15T14:34:34.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0db7fe700 1 -- 172.21.2.135:0/1080447461 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c400d910 con 0x7fa0dc0ad220 2021-11-15T14:34:34.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- 172.21.2.135:0/1080447461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0ad220 msgr2=0x7fa0dc0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 --2- 172.21.2.135:0/1080447461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0ad220 0x7fa0dc0b2a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa0dc0ad650 tx=0x7fa0c4006df0).stop 2021-11-15T14:34:34.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- 172.21.2.135:0/1080447461 shutdown_connections 2021-11-15T14:34:34.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 --2- 172.21.2.135:0/1080447461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0ad220 0x7fa0dc0b2a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- 172.21.2.135:0/1080447461 >> 172.21.2.135:0/1080447461 conn(0x7fa0dc062cb0 msgr2=0x7fa0dc063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- 172.21.2.135:0/1080447461 shutdown_connections 2021-11-15T14:34:34.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- 172.21.2.135:0/1080447461 wait complete. 2021-11-15T14:34:34.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 Processor -- start 2021-11-15T14:34:34.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.225+0000 7fa0e304e700 1 -- start start 2021-11-15T14:34:34.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0dc0ad220 0x7fa0dc148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0dc0af6f0 0x7fa0dc0a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc06a060 con 0x7fa0dc0af6f0 2021-11-15T14:34:34.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0a7e00 con 0x7fa0dc0b0770 2021-11-15T14:34:34.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc066620 con 0x7fa0dc0ad220 2021-11-15T14:34:34.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54972/0 (socket says 172.21.2.135:54972) 2021-11-15T14:34:34.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 -- 172.21.2.135:0/655489513 learned_addr learned my addr 172.21.2.135:0/655489513 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:34.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 -- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0dc0ad220 msgr2=0x7fa0dc148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0dc0ad220 0x7fa0dc148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 -- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0dc0af6f0 msgr2=0x7fa0dc0a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0dc0af6f0 0x7fa0dc0a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 -- 172.21.2.135:0/655489513 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c400b180 con 0x7fa0dc0b0770 2021-11-15T14:34:34.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e15eb700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa0dc0a9360 tx=0x7fa0d4007da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d4005c70 con 0x7fa0dc0b0770 2021-11-15T14:34:34.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4005dd0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0d40072c0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc0a9df0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc0658e0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc0a7c40 con 0x7fa0dc0b0770 2021-11-15T14:34:34.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0d4010070 con 0x7fa0dc0b0770 2021-11-15T14:34:34.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 0x7fa0c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa0d406b3f0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.229+0000 7fa0e0dea700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 0x7fa0c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.233+0000 7fa0e0dea700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 0x7fa0c0055a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa0cc001fa0 tx=0x7fa0cc0077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.233+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0d4042390 con 0x7fa0dc0b0770 2021-11-15T14:34:34.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.313+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0dc0667e0 con 0x7fa0dc0b0770 2021-11-15T14:34:34.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.313+0000 7fa0d9ffb700 1 -- 172.21.2.135:0/655489513 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0d4018070 con 0x7fa0dc0b0770 2021-11-15T14:34:34.318 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:34.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 msgr2=0x7fa0c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 0x7fa0c0055a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa0cc001fa0 tx=0x7fa0cc0077f0).stop 2021-11-15T14:34:34.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 msgr2=0x7fa0dc0a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa0dc0a9360 tx=0x7fa0d4007da0).stop 2021-11-15T14:34:34.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 shutdown_connections 2021-11-15T14:34:34.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0c0053580 0x7fa0c0055a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0dc0b0770 0x7fa0dc0a9900 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0dc0af6f0 0x7fa0dc0a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 --2- 172.21.2.135:0/655489513 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0dc0ad220 0x7fa0dc148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 >> 172.21.2.135:0/655489513 conn(0x7fa0dc062cb0 msgr2=0x7fa0dc0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 shutdown_connections 2021-11-15T14:34:34.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.317+0000 7fa0e304e700 1 -- 172.21.2.135:0/655489513 wait complete. 2021-11-15T14:34:34.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2021-11-15T14:34:34.326 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-11-15T14:34:34.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 Processor -- start 2021-11-15T14:34:34.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 -- start start 2021-11-15T14:34:34.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23380b1e30 0x7f23380b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23380a7140 0x7f23381447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380b03d0 con 0x7f2338148420 2021-11-15T14:34:34.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380a9140 con 0x7f23380a7140 2021-11-15T14:34:34.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.373+0000 7f233d4e5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380b0670 con 0x7f23380b1e30 2021-11-15T14:34:34.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23367fc700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f2338148420 0x7f23380b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:51982/0 (socket says 172.21.2.135:51982) 2021-11-15T14:34:34.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23380a7140 0x7f23381447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23367fc700 1 -- 172.21.2.135:0/764702546 learned_addr learned my addr 172.21.2.135:0/764702546 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:34.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f2336ffd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23380b1e30 0x7f23380b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 -- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23380b1e30 msgr2=0x7f23380b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 --2- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23380b1e30 0x7f23380b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 -- 172.21.2.135:0/764702546 >> v1:172.21.2.119:6789/0 conn(0x7f2338148420 legacy=0x7f23380b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 -- 172.21.2.135:0/764702546 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380b0910 con 0x7f23380a7140 2021-11-15T14:34:34.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f23377fe700 1 --2- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f23381447a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2320001110 tx=0x7f23300091d0).ready entity=mon.0 client_cookie=93372fc9cb6a90f1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f2335ffb700 1 -- 172.21.2.135:0/764702546 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233000b580 con 0x7f23380a7140 2021-11-15T14:34:34.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f2335ffb700 1 -- 172.21.2.135:0/764702546 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233000b6e0 con 0x7f23380a7140 2021-11-15T14:34:34.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f2335ffb700 1 -- 172.21.2.135:0/764702546 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233000b850 con 0x7f23380a7140 2021-11-15T14:34:34.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 -- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 msgr2=0x7f23381447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 --2- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f23381447a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2320001110 tx=0x7f23300091d0).stop 2021-11-15T14:34:34.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 -- 172.21.2.135:0/764702546 shutdown_connections 2021-11-15T14:34:34.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 --2- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f23381447a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 --2- 172.21.2.135:0/764702546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23380b1e30 0x7f23380b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 -- 172.21.2.135:0/764702546 >> 172.21.2.135:0/764702546 conn(0x7f233805f730 msgr2=0x7f233805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 -- 172.21.2.135:0/764702546 shutdown_connections 2021-11-15T14:34:34.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.377+0000 7f233d4e5700 1 -- 172.21.2.135:0/764702546 wait complete. 2021-11-15T14:34:34.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 Processor -- start 2021-11-15T14:34:34.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- start start 2021-11-15T14:34:34.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f2338144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2338148420 0x7f2338157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233813d8f0 con 0x7f23380a7140 2021-11-15T14:34:34.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233814a280 con 0x7f23380b1e30 2021-11-15T14:34:34.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233814a520 con 0x7f2338148420 2021-11-15T14:34:34.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:54984/0 (socket says 172.21.2.135:54984) 2021-11-15T14:34:34.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 -- 172.21.2.135:0/2881995374 learned_addr learned my addr 172.21.2.135:0/2881995374 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:34.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 -- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2338148420 msgr2=0x7f2338157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2338148420 0x7f2338157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 -- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 msgr2=0x7f2338144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f2338144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 -- 172.21.2.135:0/2881995374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009470 con 0x7f23380b1e30 2021-11-15T14:34:34.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f23367fc700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2320000fe0 tx=0x7f2320007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23200072e0 con 0x7f23380b1e30 2021-11-15T14:34:34.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2338159e60 con 0x7f23380b1e30 2021-11-15T14:34:34.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320007440 con 0x7f23380b1e30 2021-11-15T14:34:34.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2320005800 con 0x7f23380b1e30 2021-11-15T14:34:34.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233814a7c0 con 0x7f23380b1e30 2021-11-15T14:34:34.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2338159ff0 con 0x7f23380b1e30 2021-11-15T14:34:34.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2320010070 con 0x7f23380b1e30 2021-11-15T14:34:34.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 0x7f231c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f232006b2b0 con 0x7f23380b1e30 2021-11-15T14:34:34.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.381+0000 7f2336ffd700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 0x7f231c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.385+0000 7f2336ffd700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 0x7f231c055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f232800c000 tx=0x7f2328006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.385+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23200422b0 con 0x7f23380b1e30 2021-11-15T14:34:34.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.465+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23380573d0 con 0x7f23380b1e30 2021-11-15T14:34:34.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f232ffff700 1 -- 172.21.2.135:0/2881995374 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23200458d0 con 0x7f23380b1e30 2021-11-15T14:34:34.470 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:34.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 msgr2=0x7f231c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 0x7f231c055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f232800c000 tx=0x7f2328006df0).stop 2021-11-15T14:34:34.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 msgr2=0x7f2338156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2320000fe0 tx=0x7f2320007c10).stop 2021-11-15T14:34:34.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 shutdown_connections 2021-11-15T14:34:34.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f231c053610 0x7f231c055ad0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2338148420 0x7f2338157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23380b1e30 0x7f2338156e90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 --2- 172.21.2.135:0/2881995374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23380a7140 0x7f2338144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 >> 172.21.2.135:0/2881995374 conn(0x7f233805f730 msgr2=0x7f2338146580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 shutdown_connections 2021-11-15T14:34:34.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.469+0000 7f233d4e5700 1 -- 172.21.2.135:0/2881995374 wait complete. 2021-11-15T14:34:34.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2021-11-15T14:34:34.478 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-11-15T14:34:34.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 Processor -- start 2021-11-15T14:34:34.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 -- start start 2021-11-15T14:34:34.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 0x7fb2500addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500b2b70 con 0x7fb2500b0900 2021-11-15T14:34:34.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500b27f0 con 0x7fb2500aa1a0 2021-11-15T14:34:34.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb257749700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b2da0 con 0x7fb2500b0520 2021-11-15T14:34:34.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb254ce4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb2500aa1a0 0x7fb2500ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42580/0 (socket says 172.21.2.135:42580) 2021-11-15T14:34:34.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb254ce4700 1 -- 172.21.2.135:0/2782820457 learned_addr learned my addr 172.21.2.135:0/2782820457 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:34.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853289937 0 0) 0x7fb2500b27f0 con 0x7fb2500aa1a0 2021-11-15T14:34:34.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.529+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb238003260 con 0x7fb2500aa1a0 2021-11-15T14:34:34.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603225386 0 0) 0x7fb238003260 con 0x7fb2500aa1a0 2021-11-15T14:34:34.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 msgr2=0x7fb2500addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 0x7fb2500addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 >> v1:172.21.2.119:6789/0 conn(0x7fb2500b0900 legacy=0x7fb250140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500a9bf0 con 0x7fb2500aa1a0 2021-11-15T14:34:34.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb240001660 con 0x7fb2500aa1a0 2021-11-15T14:34:34.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 >> v1:172.21.2.135:6789/0 conn(0x7fb2500aa1a0 legacy=0x7fb2500ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb238003750 0x7fb238003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb238004500 0x7fb238004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 0x7fb238004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b2da0 con 0x7fb238003750 2021-11-15T14:34:34.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800daf0 con 0x7fb238004500 2021-11-15T14:34:34.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800dcb0 con 0x7fb2500b0520 2021-11-15T14:34:34.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb238004500 0x7fb238004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 msgr2=0x7fb238004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2500b0520 0x7fb238004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb238003750 msgr2=0x7fb238003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb238003750 0x7fb238003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/2782820457 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238003260 con 0x7fb238004500 2021-11-15T14:34:34.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb238004500 0x7fb238004980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb238004470 tx=0x7fb240001e30).ready entity=mon.1 client_cookie=6bb87c978b174108 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2400070d0 con 0x7fb238004500 2021-11-15T14:34:34.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240007230 con 0x7fb238004500 2021-11-15T14:34:34.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23ffff700 1 -- 172.21.2.135:0/2782820457 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24000c980 con 0x7fb238004500 2021-11-15T14:34:34.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/2782820457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb238004500 msgr2=0x7fb238004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 --2- 172.21.2.135:0/2782820457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb238004500 0x7fb238004980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb238004470 tx=0x7fb240001e30).stop 2021-11-15T14:34:34.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb255ce6700 1 -- 172.21.2.135:0/2782820457 reap_dead start 2021-11-15T14:34:34.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/2782820457 shutdown_connections 2021-11-15T14:34:34.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/2782820457 >> 172.21.2.135:0/2782820457 conn(0x7fb250060840 msgr2=0x7fb250060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/2782820457 shutdown_connections 2021-11-15T14:34:34.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/2782820457 wait complete. 2021-11-15T14:34:34.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 Processor -- start 2021-11-15T14:34:34.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- start start 2021-11-15T14:34:34.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 0x7fb2500646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 0x7fb2500a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250067a80 con 0x7fb2500b18d0 2021-11-15T14:34:34.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b1cb0 con 0x7fb250064c60 2021-11-15T14:34:34.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb250063950 con 0x7fb250067600 2021-11-15T14:34:34.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55004/0 (socket says 172.21.2.135:55004) 2021-11-15T14:34:34.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/1526337034 learned_addr learned my addr 172.21.2.135:0/1526337034 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:34.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb255ce6700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 0x7fb2500a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 msgr2=0x7fb2500a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb2554e5700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 0x7fb2500646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 0x7fb2500a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 msgr2=0x7fb2500646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 0x7fb2500646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 -- 172.21.2.135:0/1526337034 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250063bf0 con 0x7fb250064c60 2021-11-15T14:34:34.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb255ce6700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 0x7fb2500a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:34.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb2554e5700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 0x7fb2500646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:34.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb254ce4700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb250143f40 tx=0x7fb240015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2400070d0 con 0x7fb250064c60 2021-11-15T14:34:34.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240004920 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb250063e90 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb250151990 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.533+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb240004c80 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500b1cb0 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb240010070 con 0x7fb250064c60 2021-11-15T14:34:34.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb23e7fc700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 0x7fb230055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb24006c440 con 0x7fb250064c60 2021-11-15T14:34:34.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb2554e5700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 0x7fb230055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb2554e5700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 0x7fb230055b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb24c007000 tx=0x7fb24c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.537+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2400433e0 con 0x7fb250064c60 2021-11-15T14:34:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.621+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2500573d0 con 0x7fb250064c60 2021-11-15T14:34:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.621+0000 7fb23e7fc700 1 -- 172.21.2.135:0/1526337034 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb240046a00 con 0x7fb250064c60 2021-11-15T14:34:34.625 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 msgr2=0x7fb230055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 0x7fb230055b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb24c007000 tx=0x7fb24c008040).stop 2021-11-15T14:34:34.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 msgr2=0x7fb250067110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb250143f40 tx=0x7fb240015000).stop 2021-11-15T14:34:34.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 shutdown_connections 2021-11-15T14:34:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb230053640 0x7fb230055b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb250067600 0x7fb2500a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb250064c60 0x7fb250067110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 --2- 172.21.2.135:0/1526337034 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2500b18d0 0x7fb2500646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 >> 172.21.2.135:0/1526337034 conn(0x7fb250060840 msgr2=0x7fb2500adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 shutdown_connections 2021-11-15T14:34:34.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.625+0000 7fb257749700 1 -- 172.21.2.135:0/1526337034 wait complete. 2021-11-15T14:34:34.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2021-11-15T14:34:34.633 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-11-15T14:34:34.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 Processor -- start 2021-11-15T14:34:34.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- start start 2021-11-15T14:34:34.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb0d80b6600 0x7fb0d80b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb0d80b69e0 0x7fb0d812ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d8144130 con 0x7fb0d80b4440 2021-11-15T14:34:34.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d8143bf0 con 0x7fb0d80b69e0 2021-11-15T14:34:34.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d8143e90 con 0x7fb0d80b6600 2021-11-15T14:34:34.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d5d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb0d80b4440 0x7fb0d8061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42600/0 (socket says 172.21.2.135:42600) 2021-11-15T14:34:34.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d5d9b700 1 -- 172.21.2.135:0/2565132501 learned_addr learned my addr 172.21.2.135:0/2565132501 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:34.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 --2- 172.21.2.135:0/2565132501 >> v2:172.21.2.135:3300/0 conn(0x7fb0d80b6600 0x7fb0d80b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 -- 172.21.2.135:0/2565132501 >> v2:172.21.2.119:3300/0 conn(0x7fb0d80b69e0 msgr2=0x7fb0d812ba80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:34.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 --2- 172.21.2.135:0/2565132501 >> v2:172.21.2.119:3300/0 conn(0x7fb0d80b69e0 0x7fb0d812ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d559a700 1 -- 172.21.2.135:0/2565132501 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287587845 0 0) 0x7fb0d8144130 con 0x7fb0d80b4440 2021-11-15T14:34:34.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 -- 172.21.2.135:0/2565132501 >> v1:172.21.2.135:6789/0 conn(0x7fb0d80b4440 legacy=0x7fb0d8061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 -- 172.21.2.135:0/2565132501 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d8061670 con 0x7fb0d80b6600 2021-11-15T14:34:34.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d659c700 1 --2- 172.21.2.135:0/2565132501 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b6600 0x7fb0d80b5c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb0d81431a0 tx=0x7fb0cc006df0).ready entity=mon.1 client_cookie=1c6fd9ce74ca0003 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d559a700 1 -- 172.21.2.135:0/2565132501 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc00d5c0 con 0x7fb0d80b6600 2021-11-15T14:34:34.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d559a700 1 -- 172.21.2.135:0/2565132501 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc000e90 con 0x7fb0d80b6600 2021-11-15T14:34:34.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0d559a700 1 -- 172.21.2.135:0/2565132501 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc00d950 con 0x7fb0d80b6600 2021-11-15T14:34:34.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- 172.21.2.135:0/2565132501 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b6600 msgr2=0x7fb0d80b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/2565132501 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b6600 0x7fb0d80b5c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb0d81431a0 tx=0x7fb0cc006df0).stop 2021-11-15T14:34:34.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- 172.21.2.135:0/2565132501 shutdown_connections 2021-11-15T14:34:34.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/2565132501 >> v2:172.21.2.119:3300/0 conn(0x7fb0d80b69e0 0x7fb0d812ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/2565132501 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b6600 0x7fb0d80b5c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- 172.21.2.135:0/2565132501 >> 172.21.2.135:0/2565132501 conn(0x7fb0d805c510 msgr2=0x7fb0d805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- 172.21.2.135:0/2565132501 shutdown_connections 2021-11-15T14:34:34.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.681+0000 7fb0dcf35700 1 -- 172.21.2.135:0/2565132501 wait complete. 2021-11-15T14:34:34.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 Processor -- start 2021-11-15T14:34:34.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- start start 2021-11-15T14:34:34.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0d80b6600 0x7fb0d8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0d80b69e0 0x7fb0d812bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d812c0f0 con 0x7fb0d80b6600 2021-11-15T14:34:34.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81260c0 con 0x7fb0d80b4440 2021-11-15T14:34:34.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8126360 con 0x7fb0d80b69e0 2021-11-15T14:34:34.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55016/0 (socket says 172.21.2.135:55016) 2021-11-15T14:34:34.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 -- 172.21.2.135:0/4012863328 learned_addr learned my addr 172.21.2.135:0/4012863328 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:34.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 -- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0d80b69e0 msgr2=0x7fb0d812bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0d80b69e0 0x7fb0d812bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 -- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0d80b6600 msgr2=0x7fb0d8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0d80b6600 0x7fb0d8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 -- 172.21.2.135:0/4012863328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc00b180 con 0x7fb0d80b4440 2021-11-15T14:34:34.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d659c700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb0d81431a0 tx=0x7fb0cc012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc016070 con 0x7fb0d80b4440 2021-11-15T14:34:34.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc002f70 con 0x7fb0d80b4440 2021-11-15T14:34:34.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc00de50 con 0x7fb0d80b4440 2021-11-15T14:34:34.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d812b760 con 0x7fb0d80b4440 2021-11-15T14:34:34.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d812c680 con 0x7fb0d80b4440 2021-11-15T14:34:34.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d812b920 con 0x7fb0d80b4440 2021-11-15T14:34:34.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0cc00f030 con 0x7fb0d80b4440 2021-11-15T14:34:34.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 0x7fb0b4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb0cc06c950 con 0x7fb0d80b4440 2021-11-15T14:34:34.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.685+0000 7fb0d5d9b700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 0x7fb0b4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.689+0000 7fb0d5d9b700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 0x7fb0b4055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb0c8000bc0 tx=0x7fb0c80011a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.689+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0cc043950 con 0x7fb0d80b4440 2021-11-15T14:34:34.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0d8061910 con 0x7fb0d80b4440 2021-11-15T14:34:34.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0c77fe700 1 -- 172.21.2.135:0/4012863328 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0cc023090 con 0x7fb0d80b4440 2021-11-15T14:34:34.776 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:34.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 msgr2=0x7fb0b4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 0x7fb0b4055b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb0c8000bc0 tx=0x7fb0c80011a0).stop 2021-11-15T14:34:34.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 msgr2=0x7fb0d81268b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb0d81431a0 tx=0x7fb0cc012000).stop 2021-11-15T14:34:34.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 shutdown_connections 2021-11-15T14:34:34.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0b40536a0 0x7fb0b4055b60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0d80b69e0 0x7fb0d812bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0d80b6600 0x7fb0d8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:34.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 --2- 172.21.2.135:0/4012863328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0d80b4440 0x7fb0d81268b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 >> 172.21.2.135:0/4012863328 conn(0x7fb0d805c510 msgr2=0x7fb0d81288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:34.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 shutdown_connections 2021-11-15T14:34:34.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.773+0000 7fb0dcf35700 1 -- 172.21.2.135:0/4012863328 wait complete. 2021-11-15T14:34:34.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2021-11-15T14:34:34.783 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-11-15T14:34:34.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 Processor -- start 2021-11-15T14:34:34.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- start start 2021-11-15T14:34:34.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff5640b1e30 0x7ff5640b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff5640b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5640b03d0 con 0x7ff5640a7140 2021-11-15T14:34:34.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640a9140 con 0x7ff5640b1e30 2021-11-15T14:34:34.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640b0670 con 0x7ff564148420 2021-11-15T14:34:34.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff563fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff5640a7140 0x7ff5641447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42614/0 (socket says 172.21.2.135:42614) 2021-11-15T14:34:34.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff563fff700 1 -- 172.21.2.135:0/3107988828 learned_addr learned my addr 172.21.2.135:0/3107988828 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:34.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519230012 0 0) 0x7ff5640b03d0 con 0x7ff5640a7140 2021-11-15T14:34:34.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff544003260 con 0x7ff5640a7140 2021-11-15T14:34:34.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 --2- 172.21.2.135:0/3107988828 >> v2:172.21.2.119:3300/0 conn(0x7ff5640b1e30 0x7ff5640b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff562ffd700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff5640b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195474391 0 0) 0x7ff544003260 con 0x7ff5640a7140 2021-11-15T14:34:34.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 msgr2=0x7ff5640b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff5640b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 >> v2:172.21.2.119:3300/0 conn(0x7ff5640b1e30 msgr2=0x7ff5640b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 --2- 172.21.2.135:0/3107988828 >> v2:172.21.2.119:3300/0 conn(0x7ff5640b1e30 0x7ff5640b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640b0910 con 0x7ff5640a7140 2021-11-15T14:34:34.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff55c0019e0 con 0x7ff5640a7140 2021-11-15T14:34:34.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 >> v1:172.21.2.135:6789/0 conn(0x7ff5640a7140 legacy=0x7ff5641447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:34.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5440037d0 0x7ff544003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff544004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5440049f0 0x7ff544004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:34.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640b0670 con 0x7ff5440049f0 2021-11-15T14:34:34.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54400b750 con 0x7ff5440037d0 2021-11-15T14:34:34.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54400b890 con 0x7ff564148420 2021-11-15T14:34:34.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5440037d0 0x7ff544003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff562ffd700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff544004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff563fff700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5440049f0 0x7ff544004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:34.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 -- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 msgr2=0x7ff544004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff564148420 0x7ff544004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 -- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5440049f0 msgr2=0x7ff544004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:34.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5440049f0 0x7ff544004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:34.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 -- 172.21.2.135:0/3107988828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544003260 con 0x7ff5440037d0 2021-11-15T14:34:34.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5637fe700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5440037d0 0x7ff544003bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff55400c000 tx=0x7ff554006df0).ready entity=mon.1 client_cookie=862a4ae36c8e656d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:34.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55400e830 con 0x7ff5440037d0 2021-11-15T14:34:34.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400e990 con 0x7ff5440037d0 2021-11-15T14:34:34.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff5627fc700 1 -- 172.21.2.135:0/3107988828 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55400ecf0 con 0x7ff5440037d0 2021-11-15T14:34:34.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- 172.21.2.135:0/3107988828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5440037d0 msgr2=0x7ff544003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 --2- 172.21.2.135:0/3107988828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5440037d0 0x7ff544003bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff55400c000 tx=0x7ff554006df0).stop 2021-11-15T14:34:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff563fff700 1 -- 172.21.2.135:0/3107988828 reap_dead start 2021-11-15T14:34:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- 172.21.2.135:0/3107988828 shutdown_connections 2021-11-15T14:34:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- 172.21.2.135:0/3107988828 >> 172.21.2.135:0/3107988828 conn(0x7ff56405f730 msgr2=0x7ff56405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- 172.21.2.135:0/3107988828 shutdown_connections 2021-11-15T14:34:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 -- 172.21.2.135:0/3107988828 wait complete. 2021-11-15T14:34:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.833+0000 7ff56a18e700 1 Processor -- start 2021-11-15T14:34:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- start start 2021-11-15T14:34:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5440037d0 0x7ff5640ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5640acd90 0x7ff5640ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564141b10 con 0x7ff5640acd90 2021-11-15T14:34:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640af990 con 0x7ff564159f10 2021-11-15T14:34:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56414be90 con 0x7ff5440037d0 2021-11-15T14:34:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff5637fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5440037d0 0x7ff5640ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff562ffd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5640acd90 0x7ff5640ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55040/0 (socket says 172.21.2.135:55040) 2021-11-15T14:34:35.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 -- 172.21.2.135:0/533205302 learned_addr learned my addr 172.21.2.135:0/533205302 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 -- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5440037d0 msgr2=0x7ff5640ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5440037d0 0x7ff5640ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 -- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5640acd90 msgr2=0x7ff5640ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5640acd90 0x7ff5640ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 -- 172.21.2.135:0/533205302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56414d7f0 con 0x7ff564159f10 2021-11-15T14:34:35.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff563fff700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff5640aedf0 tx=0x7ff5640b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55c011780 con 0x7ff564159f10 2021-11-15T14:34:35.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0118e0 con 0x7ff564159f10 2021-11-15T14:34:35.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55c011c40 con 0x7ff564159f10 2021-11-15T14:34:35.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56414dde0 con 0x7ff564159f10 2021-11-15T14:34:35.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640ad7a0 con 0x7ff564159f10 2021-11-15T14:34:35.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56414e9d0 con 0x7ff564159f10 2021-11-15T14:34:35.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff55c01c360 con 0x7ff564159f10 2021-11-15T14:34:35.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 0x7ff548055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff55c06b680 con 0x7ff564159f10 2021-11-15T14:34:35.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff5637fe700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 0x7ff548055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.837+0000 7ff5637fe700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 0x7ff548055ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff55401e000 tx=0x7ff554019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.841+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff55c042620 con 0x7ff564159f10 2021-11-15T14:34:35.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.921+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff56414df70 con 0x7ff564159f10 2021-11-15T14:34:35.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff560ff9700 1 -- 172.21.2.135:0/533205302 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff55c019020 con 0x7ff564159f10 2021-11-15T14:34:35.042 INFO:teuthology.orchestra.run.gibba035.stdout:60129542148 2021-11-15T14:34:35.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 msgr2=0x7ff548055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 0x7ff548055ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff55401e000 tx=0x7ff554019000).stop 2021-11-15T14:34:35.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 msgr2=0x7ff56415a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff5640aedf0 tx=0x7ff5640b0aa0).stop 2021-11-15T14:34:35.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 shutdown_connections 2021-11-15T14:34:35.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff548053610 0x7ff548055ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff564159f10 0x7ff56415a390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5640acd90 0x7ff5640ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 --2- 172.21.2.135:0/533205302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5440037d0 0x7ff5640ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 >> 172.21.2.135:0/533205302 conn(0x7ff56405f730 msgr2=0x7ff5640b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 shutdown_connections 2021-11-15T14:34:35.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:34.925+0000 7ff56a18e700 1 -- 172.21.2.135:0/533205302 wait complete. 2021-11-15T14:34:35.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2021-11-15T14:34:35.049 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-11-15T14:34:35.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.105+0000 7f6e8dcfb700 1 Processor -- start 2021-11-15T14:34:35.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.105+0000 7f6e8dcfb700 1 -- start start 2021-11-15T14:34:35.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 0x7f6e88141720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6e880ac590 0x7f6e88141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e88142100 con 0x7f6e880b2280 2021-11-15T14:34:35.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e881452d0 con 0x7f6e880ac590 2021-11-15T14:34:35.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88145570 con 0x7f6e880b0050 2021-11-15T14:34:35.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f6e880b2280 0x7f6e880abe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42632/0 (socket says 172.21.2.135:42632) 2021-11-15T14:34:35.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 -- 172.21.2.135:0/1365677625 learned_addr learned my addr 172.21.2.135:0/1365677625 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:35.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919604796 0 0) 0x7f6e88142100 con 0x7f6e880b2280 2021-11-15T14:34:35.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e74003260 con 0x7f6e880b2280 2021-11-15T14:34:35.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e87fff700 1 --2- 172.21.2.135:0/1365677625 >> v2:172.21.2.119:3300/0 conn(0x7f6e880ac590 0x7f6e88141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460697924 0 0) 0x7f6e74003260 con 0x7f6e880b2280 2021-11-15T14:34:35.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e86ffd700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 0x7f6e88141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 msgr2=0x7f6e88141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 0x7f6e88141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 >> v2:172.21.2.119:3300/0 conn(0x7f6e880ac590 msgr2=0x7f6e88141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 --2- 172.21.2.135:0/1365677625 >> v2:172.21.2.119:3300/0 conn(0x7f6e880ac590 0x7f6e88141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88141280 con 0x7f6e880b2280 2021-11-15T14:34:35.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6e78001660 con 0x7f6e880b2280 2021-11-15T14:34:35.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 >> v1:172.21.2.135:6789/0 conn(0x7f6e880b2280 legacy=0x7f6e880abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e74003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 0x7f6e74004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e74004b10 0x7f6e74004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e881452d0 con 0x7f6e74004b10 2021-11-15T14:34:35.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88145570 con 0x7f6e74003750 2021-11-15T14:34:35.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7400b990 con 0x7f6e880b0050 2021-11-15T14:34:35.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e74003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 -- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 msgr2=0x7f6e74004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e880b0050 0x7f6e74004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 -- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e74004b10 msgr2=0x7f6e74004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e74004b10 0x7f6e74004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 -- 172.21.2.135:0/1365677625 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74003260 con 0x7f6e74003750 2021-11-15T14:34:35.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e74003b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6e78001370 tx=0x7f6e88141170).ready entity=mon.1 client_cookie=632ccfc619480f35 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e780070d0 con 0x7f6e74003750 2021-11-15T14:34:35.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78007230 con 0x7f6e74003750 2021-11-15T14:34:35.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e867fc700 1 -- 172.21.2.135:0/1365677625 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e7800c8f0 con 0x7f6e74003750 2021-11-15T14:34:35.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1365677625 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 msgr2=0x7f6e74003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1365677625 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e74003b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6e78001370 tx=0x7f6e88141170).stop 2021-11-15T14:34:35.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e87fff700 1 -- 172.21.2.135:0/1365677625 reap_dead start 2021-11-15T14:34:35.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1365677625 shutdown_connections 2021-11-15T14:34:35.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1365677625 >> 172.21.2.135:0/1365677625 conn(0x7f6e8805f730 msgr2=0x7f6e8805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1365677625 shutdown_connections 2021-11-15T14:34:35.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1365677625 wait complete. 2021-11-15T14:34:35.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 Processor -- start 2021-11-15T14:34:35.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.109+0000 7f6e8dcfb700 1 -- start start 2021-11-15T14:34:35.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e881569c0 0x7f6e8815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e8813cac0 0x7f6e8815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880b3a90 con 0x7f6e8813cac0 2021-11-15T14:34:35.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880b32b0 con 0x7f6e74003750 2021-11-15T14:34:35.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880b3550 con 0x7f6e881569c0 2021-11-15T14:34:35.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55056/0 (socket says 172.21.2.135:55056) 2021-11-15T14:34:35.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 -- 172.21.2.135:0/1258117899 learned_addr learned my addr 172.21.2.135:0/1258117899 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 -- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e881569c0 msgr2=0x7f6e8815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e881569c0 0x7f6e8815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 -- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e8813cac0 msgr2=0x7f6e8815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e8813cac0 0x7f6e8815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 -- 172.21.2.135:0/1258117899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880b37f0 con 0x7f6e74003750 2021-11-15T14:34:35.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e877fe700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6e880add90 tx=0x7f6e78015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e78004730 con 0x7f6e74003750 2021-11-15T14:34:35.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78004890 con 0x7f6e74003750 2021-11-15T14:34:35.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8815a0a0 con 0x7f6e74003750 2021-11-15T14:34:35.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88144a70 con 0x7f6e74003750 2021-11-15T14:34:35.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e78004bf0 con 0x7f6e74003750 2021-11-15T14:34:35.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8815a230 con 0x7f6e74003750 2021-11-15T14:34:35.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e7801d070 con 0x7f6e74003750 2021-11-15T14:34:35.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 0x7f6e68055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6e7806cb50 con 0x7f6e74003750 2021-11-15T14:34:35.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e86ffd700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 0x7f6e68055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.113+0000 7f6e86ffd700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 0x7f6e68055bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f6e7c007000 tx=0x7f6e7c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.117+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e78043a80 con 0x7f6e74003750 2021-11-15T14:34:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6e880573d0 con 0x7f6e74003750 2021-11-15T14:34:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e84ff9700 1 -- 172.21.2.135:0/1258117899 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e7801a020 con 0x7f6e74003750 2021-11-15T14:34:35.202 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 msgr2=0x7f6e68055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 0x7f6e68055bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f6e7c007000 tx=0x7f6e7c008040).stop 2021-11-15T14:34:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 msgr2=0x7f6e8813c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f6e880add90 tx=0x7f6e78015000).stop 2021-11-15T14:34:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 shutdown_connections 2021-11-15T14:34:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e680536f0 0x7f6e68055bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e8813cac0 0x7f6e8815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e881569c0 0x7f6e8815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 --2- 172.21.2.135:0/1258117899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e74003750 0x7f6e8813c2e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.197+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 >> 172.21.2.135:0/1258117899 conn(0x7f6e8805f730 msgr2=0x7f6e88141af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.201+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 shutdown_connections 2021-11-15T14:34:35.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.201+0000 7f6e8dcfb700 1 -- 172.21.2.135:0/1258117899 wait complete. 2021-11-15T14:34:35.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2021-11-15T14:34:35.209 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-11-15T14:34:35.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 Processor -- start 2021-11-15T14:34:35.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 -- start start 2021-11-15T14:34:35.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 0x7f5a4c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0b03d0 con 0x7f5a4c0b1e30 2021-11-15T14:34:35.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0b0670 con 0x7f5a4c148420 2021-11-15T14:34:35.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a528fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0a9140 con 0x7f5a4c0b1050 2021-11-15T14:34:35.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a4b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5a4c148420 0x7f5a4c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42656/0 (socket says 172.21.2.135:42656) 2021-11-15T14:34:35.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.257+0000 7f5a4b7fe700 1 -- 172.21.2.135:0/1534933187 learned_addr learned my addr 172.21.2.135:0/1534933187 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:35.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054719013 0 0) 0x7f5a4c0b0670 con 0x7f5a4c148420 2021-11-15T14:34:35.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a2c003260 con 0x7f5a4c148420 2021-11-15T14:34:35.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232111818 0 0) 0x7f5a2c003260 con 0x7f5a4c148420 2021-11-15T14:34:35.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 msgr2=0x7f5a4c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 0x7f5a4c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 >> v1:172.21.2.119:6789/0 conn(0x7f5a4c0b1e30 legacy=0x7f5a4c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0b0910 con 0x7f5a4c148420 2021-11-15T14:34:35.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5a3c001660 con 0x7f5a4c148420 2021-11-15T14:34:35.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 >> v1:172.21.2.135:6789/0 conn(0x7f5a4c148420 legacy=0x7f5a4c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c003780 0x7f5a2c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a2c004500 0x7f5a2c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 0x7f5a2c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c00b8e0 con 0x7f5a2c003780 2021-11-15T14:34:35.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c00ba50 con 0x7f5a2c004500 2021-11-15T14:34:35.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c00bc10 con 0x7f5a4c0b1050 2021-11-15T14:34:35.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a2c004500 0x7f5a2c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 -- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 msgr2=0x7f5a2c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0b1050 0x7f5a2c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 -- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c003780 msgr2=0x7f5a2c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c003780 0x7f5a2c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 -- 172.21.2.135:0/1534933187 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c003260 con 0x7f5a2c004500 2021-11-15T14:34:35.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a2c004500 0x7f5a2c004980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f5a4c1477b0 tx=0x7f5a4c0b0560).ready entity=mon.1 client_cookie=9c71351da6ea20b0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c0070d0 con 0x7f5a2c004500 2021-11-15T14:34:35.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c007230 con 0x7f5a2c004500 2021-11-15T14:34:35.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4affd700 1 -- 172.21.2.135:0/1534933187 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00c990 con 0x7f5a2c004500 2021-11-15T14:34:35.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- 172.21.2.135:0/1534933187 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a2c004500 msgr2=0x7f5a2c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 --2- 172.21.2.135:0/1534933187 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a2c004500 0x7f5a2c004980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f5a4c1477b0 tx=0x7f5a4c0b0560).stop 2021-11-15T14:34:35.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 -- 172.21.2.135:0/1534933187 reap_dead start 2021-11-15T14:34:35.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- 172.21.2.135:0/1534933187 shutdown_connections 2021-11-15T14:34:35.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- 172.21.2.135:0/1534933187 >> 172.21.2.135:0/1534933187 conn(0x7f5a4c05f730 msgr2=0x7f5a4c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- 172.21.2.135:0/1534933187 shutdown_connections 2021-11-15T14:34:35.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- 172.21.2.135:0/1534933187 wait complete. 2021-11-15T14:34:35.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 Processor -- start 2021-11-15T14:34:35.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- start start 2021-11-15T14:34:35.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c004500 0x7f5a4c0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0a9500 0x7f5a4c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0ac7c0 con 0x7f5a2c004500 2021-11-15T14:34:35.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0a9a10 con 0x7f5a4c0aa020 2021-11-15T14:34:35.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a528fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c159e80 con 0x7f5a4c0a9500 2021-11-15T14:34:35.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55078/0 (socket says 172.21.2.135:55078) 2021-11-15T14:34:35.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 -- 172.21.2.135:0/411254317 learned_addr learned my addr 172.21.2.135:0/411254317 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4b7fe700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0a9500 0x7f5a4c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a4bfff700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c004500 0x7f5a4c0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 -- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0a9500 msgr2=0x7f5a4c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0a9500 0x7f5a4c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 -- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c004500 msgr2=0x7f5a4c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c004500 0x7f5a4c0ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 -- 172.21.2.135:0/411254317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c15a120 con 0x7f5a4c0aa020 2021-11-15T14:34:35.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a50e99700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f5a3c001370 tx=0x7f5a4400a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4400cea0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.261+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44005c30 con 0x7f5a4c0aa020 2021-11-15T14:34:35.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a44007070 con 0x7f5a4c0aa020 2021-11-15T14:34:35.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c156ca0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c063710 con 0x7f5a4c0aa020 2021-11-15T14:34:35.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c0a9bd0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a4401d070 con 0x7f5a4c0aa020 2021-11-15T14:34:35.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a497fa700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 0x7f5a30055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5a4406ace0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a4bfff700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 0x7f5a30055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a4bfff700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 0x7f5a30055b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5a34007000 tx=0x7f5a34008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.265+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a44041ce0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5a4c15a2b0 con 0x7f5a4c0aa020 2021-11-15T14:34:35.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a497fa700 1 -- 172.21.2.135:0/411254317 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a44045300 con 0x7f5a4c0aa020 2021-11-15T14:34:35.353 INFO:teuthology.orchestra.run.gibba035.stdout:60129542150 2021-11-15T14:34:35.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 msgr2=0x7f5a30055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 0x7f5a30055b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5a34007000 tx=0x7f5a34008040).stop 2021-11-15T14:34:35.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 msgr2=0x7f5a4c15a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f5a3c001370 tx=0x7f5a4400a060).stop 2021-11-15T14:34:35.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 shutdown_connections 2021-11-15T14:34:35.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a300536a0 0x7f5a30055b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a4c0aa020 0x7f5a4c15a5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a4c0a9500 0x7f5a4c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 --2- 172.21.2.135:0/411254317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a2c004500 0x7f5a4c0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 >> 172.21.2.135:0/411254317 conn(0x7f5a4c05f730 msgr2=0x7f5a4c145620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 shutdown_connections 2021-11-15T14:34:35.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.349+0000 7f5a528fc700 1 -- 172.21.2.135:0/411254317 wait complete. 2021-11-15T14:34:35.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2021-11-15T14:34:35.360 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-11-15T14:34:35.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 Processor -- start 2021-11-15T14:34:35.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- start start 2021-11-15T14:34:35.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3064148420 0x7f30640b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f30640a7140 0x7f30641447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30640b03d0 con 0x7f30640b1e30 2021-11-15T14:34:35.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640a9140 con 0x7f3064148420 2021-11-15T14:34:35.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640b0670 con 0x7f30640a7140 2021-11-15T14:34:35.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f30640a7140 0x7f30641447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f30640a7140 0x7f30641447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55084/0 (socket says 172.21.2.135:55084) 2021-11-15T14:34:35.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 -- 172.21.2.135:0/1917055747 learned_addr learned my addr 172.21.2.135:0/1917055747 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 -- 172.21.2.135:0/1917055747 >> v2:172.21.2.119:3300/0 conn(0x7f3064148420 msgr2=0x7f30640b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:35.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 --2- 172.21.2.135:0/1917055747 >> v2:172.21.2.119:3300/0 conn(0x7f3064148420 0x7f30640b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 -- 172.21.2.135:0/1917055747 >> v1:172.21.2.119:6789/0 conn(0x7f30640b1e30 legacy=0x7f30640b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:35.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 -- 172.21.2.135:0/1917055747 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640b0910 con 0x7f30640a7140 2021-11-15T14:34:35.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f3069428700 1 --2- 172.21.2.135:0/1917055747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640a7140 0x7f30641447a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f30640acee0 tx=0x7f305c009290).ready entity=mon.1 client_cookie=a977219772a2f750 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f30637fe700 1 -- 172.21.2.135:0/1917055747 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f305c00b820 con 0x7f30640a7140 2021-11-15T14:34:35.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f30637fe700 1 -- 172.21.2.135:0/1917055747 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00b980 con 0x7f30640a7140 2021-11-15T14:34:35.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f30637fe700 1 -- 172.21.2.135:0/1917055747 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f305c00bb30 con 0x7f30640a7140 2021-11-15T14:34:35.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- 172.21.2.135:0/1917055747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640a7140 msgr2=0x7f30641447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- 172.21.2.135:0/1917055747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640a7140 0x7f30641447a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f30640acee0 tx=0x7f305c009290).stop 2021-11-15T14:34:35.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- 172.21.2.135:0/1917055747 shutdown_connections 2021-11-15T14:34:35.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- 172.21.2.135:0/1917055747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640a7140 0x7f30641447a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- 172.21.2.135:0/1917055747 >> v2:172.21.2.119:3300/0 conn(0x7f3064148420 0x7f30640b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- 172.21.2.135:0/1917055747 >> 172.21.2.135:0/1917055747 conn(0x7f306405f730 msgr2=0x7f306405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- 172.21.2.135:0/1917055747 shutdown_connections 2021-11-15T14:34:35.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- 172.21.2.135:0/1917055747 wait complete. 2021-11-15T14:34:35.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 Processor -- start 2021-11-15T14:34:35.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- start start 2021-11-15T14:34:35.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30640a7140 0x7f30640abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3064148420 0x7f3064063460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640a9b60 con 0x7f3064148420 2021-11-15T14:34:35.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640a9e00 con 0x7f30640b1e30 2021-11-15T14:34:35.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.413+0000 7f306ae8b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640aa0a0 con 0x7f30640a7140 2021-11-15T14:34:35.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55088/0 (socket says 172.21.2.135:55088) 2021-11-15T14:34:35.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 -- 172.21.2.135:0/190133593 learned_addr learned my addr 172.21.2.135:0/190133593 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 -- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30640a7140 msgr2=0x7f30640abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30640a7140 0x7f30640abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 -- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3064148420 msgr2=0x7f3064063460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3064148420 0x7f3064063460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 -- 172.21.2.135:0/190133593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009530 con 0x7f30640b1e30 2021-11-15T14:34:35.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3063fff700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f304c000ed0 tx=0x7f304c006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f304c009e00 con 0x7f30640b1e30 2021-11-15T14:34:35.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c012410 con 0x7f30640b1e30 2021-11-15T14:34:35.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f304c012770 con 0x7f30640b1e30 2021-11-15T14:34:35.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3064063950 con 0x7f30640b1e30 2021-11-15T14:34:35.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3064063e30 con 0x7f30640b1e30 2021-11-15T14:34:35.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30640aa260 con 0x7f30640b1e30 2021-11-15T14:34:35.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f304c00f030 con 0x7f30640b1e30 2021-11-15T14:34:35.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 0x7f3048055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f304c06b710 con 0x7f30640b1e30 2021-11-15T14:34:35.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3068c27700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 0x7f3048055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.417+0000 7f3068c27700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 0x7f3048055b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3054002fb0 tx=0x7f30540069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.421+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f304c042600 con 0x7f30640b1e30 2021-11-15T14:34:35.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.501+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f30640b0bb0 con 0x7f30640b1e30 2021-11-15T14:34:35.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.501+0000 7f3061ffb700 1 -- 172.21.2.135:0/190133593 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f304c045c20 con 0x7f30640b1e30 2021-11-15T14:34:35.506 INFO:teuthology.orchestra.run.gibba035.stdout:60129542149 2021-11-15T14:34:35.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 msgr2=0x7f3048055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 0x7f3048055b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3054002fb0 tx=0x7f30540069b0).stop 2021-11-15T14:34:35.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 msgr2=0x7f30640aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f304c000ed0 tx=0x7f304c006d60).stop 2021-11-15T14:34:35.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 shutdown_connections 2021-11-15T14:34:35.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3048053660 0x7f3048055b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3064148420 0x7f3064063460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30640b1e30 0x7f30640aa540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 --2- 172.21.2.135:0/190133593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30640a7140 0x7f30640abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 >> 172.21.2.135:0/190133593 conn(0x7f306405f730 msgr2=0x7f3064143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 shutdown_connections 2021-11-15T14:34:35.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.505+0000 7f306ae8b700 1 -- 172.21.2.135:0/190133593 wait complete. 2021-11-15T14:34:35.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2021-11-15T14:34:35.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-11-15T14:34:35.513 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T14:34:35.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 Processor -- start 2021-11-15T14:34:35.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- start start 2021-11-15T14:34:35.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc9bc148420 0x7fc9bc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc9bc0a7140 0x7fc9bc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0b03d0 con 0x7fc9bc0b1e30 2021-11-15T14:34:35.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0a9140 con 0x7fc9bc0a7140 2021-11-15T14:34:35.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b0670 con 0x7fc9bc148420 2021-11-15T14:34:35.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bbfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc9bc0b1e30 0x7fc9bc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42684/0 (socket says 172.21.2.135:42684) 2021-11-15T14:34:35.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bbfff700 1 -- 172.21.2.135:0/2027105725 learned_addr learned my addr 172.21.2.135:0/2027105725 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:35.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 --2- 172.21.2.135:0/2027105725 >> v2:172.21.2.135:3300/0 conn(0x7fc9bc148420 0x7fc9bc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 -- 172.21.2.135:0/2027105725 >> v2:172.21.2.119:3300/0 conn(0x7fc9bc0a7140 msgr2=0x7fc9bc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 --2- 172.21.2.135:0/2027105725 >> v2:172.21.2.119:3300/0 conn(0x7fc9bc0a7140 0x7fc9bc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9baffd700 1 -- 172.21.2.135:0/2027105725 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726565831 0 0) 0x7fc9bc0b03d0 con 0x7fc9bc0b1e30 2021-11-15T14:34:35.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 -- 172.21.2.135:0/2027105725 >> v1:172.21.2.135:6789/0 conn(0x7fc9bc0b1e30 legacy=0x7fc9bc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 -- 172.21.2.135:0/2027105725 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0b0910 con 0x7fc9bc148420 2021-11-15T14:34:35.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9bb7fe700 1 --2- 172.21.2.135:0/2027105725 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc148420 0x7fc9bc0b1050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc9bc1477b0 tx=0x7fc9b4006df0).ready entity=mon.1 client_cookie=ec7f8e9822dac4a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9baffd700 1 -- 172.21.2.135:0/2027105725 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b400d5c0 con 0x7fc9bc148420 2021-11-15T14:34:35.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9baffd700 1 -- 172.21.2.135:0/2027105725 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4000e90 con 0x7fc9bc148420 2021-11-15T14:34:35.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9baffd700 1 -- 172.21.2.135:0/2027105725 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b400d910 con 0x7fc9bc148420 2021-11-15T14:34:35.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- 172.21.2.135:0/2027105725 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc148420 msgr2=0x7fc9bc0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 --2- 172.21.2.135:0/2027105725 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc148420 0x7fc9bc0b1050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc9bc1477b0 tx=0x7fc9b4006df0).stop 2021-11-15T14:34:35.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- 172.21.2.135:0/2027105725 shutdown_connections 2021-11-15T14:34:35.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 --2- 172.21.2.135:0/2027105725 >> v2:172.21.2.119:3300/0 conn(0x7fc9bc0a7140 0x7fc9bc1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 --2- 172.21.2.135:0/2027105725 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc148420 0x7fc9bc0b1050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- 172.21.2.135:0/2027105725 >> 172.21.2.135:0/2027105725 conn(0x7fc9bc05f730 msgr2=0x7fc9bc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- 172.21.2.135:0/2027105725 shutdown_connections 2021-11-15T14:34:35.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.561+0000 7fc9c228f700 1 -- 172.21.2.135:0/2027105725 wait complete. 2021-11-15T14:34:35.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 Processor -- start 2021-11-15T14:34:35.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- start start 2021-11-15T14:34:35.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9bc0b1e30 0x7fc9bc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9bc148420 0x7fc9bc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0add60 con 0x7fc9bc148420 2021-11-15T14:34:35.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0a94c0 con 0x7fc9bc0a7140 2021-11-15T14:34:35.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0a96f0 con 0x7fc9bc0b1e30 2021-11-15T14:34:35.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55102/0 (socket says 172.21.2.135:55102) 2021-11-15T14:34:35.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 -- 172.21.2.135:0/419200523 learned_addr learned my addr 172.21.2.135:0/419200523 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 -- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9bc0b1e30 msgr2=0x7fc9bc0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9bc0b1e30 0x7fc9bc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 -- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9bc148420 msgr2=0x7fc9bc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9bc148420 0x7fc9bc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 -- 172.21.2.135:0/419200523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b400b180 con 0x7fc9bc0a7140 2021-11-15T14:34:35.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bbfff700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc9bc0ad3d0 tx=0x7fc9a4007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a400ce40 con 0x7fc9bc0a7140 2021-11-15T14:34:35.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40072e0 con 0x7fc9bc0a7140 2021-11-15T14:34:35.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4005800 con 0x7fc9bc0a7140 2021-11-15T14:34:35.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc0a9990 con 0x7fc9bc0a7140 2021-11-15T14:34:35.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0adf10 con 0x7fc9bc0a7140 2021-11-15T14:34:35.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc0b0bb0 con 0x7fc9bc0a7140 2021-11-15T14:34:35.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc9a4010070 con 0x7fc9bc0a7140 2021-11-15T14:34:35.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 0x7fc9a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc9a406b340 con 0x7fc9bc0a7140 2021-11-15T14:34:35.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.565+0000 7fc9bb7fe700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 0x7fc9a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.569+0000 7fc9bb7fe700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 0x7fc9a0055b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc9bc1477b0 tx=0x7fc9b4012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.569+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9a4042230 con 0x7fc9bc0a7140 2021-11-15T14:34:35.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.649+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9bc0a9e30 con 0x7fc9a00536a0 2021-11-15T14:34:35.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.657+0000 7fc9b97fa700 1 -- 172.21.2.135:0/419200523 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82376 (secure 0 0 0) 0x7fc9bc0a9e30 con 0x7fc9a00536a0 2021-11-15T14:34:35.663 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:35.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 msgr2=0x7fc9a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 0x7fc9a0055b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc9bc1477b0 tx=0x7fc9b4012000).stop 2021-11-15T14:34:35.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 msgr2=0x7fc9bc0ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc9bc0ad3d0 tx=0x7fc9a4007a60).stop 2021-11-15T14:34:35.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 shutdown_connections 2021-11-15T14:34:35.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9a00536a0 0x7fc9a0055b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9bc148420 0x7fc9bc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9bc0b1e30 0x7fc9bc0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 --2- 172.21.2.135:0/419200523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9bc0a7140 0x7fc9bc0ae650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 >> 172.21.2.135:0/419200523 conn(0x7fc9bc05f730 msgr2=0x7fc9bc144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 shutdown_connections 2021-11-15T14:34:35.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.661+0000 7fc9c228f700 1 -- 172.21.2.135:0/419200523 wait complete. 2021-11-15T14:34:35.667 INFO:teuthology.orchestra.run.gibba035.stderr:dumped all 2021-11-15T14:34:35.669 INFO:teuthology.orchestra.run.gibba035.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-11-15T14:34:35.058940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390764,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583956,"statfs":{"total":773094113280,"available":764501970944,"internally_reserved":8589934592,"allocated":2142208,"data_stored":832526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002898"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.576517+0000","last_change":"2021-11-15T14:34:30.574966+0000","last_active":"2021-11-15T14:34:30.576517+0000","last_peered":"2021-11-15T14:34:30.576517+0000","last_clean":"2021-11-15T14:34:30.576517+0000","last_became_active":"2021-11-15T14:34:30.573050+0000","last_became_peered":"2021-11-15T14:34:30.573050+0000","last_unstale":"2021-11-15T14:34:30.576517+0000","last_undegraded":"2021-11-15T14:34:30.576517+0000","last_fullsized":"2021-11-15T14:34:30.576517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.568971+0000","last_change":"2021-11-15T14:34:20.467684+0000","last_active":"2021-11-15T14:34:30.568971+0000","last_peered":"2021-11-15T14:34:30.568971+0000","last_clean":"2021-11-15T14:34:30.568971+0000","last_became_active":"2021-11-15T14:34:20.466743+0000","last_became_peered":"2021-11-15T14:34:20.466743+0000","last_unstale":"2021-11-15T14:34:30.568971+0000","last_undegraded":"2021-11-15T14:34:30.568971+0000","last_fullsized":"2021-11-15T14:34:30.568971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_clean_scrub_stamp":"2021-11-15T14:34:16.050418+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791526+0000","last_change":"2021-11-15T14:34:24.844233+0000","last_active":"2021-11-15T14:34:29.791526+0000","last_peered":"2021-11-15T14:34:29.791526+0000","last_clean":"2021-11-15T14:34:29.791526+0000","last_became_active":"2021-11-15T14:34:24.844069+0000","last_became_peered":"2021-11-15T14:34:24.844069+0000","last_unstale":"2021-11-15T14:34:29.791526+0000","last_undegraded":"2021-11-15T14:34:29.791526+0000","last_fullsized":"2021-11-15T14:34:29.791526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.797480+0000","last_change":"2021-11-15T14:34:26.576619+0000","last_active":"2021-11-15T14:34:29.797480+0000","last_peered":"2021-11-15T14:34:29.797480+0000","last_clean":"2021-11-15T14:34:29.797480+0000","last_became_active":"2021-11-15T14:34:26.576411+0000","last_became_peered":"2021-11-15T14:34:26.576411+0000","last_unstale":"2021-11-15T14:34:29.797480+0000","last_undegraded":"2021-11-15T14:34:29.797480+0000","last_fullsized":"2021-11-15T14:34:29.797480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.579447+0000","last_change":"2021-11-15T14:34:30.577222+0000","last_active":"2021-11-15T14:34:30.579447+0000","last_peered":"2021-11-15T14:34:30.579447+0000","last_clean":"2021-11-15T14:34:30.579447+0000","last_became_active":"2021-11-15T14:34:30.575078+0000","last_became_peered":"2021-11-15T14:34:30.575078+0000","last_unstale":"2021-11-15T14:34:30.579447+0000","last_undegraded":"2021-11-15T14:34:30.579447+0000","last_fullsized":"2021-11-15T14:34:30.579447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791468+0000","last_change":"2021-11-15T14:34:24.543141+0000","last_active":"2021-11-15T14:34:29.791468+0000","last_peered":"2021-11-15T14:34:29.791468+0000","last_clean":"2021-11-15T14:34:29.791468+0000","last_became_active":"2021-11-15T14:34:24.542973+0000","last_became_peered":"2021-11-15T14:34:24.542973+0000","last_unstale":"2021-11-15T14:34:29.791468+0000","last_undegraded":"2021-11-15T14:34:29.791468+0000","last_fullsized":"2021-11-15T14:34:29.791468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796066+0000","last_change":"2021-11-15T14:34:26.576669+0000","last_active":"2021-11-15T14:34:29.796066+0000","last_peered":"2021-11-15T14:34:29.796066+0000","last_clean":"2021-11-15T14:34:29.796066+0000","last_became_active":"2021-11-15T14:34:26.576404+0000","last_became_peered":"2021-11-15T14:34:26.576404+0000","last_unstale":"2021-11-15T14:34:29.796066+0000","last_undegraded":"2021-11-15T14:34:29.796066+0000","last_fullsized":"2021-11-15T14:34:29.796066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.580143+0000","last_change":"2021-11-15T14:34:30.579200+0000","last_active":"2021-11-15T14:34:30.580143+0000","last_peered":"2021-11-15T14:34:30.580143+0000","last_clean":"2021-11-15T14:34:30.580143+0000","last_became_active":"2021-11-15T14:34:30.576895+0000","last_became_peered":"2021-11-15T14:34:30.576895+0000","last_unstale":"2021-11-15T14:34:30.580143+0000","last_undegraded":"2021-11-15T14:34:30.580143+0000","last_fullsized":"2021-11-15T14:34:30.580143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.797727+0000","last_change":"2021-11-15T14:34:24.544907+0000","last_active":"2021-11-15T14:34:29.797727+0000","last_peered":"2021-11-15T14:34:29.797727+0000","last_clean":"2021-11-15T14:34:29.797727+0000","last_became_active":"2021-11-15T14:34:24.544673+0000","last_became_peered":"2021-11-15T14:34:24.544673+0000","last_unstale":"2021-11-15T14:34:29.797727+0000","last_undegraded":"2021-11-15T14:34:29.797727+0000","last_fullsized":"2021-11-15T14:34:29.797727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.801201+0000","last_change":"2021-11-15T14:34:26.599038+0000","last_active":"2021-11-15T14:34:29.801201+0000","last_peered":"2021-11-15T14:34:29.801201+0000","last_clean":"2021-11-15T14:34:29.801201+0000","last_became_active":"2021-11-15T14:34:26.598718+0000","last_became_peered":"2021-11-15T14:34:26.598718+0000","last_unstale":"2021-11-15T14:34:29.801201+0000","last_undegraded":"2021-11-15T14:34:29.801201+0000","last_fullsized":"2021-11-15T14:34:29.801201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796120+0000","last_change":"2021-11-15T14:34:29.673036+0000","last_active":"2021-11-15T14:34:29.796120+0000","last_peered":"2021-11-15T14:34:29.796120+0000","last_clean":"2021-11-15T14:34:29.796120+0000","last_became_active":"2021-11-15T14:34:29.672661+0000","last_became_peered":"2021-11-15T14:34:29.672661+0000","last_unstale":"2021-11-15T14:34:29.796120+0000","last_undegraded":"2021-11-15T14:34:29.796120+0000","last_fullsized":"2021-11-15T14:34:29.796120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791525+0000","last_change":"2021-11-15T14:34:24.543140+0000","last_active":"2021-11-15T14:34:29.791525+0000","last_peered":"2021-11-15T14:34:29.791525+0000","last_clean":"2021-11-15T14:34:29.791525+0000","last_became_active":"2021-11-15T14:34:24.542969+0000","last_became_peered":"2021-11-15T14:34:24.542969+0000","last_unstale":"2021-11-15T14:34:29.791525+0000","last_undegraded":"2021-11-15T14:34:29.791525+0000","last_fullsized":"2021-11-15T14:34:29.791525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.795419+0000","last_change":"2021-11-15T14:34:26.574551+0000","last_active":"2021-11-15T14:34:29.795419+0000","last_peered":"2021-11-15T14:34:29.795419+0000","last_clean":"2021-11-15T14:34:29.795419+0000","last_became_active":"2021-11-15T14:34:26.574341+0000","last_became_peered":"2021-11-15T14:34:26.574341+0000","last_unstale":"2021-11-15T14:34:29.795419+0000","last_undegraded":"2021-11-15T14:34:29.795419+0000","last_fullsized":"2021-11-15T14:34:29.795419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796083+0000","last_change":"2021-11-15T14:34:29.673022+0000","last_active":"2021-11-15T14:34:29.796083+0000","last_peered":"2021-11-15T14:34:29.796083+0000","last_clean":"2021-11-15T14:34:29.796083+0000","last_became_active":"2021-11-15T14:34:29.672633+0000","last_became_peered":"2021-11-15T14:34:29.672633+0000","last_unstale":"2021-11-15T14:34:29.796083+0000","last_undegraded":"2021-11-15T14:34:29.796083+0000","last_fullsized":"2021-11-15T14:34:29.796083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796273+0000","last_change":"2021-11-15T14:34:26.574205+0000","last_active":"2021-11-15T14:34:29.796273+0000","last_peered":"2021-11-15T14:34:29.796273+0000","last_clean":"2021-11-15T14:34:29.796273+0000","last_became_active":"2021-11-15T14:34:26.574038+0000","last_became_peered":"2021-11-15T14:34:26.574038+0000","last_unstale":"2021-11-15T14:34:29.796273+0000","last_undegraded":"2021-11-15T14:34:29.796273+0000","last_fullsized":"2021-11-15T14:34:29.796273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.798005+0000","last_change":"2021-11-15T14:34:24.544839+0000","last_active":"2021-11-15T14:34:29.798005+0000","last_peered":"2021-11-15T14:34:29.798005+0000","last_clean":"2021-11-15T14:34:29.798005+0000","last_became_active":"2021-11-15T14:34:24.544587+0000","last_became_peered":"2021-11-15T14:34:24.544587+0000","last_unstale":"2021-11-15T14:34:29.798005+0000","last_undegraded":"2021-11-15T14:34:29.798005+0000","last_fullsized":"2021-11-15T14:34:29.798005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796201+0000","last_change":"2021-11-15T14:34:29.672960+0000","last_active":"2021-11-15T14:34:29.796201+0000","last_peered":"2021-11-15T14:34:29.796201+0000","last_clean":"2021-11-15T14:34:29.796201+0000","last_became_active":"2021-11-15T14:34:29.672578+0000","last_became_peered":"2021-11-15T14:34:29.672578+0000","last_unstale":"2021-11-15T14:34:29.796201+0000","last_undegraded":"2021-11-15T14:34:29.796201+0000","last_fullsized":"2021-11-15T14:34:29.796201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.801280+0000","last_change":"2021-11-15T14:34:26.575446+0000","last_active":"2021-11-15T14:34:29.801280+0000","last_peered":"2021-11-15T14:34:29.801280+0000","last_clean":"2021-11-15T14:34:29.801280+0000","last_became_active":"2021-11-15T14:34:26.575218+0000","last_became_peered":"2021-11-15T14:34:26.575218+0000","last_unstale":"2021-11-15T14:34:29.801280+0000","last_undegraded":"2021-11-15T14:34:29.801280+0000","last_fullsized":"2021-11-15T14:34:29.801280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791556+0000","last_change":"2021-11-15T14:34:24.543128+0000","last_active":"2021-11-15T14:34:29.791556+0000","last_peered":"2021-11-15T14:34:29.791556+0000","last_clean":"2021-11-15T14:34:29.791556+0000","last_became_active":"2021-11-15T14:34:24.542965+0000","last_became_peered":"2021-11-15T14:34:24.542965+0000","last_unstale":"2021-11-15T14:34:29.791556+0000","last_undegraded":"2021-11-15T14:34:29.791556+0000","last_fullsized":"2021-11-15T14:34:29.791556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.579661+0000","last_change":"2021-11-15T14:34:30.578703+0000","last_active":"2021-11-15T14:34:30.579661+0000","last_peered":"2021-11-15T14:34:30.579661+0000","last_clean":"2021-11-15T14:34:30.579661+0000","last_became_active":"2021-11-15T14:34:30.576693+0000","last_became_peered":"2021-11-15T14:34:30.576693+0000","last_unstale":"2021-11-15T14:34:30.579661+0000","last_undegraded":"2021-11-15T14:34:30.579661+0000","last_fullsized":"2021-11-15T14:34:30.579661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.799432+0000","last_change":"2021-11-15T14:34:26.575090+0000","last_active":"2021-11-15T14:34:29.799432+0000","last_peered":"2021-11-15T14:34:29.799432+0000","last_clean":"2021-11-15T14:34:29.799432+0000","last_became_active":"2021-11-15T14:34:26.574905+0000","last_became_peered":"2021-11-15T14:34:26.574905+0000","last_unstale":"2021-11-15T14:34:29.799432+0000","last_undegraded":"2021-11-15T14:34:29.799432+0000","last_fullsized":"2021-11-15T14:34:29.799432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796239+0000","last_change":"2021-11-15T14:34:24.640770+0000","last_active":"2021-11-15T14:34:29.796239+0000","last_peered":"2021-11-15T14:34:29.796239+0000","last_clean":"2021-11-15T14:34:29.796239+0000","last_became_active":"2021-11-15T14:34:24.640524+0000","last_became_peered":"2021-11-15T14:34:24.640524+0000","last_unstale":"2021-11-15T14:34:29.796239+0000","last_undegraded":"2021-11-15T14:34:29.796239+0000","last_fullsized":"2021-11-15T14:34:29.796239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.576421+0000","last_change":"2021-11-15T14:34:30.574935+0000","last_active":"2021-11-15T14:34:30.576421+0000","last_peered":"2021-11-15T14:34:30.576421+0000","last_clean":"2021-11-15T14:34:30.576421+0000","last_became_active":"2021-11-15T14:34:30.572756+0000","last_became_peered":"2021-11-15T14:34:30.572756+0000","last_unstale":"2021-11-15T14:34:30.576421+0000","last_undegraded":"2021-11-15T14:34:30.576421+0000","last_fullsized":"2021-11-15T14:34:30.576421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.798244+0000","last_change":"2021-11-15T14:34:26.599093+0000","last_active":"2021-11-15T14:34:29.798244+0000","last_peered":"2021-11-15T14:34:29.798244+0000","last_clean":"2021-11-15T14:34:29.798244+0000","last_became_active":"2021-11-15T14:34:26.598747+0000","last_became_peered":"2021-11-15T14:34:26.598747+0000","last_unstale":"2021-11-15T14:34:29.798244+0000","last_undegraded":"2021-11-15T14:34:29.798244+0000","last_fullsized":"2021-11-15T14:34:29.798244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791556+0000","last_change":"2021-11-15T14:34:24.638667+0000","last_active":"2021-11-15T14:34:29.791556+0000","last_peered":"2021-11-15T14:34:29.791556+0000","last_clean":"2021-11-15T14:34:29.791556+0000","last_became_active":"2021-11-15T14:34:24.638483+0000","last_became_peered":"2021-11-15T14:34:24.638483+0000","last_unstale":"2021-11-15T14:34:29.791556+0000","last_undegraded":"2021-11-15T14:34:29.791556+0000","last_fullsized":"2021-11-15T14:34:29.791556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048868,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322972,"statfs":{"total":96636764160,"available":95562723328,"internally_reserved":1073741824,"allocated":290816,"data_stored":106781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":105086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":97556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]}]}]}} 2021-11-15T14:34:35.671 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T14:34:35.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.717+0000 7f047fb1c700 1 Processor -- start 2021-11-15T14:34:35.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.717+0000 7f047fb1c700 1 -- start start 2021-11-15T14:34:35.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f04780b1300 0x7f04780b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0478140390 con 0x7f04780aee40 2021-11-15T14:34:35.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0478140630 con 0x7f0478140d70 2021-11-15T14:34:35.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04781408d0 con 0x7f04780b1300 2021-11-15T14:34:35.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0478140d70 0x7f04780ae730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42700/0 (socket says 172.21.2.135:42700) 2021-11-15T14:34:35.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 -- 172.21.2.135:0/1244095891 learned_addr learned my addr 172.21.2.135:0/1244095891 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:35.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964339494 0 0) 0x7f0478140630 con 0x7f0478140d70 2021-11-15T14:34:35.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0460003260 con 0x7f0478140d70 2021-11-15T14:34:35.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/1244095891 >> v2:172.21.2.119:3300/0 conn(0x7f04780b1300 0x7f04780b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624583637 0 0) 0x7f0460003260 con 0x7f0478140d70 2021-11-15T14:34:35.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 >> v2:172.21.2.119:3300/0 conn(0x7f04780b1300 msgr2=0x7f04780b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 --2- 172.21.2.135:0/1244095891 >> v2:172.21.2.119:3300/0 conn(0x7f04780b1300 0x7f04780b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 >> v1:172.21.2.119:6789/0 conn(0x7f04780aee40 legacy=0x7f047814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478140080 con 0x7f0478140d70 2021-11-15T14:34:35.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f046c001660 con 0x7f0478140d70 2021-11-15T14:34:35.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 >> v1:172.21.2.135:6789/0 conn(0x7f0478140d70 legacy=0x7f04780ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460003750 0x7f0460003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0460004500 0x7f0460004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 0x7f046000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04781408d0 con 0x7f0460003750 2021-11-15T14:34:35.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046000bf40 con 0x7f0460005070 2021-11-15T14:34:35.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046000c100 con 0x7f0460004500 2021-11-15T14:34:35.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/1244095891 >> v2:172.21.2.119:3300/0 conn(0x7f04780b1300 0x7f04780b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:35.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 0x7f046000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 -- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0460004500 msgr2=0x7f0460004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0460004500 0x7f0460004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 -- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460003750 msgr2=0x7f0460003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460003750 0x7f0460003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460003750 0x7f0460003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 -- 172.21.2.135:0/1244095891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460003260 con 0x7f0460005070 2021-11-15T14:34:35.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460003750 0x7f0460003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:35.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 -- 172.21.2.135:0/1244095891 reap_dead start 2021-11-15T14:34:35.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047e0b9700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 0x7f046000b750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0470002320 tx=0x7f0470007d80).ready entity=mon.1 client_cookie=42e98076543ccf57 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0470002530 con 0x7f0460005070 2021-11-15T14:34:35.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470006890 con 0x7f0460005070 2021-11-15T14:34:35.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047c8b6700 1 -- 172.21.2.135:0/1244095891 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0470006bf0 con 0x7f0460005070 2021-11-15T14:34:35.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 msgr2=0x7f046000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 0x7f046000b750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0470002320 tx=0x7f0470007d80).stop 2021-11-15T14:34:35.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- 172.21.2.135:0/1244095891 shutdown_connections 2021-11-15T14:34:35.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- 172.21.2.135:0/1244095891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0460005070 0x7f046000b750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- 172.21.2.135:0/1244095891 >> 172.21.2.135:0/1244095891 conn(0x7f047805f730 msgr2=0x7f047805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- 172.21.2.135:0/1244095891 shutdown_connections 2021-11-15T14:34:35.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- 172.21.2.135:0/1244095891 wait complete. 2021-11-15T14:34:35.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 Processor -- start 2021-11-15T14:34:35.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- start start 2021-11-15T14:34:35.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 0x7f0478156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0478142050 0x7f047812c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780ac7a0 con 0x7f0460005070 2021-11-15T14:34:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780ac9d0 con 0x7f04780b4580 2021-11-15T14:34:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047fb1c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780abf00 con 0x7f0478142050 2021-11-15T14:34:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55122/0 (socket says 172.21.2.135:55122) 2021-11-15T14:34:35.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 -- 172.21.2.135:0/2157187520 learned_addr learned my addr 172.21.2.135:0/2157187520 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 -- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0478142050 msgr2=0x7f047812c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0478142050 0x7f047812c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 -- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 msgr2=0x7f0478156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 0x7f0478156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 0x7f0478156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 -- 172.21.2.135:0/2157187520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780ab890 con 0x7f04780b4580 2021-11-15T14:34:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d8b8700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 0x7f0478156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f047d0b7700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0478142450 tx=0x7f0478140520).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c007170 con 0x7f04780b4580 2021-11-15T14:34:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.721+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c0072d0 con 0x7f04780b4580 2021-11-15T14:34:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04780ac330 con 0x7f04780b4580 2021-11-15T14:34:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c004920 con 0x7f04780b4580 2021-11-15T14:34:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780accd0 con 0x7f04780b4580 2021-11-15T14:34:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780aa410 con 0x7f04780b4580 2021-11-15T14:34:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f046c01b070 con 0x7f04780b4580 2021-11-15T14:34:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f046affd700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 0x7f04580559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f046c06b3d0 con 0x7f04780b4580 2021-11-15T14:34:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f047d8b8700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 0x7f04580559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f047d8b8700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 0x7f04580559e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0474009000 tx=0x7f0474008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.725+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f046c0423d0 con 0x7f04780b4580 2021-11-15T14:34:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.809+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0478144310 con 0x7f0458053520 2021-11-15T14:34:35.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f046affd700 1 -- 172.21.2.135:0/2157187520 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82376 (secure 0 0 0) 0x7f0474012450 con 0x7f0458053520 2021-11-15T14:34:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:35.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 msgr2=0x7f04580559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 0x7f04580559e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0474009000 tx=0x7f0474008040).stop 2021-11-15T14:34:35.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 msgr2=0x7f0478141b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0478142450 tx=0x7f0478140520).stop 2021-11-15T14:34:35.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 shutdown_connections 2021-11-15T14:34:35.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0458053520 0x7f04580559e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0478142050 0x7f047812c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04780b4580 0x7f0478141b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 --2- 172.21.2.135:0/2157187520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0460005070 0x7f0478156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 >> 172.21.2.135:0/2157187520 conn(0x7f047805f730 msgr2=0x7f047812f750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 shutdown_connections 2021-11-15T14:34:35.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.821+0000 7f047fb1c700 1 -- 172.21.2.135:0/2157187520 wait complete. 2021-11-15T14:34:35.831 INFO:teuthology.orchestra.run.gibba035.stderr:dumped all 2021-11-15T14:34:35.832 INFO:teuthology.orchestra.run.gibba035.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-11-15T14:34:35.058940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390764,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583956,"statfs":{"total":773094113280,"available":764501970944,"internally_reserved":8589934592,"allocated":2142208,"data_stored":832526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002898"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.576517+0000","last_change":"2021-11-15T14:34:30.574966+0000","last_active":"2021-11-15T14:34:30.576517+0000","last_peered":"2021-11-15T14:34:30.576517+0000","last_clean":"2021-11-15T14:34:30.576517+0000","last_became_active":"2021-11-15T14:34:30.573050+0000","last_became_peered":"2021-11-15T14:34:30.573050+0000","last_unstale":"2021-11-15T14:34:30.576517+0000","last_undegraded":"2021-11-15T14:34:30.576517+0000","last_fullsized":"2021-11-15T14:34:30.576517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.568971+0000","last_change":"2021-11-15T14:34:20.467684+0000","last_active":"2021-11-15T14:34:30.568971+0000","last_peered":"2021-11-15T14:34:30.568971+0000","last_clean":"2021-11-15T14:34:30.568971+0000","last_became_active":"2021-11-15T14:34:20.466743+0000","last_became_peered":"2021-11-15T14:34:20.466743+0000","last_unstale":"2021-11-15T14:34:30.568971+0000","last_undegraded":"2021-11-15T14:34:30.568971+0000","last_fullsized":"2021-11-15T14:34:30.568971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_clean_scrub_stamp":"2021-11-15T14:34:16.050418+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791526+0000","last_change":"2021-11-15T14:34:24.844233+0000","last_active":"2021-11-15T14:34:29.791526+0000","last_peered":"2021-11-15T14:34:29.791526+0000","last_clean":"2021-11-15T14:34:29.791526+0000","last_became_active":"2021-11-15T14:34:24.844069+0000","last_became_peered":"2021-11-15T14:34:24.844069+0000","last_unstale":"2021-11-15T14:34:29.791526+0000","last_undegraded":"2021-11-15T14:34:29.791526+0000","last_fullsized":"2021-11-15T14:34:29.791526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.797480+0000","last_change":"2021-11-15T14:34:26.576619+0000","last_active":"2021-11-15T14:34:29.797480+0000","last_peered":"2021-11-15T14:34:29.797480+0000","last_clean":"2021-11-15T14:34:29.797480+0000","last_became_active":"2021-11-15T14:34:26.576411+0000","last_became_peered":"2021-11-15T14:34:26.576411+0000","last_unstale":"2021-11-15T14:34:29.797480+0000","last_undegraded":"2021-11-15T14:34:29.797480+0000","last_fullsized":"2021-11-15T14:34:29.797480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.579447+0000","last_change":"2021-11-15T14:34:30.577222+0000","last_active":"2021-11-15T14:34:30.579447+0000","last_peered":"2021-11-15T14:34:30.579447+0000","last_clean":"2021-11-15T14:34:30.579447+0000","last_became_active":"2021-11-15T14:34:30.575078+0000","last_became_peered":"2021-11-15T14:34:30.575078+0000","last_unstale":"2021-11-15T14:34:30.579447+0000","last_undegraded":"2021-11-15T14:34:30.579447+0000","last_fullsized":"2021-11-15T14:34:30.579447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791468+0000","last_change":"2021-11-15T14:34:24.543141+0000","last_active":"2021-11-15T14:34:29.791468+0000","last_peered":"2021-11-15T14:34:29.791468+0000","last_clean":"2021-11-15T14:34:29.791468+0000","last_became_active":"2021-11-15T14:34:24.542973+0000","last_became_peered":"2021-11-15T14:34:24.542973+0000","last_unstale":"2021-11-15T14:34:29.791468+0000","last_undegraded":"2021-11-15T14:34:29.791468+0000","last_fullsized":"2021-11-15T14:34:29.791468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796066+0000","last_change":"2021-11-15T14:34:26.576669+0000","last_active":"2021-11-15T14:34:29.796066+0000","last_peered":"2021-11-15T14:34:29.796066+0000","last_clean":"2021-11-15T14:34:29.796066+0000","last_became_active":"2021-11-15T14:34:26.576404+0000","last_became_peered":"2021-11-15T14:34:26.576404+0000","last_unstale":"2021-11-15T14:34:29.796066+0000","last_undegraded":"2021-11-15T14:34:29.796066+0000","last_fullsized":"2021-11-15T14:34:29.796066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.580143+0000","last_change":"2021-11-15T14:34:30.579200+0000","last_active":"2021-11-15T14:34:30.580143+0000","last_peered":"2021-11-15T14:34:30.580143+0000","last_clean":"2021-11-15T14:34:30.580143+0000","last_became_active":"2021-11-15T14:34:30.576895+0000","last_became_peered":"2021-11-15T14:34:30.576895+0000","last_unstale":"2021-11-15T14:34:30.580143+0000","last_undegraded":"2021-11-15T14:34:30.580143+0000","last_fullsized":"2021-11-15T14:34:30.580143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.797727+0000","last_change":"2021-11-15T14:34:24.544907+0000","last_active":"2021-11-15T14:34:29.797727+0000","last_peered":"2021-11-15T14:34:29.797727+0000","last_clean":"2021-11-15T14:34:29.797727+0000","last_became_active":"2021-11-15T14:34:24.544673+0000","last_became_peered":"2021-11-15T14:34:24.544673+0000","last_unstale":"2021-11-15T14:34:29.797727+0000","last_undegraded":"2021-11-15T14:34:29.797727+0000","last_fullsized":"2021-11-15T14:34:29.797727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.801201+0000","last_change":"2021-11-15T14:34:26.599038+0000","last_active":"2021-11-15T14:34:29.801201+0000","last_peered":"2021-11-15T14:34:29.801201+0000","last_clean":"2021-11-15T14:34:29.801201+0000","last_became_active":"2021-11-15T14:34:26.598718+0000","last_became_peered":"2021-11-15T14:34:26.598718+0000","last_unstale":"2021-11-15T14:34:29.801201+0000","last_undegraded":"2021-11-15T14:34:29.801201+0000","last_fullsized":"2021-11-15T14:34:29.801201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796120+0000","last_change":"2021-11-15T14:34:29.673036+0000","last_active":"2021-11-15T14:34:29.796120+0000","last_peered":"2021-11-15T14:34:29.796120+0000","last_clean":"2021-11-15T14:34:29.796120+0000","last_became_active":"2021-11-15T14:34:29.672661+0000","last_became_peered":"2021-11-15T14:34:29.672661+0000","last_unstale":"2021-11-15T14:34:29.796120+0000","last_undegraded":"2021-11-15T14:34:29.796120+0000","last_fullsized":"2021-11-15T14:34:29.796120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791525+0000","last_change":"2021-11-15T14:34:24.543140+0000","last_active":"2021-11-15T14:34:29.791525+0000","last_peered":"2021-11-15T14:34:29.791525+0000","last_clean":"2021-11-15T14:34:29.791525+0000","last_became_active":"2021-11-15T14:34:24.542969+0000","last_became_peered":"2021-11-15T14:34:24.542969+0000","last_unstale":"2021-11-15T14:34:29.791525+0000","last_undegraded":"2021-11-15T14:34:29.791525+0000","last_fullsized":"2021-11-15T14:34:29.791525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.795419+0000","last_change":"2021-11-15T14:34:26.574551+0000","last_active":"2021-11-15T14:34:29.795419+0000","last_peered":"2021-11-15T14:34:29.795419+0000","last_clean":"2021-11-15T14:34:29.795419+0000","last_became_active":"2021-11-15T14:34:26.574341+0000","last_became_peered":"2021-11-15T14:34:26.574341+0000","last_unstale":"2021-11-15T14:34:29.795419+0000","last_undegraded":"2021-11-15T14:34:29.795419+0000","last_fullsized":"2021-11-15T14:34:29.795419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796083+0000","last_change":"2021-11-15T14:34:29.673022+0000","last_active":"2021-11-15T14:34:29.796083+0000","last_peered":"2021-11-15T14:34:29.796083+0000","last_clean":"2021-11-15T14:34:29.796083+0000","last_became_active":"2021-11-15T14:34:29.672633+0000","last_became_peered":"2021-11-15T14:34:29.672633+0000","last_unstale":"2021-11-15T14:34:29.796083+0000","last_undegraded":"2021-11-15T14:34:29.796083+0000","last_fullsized":"2021-11-15T14:34:29.796083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796273+0000","last_change":"2021-11-15T14:34:26.574205+0000","last_active":"2021-11-15T14:34:29.796273+0000","last_peered":"2021-11-15T14:34:29.796273+0000","last_clean":"2021-11-15T14:34:29.796273+0000","last_became_active":"2021-11-15T14:34:26.574038+0000","last_became_peered":"2021-11-15T14:34:26.574038+0000","last_unstale":"2021-11-15T14:34:29.796273+0000","last_undegraded":"2021-11-15T14:34:29.796273+0000","last_fullsized":"2021-11-15T14:34:29.796273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.798005+0000","last_change":"2021-11-15T14:34:24.544839+0000","last_active":"2021-11-15T14:34:29.798005+0000","last_peered":"2021-11-15T14:34:29.798005+0000","last_clean":"2021-11-15T14:34:29.798005+0000","last_became_active":"2021-11-15T14:34:24.544587+0000","last_became_peered":"2021-11-15T14:34:24.544587+0000","last_unstale":"2021-11-15T14:34:29.798005+0000","last_undegraded":"2021-11-15T14:34:29.798005+0000","last_fullsized":"2021-11-15T14:34:29.798005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796201+0000","last_change":"2021-11-15T14:34:29.672960+0000","last_active":"2021-11-15T14:34:29.796201+0000","last_peered":"2021-11-15T14:34:29.796201+0000","last_clean":"2021-11-15T14:34:29.796201+0000","last_became_active":"2021-11-15T14:34:29.672578+0000","last_became_peered":"2021-11-15T14:34:29.672578+0000","last_unstale":"2021-11-15T14:34:29.796201+0000","last_undegraded":"2021-11-15T14:34:29.796201+0000","last_fullsized":"2021-11-15T14:34:29.796201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.801280+0000","last_change":"2021-11-15T14:34:26.575446+0000","last_active":"2021-11-15T14:34:29.801280+0000","last_peered":"2021-11-15T14:34:29.801280+0000","last_clean":"2021-11-15T14:34:29.801280+0000","last_became_active":"2021-11-15T14:34:26.575218+0000","last_became_peered":"2021-11-15T14:34:26.575218+0000","last_unstale":"2021-11-15T14:34:29.801280+0000","last_undegraded":"2021-11-15T14:34:29.801280+0000","last_fullsized":"2021-11-15T14:34:29.801280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791556+0000","last_change":"2021-11-15T14:34:24.543128+0000","last_active":"2021-11-15T14:34:29.791556+0000","last_peered":"2021-11-15T14:34:29.791556+0000","last_clean":"2021-11-15T14:34:29.791556+0000","last_became_active":"2021-11-15T14:34:24.542965+0000","last_became_peered":"2021-11-15T14:34:24.542965+0000","last_unstale":"2021-11-15T14:34:29.791556+0000","last_undegraded":"2021-11-15T14:34:29.791556+0000","last_fullsized":"2021-11-15T14:34:29.791556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.579661+0000","last_change":"2021-11-15T14:34:30.578703+0000","last_active":"2021-11-15T14:34:30.579661+0000","last_peered":"2021-11-15T14:34:30.579661+0000","last_clean":"2021-11-15T14:34:30.579661+0000","last_became_active":"2021-11-15T14:34:30.576693+0000","last_became_peered":"2021-11-15T14:34:30.576693+0000","last_unstale":"2021-11-15T14:34:30.579661+0000","last_undegraded":"2021-11-15T14:34:30.579661+0000","last_fullsized":"2021-11-15T14:34:30.579661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.799432+0000","last_change":"2021-11-15T14:34:26.575090+0000","last_active":"2021-11-15T14:34:29.799432+0000","last_peered":"2021-11-15T14:34:29.799432+0000","last_clean":"2021-11-15T14:34:29.799432+0000","last_became_active":"2021-11-15T14:34:26.574905+0000","last_became_peered":"2021-11-15T14:34:26.574905+0000","last_unstale":"2021-11-15T14:34:29.799432+0000","last_undegraded":"2021-11-15T14:34:29.799432+0000","last_fullsized":"2021-11-15T14:34:29.799432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.796239+0000","last_change":"2021-11-15T14:34:24.640770+0000","last_active":"2021-11-15T14:34:29.796239+0000","last_peered":"2021-11-15T14:34:29.796239+0000","last_clean":"2021-11-15T14:34:29.796239+0000","last_became_active":"2021-11-15T14:34:24.640524+0000","last_became_peered":"2021-11-15T14:34:24.640524+0000","last_unstale":"2021-11-15T14:34:29.796239+0000","last_undegraded":"2021-11-15T14:34:29.796239+0000","last_fullsized":"2021-11-15T14:34:29.796239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:30.576421+0000","last_change":"2021-11-15T14:34:30.574935+0000","last_active":"2021-11-15T14:34:30.576421+0000","last_peered":"2021-11-15T14:34:30.576421+0000","last_clean":"2021-11-15T14:34:30.576421+0000","last_became_active":"2021-11-15T14:34:30.572756+0000","last_became_peered":"2021-11-15T14:34:30.572756+0000","last_unstale":"2021-11-15T14:34:30.576421+0000","last_undegraded":"2021-11-15T14:34:30.576421+0000","last_fullsized":"2021-11-15T14:34:30.576421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:28.576942+0000","last_clean_scrub_stamp":"2021-11-15T14:34:28.576942+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.798244+0000","last_change":"2021-11-15T14:34:26.599093+0000","last_active":"2021-11-15T14:34:29.798244+0000","last_peered":"2021-11-15T14:34:29.798244+0000","last_clean":"2021-11-15T14:34:29.798244+0000","last_became_active":"2021-11-15T14:34:26.598747+0000","last_became_peered":"2021-11-15T14:34:26.598747+0000","last_unstale":"2021-11-15T14:34:29.798244+0000","last_undegraded":"2021-11-15T14:34:29.798244+0000","last_fullsized":"2021-11-15T14:34:29.798244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:25.545957+0000","last_clean_scrub_stamp":"2021-11-15T14:34:25.545957+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-15T14:34:29.791556+0000","last_change":"2021-11-15T14:34:24.638667+0000","last_active":"2021-11-15T14:34:29.791556+0000","last_peered":"2021-11-15T14:34:29.791556+0000","last_clean":"2021-11-15T14:34:29.791556+0000","last_became_active":"2021-11-15T14:34:24.638483+0000","last_became_peered":"2021-11-15T14:34:24.638483+0000","last_unstale":"2021-11-15T14:34:29.791556+0000","last_undegraded":"2021-11-15T14:34:29.791556+0000","last_fullsized":"2021-11-15T14:34:29.791556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048868,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322972,"statfs":{"total":96636764160,"available":95562723328,"internally_reserved":1073741824,"allocated":290816,"data_stored":106781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":105086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":104705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":97556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]}]}]}} 2021-11-15T14:34:35.835 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-11-15T14:34:35.835 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-11-15T14:34:35.835 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-11-15T14:34:35.836 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-11-15T14:34:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.881+0000 7fcaf168e700 1 Processor -- start 2021-11-15T14:34:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.881+0000 7fcaf168e700 1 -- start start 2021-11-15T14:34:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0b0520 0x7fcaec0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcaec0aa1a0 0x7fcaec0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec0b2b70 con 0x7fcaec0b0900 2021-11-15T14:34:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0b27f0 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0b2da0 con 0x7fcaec0b0520 2021-11-15T14:34:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaeb7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcaec0b0900 0x7fcaec143790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42718/0 (socket says 172.21.2.135:42718) 2021-11-15T14:34:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaeb7fe700 1 -- 172.21.2.135:0/936495368 learned_addr learned my addr 172.21.2.135:0/936495368 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/936495368 >> v2:172.21.2.135:3300/0 conn(0x7fcaec0aa1a0 0x7fcaec0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/936495368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0b0520 msgr2=0x7fcaec0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/936495368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0b0520 0x7fcaec0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/936495368 >> v1:172.21.2.135:6789/0 conn(0x7fcaec0b0900 legacy=0x7fcaec143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/936495368 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0a9bf0 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae9ffb700 1 -- 172.21.2.135:0/936495368 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792776216 0 0) 0x7fcaec0b2b70 con 0x7fcaec0b0900 2021-11-15T14:34:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/936495368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0aa1a0 0x7fcaec0ae2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcad4002f70 tx=0x7fcad4006df0).ready entity=mon.1 client_cookie=c11a1350296edbb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae9ffb700 1 -- 172.21.2.135:0/936495368 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad400d570 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae9ffb700 1 -- 172.21.2.135:0/936495368 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4000e90 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae9ffb700 1 -- 172.21.2.135:0/936495368 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad400d8c0 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/936495368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0aa1a0 msgr2=0x7fcaec0ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- 172.21.2.135:0/936495368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0aa1a0 0x7fcaec0ae2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcad4002f70 tx=0x7fcad4006df0).stop 2021-11-15T14:34:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/936495368 shutdown_connections 2021-11-15T14:34:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- 172.21.2.135:0/936495368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0aa1a0 0x7fcaec0ae2a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- 172.21.2.135:0/936495368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0b0520 0x7fcaec0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/936495368 >> 172.21.2.135:0/936495368 conn(0x7fcaec060840 msgr2=0x7fcaec060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/936495368 shutdown_connections 2021-11-15T14:34:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/936495368 wait complete. 2021-11-15T14:34:35.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 Processor -- start 2021-11-15T14:34:35.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- start start 2021-11-15T14:34:35.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0aa1a0 0x7fcaec1383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaec0b0900 0x7fcaec1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec137a60 con 0x7fcaec0b0900 2021-11-15T14:34:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec1388c0 con 0x7fcaec0b0520 2021-11-15T14:34:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec139180 con 0x7fcaec0aa1a0 2021-11-15T14:34:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55138/0 (socket says 172.21.2.135:55138) 2021-11-15T14:34:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/1107198179 learned_addr learned my addr 172.21.2.135:0/1107198179 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaeaffd700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0aa1a0 0x7fcaec1383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaeb7fe700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaec0b0900 0x7fcaec1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0aa1a0 msgr2=0x7fcaec1383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0aa1a0 0x7fcaec1383d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaec0b0900 msgr2=0x7fcaec1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaec0b0900 0x7fcaec1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 -- 172.21.2.135:0/1107198179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad400b180 con 0x7fcaec0b0520 2021-11-15T14:34:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaea7fc700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fcad4002f70 tx=0x7fcad4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad400de20 con 0x7fcaec0b0520 2021-11-15T14:34:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4011ce0 con 0x7fcaec0b0520 2021-11-15T14:34:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec137c90 con 0x7fcaec0b0520 2021-11-15T14:34:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad401e650 con 0x7fcaec0b0520 2021-11-15T14:34:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.885+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec137100 con 0x7fcaec0b0520 2021-11-15T14:34:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec0573d0 con 0x7fcaec0b0520 2021-11-15T14:34:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcad4025030 con 0x7fcaec0b0520 2021-11-15T14:34:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcae3fff700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 0x7fcad0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fcad406cd10 con 0x7fcaec0b0520 2021-11-15T14:34:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcaeaffd700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 0x7fcad0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcaeaffd700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 0x7fcad0055ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcadc00a000 tx=0x7fcadc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:35.889+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcad4043d10 con 0x7fcaec0b0520 2021-11-15T14:34:36.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcaec0446d0 con 0x7fcaec0b0520 2021-11-15T14:34:36.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcae3fff700 1 -- 172.21.2.135:0/1107198179 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fcad4023080 con 0x7fcaec0b0520 2021-11-15T14:34:36.008 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:36.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 msgr2=0x7fcad0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 0x7fcad0055ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcadc00a000 tx=0x7fcadc008040).stop 2021-11-15T14:34:36.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 msgr2=0x7fcaec136c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fcad4002f70 tx=0x7fcad4015000).stop 2021-11-15T14:34:36.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 shutdown_connections 2021-11-15T14:34:36.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcad0053610 0x7fcad0055ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaec0b0900 0x7fcaec1525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaec0b0520 0x7fcaec136c10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 --2- 172.21.2.135:0/1107198179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaec0aa1a0 0x7fcaec1383d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 >> 172.21.2.135:0/1107198179 conn(0x7fcaec060840 msgr2=0x7fcaec0ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 shutdown_connections 2021-11-15T14:34:36.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.005+0000 7fcaf168e700 1 -- 172.21.2.135:0/1107198179 wait complete. 2021-11-15T14:34:36.014 INFO:teuthology.orchestra.run.gibba035.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-15T14:34:36.014 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-11-15T14:34:36.015 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:36.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 Processor -- start 2021-11-15T14:34:36.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- start start 2021-11-15T14:34:36.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb728148420 0x7fb7280b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb7280a7140 0x7fb7281447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280b03d0 con 0x7fb7280b1e30 2021-11-15T14:34:36.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280a9140 con 0x7fb7280a7140 2021-11-15T14:34:36.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280b0670 con 0x7fb728148420 2021-11-15T14:34:36.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72659c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb7280b1e30 0x7fb7280b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42732/0 (socket says 172.21.2.135:42732) 2021-11-15T14:34:36.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72659c700 1 -- 172.21.2.135:0/1441689918 learned_addr learned my addr 172.21.2.135:0/1441689918 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:36.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 --2- 172.21.2.135:0/1441689918 >> v2:172.21.2.135:3300/0 conn(0x7fb7280a7140 0x7fb7281447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 -- 172.21.2.135:0/1441689918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb728148420 msgr2=0x7fb7280b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:36.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 --2- 172.21.2.135:0/1441689918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb728148420 0x7fb7280b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 -- 172.21.2.135:0/1441689918 >> v1:172.21.2.135:6789/0 conn(0x7fb7280b1e30 legacy=0x7fb7280b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 -- 172.21.2.135:0/1441689918 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280b0910 con 0x7fb7280a7140 2021-11-15T14:34:36.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb726d9d700 1 --2- 172.21.2.135:0/1441689918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280a7140 0x7fb7281447a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb7200032f0 tx=0x7fb7200091d0).ready entity=mon.1 client_cookie=671b2e50b692d75 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72559a700 1 -- 172.21.2.135:0/1441689918 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb720009ea0 con 0x7fb7280a7140 2021-11-15T14:34:36.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72559a700 1 -- 172.21.2.135:0/1441689918 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000b8a0 con 0x7fb7280a7140 2021-11-15T14:34:36.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72559a700 1 -- 172.21.2.135:0/1441689918 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb72000ba50 con 0x7fb7280a7140 2021-11-15T14:34:36.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/1441689918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280a7140 msgr2=0x7fb7281447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- 172.21.2.135:0/1441689918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280a7140 0x7fb7281447a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb7200032f0 tx=0x7fb7200091d0).stop 2021-11-15T14:34:36.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/1441689918 shutdown_connections 2021-11-15T14:34:36.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- 172.21.2.135:0/1441689918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280a7140 0x7fb7281447a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- 172.21.2.135:0/1441689918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb728148420 0x7fb7280b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/1441689918 >> 172.21.2.135:0/1441689918 conn(0x7fb72805f730 msgr2=0x7fb72805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/1441689918 shutdown_connections 2021-11-15T14:34:36.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/1441689918 wait complete. 2021-11-15T14:34:36.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 Processor -- start 2021-11-15T14:34:36.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- start start 2021-11-15T14:34:36.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7280a7140 0x7fb7280aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb728148420 0x7fb7280ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280ac080 con 0x7fb728148420 2021-11-15T14:34:36.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815aa80 con 0x7fb7280b1e30 2021-11-15T14:34:36.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815ad20 con 0x7fb7280a7140 2021-11-15T14:34:36.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55150/0 (socket says 172.21.2.135:55150) 2021-11-15T14:34:36.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 -- 172.21.2.135:0/3712795370 learned_addr learned my addr 172.21.2.135:0/3712795370 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 -- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7280a7140 msgr2=0x7fb7280aa410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:36.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7280a7140 0x7fb7280aa410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 -- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb728148420 msgr2=0x7fb7280ab600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:36.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb728148420 0x7fb7280ab600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 -- 172.21.2.135:0/3712795370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009470 con 0x7fb7280b1e30 2021-11-15T14:34:36.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb725d9b700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb718002ef0 tx=0x7fb718006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718009e00 con 0x7fb7280b1e30 2021-11-15T14:34:36.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718002320 con 0x7fb7280b1e30 2021-11-15T14:34:36.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718002680 con 0x7fb7280b1e30 2021-11-15T14:34:36.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72815a7a0 con 0x7fb7280b1e30 2021-11-15T14:34:36.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.065+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7280a9900 con 0x7fb7280b1e30 2021-11-15T14:34:36.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7280573d0 con 0x7fb7280b1e30 2021-11-15T14:34:36.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb71800f030 con 0x7fb7280b1e30 2021-11-15T14:34:36.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb71f7fe700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 0x7fb70c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb71806b840 con 0x7fb7280b1e30 2021-11-15T14:34:36.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb72659c700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 0x7fb70c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb72659c700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 0x7fb70c0559b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb728061420 tx=0x7fb710007790).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.069+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7180427c0 con 0x7fb7280b1e30 2021-11-15T14:34:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7280446d0 con 0x7fb7280b1e30 2021-11-15T14:34:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb71f7fe700 1 -- 172.21.2.135:0/3712795370 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fb718045de0 con 0x7fb7280b1e30 2021-11-15T14:34:36.156 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:36.157 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 msgr2=0x7fb70c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 0x7fb70c0559b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb728061420 tx=0x7fb710007790).stop 2021-11-15T14:34:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 msgr2=0x7fb72815a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb718002ef0 tx=0x7fb718006d40).stop 2021-11-15T14:34:36.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 shutdown_connections 2021-11-15T14:34:36.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb70c0534f0 0x7fb70c0559b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb728148420 0x7fb7280ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7280b1e30 0x7fb72815a2b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 --2- 172.21.2.135:0/3712795370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7280a7140 0x7fb7280aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 >> 172.21.2.135:0/3712795370 conn(0x7fb72805f730 msgr2=0x7fb728143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 shutdown_connections 2021-11-15T14:34:36.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.153+0000 7fb72c926700 1 -- 172.21.2.135:0/3712795370 wait complete. 2021-11-15T14:34:36.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:36.164 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:36.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 Processor -- start 2021-11-15T14:34:36.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- start start 2021-11-15T14:34:36.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0a99e0 0x7f194c0b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f194c0ac2e0 0x7f194c0ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c0b1ce0 con 0x7f194c0b0740 2021-11-15T14:34:36.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c0a9dc0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0b29c0 con 0x7f194c0a99e0 2021-11-15T14:34:36.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f194c0ac2e0 0x7f194c0ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f194c0ac2e0 0x7f194c0ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55160/0 (socket says 172.21.2.135:55160) 2021-11-15T14:34:36.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 -- 172.21.2.135:0/3029603025 learned_addr learned my addr 172.21.2.135:0/3029603025 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 -- 172.21.2.135:0/3029603025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0a99e0 msgr2=0x7f194c0b17f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:36.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 --2- 172.21.2.135:0/3029603025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0a99e0 0x7f194c0b17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 -- 172.21.2.135:0/3029603025 >> v1:172.21.2.119:6789/0 conn(0x7f194c0b0740 legacy=0x7f194c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 -- 172.21.2.135:0/3029603025 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0b0140 con 0x7f194c0ac2e0 2021-11-15T14:34:36.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1949d9b700 1 --2- 172.21.2.135:0/3029603025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c0ab020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f194c0b0480 tx=0x7f193c006eb0).ready entity=mon.1 client_cookie=717ef62546aa1401 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f194959a700 1 -- 172.21.2.135:0/3029603025 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c00d570 con 0x7f194c0ac2e0 2021-11-15T14:34:36.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f194959a700 1 -- 172.21.2.135:0/3029603025 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c000e90 con 0x7f194c0ac2e0 2021-11-15T14:34:36.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f194959a700 1 -- 172.21.2.135:0/3029603025 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c00d8c0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- 172.21.2.135:0/3029603025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 msgr2=0x7f194c0ab020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 --2- 172.21.2.135:0/3029603025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c0ab020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f194c0b0480 tx=0x7f193c006eb0).stop 2021-11-15T14:34:36.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- 172.21.2.135:0/3029603025 shutdown_connections 2021-11-15T14:34:36.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 --2- 172.21.2.135:0/3029603025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c0ab020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 --2- 172.21.2.135:0/3029603025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0a99e0 0x7f194c0b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- 172.21.2.135:0/3029603025 >> 172.21.2.135:0/3029603025 conn(0x7f194c05f730 msgr2=0x7f194c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- 172.21.2.135:0/3029603025 shutdown_connections 2021-11-15T14:34:36.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.213+0000 7f1950ced700 1 -- 172.21.2.135:0/3029603025 wait complete. 2021-11-15T14:34:36.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 Processor -- start 2021-11-15T14:34:36.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- start start 2021-11-15T14:34:36.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f194c0a99e0 0x7f194c0629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0b0740 0x7f194c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c064cb0 con 0x7f194c0a99e0 2021-11-15T14:34:36.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c064f50 con 0x7f194c0ac2e0 2021-11-15T14:34:36.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0651f0 con 0x7f194c0b0740 2021-11-15T14:34:36.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55166/0 (socket says 172.21.2.135:55166) 2021-11-15T14:34:36.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 -- 172.21.2.135:0/3256688518 learned_addr learned my addr 172.21.2.135:0/3256688518 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 -- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0b0740 msgr2=0x7f194c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0b0740 0x7f194c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 -- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f194c0a99e0 msgr2=0x7f194c0629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f194c0a99e0 0x7f194c0629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 -- 172.21.2.135:0/3256688518 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c00b1e0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1949d9b700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f194c0b0480 tx=0x7f193c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c002f70 con 0x7f194c0ac2e0 2021-11-15T14:34:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00d910 con 0x7f194c0ac2e0 2021-11-15T14:34:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c065490 con 0x7f194c0ac2e0 2021-11-15T14:34:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c01e460 con 0x7f194c0ac2e0 2021-11-15T14:34:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c144e90 con 0x7f194c0ac2e0 2021-11-15T14:34:36.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c065620 con 0x7f194c0ac2e0 2021-11-15T14:34:36.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f193c025030 con 0x7f194c0ac2e0 2021-11-15T14:34:36.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 0x7f1930055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f193c06cca0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.217+0000 7f194a59c700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 0x7f1930055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.221+0000 7f194a59c700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 0x7f1930055a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1934002fb0 tx=0x7f19340069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.221+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f193c071070 con 0x7f194c0ac2e0 2021-11-15T14:34:36.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f194c0b1ce0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f19437fe700 1 -- 172.21.2.135:0/3256688518 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f194c0b1ce0 con 0x7f194c0ac2e0 2021-11-15T14:34:36.306 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:36.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 msgr2=0x7f1930055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 0x7f1930055a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1934002fb0 tx=0x7f19340069b0).stop 2021-11-15T14:34:36.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 msgr2=0x7f194c13d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.301+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f194c0b0480 tx=0x7f193c015000).stop 2021-11-15T14:34:36.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 shutdown_connections 2021-11-15T14:34:36.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1930053580 0x7f1930055a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f194c0b0740 0x7f194c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f194c0ac2e0 0x7f194c13d710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 --2- 172.21.2.135:0/3256688518 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f194c0a99e0 0x7f194c0629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 >> 172.21.2.135:0/3256688518 conn(0x7f194c05f730 msgr2=0x7f194c141ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 shutdown_connections 2021-11-15T14:34:36.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.305+0000 7f1950ced700 1 -- 172.21.2.135:0/3256688518 wait complete. 2021-11-15T14:34:36.313 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:36.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 Processor -- start 2021-11-15T14:34:36.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 -- start start 2021-11-15T14:34:36.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd104060040 0x7fd104064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040b4eb0 con 0x7fd1040b3950 2021-11-15T14:34:36.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040b2430 con 0x7fd1040b2ca0 2021-11-15T14:34:36.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd10a541700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040b26d0 con 0x7fd104060040 2021-11-15T14:34:36.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd108ade700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd1040b2ca0 0x7fd1040b47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42760/0 (socket says 172.21.2.135:42760) 2021-11-15T14:34:36.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd108ade700 1 -- 172.21.2.135:0/1959666570 learned_addr learned my addr 172.21.2.135:0/1959666570 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:36.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd103fff700 1 --2- 172.21.2.135:0/1959666570 >> v2:172.21.2.135:3300/0 conn(0x7fd104060040 0x7fd104064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd103fff700 1 -- 172.21.2.135:0/1959666570 >> v1:172.21.2.135:6789/0 conn(0x7fd1040b2ca0 legacy=0x7fd1040b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd103fff700 1 -- 172.21.2.135:0/1959666570 >> v1:172.21.2.119:6789/0 conn(0x7fd1040b3950 legacy=0x7fd1040b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd103fff700 1 -- 172.21.2.135:0/1959666570 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040b2970 con 0x7fd104060040 2021-11-15T14:34:36.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd103fff700 1 --2- 172.21.2.135:0/1959666570 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd104064d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fd10413b870 tx=0x7fd0f8006df0).ready entity=mon.1 client_cookie=f19069f0b9f8bc96 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd102ffd700 1 -- 172.21.2.135:0/1959666570 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f800d4a0 con 0x7fd104060040 2021-11-15T14:34:36.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd102ffd700 1 -- 172.21.2.135:0/1959666570 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8000e90 con 0x7fd104060040 2021-11-15T14:34:36.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.361+0000 7fd102ffd700 1 -- 172.21.2.135:0/1959666570 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f800d7f0 con 0x7fd104060040 2021-11-15T14:34:36.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/1959666570 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 msgr2=0x7fd104064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 --2- 172.21.2.135:0/1959666570 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd104064d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fd10413b870 tx=0x7fd0f8006df0).stop 2021-11-15T14:34:36.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/1959666570 shutdown_connections 2021-11-15T14:34:36.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 --2- 172.21.2.135:0/1959666570 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd104064d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/1959666570 >> 172.21.2.135:0/1959666570 conn(0x7fd10405cfe0 msgr2=0x7fd10405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/1959666570 shutdown_connections 2021-11-15T14:34:36.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/1959666570 wait complete. 2021-11-15T14:34:36.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 Processor -- start 2021-11-15T14:34:36.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- start start 2021-11-15T14:34:36.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd1040b2ca0 0x7fd1040ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd1040b3950 0x7fd10413bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10413ec70 con 0x7fd1040b3950 2021-11-15T14:34:36.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040b1870 con 0x7fd104060040 2021-11-15T14:34:36.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040afbe0 con 0x7fd1040b2ca0 2021-11-15T14:34:36.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55180/0 (socket says 172.21.2.135:55180) 2021-11-15T14:34:36.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 -- 172.21.2.135:0/3191276031 learned_addr learned my addr 172.21.2.135:0/3191276031 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 -- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd1040b2ca0 msgr2=0x7fd1040ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd1040b2ca0 0x7fd1040ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 -- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd1040b3950 msgr2=0x7fd10413bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd1040b3950 0x7fd10413bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 -- 172.21.2.135:0/3191276031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f800b180 con 0x7fd104060040 2021-11-15T14:34:36.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd103fff700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd1040ae390 tx=0x7fd0f8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f8013ae0 con 0x7fd104060040 2021-11-15T14:34:36.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8013c40 con 0x7fd104060040 2021-11-15T14:34:36.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f801e400 con 0x7fd104060040 2021-11-15T14:34:36.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1040afe80 con 0x7fd104060040 2021-11-15T14:34:36.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1040adfb0 con 0x7fd104060040 2021-11-15T14:34:36.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1040648f0 con 0x7fd104060040 2021-11-15T14:34:36.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0f8025030 con 0x7fd104060040 2021-11-15T14:34:36.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 0x7fd0e4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.365+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd0f806ca90 con 0x7fd104060040 2021-11-15T14:34:36.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.369+0000 7fd1037fe700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 0x7fd0e4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.369+0000 7fd1037fe700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 0x7fd0e4055b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd0f4000f70 tx=0x7fd0f40077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.369+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0f80439c0 con 0x7fd104060040 2021-11-15T14:34:36.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1040573d0 con 0x7fd104060040 2021-11-15T14:34:36.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd1017fa700 1 -- 172.21.2.135:0/3191276031 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0f8023020 con 0x7fd104060040 2021-11-15T14:34:36.456 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:36.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 msgr2=0x7fd0e4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 0x7fd0e4055b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd0f4000f70 tx=0x7fd0f40077f0).stop 2021-11-15T14:34:36.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 msgr2=0x7fd10413d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd1040ae390 tx=0x7fd0f8014000).stop 2021-11-15T14:34:36.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 shutdown_connections 2021-11-15T14:34:36.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd0e4053660 0x7fd0e4055b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd1040b3950 0x7fd10413bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd1040b2ca0 0x7fd1040ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 --2- 172.21.2.135:0/3191276031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd104060040 0x7fd10413d640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 >> 172.21.2.135:0/3191276031 conn(0x7fd10405cfe0 msgr2=0x7fd10413ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 shutdown_connections 2021-11-15T14:34:36.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.453+0000 7fd10a541700 1 -- 172.21.2.135:0/3191276031 wait complete. 2021-11-15T14:34:36.463 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:36.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 Processor -- start 2021-11-15T14:34:36.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- start start 2021-11-15T14:34:36.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 0x7f9f2c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9f2c060450 0x7f9f2c13cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c061a10 con 0x7f9f2c13d240 2021-11-15T14:34:36.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c061cb0 con 0x7f9f2c060450 2021-11-15T14:34:36.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c060c10 con 0x7f9f2c0a9f40 2021-11-15T14:34:36.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31c28700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9f2c13d240 0x7f9f2c13f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42774/0 (socket says 172.21.2.135:42774) 2021-11-15T14:34:36.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31c28700 1 -- 172.21.2.135:0/3610387255 learned_addr learned my addr 172.21.2.135:0/3610387255 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:36.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003545213 0 0) 0x7f9f2c061a10 con 0x7f9f2c13d240 2021-11-15T14:34:36.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14003260 con 0x7f9f2c13d240 2021-11-15T14:34:36.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629716876 0 0) 0x7f9f14003260 con 0x7f9f2c13d240 2021-11-15T14:34:36.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 msgr2=0x7f9f2c0aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 0x7f9f2c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 >> v2:172.21.2.119:3300/0 conn(0x7f9f2c060450 msgr2=0x7f9f2c13cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 --2- 172.21.2.135:0/3610387255 >> v2:172.21.2.119:3300/0 conn(0x7f9f2c060450 0x7f9f2c13cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c060eb0 con 0x7f9f2c13d240 2021-11-15T14:34:36.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9f240019e0 con 0x7f9f2c13d240 2021-11-15T14:34:36.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 >> v1:172.21.2.135:6789/0 conn(0x7f9f2c13d240 legacy=0x7f9f2c13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f140037d0 0x7f9f14003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 0x7f9f14004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f14004bf0 0x7f9f1400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c061cb0 con 0x7f9f14004bf0 2021-11-15T14:34:36.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c060c10 con 0x7f9f140037d0 2021-11-15T14:34:36.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14005300 con 0x7f9f2c0a9f40 2021-11-15T14:34:36.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f140037d0 0x7f9f14003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 -- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 msgr2=0x7f9f14004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c0a9f40 0x7f9f14004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 -- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f14004bf0 msgr2=0x7f9f1400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f14004bf0 0x7f9f1400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 -- 172.21.2.135:0/3610387255 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14003260 con 0x7f9f140037d0 2021-11-15T14:34:36.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31427700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f140037d0 0x7f9f14003bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9f28002f70 tx=0x7f9f28006ca0).ready entity=mon.1 client_cookie=ce2c5faacdcb8c67 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f28012410 con 0x7f9f140037d0 2021-11-15T14:34:36.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28012570 con 0x7f9f140037d0 2021-11-15T14:34:36.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f1ffff700 1 -- 172.21.2.135:0/3610387255 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f280128d0 con 0x7f9f140037d0 2021-11-15T14:34:36.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- 172.21.2.135:0/3610387255 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f140037d0 msgr2=0x7f9f14003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 --2- 172.21.2.135:0/3610387255 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f140037d0 0x7f9f14003bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9f28002f70 tx=0x7f9f28006ca0).stop 2021-11-15T14:34:36.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f31c28700 1 -- 172.21.2.135:0/3610387255 reap_dead start 2021-11-15T14:34:36.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- 172.21.2.135:0/3610387255 shutdown_connections 2021-11-15T14:34:36.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- 172.21.2.135:0/3610387255 >> 172.21.2.135:0/3610387255 conn(0x7f9f2c0b29f0 msgr2=0x7f9f2c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- 172.21.2.135:0/3610387255 shutdown_connections 2021-11-15T14:34:36.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.513+0000 7f9f3368b700 1 -- 172.21.2.135:0/3610387255 wait complete. 2021-11-15T14:34:36.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 Processor -- start 2021-11-15T14:34:36.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- start start 2021-11-15T14:34:36.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f2c14d530 0x7f9f2c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c14d910 0x7f9f2c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c14e240 con 0x7f9f2c14d530 2021-11-15T14:34:36.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c15a670 con 0x7f9f2c157470 2021-11-15T14:34:36.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c14dfa0 con 0x7f9f2c14d910 2021-11-15T14:34:36.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55198/0 (socket says 172.21.2.135:55198) 2021-11-15T14:34:36.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 -- 172.21.2.135:0/2813588278 learned_addr learned my addr 172.21.2.135:0/2813588278 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 -- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c14d910 msgr2=0x7f9f2c156f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:36.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c14d910 0x7f9f2c156f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 -- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f2c14d530 msgr2=0x7f9f2c15ad70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:36.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f2c14d530 0x7f9f2c15ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 -- 172.21.2.135:0/2813588278 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c15a8d0 con 0x7f9f2c157470 2021-11-15T14:34:36.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31c28700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9f2c14cbb0 tx=0x7f9f2c061040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f24004b70 con 0x7f9f2c157470 2021-11-15T14:34:36.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24004cd0 con 0x7f9f2c157470 2021-11-15T14:34:36.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c157de0 con 0x7f9f2c157470 2021-11-15T14:34:36.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f240072c0 con 0x7f9f2c157470 2021-11-15T14:34:36.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c13e210 con 0x7f9f2c157470 2021-11-15T14:34:36.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c14cf90 con 0x7f9f2c157470 2021-11-15T14:34:36.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f2401b070 con 0x7f9f2c157470 2021-11-15T14:34:36.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 0x7f9f0c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9f2406b160 con 0x7f9f2c157470 2021-11-15T14:34:36.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.517+0000 7f9f31427700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 0x7f9f0c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.521+0000 7f9f31427700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 0x7f9f0c055be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f28002f70 tx=0x7f9f28015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.521+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f24042100 con 0x7f9f2c157470 2021-11-15T14:34:36.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f2c15aa60 con 0x7f9f2c157470 2021-11-15T14:34:36.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f1e7fc700 1 -- 172.21.2.135:0/2813588278 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9f24019030 con 0x7f9f2c157470 2021-11-15T14:34:36.609 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:36.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 msgr2=0x7f9f0c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 0x7f9f0c055be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f28002f70 tx=0x7f9f28015000).stop 2021-11-15T14:34:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 msgr2=0x7f9f2c1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9f2c14cbb0 tx=0x7f9f2c061040).stop 2021-11-15T14:34:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 shutdown_connections 2021-11-15T14:34:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f0c053720 0x7f9f0c055be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f2c157470 0x7f9f2c1578f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f2c14d910 0x7f9f2c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 --2- 172.21.2.135:0/2813588278 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f2c14d530 0x7f9f2c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 >> 172.21.2.135:0/2813588278 conn(0x7f9f2c0b29f0 msgr2=0x7f9f2c13b350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 shutdown_connections 2021-11-15T14:34:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.605+0000 7f9f3368b700 1 -- 172.21.2.135:0/2813588278 wait complete. 2021-11-15T14:34:36.616 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:36.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 Processor -- start 2021-11-15T14:34:36.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 -- start start 2021-11-15T14:34:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f40000b2320 0x7f40001412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000a7850 con 0x7f40000b0030 2021-11-15T14:34:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000b0470 con 0x7f40000b2320 2021-11-15T14:34:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f400757e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b06d0 con 0x7f40000b1f40 2021-11-15T14:34:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4004b19700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f40000b0030 0x7f40000a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42796/0 (socket says 172.21.2.135:42796) 2021-11-15T14:34:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4004b19700 1 -- 172.21.2.135:0/160374420 learned_addr learned my addr 172.21.2.135:0/160374420 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4005b1b700 1 --2- 172.21.2.135:0/160374420 >> v2:172.21.2.135:3300/0 conn(0x7f40000b2320 0x7f40001412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f3ff3fff700 1 -- 172.21.2.135:0/160374420 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082735329 0 0) 0x7f40000a7850 con 0x7f40000b0030 2021-11-15T14:34:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f3ff3fff700 1 -- 172.21.2.135:0/160374420 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe8003260 con 0x7f40000b0030 2021-11-15T14:34:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4005b1b700 1 -- 172.21.2.135:0/160374420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 msgr2=0x7f40000b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4005b1b700 1 --2- 172.21.2.135:0/160374420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4005b1b700 1 -- 172.21.2.135:0/160374420 >> v1:172.21.2.135:6789/0 conn(0x7f40000b0030 legacy=0x7f40000a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.665+0000 7f4005b1b700 1 -- 172.21.2.135:0/160374420 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000b0970 con 0x7f40000b2320 2021-11-15T14:34:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- 172.21.2.135:0/160374420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f40001412d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3ff80032f0 tx=0x7f3ff80091d0).ready entity=mon.1 client_cookie=3ed449c54b1e2756 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff3fff700 1 -- 172.21.2.135:0/160374420 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff800b6c0 con 0x7f40000b2320 2021-11-15T14:34:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff3fff700 1 -- 172.21.2.135:0/160374420 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800b820 con 0x7f40000b2320 2021-11-15T14:34:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff3fff700 1 -- 172.21.2.135:0/160374420 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff800b990 con 0x7f40000b2320 2021-11-15T14:34:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/160374420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 msgr2=0x7f40001412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- 172.21.2.135:0/160374420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f40001412d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3ff80032f0 tx=0x7f3ff80091d0).stop 2021-11-15T14:34:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/160374420 shutdown_connections 2021-11-15T14:34:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- 172.21.2.135:0/160374420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f40001412d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- 172.21.2.135:0/160374420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/160374420 >> 172.21.2.135:0/160374420 conn(0x7f400005f730 msgr2=0x7f400005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/160374420 shutdown_connections 2021-11-15T14:34:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/160374420 wait complete. 2021-11-15T14:34:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 Processor -- start 2021-11-15T14:34:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- start start 2021-11-15T14:34:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40000b0030 0x7f4000146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000abdd0 con 0x7f40000b0030 2021-11-15T14:34:36.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b3f60 con 0x7f40000b2320 2021-11-15T14:34:36.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4000148b80 con 0x7f40000b1f40 2021-11-15T14:34:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55214/0 (socket says 172.21.2.135:55214) 2021-11-15T14:34:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 -- 172.21.2.135:0/3784531165 learned_addr learned my addr 172.21.2.135:0/3784531165 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 -- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 msgr2=0x7f40000b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 -- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40000b0030 msgr2=0x7f4000146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40000b0030 0x7f4000146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 -- 172.21.2.135:0/3784531165 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009470 con 0x7f40000b2320 2021-11-15T14:34:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f4005b1b700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f3ff80032f0 tx=0x7f3ff8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff800b030 con 0x7f40000b2320 2021-11-15T14:34:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8021480 con 0x7f40000b2320 2021-11-15T14:34:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff80217e0 con 0x7f40000b2320 2021-11-15T14:34:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4000145110 con 0x7f40000b2320 2021-11-15T14:34:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000ac350 con 0x7f40000b2320 2021-11-15T14:34:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000b0c10 con 0x7f40000b2320 2021-11-15T14:34:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ff800f070 con 0x7f40000b2320 2021-11-15T14:34:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.669+0000 7f3ff27fc700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 0x7f3fe0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.673+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f3ff806cde0 con 0x7f40000b2320 2021-11-15T14:34:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.673+0000 7f400531a700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 0x7f3fe0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.673+0000 7f400531a700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 0x7f3fe0055ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3ff4002f70 tx=0x7f3ff4006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.673+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ff8043d80 con 0x7f40000b2320 2021-11-15T14:34:36.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.753+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40000573d0 con 0x7f40000b2320 2021-11-15T14:34:36.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.753+0000 7f3ff27fc700 1 -- 172.21.2.135:0/3784531165 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3ff8026020 con 0x7f40000b2320 2021-11-15T14:34:36.758 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:36.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 msgr2=0x7f3fe0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 0x7f3fe0055ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3ff4002f70 tx=0x7f3ff4006a80).stop 2021-11-15T14:34:36.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 msgr2=0x7f400014ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f3ff80032f0 tx=0x7f3ff8016000).stop 2021-11-15T14:34:36.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 shutdown_connections 2021-11-15T14:34:36.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fe0053610 0x7f3fe0055ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40000b2320 0x7f400014ab00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40000b1f40 0x7f40000b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 --2- 172.21.2.135:0/3784531165 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f40000b0030 0x7f4000146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 >> 172.21.2.135:0/3784531165 conn(0x7f400005f730 msgr2=0x7f400013cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 shutdown_connections 2021-11-15T14:34:36.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.757+0000 7f400757e700 1 -- 172.21.2.135:0/3784531165 wait complete. 2021-11-15T14:34:36.765 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:36.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 Processor -- start 2021-11-15T14:34:36.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 -- start start 2021-11-15T14:34:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 0x7f659c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0b6d60 con 0x7f659c060990 2021-11-15T14:34:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c061260 con 0x7f659c0aa650 2021-11-15T14:34:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c061500 con 0x7f659c0b6980 2021-11-15T14:34:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f659c0aa650 0x7f659c13c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42810/0 (socket says 172.21.2.135:42810) 2021-11-15T14:34:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 -- 172.21.2.135:0/2298223734 learned_addr learned my addr 172.21.2.135:0/2298223734 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622521566 0 0) 0x7f659c061260 con 0x7f659c0aa650 2021-11-15T14:34:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003260 con 0x7f659c0aa650 2021-11-15T14:34:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659b7fe700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 0x7f659c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1588000983 0 0) 0x7f657c003260 con 0x7f659c0aa650 2021-11-15T14:34:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 msgr2=0x7f659c0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 0x7f659c0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 >> v1:172.21.2.119:6789/0 conn(0x7f659c060990 legacy=0x7f659c0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0617a0 con 0x7f659c0aa650 2021-11-15T14:34:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f65940019e0 con 0x7f659c0aa650 2021-11-15T14:34:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 >> v1:172.21.2.135:6789/0 conn(0x7f659c0aa650 legacy=0x7f659c13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 0x7f657c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c003e10 0x7f657c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f657c004b10 0x7f657c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c061500 con 0x7f657c003e10 2021-11-15T14:34:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c005950 con 0x7f657c004b10 2021-11-15T14:34:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c005b10 con 0x7f659c0b6980 2021-11-15T14:34:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f657c004b10 0x7f657c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 -- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 msgr2=0x7f657c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c0b6980 0x7f657c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 -- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c003e10 msgr2=0x7f657c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c003e10 0x7f657c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 -- 172.21.2.135:0/2298223734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c003260 con 0x7f657c004b10 2021-11-15T14:34:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f657c004b10 0x7f657c004f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f659c0b5e80 tx=0x7f659c0ac010).ready entity=mon.1 client_cookie=3cdc2f72c3ee51f8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659400ccc0 con 0x7f657c004b10 2021-11-15T14:34:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659400ce20 con 0x7f657c004b10 2021-11-15T14:34:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659a7fc700 1 -- 172.21.2.135:0/2298223734 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6594005b80 con 0x7f657c004b10 2021-11-15T14:34:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 -- 172.21.2.135:0/2298223734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f657c004b10 msgr2=0x7f657c004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/2298223734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f657c004b10 0x7f657c004f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f659c0b5e80 tx=0x7f659c0ac010).stop 2021-11-15T14:34:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.813+0000 7f659bfff700 1 -- 172.21.2.135:0/2298223734 reap_dead start 2021-11-15T14:34:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/2298223734 shutdown_connections 2021-11-15T14:34:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/2298223734 >> 172.21.2.135:0/2298223734 conn(0x7f659c0b3500 msgr2=0x7f659c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/2298223734 shutdown_connections 2021-11-15T14:34:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/2298223734 wait complete. 2021-11-15T14:34:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 Processor -- start 2021-11-15T14:34:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- start start 2021-11-15T14:34:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c004b10 0x7f659c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c13db50 0x7f659c13e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c13a350 con 0x7f657c004b10 2021-11-15T14:34:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c14e4b0 con 0x7f659c13cb10 2021-11-15T14:34:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c13e110 con 0x7f659c13db50 2021-11-15T14:34:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55236/0 (socket says 172.21.2.135:55236) 2021-11-15T14:34:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 -- 172.21.2.135:0/1441525259 learned_addr learned my addr 172.21.2.135:0/1441525259 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 -- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c13db50 msgr2=0x7f659c13e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c13db50 0x7f659c13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 -- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c004b10 msgr2=0x7f659c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c004b10 0x7f659c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 -- 172.21.2.135:0/1441525259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c13f1e0 con 0x7f659c13cb10 2021-11-15T14:34:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659affd700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f658c000f70 tx=0x7f658c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658c013460 con 0x7f659c13cb10 2021-11-15T14:34:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0135c0 con 0x7f659c13cb10 2021-11-15T14:34:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c13f480 con 0x7f659c13cb10 2021-11-15T14:34:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c13abd0 con 0x7f659c13cb10 2021-11-15T14:34:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658c013920 con 0x7f659c13cb10 2021-11-15T14:34:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c061a40 con 0x7f659c13cb10 2021-11-15T14:34:36.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f658c01a060 con 0x7f659c13cb10 2021-11-15T14:34:36.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 0x7f6580055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f658c06b520 con 0x7f659c13cb10 2021-11-15T14:34:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.817+0000 7f659b7fe700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 0x7f6580055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.821+0000 7f659b7fe700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 0x7f6580055b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6584007000 tx=0x7f6584008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.821+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f658c0423b0 con 0x7f659c13cb10 2021-11-15T14:34:36.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.929+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f659c0573d0 con 0x7f659c13cb10 2021-11-15T14:34:36.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f6598ff9700 1 -- 172.21.2.135:0/1441525259 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f658c018090 con 0x7f659c13cb10 2021-11-15T14:34:36.935 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:36.935 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:30.789816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2579658836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2579658836},{"type":"v1","addr":"172.21.2.135:6835","nonce":2579658836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:36.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 msgr2=0x7f6580055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 0x7f6580055b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6584007000 tx=0x7f6584008040).stop 2021-11-15T14:34:36.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 msgr2=0x7f659c13a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:36.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f658c000f70 tx=0x7f658c006df0).stop 2021-11-15T14:34:36.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 shutdown_connections 2021-11-15T14:34:36.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65800536d0 0x7f6580055b90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f659c13db50 0x7f659c13e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f659c13cb10 0x7f659c13a6e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:36.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 --2- 172.21.2.135:0/1441525259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f657c004b10 0x7f659c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:36.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 >> 172.21.2.135:0/1441525259 conn(0x7f659c0b3500 msgr2=0x7f659c135fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:36.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 shutdown_connections 2021-11-15T14:34:36.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:36.933+0000 7f65a1b7a700 1 -- 172.21.2.135:0/1441525259 wait complete. 2021-11-15T14:34:36.939 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 6 2021-11-15T14:34:37.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:34:29.784960+0000', 'modified': '2021-11-15T14:34:30.789816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4234': {'gid': 4234, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2579658836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2579658836}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2579658836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:34:37.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:34:37.245 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:34:37.308 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":4234,"want_state":"up:active","state":"up:active","rank_uptime":7.5169686789999997,"mdsmap_epoch":6,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":12.713999372} 2021-11-15T14:34:37.309 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 4234, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 7.516968679, "state": "up:active", "uptime": 12.713999372, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:34:37.309 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-11-15T14:34:37.327 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-11-15T14:34:37.327 INFO:tasks.ceph_fuse:config is None 2021-11-15T14:34:37.327 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2021-11-15T14:34:37.328 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-11-15T14:34:37.328 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:37.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.373+0000 7f35f91fd700 1 Processor -- start 2021-11-15T14:34:37.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.373+0000 7f35f91fd700 1 -- start start 2021-11-15T14:34:37.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35f4060180 0x7f35f40616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f35f4065ea0 0x7f35f4066d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f4060560 con 0x7f35f40659f0 2021-11-15T14:34:37.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f4060cf0 con 0x7f35f4065ea0 2021-11-15T14:34:37.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f4060f90 con 0x7f35f4060180 2021-11-15T14:34:37.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35f4060180 0x7f35f40616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35f4060180 0x7f35f40616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55240/0 (socket says 172.21.2.135:55240) 2021-11-15T14:34:37.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 -- 172.21.2.135:0/172247290 learned_addr learned my addr 172.21.2.135:0/172247290 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 -- 172.21.2.135:0/172247290 >> v2:172.21.2.119:3300/0 conn(0x7f35f4065ea0 msgr2=0x7f35f4066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 --2- 172.21.2.135:0/172247290 >> v2:172.21.2.119:3300/0 conn(0x7f35f4065ea0 0x7f35f4066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 -- 172.21.2.135:0/172247290 >> v1:172.21.2.119:6789/0 conn(0x7f35f40659f0 legacy=0x7f35f4066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 -- 172.21.2.135:0/172247290 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4061230 con 0x7f35f4060180 2021-11-15T14:34:37.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f2d9d700 1 --2- 172.21.2.135:0/172247290 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4060180 0x7f35f40616d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f35f40ae9b0 tx=0x7f35dc006eb0).ready entity=mon.1 client_cookie=8dee8f661a59029d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f1d9b700 1 -- 172.21.2.135:0/172247290 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35dc00d5c0 con 0x7f35f4060180 2021-11-15T14:34:37.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f1d9b700 1 -- 172.21.2.135:0/172247290 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc000e90 con 0x7f35f4060180 2021-11-15T14:34:37.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f1d9b700 1 -- 172.21.2.135:0/172247290 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35dc00d910 con 0x7f35f4060180 2021-11-15T14:34:37.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- 172.21.2.135:0/172247290 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4060180 msgr2=0x7f35f40616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- 172.21.2.135:0/172247290 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4060180 0x7f35f40616d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f35f40ae9b0 tx=0x7f35dc006eb0).stop 2021-11-15T14:34:37.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- 172.21.2.135:0/172247290 shutdown_connections 2021-11-15T14:34:37.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- 172.21.2.135:0/172247290 >> v2:172.21.2.119:3300/0 conn(0x7f35f4065ea0 0x7f35f4066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- 172.21.2.135:0/172247290 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4060180 0x7f35f40616d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- 172.21.2.135:0/172247290 >> 172.21.2.135:0/172247290 conn(0x7f35f405cfb0 msgr2=0x7f35f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- 172.21.2.135:0/172247290 shutdown_connections 2021-11-15T14:34:37.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- 172.21.2.135:0/172247290 wait complete. 2021-11-15T14:34:37.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 Processor -- start 2021-11-15T14:34:37.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- start start 2021-11-15T14:34:37.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35f4060180 0x7f35f40a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35f40659f0 0x7f35f40a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f409ecb0 con 0x7f35f4060180 2021-11-15T14:34:37.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40ae7f0 con 0x7f35f4065ea0 2021-11-15T14:34:37.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f91fd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40ae550 con 0x7f35f40659f0 2021-11-15T14:34:37.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.377+0000 7f35f359e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55250/0 (socket says 172.21.2.135:55250) 2021-11-15T14:34:37.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 -- 172.21.2.135:0/1029067325 learned_addr learned my addr 172.21.2.135:0/1029067325 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 -- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35f40659f0 msgr2=0x7f35f40a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35f40659f0 0x7f35f40a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 -- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35f4060180 msgr2=0x7f35f40a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35f4060180 0x7f35f40a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 -- 172.21.2.135:0/1029067325 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc00b1e0 con 0x7f35f4065ea0 2021-11-15T14:34:37.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f359e700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f35f409fb20 tx=0x7f35ec0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec00f510 con 0x7f35f4065ea0 2021-11-15T14:34:37.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00f670 con 0x7f35f4065ea0 2021-11-15T14:34:37.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f40ac5c0 con 0x7f35f4065ea0 2021-11-15T14:34:37.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec00f7e0 con 0x7f35f4065ea0 2021-11-15T14:34:37.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f409e930 con 0x7f35f4065ea0 2021-11-15T14:34:37.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f40ae380 con 0x7f35f4065ea0 2021-11-15T14:34:37.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35ec00f070 con 0x7f35f4065ea0 2021-11-15T14:34:37.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 0x7f35d8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f35ec06b850 con 0x7f35f4065ea0 2021-11-15T14:34:37.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f2d9d700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 0x7f35d8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.381+0000 7f35f2d9d700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 0x7f35d8055a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f35f40ae9b0 tx=0x7f35dc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.385+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35ec042740 con 0x7f35f4065ea0 2021-11-15T14:34:37.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.465+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f40ac750 con 0x7f35f4065ea0 2021-11-15T14:34:37.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.465+0000 7f35ebfff700 1 -- 172.21.2.135:0/1029067325 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f35ec045d60 con 0x7f35f4065ea0 2021-11-15T14:34:37.469 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:37.470 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:37.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 msgr2=0x7f35d8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 0x7f35d8055a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f35f40ae9b0 tx=0x7f35dc015000).stop 2021-11-15T14:34:37.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 msgr2=0x7f35f40a25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f35f409fb20 tx=0x7f35ec0091a0).stop 2021-11-15T14:34:37.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 shutdown_connections 2021-11-15T14:34:37.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35d8053580 0x7f35d8055a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35f4065ea0 0x7f35f40a25b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35f40659f0 0x7f35f40a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 --2- 172.21.2.135:0/1029067325 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35f4060180 0x7f35f40a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 >> 172.21.2.135:0/1029067325 conn(0x7f35f405cfb0 msgr2=0x7f35f40615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 shutdown_connections 2021-11-15T14:34:37.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.469+0000 7f35f91fd700 1 -- 172.21.2.135:0/1029067325 wait complete. 2021-11-15T14:34:37.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:37.477 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:37.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 Processor -- start 2021-11-15T14:34:37.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 -- start start 2021-11-15T14:34:37.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 0x7efc541444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7efc540b3950 0x7efc541449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540b2430 con 0x7efc54060040 2021-11-15T14:34:37.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540b26d0 con 0x7efc540b3950 2021-11-15T14:34:37.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc58fda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc540b2970 con 0x7efc540654a0 2021-11-15T14:34:37.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc5259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7efc54060040 0x7efc54064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42842/0 (socket says 172.21.2.135:42842) 2021-11-15T14:34:37.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc5259c700 1 -- 172.21.2.135:0/104285886 learned_addr learned my addr 172.21.2.135:0/104285886 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:37.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 --2- 172.21.2.135:0/104285886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 0x7efc541444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc52d9d700 1 --2- 172.21.2.135:0/104285886 >> v2:172.21.2.119:3300/0 conn(0x7efc540b3950 0x7efc541449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 -- 172.21.2.135:0/104285886 >> v2:172.21.2.119:3300/0 conn(0x7efc540b3950 msgr2=0x7efc541449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 --2- 172.21.2.135:0/104285886 >> v2:172.21.2.119:3300/0 conn(0x7efc540b3950 0x7efc541449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 -- 172.21.2.135:0/104285886 >> v1:172.21.2.135:6789/0 conn(0x7efc54060040 legacy=0x7efc54064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 -- 172.21.2.135:0/104285886 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540648f0 con 0x7efc540654a0 2021-11-15T14:34:37.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.529+0000 7efc51d9b700 1 --2- 172.21.2.135:0/104285886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 0x7efc541444c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efc48002f70 tx=0x7efc48006df0).ready entity=mon.2 client_cookie=dfe5499f0cf75cc2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc5159a700 1 -- 172.21.2.135:0/104285886 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4800d570 con 0x7efc540654a0 2021-11-15T14:34:37.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc5159a700 1 -- 172.21.2.135:0/104285886 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48000e90 con 0x7efc540654a0 2021-11-15T14:34:37.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc5159a700 1 -- 172.21.2.135:0/104285886 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4800d8c0 con 0x7efc540654a0 2021-11-15T14:34:37.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/104285886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 msgr2=0x7efc541444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- 172.21.2.135:0/104285886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 0x7efc541444c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efc48002f70 tx=0x7efc48006df0).stop 2021-11-15T14:34:37.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/104285886 shutdown_connections 2021-11-15T14:34:37.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- 172.21.2.135:0/104285886 >> v2:172.21.2.119:3300/0 conn(0x7efc540b3950 0x7efc541449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- 172.21.2.135:0/104285886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc540654a0 0x7efc541444c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/104285886 >> 172.21.2.135:0/104285886 conn(0x7efc5405cfe0 msgr2=0x7efc5405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/104285886 shutdown_connections 2021-11-15T14:34:37.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/104285886 wait complete. 2021-11-15T14:34:37.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 Processor -- start 2021-11-15T14:34:37.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- start start 2021-11-15T14:34:37.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc54060040 0x7efc540b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc540b3950 0x7efc540b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540ae330 con 0x7efc540b3950 2021-11-15T14:34:37.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540ad1d0 con 0x7efc540654a0 2021-11-15T14:34:37.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc540b0ff0 con 0x7efc54060040 2021-11-15T14:34:37.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55264/0 (socket says 172.21.2.135:55264) 2021-11-15T14:34:37.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 -- 172.21.2.135:0/3727643321 learned_addr learned my addr 172.21.2.135:0/3727643321 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 -- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc54060040 msgr2=0x7efc540b6530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:37.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc54060040 0x7efc540b6530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 -- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc540b3950 msgr2=0x7efc540b0b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:37.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc540b3950 0x7efc540b0b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 -- 172.21.2.135:0/3727643321 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4800b180 con 0x7efc540654a0 2021-11-15T14:34:37.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc51d9b700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7efc540b1340 tx=0x7efc48014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc48016070 con 0x7efc540654a0 2021-11-15T14:34:37.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800de40 con 0x7efc540654a0 2021-11-15T14:34:37.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc540b1420 con 0x7efc540654a0 2021-11-15T14:34:37.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4801e450 con 0x7efc540654a0 2021-11-15T14:34:37.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc540ad600 con 0x7efc540654a0 2021-11-15T14:34:37.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc540ad340 con 0x7efc540654a0 2021-11-15T14:34:37.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.533+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc48025030 con 0x7efc540654a0 2021-11-15T14:34:37.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.537+0000 7efc437fe700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 0x7efc30055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.537+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7efc4806ca80 con 0x7efc540654a0 2021-11-15T14:34:37.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.537+0000 7efc5259c700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 0x7efc30055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.537+0000 7efc5259c700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 0x7efc30055a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7efc54064c70 tx=0x7efc44007790).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.537+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc540ad340 con 0x7efc540654a0 2021-11-15T14:34:37.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efc540ad310 con 0x7efc540654a0 2021-11-15T14:34:37.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc437fe700 1 -- 172.21.2.135:0/3727643321 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7efc480230b0 con 0x7efc540654a0 2021-11-15T14:34:37.624 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:37.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 msgr2=0x7efc30055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 0x7efc30055a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7efc54064c70 tx=0x7efc44007790).stop 2021-11-15T14:34:37.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 msgr2=0x7efc540b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7efc540b1340 tx=0x7efc48014000).stop 2021-11-15T14:34:37.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 shutdown_connections 2021-11-15T14:34:37.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efc30053580 0x7efc30055a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc540b3950 0x7efc540b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc540654a0 0x7efc540b0610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 --2- 172.21.2.135:0/3727643321 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc54060040 0x7efc540b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 >> 172.21.2.135:0/3727643321 conn(0x7efc5405cfe0 msgr2=0x7efc5413ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 shutdown_connections 2021-11-15T14:34:37.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.621+0000 7efc58fda700 1 -- 172.21.2.135:0/3727643321 wait complete. 2021-11-15T14:34:37.631 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:37.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 Processor -- start 2021-11-15T14:34:37.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- start start 2021-11-15T14:34:37.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23980b1f40 0x7f23980b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 0x7f23980b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 0x7f23981412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23980b04a0 con 0x7f23980b0030 2021-11-15T14:34:37.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23980b2810 con 0x7f23980b1f40 2021-11-15T14:34:37.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23980b06d0 con 0x7f23980a7140 2021-11-15T14:34:37.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23980b1f40 0x7f23980b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23980b1f40 0x7f23980b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55268/0 (socket says 172.21.2.135:55268) 2021-11-15T14:34:37.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 -- 172.21.2.135:0/3686652146 learned_addr learned my addr 172.21.2.135:0/3686652146 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 -- 172.21.2.135:0/3686652146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 msgr2=0x7f23981412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239ec55700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 0x7f23981412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 0x7f23981412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239dc53700 1 --2- 172.21.2.135:0/3686652146 >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 0x7f23980b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 -- 172.21.2.135:0/3686652146 >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 msgr2=0x7f23980b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 --2- 172.21.2.135:0/3686652146 >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 0x7f23980b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 -- 172.21.2.135:0/3686652146 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23980b0970 con 0x7f23980b1f40 2021-11-15T14:34:37.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239ec55700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 0x7f23981412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:37.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239dc53700 1 --2- 172.21.2.135:0/3686652146 >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 0x7f23980b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:37.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239e454700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b1f40 0x7f23980b1350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394006eb0).ready entity=mon.1 client_cookie=9c6f3aab232f2415 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239d452700 1 -- 172.21.2.135:0/3686652146 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239400d570 con 0x7f23980b1f40 2021-11-15T14:34:37.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239d452700 1 -- 172.21.2.135:0/3686652146 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394000e90 con 0x7f23980b1f40 2021-11-15T14:34:37.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f239d452700 1 -- 172.21.2.135:0/3686652146 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239400d900 con 0x7f23980b1f40 2021-11-15T14:34:37.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- 172.21.2.135:0/3686652146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b1f40 msgr2=0x7f23980b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b1f40 0x7f23980b1350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394006eb0).stop 2021-11-15T14:34:37.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- 172.21.2.135:0/3686652146 shutdown_connections 2021-11-15T14:34:37.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980a7140 0x7f23981412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- 172.21.2.135:0/3686652146 >> v2:172.21.2.119:3300/0 conn(0x7f23980b0030 0x7f23980b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 --2- 172.21.2.135:0/3686652146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b1f40 0x7f23980b1350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- 172.21.2.135:0/3686652146 >> 172.21.2.135:0/3686652146 conn(0x7f239805f730 msgr2=0x7f239805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- 172.21.2.135:0/3686652146 shutdown_connections 2021-11-15T14:34:37.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.681+0000 7f23a06b8700 1 -- 172.21.2.135:0/3686652146 wait complete. 2021-11-15T14:34:37.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 Processor -- start 2021-11-15T14:34:37.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- start start 2021-11-15T14:34:37.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23980a7140 0x7f239815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980b1f40 0x7f23980ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980add70 con 0x7f23980a7140 2021-11-15T14:34:37.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239815ae40 con 0x7f23980b0030 2021-11-15T14:34:37.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23980ab690 con 0x7f23980b1f40 2021-11-15T14:34:37.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55278/0 (socket says 172.21.2.135:55278) 2021-11-15T14:34:37.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 -- 172.21.2.135:0/2717126975 learned_addr learned my addr 172.21.2.135:0/2717126975 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 -- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980b1f40 msgr2=0x7f23980ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980b1f40 0x7f23980ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 -- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23980a7140 msgr2=0x7f239815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23980a7140 0x7f239815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 -- 172.21.2.135:0/2717126975 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239400b1e0 con 0x7f23980b0030 2021-11-15T14:34:37.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239dc53700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f23980adeb0 tx=0x7f2388008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2388010580 con 0x7f23980b0030 2021-11-15T14:34:37.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23880106e0 con 0x7f23980b0030 2021-11-15T14:34:37.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239815aba0 con 0x7f23980b0030 2021-11-15T14:34:37.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2388010a40 con 0x7f23980b0030 2021-11-15T14:34:37.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23980ac040 con 0x7f23980b0030 2021-11-15T14:34:37.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23980ab7d0 con 0x7f23980b0030 2021-11-15T14:34:37.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2388010ba0 con 0x7f23980b0030 2021-11-15T14:34:37.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 0x7f2378055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f238806bbf0 con 0x7f23980b0030 2021-11-15T14:34:37.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.685+0000 7f239e454700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 0x7f2378055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.689+0000 7f239e454700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 0x7f2378055b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.689+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2388042b90 con 0x7f23980b0030 2021-11-15T14:34:37.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.769+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23980b0c10 con 0x7f23980b0030 2021-11-15T14:34:37.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23877fe700 1 -- 172.21.2.135:0/2717126975 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23880461b0 con 0x7f23980b0030 2021-11-15T14:34:37.775 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:37.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 msgr2=0x7f2378055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 0x7f2378055b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394015000).stop 2021-11-15T14:34:37.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 msgr2=0x7f23980ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f23980adeb0 tx=0x7f2388008040).stop 2021-11-15T14:34:37.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 shutdown_connections 2021-11-15T14:34:37.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2378053690 0x7f2378055b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23980b1f40 0x7f23980ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23980b0030 0x7f23980ad390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 --2- 172.21.2.135:0/2717126975 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23980a7140 0x7f239815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 >> 172.21.2.135:0/2717126975 conn(0x7f239805f730 msgr2=0x7f239813d840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 shutdown_connections 2021-11-15T14:34:37.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.773+0000 7f23a06b8700 1 -- 172.21.2.135:0/2717126975 wait complete. 2021-11-15T14:34:37.782 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:37.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 Processor -- start 2021-11-15T14:34:37.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- start start 2021-11-15T14:34:37.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b1f40 0x7f5b6c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5b6c0b2320 0x7f5b6c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c0a7850 con 0x7f5b6c0b0030 2021-11-15T14:34:37.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c0b0470 con 0x7f5b6c0b2320 2021-11-15T14:34:37.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c0b06d0 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5b6c0b2320 0x7f5b6c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5b6c0b2320 0x7f5b6c1412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55284/0 (socket says 172.21.2.135:55284) 2021-11-15T14:34:37.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 -- 172.21.2.135:0/3811761948 learned_addr learned my addr 172.21.2.135:0/3811761948 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 -- 172.21.2.135:0/3811761948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b1f40 msgr2=0x7f5b6c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 --2- 172.21.2.135:0/3811761948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b1f40 0x7f5b6c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 -- 172.21.2.135:0/3811761948 >> v1:172.21.2.119:6789/0 conn(0x7f5b6c0b0030 legacy=0x7f5b6c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 -- 172.21.2.135:0/3811761948 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0b0970 con 0x7f5b6c0b2320 2021-11-15T14:34:37.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b72936700 1 --2- 172.21.2.135:0/3811761948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c1412d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5b6c06a170 tx=0x7f5b64009290).ready entity=mon.1 client_cookie=c5bf6049979acd13 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b71133700 1 -- 172.21.2.135:0/3811761948 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6400b860 con 0x7f5b6c0b2320 2021-11-15T14:34:37.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b71133700 1 -- 172.21.2.135:0/3811761948 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6400b9c0 con 0x7f5b6c0b2320 2021-11-15T14:34:37.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b71133700 1 -- 172.21.2.135:0/3811761948 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6400bb70 con 0x7f5b6c0b2320 2021-11-15T14:34:37.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- 172.21.2.135:0/3811761948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b2320 msgr2=0x7f5b6c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- 172.21.2.135:0/3811761948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c1412d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5b6c06a170 tx=0x7f5b64009290).stop 2021-11-15T14:34:37.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- 172.21.2.135:0/3811761948 shutdown_connections 2021-11-15T14:34:37.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- 172.21.2.135:0/3811761948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c1412d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- 172.21.2.135:0/3811761948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b1f40 0x7f5b6c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- 172.21.2.135:0/3811761948 >> 172.21.2.135:0/3811761948 conn(0x7f5b6c05f730 msgr2=0x7f5b6c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- 172.21.2.135:0/3811761948 shutdown_connections 2021-11-15T14:34:37.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- 172.21.2.135:0/3811761948 wait complete. 2021-11-15T14:34:37.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 Processor -- start 2021-11-15T14:34:37.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- start start 2021-11-15T14:34:37.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b0030 0x7f5b6c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c156df0 con 0x7f5b6c0b2320 2021-11-15T14:34:37.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c140c20 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.833+0000 7f5b74399700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c140980 con 0x7f5b6c0b0030 2021-11-15T14:34:37.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55292/0 (socket says 172.21.2.135:55292) 2021-11-15T14:34:37.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 -- 172.21.2.135:0/3398374679 learned_addr learned my addr 172.21.2.135:0/3398374679 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 -- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b0030 msgr2=0x7f5b6c14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b0030 0x7f5b6c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 -- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5b6c0b2320 msgr2=0x7f5b6c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 -- 172.21.2.135:0/3398374679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b64009530 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b71934700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5b68002f90 tx=0x7f5b68006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b68013460 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680135c0 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c157050 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c14de90 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b68013920 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c1571e0 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5b6801a060 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 0x7f5b4c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5b6806b570 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b72135700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 0x7f5b4c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.837+0000 7f5b72135700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 0x7f5b4c055bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5b60002f70 tx=0x7f5b60006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.841+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5b68042460 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.921+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b6c0b0c10 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.921+0000 7f5b5f7fe700 1 -- 172.21.2.135:0/3398374679 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5b680180a0 con 0x7f5b6c0b1f40 2021-11-15T14:34:37.926 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:37.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 msgr2=0x7f5b4c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 0x7f5b4c055bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5b60002f70 tx=0x7f5b60006a80).stop 2021-11-15T14:34:37.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 msgr2=0x7f5b6c1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5b68002f90 tx=0x7f5b68006df0).stop 2021-11-15T14:34:37.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 shutdown_connections 2021-11-15T14:34:37.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5b4c0536f0 0x7f5b4c055bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5b6c0b2320 0x7f5b6c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5b6c0b1f40 0x7f5b6c1574f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 --2- 172.21.2.135:0/3398374679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5b6c0b0030 0x7f5b6c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 >> 172.21.2.135:0/3398374679 conn(0x7f5b6c05f730 msgr2=0x7f5b6c146400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 shutdown_connections 2021-11-15T14:34:37.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.925+0000 7f5b74399700 1 -- 172.21.2.135:0/3398374679 wait complete. 2021-11-15T14:34:37.933 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:37.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 Processor -- start 2021-11-15T14:34:37.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 -- start start 2021-11-15T14:34:37.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f38780654a0 0x7f38781444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780b2430 con 0x7f3878060040 2021-11-15T14:34:37.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780b26d0 con 0x7f38780b3950 2021-11-15T14:34:37.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f387df32700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780b2970 con 0x7f38780654a0 2021-11-15T14:34:37.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3877fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f38780b3950 0x7f38781449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42888/0 (socket says 172.21.2.135:42888) 2021-11-15T14:34:37.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3877fff700 1 -- 172.21.2.135:0/1339778684 learned_addr learned my addr 172.21.2.135:0/1339778684 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:37.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3876ffd700 1 --2- 172.21.2.135:0/1339778684 >> v2:172.21.2.135:3300/0 conn(0x7f38780654a0 0x7f38781444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3876ffd700 1 -- 172.21.2.135:0/1339778684 >> v1:172.21.2.135:6789/0 conn(0x7f38780b3950 legacy=0x7f38781449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3876ffd700 1 -- 172.21.2.135:0/1339778684 >> v1:172.21.2.119:6789/0 conn(0x7f3878060040 legacy=0x7f3878064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:37.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3876ffd700 1 -- 172.21.2.135:0/1339778684 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780648f0 con 0x7f38780654a0 2021-11-15T14:34:37.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f3876ffd700 1 --2- 172.21.2.135:0/1339778684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f38781444c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f387813b870 tx=0x7f3868006df0).ready entity=mon.1 client_cookie=c04d3b7c9bc73d3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.981+0000 7f38767fc700 1 -- 172.21.2.135:0/1339778684 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386800d5c0 con 0x7f38780654a0 2021-11-15T14:34:37.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f38767fc700 1 -- 172.21.2.135:0/1339778684 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868000e90 con 0x7f38780654a0 2021-11-15T14:34:37.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f38767fc700 1 -- 172.21.2.135:0/1339778684 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386800d910 con 0x7f38780654a0 2021-11-15T14:34:37.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/1339778684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 msgr2=0x7f38781444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:37.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 --2- 172.21.2.135:0/1339778684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f38781444c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f387813b870 tx=0x7f3868006df0).stop 2021-11-15T14:34:37.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/1339778684 shutdown_connections 2021-11-15T14:34:37.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 --2- 172.21.2.135:0/1339778684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f38781444c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:37.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/1339778684 >> 172.21.2.135:0/1339778684 conn(0x7f387805cfe0 msgr2=0x7f387805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:37.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/1339778684 shutdown_connections 2021-11-15T14:34:37.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/1339778684 wait complete. 2021-11-15T14:34:37.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 Processor -- start 2021-11-15T14:34:37.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- start start 2021-11-15T14:34:37.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3878060040 0x7f38780ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38780b3950 0x7f3878156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:37.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780acf00 con 0x7f3878060040 2021-11-15T14:34:37.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780ad1a0 con 0x7f38780654a0 2021-11-15T14:34:37.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780ad440 con 0x7f38780b3950 2021-11-15T14:34:37.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:37.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55302/0 (socket says 172.21.2.135:55302) 2021-11-15T14:34:37.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 -- 172.21.2.135:0/3517158153 learned_addr learned my addr 172.21.2.135:0/3517158153 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:37.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 -- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38780b3950 msgr2=0x7f3878156270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:37.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38780b3950 0x7f3878156270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 -- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3878060040 msgr2=0x7f38780ab590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:37.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3878060040 0x7f38780ab590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:37.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 -- 172.21.2.135:0/3517158153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386800b180 con 0x7f38780654a0 2021-11-15T14:34:37.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3876ffd700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f387813b870 tx=0x7f3868012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:37.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3868002f50 con 0x7f38780654a0 2021-11-15T14:34:37.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868013d50 con 0x7f38780654a0 2021-11-15T14:34:37.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38780afde0 con 0x7f38780654a0 2021-11-15T14:34:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780ac5d0 con 0x7f38780654a0 2021-11-15T14:34:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f386801f640 con 0x7f38780654a0 2021-11-15T14:34:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38780ad600 con 0x7f38780654a0 2021-11-15T14:34:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f386801c070 con 0x7f38780654a0 2021-11-15T14:34:37.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 0x7f385c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.985+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f386806c9a0 con 0x7f38780654a0 2021-11-15T14:34:38.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.989+0000 7f38777fe700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 0x7f385c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:38.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.989+0000 7f38777fe700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 0x7f385c055a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3860002f90 tx=0x7f3860006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:38.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:37.989+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3868043890 con 0x7f38780654a0 2021-11-15T14:34:38.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.069+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3878060420 con 0x7f38780654a0 2021-11-15T14:34:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.069+0000 7f3874ff9700 1 -- 172.21.2.135:0/3517158153 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3868046eb0 con 0x7f38780654a0 2021-11-15T14:34:38.074 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 msgr2=0x7f385c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 0x7f385c055a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3860002f90 tx=0x7f3860006930).stop 2021-11-15T14:34:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 msgr2=0x7f3878155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f387813b870 tx=0x7f3868012000).stop 2021-11-15T14:34:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 shutdown_connections 2021-11-15T14:34:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f385c0535d0 0x7f385c055a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38780b3950 0x7f3878156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38780654a0 0x7f3878155d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 --2- 172.21.2.135:0/3517158153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3878060040 0x7f38780ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 >> 172.21.2.135:0/3517158153 conn(0x7f387805cfe0 msgr2=0x7f38780b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 shutdown_connections 2021-11-15T14:34:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.073+0000 7f387df32700 1 -- 172.21.2.135:0/3517158153 wait complete. 2021-11-15T14:34:38.081 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:34:38.082 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:38.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 Processor -- start 2021-11-15T14:34:38.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- start start 2021-11-15T14:34:38.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5f1c067380 0x7f5f1c143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c0aac30 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c060560 con 0x7f5f1c067380 2021-11-15T14:34:38.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c066f20 con 0x7f5f1c060180 2021-11-15T14:34:38.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f20ddc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5f1c0b4cc0 0x7f5f1c144590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42898/0 (socket says 172.21.2.135:42898) 2021-11-15T14:34:38.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f20ddc700 1 -- 172.21.2.135:0/2809834284 learned_addr learned my addr 172.21.2.135:0/2809834284 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:38.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 --2- 172.21.2.135:0/2809834284 >> v2:172.21.2.135:3300/0 conn(0x7f5f1c067380 0x7f5f1c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:38.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 -- 172.21.2.135:0/2809834284 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 msgr2=0x7f5f1c0b47d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:38.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 --2- 172.21.2.135:0/2809834284 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0b47d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 -- 172.21.2.135:0/2809834284 >> v1:172.21.2.135:6789/0 conn(0x7f5f1c0b4cc0 legacy=0x7f5f1c144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 -- 172.21.2.135:0/2809834284 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0b3430 con 0x7f5f1c067380 2021-11-15T14:34:38.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1b7fe700 1 --2- 172.21.2.135:0/2809834284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c067380 0x7f5f1c143970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c006df0).ready entity=mon.1 client_cookie=a9f136430e80b3e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:38.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1affd700 1 -- 172.21.2.135:0/2809834284 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c00d570 con 0x7f5f1c067380 2021-11-15T14:34:38.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1affd700 1 -- 172.21.2.135:0/2809834284 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c000e90 con 0x7f5f1c067380 2021-11-15T14:34:38.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f1affd700 1 -- 172.21.2.135:0/2809834284 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c00d900 con 0x7f5f1c067380 2021-11-15T14:34:38.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- 172.21.2.135:0/2809834284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c067380 msgr2=0x7f5f1c143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 --2- 172.21.2.135:0/2809834284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c067380 0x7f5f1c143970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c006df0).stop 2021-11-15T14:34:38.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- 172.21.2.135:0/2809834284 shutdown_connections 2021-11-15T14:34:38.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 --2- 172.21.2.135:0/2809834284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c067380 0x7f5f1c143970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:38.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 --2- 172.21.2.135:0/2809834284 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- 172.21.2.135:0/2809834284 >> 172.21.2.135:0/2809834284 conn(0x7f5f1c05cfb0 msgr2=0x7f5f1c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- 172.21.2.135:0/2809834284 shutdown_connections 2021-11-15T14:34:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.129+0000 7f5f2283f700 1 -- 172.21.2.135:0/2809834284 wait complete. 2021-11-15T14:34:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 Processor -- start 2021-11-15T14:34:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- start start 2021-11-15T14:34:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f1c067380 0x7f5f1c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c150580 con 0x7f5f1c067380 2021-11-15T14:34:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0ad740 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0a2ec0 con 0x7f5f1c060180 2021-11-15T14:34:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55318/0 (socket says 172.21.2.135:55318) 2021-11-15T14:34:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 -- 172.21.2.135:0/4124064708 learned_addr learned my addr 172.21.2.135:0/4124064708 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 -- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 msgr2=0x7f5f1c0a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 -- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f1c067380 msgr2=0x7f5f1c0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f1c067380 0x7f5f1c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 -- 172.21.2.135:0/4124064708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c00b180 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f20ddc700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5f1c067260 tx=0x7f5f14007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f14005ba0 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14005d00 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c0a3160 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0adfd0 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f140072c0 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c0ad910 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f1401a070 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 0x7f5f00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5f1406af90 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.133+0000 7f5f1bfff700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 0x7f5f00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:38.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.137+0000 7f5f1bfff700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 0x7f5f00055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5f04002fb0 tx=0x7f5f040069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:38.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.137+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f14041ef0 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.241+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f1c0a32f0 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f197fa700 1 -- 172.21.2.135:0/4124064708 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f5f14045510 con 0x7f5f1c0b4cc0 2021-11-15T14:34:38.247 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:38.247 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:30.789816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2579658836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2579658836},{"type":"v1","addr":"172.21.2.135:6835","nonce":2579658836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:38.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 msgr2=0x7f5f00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 0x7f5f00055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5f04002fb0 tx=0x7f5f040069b0).stop 2021-11-15T14:34:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 msgr2=0x7f5f1c1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f5f1c067260 tx=0x7f5f14007f00).stop 2021-11-15T14:34:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 shutdown_connections 2021-11-15T14:34:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f00053610 0x7f5f00055ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f1c0b4cc0 0x7f5f1c1528d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:38.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f1c067380 0x7f5f1c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 --2- 172.21.2.135:0/4124064708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f1c060180 0x7f5f1c0a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:38.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 >> 172.21.2.135:0/4124064708 conn(0x7f5f1c05cfb0 msgr2=0x7f5f1c0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:38.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 shutdown_connections 2021-11-15T14:34:38.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:38.245+0000 7f5f2283f700 1 -- 172.21.2.135:0/4124064708 wait complete. 2021-11-15T14:34:38.251 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 6 2021-11-15T14:34:38.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:34:29.784960+0000', 'modified': '2021-11-15T14:34:30.789816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4234': {'gid': 4234, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2579658836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2579658836}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2579658836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:34:38.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:34:38.558 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:34:38.623 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":4234,"want_state":"up:active","state":"up:active","rank_uptime":8.8311405109999992,"mdsmap_epoch":6,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":14.028170319999999} 2021-11-15T14:34:38.623 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 4234, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 8.831140511, "state": "up:active", "uptime": 14.02817032, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:34:38.624 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:34:38.624 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:34:38.624 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:34:38.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:38.625 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:38.635 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:34:38.646 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:38.647 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:38.653 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:38.654 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:38.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:38.655 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:34:38.659 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:34:38.659 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:38.704 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:34:38.714 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:38.714 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:38.719 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:38.720 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:38.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:38.720 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:34:38.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:34:38.756+0000 7f3243833080 -1 init, newargv = 0x55cd3e2430e0 newargc=9 2021-11-15T14:34:38.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[13947]: starting ceph client 2021-11-15T14:34:38.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[13947]: starting fuse 2021-11-15T14:34:39.866 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:34:39.878 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:39.879 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:39.930 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:39.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:39.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:39.932 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:34:39.938 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:34:39.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:34:39.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:39.939 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:34:39.939 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:34:39.939 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:34:39.940 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:34:39.940 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:34:39.940 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:34:39.941 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:34:39.941 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:34:39.941 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:34:39.941 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:34:39.942 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:34:39.942 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:34:39.942 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:34:39.943 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:34:39.943 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:34:39.943 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:34:39.944 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:34:39.944 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:34:39.944 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:34:39.944 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:34:39.945 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:34:39.945 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:34:39.945 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:34:39.979 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.13947.asok 2021-11-15T14:34:39.982 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13947.asok 2021-11-15T14:34:39.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:39.982 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13947.asok status 2021-11-15T14:34:40.029 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:34:40.029 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:34:40.030 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:34:40.030 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:34:40.030 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:34:40.030 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:34:40.030 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:34:40.031 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "13947", 2021-11-15T14:34:40.031 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:34:40.031 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:34:40.031 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:34:40.032 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:34:40.032 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4615, 2021-11-15T14:34:40.032 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:34:40.032 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:34:40.032 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:34:40.033 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4615 2021-11-15T14:34:40.033 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:34:40.033 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:34:40.033 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:34:40.033 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:34:40.034 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2433310421 2021-11-15T14:34:40.034 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:34:40.034 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:34:40.034 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:34:40.034 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:34:40.035 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:34:40.035 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2433310421 2021-11-15T14:34:40.035 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:34:40.035 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4615 172.21.2.138:0/2433310421", 2021-11-15T14:34:40.035 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2433310421", 2021-11-15T14:34:40.036 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:34:40.036 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 6, 2021-11-15T14:34:40.036 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 25, 2021-11-15T14:34:40.036 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:34:40.036 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:34:40.037 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:34:40.037 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:34:40.038 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:40.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 Processor -- start 2021-11-15T14:34:40.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 -- start start 2021-11-15T14:34:40.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 0x7fabb01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00b03d0 con 0x7fabb00b1e30 2021-11-15T14:34:40.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00b0670 con 0x7fabb0148420 2021-11-15T14:34:40.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabb6a3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00a9140 con 0x7fabb00b1050 2021-11-15T14:34:40.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabaf7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fabb0148420 0x7fabb00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42912/0 (socket says 172.21.2.135:42912) 2021-11-15T14:34:40.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabaf7fe700 1 -- 172.21.2.135:0/3784161697 learned_addr learned my addr 172.21.2.135:0/3784161697 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:40.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065382651 0 0) 0x7fabb00b0670 con 0x7fabb0148420 2021-11-15T14:34:40.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.089+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab90003260 con 0x7fabb0148420 2021-11-15T14:34:40.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234918472 0 0) 0x7fab90003260 con 0x7fabb0148420 2021-11-15T14:34:40.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 msgr2=0x7fabb01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 0x7fabb01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 >> v1:172.21.2.119:6789/0 conn(0x7fabb00b1e30 legacy=0x7fabb00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00b0910 con 0x7fabb0148420 2021-11-15T14:34:40.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fab98001660 con 0x7fabb0148420 2021-11-15T14:34:40.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 >> v1:172.21.2.135:6789/0 conn(0x7fabb0148420 legacy=0x7fabb00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 0x7fab90003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fab90003e20 0x7fab90004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fab90004b10 0x7fab90004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9000b930 con 0x7fab90003e20 2021-11-15T14:34:40.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9000baa0 con 0x7fab90004b10 2021-11-15T14:34:40.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9000bc60 con 0x7fabb00b1050 2021-11-15T14:34:40.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fab90004b10 0x7fab90004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 -- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 msgr2=0x7fab90003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabb00b1050 0x7fab90003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 -- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fab90003e20 msgr2=0x7fab90004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fab90003e20 0x7fab90004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 -- 172.21.2.135:0/3784161697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90003260 con 0x7fab90004b10 2021-11-15T14:34:40.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fab90004b10 0x7fab90004f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7faba80032f0 tx=0x7faba8006f90).ready entity=mon.1 client_cookie=82c73f4fc3004d2b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba800b460 con 0x7fab90004b10 2021-11-15T14:34:40.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba800b5c0 con 0x7fab90004b10 2021-11-15T14:34:40.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaeffd700 1 -- 172.21.2.135:0/3784161697 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba800b730 con 0x7fab90004b10 2021-11-15T14:34:40.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3784161697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fab90004b10 msgr2=0x7fab90004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3784161697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fab90004b10 0x7fab90004f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7faba80032f0 tx=0x7faba8006f90).stop 2021-11-15T14:34:40.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb4fda700 1 -- 172.21.2.135:0/3784161697 reap_dead start 2021-11-15T14:34:40.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3784161697 shutdown_connections 2021-11-15T14:34:40.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3784161697 >> 172.21.2.135:0/3784161697 conn(0x7fabb005f730 msgr2=0x7fabb005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3784161697 shutdown_connections 2021-11-15T14:34:40.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3784161697 wait complete. 2021-11-15T14:34:40.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 Processor -- start 2021-11-15T14:34:40.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- start start 2021-11-15T14:34:40.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fab90004b10 0x7fabb014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabb00aac60 0x7fabb00a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00a9560 con 0x7fabb00aac60 2021-11-15T14:34:40.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00ab7c0 con 0x7fabb0062840 2021-11-15T14:34:40.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0157330 con 0x7fab90004b10 2021-11-15T14:34:40.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55336/0 (socket says 172.21.2.135:55336) 2021-11-15T14:34:40.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 -- 172.21.2.135:0/3744643431 learned_addr learned my addr 172.21.2.135:0/3744643431 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 -- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fab90004b10 msgr2=0x7fabb014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fab90004b10 0x7fabb014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 -- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabb00aac60 msgr2=0x7fabb00a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabb00aac60 0x7fabb00a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 -- 172.21.2.135:0/3744643431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0157050 con 0x7fabb0062840 2021-11-15T14:34:40.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabaf7fe700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fabb01477b0 tx=0x7fabb00b0560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab98007170 con 0x7fabb0062840 2021-11-15T14:34:40.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab980072d0 con 0x7fabb0062840 2021-11-15T14:34:40.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb01575d0 con 0x7fabb0062840 2021-11-15T14:34:40.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab98004920 con 0x7fabb0062840 2021-11-15T14:34:40.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.093+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb00aa860 con 0x7fabb0062840 2021-11-15T14:34:40.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb00a96d0 con 0x7fabb0062840 2021-11-15T14:34:40.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab9801b070 con 0x7fabb0062840 2021-11-15T14:34:40.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabad7fa700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 0x7fab94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fab9806b390 con 0x7fabb0062840 2021-11-15T14:34:40.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabaffff700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 0x7fab94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabaffff700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 0x7fab94055ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faba0000f70 tx=0x7faba00069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.097+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabb00a96d0 con 0x7fabb0062840 2021-11-15T14:34:40.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb00a96d0 con 0x7fabb0062840 2021-11-15T14:34:40.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabad7fa700 1 -- 172.21.2.135:0/3744643431 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fabb00a96d0 con 0x7fabb0062840 2021-11-15T14:34:40.184 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:40.184 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 msgr2=0x7fab94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 0x7fab94055ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faba0000f70 tx=0x7faba00069b0).stop 2021-11-15T14:34:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 msgr2=0x7fabb00a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fabb01477b0 tx=0x7fabb00b0560).stop 2021-11-15T14:34:40.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 shutdown_connections 2021-11-15T14:34:40.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab94053610 0x7fab94055ad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabb00aac60 0x7fabb00a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabb0062840 0x7fabb00a9990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 --2- 172.21.2.135:0/3744643431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fab90004b10 0x7fabb014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 >> 172.21.2.135:0/3744643431 conn(0x7fabb005f730 msgr2=0x7fabb00b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 shutdown_connections 2021-11-15T14:34:40.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.181+0000 7fabb6a3d700 1 -- 172.21.2.135:0/3744643431 wait complete. 2021-11-15T14:34:40.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:40.192 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:40.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 Processor -- start 2021-11-15T14:34:40.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 -- start start 2021-11-15T14:34:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa4ec060040 0x7fa4ec064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec065770 con 0x7fa4ec060040 2021-11-15T14:34:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b2430 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f314e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b26d0 con 0x7fa4ec0b3950 2021-11-15T14:34:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55346/0 (socket says 172.21.2.135:55346) 2021-11-15T14:34:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 -- 172.21.2.135:0/138564533 learned_addr learned my addr 172.21.2.135:0/138564533 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 -- 172.21.2.135:0/138564533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 msgr2=0x7fa4ec065280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 --2- 172.21.2.135:0/138564533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec065280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 -- 172.21.2.135:0/138564533 >> v2:172.21.2.119:3300/0 conn(0x7fa4ec060040 msgr2=0x7fa4ec064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 --2- 172.21.2.135:0/138564533 >> v2:172.21.2.119:3300/0 conn(0x7fa4ec060040 0x7fa4ec064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.241+0000 7fa4f16eb700 1 -- 172.21.2.135:0/138564533 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0b2970 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f16eb700 1 --2- 172.21.2.135:0/138564533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fa4e40032f0 tx=0x7fa4e4009290).ready entity=mon.1 client_cookie=2b11144cb053b316 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4eb7fe700 1 -- 172.21.2.135:0/138564533 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e400b870 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4eb7fe700 1 -- 172.21.2.135:0/138564533 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e400b9d0 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4eb7fe700 1 -- 172.21.2.135:0/138564533 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e400bb80 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/138564533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 msgr2=0x7fa4ec0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- 172.21.2.135:0/138564533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fa4e40032f0 tx=0x7fa4e4009290).stop 2021-11-15T14:34:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/138564533 shutdown_connections 2021-11-15T14:34:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- 172.21.2.135:0/138564533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b4090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- 172.21.2.135:0/138564533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- 172.21.2.135:0/138564533 >> v2:172.21.2.119:3300/0 conn(0x7fa4ec060040 0x7fa4ec064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/138564533 >> 172.21.2.135:0/138564533 conn(0x7fa4ec05cfe0 msgr2=0x7fa4ec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/138564533 shutdown_connections 2021-11-15T14:34:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/138564533 wait complete. 2021-11-15T14:34:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 Processor -- start 2021-11-15T14:34:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- start start 2021-11-15T14:34:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec060040 0x7fa4ec13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b1b00 con 0x7fa4ec060040 2021-11-15T14:34:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec155e60 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec13e9f0 con 0x7fa4ec0b3950 2021-11-15T14:34:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55352/0 (socket says 172.21.2.135:55352) 2021-11-15T14:34:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 -- 172.21.2.135:0/3821232682 learned_addr learned my addr 172.21.2.135:0/3821232682 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 -- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 msgr2=0x7fa4ec1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 -- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec060040 msgr2=0x7fa4ec13de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec060040 0x7fa4ec13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 -- 172.21.2.135:0/3821232682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4009530 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4ebfff700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa4ec0b1c40 tx=0x7fa4d4006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d4012410 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4012570 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec13e4b0 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d40128d0 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec13d870 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec0648f0 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4d400f030 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 0x7fa4d0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.245+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa4d406b910 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.249+0000 7fa4f0eea700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 0x7fa4d0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.249+0000 7fa4f0eea700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 0x7fa4d0055be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa4dc002f70 tx=0x7fa4dc006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.249+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4d4042800 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.329+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa4ec155fa0 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.329+0000 7fa4e9ffb700 1 -- 172.21.2.135:0/3821232682 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa4d4045e20 con 0x7fa4ec0b2ca0 2021-11-15T14:34:40.334 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:40.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 msgr2=0x7fa4d0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 0x7fa4d0055be0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa4dc002f70 tx=0x7fa4dc006a80).stop 2021-11-15T14:34:40.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 msgr2=0x7fa4ec0b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fa4ec0b1c40 tx=0x7fa4d4006d60).stop 2021-11-15T14:34:40.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 shutdown_connections 2021-11-15T14:34:40.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4d0053720 0x7fa4d0055be0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0b3950 0x7fa4ec1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec0b2ca0 0x7fa4ec0b6ac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 --2- 172.21.2.135:0/3821232682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec060040 0x7fa4ec13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 >> 172.21.2.135:0/3821232682 conn(0x7fa4ec05cfe0 msgr2=0x7fa4ec1416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 shutdown_connections 2021-11-15T14:34:40.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.333+0000 7fa4f314e700 1 -- 172.21.2.135:0/3821232682 wait complete. 2021-11-15T14:34:40.342 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:40.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.389+0000 7f08ac311700 1 Processor -- start 2021-11-15T14:34:40.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.389+0000 7f08ac311700 1 -- start start 2021-11-15T14:34:40.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f08a40b4200 0x7f08a41409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 0x7f08a40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a4143be0 con 0x7f08a41469d0 2021-11-15T14:34:40.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a4147590 con 0x7f08a40b4200 2021-11-15T14:34:40.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4143e80 con 0x7f08a40b4710 2021-11-15T14:34:40.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f08a41469d0 0x7f08a41402b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42946/0 (socket says 172.21.2.135:42946) 2021-11-15T14:34:40.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2364503780 learned_addr learned my addr 172.21.2.135:0/2364503780 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:40.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401919539 0 0) 0x7f08a4143be0 con 0x7f08a41469d0 2021-11-15T14:34:40.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c003260 con 0x7f08a41469d0 2021-11-15T14:34:40.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1166161449 0 0) 0x7f088c003260 con 0x7f08a41469d0 2021-11-15T14:34:40.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 msgr2=0x7f08a40b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 0x7f08a40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 >> v2:172.21.2.119:3300/0 conn(0x7f08a40b4200 msgr2=0x7f08a41409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 --2- 172.21.2.135:0/2364503780 >> v2:172.21.2.119:3300/0 conn(0x7f08a40b4200 0x7f08a41409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40b0d10 con 0x7f08a41469d0 2021-11-15T14:34:40.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0898001660 con 0x7f08a41469d0 2021-11-15T14:34:40.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 >> v1:172.21.2.135:6789/0 conn(0x7f08a41469d0 legacy=0x7f08a41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f088c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f088c004500 0x7f088c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 0x7f088c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4147590 con 0x7f088c004500 2021-11-15T14:34:40.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4143e80 con 0x7f088c0037d0 2021-11-15T14:34:40.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c005360 con 0x7f08a40b4710 2021-11-15T14:34:40.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f088c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 msgr2=0x7f088c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40b4710 0x7f088c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f088c004500 msgr2=0x7f088c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f088c004500 0x7f088c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2364503780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40b0d10 con 0x7f088c0037d0 2021-11-15T14:34:40.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f088c003bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0898001370 tx=0x7f0898001e40).ready entity=mon.1 client_cookie=69d9ce3e0d810cbe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08980070d0 con 0x7f088c0037d0 2021-11-15T14:34:40.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898007230 con 0x7f088c0037d0 2021-11-15T14:34:40.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08a90ab700 1 -- 172.21.2.135:0/2364503780 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f089800c980 con 0x7f088c0037d0 2021-11-15T14:34:40.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2364503780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 msgr2=0x7f088c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- 172.21.2.135:0/2364503780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f088c003bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0898001370 tx=0x7f0898001e40).stop 2021-11-15T14:34:40.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa8ae700 1 -- 172.21.2.135:0/2364503780 reap_dead start 2021-11-15T14:34:40.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2364503780 shutdown_connections 2021-11-15T14:34:40.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2364503780 >> 172.21.2.135:0/2364503780 conn(0x7f08a405c510 msgr2=0x7f08a405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2364503780 shutdown_connections 2021-11-15T14:34:40.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2364503780 wait complete. 2021-11-15T14:34:40.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 Processor -- start 2021-11-15T14:34:40.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- start start 2021-11-15T14:34:40.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a40b84a0 0x7f08a414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40aedc0 0x7f08a414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40adae0 con 0x7f08a40b84a0 2021-11-15T14:34:40.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4153080 con 0x7f088c0037d0 2021-11-15T14:34:40.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4153320 con 0x7f08a40aedc0 2021-11-15T14:34:40.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55370/0 (socket says 172.21.2.135:55370) 2021-11-15T14:34:40.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2114502672 learned_addr learned my addr 172.21.2.135:0/2114502672 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40aedc0 msgr2=0x7f08a414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40aedc0 0x7f08a414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a40b84a0 msgr2=0x7f08a414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a40b84a0 0x7f08a414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 -- 172.21.2.135:0/2114502672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40b7a90 con 0x7f088c0037d0 2021-11-15T14:34:40.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08aa0ad700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f08a40b03f0 tx=0x7f0898015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0898001ba0 con 0x7f088c0037d0 2021-11-15T14:34:40.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898004920 con 0x7f088c0037d0 2021-11-15T14:34:40.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a40b7f30 con 0x7f088c0037d0 2021-11-15T14:34:40.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0898004c80 con 0x7f088c0037d0 2021-11-15T14:34:40.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.393+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a40af290 con 0x7f088c0037d0 2021-11-15T14:34:40.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a41534e0 con 0x7f088c0037d0 2021-11-15T14:34:40.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0898025020 con 0x7f088c0037d0 2021-11-15T14:34:40.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08977fe700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 0x7f0884055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f089806c780 con 0x7f088c0037d0 2021-11-15T14:34:40.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08a98ac700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 0x7f0884055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08a98ac700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 0x7f0884055b00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08a0002f70 tx=0x7f08a0006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.397+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0898043780 con 0x7f088c0037d0 2021-11-15T14:34:40.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08a40573d0 con 0x7f088c0037d0 2021-11-15T14:34:40.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08977fe700 1 -- 172.21.2.135:0/2114502672 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f089801a030 con 0x7f088c0037d0 2021-11-15T14:34:40.485 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:40.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 msgr2=0x7f0884055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 0x7f0884055b00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08a0002f70 tx=0x7f08a0006a80).stop 2021-11-15T14:34:40.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 msgr2=0x7f08a40ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f08a40b03f0 tx=0x7f0898015000).stop 2021-11-15T14:34:40.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 shutdown_connections 2021-11-15T14:34:40.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0884053640 0x7f0884055b00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08a40aedc0 0x7f08a414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08a40b84a0 0x7f08a414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 --2- 172.21.2.135:0/2114502672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f088c0037d0 0x7f08a40ae8d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 >> 172.21.2.135:0/2114502672 conn(0x7f08a405c510 msgr2=0x7f08a413b320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 shutdown_connections 2021-11-15T14:34:40.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.481+0000 7f08ac311700 1 -- 172.21.2.135:0/2114502672 wait complete. 2021-11-15T14:34:40.492 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:40.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 Processor -- start 2021-11-15T14:34:40.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- start start 2021-11-15T14:34:40.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7febbc0b3950 0x7febbc144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febbc0b2430 con 0x7febbc0654a0 2021-11-15T14:34:40.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febbc0b26d0 con 0x7febbc060040 2021-11-15T14:34:40.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc0b2970 con 0x7febbc0b3950 2021-11-15T14:34:40.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7febbc060040 0x7febbc064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:42966/0 (socket says 172.21.2.135:42966) 2021-11-15T14:34:40.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 -- 172.21.2.135:0/3496690885 learned_addr learned my addr 172.21.2.135:0/3496690885 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:40.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824838018 0 0) 0x7febbc0b26d0 con 0x7febbc060040 2021-11-15T14:34:40.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba8003260 con 0x7febbc060040 2021-11-15T14:34:40.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc0d09700 1 --2- 172.21.2.135:0/3496690885 >> v2:172.21.2.119:3300/0 conn(0x7febbc0b3950 0x7febbc144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 884427335 0 0) 0x7feba8003260 con 0x7febbc060040 2021-11-15T14:34:40.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 >> v2:172.21.2.119:3300/0 conn(0x7febbc0b3950 msgr2=0x7febbc144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 --2- 172.21.2.135:0/3496690885 >> v2:172.21.2.119:3300/0 conn(0x7febbc0b3950 0x7febbc144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 >> v1:172.21.2.119:6789/0 conn(0x7febbc0654a0 legacy=0x7febbc1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0648f0 con 0x7febbc060040 2021-11-15T14:34:40.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7febb0001660 con 0x7febbc060040 2021-11-15T14:34:40.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 >> v1:172.21.2.135:6789/0 conn(0x7febbc060040 legacy=0x7febbc064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 0x7feba8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8004500 0x7feba8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feba8004ec0 0x7feba800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0b2970 con 0x7feba8004500 2021-11-15T14:34:40.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba800bd80 con 0x7feba8003750 2021-11-15T14:34:40.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba800bf40 con 0x7feba8004ec0 2021-11-15T14:34:40.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 0x7feba8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 -- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feba8004ec0 msgr2=0x7feba800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feba8004ec0 0x7feba800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 -- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8004500 msgr2=0x7feba8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8004500 0x7feba8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 -- 172.21.2.135:0/3496690885 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8003260 con 0x7feba8003750 2021-11-15T14:34:40.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc0d09700 1 -- 172.21.2.135:0/3496690885 reap_dead start 2021-11-15T14:34:40.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbbfff700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 0x7feba8003b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7febbc13b870 tx=0x7febbc064a80).ready entity=mon.1 client_cookie=10ab450c75d7addd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb00070d0 con 0x7feba8003750 2021-11-15T14:34:40.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0007230 con 0x7feba8003750 2021-11-15T14:34:40.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febbaffd700 1 -- 172.21.2.135:0/3496690885 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb000c9c0 con 0x7feba8003750 2021-11-15T14:34:40.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 msgr2=0x7feba8003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 0x7feba8003b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7febbc13b870 tx=0x7febbc064a80).stop 2021-11-15T14:34:40.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- 172.21.2.135:0/3496690885 shutdown_connections 2021-11-15T14:34:40.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 --2- 172.21.2.135:0/3496690885 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feba8003750 0x7feba8003b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- 172.21.2.135:0/3496690885 >> 172.21.2.135:0/3496690885 conn(0x7febbc05cfe0 msgr2=0x7febbc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- 172.21.2.135:0/3496690885 shutdown_connections 2021-11-15T14:34:40.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.541+0000 7febc276c700 1 -- 172.21.2.135:0/3496690885 wait complete. 2021-11-15T14:34:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 Processor -- start 2021-11-15T14:34:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- start start 2021-11-15T14:34:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8003750 0x7febbc061f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7febbc0ad8c0 0x7febbc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0af000 con 0x7feba8003750 2021-11-15T14:34:40.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0ae370 con 0x7febbc1561d0 2021-11-15T14:34:40.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0af250 con 0x7febbc0ad8c0 2021-11-15T14:34:40.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55392/0 (socket says 172.21.2.135:55392) 2021-11-15T14:34:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 -- 172.21.2.135:0/3194647417 learned_addr learned my addr 172.21.2.135:0/3194647417 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 -- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7febbc0ad8c0 msgr2=0x7febbc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7febbc0ad8c0 0x7febbc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 -- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8003750 msgr2=0x7febbc061f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8003750 0x7febbc061f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 -- 172.21.2.135:0/3194647417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc062540 con 0x7febbc1561d0 2021-11-15T14:34:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc0d09700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7febac000b60 tx=0x7febac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febac013670 con 0x7febbc1561d0 2021-11-15T14:34:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0137d0 con 0x7febbc1561d0 2021-11-15T14:34:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febac013b30 con 0x7febbc1561d0 2021-11-15T14:34:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc0aebc0 con 0x7febbc1561d0 2021-11-15T14:34:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc156650 con 0x7febbc1561d0 2021-11-15T14:34:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc0626d0 con 0x7febbc1561d0 2021-11-15T14:34:40.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febac0125f0 con 0x7febbc1561d0 2021-11-15T14:34:40.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 0x7feb9c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7febac06bd00 con 0x7febbc1561d0 2021-11-15T14:34:40.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.545+0000 7febbbfff700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 0x7feb9c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.549+0000 7febbbfff700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 0x7feb9c055a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7febbc13b870 tx=0x7febb0013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.549+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febac06f030 con 0x7febbc1561d0 2021-11-15T14:34:40.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.629+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febbc0674f0 con 0x7febbc1561d0 2021-11-15T14:34:40.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.629+0000 7febb97fa700 1 -- 172.21.2.135:0/3194647417 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7febac042ca0 con 0x7febbc1561d0 2021-11-15T14:34:40.634 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:40.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 msgr2=0x7feb9c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 0x7feb9c055a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7febbc13b870 tx=0x7febb0013000).stop 2021-11-15T14:34:40.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 msgr2=0x7febbc060840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7febac000b60 tx=0x7febac008040).stop 2021-11-15T14:34:40.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 shutdown_connections 2021-11-15T14:34:40.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb9c0535b0 0x7feb9c055a70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7febbc1561d0 0x7febbc060840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7febbc0ad8c0 0x7febbc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 --2- 172.21.2.135:0/3194647417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feba8003750 0x7febbc061f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 >> 172.21.2.135:0/3194647417 conn(0x7febbc05cfe0 msgr2=0x7febbc1407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 shutdown_connections 2021-11-15T14:34:40.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.633+0000 7febc276c700 1 -- 172.21.2.135:0/3194647417 wait complete. 2021-11-15T14:34:40.642 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 Processor -- start 2021-11-15T14:34:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- start start 2021-11-15T14:34:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb0f40b4200 0x7fb0f41409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f4143be0 con 0x7fb0f40b4710 2021-11-15T14:34:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f4143e80 con 0x7fb0f41469d0 2021-11-15T14:34:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4147590 con 0x7fb0f40b4200 2021-11-15T14:34:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb0f40b4200 0x7fb0f41409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb0f40b4200 0x7fb0f41409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55400/0 (socket says 172.21.2.135:55400) 2021-11-15T14:34:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 -- 172.21.2.135:0/2749353343 learned_addr learned my addr 172.21.2.135:0/2749353343 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 -- 172.21.2.135:0/2749353343 >> v1:172.21.2.135:6789/0 conn(0x7fb0f41469d0 legacy=0x7fb0f41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 -- 172.21.2.135:0/2749353343 >> v1:172.21.2.119:6789/0 conn(0x7fb0f40b4710 legacy=0x7fb0f40b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 -- 172.21.2.135:0/2749353343 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40b0d10 con 0x7fb0f40b4200 2021-11-15T14:34:40.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0e9d9b700 1 --2- 172.21.2.135:0/2749353343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f41409c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb0f4060cd0 tx=0x7fb0e4006eb0).ready entity=mon.1 client_cookie=470631eb3356fe61 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f1d9b700 1 -- 172.21.2.135:0/2749353343 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e400d610 con 0x7fb0f40b4200 2021-11-15T14:34:40.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f1d9b700 1 -- 172.21.2.135:0/2749353343 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e4000e90 con 0x7fb0f40b4200 2021-11-15T14:34:40.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f1d9b700 1 -- 172.21.2.135:0/2749353343 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e400d960 con 0x7fb0f40b4200 2021-11-15T14:34:40.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- 172.21.2.135:0/2749353343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 msgr2=0x7fb0f41409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/2749353343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f41409c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb0f4060cd0 tx=0x7fb0e4006eb0).stop 2021-11-15T14:34:40.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- 172.21.2.135:0/2749353343 shutdown_connections 2021-11-15T14:34:40.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/2749353343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f41409c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- 172.21.2.135:0/2749353343 >> 172.21.2.135:0/2749353343 conn(0x7fb0f405c510 msgr2=0x7fb0f405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- 172.21.2.135:0/2749353343 shutdown_connections 2021-11-15T14:34:40.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- 172.21.2.135:0/2749353343 wait complete. 2021-11-15T14:34:40.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 Processor -- start 2021-11-15T14:34:40.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- start start 2021-11-15T14:34:40.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0f40b4710 0x7fb0f40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0f41469d0 0x7fb0f40ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4152500 con 0x7fb0f40b4710 2021-11-15T14:34:40.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40af160 con 0x7fb0f40b4200 2021-11-15T14:34:40.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f8e51700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40adca0 con 0x7fb0f41469d0 2021-11-15T14:34:40.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55406/0 (socket says 172.21.2.135:55406) 2021-11-15T14:34:40.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 -- 172.21.2.135:0/641433469 learned_addr learned my addr 172.21.2.135:0/641433469 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 -- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0f41469d0 msgr2=0x7fb0f40ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0f41469d0 0x7fb0f40ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 -- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0f40b4710 msgr2=0x7fb0f40aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0f40b4710 0x7fb0f40aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 -- 172.21.2.135:0/641433469 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e400b1e0 con 0x7fb0f40b4200 2021-11-15T14:34:40.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0f259c700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb0f4060d10 tx=0x7fb0dc007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0dc00ce30 con 0x7fb0f40b4200 2021-11-15T14:34:40.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.693+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00f470 con 0x7fb0f40b4200 2021-11-15T14:34:40.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f41526f0 con 0x7fb0f40b4200 2021-11-15T14:34:40.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0dc00f7d0 con 0x7fb0f40b4200 2021-11-15T14:34:40.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f40ae730 con 0x7fb0f40b4200 2021-11-15T14:34:40.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40573d0 con 0x7fb0f40b4200 2021-11-15T14:34:40.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0dc019030 con 0x7fb0f40b4200 2021-11-15T14:34:40.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0ebfff700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 0x7fb0d8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb0dc06aee0 con 0x7fb0f40b4200 2021-11-15T14:34:40.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0e9d9b700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 0x7fb0d8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0e9d9b700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 0x7fb0d8055a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb0f4060cd0 tx=0x7fb0e4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.697+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0dc041ee0 con 0x7fb0f40b4200 2021-11-15T14:34:40.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0f4069960 con 0x7fb0f40b4200 2021-11-15T14:34:40.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0ebfff700 1 -- 172.21.2.135:0/641433469 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb0dc045500 con 0x7fb0f40b4200 2021-11-15T14:34:40.785 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:40.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 msgr2=0x7fb0d8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 0x7fb0d8055a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb0f4060cd0 tx=0x7fb0e4015000).stop 2021-11-15T14:34:40.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 msgr2=0x7fb0f40afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb0f4060d10 tx=0x7fb0dc007c50).stop 2021-11-15T14:34:40.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 shutdown_connections 2021-11-15T14:34:40.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb0d8053580 0x7fb0d8055a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0f41469d0 0x7fb0f40ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0f40b4710 0x7fb0f40aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 --2- 172.21.2.135:0/641433469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb0f40b4200 0x7fb0f40afd70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.781+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 >> 172.21.2.135:0/641433469 conn(0x7fb0f405c510 msgr2=0x7fb0f413def0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.785+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 shutdown_connections 2021-11-15T14:34:40.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.785+0000 7fb0f8e51700 1 -- 172.21.2.135:0/641433469 wait complete. 2021-11-15T14:34:40.792 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:34:40.792 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:40.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 Processor -- start 2021-11-15T14:34:40.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- start start 2021-11-15T14:34:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0960060180 0x7f09600b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0960067380 0x7f0960143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09600b4cc0 0x7f0960143e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09600aac30 con 0x7f0960067380 2021-11-15T14:34:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0960060560 con 0x7f0960060180 2021-11-15T14:34:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960066f20 con 0x7f09600b4cc0 2021-11-15T14:34:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0960060180 0x7f09600b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0960060180 0x7f09600b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55414/0 (socket says 172.21.2.135:55414) 2021-11-15T14:34:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/3859042681 learned_addr learned my addr 172.21.2.135:0/3859042681 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/3859042681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09600b4cc0 msgr2=0x7f0960143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/3859042681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09600b4cc0 0x7f0960143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/3859042681 >> v2:172.21.2.119:3300/0 conn(0x7f0960067380 msgr2=0x7f0960143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:40.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/3859042681 >> v2:172.21.2.119:3300/0 conn(0x7f0960067380 0x7f0960143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/3859042681 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960144350 con 0x7f0960060180 2021-11-15T14:34:40.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/3859042681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b47d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f095c002f70 tx=0x7f095c006eb0).ready entity=mon.1 client_cookie=55b406726557d31b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09648ef700 1 -- 172.21.2.135:0/3859042681 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c00d570 con 0x7f0960060180 2021-11-15T14:34:40.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09648ef700 1 -- 172.21.2.135:0/3859042681 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c000e90 con 0x7f0960060180 2021-11-15T14:34:40.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09648ef700 1 -- 172.21.2.135:0/3859042681 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c00d900 con 0x7f0960060180 2021-11-15T14:34:40.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/3859042681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 msgr2=0x7f09600b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- 172.21.2.135:0/3859042681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b47d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f095c002f70 tx=0x7f095c006eb0).stop 2021-11-15T14:34:40.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/3859042681 shutdown_connections 2021-11-15T14:34:40.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- 172.21.2.135:0/3859042681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09600b4cc0 0x7f0960143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- 172.21.2.135:0/3859042681 >> v2:172.21.2.119:3300/0 conn(0x7f0960067380 0x7f0960143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- 172.21.2.135:0/3859042681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b47d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/3859042681 >> 172.21.2.135:0/3859042681 conn(0x7f096005cfb0 msgr2=0x7f096005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/3859042681 shutdown_connections 2021-11-15T14:34:40.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/3859042681 wait complete. 2021-11-15T14:34:40.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 Processor -- start 2021-11-15T14:34:40.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- start start 2021-11-15T14:34:40.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0960067380 0x7f096013e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09600b4cc0 0x7f096013e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096013cb20 con 0x7f09600b4cc0 2021-11-15T14:34:40.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600ae590 con 0x7f0960060180 2021-11-15T14:34:40.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600ae7c0 con 0x7f0960067380 2021-11-15T14:34:40.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55418/0 (socket says 172.21.2.135:55418) 2021-11-15T14:34:40.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/540531687 learned_addr learned my addr 172.21.2.135:0/540531687 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:40.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0960067380 msgr2=0x7f096013e020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:40.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0960067380 0x7f096013e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09600b4cc0 msgr2=0x7f096013e510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:40.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09600b4cc0 0x7f096013e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 -- 172.21.2.135:0/540531687 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c00b1e0 con 0x7f0960060180 2021-11-15T14:34:40.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f09658f1700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f096013cc60 tx=0x7f095c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c00de60 con 0x7f0960060180 2021-11-15T14:34:40.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c006b60 con 0x7f0960060180 2021-11-15T14:34:40.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600aea60 con 0x7f0960060180 2021-11-15T14:34:40.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c011e90 con 0x7f0960060180 2021-11-15T14:34:40.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.845+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09601409d0 con 0x7f0960060180 2021-11-15T14:34:40.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096013d9e0 con 0x7f0960060180 2021-11-15T14:34:40.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f095c025030 con 0x7f0960060180 2021-11-15T14:34:40.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f0952ffd700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 0x7f09400559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:40.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f095c06cd90 con 0x7f0960060180 2021-11-15T14:34:40.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f09650f0700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 0x7f09400559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:40.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f09650f0700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 0x7f09400559b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0954002f70 tx=0x7f0954006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:40.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.849+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f096013d9e0 con 0x7f0960060180 2021-11-15T14:34:40.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.957+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f096013dd80 con 0x7f0960060180 2021-11-15T14:34:40.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.957+0000 7f0952ffd700 1 -- 172.21.2.135:0/540531687 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f096013dd80 con 0x7f0960060180 2021-11-15T14:34:40.962 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:40.962 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:30.789816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2579658836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2579658836},{"type":"v1","addr":"172.21.2.135:6835","nonce":2579658836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:40.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 msgr2=0x7f09400559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 0x7f09400559b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0954002f70 tx=0x7f0954006a00).stop 2021-11-15T14:34:40.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 msgr2=0x7f09600b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:40.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f096013cc60 tx=0x7f095c015000).stop 2021-11-15T14:34:40.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 shutdown_connections 2021-11-15T14:34:40.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f09400534f0 0x7f09400559b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09600b4cc0 0x7f096013e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0960067380 0x7f096013e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:40.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 --2- 172.21.2.135:0/540531687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0960060180 0x7f09600b68d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:40.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 >> 172.21.2.135:0/540531687 conn(0x7f096005cfb0 msgr2=0x7f09600b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:40.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 shutdown_connections 2021-11-15T14:34:40.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:40.961+0000 7f0967b55700 1 -- 172.21.2.135:0/540531687 wait complete. 2021-11-15T14:34:40.966 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 6 2021-11-15T14:34:41.253 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:41.256 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:41.260 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:41.263 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:34:41.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:34:29.784960+0000', 'modified': '2021-11-15T14:34:30.789816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4234': {'gid': 4234, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2579658836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2579658836}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2579658836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:34:41.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:34:41.271 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:34:41.330 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":4234,"want_state":"up:active","state":"up:active","rank_uptime":11.538660162999999,"mdsmap_epoch":6,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":16.735692186000001} 2021-11-15T14:34:41.331 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 4234, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 11.538660163, "state": "up:active", "uptime": 16.735692186, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:34:41.331 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:34:41.331 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:34:41.332 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:34:41.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:41.332 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:41.339 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:34:41.357 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:41.358 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:41.378 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:41.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:41.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:41.381 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:34:41.390 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:34:41.390 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:41.435 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:34:41.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:41.446 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:41.451 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:41.451 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:41.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:41.452 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:34:41.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:34:41.475+0000 7efc4c530080 -1 init, newargv = 0x55e5f5e51ca0 newargc=9 2021-11-15T14:34:41.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[13995]: starting ceph client 2021-11-15T14:34:41.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[13995]: starting fuse 2021-11-15T14:34:42.588 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:34:42.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:34:42.601 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:34:42.651 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:34:42.652 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:34:42.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.653 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:34:42.658 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:34:42.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:34:42.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.659 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:34:42.660 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:34:42.660 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:34:42.660 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:34:42.661 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:34:42.661 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:34:42.661 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:34:42.662 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:34:42.662 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:34:42.662 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:34:42.662 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:34:42.663 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:34:42.663 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:34:42.663 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:34:42.664 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:34:42.664 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:34:42.664 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:34:42.665 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:34:42.665 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:34:42.665 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:34:42.665 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:34:42.666 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:34:42.666 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:34:42.694 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.13995.asok 2021-11-15T14:34:42.697 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13995.asok 2021-11-15T14:34:42.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.697 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13995.asok status 2021-11-15T14:34:42.818 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:34:42.818 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:34:42.818 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:34:42.819 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:34:42.819 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:34:42.819 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:34:42.819 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:34:42.819 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "13995", 2021-11-15T14:34:42.820 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:34:42.820 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:34:42.820 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:34:42.820 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:34:42.820 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 4663, 2021-11-15T14:34:42.821 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:34:42.821 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:34:42.821 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:34:42.821 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 4663 2021-11-15T14:34:42.821 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:34:42.822 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:34:42.822 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:34:42.822 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:34:42.822 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3315602898 2021-11-15T14:34:42.823 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:34:42.823 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:34:42.823 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:34:42.823 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:34:42.823 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3315602898 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.4663 172.21.2.132:0/3315602898", 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3315602898", 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:34:42.824 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 6, 2021-11-15T14:34:42.825 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 25, 2021-11-15T14:34:42.825 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:34:42.825 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:34:42.825 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:34:42.826 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:34:42.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.827 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:42.827 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:42.839 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:34:42.840 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:34:42.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.841 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:42.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.860 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:42.860 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:42.865 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:34:42.865 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:34:42.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:42.866 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:42.884 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-11-15T14:34:42.903 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:42.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 Processor -- start 2021-11-15T14:34:42.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 -- start start 2021-11-15T14:34:42.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2b580b1e30 0x7f2b580b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2b58148420 0x7f2b580b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b580b03d0 con 0x7f2b580a7140 2021-11-15T14:34:42.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580a9140 con 0x7f2b58148420 2021-11-15T14:34:42.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b5d412700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580b0670 con 0x7f2b580b1e30 2021-11-15T14:34:42.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b56ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2b580b1e30 0x7f2b580b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:42.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b56ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2b580b1e30 0x7f2b580b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55426/0 (socket says 172.21.2.135:55426) 2021-11-15T14:34:42.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.953+0000 7f2b56ffd700 1 -- 172.21.2.135:0/834606751 learned_addr learned my addr 172.21.2.135:0/834606751 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:42.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/834606751 >> v2:172.21.2.119:3300/0 conn(0x7f2b58148420 msgr2=0x7f2b580b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:42.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- 172.21.2.135:0/834606751 >> v2:172.21.2.119:3300/0 conn(0x7f2b58148420 0x7f2b580b2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:42.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/834606751 >> v1:172.21.2.119:6789/0 conn(0x7f2b580a7140 legacy=0x7f2b581447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:42.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/834606751 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580b0910 con 0x7f2b580b1e30 2021-11-15T14:34:42.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- 172.21.2.135:0/834606751 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580b1e30 0x7f2b580b1050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2b580acee0 tx=0x7f2b40006eb0).ready entity=mon.1 client_cookie=d33dc863ad6a406e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:42.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b55ffb700 1 -- 172.21.2.135:0/834606751 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4000d5c0 con 0x7f2b580b1e30 2021-11-15T14:34:42.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b55ffb700 1 -- 172.21.2.135:0/834606751 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40000e90 con 0x7f2b580b1e30 2021-11-15T14:34:42.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b55ffb700 1 -- 172.21.2.135:0/834606751 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4000d950 con 0x7f2b580b1e30 2021-11-15T14:34:42.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/834606751 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580b1e30 msgr2=0x7f2b580b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:42.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- 172.21.2.135:0/834606751 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580b1e30 0x7f2b580b1050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2b580acee0 tx=0x7f2b40006eb0).stop 2021-11-15T14:34:42.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/834606751 shutdown_connections 2021-11-15T14:34:42.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- 172.21.2.135:0/834606751 >> v2:172.21.2.119:3300/0 conn(0x7f2b58148420 0x7f2b580b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:42.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- 172.21.2.135:0/834606751 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580b1e30 0x7f2b580b1050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:42.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/834606751 >> 172.21.2.135:0/834606751 conn(0x7f2b5805f730 msgr2=0x7f2b5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:42.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/834606751 shutdown_connections 2021-11-15T14:34:42.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/834606751 wait complete. 2021-11-15T14:34:42.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 Processor -- start 2021-11-15T14:34:42.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- start start 2021-11-15T14:34:42.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2b580b1e30 0x7f2b5814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2b58148420 0x7f2b5814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580aad10 con 0x7f2b580b1e30 2021-11-15T14:34:42.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580ac620 con 0x7f2b580a7140 2021-11-15T14:34:42.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5814ae00 con 0x7f2b58148420 2021-11-15T14:34:42.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55432/0 (socket says 172.21.2.135:55432) 2021-11-15T14:34:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/370732312 learned_addr learned my addr 172.21.2.135:0/370732312 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2b58148420 msgr2=0x7f2b5814b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2b58148420 0x7f2b5814b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:42.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2b580b1e30 msgr2=0x7f2b5814aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:42.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2b580b1e30 0x7f2b5814aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:42.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 -- 172.21.2.135:0/370732312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4000b1e0 con 0x7f2b580a7140 2021-11-15T14:34:42.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b56ffd700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f2b5814ba00 tx=0x7f2b40015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:42.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b40011970 con 0x7f2b580a7140 2021-11-15T14:34:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40011ad0 con 0x7f2b580a7140 2021-11-15T14:34:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b40011e30 con 0x7f2b580a7140 2021-11-15T14:34:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b580abb60 con 0x7f2b580a7140 2021-11-15T14:34:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.957+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b580af910 con 0x7f2b580a7140 2021-11-15T14:34:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b580aae60 con 0x7f2b580a7140 2021-11-15T14:34:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b40025030 con 0x7f2b580a7140 2021-11-15T14:34:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b4ffff700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 0x7f2b3c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f2b4006cfb0 con 0x7f2b580a7140 2021-11-15T14:34:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b567fc700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 0x7f2b3c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b567fc700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 0x7f2b3c055b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2b50001250 tx=0x7f2b50006c30).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:42.961+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b580aae60 con 0x7f2b580a7140 2021-11-15T14:34:43.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.041+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b580aae60 con 0x7f2b580a7140 2021-11-15T14:34:43.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b4ffff700 1 -- 172.21.2.135:0/370732312 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f2b580aae60 con 0x7f2b580a7140 2021-11-15T14:34:43.047 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:43.047 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:43.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 msgr2=0x7f2b3c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 0x7f2b3c055b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2b50001250 tx=0x7f2b50006c30).stop 2021-11-15T14:34:43.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 msgr2=0x7f2b580ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f2b5814ba00 tx=0x7f2b40015000).stop 2021-11-15T14:34:43.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 shutdown_connections 2021-11-15T14:34:43.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2b3c053660 0x7f2b3c055b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2b58148420 0x7f2b5814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2b580b1e30 0x7f2b5814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 --2- 172.21.2.135:0/370732312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2b580a7140 0x7f2b580ae1f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 >> 172.21.2.135:0/370732312 conn(0x7f2b5805f730 msgr2=0x7f2b581448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 shutdown_connections 2021-11-15T14:34:43.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.045+0000 7f2b5d412700 1 -- 172.21.2.135:0/370732312 wait complete. 2021-11-15T14:34:43.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:43.055 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:43.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 Processor -- start 2021-11-15T14:34:43.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 -- start start 2021-11-15T14:34:43.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f68b813f810 0x7f68b813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b8061a10 con 0x7f68b8060450 2021-11-15T14:34:43.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b8140190 con 0x7f68b813f810 2021-11-15T14:34:43.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68beff4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8061cb0 con 0x7f68b80a9f40 2021-11-15T14:34:43.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bd591700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f68b813f810 0x7f68b813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:36984/0 (socket says 172.21.2.135:36984) 2021-11-15T14:34:43.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 -- 172.21.2.135:0/2344858178 learned_addr learned my addr 172.21.2.135:0/2344858178 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68b7fff700 1 --1- 172.21.2.135:0/2344858178 >> v1:172.21.2.119:6789/0 conn(0x7f68b8060450 0x7f68b813cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:52448/0 (socket says 172.21.2.135:52448) 2021-11-15T14:34:43.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 -- 172.21.2.135:0/2344858178 >> v2:172.21.2.119:3300/0 conn(0x7f68b813f810 msgr2=0x7f68b813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 --2- 172.21.2.135:0/2344858178 >> v2:172.21.2.119:3300/0 conn(0x7f68b813f810 0x7f68b813fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 -- 172.21.2.135:0/2344858178 >> v1:172.21.2.119:6789/0 conn(0x7f68b8060450 legacy=0x7f68b813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.105+0000 7f68bcd90700 1 -- 172.21.2.135:0/2344858178 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8060c10 con 0x7f68b80a9f40 2021-11-15T14:34:43.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- 172.21.2.135:0/2344858178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f68a8002f70 tx=0x7f68a8006eb0).ready entity=mon.2 client_cookie=ca8051ddb2ff62bb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b77fe700 1 -- 172.21.2.135:0/2344858178 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a800d570 con 0x7f68b80a9f40 2021-11-15T14:34:43.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b77fe700 1 -- 172.21.2.135:0/2344858178 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a8000e90 con 0x7f68b80a9f40 2021-11-15T14:34:43.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b77fe700 1 -- 172.21.2.135:0/2344858178 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a800d900 con 0x7f68b80a9f40 2021-11-15T14:34:43.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/2344858178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 msgr2=0x7f68b80aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- 172.21.2.135:0/2344858178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f68a8002f70 tx=0x7f68a8006eb0).stop 2021-11-15T14:34:43.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/2344858178 shutdown_connections 2021-11-15T14:34:43.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- 172.21.2.135:0/2344858178 >> v2:172.21.2.119:3300/0 conn(0x7f68b813f810 0x7f68b813fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- 172.21.2.135:0/2344858178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b80a9f40 0x7f68b80aa320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/2344858178 >> 172.21.2.135:0/2344858178 conn(0x7f68b80b29f0 msgr2=0x7f68b80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/2344858178 shutdown_connections 2021-11-15T14:34:43.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/2344858178 wait complete. 2021-11-15T14:34:43.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 Processor -- start 2021-11-15T14:34:43.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- start start 2021-11-15T14:34:43.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68b80a9f40 0x7f68b80a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b813f810 0x7f68b8133010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8136c10 con 0x7f68b80a9f40 2021-11-15T14:34:43.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80b45c0 con 0x7f68b8060450 2021-11-15T14:34:43.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80a75f0 con 0x7f68b813f810 2021-11-15T14:34:43.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55446/0 (socket says 172.21.2.135:55446) 2021-11-15T14:34:43.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 -- 172.21.2.135:0/1341928158 learned_addr learned my addr 172.21.2.135:0/1341928158 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 -- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b813f810 msgr2=0x7f68b8133010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b813f810 0x7f68b8133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 -- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68b80a9f40 msgr2=0x7f68b80a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68b80a9f40 0x7f68b80a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 -- 172.21.2.135:0/1341928158 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a800b1e0 con 0x7f68b8060450 2021-11-15T14:34:43.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68bcd90700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f68b80ad420 tx=0x7f68a8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a8011910 con 0x7f68b8060450 2021-11-15T14:34:43.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a8011a70 con 0x7f68b8060450 2021-11-15T14:34:43.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a8011dd0 con 0x7f68b8060450 2021-11-15T14:34:43.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b80b47f0 con 0x7f68b8060450 2021-11-15T14:34:43.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.109+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b80b5b50 con 0x7f68b8060450 2021-11-15T14:34:43.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b80573d0 con 0x7f68b8060450 2021-11-15T14:34:43.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68a8025030 con 0x7f68b8060450 2021-11-15T14:34:43.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b5ffb700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 0x7f689c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f68a806cd60 con 0x7f68b8060450 2021-11-15T14:34:43.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b7fff700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 0x7f689c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b7fff700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 0x7f689c0559b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f68b805fe10 tx=0x7f68a0007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.113+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68a8043d60 con 0x7f68b8060450 2021-11-15T14:34:43.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f68b80446d0 con 0x7f68b8060450 2021-11-15T14:34:43.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68b5ffb700 1 -- 172.21.2.135:0/1341928158 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f68a8023070 con 0x7f68b8060450 2021-11-15T14:34:43.200 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:43.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 msgr2=0x7f689c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 0x7f689c0559b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f68b805fe10 tx=0x7f68a0007800).stop 2021-11-15T14:34:43.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 msgr2=0x7f68b81360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f68b80ad420 tx=0x7f68a8015000).stop 2021-11-15T14:34:43.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 shutdown_connections 2021-11-15T14:34:43.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f689c0534f0 0x7f689c0559b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68b813f810 0x7f68b8133010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68b80a9f40 0x7f68b80a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 --2- 172.21.2.135:0/1341928158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68b8060450 0x7f68b81360f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 >> 172.21.2.135:0/1341928158 conn(0x7f68b80b29f0 msgr2=0x7f68b805c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 shutdown_connections 2021-11-15T14:34:43.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.197+0000 7f68beff4700 1 -- 172.21.2.135:0/1341928158 wait complete. 2021-11-15T14:34:43.207 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:43.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 Processor -- start 2021-11-15T14:34:43.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- start start 2021-11-15T14:34:43.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f294c0b0630 0x7f294c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f294c0b3790 0x7f294c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c1439a0 con 0x7f294c13dac0 2021-11-15T14:34:43.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c143c40 con 0x7f294c0b3790 2021-11-15T14:34:43.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c143ee0 con 0x7f294c0b0630 2021-11-15T14:34:43.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f294c0b0630 0x7f294c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f294c13dac0 0x7f294c0b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43044/0 (socket says 172.21.2.135:43044) 2021-11-15T14:34:43.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294b7fe700 1 -- 172.21.2.135:0/3537483428 learned_addr learned my addr 172.21.2.135:0/3537483428 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:43.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 -- 172.21.2.135:0/3537483428 >> v2:172.21.2.119:3300/0 conn(0x7f294c0b3790 msgr2=0x7f294c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 --2- 172.21.2.135:0/3537483428 >> v2:172.21.2.119:3300/0 conn(0x7f294c0b3790 0x7f294c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 -- 172.21.2.135:0/3537483428 >> v1:172.21.2.135:6789/0 conn(0x7f294c13dac0 legacy=0x7f294c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 -- 172.21.2.135:0/3537483428 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c144180 con 0x7f294c0b0630 2021-11-15T14:34:43.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294affd700 1 --2- 172.21.2.135:0/3537483428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b0630 0x7f294c0b0a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c006df0).ready entity=mon.1 client_cookie=ee6e0fd1bdec8dc3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f2949ffb700 1 -- 172.21.2.135:0/3537483428 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c00d5c0 con 0x7f294c0b0630 2021-11-15T14:34:43.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f2949ffb700 1 -- 172.21.2.135:0/3537483428 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c000e90 con 0x7f294c0b0630 2021-11-15T14:34:43.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f2949ffb700 1 -- 172.21.2.135:0/3537483428 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c00d910 con 0x7f294c0b0630 2021-11-15T14:34:43.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- 172.21.2.135:0/3537483428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b0630 msgr2=0x7f294c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- 172.21.2.135:0/3537483428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b0630 0x7f294c0b0a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c006df0).stop 2021-11-15T14:34:43.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- 172.21.2.135:0/3537483428 shutdown_connections 2021-11-15T14:34:43.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- 172.21.2.135:0/3537483428 >> v2:172.21.2.119:3300/0 conn(0x7f294c0b3790 0x7f294c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- 172.21.2.135:0/3537483428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b0630 0x7f294c0b0a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- 172.21.2.135:0/3537483428 >> 172.21.2.135:0/3537483428 conn(0x7f294c060840 msgr2=0x7f294c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- 172.21.2.135:0/3537483428 shutdown_connections 2021-11-15T14:34:43.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- 172.21.2.135:0/3537483428 wait complete. 2021-11-15T14:34:43.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 Processor -- start 2021-11-15T14:34:43.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- start start 2021-11-15T14:34:43.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f294c0b0630 0x7f294c0aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f294c13dac0 0x7f294c132d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c064fc0 con 0x7f294c0b0630 2021-11-15T14:34:43.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0ae260 con 0x7f294c0b3790 2021-11-15T14:34:43.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f29519be700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c140ee0 con 0x7f294c13dac0 2021-11-15T14:34:43.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55460/0 (socket says 172.21.2.135:55460) 2021-11-15T14:34:43.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.257+0000 7f294a7fc700 1 -- 172.21.2.135:0/1803668717 learned_addr learned my addr 172.21.2.135:0/1803668717 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 -- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f294c13dac0 msgr2=0x7f294c132d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f294c13dac0 0x7f294c132d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 -- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f294c0b0630 msgr2=0x7f294c0aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f294c0b0630 0x7f294c0aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 -- 172.21.2.135:0/1803668717 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c00b180 con 0x7f294c0b3790 2021-11-15T14:34:43.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294a7fc700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f294c0aec00 tx=0x7f2934006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2934013460 con 0x7f294c0b3790 2021-11-15T14:34:43.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340135c0 con 0x7f294c0b3790 2021-11-15T14:34:43.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c0651f0 con 0x7f294c0b3790 2021-11-15T14:34:43.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0ae730 con 0x7f294c0b3790 2021-11-15T14:34:43.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2934013920 con 0x7f294c0b3790 2021-11-15T14:34:43.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c143620 con 0x7f294c0b3790 2021-11-15T14:34:43.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f293401a060 con 0x7f294c0b3790 2021-11-15T14:34:43.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 0x7f2930055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f293406b670 con 0x7f294c0b3790 2021-11-15T14:34:43.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294affd700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 0x7f2930055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.261+0000 7f294affd700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 0x7f2930055a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.265+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2934042500 con 0x7f294c0b3790 2021-11-15T14:34:43.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f294c0573d0 con 0x7f294c0b3790 2021-11-15T14:34:43.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f2943fff700 1 -- 172.21.2.135:0/1803668717 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2934045b20 con 0x7f294c0b3790 2021-11-15T14:34:43.349 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:43.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 msgr2=0x7f2930055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 0x7f2930055a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c014000).stop 2021-11-15T14:34:43.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 msgr2=0x7f294c132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f294c0aec00 tx=0x7f2934006e90).stop 2021-11-15T14:34:43.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 shutdown_connections 2021-11-15T14:34:43.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29300535d0 0x7f2930055a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f294c13dac0 0x7f294c132d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f294c0b3790 0x7f294c132880 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 --2- 172.21.2.135:0/1803668717 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f294c0b0630 0x7f294c0aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 >> 172.21.2.135:0/1803668717 conn(0x7f294c060840 msgr2=0x7f294c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 shutdown_connections 2021-11-15T14:34:43.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.345+0000 7f29519be700 1 -- 172.21.2.135:0/1803668717 wait complete. 2021-11-15T14:34:43.356 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:43.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 Processor -- start 2021-11-15T14:34:43.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- start start 2021-11-15T14:34:43.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19f00b1f40 0x7f19f00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00b04a0 con 0x7f19f00b2320 2021-11-15T14:34:43.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00a7850 con 0x7f19f00b0030 2021-11-15T14:34:43.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f00b06d0 con 0x7f19f00b1f40 2021-11-15T14:34:43.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19f00b1f40 0x7f19f00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19f00b1f40 0x7f19f00b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55468/0 (socket says 172.21.2.135:55468) 2021-11-15T14:34:43.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19ef7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f19f00b0030 0x7f19f00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43060/0 (socket says 172.21.2.135:43060) 2021-11-15T14:34:43.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 -- 172.21.2.135:0/116666325 learned_addr learned my addr 172.21.2.135:0/116666325 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 -- 172.21.2.135:0/116666325 >> v1:172.21.2.135:6789/0 conn(0x7f19f00b0030 legacy=0x7f19f00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 -- 172.21.2.135:0/116666325 >> v1:172.21.2.119:6789/0 conn(0x7f19f00b2320 legacy=0x7f19f01412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:43.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 -- 172.21.2.135:0/116666325 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00b0970 con 0x7f19f00b1f40 2021-11-15T14:34:43.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19effff700 1 --2- 172.21.2.135:0/116666325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b1f40 0x7f19f00b1350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f19f00ad350 tx=0x7f19d8006eb0).ready entity=mon.1 client_cookie=3fc44fc76392eae0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19eeffd700 1 -- 172.21.2.135:0/116666325 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d800d610 con 0x7f19f00b1f40 2021-11-15T14:34:43.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19eeffd700 1 -- 172.21.2.135:0/116666325 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8000e90 con 0x7f19f00b1f40 2021-11-15T14:34:43.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19eeffd700 1 -- 172.21.2.135:0/116666325 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d800d960 con 0x7f19f00b1f40 2021-11-15T14:34:43.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- 172.21.2.135:0/116666325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b1f40 msgr2=0x7f19f00b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 --2- 172.21.2.135:0/116666325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b1f40 0x7f19f00b1350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f19f00ad350 tx=0x7f19d8006eb0).stop 2021-11-15T14:34:43.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- 172.21.2.135:0/116666325 shutdown_connections 2021-11-15T14:34:43.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 --2- 172.21.2.135:0/116666325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b1f40 0x7f19f00b1350 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- 172.21.2.135:0/116666325 >> 172.21.2.135:0/116666325 conn(0x7f19f005f730 msgr2=0x7f19f005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- 172.21.2.135:0/116666325 shutdown_connections 2021-11-15T14:34:43.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- 172.21.2.135:0/116666325 wait complete. 2021-11-15T14:34:43.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 Processor -- start 2021-11-15T14:34:43.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.405+0000 7f19f6456700 1 -- start start 2021-11-15T14:34:43.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19f00b1f40 0x7f19f0145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19f00b2320 0x7f19f0146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0142e80 con 0x7f19f00b2320 2021-11-15T14:34:43.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00ab540 con 0x7f19f00b0030 2021-11-15T14:34:43.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00a9f90 con 0x7f19f00b1f40 2021-11-15T14:34:43.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55474/0 (socket says 172.21.2.135:55474) 2021-11-15T14:34:43.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 -- 172.21.2.135:0/623817299 learned_addr learned my addr 172.21.2.135:0/623817299 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 -- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19f00b1f40 msgr2=0x7f19f0145ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:43.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19f00b1f40 0x7f19f0145ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 -- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19f00b2320 msgr2=0x7f19f0146390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:43.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19f00b2320 0x7f19f0146390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 -- 172.21.2.135:0/623817299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d800b1e0 con 0x7f19f00b0030 2021-11-15T14:34:43.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19effff700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f19f0144240 tx=0x7f19d8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d800d290 con 0x7f19f00b0030 2021-11-15T14:34:43.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8002f70 con 0x7f19f00b0030 2021-11-15T14:34:43.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d8011e80 con 0x7f19f00b0030 2021-11-15T14:34:43.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f0146880 con 0x7f19f00b0030 2021-11-15T14:34:43.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00aa1c0 con 0x7f19f00b0030 2021-11-15T14:34:43.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f00aa380 con 0x7f19f00b0030 2021-11-15T14:34:43.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19d8025030 con 0x7f19f00b0030 2021-11-15T14:34:43.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 0x7f19d4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f19d806cf40 con 0x7f19f00b0030 2021-11-15T14:34:43.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ef7fe700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 0x7f19d4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.409+0000 7f19ef7fe700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 0x7f19d4055b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f19f00b2fd0 tx=0x7f19e0007780).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.413+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19d8043e30 con 0x7f19f00b0030 2021-11-15T14:34:43.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19f00b0c10 con 0x7f19f00b0030 2021-11-15T14:34:43.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19ed7fa700 1 -- 172.21.2.135:0/623817299 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f19d80230a0 con 0x7f19f00b0030 2021-11-15T14:34:43.499 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:43.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 msgr2=0x7f19d4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 0x7f19d4055b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f19f00b2fd0 tx=0x7f19e0007780).stop 2021-11-15T14:34:43.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 msgr2=0x7f19f0142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f19f0144240 tx=0x7f19d8015000).stop 2021-11-15T14:34:43.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 shutdown_connections 2021-11-15T14:34:43.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19d4053660 0x7f19d4055b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19f00b2320 0x7f19f0146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19f00b1f40 0x7f19f0145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 --2- 172.21.2.135:0/623817299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19f00b0030 0x7f19f0142060 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 >> 172.21.2.135:0/623817299 conn(0x7f19f005f730 msgr2=0x7f19f013f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 shutdown_connections 2021-11-15T14:34:43.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.497+0000 7f19f6456700 1 -- 172.21.2.135:0/623817299 wait complete. 2021-11-15T14:34:43.506 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:43.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 Processor -- start 2021-11-15T14:34:43.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 -- start start 2021-11-15T14:34:43.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff5140b1f40 0x7ff5140b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 0x7ff5141412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140b04a0 con 0x7ff5140b0030 2021-11-15T14:34:43.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140a7850 con 0x7ff5140b1f40 2021-11-15T14:34:43.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff51b945700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140b06d0 con 0x7ff5140b2320 2021-11-15T14:34:43.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 0x7ff5141412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff518ee0700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7ff5140b0030 0x7ff5140a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:52488/0 (socket says 172.21.2.135:52488) 2021-11-15T14:34:43.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff518ee0700 1 -- 172.21.2.135:0/2711581867 learned_addr learned my addr 172.21.2.135:0/2711581867 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:43.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff5196e1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff5140b1f40 0x7ff5140b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 -- 172.21.2.135:0/2711581867 >> v2:172.21.2.119:3300/0 conn(0x7ff5140b1f40 msgr2=0x7ff5140b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 --2- 172.21.2.135:0/2711581867 >> v2:172.21.2.119:3300/0 conn(0x7ff5140b1f40 0x7ff5140b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 -- 172.21.2.135:0/2711581867 >> v1:172.21.2.119:6789/0 conn(0x7ff5140b0030 legacy=0x7ff5140a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 -- 172.21.2.135:0/2711581867 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140b0970 con 0x7ff5140b2320 2021-11-15T14:34:43.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff519ee2700 1 --2- 172.21.2.135:0/2711581867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 0x7ff5141412d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff50c0032f0 tx=0x7ff50c0091d0).ready entity=mon.2 client_cookie=4a15ff3d2bf95139 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff507fff700 1 -- 172.21.2.135:0/2711581867 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50c00b6c0 con 0x7ff5140b2320 2021-11-15T14:34:43.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff507fff700 1 -- 172.21.2.135:0/2711581867 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00b820 con 0x7ff5140b2320 2021-11-15T14:34:43.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.557+0000 7ff507fff700 1 -- 172.21.2.135:0/2711581867 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50c00b990 con 0x7ff5140b2320 2021-11-15T14:34:43.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/2711581867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 msgr2=0x7ff5141412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- 172.21.2.135:0/2711581867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 0x7ff5141412d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff50c0032f0 tx=0x7ff50c0091d0).stop 2021-11-15T14:34:43.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/2711581867 shutdown_connections 2021-11-15T14:34:43.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- 172.21.2.135:0/2711581867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b2320 0x7ff5141412d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- 172.21.2.135:0/2711581867 >> v2:172.21.2.119:3300/0 conn(0x7ff5140b1f40 0x7ff5140b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/2711581867 >> 172.21.2.135:0/2711581867 conn(0x7ff51405f730 msgr2=0x7ff51405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/2711581867 shutdown_connections 2021-11-15T14:34:43.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/2711581867 wait complete. 2021-11-15T14:34:43.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 Processor -- start 2021-11-15T14:34:43.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- start start 2021-11-15T14:34:43.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b0030 0x7ff51414a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5140b1f40 0x7ff5140b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141494d0 con 0x7ff5140b1f40 2021-11-15T14:34:43.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514148bb0 con 0x7ff5140b2320 2021-11-15T14:34:43.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514149080 con 0x7ff5140b0030 2021-11-15T14:34:43.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55490/0 (socket says 172.21.2.135:55490) 2021-11-15T14:34:43.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 -- 172.21.2.135:0/3782865671 learned_addr learned my addr 172.21.2.135:0/3782865671 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5196e1700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b0030 0x7ff51414a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 -- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b0030 msgr2=0x7ff51414a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b0030 0x7ff51414a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 -- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5140b1f40 msgr2=0x7ff5140b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5140b1f40 0x7ff5140b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 -- 172.21.2.135:0/3782865671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009470 con 0x7ff5140b2320 2021-11-15T14:34:43.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff519ee2700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff5140abbc0 tx=0x7ff50c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50c00b6c0 con 0x7ff5140b2320 2021-11-15T14:34:43.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff514149700 con 0x7ff5140b2320 2021-11-15T14:34:43.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c0107a0 con 0x7ff5140b2320 2021-11-15T14:34:43.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50c010b00 con 0x7ff5140b2320 2021-11-15T14:34:43.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5140b4680 con 0x7ff5140b2320 2021-11-15T14:34:43.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514146950 con 0x7ff5140b2320 2021-11-15T14:34:43.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff50c027020 con 0x7ff5140b2320 2021-11-15T14:34:43.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.561+0000 7ff5067fc700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 0x7ff4f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.565+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff50c06cff0 con 0x7ff5140b2320 2021-11-15T14:34:43.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.565+0000 7ff5196e1700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 0x7ff4f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.565+0000 7ff5196e1700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 0x7ff4f4055ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff51000b000 tx=0x7ff510008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.565+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff50c043f50 con 0x7ff5140b2320 2021-11-15T14:34:43.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5140b0c10 con 0x7ff5140b2320 2021-11-15T14:34:43.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff5067fc700 1 -- 172.21.2.135:0/3782865671 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff50c015020 con 0x7ff5140b2320 2021-11-15T14:34:43.652 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:43.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 msgr2=0x7ff4f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 0x7ff4f4055ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff51000b000 tx=0x7ff510008040).stop 2021-11-15T14:34:43.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 msgr2=0x7ff5141462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff5140abbc0 tx=0x7ff50c016000).stop 2021-11-15T14:34:43.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 shutdown_connections 2021-11-15T14:34:43.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff4f4053610 0x7ff4f4055ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5140b2320 0x7ff5141462c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5140b1f40 0x7ff5140b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 --2- 172.21.2.135:0/3782865671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5140b0030 0x7ff51414a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 >> 172.21.2.135:0/3782865671 conn(0x7ff51405f730 msgr2=0x7ff5140af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 shutdown_connections 2021-11-15T14:34:43.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.649+0000 7ff51b945700 1 -- 172.21.2.135:0/3782865671 wait complete. 2021-11-15T14:34:43.659 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:43.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 Processor -- start 2021-11-15T14:34:43.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 -- start start 2021-11-15T14:34:43.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15e80b0520 0x7f15e80addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f15e80aa1a0 0x7f15e80ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80b2b70 con 0x7f15e80b0900 2021-11-15T14:34:43.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80b27f0 con 0x7f15e80aa1a0 2021-11-15T14:34:43.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15eea36700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80b2da0 con 0x7f15e80b0520 2021-11-15T14:34:43.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15e80b0520 0x7f15e80addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15e80b0520 0x7f15e80addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55496/0 (socket says 172.21.2.135:55496) 2021-11-15T14:34:43.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 -- 172.21.2.135:0/1421381903 learned_addr learned my addr 172.21.2.135:0/1421381903 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 -- 172.21.2.135:0/1421381903 >> v2:172.21.2.119:3300/0 conn(0x7f15e80aa1a0 msgr2=0x7f15e80ae2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:43.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 --2- 172.21.2.135:0/1421381903 >> v2:172.21.2.119:3300/0 conn(0x7f15e80aa1a0 0x7f15e80ae2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.705+0000 7f15e7fff700 1 -- 172.21.2.135:0/1421381903 >> v1:172.21.2.119:6789/0 conn(0x7f15e80b0900 legacy=0x7f15e8143790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:43.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 -- 172.21.2.135:0/1421381903 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80a9bf0 con 0x7f15e80b0520 2021-11-15T14:34:43.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- 172.21.2.135:0/1421381903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80b0520 0x7f15e80addb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f15e80b0130 tx=0x7f15d8006eb0).ready entity=mon.1 client_cookie=1ed7c4fb542c047d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e6ffd700 1 -- 172.21.2.135:0/1421381903 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d800d5c0 con 0x7f15e80b0520 2021-11-15T14:34:43.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e6ffd700 1 -- 172.21.2.135:0/1421381903 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8000e90 con 0x7f15e80b0520 2021-11-15T14:34:43.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e6ffd700 1 -- 172.21.2.135:0/1421381903 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d800d910 con 0x7f15e80b0520 2021-11-15T14:34:43.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/1421381903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80b0520 msgr2=0x7f15e80addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- 172.21.2.135:0/1421381903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80b0520 0x7f15e80addb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f15e80b0130 tx=0x7f15d8006eb0).stop 2021-11-15T14:34:43.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/1421381903 shutdown_connections 2021-11-15T14:34:43.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- 172.21.2.135:0/1421381903 >> v2:172.21.2.119:3300/0 conn(0x7f15e80aa1a0 0x7f15e80ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- 172.21.2.135:0/1421381903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80b0520 0x7f15e80addb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/1421381903 >> 172.21.2.135:0/1421381903 conn(0x7f15e8060840 msgr2=0x7f15e8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/1421381903 shutdown_connections 2021-11-15T14:34:43.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/1421381903 wait complete. 2021-11-15T14:34:43.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 Processor -- start 2021-11-15T14:34:43.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- start start 2021-11-15T14:34:43.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e80b0520 0x7f15e80a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15e80b0900 0x7f15e815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80a14e0 con 0x7f15e80b0520 2021-11-15T14:34:43.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8066b80 con 0x7f15e80aa1a0 2021-11-15T14:34:43.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8066e20 con 0x7f15e80b0900 2021-11-15T14:34:43.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55502/0 (socket says 172.21.2.135:55502) 2021-11-15T14:34:43.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 -- 172.21.2.135:0/954394641 learned_addr learned my addr 172.21.2.135:0/954394641 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 -- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15e80b0900 msgr2=0x7f15e815a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:43.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15e80b0900 0x7f15e815a6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 -- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e80b0520 msgr2=0x7f15e80a0860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:43.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e80b0520 0x7f15e80a0860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 -- 172.21.2.135:0/954394641 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d800b1e0 con 0x7f15e80aa1a0 2021-11-15T14:34:43.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e7fff700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f15e80b0130 tx=0x7f15d8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d8002f70 con 0x7f15e80aa1a0 2021-11-15T14:34:43.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800de70 con 0x7f15e80aa1a0 2021-11-15T14:34:43.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e80a1040 con 0x7f15e80aa1a0 2021-11-15T14:34:43.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e815ad80 con 0x7f15e80aa1a0 2021-11-15T14:34:43.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d801e460 con 0x7f15e80aa1a0 2021-11-15T14:34:43.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.709+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e80a1650 con 0x7f15e80aa1a0 2021-11-15T14:34:43.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f15d8025030 con 0x7f15e80aa1a0 2021-11-15T14:34:43.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e57fa700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 0x7f15cc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f15d806d060 con 0x7f15e80aa1a0 2021-11-15T14:34:43.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e77fe700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 0x7f15cc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e77fe700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 0x7f15cc055bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f15d0002fb0 tx=0x7f15d0006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.713+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15d8043f50 con 0x7f15e80aa1a0 2021-11-15T14:34:43.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.797+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15e80573d0 con 0x7f15e80aa1a0 2021-11-15T14:34:43.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15e57fa700 1 -- 172.21.2.135:0/954394641 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f15d8047570 con 0x7f15e80aa1a0 2021-11-15T14:34:43.803 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:43.803 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:43.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 msgr2=0x7f15cc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 0x7f15cc055bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f15d0002fb0 tx=0x7f15d0006930).stop 2021-11-15T14:34:43.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 msgr2=0x7f15e80a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f15e80b0130 tx=0x7f15d8015000).stop 2021-11-15T14:34:43.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 shutdown_connections 2021-11-15T14:34:43.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0536f0 0x7f15cc055bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15e80b0900 0x7f15e815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e80b0520 0x7f15e80a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 --2- 172.21.2.135:0/954394641 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e80aa1a0 0x7f15e80a2a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 >> 172.21.2.135:0/954394641 conn(0x7f15e8060840 msgr2=0x7f15e80b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 shutdown_connections 2021-11-15T14:34:43.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.801+0000 7f15eea36700 1 -- 172.21.2.135:0/954394641 wait complete. 2021-11-15T14:34:43.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:43.811 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 Processor -- start 2021-11-15T14:34:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- start start 2021-11-15T14:34:43.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2c4c0b1f40 0x7f2c4c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0b04a0 con 0x7f2c4c0b2320 2021-11-15T14:34:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0a7850 con 0x7f2c4c0b0030 2021-11-15T14:34:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b06d0 con 0x7f2c4c0b1f40 2021-11-15T14:34:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c49d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2c4c0b0030 0x7f2c4c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43100/0 (socket says 172.21.2.135:43100) 2021-11-15T14:34:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c49d9b700 1 -- 172.21.2.135:0/3904861425 learned_addr learned my addr 172.21.2.135:0/3904861425 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183650043 0 0) 0x7f2c4c0a7850 con 0x7f2c4c0b0030 2021-11-15T14:34:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2c003260 con 0x7f2c4c0b0030 2021-11-15T14:34:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4a59c700 1 --2- 172.21.2.135:0/3904861425 >> v2:172.21.2.119:3300/0 conn(0x7f2c4c0b1f40 0x7f2c4c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115133192 0 0) 0x7f2c2c003260 con 0x7f2c4c0b0030 2021-11-15T14:34:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 >> v2:172.21.2.119:3300/0 conn(0x7f2c4c0b1f40 msgr2=0x7f2c4c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 --2- 172.21.2.135:0/3904861425 >> v2:172.21.2.119:3300/0 conn(0x7f2c4c0b1f40 0x7f2c4c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 >> v1:172.21.2.119:6789/0 conn(0x7f2c4c0b2320 legacy=0x7f2c4c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0b0970 con 0x7f2c4c0b0030 2021-11-15T14:34:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2c3c001660 con 0x7f2c4c0b0030 2021-11-15T14:34:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4a59c700 1 --2- 172.21.2.135:0/3904861425 >> v2:172.21.2.119:3300/0 conn(0x7f2c4c0b1f40 0x7f2c4c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 >> v1:172.21.2.135:6789/0 conn(0x7f2c4c0b0030 legacy=0x7f2c4c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c2c0037a0 0x7f2c2c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004500 0x7f2c2c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 0x7f2c2c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b06d0 con 0x7f2c2c0037a0 2021-11-15T14:34:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c00be00 con 0x7f2c2c004f90 2021-11-15T14:34:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c00bfc0 con 0x7f2c2c004500 2021-11-15T14:34:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 0x7f2c2c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 -- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004500 msgr2=0x7f2c2c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004500 0x7f2c2c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 -- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c2c0037a0 msgr2=0x7f2c2c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:43.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c2c0037a0 0x7f2c2c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:43.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 -- 172.21.2.135:0/3904861425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c003260 con 0x7f2c2c004f90 2021-11-15T14:34:43.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 -- 172.21.2.135:0/3904861425 reap_dead start 2021-11-15T14:34:43.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4ad9d700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 0x7f2c2c00b750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2c4c0ad350 tx=0x7f2c44007d80).ready entity=mon.1 client_cookie=603551a91834c0c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c44006890 con 0x7f2c2c004f90 2021-11-15T14:34:43.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440069f0 con 0x7f2c2c004f90 2021-11-15T14:34:43.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c4959a700 1 -- 172.21.2.135:0/3904861425 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c44006d50 con 0x7f2c2c004f90 2021-11-15T14:34:43.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 msgr2=0x7f2c2c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 0x7f2c2c00b750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2c4c0ad350 tx=0x7f2c44007d80).stop 2021-11-15T14:34:43.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- 172.21.2.135:0/3904861425 shutdown_connections 2021-11-15T14:34:43.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 --2- 172.21.2.135:0/3904861425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c2c004f90 0x7f2c2c00b750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- 172.21.2.135:0/3904861425 >> 172.21.2.135:0/3904861425 conn(0x7f2c4c05f730 msgr2=0x7f2c4c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- 172.21.2.135:0/3904861425 shutdown_connections 2021-11-15T14:34:43.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.861+0000 7f2c50bef700 1 -- 172.21.2.135:0/3904861425 wait complete. 2021-11-15T14:34:43.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 Processor -- start 2021-11-15T14:34:43.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- start start 2021-11-15T14:34:43.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004f90 0x7f2c4c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c4c1572e0 0x7f2c4c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b4d80 con 0x7f2c4c1572e0 2021-11-15T14:34:43.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c157c80 con 0x7f2c4c063db0 2021-11-15T14:34:43.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c064250 con 0x7f2c2c004f90 2021-11-15T14:34:43.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55524/0 (socket says 172.21.2.135:55524) 2021-11-15T14:34:43.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 -- 172.21.2.135:0/159765109 learned_addr learned my addr 172.21.2.135:0/159765109 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:43.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c4a59c700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004f90 0x7f2c4c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c4ad9d700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c4c1572e0 0x7f2c4c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 -- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004f90 msgr2=0x7f2c4c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004f90 0x7f2c4c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 -- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c4c1572e0 msgr2=0x7f2c4c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c4c1572e0 0x7f2c4c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 -- 172.21.2.135:0/159765109 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0644f0 con 0x7f2c4c063db0 2021-11-15T14:34:43.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c49d9b700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2c3c001370 tx=0x7f2c4c0b0b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3c007170 con 0x7f2c4c063db0 2021-11-15T14:34:43.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0072d0 con 0x7f2c4c063db0 2021-11-15T14:34:43.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c064790 con 0x7f2c4c063db0 2021-11-15T14:34:43.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3c004920 con 0x7f2c4c063db0 2021-11-15T14:34:43.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c062940 con 0x7f2c4c063db0 2021-11-15T14:34:43.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c0b0c10 con 0x7f2c4c063db0 2021-11-15T14:34:43.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c3c004a80 con 0x7f2c4c063db0 2021-11-15T14:34:43.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 0x7f2c30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:43.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f2c3c06b550 con 0x7f2c4c063db0 2021-11-15T14:34:43.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.865+0000 7f2c4a59c700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 0x7f2c30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:43.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.869+0000 7f2c4a59c700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 0x7f2c30055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2c3400c000 tx=0x7f2c34008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:43.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.869+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c3c0424f0 con 0x7f2c4c063db0 2021-11-15T14:34:43.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2c4c0573d0 con 0x7f2c4c063db0 2021-11-15T14:34:43.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c437fe700 1 -- 172.21.2.135:0/159765109 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2c3c001a40 con 0x7f2c4c063db0 2021-11-15T14:34:43.955 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:43.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 msgr2=0x7f2c30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 0x7f2c30055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f2c3400c000 tx=0x7f2c34008040).stop 2021-11-15T14:34:43.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 msgr2=0x7f2c4c0b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:43.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2c3c001370 tx=0x7f2c4c0b0b00).stop 2021-11-15T14:34:43.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 shutdown_connections 2021-11-15T14:34:43.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c30053610 0x7f2c30055ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c4c1572e0 0x7f2c4c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c4c063db0 0x7f2c4c0b4890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 --2- 172.21.2.135:0/159765109 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c2c004f90 0x7f2c4c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:43.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 >> 172.21.2.135:0/159765109 conn(0x7f2c4c05f730 msgr2=0x7f2c4c0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:43.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 shutdown_connections 2021-11-15T14:34:43.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:43.953+0000 7f2c50bef700 1 -- 172.21.2.135:0/159765109 wait complete. 2021-11-15T14:34:43.962 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:44.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 Processor -- start 2021-11-15T14:34:44.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- start start 2021-11-15T14:34:44.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f897c0b1f40 0x7f897c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0b0030 0x7f897c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f897c0a7140 0x7f897c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0b04a0 con 0x7f897c0b1f40 2021-11-15T14:34:44.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0b2810 con 0x7f897c0a7140 2021-11-15T14:34:44.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0b06d0 con 0x7f897c0b0030 2021-11-15T14:34:44.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f897c0a7140 0x7f897c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f897c0a7140 0x7f897c1412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55532/0 (socket says 172.21.2.135:55532) 2021-11-15T14:34:44.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 -- 172.21.2.135:0/4088782849 learned_addr learned my addr 172.21.2.135:0/4088782849 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 -- 172.21.2.135:0/4088782849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0b0030 msgr2=0x7f897c0b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- 172.21.2.135:0/4088782849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0b0030 0x7f897c0b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 -- 172.21.2.135:0/4088782849 >> v2:172.21.2.119:3300/0 conn(0x7f897c0b1f40 msgr2=0x7f897c0b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- 172.21.2.135:0/4088782849 >> v2:172.21.2.119:3300/0 conn(0x7f897c0b1f40 0x7f897c0b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 -- 172.21.2.135:0/4088782849 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0b0970 con 0x7f897c0a7140 2021-11-15T14:34:44.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- 172.21.2.135:0/4088782849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0a7140 0x7f897c1412d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f89740032f0 tx=0x7f8974009290).ready entity=mon.1 client_cookie=8b8add37e559f4de server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f896bfff700 1 -- 172.21.2.135:0/4088782849 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897400b870 con 0x7f897c0a7140 2021-11-15T14:34:44.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f896bfff700 1 -- 172.21.2.135:0/4088782849 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400b9d0 con 0x7f897c0a7140 2021-11-15T14:34:44.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f896bfff700 1 -- 172.21.2.135:0/4088782849 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897400bb80 con 0x7f897c0a7140 2021-11-15T14:34:44.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- 172.21.2.135:0/4088782849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0a7140 msgr2=0x7f897c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- 172.21.2.135:0/4088782849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0a7140 0x7f897c1412d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f89740032f0 tx=0x7f8974009290).stop 2021-11-15T14:34:44.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- 172.21.2.135:0/4088782849 shutdown_connections 2021-11-15T14:34:44.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- 172.21.2.135:0/4088782849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0a7140 0x7f897c1412d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- 172.21.2.135:0/4088782849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0b0030 0x7f897c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- 172.21.2.135:0/4088782849 >> v2:172.21.2.119:3300/0 conn(0x7f897c0b1f40 0x7f897c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- 172.21.2.135:0/4088782849 >> 172.21.2.135:0/4088782849 conn(0x7f897c05f730 msgr2=0x7f897c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- 172.21.2.135:0/4088782849 shutdown_connections 2021-11-15T14:34:44.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- 172.21.2.135:0/4088782849 wait complete. 2021-11-15T14:34:44.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 Processor -- start 2021-11-15T14:34:44.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- start start 2021-11-15T14:34:44.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0a7140 0x7f897c0a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f897c0b0030 0x7f897c146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c156e80 con 0x7f897c0b0030 2021-11-15T14:34:44.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c15aed0 con 0x7f897c0b1f40 2021-11-15T14:34:44.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898337f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1570b0 con 0x7f897c0a7140 2021-11-15T14:34:44.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55538/0 (socket says 172.21.2.135:55538) 2021-11-15T14:34:44.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.013+0000 7f898191c700 1 -- 172.21.2.135:0/4255774870 learned_addr learned my addr 172.21.2.135:0/4255774870 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 -- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0a7140 msgr2=0x7f897c0a9af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:44.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0a7140 0x7f897c0a9af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 -- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f897c0b0030 msgr2=0x7f897c146780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:44.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f897c0b0030 0x7f897c146780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 -- 172.21.2.135:0/4255774870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974009530 con 0x7f897c0b1f40 2021-11-15T14:34:44.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898191c700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f89740032f0 tx=0x7f8974016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f897400b870 con 0x7f897c0b1f40 2021-11-15T14:34:44.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89740107a0 con 0x7f897c0b1f40 2021-11-15T14:34:44.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8974010b00 con 0x7f897c0b1f40 2021-11-15T14:34:44.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c15b170 con 0x7f897c0b1f40 2021-11-15T14:34:44.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c140610 con 0x7f897c0b1f40 2021-11-15T14:34:44.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c157270 con 0x7f897c0b1f40 2021-11-15T14:34:44.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8974028070 con 0x7f897c0b1f40 2021-11-15T14:34:44.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 0x7f895c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f897406cb30 con 0x7f897c0b1f40 2021-11-15T14:34:44.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898111b700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 0x7f895c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.017+0000 7f898111b700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 0x7f895c055b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8978000ed0 tx=0x7f89780068b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.021+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8974043a20 con 0x7f897c0b1f40 2021-11-15T14:34:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f897c0b0c10 con 0x7f897c0b1f40 2021-11-15T14:34:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f896a7fc700 1 -- 172.21.2.135:0/4255774870 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8974015070 con 0x7f897c0b1f40 2021-11-15T14:34:44.107 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:44.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 msgr2=0x7f895c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 0x7f895c055b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8978000ed0 tx=0x7f89780068b0).stop 2021-11-15T14:34:44.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 msgr2=0x7f897c157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f89740032f0 tx=0x7f8974016000).stop 2021-11-15T14:34:44.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 shutdown_connections 2021-11-15T14:34:44.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f895c053660 0x7f895c055b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f897c0b1f40 0x7f897c157550 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f897c0b0030 0x7f897c146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 --2- 172.21.2.135:0/4255774870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f897c0a7140 0x7f897c0a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 >> 172.21.2.135:0/4255774870 conn(0x7f897c05f730 msgr2=0x7f897c0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 shutdown_connections 2021-11-15T14:34:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.105+0000 7f898337f700 1 -- 172.21.2.135:0/4255774870 wait complete. 2021-11-15T14:34:44.114 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:44.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.161+0000 7fc4f49fb700 1 Processor -- start 2021-11-15T14:34:44.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.161+0000 7fc4f49fb700 1 -- start start 2021-11-15T14:34:44.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f0060040 0x7fc4f0064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc4f00b3950 0x7fc4f0065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00b2430 con 0x7fc4f00b2ca0 2021-11-15T14:34:44.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f0065770 con 0x7fc4f00b3950 2021-11-15T14:34:44.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b26d0 con 0x7fc4f0060040 2021-11-15T14:34:44.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc4f00b3950 0x7fc4f0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc4f00b3950 0x7fc4f0065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55546/0 (socket says 172.21.2.135:55546) 2021-11-15T14:34:44.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 -- 172.21.2.135:0/1036515672 learned_addr learned my addr 172.21.2.135:0/1036515672 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 -- 172.21.2.135:0/1036515672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f0060040 msgr2=0x7fc4f0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 --2- 172.21.2.135:0/1036515672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f0060040 0x7fc4f0064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 -- 172.21.2.135:0/1036515672 >> v1:172.21.2.119:6789/0 conn(0x7fc4f00b2ca0 legacy=0x7fc4f00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 -- 172.21.2.135:0/1036515672 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00b2970 con 0x7fc4f00b3950 2021-11-15T14:34:44.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4edd9b700 1 --2- 172.21.2.135:0/1036515672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f00b3950 0x7fc4f0065280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc4f0064c70 tx=0x7fc4e0006eb0).ready entity=mon.1 client_cookie=58e72b28fde9d6a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ed59a700 1 -- 172.21.2.135:0/1036515672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e000d570 con 0x7fc4f00b3950 2021-11-15T14:34:44.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ed59a700 1 -- 172.21.2.135:0/1036515672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e0000e90 con 0x7fc4f00b3950 2021-11-15T14:34:44.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ed59a700 1 -- 172.21.2.135:0/1036515672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e000d8c0 con 0x7fc4f00b3950 2021-11-15T14:34:44.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/1036515672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f00b3950 msgr2=0x7fc4f0065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/1036515672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f00b3950 0x7fc4f0065280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc4f0064c70 tx=0x7fc4e0006eb0).stop 2021-11-15T14:34:44.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/1036515672 shutdown_connections 2021-11-15T14:34:44.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/1036515672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f00b3950 0x7fc4f0065280 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/1036515672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f0060040 0x7fc4f0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/1036515672 >> 172.21.2.135:0/1036515672 conn(0x7fc4f005cfe0 msgr2=0x7fc4f005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/1036515672 shutdown_connections 2021-11-15T14:34:44.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/1036515672 wait complete. 2021-11-15T14:34:44.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 Processor -- start 2021-11-15T14:34:44.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- start start 2021-11-15T14:34:44.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc4f00b2ca0 0x7fc4f013f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f00b3950 0x7fc4f01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f013bef0 con 0x7fc4f00b2ca0 2021-11-15T14:34:44.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01524b0 con 0x7fc4f0060040 2021-11-15T14:34:44.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f013c0e0 con 0x7fc4f00b3950 2021-11-15T14:34:44.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55552/0 (socket says 172.21.2.135:55552) 2021-11-15T14:34:44.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 -- 172.21.2.135:0/2078080305 learned_addr learned my addr 172.21.2.135:0/2078080305 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 -- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f00b3950 msgr2=0x7fc4f01528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f00b3950 0x7fc4f01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 -- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc4f00b2ca0 msgr2=0x7fc4f013f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc4f00b2ca0 0x7fc4f013f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 -- 172.21.2.135:0/2078080305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e000b1e0 con 0x7fc4f0060040 2021-11-15T14:34:44.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4ee59c700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc4f00afa40 tx=0x7fc4d8006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4d8013460 con 0x7fc4f0060040 2021-11-15T14:34:44.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d80135c0 con 0x7fc4f0060040 2021-11-15T14:34:44.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f013c400 con 0x7fc4f0060040 2021-11-15T14:34:44.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4d8013920 con 0x7fc4f0060040 2021-11-15T14:34:44.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.165+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f013c980 con 0x7fc4f0060040 2021-11-15T14:34:44.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f013bc90 con 0x7fc4f0060040 2021-11-15T14:34:44.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc4d801a060 con 0x7fc4f0060040 2021-11-15T14:34:44.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4e77fe700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 0x7fc4d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc4d806b4b0 con 0x7fc4f0060040 2021-11-15T14:34:44.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4edd9b700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 0x7fc4d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4edd9b700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 0x7fc4d4055a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4f0064c70 tx=0x7fc4e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.169+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc4d80424b0 con 0x7fc4f0060040 2021-11-15T14:34:44.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4f00648f0 con 0x7fc4f0060040 2021-11-15T14:34:44.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4e77fe700 1 -- 172.21.2.135:0/2078080305 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc4d8045ad0 con 0x7fc4f0060040 2021-11-15T14:34:44.256 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 msgr2=0x7fc4d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 0x7fc4d4055a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4f0064c70 tx=0x7fc4e0015000).stop 2021-11-15T14:34:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 msgr2=0x7fc4f00b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc4f00afa40 tx=0x7fc4d8006ec0).stop 2021-11-15T14:34:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 shutdown_connections 2021-11-15T14:34:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc4d4053580 0x7fc4d4055a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4f00b3950 0x7fc4f01528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc4f00b2ca0 0x7fc4f013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 --2- 172.21.2.135:0/2078080305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc4f0060040 0x7fc4f00b6f40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 >> 172.21.2.135:0/2078080305 conn(0x7fc4f005cfe0 msgr2=0x7fc4f0142fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 shutdown_connections 2021-11-15T14:34:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.253+0000 7fc4f49fb700 1 -- 172.21.2.135:0/2078080305 wait complete. 2021-11-15T14:34:44.263 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:44.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 Processor -- start 2021-11-15T14:34:44.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- start start 2021-11-15T14:34:44.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8d80b1f40 0x7ff8d80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b2320 0x7ff8d81412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80b04a0 con 0x7ff8d80b0030 2021-11-15T14:34:44.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80a7850 con 0x7ff8d80b1f40 2021-11-15T14:34:44.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b06d0 con 0x7ff8d80b2320 2021-11-15T14:34:44.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8d80b1f40 0x7ff8d80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8d80b1f40 0x7ff8d80b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55558/0 (socket says 172.21.2.135:55558) 2021-11-15T14:34:44.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 -- 172.21.2.135:0/1271515511 learned_addr learned my addr 172.21.2.135:0/1271515511 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 -- 172.21.2.135:0/1271515511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b2320 msgr2=0x7ff8d81412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 --2- 172.21.2.135:0/1271515511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b2320 0x7ff8d81412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 -- 172.21.2.135:0/1271515511 >> v1:172.21.2.119:6789/0 conn(0x7ff8d80b0030 legacy=0x7ff8d80a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 -- 172.21.2.135:0/1271515511 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80b0970 con 0x7ff8d80b1f40 2021-11-15T14:34:44.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8dc8ba700 1 --2- 172.21.2.135:0/1271515511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d80b1350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff8d80b2fd0 tx=0x7ff8c0006eb0).ready entity=mon.1 client_cookie=f8af2aa485785246 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8d77fe700 1 -- 172.21.2.135:0/1271515511 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c000d570 con 0x7ff8d80b1f40 2021-11-15T14:34:44.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8d77fe700 1 -- 172.21.2.135:0/1271515511 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c0000e90 con 0x7ff8d80b1f40 2021-11-15T14:34:44.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8d77fe700 1 -- 172.21.2.135:0/1271515511 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c000d8c0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- 172.21.2.135:0/1271515511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 msgr2=0x7ff8d80b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/1271515511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d80b1350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff8d80b2fd0 tx=0x7ff8c0006eb0).stop 2021-11-15T14:34:44.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- 172.21.2.135:0/1271515511 shutdown_connections 2021-11-15T14:34:44.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/1271515511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b2320 0x7ff8d81412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/1271515511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d80b1350 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- 172.21.2.135:0/1271515511 >> 172.21.2.135:0/1271515511 conn(0x7ff8d805f730 msgr2=0x7ff8d805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- 172.21.2.135:0/1271515511 shutdown_connections 2021-11-15T14:34:44.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- 172.21.2.135:0/1271515511 wait complete. 2021-11-15T14:34:44.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 Processor -- start 2021-11-15T14:34:44.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.313+0000 7ff8deb1e700 1 -- start start 2021-11-15T14:34:44.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b0030 0x7ff8d8140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d80b2320 0x7ff8d815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80abaf0 con 0x7ff8d80b2320 2021-11-15T14:34:44.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80abd90 con 0x7ff8d80b1f40 2021-11-15T14:34:44.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80ac030 con 0x7ff8d80b0030 2021-11-15T14:34:44.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55568/0 (socket says 172.21.2.135:55568) 2021-11-15T14:34:44.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 -- 172.21.2.135:0/3981277220 learned_addr learned my addr 172.21.2.135:0/3981277220 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 -- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b0030 msgr2=0x7ff8d8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b0030 0x7ff8d8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 -- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d80b2320 msgr2=0x7ff8d815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d80b2320 0x7ff8d815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 -- 172.21.2.135:0/3981277220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c000b1e0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d7fff700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff8c8002fb0 tx=0x7ff8c8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c8013460 con 0x7ff8d80b1f40 2021-11-15T14:34:44.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80135c0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80ac2d0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c8013920 con 0x7ff8d80b1f40 2021-11-15T14:34:44.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80ab6c0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80b0c10 con 0x7ff8d80b1f40 2021-11-15T14:34:44.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8c800f070 con 0x7ff8d80b1f40 2021-11-15T14:34:44.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 0x7ff8bc055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff8c806b510 con 0x7ff8d80b1f40 2021-11-15T14:34:44.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.317+0000 7ff8dc8ba700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 0x7ff8bc055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.321+0000 7ff8dc8ba700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 0x7ff8bc055a90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff8d80b2fd0 tx=0x7ff8c0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.321+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8c8042510 con 0x7ff8d80b1f40 2021-11-15T14:34:44.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8d80573d0 con 0x7ff8d80b1f40 2021-11-15T14:34:44.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8d5ffb700 1 -- 172.21.2.135:0/3981277220 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff8c8045b30 con 0x7ff8d80b1f40 2021-11-15T14:34:44.407 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 msgr2=0x7ff8bc055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 0x7ff8bc055a90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff8d80b2fd0 tx=0x7ff8c0015000).stop 2021-11-15T14:34:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 msgr2=0x7ff8d815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff8c8002fb0 tx=0x7ff8c8006df0).stop 2021-11-15T14:34:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 shutdown_connections 2021-11-15T14:34:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8bc0535d0 0x7ff8bc055a90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d80b2320 0x7ff8d815ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d80b1f40 0x7ff8d815a680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 --2- 172.21.2.135:0/3981277220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d80b0030 0x7ff8d8140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 >> 172.21.2.135:0/3981277220 conn(0x7ff8d805f730 msgr2=0x7ff8d80af780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 shutdown_connections 2021-11-15T14:34:44.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.405+0000 7ff8deb1e700 1 -- 172.21.2.135:0/3981277220 wait complete. 2021-11-15T14:34:44.415 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:44.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 Processor -- start 2021-11-15T14:34:44.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 -- start start 2021-11-15T14:34:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f83cc0aa1a0 0x7f83cc0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0b2b70 con 0x7f83cc0b0520 2021-11-15T14:34:44.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0b27f0 con 0x7f83cc0aa1a0 2021-11-15T14:34:44.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.461+0000 7f83d33ab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0b2da0 con 0x7f83cc0b0900 2021-11-15T14:34:44.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:37118/0 (socket says 172.21.2.135:37118) 2021-11-15T14:34:44.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 -- 172.21.2.135:0/1726351153 learned_addr learned my addr 172.21.2.135:0/1726351153 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d0946700 1 --2- 172.21.2.135:0/1726351153 >> v2:172.21.2.119:3300/0 conn(0x7f83cc0aa1a0 0x7f83cc0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 -- 172.21.2.135:0/1726351153 >> v2:172.21.2.119:3300/0 conn(0x7f83cc0aa1a0 msgr2=0x7f83cc0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 --2- 172.21.2.135:0/1726351153 >> v2:172.21.2.119:3300/0 conn(0x7f83cc0aa1a0 0x7f83cc0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 -- 172.21.2.135:0/1726351153 >> v1:172.21.2.119:6789/0 conn(0x7f83cc0b0520 legacy=0x7f83cc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 -- 172.21.2.135:0/1726351153 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0a9bf0 con 0x7f83cc0b0900 2021-11-15T14:34:44.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d1948700 1 --2- 172.21.2.135:0/1726351153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f83c40032f0 tx=0x7f83c400b530).ready entity=mon.2 client_cookie=50133334f8c2450e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83bbfff700 1 -- 172.21.2.135:0/1726351153 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c400de20 con 0x7f83cc0b0900 2021-11-15T14:34:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83bbfff700 1 -- 172.21.2.135:0/1726351153 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4010470 con 0x7f83cc0b0900 2021-11-15T14:34:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83bbfff700 1 -- 172.21.2.135:0/1726351153 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c40107d0 con 0x7f83cc0b0900 2021-11-15T14:34:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- 172.21.2.135:0/1726351153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 msgr2=0x7f83cc140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 --2- 172.21.2.135:0/1726351153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f83c40032f0 tx=0x7f83c400b530).stop 2021-11-15T14:34:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- 172.21.2.135:0/1726351153 shutdown_connections 2021-11-15T14:34:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 --2- 172.21.2.135:0/1726351153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0900 0x7f83cc140620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 --2- 172.21.2.135:0/1726351153 >> v2:172.21.2.119:3300/0 conn(0x7f83cc0aa1a0 0x7f83cc0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- 172.21.2.135:0/1726351153 >> 172.21.2.135:0/1726351153 conn(0x7f83cc060840 msgr2=0x7f83cc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- 172.21.2.135:0/1726351153 shutdown_connections 2021-11-15T14:34:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- 172.21.2.135:0/1726351153 wait complete. 2021-11-15T14:34:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 Processor -- start 2021-11-15T14:34:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.465+0000 7f83d33ab700 1 -- start start 2021-11-15T14:34:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83cc0aa1a0 0x7f83cc14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0520 0x7f83cc142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc144690 con 0x7f83cc0aa1a0 2021-11-15T14:34:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc14f0f0 con 0x7f83cc0b0900 2021-11-15T14:34:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc14f390 con 0x7f83cc0b0520 2021-11-15T14:34:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55582/0 (socket says 172.21.2.135:55582) 2021-11-15T14:34:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 -- 172.21.2.135:0/275697711 learned_addr learned my addr 172.21.2.135:0/275697711 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 -- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0520 msgr2=0x7f83cc142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0520 0x7f83cc142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 -- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83cc0aa1a0 msgr2=0x7f83cc14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83cc0aa1a0 0x7f83cc14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 -- 172.21.2.135:0/275697711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c400b7d0 con 0x7f83cc0b0900 2021-11-15T14:34:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1948700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f83c40032f0 tx=0x7f83c400b530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c40186e0 con 0x7f83cc0b0900 2021-11-15T14:34:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4018840 con 0x7f83cc0b0900 2021-11-15T14:34:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc1437b0 con 0x7f83cc0b0900 2021-11-15T14:34:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc143180 con 0x7f83cc0b0900 2021-11-15T14:34:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c4018ba0 con 0x7f83cc0b0900 2021-11-15T14:34:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc143c50 con 0x7f83cc0b0900 2021-11-15T14:34:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83c4021020 con 0x7f83cc0b0900 2021-11-15T14:34:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 0x7f83ac055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f83c406fc70 con 0x7f83cc0b0900 2021-11-15T14:34:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1147700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 0x7f83ac055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.469+0000 7f83d1147700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 0x7f83ac055bb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f83cc0b77f0 tx=0x7f83c8007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.473+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83cc143c50 con 0x7f83cc0b0900 2021-11-15T14:34:44.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83cc143c50 con 0x7f83cc0b0900 2021-11-15T14:34:44.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83ba7fc700 1 -- 172.21.2.135:0/275697711 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f83cc143c50 con 0x7f83cc0b0900 2021-11-15T14:34:44.559 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:44.560 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 msgr2=0x7f83ac055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 0x7f83ac055bb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f83cc0b77f0 tx=0x7f83c8007810).stop 2021-11-15T14:34:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 msgr2=0x7f83cc0aa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f83c40032f0 tx=0x7f83c400b530).stop 2021-11-15T14:34:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 shutdown_connections 2021-11-15T14:34:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83ac0536f0 0x7f83ac055bb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83cc0b0900 0x7f83cc0aa8c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83cc0b0520 0x7f83cc142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 --2- 172.21.2.135:0/275697711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83cc0aa1a0 0x7f83cc14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 >> 172.21.2.135:0/275697711 conn(0x7f83cc060840 msgr2=0x7f83cc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 shutdown_connections 2021-11-15T14:34:44.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.557+0000 7f83d33ab700 1 -- 172.21.2.135:0/275697711 wait complete. 2021-11-15T14:34:44.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:44.568 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:44.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 Processor -- start 2021-11-15T14:34:44.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 -- start start 2021-11-15T14:34:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd5140b0630 0x7fd5140b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd5140a9c90 0x7fd5140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5141439a0 con 0x7fd5140b3790 2021-11-15T14:34:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd514143c40 con 0x7fd5140b0630 2021-11-15T14:34:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51c33d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd514143ee0 con 0x7fd5140a9c90 2021-11-15T14:34:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd5140a9c90 0x7fd5140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd5140a9c90 0x7fd5140b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55590/0 (socket says 172.21.2.135:55590) 2021-11-15T14:34:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 -- 172.21.2.135:0/2228358092 learned_addr learned my addr 172.21.2.135:0/2228358092 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 -- 172.21.2.135:0/2228358092 >> v2:172.21.2.119:3300/0 conn(0x7fd5140b0630 msgr2=0x7fd5140b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 --2- 172.21.2.135:0/2228358092 >> v2:172.21.2.119:3300/0 conn(0x7fd5140b0630 0x7fd5140b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 -- 172.21.2.135:0/2228358092 >> v1:172.21.2.119:6789/0 conn(0x7fd5140b3790 legacy=0x7fd51413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 -- 172.21.2.135:0/2228358092 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514144180 con 0x7fd5140a9c90 2021-11-15T14:34:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd51a8da700 1 --2- 172.21.2.135:0/2228358092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140a9c90 0x7fd5140b1130 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd51406aad0 tx=0x7fd50c00b530).ready entity=mon.1 client_cookie=e5379ab0b63ec5c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd5190d7700 1 -- 172.21.2.135:0/2228358092 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c00be70 con 0x7fd5140a9c90 2021-11-15T14:34:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd5190d7700 1 -- 172.21.2.135:0/2228358092 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c010470 con 0x7fd5140a9c90 2021-11-15T14:34:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.617+0000 7fd5190d7700 1 -- 172.21.2.135:0/2228358092 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50c0107d0 con 0x7fd5140a9c90 2021-11-15T14:34:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2228358092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140a9c90 msgr2=0x7fd5140b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2228358092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140a9c90 0x7fd5140b1130 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd51406aad0 tx=0x7fd50c00b530).stop 2021-11-15T14:34:44.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2228358092 shutdown_connections 2021-11-15T14:34:44.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2228358092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140a9c90 0x7fd5140b1130 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2228358092 >> v2:172.21.2.119:3300/0 conn(0x7fd5140b0630 0x7fd5140b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2228358092 >> 172.21.2.135:0/2228358092 conn(0x7fd514060840 msgr2=0x7fd514060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2228358092 shutdown_connections 2021-11-15T14:34:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2228358092 wait complete. 2021-11-15T14:34:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 Processor -- start 2021-11-15T14:34:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- start start 2021-11-15T14:34:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5140a9c90 0x7fd5140aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5140b3790 0x7fd51413f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514155d10 con 0x7fd5140b3790 2021-11-15T14:34:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514148680 con 0x7fd5140b0630 2021-11-15T14:34:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd514140190 con 0x7fd5140a9c90 2021-11-15T14:34:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55592/0 (socket says 172.21.2.135:55592) 2021-11-15T14:34:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 -- 172.21.2.135:0/2536502679 learned_addr learned my addr 172.21.2.135:0/2536502679 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 -- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5140a9c90 msgr2=0x7fd5140aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5140a9c90 0x7fd5140aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 -- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5140b3790 msgr2=0x7fd51413f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5140b3790 0x7fd51413f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 -- 172.21.2.135:0/2536502679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c00b7d0 con 0x7fd5140b0630 2021-11-15T14:34:44.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5198d8700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd508002ef0 tx=0x7fd508006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508009e00 con 0x7fd5140b0630 2021-11-15T14:34:44.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508002320 con 0x7fd5140b0630 2021-11-15T14:34:44.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51413e760 con 0x7fd5140b0630 2021-11-15T14:34:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51413fe50 con 0x7fd5140b0630 2021-11-15T14:34:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508002680 con 0x7fd5140b0630 2021-11-15T14:34:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514140350 con 0x7fd5140b0630 2021-11-15T14:34:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd50800f030 con 0x7fd5140b0630 2021-11-15T14:34:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 0x7fd4f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.621+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd50806b8f0 con 0x7fd5140b0630 2021-11-15T14:34:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.625+0000 7fd51a0d9700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 0x7fd4f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.625+0000 7fd51a0d9700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 0x7fd4f4055ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd510002f70 tx=0x7fd510006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.625+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5080427e0 con 0x7fd5140b0630 2021-11-15T14:34:44.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd51413dce0 con 0x7fd5140b0630 2021-11-15T14:34:44.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd5077fe700 1 -- 172.21.2.135:0/2536502679 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd508045e00 con 0x7fd5140b0630 2021-11-15T14:34:44.713 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 msgr2=0x7fd4f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 0x7fd4f4055ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd510002f70 tx=0x7fd510006a80).stop 2021-11-15T14:34:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 msgr2=0x7fd51413f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd508002ef0 tx=0x7fd508006d40).stop 2021-11-15T14:34:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 shutdown_connections 2021-11-15T14:34:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053610 0x7fd4f4055ad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5140b3790 0x7fd51413f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5140b0630 0x7fd51413f470 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 --2- 172.21.2.135:0/2536502679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5140a9c90 0x7fd5140aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 >> 172.21.2.135:0/2536502679 conn(0x7fd514060840 msgr2=0x7fd514060010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 shutdown_connections 2021-11-15T14:34:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.709+0000 7fd51c33d700 1 -- 172.21.2.135:0/2536502679 wait complete. 2021-11-15T14:34:44.720 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 Processor -- start 2021-11-15T14:34:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- start start 2021-11-15T14:34:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff9e40b1140 0x7ff9e40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9e40acbf0 0x7ff9e4140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40ac840 con 0x7ff9e413d4e0 2021-11-15T14:34:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e4141110 con 0x7ff9e40b1140 2021-11-15T14:34:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40ac0a0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9e40acbf0 0x7ff9e4140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9e40acbf0 0x7ff9e4140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55604/0 (socket says 172.21.2.135:55604) 2021-11-15T14:34:44.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 -- 172.21.2.135:0/3302252186 learned_addr learned my addr 172.21.2.135:0/3302252186 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 -- 172.21.2.135:0/3302252186 >> v2:172.21.2.119:3300/0 conn(0x7ff9e40b1140 msgr2=0x7ff9e40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 --2- 172.21.2.135:0/3302252186 >> v2:172.21.2.119:3300/0 conn(0x7ff9e40b1140 0x7ff9e40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 -- 172.21.2.135:0/3302252186 >> v1:172.21.2.119:6789/0 conn(0x7ff9e413d4e0 legacy=0x7ff9e40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:44.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 -- 172.21.2.135:0/3302252186 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40ac300 con 0x7ff9e40acbf0 2021-11-15T14:34:44.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e1d9b700 1 --2- 172.21.2.135:0/3302252186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e4140c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff9e40a9e30 tx=0x7ff9cc006f40).ready entity=mon.1 client_cookie=12e94f4ddb062b99 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e159a700 1 -- 172.21.2.135:0/3302252186 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9cc00dc30 con 0x7ff9e40acbf0 2021-11-15T14:34:44.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e159a700 1 -- 172.21.2.135:0/3302252186 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc000e90 con 0x7ff9e40acbf0 2021-11-15T14:34:44.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e159a700 1 -- 172.21.2.135:0/3302252186 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9cc00be90 con 0x7ff9e40acbf0 2021-11-15T14:34:44.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3302252186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 msgr2=0x7ff9e4140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3302252186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e4140c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff9e40a9e30 tx=0x7ff9cc006f40).stop 2021-11-15T14:34:44.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3302252186 shutdown_connections 2021-11-15T14:34:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3302252186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e4140c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3302252186 >> v2:172.21.2.119:3300/0 conn(0x7ff9e40b1140 0x7ff9e40b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3302252186 >> 172.21.2.135:0/3302252186 conn(0x7ff9e405f730 msgr2=0x7ff9e405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3302252186 shutdown_connections 2021-11-15T14:34:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.769+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3302252186 wait complete. 2021-11-15T14:34:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 Processor -- start 2021-11-15T14:34:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- start start 2021-11-15T14:34:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9e40b1140 0x7ff9e40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9e413d4e0 0x7ff9e414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40b4070 con 0x7ff9e413d4e0 2021-11-15T14:34:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41528e0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e4152b80 con 0x7ff9e40b1140 2021-11-15T14:34:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55608/0 (socket says 172.21.2.135:55608) 2021-11-15T14:34:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 -- 172.21.2.135:0/3136554815 learned_addr learned my addr 172.21.2.135:0/3136554815 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 -- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9e40b1140 msgr2=0x7ff9e40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9e40b1140 0x7ff9e40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 -- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9e413d4e0 msgr2=0x7ff9e414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9e413d4e0 0x7ff9e414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 -- 172.21.2.135:0/3136554815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc00b460 con 0x7ff9e40acbf0 2021-11-15T14:34:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e259c700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4013460 con 0x7ff9e40acbf0 2021-11-15T14:34:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40135c0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4013920 con 0x7ff9e40acbf0 2021-11-15T14:34:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e40b3930 con 0x7ff9e40acbf0 2021-11-15T14:34:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e41412c0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e40ac5a0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff9d401a060 con 0x7ff9e40acbf0 2021-11-15T14:34:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 0x7ff9c8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff9d406b660 con 0x7ff9e40acbf0 2021-11-15T14:34:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.773+0000 7ff9e1d9b700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 0x7ff9c8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.777+0000 7ff9e1d9b700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 0x7ff9c8055b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff9e40a9e30 tx=0x7ff9e40ac490).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.777+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9d4042550 con 0x7ff9e40acbf0 2021-11-15T14:34:44.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9e40573d0 con 0x7ff9e40acbf0 2021-11-15T14:34:44.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9db7fe700 1 -- 172.21.2.135:0/3136554815 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff9d4018030 con 0x7ff9e40acbf0 2021-11-15T14:34:44.861 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:44.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 msgr2=0x7ff9c8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 0x7ff9c8055b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff9e40a9e30 tx=0x7ff9e40ac490).stop 2021-11-15T14:34:44.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 msgr2=0x7ff9e40ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ff9d4002f70 tx=0x7ff9d4006ec0).stop 2021-11-15T14:34:44.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 shutdown_connections 2021-11-15T14:34:44.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff9c8053660 0x7ff9c8055b20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9e413d4e0 0x7ff9e414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9e40b1140 0x7ff9e40b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 --2- 172.21.2.135:0/3136554815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9e40acbf0 0x7ff9e40ab450 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 >> 172.21.2.135:0/3136554815 conn(0x7ff9e405f730 msgr2=0x7ff9e4137690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 shutdown_connections 2021-11-15T14:34:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.857+0000 7ff9e8fff700 1 -- 172.21.2.135:0/3136554815 wait complete. 2021-11-15T14:34:44.868 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:44.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 Processor -- start 2021-11-15T14:34:44.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- start start 2021-11-15T14:34:44.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f36080b1f40 0x7f36080b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b0030 0x7f36080b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36080b04a0 con 0x7f36080a7140 2021-11-15T14:34:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080b2810 con 0x7f36080b1f40 2021-11-15T14:34:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36080b06d0 con 0x7f36080b0030 2021-11-15T14:34:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f36080b1f40 0x7f36080b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f36080b1f40 0x7f36080b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55614/0 (socket says 172.21.2.135:55614) 2021-11-15T14:34:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 -- 172.21.2.135:0/3163393796 learned_addr learned my addr 172.21.2.135:0/3163393796 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 -- 172.21.2.135:0/3163393796 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b0030 msgr2=0x7f36080b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 --2- 172.21.2.135:0/3163393796 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b0030 0x7f36080b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 -- 172.21.2.135:0/3163393796 >> v1:172.21.2.119:6789/0 conn(0x7f36080a7140 legacy=0x7f36081412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 -- 172.21.2.135:0/3163393796 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080b0970 con 0x7f36080b1f40 2021-11-15T14:34:44.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3606d9d700 1 --2- 172.21.2.135:0/3163393796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080b1f40 0x7f36080b1350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f360806a170 tx=0x7f35fc006eb0).ready entity=mon.1 client_cookie=1a268a0cc7c8eb3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3605d9b700 1 -- 172.21.2.135:0/3163393796 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc00d570 con 0x7f36080b1f40 2021-11-15T14:34:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3605d9b700 1 -- 172.21.2.135:0/3163393796 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc000e90 con 0x7f36080b1f40 2021-11-15T14:34:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f3605d9b700 1 -- 172.21.2.135:0/3163393796 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc00d8c0 con 0x7f36080b1f40 2021-11-15T14:34:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- 172.21.2.135:0/3163393796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080b1f40 msgr2=0x7f36080b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- 172.21.2.135:0/3163393796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080b1f40 0x7f36080b1350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f360806a170 tx=0x7f35fc006eb0).stop 2021-11-15T14:34:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- 172.21.2.135:0/3163393796 shutdown_connections 2021-11-15T14:34:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- 172.21.2.135:0/3163393796 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b0030 0x7f36080b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- 172.21.2.135:0/3163393796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080b1f40 0x7f36080b1350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- 172.21.2.135:0/3163393796 >> 172.21.2.135:0/3163393796 conn(0x7f360805f730 msgr2=0x7f360805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- 172.21.2.135:0/3163393796 shutdown_connections 2021-11-15T14:34:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- 172.21.2.135:0/3163393796 wait complete. 2021-11-15T14:34:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 Processor -- start 2021-11-15T14:34:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 -- start start 2021-11-15T14:34:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.929+0000 7f360d0b6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36080b0030 0x7f3608153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b1f40 0x7f3608154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3608154920 con 0x7f36080b0030 2021-11-15T14:34:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080ac270 con 0x7f36080a7140 2021-11-15T14:34:44.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36080abfd0 con 0x7f36080b1f40 2021-11-15T14:34:44.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55620/0 (socket says 172.21.2.135:55620) 2021-11-15T14:34:44.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 -- 172.21.2.135:0/2506353853 learned_addr learned my addr 172.21.2.135:0/2506353853 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:44.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 -- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b1f40 msgr2=0x7f3608154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b1f40 0x7f3608154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 -- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36080b0030 msgr2=0x7f3608153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:44.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36080b0030 0x7f3608153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:44.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 -- 172.21.2.135:0/2506353853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc00b1e0 con 0x7f36080a7140 2021-11-15T14:34:44.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f3606d9d700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f3608156c30 tx=0x7f35fc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc011c60 con 0x7f36080a7140 2021-11-15T14:34:44.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc011dc0 con 0x7f36080a7140 2021-11-15T14:34:44.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3608157790 con 0x7f36080a7140 2021-11-15T14:34:44.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc01e650 con 0x7f36080a7140 2021-11-15T14:34:44.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36080a9b20 con 0x7f36080a7140 2021-11-15T14:34:44.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360814a830 con 0x7f36080a7140 2021-11-15T14:34:44.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35fc025030 con 0x7f36080a7140 2021-11-15T14:34:44.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 0x7f35e40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:44.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f35fc06d120 con 0x7f36080a7140 2021-11-15T14:34:44.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360659c700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 0x7f35e40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:44.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.933+0000 7f360659c700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 0x7f35e40559b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f35f8002fb0 tx=0x7f35f80069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:44.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:44.937+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35fc044010 con 0x7f36080a7140 2021-11-15T14:34:45.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36081575d0 con 0x7f36080a7140 2021-11-15T14:34:45.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f35f7fff700 1 -- 172.21.2.135:0/2506353853 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f35fc0230a0 con 0x7f36080a7140 2021-11-15T14:34:45.024 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:45.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 msgr2=0x7f35e40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 0x7f35e40559b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f35f8002fb0 tx=0x7f35f80069b0).stop 2021-11-15T14:34:45.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 msgr2=0x7f360814a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f3608156c30 tx=0x7f35fc015000).stop 2021-11-15T14:34:45.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 shutdown_connections 2021-11-15T14:34:45.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35e40534f0 0x7f35e40559b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36080b1f40 0x7f3608154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36080b0030 0x7f3608153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 --2- 172.21.2.135:0/2506353853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36080a7140 0x7f360814a000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 >> 172.21.2.135:0/2506353853 conn(0x7f360805f730 msgr2=0x7f36080a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 shutdown_connections 2021-11-15T14:34:45.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.021+0000 7f360d0b6700 1 -- 172.21.2.135:0/2506353853 wait complete. 2021-11-15T14:34:45.031 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.077+0000 7f83a5c50700 1 Processor -- start 2021-11-15T14:34:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.077+0000 7f83a5c50700 1 -- start start 2021-11-15T14:34:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 0x7f83a0064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f83a00b2ca0 0x7f83a0065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00b2430 con 0x7f83a00b3950 2021-11-15T14:34:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a0065770 con 0x7f83a0060040 2021-11-15T14:34:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a00b26d0 con 0x7f83a00b2ca0 2021-11-15T14:34:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f83a00b2ca0 0x7f83a0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839effd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f83a00b3950 0x7f83a00b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43216/0 (socket says 172.21.2.135:43216) 2021-11-15T14:34:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f83a00b2ca0 0x7f83a0065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55632/0 (socket says 172.21.2.135:55632) 2021-11-15T14:34:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839effd700 1 -- 172.21.2.135:0/4116495878 learned_addr learned my addr 172.21.2.135:0/4116495878 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:45.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- 172.21.2.135:0/4116495878 >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 0x7f83a0064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 -- 172.21.2.135:0/4116495878 >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 msgr2=0x7f83a0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 --2- 172.21.2.135:0/4116495878 >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 0x7f83a0064d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 -- 172.21.2.135:0/4116495878 >> v1:172.21.2.135:6789/0 conn(0x7f83a00b3950 legacy=0x7f83a00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 -- 172.21.2.135:0/4116495878 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00b2970 con 0x7f83a00b2ca0 2021-11-15T14:34:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- 172.21.2.135:0/4116495878 >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 0x7f83a0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839ffff700 1 --2- 172.21.2.135:0/4116495878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a00b2ca0 0x7f83a0065280 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f83980032f0 tx=0x7f83980091d0).ready entity=mon.1 client_cookie=5de1e1f2b9ec1024 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839e7fc700 1 -- 172.21.2.135:0/4116495878 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8398009ea0 con 0x7f83a00b2ca0 2021-11-15T14:34:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839e7fc700 1 -- 172.21.2.135:0/4116495878 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800b870 con 0x7f83a00b2ca0 2021-11-15T14:34:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839e7fc700 1 -- 172.21.2.135:0/4116495878 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f839800b9e0 con 0x7f83a00b2ca0 2021-11-15T14:34:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- 172.21.2.135:0/4116495878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a00b2ca0 msgr2=0x7f83a0065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- 172.21.2.135:0/4116495878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a00b2ca0 0x7f83a0065280 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f83980032f0 tx=0x7f83980091d0).stop 2021-11-15T14:34:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- 172.21.2.135:0/4116495878 shutdown_connections 2021-11-15T14:34:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- 172.21.2.135:0/4116495878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a00b2ca0 0x7f83a0065280 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- 172.21.2.135:0/4116495878 >> v2:172.21.2.119:3300/0 conn(0x7f83a0060040 0x7f83a0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- 172.21.2.135:0/4116495878 >> 172.21.2.135:0/4116495878 conn(0x7f83a005cfe0 msgr2=0x7f83a005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- 172.21.2.135:0/4116495878 shutdown_connections 2021-11-15T14:34:45.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- 172.21.2.135:0/4116495878 wait complete. 2021-11-15T14:34:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 Processor -- start 2021-11-15T14:34:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- start start 2021-11-15T14:34:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83a00b2ca0 0x7f83a00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83a00b3950 0x7f83a00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00ab510 con 0x7f83a00b2ca0 2021-11-15T14:34:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00ab7b0 con 0x7f83a0060040 2021-11-15T14:34:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f83a5c50700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00aba50 con 0x7f83a00b3950 2021-11-15T14:34:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55636/0 (socket says 172.21.2.135:55636) 2021-11-15T14:34:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 -- 172.21.2.135:0/2027010308 learned_addr learned my addr 172.21.2.135:0/2027010308 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 -- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83a00b3950 msgr2=0x7f83a00ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83a00b3950 0x7f83a00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 -- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83a00b2ca0 msgr2=0x7f83a00abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83a00b2ca0 0x7f83a00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.081+0000 7f839f7fe700 1 -- 172.21.2.135:0/2027010308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009470 con 0x7f83a0060040 2021-11-15T14:34:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839f7fe700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8390007000 tx=0x7f8390008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8390010580 con 0x7f83a0060040 2021-11-15T14:34:45.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900106e0 con 0x7f83a0060040 2021-11-15T14:34:45.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8390010a40 con 0x7f83a0060040 2021-11-15T14:34:45.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a01535d0 con 0x7f83a0060040 2021-11-15T14:34:45.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a00aff80 con 0x7f83a0060040 2021-11-15T14:34:45.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a00abc10 con 0x7f83a0060040 2021-11-15T14:34:45.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8390010ba0 con 0x7f83a0060040 2021-11-15T14:34:45.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 0x7f8384055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f839006bd30 con 0x7f83a0060040 2021-11-15T14:34:45.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839effd700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 0x7f8384055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.085+0000 7f839effd700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 0x7f8384055a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f83a013b870 tx=0x7f8388007860).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.089+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8390042c20 con 0x7f83a0060040 2021-11-15T14:34:45.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83a00648f0 con 0x7f83a0060040 2021-11-15T14:34:45.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f839cff9700 1 -- 172.21.2.135:0/2027010308 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8390046240 con 0x7f83a0060040 2021-11-15T14:34:45.172 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:45.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 msgr2=0x7f8384055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 0x7f8384055a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f83a013b870 tx=0x7f8388007860).stop 2021-11-15T14:34:45.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 msgr2=0x7f83a00b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8390007000 tx=0x7f8390008040).stop 2021-11-15T14:34:45.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 shutdown_connections 2021-11-15T14:34:45.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f83840535d0 0x7f8384055a90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83a00b3950 0x7f83a00ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83a00b2ca0 0x7f83a00abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 --2- 172.21.2.135:0/2027010308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f83a0060040 0x7f83a00b6530 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 >> 172.21.2.135:0/2027010308 conn(0x7f83a005cfe0 msgr2=0x7f83a0142e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 shutdown_connections 2021-11-15T14:34:45.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.169+0000 7f83a5c50700 1 -- 172.21.2.135:0/2027010308 wait complete. 2021-11-15T14:34:45.179 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:45.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.225+0000 7f4a35365700 1 Processor -- start 2021-11-15T14:34:45.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.225+0000 7f4a35365700 1 -- start start 2021-11-15T14:34:45.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4a30144080 0x7f4a3014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300aac30 con 0x7f4a30067380 2021-11-15T14:34:45.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a30060560 con 0x7f4a30060180 2021-11-15T14:34:45.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a30066f20 con 0x7f4a30144080 2021-11-15T14:34:45.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f4a30060180 0x7f4a300b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43230/0 (socket says 172.21.2.135:43230) 2021-11-15T14:34:45.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 -- 172.21.2.135:0/1393333721 learned_addr learned my addr 172.21.2.135:0/1393333721 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:45.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765974588 0 0) 0x7f4a30060560 con 0x7f4a30060180 2021-11-15T14:34:45.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a10003260 con 0x7f4a30060180 2021-11-15T14:34:45.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2f7fe700 1 --2- 172.21.2.135:0/1393333721 >> v2:172.21.2.119:3300/0 conn(0x7f4a30144080 0x7f4a3014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063963360 0 0) 0x7f4a10003260 con 0x7f4a30060180 2021-11-15T14:34:45.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 >> v2:172.21.2.119:3300/0 conn(0x7f4a30144080 msgr2=0x7f4a3014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 --2- 172.21.2.135:0/1393333721 >> v2:172.21.2.119:3300/0 conn(0x7f4a30144080 0x7f4a3014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 >> v1:172.21.2.119:6789/0 conn(0x7f4a30067380 legacy=0x7f4a30143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300b3430 con 0x7f4a30060180 2021-11-15T14:34:45.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f4a18001660 con 0x7f4a30060180 2021-11-15T14:34:45.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 >> v1:172.21.2.135:6789/0 conn(0x7f4a30060180 legacy=0x7f4a300b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 0x7f4a10003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a10004500 0x7f4a10004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10005050 0x7f4a1000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30066f20 con 0x7f4a10004500 2021-11-15T14:34:45.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10010350 con 0x7f4a10003820 2021-11-15T14:34:45.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10010510 con 0x7f4a10005050 2021-11-15T14:34:45.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 0x7f4a10003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 -- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10005050 msgr2=0x7f4a1000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10005050 0x7f4a1000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 -- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a10004500 msgr2=0x7f4a10004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a10004500 0x7f4a10004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 -- 172.21.2.135:0/1393333721 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10003260 con 0x7f4a10003820 2021-11-15T14:34:45.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2f7fe700 1 -- 172.21.2.135:0/1393333721 reap_dead start 2021-11-15T14:34:45.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2effd700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 0x7f4a10003c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4a3005f260 tx=0x7f4a300b1a10).ready entity=mon.1 client_cookie=a84ce1227d70754c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a180070d0 con 0x7f4a10003820 2021-11-15T14:34:45.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18007230 con 0x7f4a10003820 2021-11-15T14:34:45.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2dffb700 1 -- 172.21.2.135:0/1393333721 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1800c8f0 con 0x7f4a10003820 2021-11-15T14:34:45.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 msgr2=0x7f4a10003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 0x7f4a10003c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4a3005f260 tx=0x7f4a300b1a10).stop 2021-11-15T14:34:45.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- 172.21.2.135:0/1393333721 shutdown_connections 2021-11-15T14:34:45.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- 172.21.2.135:0/1393333721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a10003820 0x7f4a10003c20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- 172.21.2.135:0/1393333721 >> 172.21.2.135:0/1393333721 conn(0x7f4a3005cfb0 msgr2=0x7f4a3005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- 172.21.2.135:0/1393333721 shutdown_connections 2021-11-15T14:34:45.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- 172.21.2.135:0/1393333721 wait complete. 2021-11-15T14:34:45.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 Processor -- start 2021-11-15T14:34:45.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- start start 2021-11-15T14:34:45.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10003820 0x7f4a3013ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a30141f80 0x7f4a300b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b1090 con 0x7f4a30141f80 2021-11-15T14:34:45.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300ab950 con 0x7f4a301388a0 2021-11-15T14:34:45.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a35365700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300abbf0 con 0x7f4a10003820 2021-11-15T14:34:45.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55656/0 (socket says 172.21.2.135:55656) 2021-11-15T14:34:45.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.229+0000 7f4a2f7fe700 1 -- 172.21.2.135:0/866258232 learned_addr learned my addr 172.21.2.135:0/866258232 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 -- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10003820 msgr2=0x7f4a3013ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10003820 0x7f4a3013ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 -- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a30141f80 msgr2=0x7f4a300b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a30141f80 0x7f4a300b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 -- 172.21.2.135:0/866258232 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300abe90 con 0x7f4a301388a0 2021-11-15T14:34:45.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2f7fe700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4a18001370 tx=0x7f4a20008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a20012470 con 0x7f4a301388a0 2021-11-15T14:34:45.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a200125d0 con 0x7f4a301388a0 2021-11-15T14:34:45.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300ac130 con 0x7f4a301388a0 2021-11-15T14:34:45.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301393b0 con 0x7f4a301388a0 2021-11-15T14:34:45.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a20012930 con 0x7f4a301388a0 2021-11-15T14:34:45.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a08003410 con 0x7f4a301388a0 2021-11-15T14:34:45.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a20019030 con 0x7f4a301388a0 2021-11-15T14:34:45.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 0x7f4a14055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f4a2006b0d0 con 0x7f4a301388a0 2021-11-15T14:34:45.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2effd700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 0x7f4a14055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.233+0000 7f4a2effd700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 0x7f4a14055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4a3005f260 tx=0x7f4a18015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.237+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a20041fc0 con 0x7f4a301388a0 2021-11-15T14:34:45.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a080036c0 con 0x7f4a301388a0 2021-11-15T14:34:45.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a27fff700 1 -- 172.21.2.135:0/866258232 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f4a200455e0 con 0x7f4a301388a0 2021-11-15T14:34:45.324 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:45.324 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":25,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:30.790970+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:25.390706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:27.589267+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:45.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 msgr2=0x7f4a14055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 0x7f4a14055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4a3005f260 tx=0x7f4a18015000).stop 2021-11-15T14:34:45.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 msgr2=0x7f4a30138d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4a18001370 tx=0x7f4a20008040).stop 2021-11-15T14:34:45.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 shutdown_connections 2021-11-15T14:34:45.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4a140536a0 0x7f4a14055b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4a301388a0 0x7f4a30138d20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4a30141f80 0x7f4a300b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 --2- 172.21.2.135:0/866258232 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4a10003820 0x7f4a3013ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 >> 172.21.2.135:0/866258232 conn(0x7f4a3005cfb0 msgr2=0x7f4a3005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 shutdown_connections 2021-11-15T14:34:45.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.321+0000 7f4a35365700 1 -- 172.21.2.135:0/866258232 wait complete. 2021-11-15T14:34:45.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:25.390706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:27.589267+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:45.332 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:45.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 Processor -- start 2021-11-15T14:34:45.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 -- start start 2021-11-15T14:34:45.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f20a40b1f40 0x7f20a40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 0x7f20a40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40b04a0 con 0x7f20a40a7140 2021-11-15T14:34:45.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40b2810 con 0x7f20a40b1f40 2021-11-15T14:34:45.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20ab08d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b06d0 con 0x7f20a40b0030 2021-11-15T14:34:45.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a962a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f20a40a7140 0x7f20a41412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43250/0 (socket says 172.21.2.135:43250) 2021-11-15T14:34:45.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a962a700 1 -- 172.21.2.135:0/2219809603 learned_addr learned my addr 172.21.2.135:0/2219809603 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:45.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247496431 0 0) 0x7f20a40b04a0 con 0x7f20a40a7140 2021-11-15T14:34:45.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2084003260 con 0x7f20a40a7140 2021-11-15T14:34:45.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2206666093 0 0) 0x7f2084003260 con 0x7f20a40a7140 2021-11-15T14:34:45.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 msgr2=0x7f20a40b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 0x7f20a40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 >> v2:172.21.2.119:3300/0 conn(0x7f20a40b1f40 msgr2=0x7f20a40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 --2- 172.21.2.135:0/2219809603 >> v2:172.21.2.119:3300/0 conn(0x7f20a40b1f40 0x7f20a40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40b0970 con 0x7f20a40a7140 2021-11-15T14:34:45.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f209c0019e0 con 0x7f20a40a7140 2021-11-15T14:34:45.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 >> v1:172.21.2.135:6789/0 conn(0x7f20a40a7140 legacy=0x7f20a41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 0x7f2084003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2084003e10 0x7f2084004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f2084004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b2810 con 0x7f2084003e10 2021-11-15T14:34:45.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40b06d0 con 0x7f2084004b10 2021-11-15T14:34:45.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208400b9e0 con 0x7f20a40b0030 2021-11-15T14:34:45.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.381+0000 7f20a962a700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f2084004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 -- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 msgr2=0x7f2084003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b0030 0x7f2084003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 -- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2084003e10 msgr2=0x7f2084004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2084003e10 0x7f2084004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 -- 172.21.2.135:0/2219809603 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084003260 con 0x7f2084004b10 2021-11-15T14:34:45.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f2084004f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f209c0016f0 tx=0x7f20a40b2950).ready entity=mon.1 client_cookie=634ce7f18eed4e69 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209c00cd70 con 0x7f2084004b10 2021-11-15T14:34:45.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c005990 con 0x7f2084004b10 2021-11-15T14:34:45.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a37fe700 1 -- 172.21.2.135:0/2219809603 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209c005cf0 con 0x7f2084004b10 2021-11-15T14:34:45.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2219809603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 msgr2=0x7f2084004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2219809603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f2084004f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f209c0016f0 tx=0x7f20a40b2950).stop 2021-11-15T14:34:45.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a962a700 1 -- 172.21.2.135:0/2219809603 reap_dead start 2021-11-15T14:34:45.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2219809603 shutdown_connections 2021-11-15T14:34:45.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2219809603 >> 172.21.2.135:0/2219809603 conn(0x7f20a405f730 msgr2=0x7f20a405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2219809603 shutdown_connections 2021-11-15T14:34:45.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2219809603 wait complete. 2021-11-15T14:34:45.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 Processor -- start 2021-11-15T14:34:45.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- start start 2021-11-15T14:34:45.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b3e60 0x7f20a4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20a41543b0 0x7f20a40a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40a94a0 con 0x7f20a41543b0 2021-11-15T14:34:45.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4148ec0 con 0x7f2084004b10 2021-11-15T14:34:45.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4157830 con 0x7f20a40b3e60 2021-11-15T14:34:45.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55676/0 (socket says 172.21.2.135:55676) 2021-11-15T14:34:45.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 -- 172.21.2.135:0/2189634098 learned_addr learned my addr 172.21.2.135:0/2189634098 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 -- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b3e60 msgr2=0x7f20a4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b3e60 0x7f20a4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 -- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20a41543b0 msgr2=0x7f20a40a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20a41543b0 0x7f20a40a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 -- 172.21.2.135:0/2189634098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4157ad0 con 0x7f2084004b10 2021-11-15T14:34:45.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a8e29700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f20a40a97b0 tx=0x7f2094006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2094013460 con 0x7f2084004b10 2021-11-15T14:34:45.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20940135c0 con 0x7f2084004b10 2021-11-15T14:34:45.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2094013920 con 0x7f2084004b10 2021-11-15T14:34:45.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40ab300 con 0x7f2084004b10 2021-11-15T14:34:45.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a40ac290 con 0x7f2084004b10 2021-11-15T14:34:45.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.385+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40b0c10 con 0x7f2084004b10 2021-11-15T14:34:45.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f209400f070 con 0x7f2084004b10 2021-11-15T14:34:45.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a1ffb700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 0x7f2088055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f209406b3c0 con 0x7f2084004b10 2021-11-15T14:34:45.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a3fff700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 0x7f2088055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a3fff700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 0x7f2088055a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f208c002f70 tx=0x7f208c006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.389+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20940423c0 con 0x7f2084004b10 2021-11-15T14:34:45.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f20a40573d0 con 0x7f2084004b10 2021-11-15T14:34:45.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20a1ffb700 1 -- 172.21.2.135:0/2189634098 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f20940459e0 con 0x7f2084004b10 2021-11-15T14:34:45.476 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:45.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 msgr2=0x7f2088055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 0x7f2088055a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f208c002f70 tx=0x7f208c006a10).stop 2021-11-15T14:34:45.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 msgr2=0x7f20a40b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f20a40a97b0 tx=0x7f2094006ec0).stop 2021-11-15T14:34:45.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 shutdown_connections 2021-11-15T14:34:45.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20880535b0 0x7f2088055a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20a41543b0 0x7f20a40a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20a40b3e60 0x7f20a4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 --2- 172.21.2.135:0/2189634098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2084004b10 0x7f20a40b3970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 >> 172.21.2.135:0/2189634098 conn(0x7f20a405f730 msgr2=0x7f20a413b670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 shutdown_connections 2021-11-15T14:34:45.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.473+0000 7f20ab08d700 1 -- 172.21.2.135:0/2189634098 wait complete. 2021-11-15T14:34:45.483 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:45.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 Processor -- start 2021-11-15T14:34:45.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- start start 2021-11-15T14:34:45.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f91d00b2320 0x7f91d01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d00a7850 con 0x7f91d00b0030 2021-11-15T14:34:45.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00b0470 con 0x7f91d00b2320 2021-11-15T14:34:45.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00b06d0 con 0x7f91d00b1f40 2021-11-15T14:34:45.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f91d00b2320 0x7f91d01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91cdd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f91d00b0030 0x7f91d00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43270/0 (socket says 172.21.2.135:43270) 2021-11-15T14:34:45.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91cdd9b700 1 -- 172.21.2.135:0/2815439855 learned_addr learned my addr 172.21.2.135:0/2815439855 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:45.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 -- 172.21.2.135:0/2815439855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 msgr2=0x7f91d00b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 --2- 172.21.2.135:0/2815439855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 -- 172.21.2.135:0/2815439855 >> v1:172.21.2.135:6789/0 conn(0x7f91d00b0030 legacy=0x7f91d00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 -- 172.21.2.135:0/2815439855 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00b0970 con 0x7f91d00b2320 2021-11-15T14:34:45.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91ced9d700 1 --2- 172.21.2.135:0/2815439855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b2320 0x7f91d01412d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f91c80032f0 tx=0x7f91c80091d0).ready entity=mon.1 client_cookie=7e4d65321d29e1e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91cd59a700 1 -- 172.21.2.135:0/2815439855 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c8009ea0 con 0x7f91d00b2320 2021-11-15T14:34:45.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91cd59a700 1 -- 172.21.2.135:0/2815439855 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c800b8a0 con 0x7f91d00b2320 2021-11-15T14:34:45.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91cd59a700 1 -- 172.21.2.135:0/2815439855 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c800ba10 con 0x7f91d00b2320 2021-11-15T14:34:45.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- 172.21.2.135:0/2815439855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b2320 msgr2=0x7f91d01412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/2815439855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b2320 0x7f91d01412d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f91c80032f0 tx=0x7f91c80091d0).stop 2021-11-15T14:34:45.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- 172.21.2.135:0/2815439855 shutdown_connections 2021-11-15T14:34:45.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/2815439855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b2320 0x7f91d01412d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/2815439855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- 172.21.2.135:0/2815439855 >> 172.21.2.135:0/2815439855 conn(0x7f91d005f730 msgr2=0x7f91d005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- 172.21.2.135:0/2815439855 shutdown_connections 2021-11-15T14:34:45.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.533+0000 7f91d4a1b700 1 -- 172.21.2.135:0/2815439855 wait complete. 2021-11-15T14:34:45.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 Processor -- start 2021-11-15T14:34:45.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- start start 2021-11-15T14:34:45.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f91d00b2320 0x7f91d014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00a9580 con 0x7f91d00b2320 2021-11-15T14:34:45.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00a9770 con 0x7f91d00b0030 2021-11-15T14:34:45.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00aa6c0 con 0x7f91d00b1f40 2021-11-15T14:34:45.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55688/0 (socket says 172.21.2.135:55688) 2021-11-15T14:34:45.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 -- 172.21.2.135:0/1006687462 learned_addr learned my addr 172.21.2.135:0/1006687462 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 -- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 msgr2=0x7f91d00aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 -- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f91d00b2320 msgr2=0x7f91d014c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f91d00b2320 0x7f91d014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 -- 172.21.2.135:0/1006687462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009470 con 0x7f91d00b0030 2021-11-15T14:34:45.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91ce59c700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f91c0002f70 tx=0x7f91c0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c0013460 con 0x7f91d00b0030 2021-11-15T14:34:45.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c00135c0 con 0x7f91d00b0030 2021-11-15T14:34:45.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d00aaa00 con 0x7f91d00b0030 2021-11-15T14:34:45.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c0013920 con 0x7f91d00b0030 2021-11-15T14:34:45.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d014aa20 con 0x7f91d00b0030 2021-11-15T14:34:45.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00aa500 con 0x7f91d00b0030 2021-11-15T14:34:45.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f91c000f070 con 0x7f91d00b0030 2021-11-15T14:34:45.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 0x7f91b4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f91c006b4c0 con 0x7f91d00b0030 2021-11-15T14:34:45.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.537+0000 7f91cdd9b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 0x7f91b4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.541+0000 7f91cdd9b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 0x7f91b4055a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f91d006a170 tx=0x7f91b8007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.541+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91c00423b0 con 0x7f91d00b0030 2021-11-15T14:34:45.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91d00b0c10 con 0x7f91d00b0030 2021-11-15T14:34:45.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91c77fe700 1 -- 172.21.2.135:0/1006687462 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91c00459d0 con 0x7f91d00b0030 2021-11-15T14:34:45.630 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:45.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 msgr2=0x7f91b4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 0x7f91b4055a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f91d006a170 tx=0x7f91b8007800).stop 2021-11-15T14:34:45.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 msgr2=0x7f91d0145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f91c0002f70 tx=0x7f91c0006ec0).stop 2021-11-15T14:34:45.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 shutdown_connections 2021-11-15T14:34:45.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f91b40535b0 0x7f91b4055a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f91d00b2320 0x7f91d014c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f91d00b1f40 0x7f91d00aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 --2- 172.21.2.135:0/1006687462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f91d00b0030 0x7f91d0145330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 >> 172.21.2.135:0/1006687462 conn(0x7f91d005f730 msgr2=0x7f91d00ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 shutdown_connections 2021-11-15T14:34:45.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.625+0000 7f91d4a1b700 1 -- 172.21.2.135:0/1006687462 wait complete. 2021-11-15T14:34:45.636 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:34:45.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 Processor -- start 2021-11-15T14:34:45.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- start start 2021-11-15T14:34:45.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f16f4060040 0x7f16f4064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f16f40b3950 0x7f16f4065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40b2430 con 0x7f16f40b2ca0 2021-11-15T14:34:45.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f4065770 con 0x7f16f4060040 2021-11-15T14:34:45.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40b26d0 con 0x7f16f40b3950 2021-11-15T14:34:45.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f16f40b3950 0x7f16f4065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f16f40b3950 0x7f16f4065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55698/0 (socket says 172.21.2.135:55698) 2021-11-15T14:34:45.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 -- 172.21.2.135:0/1118782890 learned_addr learned my addr 172.21.2.135:0/1118782890 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 -- 172.21.2.135:0/1118782890 >> v2:172.21.2.119:3300/0 conn(0x7f16f4060040 msgr2=0x7f16f4064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:45.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 --2- 172.21.2.135:0/1118782890 >> v2:172.21.2.119:3300/0 conn(0x7f16f4060040 0x7f16f4064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 -- 172.21.2.135:0/1118782890 >> v1:172.21.2.119:6789/0 conn(0x7f16f40b2ca0 legacy=0x7f16f40b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 -- 172.21.2.135:0/1118782890 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40b2970 con 0x7f16f40b3950 2021-11-15T14:34:45.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f27fc700 1 --2- 172.21.2.135:0/1118782890 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f4065280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f16f413b870 tx=0x7f16e4006eb0).ready entity=mon.1 client_cookie=49bc208215053dcf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f1ffb700 1 -- 172.21.2.135:0/1118782890 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e400d5c0 con 0x7f16f40b3950 2021-11-15T14:34:45.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f1ffb700 1 -- 172.21.2.135:0/1118782890 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e4000e90 con 0x7f16f40b3950 2021-11-15T14:34:45.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f1ffb700 1 -- 172.21.2.135:0/1118782890 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e400d910 con 0x7f16f40b3950 2021-11-15T14:34:45.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- 172.21.2.135:0/1118782890 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 msgr2=0x7f16f4065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1118782890 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f4065280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f16f413b870 tx=0x7f16e4006eb0).stop 2021-11-15T14:34:45.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- 172.21.2.135:0/1118782890 shutdown_connections 2021-11-15T14:34:45.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1118782890 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f4065280 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1118782890 >> v2:172.21.2.119:3300/0 conn(0x7f16f4060040 0x7f16f4064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- 172.21.2.135:0/1118782890 >> 172.21.2.135:0/1118782890 conn(0x7f16f405cfe0 msgr2=0x7f16f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- 172.21.2.135:0/1118782890 shutdown_connections 2021-11-15T14:34:45.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.685+0000 7f16f95a2700 1 -- 172.21.2.135:0/1118782890 wait complete. 2021-11-15T14:34:45.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 Processor -- start 2021-11-15T14:34:45.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- start start 2021-11-15T14:34:45.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16f4060040 0x7f16f4157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16f40b2ca0 0x7f16f40b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b0f40 con 0x7f16f40b2ca0 2021-11-15T14:34:45.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b11e0 con 0x7f16f40b3950 2021-11-15T14:34:45.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b1480 con 0x7f16f4060040 2021-11-15T14:34:45.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55700/0 (socket says 172.21.2.135:55700) 2021-11-15T14:34:45.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 -- 172.21.2.135:0/1188696151 learned_addr learned my addr 172.21.2.135:0/1188696151 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 -- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16f4060040 msgr2=0x7f16f4157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16f4060040 0x7f16f4157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 -- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16f40b2ca0 msgr2=0x7f16f40b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16f40b2ca0 0x7f16f40b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 -- 172.21.2.135:0/1188696151 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e400b1e0 con 0x7f16f40b3950 2021-11-15T14:34:45.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f37fe700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f16ec003310 tx=0x7f16ec0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16ec001500 con 0x7f16f40b3950 2021-11-15T14:34:45.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec001660 con 0x7f16f40b3950 2021-11-15T14:34:45.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f413b8b0 con 0x7f16f40b3950 2021-11-15T14:34:45.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f40ad520 con 0x7f16f40b3950 2021-11-15T14:34:45.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16ec0019c0 con 0x7f16f40b3950 2021-11-15T14:34:45.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f40b1640 con 0x7f16f40b3950 2021-11-15T14:34:45.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f16ec018030 con 0x7f16f40b3950 2021-11-15T14:34:45.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 0x7f16d8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f16ec06b5f0 con 0x7f16f40b3950 2021-11-15T14:34:45.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.689+0000 7f16f2ffd700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 0x7f16d8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.693+0000 7f16f2ffd700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 0x7f16d8055bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f16dc002f70 tx=0x7f16dc006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.693+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16ec042590 con 0x7f16f40b3950 2021-11-15T14:34:45.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16f40648f0 con 0x7f16f40b3950 2021-11-15T14:34:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16ebfff700 1 -- 172.21.2.135:0/1188696151 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f16ec045bb0 con 0x7f16f40b3950 2021-11-15T14:34:45.780 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 msgr2=0x7f16d8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 0x7f16d8055bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f16dc002f70 tx=0x7f16dc006a80).stop 2021-11-15T14:34:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 msgr2=0x7f16f40ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f16ec003310 tx=0x7f16ec0091a0).stop 2021-11-15T14:34:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 shutdown_connections 2021-11-15T14:34:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f16d80536f0 0x7f16d8055bb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f16f40b3950 0x7f16f40ae7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f16f40b2ca0 0x7f16f40b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 --2- 172.21.2.135:0/1188696151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f16f4060040 0x7f16f4157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 >> 172.21.2.135:0/1188696151 conn(0x7f16f405cfe0 msgr2=0x7f16f40b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 shutdown_connections 2021-11-15T14:34:45.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.777+0000 7f16f95a2700 1 -- 172.21.2.135:0/1188696151 wait complete. 2021-11-15T14:34:45.787 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:34:45.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 Processor -- start 2021-11-15T14:34:45.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 -- start start 2021-11-15T14:34:45.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcb480b1f40 0x7fcb480b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb481412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480b04a0 con 0x7fcb480b0030 2021-11-15T14:34:45.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480a7850 con 0x7fcb480b1f40 2021-11-15T14:34:45.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4cf43700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b06d0 con 0x7fcb480b2320 2021-11-15T14:34:45.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb45d9b700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fcb480b0030 0x7fcb480a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:52714/0 (socket says 172.21.2.135:52714) 2021-11-15T14:34:45.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb45d9b700 1 -- 172.21.2.135:0/2134611502 learned_addr learned my addr 172.21.2.135:0/2134611502 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:45.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2134611502 >> v2:172.21.2.119:3300/0 conn(0x7fcb480b1f40 0x7fcb480b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.837+0000 7fcb46d9d700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb481412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 msgr2=0x7fcb481412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:45.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb481412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2134611502 >> v1:172.21.2.119:6789/0 conn(0x7fcb480b0030 legacy=0x7fcb480a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2134611502 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480b0970 con 0x7fcb480b1f40 2021-11-15T14:34:45.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb46d9d700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb481412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:34:45.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb480b1350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcb30002f70 tx=0x7fcb30006df0).ready entity=mon.0 client_cookie=d798cf9e046d4b4f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4559a700 1 -- 172.21.2.135:0/2134611502 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3000d570 con 0x7fcb480b1f40 2021-11-15T14:34:45.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4559a700 1 -- 172.21.2.135:0/2134611502 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30000e90 con 0x7fcb480b1f40 2021-11-15T14:34:45.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4559a700 1 -- 172.21.2.135:0/2134611502 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3000d8c0 con 0x7fcb480b1f40 2021-11-15T14:34:45.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 msgr2=0x7fcb480b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb480b1350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcb30002f70 tx=0x7fcb30006df0).stop 2021-11-15T14:34:45.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2134611502 shutdown_connections 2021-11-15T14:34:45.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb481412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2134611502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb480b1350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2134611502 >> 172.21.2.135:0/2134611502 conn(0x7fcb4805f730 msgr2=0x7fcb4805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2134611502 shutdown_connections 2021-11-15T14:34:45.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2134611502 wait complete. 2021-11-15T14:34:45.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 Processor -- start 2021-11-15T14:34:45.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- start start 2021-11-15T14:34:45.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb48140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb48148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4815a330 con 0x7fcb480b1f40 2021-11-15T14:34:45.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48157bb0 con 0x7fcb480b0030 2021-11-15T14:34:45.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4cf43700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4815a590 con 0x7fcb480b2320 2021-11-15T14:34:45.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55714/0 (socket says 172.21.2.135:55714) 2021-11-15T14:34:45.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2472740027 learned_addr learned my addr 172.21.2.135:0/2472740027 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:45.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 msgr2=0x7fcb48148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb48148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 msgr2=0x7fcb48140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb48140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 -- 172.21.2.135:0/2472740027 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009470 con 0x7fcb480b0030 2021-11-15T14:34:45.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb4659c700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fcb30002f70 tx=0x7fcb30014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.841+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb30016070 con 0x7fcb480b0030 2021-11-15T14:34:45.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000de40 con 0x7fcb480b0030 2021-11-15T14:34:45.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3001e450 con 0x7fcb480b0030 2021-11-15T14:34:45.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3000b180 con 0x7fcb480b0030 2021-11-15T14:34:45.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb48140660 con 0x7fcb480b0030 2021-11-15T14:34:45.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb480b0c10 con 0x7fcb480b0030 2021-11-15T14:34:45.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb3000f030 con 0x7fcb480b0030 2021-11-15T14:34:45.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 0x7fcb2c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:45.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fcb3006c7e0 con 0x7fcb480b0030 2021-11-15T14:34:45.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb45d9b700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 0x7fcb2c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:45.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb45d9b700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 0x7fcb2c055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fcb480b2fd0 tx=0x7fcb38007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:45.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.845+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb300437e0 con 0x7fcb480b0030 2021-11-15T14:34:45.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb480573d0 con 0x7fcb480b0030 2021-11-15T14:34:45.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb3f7fe700 1 -- 172.21.2.135:0/2472740027 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcb30023020 con 0x7fcb480b0030 2021-11-15T14:34:45.933 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:45.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 msgr2=0x7fcb2c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 0x7fcb2c055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fcb480b2fd0 tx=0x7fcb38007800).stop 2021-11-15T14:34:45.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 msgr2=0x7fcb4815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:45.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fcb30002f70 tx=0x7fcb30014000).stop 2021-11-15T14:34:45.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 shutdown_connections 2021-11-15T14:34:45.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb2c053610 0x7fcb2c055ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb480b2320 0x7fcb48148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb480b1f40 0x7fcb48140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:45.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 --2- 172.21.2.135:0/2472740027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb480b0030 0x7fcb4815acd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:45.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 >> 172.21.2.135:0/2472740027 conn(0x7fcb4805f730 msgr2=0x7fcb48146900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:45.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 shutdown_connections 2021-11-15T14:34:45.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.929+0000 7fcb4cf43700 1 -- 172.21.2.135:0/2472740027 wait complete. 2021-11-15T14:34:45.947 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T14:34:45.949 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-15T14:34:46.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 Processor -- start 2021-11-15T14:34:46.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- start start 2021-11-15T14:34:46.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 0x7f7f6805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f680a7b10 con 0x7f7f680b19f0 2021-11-15T14:34:46.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f681476a0 con 0x7f7f680a7730 2021-11-15T14:34:46.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68147940 con 0x7f7f68067200 2021-11-15T14:34:46.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6e542700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7f680a7730 0x7f7f68066af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43310/0 (socket says 172.21.2.135:43310) 2021-11-15T14:34:46.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6e542700 1 -- 172.21.2.135:0/507802530 learned_addr learned my addr 172.21.2.135:0/507802530 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:46.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999329842 0 0) 0x7f7f681476a0 con 0x7f7f680a7730 2021-11-15T14:34:46.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f50003260 con 0x7f7f680a7730 2021-11-15T14:34:46.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318225922 0 0) 0x7f7f50003260 con 0x7f7f680a7730 2021-11-15T14:34:46.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 msgr2=0x7f7f6805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:46.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 0x7f7f6805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 >> v1:172.21.2.119:6789/0 conn(0x7f7f680b19f0 legacy=0x7f7f6805fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:46.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68147be0 con 0x7f7f680a7730 2021-11-15T14:34:46.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7f58001660 con 0x7f7f680a7730 2021-11-15T14:34:46.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 >> v1:172.21.2.135:6789/0 conn(0x7f7f680a7730 legacy=0x7f7f68066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f500037d0 0x7f7f50003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 0x7f7f50004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f50004bf0 0x7f7f5000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68147940 con 0x7f7f500037d0 2021-11-15T14:34:46.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50005280 con 0x7f7f50004bf0 2021-11-15T14:34:46.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5000bc40 con 0x7f7f68067200 2021-11-15T14:34:46.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f50004bf0 0x7f7f5000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6e542700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f500037d0 0x7f7f50003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 -- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 msgr2=0x7f7f50004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:46.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f68067200 0x7f7f50004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 -- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f500037d0 msgr2=0x7f7f50003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:46.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f500037d0 0x7f7f50003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 -- 172.21.2.135:0/507802530 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50003260 con 0x7f7f50004bf0 2021-11-15T14:34:46.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f50004bf0 0x7f7f5000b750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7f600012f0 tx=0x7f7f60007d60).ready entity=mon.1 client_cookie=4f9f3483fbe6126d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f600014e0 con 0x7f7f50004bf0 2021-11-15T14:34:46.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60006870 con 0x7f7f50004bf0 2021-11-15T14:34:46.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6d540700 1 -- 172.21.2.135:0/507802530 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f60006bd0 con 0x7f7f50004bf0 2021-11-15T14:34:46.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- 172.21.2.135:0/507802530 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f50004bf0 msgr2=0x7f7f5000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 --2- 172.21.2.135:0/507802530 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f50004bf0 0x7f7f5000b750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7f600012f0 tx=0x7f7f60007d60).stop 2021-11-15T14:34:46.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f6ed43700 1 -- 172.21.2.135:0/507802530 reap_dead start 2021-11-15T14:34:46.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- 172.21.2.135:0/507802530 shutdown_connections 2021-11-15T14:34:46.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- 172.21.2.135:0/507802530 >> 172.21.2.135:0/507802530 conn(0x7f7f680b5460 msgr2=0x7f7f680b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:46.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- 172.21.2.135:0/507802530 shutdown_connections 2021-11-15T14:34:46.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:45.997+0000 7f7f707a6700 1 -- 172.21.2.135:0/507802530 wait complete. 2021-11-15T14:34:46.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 Processor -- start 2021-11-15T14:34:46.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- start start 2021-11-15T14:34:46.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f50004bf0 0x7f7f680acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f680ac5a0 0x7f7f680b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680ab380 con 0x7f7f50004bf0 2021-11-15T14:34:46.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680ab5b0 con 0x7f7f6815a120 2021-11-15T14:34:46.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680ab850 con 0x7f7f680ac5a0 2021-11-15T14:34:46.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55736/0 (socket says 172.21.2.135:55736) 2021-11-15T14:34:46.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 -- 172.21.2.135:0/1676953630 learned_addr learned my addr 172.21.2.135:0/1676953630 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:46.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 -- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f680ac5a0 msgr2=0x7f7f680b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f680ac5a0 0x7f7f680b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 -- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f50004bf0 msgr2=0x7f7f680acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f50004bf0 0x7f7f680acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 -- 172.21.2.135:0/1676953630 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680abaf0 con 0x7f7f6815a120 2021-11-15T14:34:46.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6ed43700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7f680a8f60 tx=0x7f7f60014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f60018030 con 0x7f7f6815a120 2021-11-15T14:34:46.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60006e00 con 0x7f7f6815a120 2021-11-15T14:34:46.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f60014860 con 0x7f7f6815a120 2021-11-15T14:34:46.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f680abd90 con 0x7f7f6815a120 2021-11-15T14:34:46.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6815ac60 con 0x7f7f6815a120 2021-11-15T14:34:46.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f680573d0 con 0x7f7f6815a120 2021-11-15T14:34:46.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f60010070 con 0x7f7f6815a120 2021-11-15T14:34:46.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 0x7f7f48055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f7f60019070 con 0x7f7f6815a120 2021-11-15T14:34:46.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.001+0000 7f7f6e542700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 0x7f7f48055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.005+0000 7f7f6e542700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 0x7f7f48055a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7f58008000 tx=0x7f7f58009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.005+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f60043bb0 con 0x7f7f6815a120 2021-11-15T14:34:46.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.117+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f7f680a7c00 con 0x7f7f6815a120 2021-11-15T14:34:46.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f577fe700 1 -- 172.21.2.135:0/1676953630 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v34) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7f600471d0 con 0x7f7f6815a120 2021-11-15T14:34:46.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 msgr2=0x7f7f48055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 0x7f7f48055a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7f58008000 tx=0x7f7f58009040).stop 2021-11-15T14:34:46.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 msgr2=0x7f7f6815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7f680a8f60 tx=0x7f7f60014000).stop 2021-11-15T14:34:46.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 shutdown_connections 2021-11-15T14:34:46.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f48053540 0x7f7f48055a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f6815a120 0x7f7f6815a5d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f680ac5a0 0x7f7f680b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 --2- 172.21.2.135:0/1676953630 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f50004bf0 0x7f7f680acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 >> 172.21.2.135:0/1676953630 conn(0x7f7f680b5460 msgr2=0x7f7f68149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:46.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 shutdown_connections 2021-11-15T14:34:46.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.569+0000 7f7f707a6700 1 -- 172.21.2.135:0/1676953630 wait complete. 2021-11-15T14:34:46.579 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:34:46.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 Processor -- start 2021-11-15T14:34:46.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 -- start start 2021-11-15T14:34:46.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23180b0630 0x7f23180b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23181439a0 con 0x7f23180a9c90 2021-11-15T14:34:46.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2318143c40 con 0x7f23180b3790 2021-11-15T14:34:46.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318143ee0 con 0x7f23180b0630 2021-11-15T14:34:46.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23180b0630 0x7f23180b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23180b0630 0x7f23180b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55742/0 (socket says 172.21.2.135:55742) 2021-11-15T14:34:46.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 -- 172.21.2.135:0/1656326189 learned_addr learned my addr 172.21.2.135:0/1656326189 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:46.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 -- 172.21.2.135:0/1656326189 >> v1:172.21.2.135:6789/0 conn(0x7f23180b3790 legacy=0x7f231813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 -- 172.21.2.135:0/1656326189 >> v1:172.21.2.119:6789/0 conn(0x7f23180a9c90 legacy=0x7f23180b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:46.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 -- 172.21.2.135:0/1656326189 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318144180 con 0x7f23180b0630 2021-11-15T14:34:46.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f2316ffd700 1 --2- 172.21.2.135:0/1656326189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f23180b0a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f231806aad0 tx=0x7f2308006eb0).ready entity=mon.1 client_cookie=a8f8a864160e936b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f23167fc700 1 -- 172.21.2.135:0/1656326189 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800d610 con 0x7f23180b0630 2021-11-15T14:34:46.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f23167fc700 1 -- 172.21.2.135:0/1656326189 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308000e90 con 0x7f23180b0630 2021-11-15T14:34:46.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f23167fc700 1 -- 172.21.2.135:0/1656326189 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800d960 con 0x7f23180b0630 2021-11-15T14:34:46.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 -- 172.21.2.135:0/1656326189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 msgr2=0x7f23180b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.629+0000 7f231d60d700 1 --2- 172.21.2.135:0/1656326189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f23180b0a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f231806aad0 tx=0x7f2308006eb0).stop 2021-11-15T14:34:46.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/1656326189 shutdown_connections 2021-11-15T14:34:46.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 --2- 172.21.2.135:0/1656326189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f23180b0a10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/1656326189 >> 172.21.2.135:0/1656326189 conn(0x7f2318060840 msgr2=0x7f2318060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:46.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/1656326189 shutdown_connections 2021-11-15T14:34:46.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/1656326189 wait complete. 2021-11-15T14:34:46.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 Processor -- start 2021-11-15T14:34:46.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- start start 2021-11-15T14:34:46.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23180a9c90 0x7f2318067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23180b3790 0x7f231813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180674f0 con 0x7f23180a9c90 2021-11-15T14:34:46.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318140d40 con 0x7f23180b0630 2021-11-15T14:34:46.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231813f580 con 0x7f23180b3790 2021-11-15T14:34:46.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55750/0 (socket says 172.21.2.135:55750) 2021-11-15T14:34:46.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 -- 172.21.2.135:0/2932038168 learned_addr learned my addr 172.21.2.135:0/2932038168 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:46.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 -- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23180b3790 msgr2=0x7f231813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23180b3790 0x7f231813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 -- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23180a9c90 msgr2=0x7f2318067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23180a9c90 0x7f2318067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 -- 172.21.2.135:0/2932038168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230800b1e0 con 0x7f23180b0630 2021-11-15T14:34:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f230e7fc700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f231806ab10 tx=0x7f2300007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230000ce30 con 0x7f23180b0630 2021-11-15T14:34:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300012400 con 0x7f23180b0630 2021-11-15T14:34:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2300012760 con 0x7f23180b0630 2021-11-15T14:34:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318140100 con 0x7f23180b0630 2021-11-15T14:34:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318067720 con 0x7f23180b0630 2021-11-15T14:34:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231813e940 con 0x7f23180b0630 2021-11-15T14:34:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2300019030 con 0x7f23180b0630 2021-11-15T14:34:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 0x7f22fc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:46.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.633+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f230006ae20 con 0x7f23180b0630 2021-11-15T14:34:46.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.637+0000 7f2316ffd700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 0x7f22fc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:46.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.637+0000 7f2316ffd700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 0x7f22fc0559b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f231806aad0 tx=0x7f2308015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:46.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.637+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2300041e20 con 0x7f23180b0630 2021-11-15T14:34:46.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.721+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f231813dce0 con 0x7f23180b0630 2021-11-15T14:34:46.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f2314ff9700 1 -- 172.21.2.135:0/2932038168 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2300045440 con 0x7f23180b0630 2021-11-15T14:34:46.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 msgr2=0x7f22fc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 0x7f22fc0559b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f231806aad0 tx=0x7f2308015000).stop 2021-11-15T14:34:46.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 msgr2=0x7f231813eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:46.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f231806ab10 tx=0x7f2300007c20).stop 2021-11-15T14:34:46.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 shutdown_connections 2021-11-15T14:34:46.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22fc0534f0 0x7f22fc0559b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23180b3790 0x7f231813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23180b0630 0x7f231813eba0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:46.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 --2- 172.21.2.135:0/2932038168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23180a9c90 0x7f2318067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:46.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 >> 172.21.2.135:0/2932038168 conn(0x7f2318060840 msgr2=0x7f23180b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:46.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 shutdown_connections 2021-11-15T14:34:46.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:46.733+0000 7f231d60d700 1 -- 172.21.2.135:0/2932038168 wait complete. 2021-11-15T14:34:46.743 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:34:46.744 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:34:46.753 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:34:46.766 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:34:46.774 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:34:46.788 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:34:46.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.789 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.789 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.794 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:34:46.794 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:34:46.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.795 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.795 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.839 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:34:46.840 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:34:46.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.841 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.842 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:34:46.848 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T14:34:46.848 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T14:34:46.848 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:34:46.849 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:34:46.849 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.873 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.874 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.922 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:34:46.924 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:34:46.924 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:34:46.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:34:46.925 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:34:46.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.939 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.939 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:46.950 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:34:46.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:34:46.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.953 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.953 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:46.964 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:34:46.965 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:34:46.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:46.966 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:46.967 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:47.017 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-11-15T14:34:47.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:34:47.018 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-11-15T14:34:47.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:34:47.019 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:34:47.020 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:47.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:34:47.030 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:34:47.030 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:47.034 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:34:47.035 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:34:47.035 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:34:47.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:34:47.036 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:34:47.055 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:34:47.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.105+0000 7f2379fbc700 1 Processor -- start 2021-11-15T14:34:47.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- start start 2021-11-15T14:34:47.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 0x7f23740b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23740b0770 0x7f23741477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740afad0 con 0x7f23740af6f0 2021-11-15T14:34:47.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740ae6b0 con 0x7f23740b0770 2021-11-15T14:34:47.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23740ae950 con 0x7f23740ad220 2021-11-15T14:34:47.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f23740af6f0 0x7f23740b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43344/0 (socket says 172.21.2.135:43344) 2021-11-15T14:34:47.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 -- 172.21.2.135:0/1027007403 learned_addr learned my addr 172.21.2.135:0/1027007403 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197135544 0 0) 0x7f23740afad0 con 0x7f23740af6f0 2021-11-15T14:34:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2354003260 con 0x7f23740af6f0 2021-11-15T14:34:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2373fff700 1 --2- 172.21.2.135:0/1027007403 >> v2:172.21.2.119:3300/0 conn(0x7f23740b0770 0x7f23741477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f236affd700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 0x7f23740b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1095669521 0 0) 0x7f2354003260 con 0x7f23740af6f0 2021-11-15T14:34:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 msgr2=0x7f23740b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 0x7f23740b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 >> v2:172.21.2.119:3300/0 conn(0x7f23740b0770 msgr2=0x7f23741477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 --2- 172.21.2.135:0/1027007403 >> v2:172.21.2.119:3300/0 conn(0x7f23740b0770 0x7f23741477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740aebf0 con 0x7f23740af6f0 2021-11-15T14:34:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f235c001680 con 0x7f23740af6f0 2021-11-15T14:34:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 >> v1:172.21.2.135:6789/0 conn(0x7f23740af6f0 legacy=0x7f23740b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2354003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 0x7f2354004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23540049f0 0x7f2354004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740ae6b0 con 0x7f23540049f0 2021-11-15T14:34:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740ae950 con 0x7f23540037d0 2021-11-15T14:34:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235400b750 con 0x7f23740ad220 2021-11-15T14:34:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2354003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 -- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 msgr2=0x7f2354004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23740ad220 0x7f2354004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 -- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23540049f0 msgr2=0x7f2354004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23540049f0 0x7f2354004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 -- 172.21.2.135:0/1027007403 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354003260 con 0x7f23540037d0 2021-11-15T14:34:47.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f23737fe700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2354003bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f235c001390 tx=0x7f23740afe80).ready entity=mon.1 client_cookie=25781d2acba5d784 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c007170 con 0x7f23540037d0 2021-11-15T14:34:47.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c0072d0 con 0x7f23540037d0 2021-11-15T14:34:47.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2372ffd700 1 -- 172.21.2.135:0/1027007403 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c00c8c0 con 0x7f23540037d0 2021-11-15T14:34:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- 172.21.2.135:0/1027007403 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 msgr2=0x7f2354003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 --2- 172.21.2.135:0/1027007403 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2354003bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f235c001390 tx=0x7f23740afe80).stop 2021-11-15T14:34:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2373fff700 1 -- 172.21.2.135:0/1027007403 reap_dead start 2021-11-15T14:34:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- 172.21.2.135:0/1027007403 shutdown_connections 2021-11-15T14:34:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- 172.21.2.135:0/1027007403 >> 172.21.2.135:0/1027007403 conn(0x7f2374062cb0 msgr2=0x7f2374063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- 172.21.2.135:0/1027007403 shutdown_connections 2021-11-15T14:34:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- 172.21.2.135:0/1027007403 wait complete. 2021-11-15T14:34:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 Processor -- start 2021-11-15T14:34:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.109+0000 7f2379fbc700 1 -- start start 2021-11-15T14:34:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2374067a40 0x7f23741467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2374146c90 0x7f237415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2374157580 con 0x7f2374067a40 2021-11-15T14:34:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2374066560 con 0x7f23540037d0 2021-11-15T14:34:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2374066800 con 0x7f2374146c90 2021-11-15T14:34:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55766/0 (socket says 172.21.2.135:55766) 2021-11-15T14:34:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 -- 172.21.2.135:0/2425129004 learned_addr learned my addr 172.21.2.135:0/2425129004 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 -- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2374146c90 msgr2=0x7f237415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2374146c90 0x7f237415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 -- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2374067a40 msgr2=0x7f23741467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2374067a40 0x7f23741467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 -- 172.21.2.135:0/2425129004 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374066aa0 con 0x7f23540037d0 2021-11-15T14:34:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23737fe700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f235c001390 tx=0x7f235c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c004730 con 0x7f23540037d0 2021-11-15T14:34:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c004890 con 0x7f23540037d0 2021-11-15T14:34:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2374159bb0 con 0x7f23540037d0 2021-11-15T14:34:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235c004bf0 con 0x7f23540037d0 2021-11-15T14:34:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740673c0 con 0x7f23540037d0 2021-11-15T14:34:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2374067180 con 0x7f23540037d0 2021-11-15T14:34:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f235c01d070 con 0x7f23540037d0 2021-11-15T14:34:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f235c06c670 con 0x7f23540037d0 2021-11-15T14:34:47.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.113+0000 7f236affd700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.117+0000 7f236affd700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f236400c000 tx=0x7f2364006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.117+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f235c043670 con 0x7f23540037d0 2021-11-15T14:34:47.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.197+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2374159d40 con 0x7f23540037d0 2021-11-15T14:34:47.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f23717fa700 1 -- 172.21.2.135:0/2425129004 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+34065 (secure 0 0 0) 0x7f235c035530 con 0x7f23540037d0 2021-11-15T14:34:47.204 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:47.204 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:34:47.204 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 25, 2021-11-15T14:34:47.205 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:34:47.205 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:34:47.205 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:34:30.790970+0000", 2021-11-15T14:34:47.205 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:34:47.205 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:34:47.206 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:34:47.206 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:34:47.206 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:34:47.206 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:34:47.207 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:34:47.207 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:34:47.207 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:34:47.207 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:34:47.208 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:34:47.208 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:34:47.208 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:34:47.208 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:34:47.208 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:34:47.209 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 4, 2021-11-15T14:34:47.209 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:34:47.209 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:34:47.209 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:34:47.210 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:34:47.210 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:34:47.210 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.210 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:34:47.211 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:34:47.211 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:34:47.211 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:34:47.211 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:34:47.211 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:34:47.212 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:34:47.212 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:34:47.212 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:34:47.212 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:34:47.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:34:47.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:34:47.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:34:47.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:34:47.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:34:47.214 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:34:47.214 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:34:47.214 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:34:47.214 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:34:47.215 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:34:47.215 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:34:47.215 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:34:47.215 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:34:47.216 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.216 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:34:47.216 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:34:47.216 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:34:47.216 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:34:47.217 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:34:47.217 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:34:47.217 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:34:47.217 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:34:47.218 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:34:47.218 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:34:47.218 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:34:47.218 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:34:47.218 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:34:47.219 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:34:47.219 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:34:47.219 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:34:47.219 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:34:47.220 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:34:47.220 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:34:47.220 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:34:47.220 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:34:47.220 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:34:47.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:34:47.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:34:47.221 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:34:47.221 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:34:47.222 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:34:47.222 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.222 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:34:47.222 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:34:47.223 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:34:47.223 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:34:47.223 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:34:47.223 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:34:47.223 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:34:47.224 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:34:47.224 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:34:47.224 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:34:47.224 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:34:47.225 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:34:47.225 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:34:47.225 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.225 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:34:47.225 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:34:47.226 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.226 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.226 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.226 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:34:47.227 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:34:47.227 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:34:47.227 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:34:47.227 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:34:47.228 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:34:47.228 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:34:47.228 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:34:47.228 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:34:47.228 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:34:47.229 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:34:47.229 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:34:47.229 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:34:47.229 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:34:47.230 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:34:47.230 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:34:47.230 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:34:47.230 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:34:47.230 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:34:47.231 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:34:47.231 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:34:47.231 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:34:47.231 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:34:47.232 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.232 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:34:47.232 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:34:47.232 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:34:47.232 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:34:47.233 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:34:47.233 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:34:47.233 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:34:47.233 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:34:47.234 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:34:47.234 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:34:47.234 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:34:47.234 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:34:47.235 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:34:47.235 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:34:47.235 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:34:47.235 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:34:47.236 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:34:47.236 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:34:47.236 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:34:47.236 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:34:47.236 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:34:47.237 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:34:47.237 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:34:47.237 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:34:47.237 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:34:47.238 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:34:47.238 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:34:47.238 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.238 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:34:47.238 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:34:47.239 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:34:47.239 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:34:47.239 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:34:47.239 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:34:47.240 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:34:47.240 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:34:47.240 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:34:47.240 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:34:47.240 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:34:47.241 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:34:47.241 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:34:47.241 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:34:47.241 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.242 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.242 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.242 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 3, 2021-11-15T14:34:47.242 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:34:47.243 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:25.390706+0000", 2021-11-15T14:34:47.243 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:34:47.243 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:34:47.243 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:34:47.244 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:34:47.244 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:34:47.244 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:34:47.244 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:34:47.244 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:34:47.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:34:47.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:34:47.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:34:47.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:34:47.246 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:34:47.246 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:34:47.246 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:34:47.246 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:34:47.247 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:34:47.247 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:34:47.247 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:34:47.247 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:34:47.247 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.248 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "24", 2021-11-15T14:34:47.248 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:34:47.248 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:34:47.248 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:34:47.249 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:34:47.249 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:34:47.249 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:34:47.249 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:34:47.250 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:34:47.250 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:34:47.250 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:34:47.250 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:34:47.251 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:34:47.251 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:34:47.251 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:34:47.251 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:34:47.251 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:34:47.252 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:34:47.252 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:34:47.252 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:34:47.252 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:34:47.253 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:34:47.253 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:34:47.253 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:34:47.253 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:34:47.254 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:34:47.254 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:34:47.254 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.254 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:34:47.255 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:34:47.255 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:34:47.255 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:34:47.255 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:34:47.255 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:34:47.256 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:34:47.256 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:34:47.256 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:34:47.257 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:34:47.257 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:34:47.257 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:34:47.258 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:34:47.258 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:34:47.258 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:34:47.258 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.259 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:34:47.259 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:34:47.259 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:34:47.259 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.260 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.260 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.260 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 4, 2021-11-15T14:34:47.260 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:34:47.261 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:27.589267+0000", 2021-11-15T14:34:47.261 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 5, 2021-11-15T14:34:47.261 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool,ec_overwrites", 2021-11-15T14:34:47.261 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 3, 2021-11-15T14:34:47.262 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 4, 2021-11-15T14:34:47.262 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 3, 2021-11-15T14:34:47.262 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 1, 2021-11-15T14:34:47.262 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:34:47.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:34:47.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:34:47.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:34:47.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:34:47.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:34:47.264 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:34:47.264 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:34:47.264 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:34:47.264 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:34:47.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:34:47.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:34:47.265 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:34:47.265 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:34:47.265 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "25", 2021-11-15T14:34:47.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:34:47.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:34:47.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:34:47.267 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:34:47.267 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:34:47.267 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:34:47.267 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:34:47.268 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:34:47.268 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:34:47.268 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:34:47.268 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:34:47.268 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:34:47.269 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:34:47.269 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:34:47.269 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:34:47.269 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:34:47.270 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:34:47.270 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:34:47.270 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:34:47.270 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:34:47.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:34:47.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:34:47.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:34:47.271 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "cephfs_data", 2021-11-15T14:34:47.271 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:34:47.272 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:34:47.272 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.272 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:34:47.272 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:34:47.273 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:34:47.273 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:34:47.273 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:34:47.273 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:34:47.274 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:34:47.274 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:34:47.274 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 8192, 2021-11-15T14:34:47.274 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:34:47.274 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:34:47.275 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:34:47.275 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:34:47.275 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:34:47.275 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:34:47.276 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.276 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.276 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.276 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:34:47.277 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:34:47.277 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.277 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:34:47.277 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:34:47.278 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.278 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.278 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.278 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.278 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.279 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.279 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.279 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 19, 2021-11-15T14:34:47.279 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.280 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.280 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.280 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.280 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.280 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.281 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:34:47.281 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.281 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.281 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.282 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.282 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:34:47.282 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.282 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.282 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.283 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.283 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.283 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.283 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.284 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.284 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:34:47.284 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.284 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.285 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.285 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.285 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:34:47.285 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.285 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.286 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.286 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.286 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.287 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.287 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.287 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:34:47.287 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.288 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.288 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.288 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:34:47.288 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.289 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.289 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.289 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.289 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.290 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.290 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.290 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.290 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:34:47.290 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.291 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.291 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.291 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.291 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:34:47.292 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:34:47.292 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.292 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.292 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.292 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:34:47.293 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:34:47.293 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:34:47.293 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:34:47.293 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.294 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.294 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.294 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.294 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.295 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.295 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:34:47.295 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:34:47.295 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.295 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.296 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.296 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.296 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.296 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.297 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.297 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 14, 2021-11-15T14:34:47.297 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.297 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.297 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.298 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.298 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.298 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.298 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:34:47.299 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.299 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.299 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.299 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.299 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:34:47.300 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.300 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.300 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.301 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.301 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.301 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.301 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.302 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:34:47.302 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.302 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.302 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.303 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.303 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:34:47.303 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.303 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.303 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.304 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.304 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.304 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.304 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.305 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:34:47.305 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.305 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:34:47.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.306 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.307 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.307 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.308 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:34:47.308 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.308 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.309 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.309 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:34:47.309 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:34:47.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.310 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.310 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.310 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:34:47.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:34:47.311 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:34:47.311 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:34:47.311 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.311 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.312 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.312 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.312 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.312 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:34:47.313 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:34:47.313 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.313 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.313 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.314 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.314 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.314 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.314 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.314 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:34:47.315 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.315 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.315 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.315 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.316 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.316 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:34:47.316 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.317 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.317 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.317 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.317 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:34:47.317 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.318 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.318 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.318 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.318 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.319 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:34:47.320 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.320 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.320 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:34:47.321 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.321 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.321 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.321 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.322 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.322 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:34:47.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.323 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.324 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:34:47.324 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.324 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.324 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.325 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.325 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:34:47.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.326 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.327 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.327 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:34:47.327 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:34:47.328 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.328 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.328 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:34:47.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:34:47.329 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:34:47.329 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:34:47.329 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.329 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.330 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.330 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.330 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.330 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:34:47.331 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:34:47.331 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.331 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.331 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.332 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.332 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.332 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.332 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.333 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:34:47.333 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.333 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.333 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.334 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.334 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.334 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:34:47.335 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.335 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.335 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.336 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:34:47.336 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.336 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.336 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.336 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.337 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.337 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.337 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:34:47.338 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.338 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:34:47.339 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.339 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.340 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.340 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.340 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:34:47.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.341 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.342 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:34:47.342 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.342 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.343 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.343 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:34:47.344 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.345 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.345 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.345 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:34:47.346 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:34:47.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.346 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.347 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:34:47.347 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:34:47.347 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:34:47.347 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:34:47.348 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.348 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.348 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.348 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.349 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.349 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:34:47.349 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:34:47.349 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.350 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.350 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.350 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.350 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.351 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.351 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.351 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:34:47.351 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.352 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.352 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.352 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.352 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.352 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.353 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:34:47.353 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.353 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.353 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.354 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.354 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:34:47.354 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.354 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.354 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.355 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.355 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.355 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:34:47.356 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.357 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.357 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.357 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:34:47.357 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.357 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.358 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.358 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.358 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.359 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:34:47.359 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.360 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.360 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:34:47.360 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.361 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.361 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.361 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.361 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.362 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.362 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:34:47.362 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.363 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:34:47.364 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:34:47.364 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.364 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.364 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.364 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:34:47.365 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:34:47.365 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:34:47.365 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:34:47.365 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.366 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.366 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.366 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.366 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.367 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.367 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:34:47.367 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:34:47.367 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.367 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.368 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.368 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.369 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.369 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:34:47.369 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.369 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.369 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.370 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.370 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.370 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.370 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:34:47.371 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.371 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.371 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.371 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.371 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:34:47.372 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.372 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.372 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.373 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.373 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.373 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.373 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.373 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:34:47.374 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.374 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.374 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.375 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:34:47.375 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.375 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.375 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.376 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.376 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.376 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.376 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.376 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.377 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:34:47.377 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.377 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.377 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.378 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:34:47.378 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.378 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.379 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.379 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.379 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.379 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.380 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.380 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:34:47.380 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.381 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:34:47.381 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:34:47.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.382 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.382 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.382 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:34:47.382 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:34:47.383 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:34:47.383 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:34:47.383 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.383 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.384 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.384 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.384 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.384 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:34:47.385 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:34:47.385 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.385 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.385 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.386 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.386 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.386 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.386 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.387 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:34:47.387 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.387 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.387 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.387 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.388 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.388 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.388 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:34:47.388 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.389 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.389 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:34:47.389 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.390 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.390 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.390 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:34:47.391 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.392 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.392 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.392 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:34:47.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.393 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.393 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.393 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.394 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:34:47.395 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.395 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:34:47.396 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.396 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.396 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.396 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.397 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.397 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:34:47.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.398 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.399 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:34:47.399 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:34:47.399 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:34:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:34:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:34:47.401 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:34:47.401 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.401 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.401 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.402 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.402 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.402 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.402 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:34:47.402 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:34:47.403 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:34:47.403 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:34:47.403 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:34:47.403 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:34:47.404 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:34:47.404 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:34:47.404 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:34:47.404 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 17, 2021-11-15T14:34:47.404 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:34:47.405 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:34:47.405 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:34:47.405 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.405 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.406 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.406 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:34:47.406 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.406 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.407 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:34:47.407 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.407 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.408 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.408 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:34:47.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.409 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.409 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.409 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:34:47.409 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.410 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.410 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:34:47.410 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.411 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.411 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.411 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.411 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:34:47.411 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.412 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.412 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.412 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:34:47.412 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.413 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.413 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.413 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.413 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:34:47.413 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.414 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.414 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.414 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:34:47.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:34:47.415 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.415 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:34:47.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:34:47.416 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.416 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.416 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:34:47.416 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:34:47.417 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:34:47.417 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.417 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.417 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.418 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:34:47.418 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:34:47.418 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:34:47.418 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:34:47.419 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:34:47.419 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:34:47.419 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:34:47.419 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:47.419 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.420 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:34:47.420 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:34:47.420 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.420 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:34:47.421 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.421 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.421 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.421 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.422 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.422 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:34:47.422 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.422 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.423 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:34:47.423 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.423 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.423 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.424 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.424 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:34:47.424 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.425 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.425 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:34:47.425 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.425 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.426 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.426 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.426 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.426 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:34:47.426 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.427 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.427 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.427 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:34:47.427 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.428 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.428 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.428 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.428 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.428 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:34:47.429 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.429 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.429 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.429 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:34:47.430 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.430 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.430 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.430 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.431 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.431 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:34:47.431 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.431 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.432 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:34:47.432 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.432 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.432 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.433 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.433 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.433 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:34:47.433 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.434 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.434 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:34:47.434 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.434 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.435 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.435 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.435 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.435 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:34:47.435 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.436 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:47.436 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:34:47.436 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:34:47.437 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:34:47.437 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:34:47.437 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:34:47.437 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:34:47.438 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:34:47.438 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:34:47.438 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.438 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:34:47.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:34:47.439 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:34:47.439 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:34:47.439 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:34:47.439 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:34:47.440 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:34:47.440 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:34:47.440 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:34:47.440 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:34:47.441 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:34:47.441 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:34:47.441 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:34:47.441 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:34:47.441 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:34:47.442 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:34:47.442 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:34:47.442 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:34:47.442 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.443 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:34:47.443 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:34:47.443 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:34:47.443 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:34:47.444 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:34:47.444 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:34:47.444 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:34:47.444 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:47.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:47.445 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:34:47.445 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:34:47.445 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:34:47.445 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:34:47.445 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:34:47.446 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:34:47.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 msgr2=0x7f2358055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f236400c000 tx=0x7f2364006df0).stop 2021-11-15T14:34:47.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 msgr2=0x7f2374149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f235c001390 tx=0x7f235c015000).stop 2021-11-15T14:34:47.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 shutdown_connections 2021-11-15T14:34:47.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2374146c90 0x7f237415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2374067a40 0x7f23741467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 --2- 172.21.2.135:0/2425129004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23540037d0 0x7f2374149e30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 >> 172.21.2.135:0/2425129004 conn(0x7f2374062cb0 msgr2=0x7f23740b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:47.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 shutdown_connections 2021-11-15T14:34:47.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.201+0000 7f2379fbc700 1 -- 172.21.2.135:0/2425129004 wait complete. 2021-11-15T14:34:47.451 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:47.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 Processor -- start 2021-11-15T14:34:47.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 -- start start 2021-11-15T14:34:47.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd3500b1050 0x7fd3501447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500b03d0 con 0x7fd350148420 2021-11-15T14:34:47.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500b0670 con 0x7fd3500b1e30 2021-11-15T14:34:47.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd3581df700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500a9140 con 0x7fd3500b1050 2021-11-15T14:34:47.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd355f7b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd3500b1e30 0x7fd3500b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43362/0 (socket says 172.21.2.135:43362) 2021-11-15T14:34:47.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.501+0000 7fd355f7b700 1 -- 172.21.2.135:0/1592034152 learned_addr learned my addr 172.21.2.135:0/1592034152 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:47.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419018294 0 0) 0x7fd3500b0670 con 0x7fd3500b1e30 2021-11-15T14:34:47.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd338003260 con 0x7fd3500b1e30 2021-11-15T14:34:47.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 --2- 172.21.2.135:0/1592034152 >> v2:172.21.2.119:3300/0 conn(0x7fd3500b1050 0x7fd3501447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108860939 0 0) 0x7fd338003260 con 0x7fd3500b1e30 2021-11-15T14:34:47.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 >> v2:172.21.2.119:3300/0 conn(0x7fd3500b1050 msgr2=0x7fd3501447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 --2- 172.21.2.135:0/1592034152 >> v2:172.21.2.119:3300/0 conn(0x7fd3500b1050 0x7fd3501447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 >> v1:172.21.2.119:6789/0 conn(0x7fd350148420 legacy=0x7fd3500a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500b0910 con 0x7fd3500b1e30 2021-11-15T14:34:47.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd34c001660 con 0x7fd3500b1e30 2021-11-15T14:34:47.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 >> v1:172.21.2.135:6789/0 conn(0x7fd3500b1e30 legacy=0x7fd3500b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd338003750 0x7fd338003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004500 0x7fd338004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 0x7fd33800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800bd50 con 0x7fd338004500 2021-11-15T14:34:47.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800bec0 con 0x7fd338004ec0 2021-11-15T14:34:47.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800c080 con 0x7fd338003750 2021-11-15T14:34:47.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 0x7fd33800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 -- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd338003750 msgr2=0x7fd338003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd338003750 0x7fd338003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 -- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004500 msgr2=0x7fd338004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:47.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004500 0x7fd338004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 -- 172.21.2.135:0/1592034152 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338003260 con 0x7fd338004ec0 2021-11-15T14:34:47.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 -- 172.21.2.135:0/1592034152 reap_dead start 2021-11-15T14:34:47.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35677c700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 0x7fd33800b750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd34800a000 tx=0x7fd348008040).ready entity=mon.1 client_cookie=99b3b4fce3923156 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34800c070 con 0x7fd338004ec0 2021-11-15T14:34:47.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800e810 con 0x7fd338004ec0 2021-11-15T14:34:47.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd354f79700 1 -- 172.21.2.135:0/1592034152 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34800eb70 con 0x7fd338004ec0 2021-11-15T14:34:47.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 msgr2=0x7fd33800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 0x7fd33800b750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd34800a000 tx=0x7fd348008040).stop 2021-11-15T14:34:47.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- 172.21.2.135:0/1592034152 shutdown_connections 2021-11-15T14:34:47.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 --2- 172.21.2.135:0/1592034152 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd338004ec0 0x7fd33800b750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- 172.21.2.135:0/1592034152 >> 172.21.2.135:0/1592034152 conn(0x7fd35005f730 msgr2=0x7fd35005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:47.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- 172.21.2.135:0/1592034152 shutdown_connections 2021-11-15T14:34:47.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- 172.21.2.135:0/1592034152 wait complete. 2021-11-15T14:34:47.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 Processor -- start 2021-11-15T14:34:47.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- start start 2021-11-15T14:34:47.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004ec0 0x7fd350157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd350146b20 0x7fd3500aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd350157700 con 0x7fd338004ec0 2021-11-15T14:34:47.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500aa3b0 con 0x7fd3500ad6a0 2021-11-15T14:34:47.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd3581df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500aa650 con 0x7fd350146b20 2021-11-15T14:34:47.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55786/0 (socket says 172.21.2.135:55786) 2021-11-15T14:34:47.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 -- 172.21.2.135:0/1217641716 learned_addr learned my addr 172.21.2.135:0/1217641716 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:47.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 -- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd350146b20 msgr2=0x7fd3500aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd350146b20 0x7fd3500aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 -- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004ec0 msgr2=0x7fd350157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004ec0 0x7fd350157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 -- 172.21.2.135:0/1217641716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500aa8f0 con 0x7fd3500ad6a0 2021-11-15T14:34:47.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd35577a700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd3501567c0 tx=0x7fd340007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000ce70 con 0x7fd3500ad6a0 2021-11-15T14:34:47.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.505+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340000e90 con 0x7fd3500ad6a0 2021-11-15T14:34:47.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3500aab90 con 0x7fd3500ad6a0 2021-11-15T14:34:47.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd340007430 con 0x7fd3500ad6a0 2021-11-15T14:34:47.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500adb20 con 0x7fd3500ad6a0 2021-11-15T14:34:47.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd350147170 con 0x7fd3500ad6a0 2021-11-15T14:34:47.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd34001a060 con 0x7fd3500ad6a0 2021-11-15T14:34:47.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd33effd700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 0x7fd330055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd34006b270 con 0x7fd3500ad6a0 2021-11-15T14:34:47.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd355f7b700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 0x7fd330055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd355f7b700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 0x7fd330055b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd3500acee0 tx=0x7fd3500b0800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.509+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd340042270 con 0x7fd3500ad6a0 2021-11-15T14:34:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3500b0bb0 con 0x7fd3500ad6a0 2021-11-15T14:34:47.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd33effd700 1 -- 172.21.2.135:0/1217641716 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7fd340018090 con 0x7fd3500ad6a0 2021-11-15T14:34:47.624 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:47.624 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:30.789816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2579658836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2579658836},{"type":"v1","addr":"172.21.2.135:6835","nonce":2579658836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:47.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 msgr2=0x7fd330055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 0x7fd330055b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd3500acee0 tx=0x7fd3500b0800).stop 2021-11-15T14:34:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 msgr2=0x7fd350146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd3501567c0 tx=0x7fd340007c00).stop 2021-11-15T14:34:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 shutdown_connections 2021-11-15T14:34:47.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3300536a0 0x7fd330055b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd350146b20 0x7fd3500aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3500ad6a0 0x7fd350146630 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 --2- 172.21.2.135:0/1217641716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd338004ec0 0x7fd350157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 >> 172.21.2.135:0/1217641716 conn(0x7fd35005f730 msgr2=0x7fd350142d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 shutdown_connections 2021-11-15T14:34:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.621+0000 7fd3581df700 1 -- 172.21.2.135:0/1217641716 wait complete. 2021-11-15T14:34:47.629 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 6 2021-11-15T14:34:47.631 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:34:47.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 Processor -- start 2021-11-15T14:34:47.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 -- start start 2021-11-15T14:34:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8d80b1e30 0x7fd8d80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd8d8148420 0x7fd8d80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80b03d0 con 0x7fd8d80a7140 2021-11-15T14:34:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80a9140 con 0x7fd8d8148420 2021-11-15T14:34:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8deb33700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80b0670 con 0x7fd8d80b1e30 2021-11-15T14:34:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.681+0000 7fd8dc8cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8d80b1e30 0x7fd8d80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8d80b1e30 0x7fd8d80b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55794/0 (socket says 172.21.2.135:55794) 2021-11-15T14:34:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 -- 172.21.2.135:0/3120247348 learned_addr learned my addr 172.21.2.135:0/3120247348 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 -- 172.21.2.135:0/3120247348 >> v2:172.21.2.119:3300/0 conn(0x7fd8d8148420 msgr2=0x7fd8d80b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 --2- 172.21.2.135:0/3120247348 >> v2:172.21.2.119:3300/0 conn(0x7fd8d8148420 0x7fd8d80b2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 -- 172.21.2.135:0/3120247348 >> v1:172.21.2.119:6789/0 conn(0x7fd8d80a7140 legacy=0x7fd8d81447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 -- 172.21.2.135:0/3120247348 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80b0910 con 0x7fd8d80b1e30 2021-11-15T14:34:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dc8cf700 1 --2- 172.21.2.135:0/3120247348 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80b1050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fd8d80acee0 tx=0x7fd8c8006eb0).ready entity=mon.1 client_cookie=71168617b7228589 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d77fe700 1 -- 172.21.2.135:0/3120247348 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c800d5c0 con 0x7fd8d80b1e30 2021-11-15T14:34:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d77fe700 1 -- 172.21.2.135:0/3120247348 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8000e90 con 0x7fd8d80b1e30 2021-11-15T14:34:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d77fe700 1 -- 172.21.2.135:0/3120247348 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c800d950 con 0x7fd8d80b1e30 2021-11-15T14:34:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/3120247348 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d80b1e30 msgr2=0x7fd8d80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- 172.21.2.135:0/3120247348 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80b1050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fd8d80acee0 tx=0x7fd8c8006eb0).stop 2021-11-15T14:34:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/3120247348 shutdown_connections 2021-11-15T14:34:47.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- 172.21.2.135:0/3120247348 >> v2:172.21.2.119:3300/0 conn(0x7fd8d8148420 0x7fd8d80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- 172.21.2.135:0/3120247348 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80b1050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:47.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/3120247348 >> 172.21.2.135:0/3120247348 conn(0x7fd8d805f730 msgr2=0x7fd8d805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:47.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/3120247348 shutdown_connections 2021-11-15T14:34:47.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/3120247348 wait complete. 2021-11-15T14:34:47.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 Processor -- start 2021-11-15T14:34:47.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- start start 2021-11-15T14:34:47.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8d80a7140 0x7fd8d80b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80aa810 con 0x7fd8d80b1e30 2021-11-15T14:34:47.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80a94c0 con 0x7fd8d8148420 2021-11-15T14:34:47.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8157bb0 con 0x7fd8d80a7140 2021-11-15T14:34:47.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55804/0 (socket says 172.21.2.135:55804) 2021-11-15T14:34:47.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 -- 172.21.2.135:0/1388292571 learned_addr learned my addr 172.21.2.135:0/1388292571 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:47.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 -- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8d80a7140 msgr2=0x7fd8d80b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8d80a7140 0x7fd8d80b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 -- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8d80b1e30 msgr2=0x7fd8d80a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:47.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:47.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 -- 172.21.2.135:0/1388292571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c800b1e0 con 0x7fd8d8148420 2021-11-15T14:34:47.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8dd0d0700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd8d0003330 tx=0x7fd8d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0001520 con 0x7fd8d8148420 2021-11-15T14:34:47.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0001680 con 0x7fd8d8148420 2021-11-15T14:34:47.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d00019e0 con 0x7fd8d8148420 2021-11-15T14:34:47.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d80a96f0 con 0x7fd8d8148420 2021-11-15T14:34:47.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81577f0 con 0x7fd8d8148420 2021-11-15T14:34:47.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d80b0bb0 con 0x7fd8d8148420 2021-11-15T14:34:47.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.685+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8d0018030 con 0x7fd8d8148420 2021-11-15T14:34:47.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.689+0000 7fd8d5ffb700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 0x7fd8bc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:47.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.689+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd8d006b410 con 0x7fd8d8148420 2021-11-15T14:34:47.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.689+0000 7fd8dc8cf700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 0x7fd8bc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:47.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.689+0000 7fd8dc8cf700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 0x7fd8bc055b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd8d80acee0 tx=0x7fd8c8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:47.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.689+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8d00424c0 con 0x7fd8d8148420 2021-11-15T14:34:47.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:47.797+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd8d80573d0 con 0x7fd8d8148420 2021-11-15T14:34:48.735 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:34:48.736+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:34:48.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.741+0000 7fd8d5ffb700 1 -- 172.21.2.135:0/1388292571 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd8d0045ae0 con 0x7fd8d8148420 2021-11-15T14:34:48.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 msgr2=0x7fd8bc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 0x7fd8bc055b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd8d80acee0 tx=0x7fd8c8015000).stop 2021-11-15T14:34:48.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 msgr2=0x7fd8d80aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd8d0003330 tx=0x7fd8d00091a0).stop 2021-11-15T14:34:48.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 shutdown_connections 2021-11-15T14:34:48.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8bc053640 0x7fd8bc055b00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8d8148420 0x7fd8d80aa320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8d80b1e30 0x7fd8d80a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:48.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 --2- 172.21.2.135:0/1388292571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8d80a7140 0x7fd8d80b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:48.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 >> 172.21.2.135:0/1388292571 conn(0x7fd8d805f730 msgr2=0x7fd8d8143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:48.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 shutdown_connections 2021-11-15T14:34:48.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.745+0000 7fd8deb33700 1 -- 172.21.2.135:0/1388292571 wait complete. 2021-11-15T14:34:48.751 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:34:48.754 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:48.759 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:34:48.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.801+0000 7fa4dcb19700 1 Processor -- start 2021-11-15T14:34:48.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.801+0000 7fa4dcb19700 1 -- start start 2021-11-15T14:34:48.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.801+0000 7fa4dcb19700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 0x7fa4d80acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.801+0000 7fa4dcb19700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 0x7fa4d80a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80b6d60 con 0x7fa4d805c510 2021-11-15T14:34:48.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d8061260 con 0x7fa4d8060990 2021-11-15T14:34:48.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8061500 con 0x7fa4d80b6980 2021-11-15T14:34:48.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d5d9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 0x7fa4d80a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d5d9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 0x7fa4d80a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:49634/0 (socket says 172.21.2.135:49634) 2021-11-15T14:34:48.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d6d9d700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa4d805c510 0x7fa4d80aa430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:52826/0 (socket says 172.21.2.135:52826) 2021-11-15T14:34:48.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 0x7fa4d80acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d5d9b700 1 -- 172.21.2.135:0/2969027005 learned_addr learned my addr 172.21.2.135:0/2969027005 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:48.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d559a700 1 -- 172.21.2.135:0/2969027005 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523078506 0 0) 0x7fa4d80b6d60 con 0x7fa4d805c510 2021-11-15T14:34:48.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 -- 172.21.2.135:0/2969027005 >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 msgr2=0x7fa4d80a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:48.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 --2- 172.21.2.135:0/2969027005 >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 0x7fa4d80a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 -- 172.21.2.135:0/2969027005 >> v1:172.21.2.119:6789/0 conn(0x7fa4d805c510 legacy=0x7fa4d80aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 -- 172.21.2.135:0/2969027005 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80617a0 con 0x7fa4d80b6980 2021-11-15T14:34:48.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d659c700 1 --2- 172.21.2.135:0/2969027005 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 0x7fa4d80acdd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa4c8002f70 tx=0x7fa4c8006df0).ready entity=mon.2 client_cookie=ba04ff275405c3eb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:48.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d559a700 1 -- 172.21.2.135:0/2969027005 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c800d570 con 0x7fa4d80b6980 2021-11-15T14:34:48.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d559a700 1 -- 172.21.2.135:0/2969027005 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8000e90 con 0x7fa4d80b6980 2021-11-15T14:34:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4d559a700 1 -- 172.21.2.135:0/2969027005 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c800d8c0 con 0x7fa4d80b6980 2021-11-15T14:34:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- 172.21.2.135:0/2969027005 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 msgr2=0x7fa4d80acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/2969027005 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 0x7fa4d80acdd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa4c8002f70 tx=0x7fa4c8006df0).stop 2021-11-15T14:34:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- 172.21.2.135:0/2969027005 shutdown_connections 2021-11-15T14:34:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/2969027005 >> v2:172.21.2.119:3300/0 conn(0x7fa4d8060990 0x7fa4d80a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/2969027005 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d80b6980 0x7fa4d80acdd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- 172.21.2.135:0/2969027005 >> 172.21.2.135:0/2969027005 conn(0x7fa4d80b3500 msgr2=0x7fa4d80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- 172.21.2.135:0/2969027005 shutdown_connections 2021-11-15T14:34:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- 172.21.2.135:0/2969027005 wait complete. 2021-11-15T14:34:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 Processor -- start 2021-11-15T14:34:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- start start 2021-11-15T14:34:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d8060990 0x7fa4d81563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4d80b6980 0x7fa4d80ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8155a50 con 0x7fa4d80b6980 2021-11-15T14:34:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81568b0 con 0x7fa4d805c510 2021-11-15T14:34:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.805+0000 7fa4dcb19700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8140b40 con 0x7fa4d8060990 2021-11-15T14:34:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55826/0 (socket says 172.21.2.135:55826) 2021-11-15T14:34:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 -- 172.21.2.135:0/1130877938 learned_addr learned my addr 172.21.2.135:0/1130877938 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d6d9d700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4d80b6980 0x7fa4d80ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d5d9b700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d8060990 0x7fa4d81563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 -- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d8060990 msgr2=0x7fa4d81563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d8060990 0x7fa4d81563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 -- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4d80b6980 msgr2=0x7fa4d80ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4d80b6980 0x7fa4d80ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 -- 172.21.2.135:0/1130877938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c800b180 con 0x7fa4d805c510 2021-11-15T14:34:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d659c700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa4c8002f70 tx=0x7fa4c8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c800de20 con 0x7fa4d805c510 2021-11-15T14:34:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c801e400 con 0x7fa4d805c510 2021-11-15T14:34:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c801e760 con 0x7fa4d805c510 2021-11-15T14:34:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d8155c80 con 0x7fa4d805c510 2021-11-15T14:34:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d8140de0 con 0x7fa4d805c510 2021-11-15T14:34:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8061a40 con 0x7fa4d805c510 2021-11-15T14:34:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4c8025030 con 0x7fa4d805c510 2021-11-15T14:34:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 0x7fa4bc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fa4c806cbb0 con 0x7fa4d805c510 2021-11-15T14:34:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d5d9b700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 0x7fa4bc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.809+0000 7fa4d5d9b700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 0x7fa4bc055bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa4c0008000 tx=0x7fa4c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.813+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4c8043a80 con 0x7fa4d805c510 2021-11-15T14:34:48.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.921+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d80573d0 con 0x7fa4d805c510 2021-11-15T14:34:48.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.921+0000 7fa4cf7fe700 1 -- 172.21.2.135:0/1130877938 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2123 (secure 0 0 0) 0x7fa4c8023070 con 0x7fa4d805c510 2021-11-15T14:34:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:48.926 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/458145999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":458145999},{"type":"v1","addr":"172.21.2.119:6835","nonce":458145999}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1678287166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1678287166},{"type":"v1","addr":"172.21.2.135:6833","nonce":1678287166}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:29.784960+0000","modified":"2021-11-15T14:34:48.737495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-15T14:34:48.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 msgr2=0x7fa4bc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 0x7fa4bc055bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa4c0008000 tx=0x7fa4c0008040).stop 2021-11-15T14:34:48.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 msgr2=0x7fa4d81401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa4c8002f70 tx=0x7fa4c8014000).stop 2021-11-15T14:34:48.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 shutdown_connections 2021-11-15T14:34:48.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4bc0536f0 0x7fa4bc055bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4d80b6980 0x7fa4d80ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4d8060990 0x7fa4d81563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 --2- 172.21.2.135:0/1130877938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4d805c510 0x7fa4d81401e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 >> 172.21.2.135:0/1130877938 conn(0x7fa4d80b3500 msgr2=0x7fa4d80b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:48.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 shutdown_connections 2021-11-15T14:34:48.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.925+0000 7fa4dcb19700 1 -- 172.21.2.135:0/1130877938 wait complete. 2021-11-15T14:34:48.930 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 7 2021-11-15T14:34:48.933 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:34:48.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 Processor -- start 2021-11-15T14:34:48.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 -- start start 2021-11-15T14:34:48.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 0x7fa98c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0a7850 con 0x7fa98c0b1f40 2021-11-15T14:34:48.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0b06d0 con 0x7fa98c0b2320 2021-11-15T14:34:48.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa99455e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0b17c0 con 0x7fa98c0b1350 2021-11-15T14:34:48.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa98c0b2320 0x7fa98c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43420/0 (socket says 172.21.2.135:43420) 2021-11-15T14:34:48.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 -- 172.21.2.135:0/2739634827 learned_addr learned my addr 172.21.2.135:0/2739634827 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:48.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263550756 0 0) 0x7fa98c0b06d0 con 0x7fa98c0b2320 2021-11-15T14:34:48.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa974003260 con 0x7fa98c0b2320 2021-11-15T14:34:48.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857512180 0 0) 0x7fa974003260 con 0x7fa98c0b2320 2021-11-15T14:34:48.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 msgr2=0x7fa98c0b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:48.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 0x7fa98c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:48.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 >> v1:172.21.2.119:6789/0 conn(0x7fa98c0b1f40 legacy=0x7fa98c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:48.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0b0970 con 0x7fa98c0b2320 2021-11-15T14:34:48.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa9840019e0 con 0x7fa98c0b2320 2021-11-15T14:34:48.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 >> v1:172.21.2.135:6789/0 conn(0x7fa98c0b2320 legacy=0x7fa98c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa974003750 0x7fa974003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 0x7fa974004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa974004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0b17c0 con 0x7fa974003750 2021-11-15T14:34:48.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97400b940 con 0x7fa974004b10 2021-11-15T14:34:48.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97400bb00 con 0x7fa98c0b1350 2021-11-15T14:34:48.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa974004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa9922fa700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa974003750 0x7fa974003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa991af9700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 0x7fa974004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 -- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 msgr2=0x7fa974004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:48.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c0b1350 0x7fa974004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 -- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa974003750 msgr2=0x7fa974003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:48.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa974003750 0x7fa974003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:48.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 -- 172.21.2.135:0/2739634827 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974003260 con 0x7fa974004b10 2021-11-15T14:34:48.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.981+0000 7fa992afb700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa974004f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa98c06a170 tx=0x7fa98c0b0860).ready entity=mon.1 client_cookie=49c35a9b49d6d410 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:48.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa98400cc60 con 0x7fa974004b10 2021-11-15T14:34:48.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400cdc0 con 0x7fa974004b10 2021-11-15T14:34:48.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9912f8700 1 -- 172.21.2.135:0/2739634827 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa984005b80 con 0x7fa974004b10 2021-11-15T14:34:48.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/2739634827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 msgr2=0x7fa974004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:48.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 --2- 172.21.2.135:0/2739634827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa974004f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa98c06a170 tx=0x7fa98c0b0860).stop 2021-11-15T14:34:48.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa992afb700 1 -- 172.21.2.135:0/2739634827 reap_dead start 2021-11-15T14:34:48.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/2739634827 shutdown_connections 2021-11-15T14:34:48.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/2739634827 >> 172.21.2.135:0/2739634827 conn(0x7fa98c05f730 msgr2=0x7fa98c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:48.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/2739634827 shutdown_connections 2021-11-15T14:34:48.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/2739634827 wait complete. 2021-11-15T14:34:48.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 Processor -- start 2021-11-15T14:34:48.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- start start 2021-11-15T14:34:48.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c15aad0 0x7fa98c1387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa98c0aba80 0x7fa98c138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:48.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0aec10 con 0x7fa98c0aba80 2021-11-15T14:34:48.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ae230 con 0x7fa974004b10 2021-11-15T14:34:48.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ae4d0 con 0x7fa98c15aad0 2021-11-15T14:34:48.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:48.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55848/0 (socket says 172.21.2.135:55848) 2021-11-15T14:34:49.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 -- 172.21.2.135:0/4233299681 learned_addr learned my addr 172.21.2.135:0/4233299681 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:49.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa992afb700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa98c0aba80 0x7fa98c138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 -- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c15aad0 msgr2=0x7fa98c1387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c15aad0 0x7fa98c1387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:49.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 -- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa98c0aba80 msgr2=0x7fa98c138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa98c0aba80 0x7fa98c138ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 -- 172.21.2.135:0/4233299681 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0ae770 con 0x7fa974004b10 2021-11-15T14:34:49.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa9922fa700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa980007560 tx=0x7fa980009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:49.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9800155f0 con 0x7fa974004b10 2021-11-15T14:34:49.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980010040 con 0x7fa974004b10 2021-11-15T14:34:49.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c0b01d0 con 0x7fa974004b10 2021-11-15T14:34:49.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa980015940 con 0x7fa974004b10 2021-11-15T14:34:49.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c156b50 con 0x7fa974004b10 2021-11-15T14:34:49.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0ae900 con 0x7fa974004b10 2021-11-15T14:34:49.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa980015aa0 con 0x7fa974004b10 2021-11-15T14:34:49.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 0x7fa96c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.985+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fa98006bbc0 con 0x7fa974004b10 2021-11-15T14:34:49.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.989+0000 7fa991af9700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 0x7fa96c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.989+0000 7fa991af9700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 0x7fa96c055ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa988007000 tx=0x7fa988008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:49.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:48.989+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa980042a50 con 0x7fa974004b10 2021-11-15T14:34:49.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.097+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa98c0b0c10 con 0x7fa974004b10 2021-11-15T14:34:49.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.749+0000 7fa97f7fe700 1 -- 172.21.2.135:0/4233299681 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa980046070 con 0x7fa974004b10 2021-11-15T14:34:49.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 msgr2=0x7fa96c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 0x7fa96c055ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa988007000 tx=0x7fa988008040).stop 2021-11-15T14:34:49.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 msgr2=0x7fa98c1407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa980007560 tx=0x7fa980009040).stop 2021-11-15T14:34:49.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 shutdown_connections 2021-11-15T14:34:49.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa96c053610 0x7fa96c055ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa98c0aba80 0x7fa98c138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa98c15aad0 0x7fa98c1387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 --2- 172.21.2.135:0/4233299681 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa974004b10 0x7fa98c1407b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 >> 172.21.2.135:0/4233299681 conn(0x7fa98c05f730 msgr2=0x7fa98c147000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 shutdown_connections 2021-11-15T14:34:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.753+0000 7fa99455e700 1 -- 172.21.2.135:0/4233299681 wait complete. 2021-11-15T14:34:49.762 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:34:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 Processor -- start 2021-11-15T14:34:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- start start 2021-11-15T14:34:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb7540b6980 0x7fb7540acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb754060990 0x7fb7540a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 0x7fb7540aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540b6d60 con 0x7fb7540b6980 2021-11-15T14:34:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb754061260 con 0x7fb754060990 2021-11-15T14:34:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb754061500 con 0x7fb7540aa430 2021-11-15T14:34:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb754060990 0x7fb7540a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb754060990 0x7fb7540a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55854/0 (socket says 172.21.2.135:55854) 2021-11-15T14:34:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/2586926260 learned_addr learned my addr 172.21.2.135:0/2586926260 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759844700 1 --2- 172.21.2.135:0/2586926260 >> v2:172.21.2.119:3300/0 conn(0x7fb7540b6980 0x7fb7540acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75a045700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 0x7fb7540aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/2586926260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 msgr2=0x7fb7540aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 0x7fb7540aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/2586926260 >> v2:172.21.2.119:3300/0 conn(0x7fb7540b6980 msgr2=0x7fb7540acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- 172.21.2.135:0/2586926260 >> v2:172.21.2.119:3300/0 conn(0x7fb7540b6980 0x7fb7540acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/2586926260 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540617a0 con 0x7fb754060990 2021-11-15T14:34:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75a045700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 0x7fb7540aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb754060990 0x7fb7540a9f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fb744002f70 tx=0x7fb744006eb0).ready entity=mon.1 client_cookie=41746c30ff05a2e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb758842700 1 -- 172.21.2.135:0/2586926260 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74400d570 con 0x7fb754060990 2021-11-15T14:34:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb758842700 1 -- 172.21.2.135:0/2586926260 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744000e90 con 0x7fb754060990 2021-11-15T14:34:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb758842700 1 -- 172.21.2.135:0/2586926260 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74400d900 con 0x7fb754060990 2021-11-15T14:34:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- 172.21.2.135:0/2586926260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb754060990 msgr2=0x7fb7540a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb754060990 0x7fb7540a9f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fb744002f70 tx=0x7fb744006eb0).stop 2021-11-15T14:34:49.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- 172.21.2.135:0/2586926260 shutdown_connections 2021-11-15T14:34:49.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7540aa430 0x7fb7540aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- 172.21.2.135:0/2586926260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb754060990 0x7fb7540a9f40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- 172.21.2.135:0/2586926260 >> v2:172.21.2.119:3300/0 conn(0x7fb7540b6980 0x7fb7540acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- 172.21.2.135:0/2586926260 >> 172.21.2.135:0/2586926260 conn(0x7fb7540b3500 msgr2=0x7fb7540b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- 172.21.2.135:0/2586926260 shutdown_connections 2021-11-15T14:34:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- 172.21.2.135:0/2586926260 wait complete. 2021-11-15T14:34:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 Processor -- start 2021-11-15T14:34:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- start start 2021-11-15T14:34:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb754060990 0x7fb75413d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 0x7fb75412f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540b0240 con 0x7fb7540b6980 2021-11-15T14:34:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540b2060 con 0x7fb7540aa430 2021-11-15T14:34:49.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75baa8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540b2300 con 0x7fb754060990 2021-11-15T14:34:49.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55862/0 (socket says 172.21.2.135:55862) 2021-11-15T14:34:49.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/1854696865 learned_addr learned my addr 172.21.2.135:0/1854696865 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:49.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75a045700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 0x7fb75412f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759844700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb754060990 0x7fb75413d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb754060990 msgr2=0x7fb75413d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb754060990 0x7fb75413d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 msgr2=0x7fb75412f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:49.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 0x7fb75412f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:49.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb759043700 1 -- 172.21.2.135:0/1854696865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74400b1e0 con 0x7fb7540aa430 2021-11-15T14:34:49.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.813+0000 7fb75a045700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 0x7fb75412f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:49.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb759043700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb744002f70 tx=0x7fb744015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:49.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb744011950 con 0x7fb7540aa430 2021-11-15T14:34:49.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744011ab0 con 0x7fb7540aa430 2021-11-15T14:34:49.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540b25a0 con 0x7fb7540aa430 2021-11-15T14:34:49.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7540ad780 con 0x7fb7540aa430 2021-11-15T14:34:49.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb744011e10 con 0x7fb7540aa430 2021-11-15T14:34:49.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540b2730 con 0x7fb7540aa430 2021-11-15T14:34:49.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb744025030 con 0x7fb7540aa430 2021-11-15T14:34:49.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 0x7fb734055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:49.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fb74406cf30 con 0x7fb7540aa430 2021-11-15T14:34:49.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb759844700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 0x7fb734055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:49.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.817+0000 7fb759844700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 0x7fb734055a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb75000c000 tx=0x7fb750008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:49.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.821+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb744043dc0 con 0x7fb7540aa430 2021-11-15T14:34:49.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:49.901+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb754061a40 con 0x7fb7540aa430 2021-11-15T14:34:50.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.761+0000 7fb742ffd700 1 -- 172.21.2.135:0/1854696865 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb7440230e0 con 0x7fb7540aa430 2021-11-15T14:34:50.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 msgr2=0x7fb734055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 0x7fb734055a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb75000c000 tx=0x7fb750008040).stop 2021-11-15T14:34:50.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 msgr2=0x7fb7540afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb744002f70 tx=0x7fb744015000).stop 2021-11-15T14:34:50.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 shutdown_connections 2021-11-15T14:34:50.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb734053540 0x7fb734055a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:50.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7540b6980 0x7fb75412f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:50.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7540aa430 0x7fb7540afba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:50.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 --2- 172.21.2.135:0/1854696865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb754060990 0x7fb75413d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:50.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 >> 172.21.2.135:0/1854696865 conn(0x7fb7540b3500 msgr2=0x7fb75405c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:50.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 shutdown_connections 2021-11-15T14:34:50.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.765+0000 7fb75baa8700 1 -- 172.21.2.135:0/1854696865 wait complete. 2021-11-15T14:34:50.773 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:34:50.798 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:34:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 Processor -- start 2021-11-15T14:34:50.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- start start 2021-11-15T14:34:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f01980addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f01980b0900 0x7f0198140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01980b2b70 con 0x7f01980aa1a0 2021-11-15T14:34:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b27f0 con 0x7f01980b0900 2021-11-15T14:34:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b2da0 con 0x7f01980b0520 2021-11-15T14:34:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f01977fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f01980aa1a0 0x7f01980ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43456/0 (socket says 172.21.2.135:43456) 2021-11-15T14:34:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f01977fe700 1 -- 172.21.2.135:0/989417680 learned_addr learned my addr 172.21.2.135:0/989417680 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 --2- 172.21.2.135:0/989417680 >> v2:172.21.2.135:3300/0 conn(0x7f01980b0900 0x7f0198140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 -- 172.21.2.135:0/989417680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 msgr2=0x7f01980addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 --2- 172.21.2.135:0/989417680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f01980addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 -- 172.21.2.135:0/989417680 >> v1:172.21.2.135:6789/0 conn(0x7f01980aa1a0 legacy=0x7f01980ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 -- 172.21.2.135:0/989417680 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980a9bf0 con 0x7f01980b0900 2021-11-15T14:34:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019cafe700 1 --2- 172.21.2.135:0/989417680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980b0900 0x7f0198140620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f01900032f0 tx=0x7f01900091d0).ready entity=mon.1 client_cookie=d4f97a1a399c461c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:50.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f0196ffd700 1 -- 172.21.2.135:0/989417680 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0190009ea0 con 0x7f01980b0900 2021-11-15T14:34:50.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f0196ffd700 1 -- 172.21.2.135:0/989417680 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000b8a0 con 0x7f01980b0900 2021-11-15T14:34:50.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f0196ffd700 1 -- 172.21.2.135:0/989417680 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019000ba10 con 0x7f01980b0900 2021-11-15T14:34:50.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- 172.21.2.135:0/989417680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980b0900 msgr2=0x7f0198140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 --2- 172.21.2.135:0/989417680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980b0900 0x7f0198140620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f01900032f0 tx=0x7f01900091d0).stop 2021-11-15T14:34:50.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- 172.21.2.135:0/989417680 shutdown_connections 2021-11-15T14:34:50.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 --2- 172.21.2.135:0/989417680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980b0900 0x7f0198140620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:50.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 --2- 172.21.2.135:0/989417680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f01980addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:50.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- 172.21.2.135:0/989417680 >> 172.21.2.135:0/989417680 conn(0x7f0198060840 msgr2=0x7f0198060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:50.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- 172.21.2.135:0/989417680 shutdown_connections 2021-11-15T14:34:50.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 -- 172.21.2.135:0/989417680 wait complete. 2021-11-15T14:34:50.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.853+0000 7f019e561700 1 Processor -- start 2021-11-15T14:34:50.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- start start 2021-11-15T14:34:50.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f0198140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01980b0900 0x7f01981388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198156b60 con 0x7f01980b0900 2021-11-15T14:34:50.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198154840 con 0x7f01980aa1a0 2021-11-15T14:34:50.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980a8be0 con 0x7f01980b0520 2021-11-15T14:34:50.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:50.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55874/0 (socket says 172.21.2.135:55874) 2021-11-15T14:34:50.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 -- 172.21.2.135:0/2847153280 learned_addr learned my addr 172.21.2.135:0/2847153280 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:50.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 -- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 msgr2=0x7f0198140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f0198140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:50.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 -- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01980b0900 msgr2=0x7f01981388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:50.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01980b0900 0x7f01981388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:50.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 -- 172.21.2.135:0/2847153280 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009470 con 0x7f01980aa1a0 2021-11-15T14:34:50.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f0197fff700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0198140c80 tx=0x7f0188006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:50.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0188013460 con 0x7f01980aa1a0 2021-11-15T14:34:50.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880135c0 con 0x7f01980aa1a0 2021-11-15T14:34:50.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198140de0 con 0x7f01980aa1a0 2021-11-15T14:34:50.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980a8940 con 0x7f01980aa1a0 2021-11-15T14:34:50.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0188013920 con 0x7f01980aa1a0 2021-11-15T14:34:50.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019813eb00 con 0x7f01980aa1a0 2021-11-15T14:34:50.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f018801a060 con 0x7f01980aa1a0 2021-11-15T14:34:50.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 0x7f017c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:50.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f018806b4b0 con 0x7f01980aa1a0 2021-11-15T14:34:50.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.857+0000 7f01977fe700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 0x7f017c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:50.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.861+0000 7f01977fe700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 0x7f017c055b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f01980ad450 tx=0x7f0180007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:50.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.861+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0188042500 con 0x7f01980aa1a0 2021-11-15T14:34:50.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:50.941+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01980573d0 con 0x7f01980aa1a0 2021-11-15T14:34:51.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.765+0000 7f01957fa700 1 -- 172.21.2.135:0/2847153280 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0188018030 con 0x7f01980aa1a0 2021-11-15T14:34:51.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 msgr2=0x7f017c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 0x7f017c055b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f01980ad450 tx=0x7f0180007800).stop 2021-11-15T14:34:51.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 msgr2=0x7f01980a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0198140c80 tx=0x7f0188006ec0).stop 2021-11-15T14:34:51.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 shutdown_connections 2021-11-15T14:34:51.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f017c053660 0x7f017c055b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:51.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01980b0900 0x7f01981388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:51.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01980b0520 0x7f0198140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:51.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 --2- 172.21.2.135:0/2847153280 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01980aa1a0 0x7f01980a9040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:51.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 >> 172.21.2.135:0/2847153280 conn(0x7f0198060840 msgr2=0x7f01980b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:51.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 shutdown_connections 2021-11-15T14:34:51.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.769+0000 7f019e561700 1 -- 172.21.2.135:0/2847153280 wait complete. 2021-11-15T14:34:51.775 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:34:51.778 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:34:51.779 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:34:51.779 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:34:51.779 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:34:51.780 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:34:51.780 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:34:51.780 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:34:51.781 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:34:51.781 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:34:51.781 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:34:51.781 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:34:51.782 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:34:51.785 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:34:51.785 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:34:51.787 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:34:51.787 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:34:51.788 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:34:51.788 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:34:51.790 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:34:51.791 DEBUG:teuthology.parallel:result is None 2021-11-15T14:34:51.827 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:34:51.831 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:34:51.832 DEBUG:teuthology.parallel:result is None 2021-11-15T14:34:51.833 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:34:51.833 DEBUG:teuthology.parallel:result is None 2021-11-15T14:34:51.834 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:34:51.870 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:34:51.871 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:34:51.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 Processor -- start 2021-11-15T14:34:51.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- start start 2021-11-15T14:34:51.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7feff8064a00 0x7feff8144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 0x7feff81411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff8066580 con 0x7feff80b35d0 2021-11-15T14:34:51.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff80b3f20 con 0x7feff8067190 2021-11-15T14:34:51.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff8140dc0 con 0x7feff8064a00 2021-11-15T14:34:51.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff5d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feff80b35d0 0x7feff8066a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43494/0 (socket says 172.21.2.135:43494) 2021-11-15T14:34:51.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff5d9b700 1 -- 172.21.2.135:0/1753214292 learned_addr learned my addr 172.21.2.135:0/1753214292 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:51.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 --2- 172.21.2.135:0/1753214292 >> v2:172.21.2.135:3300/0 conn(0x7feff8064a00 0x7feff8144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:51.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713330055 0 0) 0x7feff8066580 con 0x7feff80b35d0 2021-11-15T14:34:51.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd8003260 con 0x7feff80b35d0 2021-11-15T14:34:51.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- 172.21.2.135:0/1753214292 >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 0x7feff81411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 -- 172.21.2.135:0/1753214292 >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 msgr2=0x7feff81411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 --2- 172.21.2.135:0/1753214292 >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 0x7feff81411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 -- 172.21.2.135:0/1753214292 >> v1:172.21.2.135:6789/0 conn(0x7feff80b35d0 legacy=0x7feff8066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 326348740 0 0) 0x7fefd8003260 con 0x7feff80b35d0 2021-11-15T14:34:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 -- 172.21.2.135:0/1753214292 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80b4740 con 0x7feff8064a00 2021-11-15T14:34:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- 172.21.2.135:0/1753214292 >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 0x7feff81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff659c700 1 --2- 172.21.2.135:0/1753214292 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff8064a00 0x7feff8144d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fefe0001800 tx=0x7fefe8006df0).ready entity=mon.1 client_cookie=da143074dea55101 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe0001660 con 0x7feff8064a00 2021-11-15T14:34:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8000e90 con 0x7feff8064a00 2021-11-15T14:34:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff559a700 1 -- 172.21.2.135:0/1753214292 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe800d4a0 con 0x7feff8064a00 2021-11-15T14:34:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1753214292 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff8064a00 msgr2=0x7feff8144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- 172.21.2.135:0/1753214292 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff8064a00 0x7feff8144d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fefe0001800 tx=0x7fefe8006df0).stop 2021-11-15T14:34:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1753214292 shutdown_connections 2021-11-15T14:34:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- 172.21.2.135:0/1753214292 >> v2:172.21.2.119:3300/0 conn(0x7feff8067190 0x7feff81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- 172.21.2.135:0/1753214292 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff8064a00 0x7feff8144d60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1753214292 >> 172.21.2.135:0/1753214292 conn(0x7feff805f730 msgr2=0x7feff805fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1753214292 shutdown_connections 2021-11-15T14:34:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1753214292 wait complete. 2021-11-15T14:34:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 Processor -- start 2021-11-15T14:34:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- start start 2021-11-15T14:34:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feff8064a00 0x7feff80b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff8067190 0x7feff8144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81511d0 con 0x7feff8064a00 2021-11-15T14:34:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff813a7f0 con 0x7feff80b35d0 2021-11-15T14:34:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff81542b0 con 0x7feff8067190 2021-11-15T14:34:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55914/0 (socket says 172.21.2.135:55914) 2021-11-15T14:34:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 -- 172.21.2.135:0/1442976992 learned_addr learned my addr 172.21.2.135:0/1442976992 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 -- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff8067190 msgr2=0x7feff8144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff8067190 0x7feff8144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 -- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feff8064a00 msgr2=0x7feff80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feff8064a00 0x7feff80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 -- 172.21.2.135:0/1442976992 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe800b180 con 0x7feff80b35d0 2021-11-15T14:34:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff6d9d700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7feff0007000 tx=0x7feff0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff0015070 con 0x7feff80b35d0 2021-11-15T14:34:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff000a5f0 con 0x7feff80b35d0 2021-11-15T14:34:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff8154550 con 0x7feff80b35d0 2021-11-15T14:34:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff000a950 con 0x7feff80b35d0 2021-11-15T14:34:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.889+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff80b5710 con 0x7feff80b35d0 2021-11-15T14:34:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff80573d0 con 0x7feff80b35d0 2021-11-15T14:34:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feff000aab0 con 0x7feff80b35d0 2021-11-15T14:34:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7fefef7fe700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 0x7fefdc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5682+0+0 (secure 0 0 0) 0x7feff006bac0 con 0x7feff80b35d0 2021-11-15T14:34:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7feff659c700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 0x7fefdc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7feff659c700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 0x7fefdc0559b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fefe0001800 tx=0x7fefe8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:51.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.893+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feff0042d40 con 0x7feff80b35d0 2021-11-15T14:34:51.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:51.985+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7feff8069c80 con 0x7feff80b35d0 2021-11-15T14:34:52.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.885+0000 7fefef7fe700 1 -- 172.21.2.135:0/1442976992 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7feff0046360 con 0x7feff80b35d0 2021-11-15T14:34:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 msgr2=0x7fefdc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 0x7fefdc0559b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fefe0001800 tx=0x7fefe8014000).stop 2021-11-15T14:34:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 msgr2=0x7feff81501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7feff0007000 tx=0x7feff0008040).stop 2021-11-15T14:34:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 shutdown_connections 2021-11-15T14:34:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefdc0534f0 0x7fefdc0559b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff80b35d0 0x7feff81501d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff8067190 0x7feff8144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 --2- 172.21.2.135:0/1442976992 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feff8064a00 0x7feff80b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 >> 172.21.2.135:0/1442976992 conn(0x7feff805f730 msgr2=0x7feff813f940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 shutdown_connections 2021-11-15T14:34:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.893+0000 7feff759e700 1 -- 172.21.2.135:0/1442976992 wait complete. 2021-11-15T14:34:52.899 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:34:52.908 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:34:52.909 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:34:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 Processor -- start 2021-11-15T14:34:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- start start 2021-11-15T14:34:52.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9c500ad150 0x7f9c5013f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 0x7f9c5013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500b04b0 con 0x7f9c500afca0 2021-11-15T14:34:52.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500ad530 con 0x7f9c500ad150 2021-11-15T14:34:52.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b57d0 con 0x7f9c500b0bb0 2021-11-15T14:34:52.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9c500afca0 0x7f9c5013f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43512/0 (socket says 172.21.2.135:43512) 2021-11-15T14:34:52.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 -- 172.21.2.135:0/423392526 learned_addr learned my addr 172.21.2.135:0/423392526 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:52.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367260637 0 0) 0x7f9c500b04b0 con 0x7f9c500afca0 2021-11-15T14:34:52.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c003260 con 0x7f9c500afca0 2021-11-15T14:34:52.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2094314650 0 0) 0x7f9c3c003260 con 0x7f9c500afca0 2021-11-15T14:34:52.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 msgr2=0x7f9c5013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:52.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 0x7f9c5013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 >> v2:172.21.2.119:3300/0 conn(0x7f9c500ad150 msgr2=0x7f9c5013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:52.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 --2- 172.21.2.135:0/423392526 >> v2:172.21.2.119:3300/0 conn(0x7f9c500ad150 0x7f9c5013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500b06e0 con 0x7f9c500afca0 2021-11-15T14:34:52.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9c40001660 con 0x7f9c500afca0 2021-11-15T14:34:52.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 >> v1:172.21.2.135:6789/0 conn(0x7f9c500afca0 legacy=0x7f9c5013f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c0037d0 0x7f9c3c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c3c004500 0x7f9c3c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 0x7f9c3c005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500ad530 con 0x7f9c3c0037d0 2021-11-15T14:34:52.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b57d0 con 0x7f9c3c004500 2021-11-15T14:34:52.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c005300 con 0x7f9c500b0bb0 2021-11-15T14:34:52.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c3c004500 0x7f9c3c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:52.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4ffff700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 0x7f9c3c005720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:52.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 -- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 msgr2=0x7f9c3c005720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:52.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b0bb0 0x7f9c3c005720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:52.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 -- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c0037d0 msgr2=0x7f9c3c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:52.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c0037d0 0x7f9c3c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 -- 172.21.2.135:0/423392526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c003260 con 0x7f9c3c004500 2021-11-15T14:34:52.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4effd700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c3c004500 0x7f9c3c004980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9c40001370 tx=0x7f9c500ae980).ready entity=mon.1 client_cookie=db586f212871b5ab server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:52.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c40005ea0 con 0x7f9c3c004500 2021-11-15T14:34:52.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000ca90 con 0x7f9c3c004500 2021-11-15T14:34:52.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4e7fc700 1 -- 172.21.2.135:0/423392526 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4000cdf0 con 0x7f9c3c004500 2021-11-15T14:34:52.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- 172.21.2.135:0/423392526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c3c004500 msgr2=0x7f9c3c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 --2- 172.21.2.135:0/423392526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c3c004500 0x7f9c3c004980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9c40001370 tx=0x7f9c500ae980).stop 2021-11-15T14:34:52.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c4ffff700 1 -- 172.21.2.135:0/423392526 reap_dead start 2021-11-15T14:34:52.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- 172.21.2.135:0/423392526 shutdown_connections 2021-11-15T14:34:52.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- 172.21.2.135:0/423392526 >> 172.21.2.135:0/423392526 conn(0x7f9c50062cb0 msgr2=0x7f9c50063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:52.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- 172.21.2.135:0/423392526 shutdown_connections 2021-11-15T14:34:52.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.957+0000 7f9c55b45700 1 -- 172.21.2.135:0/423392526 wait complete. 2021-11-15T14:34:52.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 Processor -- start 2021-11-15T14:34:52.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- start start 2021-11-15T14:34:52.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c004500 0x7f9c50132a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b3aa0 0x7f9c50144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5013bf60 con 0x7f9c3c004500 2021-11-15T14:34:52.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5014ead0 con 0x7f9c50144b40 2021-11-15T14:34:52.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5014ed70 con 0x7f9c500b3aa0 2021-11-15T14:34:52.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:52.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55936/0 (socket says 172.21.2.135:55936) 2021-11-15T14:34:52.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 -- 172.21.2.135:0/3102522189 learned_addr learned my addr 172.21.2.135:0/3102522189 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:52.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 -- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b3aa0 msgr2=0x7f9c50144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b3aa0 0x7f9c50144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 -- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c004500 msgr2=0x7f9c50132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:52.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c004500 0x7f9c50132a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:52.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 -- 172.21.2.135:0/3102522189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5014e7d0 con 0x7f9c50144b40 2021-11-15T14:34:52.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4ffff700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f9c400017c0 tx=0x7f9c48008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:52.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4800ceb0 con 0x7f9c50144b40 2021-11-15T14:34:52.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4800f4e0 con 0x7f9c50144b40 2021-11-15T14:34:52.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4800f840 con 0x7f9c50144b40 2021-11-15T14:34:52.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c500b3770 con 0x7f9c50144b40 2021-11-15T14:34:52.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c501332b0 con 0x7f9c50144b40 2021-11-15T14:34:52.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c500b5a30 con 0x7f9c50144b40 2021-11-15T14:34:52.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c48019030 con 0x7f9c50144b40 2021-11-15T14:34:52.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 0x7f9c30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:52.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f9c4806b1e0 con 0x7f9c50144b40 2021-11-15T14:34:52.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.961+0000 7f9c4f7fe700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 0x7f9c30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:52.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.965+0000 7f9c4f7fe700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 0x7f9c30055ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9c44002f70 tx=0x7f9c44006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:52.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:52.965+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c48042460 con 0x7f9c50144b40 2021-11-15T14:34:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.077+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9c500573d0 con 0x7f9c50144b40 2021-11-15T14:34:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.077+0000 7f9c4cff9700 1 -- 172.21.2.135:0/3102522189 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5621 (secure 0 0 0) 0x7f9c48045a80 con 0x7f9c50144b40 2021-11-15T14:34:53.082 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:53.082 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:34:53.082 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:34:53.082 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.083 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:34:53.083 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:34:53.083 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.083 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:34:53.084 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.084 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.084 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.084 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.084 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.085 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.085 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:34:53.085 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:34:53.085 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.086 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:34:53.086 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.086 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.086 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.086 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.087 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.087 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.087 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:34:53.087 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:34:53.087 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.088 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:34:53.088 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.088 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.088 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.089 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.089 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.089 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.089 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:34:53.089 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:34:53.090 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.090 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.090 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.090 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.090 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.091 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.091 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.091 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:34:53.091 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:34:53.091 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.092 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.092 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.092 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.092 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.092 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.093 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.093 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:34:53.093 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:34:53.093 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.094 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.094 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.094 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.094 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.094 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.095 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.095 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:34:53.095 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:34:53.095 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.095 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.096 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.096 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.096 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.096 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.096 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.097 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:34:53.097 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:34:53.097 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.097 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.097 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.098 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.098 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.098 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.098 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.098 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:34:53.099 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:34:53.099 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.099 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.099 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.099 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.100 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.100 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.100 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.100 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:34:53.100 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:34:53.101 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.101 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.101 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.101 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.101 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.102 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.102 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.102 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:34:53.102 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:34:53.103 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.103 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.103 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.103 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.103 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.104 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.104 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.104 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:34:53.104 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:34:53.104 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.105 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:34:53.105 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow r", 2021-11-15T14:34:53.105 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow rw", 2021-11-15T14:34:53.105 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rwx" 2021-11-15T14:34:53.105 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.106 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.106 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.106 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:34:53.106 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:34:53.106 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.107 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:34:53.107 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow r", 2021-11-15T14:34:53.107 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow rw", 2021-11-15T14:34:53.107 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rwx" 2021-11-15T14:34:53.107 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.108 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.108 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.108 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:34:53.108 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:34:53.108 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.109 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:34:53.109 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:34:53.109 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:34:53.109 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.110 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.110 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.110 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.110 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-mds", 2021-11-15T14:34:53.110 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5JhVErrLhAAmgyMVMupkwEpqjdUxXGxAw==", 2021-11-15T14:34:53.111 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.111 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-mds" 2021-11-15T14:34:53.111 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.111 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.111 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-mgr", 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5JhUFLrLhAAc/RYV3bIlO4MSCUajBfJEg==", 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-mgr" 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.112 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.113 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.113 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-osd", 2021-11-15T14:34:53.113 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5JhuVjrLhAAP0lU0FcZBvmBny+2FuWQwQ==", 2021-11-15T14:34:53.113 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.113 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-osd" 2021-11-15T14:34:53.114 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.114 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.114 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.114 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-rbd", 2021-11-15T14:34:53.114 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5Jhil/rLhAAf3/nSUoJ+0MBKI+QLUoyLQ==", 2021-11-15T14:34:53.115 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.115 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-rbd" 2021-11-15T14:34:53.115 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.115 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.115 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.116 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-11-15T14:34:53.116 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5Jh3WXrLhAAdHUhKDW5btQ0sM1c5q9lZA==", 2021-11-15T14:34:53.116 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.116 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-11-15T14:34:53.116 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.117 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.117 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.117 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.bootstrap-rgw", 2021-11-15T14:34:53.117 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDkb5JhEmzrLhAAS/1R7O0YY2UxOdXZDaAV9w==", 2021-11-15T14:34:53.117 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.118 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile bootstrap-rgw" 2021-11-15T14:34:53.118 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.118 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.118 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.118 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:34:53.119 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:34:53.119 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.119 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:34:53.119 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:34:53.119 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.120 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.120 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:53.120 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:53.120 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:34:53.120 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:34:53.121 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:34:53.121 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:34:53.121 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:34:53.121 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:34:53.121 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.122 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:53.122 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:34:53.122 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:34:53.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 msgr2=0x7f9c30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 0x7f9c30055ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9c44002f70 tx=0x7f9c44006a80).stop 2021-11-15T14:34:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 msgr2=0x7f9c50151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f9c400017c0 tx=0x7f9c48008040).stop 2021-11-15T14:34:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 shutdown_connections 2021-11-15T14:34:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c30053610 0x7f9c30055ad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c50144b40 0x7f9c50151390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c500b3aa0 0x7f9c50144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 --2- 172.21.2.135:0/3102522189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c3c004500 0x7f9c50132a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 >> 172.21.2.135:0/3102522189 conn(0x7f9c50062cb0 msgr2=0x7f9c50137c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 shutdown_connections 2021-11-15T14:34:53.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.081+0000 7f9c55b45700 1 -- 172.21.2.135:0/3102522189 wait complete. 2021-11-15T14:34:53.126 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-11-15T14:34:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 Processor -- start 2021-11-15T14:34:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- start start 2021-11-15T14:34:53.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f12880b1e30 0x7f12880b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12880a7140 0x7f12881447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880a9140 con 0x7f12880b1e30 2021-11-15T14:34:53.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880b03d0 con 0x7f12880a7140 2021-11-15T14:34:53.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12880b0670 con 0x7f1288148420 2021-11-15T14:34:53.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12880a7140 0x7f12881447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12880a7140 0x7f12881447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55944/0 (socket says 172.21.2.135:55944) 2021-11-15T14:34:53.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 -- 172.21.2.135:0/1695408902 learned_addr learned my addr 172.21.2.135:0/1695408902 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 -- 172.21.2.135:0/1695408902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 msgr2=0x7f12880b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 --2- 172.21.2.135:0/1695408902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 -- 172.21.2.135:0/1695408902 >> v2:172.21.2.119:3300/0 conn(0x7f12880b1e30 msgr2=0x7f12880b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 --2- 172.21.2.135:0/1695408902 >> v2:172.21.2.119:3300/0 conn(0x7f12880b1e30 0x7f12880b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 -- 172.21.2.135:0/1695408902 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880b0910 con 0x7f12880a7140 2021-11-15T14:34:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1286d9d700 1 --2- 172.21.2.135:0/1695408902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12881447a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f12800032f0 tx=0x7f1280009290).ready entity=mon.1 client_cookie=9c6eabfc5a02587e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1285d9b700 1 -- 172.21.2.135:0/1695408902 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128000b870 con 0x7f12880a7140 2021-11-15T14:34:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1285d9b700 1 -- 172.21.2.135:0/1695408902 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000b9d0 con 0x7f12880a7140 2021-11-15T14:34:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f1285d9b700 1 -- 172.21.2.135:0/1695408902 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128000bb40 con 0x7f12880a7140 2021-11-15T14:34:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- 172.21.2.135:0/1695408902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 msgr2=0x7f12881447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- 172.21.2.135:0/1695408902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12881447a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f12800032f0 tx=0x7f1280009290).stop 2021-11-15T14:34:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- 172.21.2.135:0/1695408902 shutdown_connections 2021-11-15T14:34:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- 172.21.2.135:0/1695408902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12881447a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- 172.21.2.135:0/1695408902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- 172.21.2.135:0/1695408902 >> v2:172.21.2.119:3300/0 conn(0x7f12880b1e30 0x7f12880b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- 172.21.2.135:0/1695408902 >> 172.21.2.135:0/1695408902 conn(0x7f128805f730 msgr2=0x7f128805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- 172.21.2.135:0/1695408902 shutdown_connections 2021-11-15T14:34:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- 172.21.2.135:0/1695408902 wait complete. 2021-11-15T14:34:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 Processor -- start 2021-11-15T14:34:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- start start 2021-11-15T14:34:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12880b1e30 0x7f12880abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880ac9d0 con 0x7f12880b1e30 2021-11-15T14:34:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288149c70 con 0x7f12880a7140 2021-11-15T14:34:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128cda5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128814a9e0 con 0x7f1288148420 2021-11-15T14:34:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55946/0 (socket says 172.21.2.135:55946) 2021-11-15T14:34:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.185+0000 7f128659c700 1 -- 172.21.2.135:0/2441317115 learned_addr learned my addr 172.21.2.135:0/2441317115 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 -- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 msgr2=0x7f12880ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 -- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12880b1e30 msgr2=0x7f12880abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12880b1e30 0x7f12880abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 -- 172.21.2.135:0/2441317115 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280009530 con 0x7f12880a7140 2021-11-15T14:34:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128659c700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f12880acb10 tx=0x7f1270006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1270013460 con 0x7f12880a7140 2021-11-15T14:34:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12700135c0 con 0x7f12880a7140 2021-11-15T14:34:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1270013920 con 0x7f12880a7140 2021-11-15T14:34:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288149ea0 con 0x7f12880a7140 2021-11-15T14:34:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12880ab210 con 0x7f12880a7140 2021-11-15T14:34:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12880b0bb0 con 0x7f12880a7140 2021-11-15T14:34:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f127001a060 con 0x7f12880a7140 2021-11-15T14:34:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 0x7f1260055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f127006b2d0 con 0x7f12880a7140 2021-11-15T14:34:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127ffff700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 0x7f1260055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.189+0000 7f127ffff700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 0x7f1260055be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1278002f70 tx=0x7f1278006970).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.193+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1270042500 con 0x7f12880a7140 2021-11-15T14:34:53.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.301+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f12880573d0 con 0x7f12880a7140 2021-11-15T14:34:53.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.313+0000 7f127f7fe700 1 -- 172.21.2.135:0/2441317115 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1270018030 con 0x7f12880a7140 2021-11-15T14:34:53.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 msgr2=0x7f1260055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 0x7f1260055be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1278002f70 tx=0x7f1278006970).stop 2021-11-15T14:34:53.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 msgr2=0x7f12880ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f12880acb10 tx=0x7f1270006ec0).stop 2021-11-15T14:34:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 shutdown_connections 2021-11-15T14:34:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1260053720 0x7f1260055be0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1288148420 0x7f12880ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12880b1e30 0x7f12880abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 --2- 172.21.2.135:0/2441317115 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12880a7140 0x7f12880ae220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 >> 172.21.2.135:0/2441317115 conn(0x7f128805f730 msgr2=0x7f1288144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 shutdown_connections 2021-11-15T14:34:53.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.317+0000 7f128cda5700 1 -- 172.21.2.135:0/2441317115 wait complete. 2021-11-15T14:34:53.322 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:53.325 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-11-15T14:34:53.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 Processor -- start 2021-11-15T14:34:53.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- start start 2021-11-15T14:34:53.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb8a80ad150 0x7fb8a813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80b0bb0 0x7fb8a813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a80b04b0 con 0x7fb8a80afca0 2021-11-15T14:34:53.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80ad530 con 0x7fb8a80ad150 2021-11-15T14:34:53.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80b57d0 con 0x7fb8a80b0bb0 2021-11-15T14:34:53.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8aed29700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80b0bb0 0x7fb8a813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8add27700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fb8a80afca0 0x7fb8a813f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:52960/0 (socket says 172.21.2.135:52960) 2021-11-15T14:34:53.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8add27700 1 -- 172.21.2.135:0/3617407555 learned_addr learned my addr 172.21.2.135:0/3617407555 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:53.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 --2- 172.21.2.135:0/3617407555 >> v2:172.21.2.119:3300/0 conn(0x7fb8a80ad150 0x7fb8a813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 -- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80b0bb0 msgr2=0x7fb8a813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 --2- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80b0bb0 0x7fb8a813bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 -- 172.21.2.135:0/3617407555 >> v1:172.21.2.119:6789/0 conn(0x7fb8a80afca0 legacy=0x7fb8a813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 -- 172.21.2.135:0/3617407555 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80b06e0 con 0x7fb8a80ad150 2021-11-15T14:34:53.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ae528700 1 --2- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80ad150 0x7fb8a813f150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb89c002f70 tx=0x7fb89c006e80).ready entity=mon.0 client_cookie=17d986233487582 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ad526700 1 -- 172.21.2.135:0/3617407555 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb89c012070 con 0x7fb8a80ad150 2021-11-15T14:34:53.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ad526700 1 -- 172.21.2.135:0/3617407555 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c000e90 con 0x7fb8a80ad150 2021-11-15T14:34:53.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8ad526700 1 -- 172.21.2.135:0/3617407555 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb89c00f7f0 con 0x7fb8a80ad150 2021-11-15T14:34:53.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80ad150 msgr2=0x7fb8a813f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 --2- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80ad150 0x7fb8a813f150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb89c002f70 tx=0x7fb89c006e80).stop 2021-11-15T14:34:53.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- 172.21.2.135:0/3617407555 shutdown_connections 2021-11-15T14:34:53.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 --2- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80b0bb0 0x7fb8a813bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 --2- 172.21.2.135:0/3617407555 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80ad150 0x7fb8a813f150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- 172.21.2.135:0/3617407555 >> 172.21.2.135:0/3617407555 conn(0x7fb8a8062cb0 msgr2=0x7fb8a8063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- 172.21.2.135:0/3617407555 shutdown_connections 2021-11-15T14:34:53.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.373+0000 7fb8b078c700 1 -- 172.21.2.135:0/3617407555 wait complete. 2021-11-15T14:34:53.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 Processor -- start 2021-11-15T14:34:53.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- start start 2021-11-15T14:34:53.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80ad150 0x7fb8a812f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 0x7fb8a8131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81346b0 con 0x7fb8a80b0bb0 2021-11-15T14:34:53.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8132140 con 0x7fb8a80afca0 2021-11-15T14:34:53.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8134960 con 0x7fb8a80ad150 2021-11-15T14:34:53.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55962/0 (socket says 172.21.2.135:55962) 2021-11-15T14:34:53.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 -- 172.21.2.135:0/1706957095 learned_addr learned my addr 172.21.2.135:0/1706957095 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8ae528700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80ad150 0x7fb8a812f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8aed29700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 0x7fb8a8131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 -- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80ad150 msgr2=0x7fb8a812f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80ad150 0x7fb8a812f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 -- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 msgr2=0x7fb8a8131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 0x7fb8a8131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 -- 172.21.2.135:0/1706957095 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c00d590 con 0x7fb8a80afca0 2021-11-15T14:34:53.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8aed29700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 0x7fb8a8131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:53.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8add27700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb8a8060b80 tx=0x7fb8a4009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a4006320 con 0x7fb8a80afca0 2021-11-15T14:34:53.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4006480 con 0x7fb8a80afca0 2021-11-15T14:34:53.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8134c00 con 0x7fb8a80afca0 2021-11-15T14:34:53.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81350e0 con 0x7fb8a80afca0 2021-11-15T14:34:53.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a40067e0 con 0x7fb8a80afca0 2021-11-15T14:34:53.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a80b5a30 con 0x7fb8a80afca0 2021-11-15T14:34:53.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8a400f030 con 0x7fb8a80afca0 2021-11-15T14:34:53.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 0x7fb888055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fb8a406b8d0 con 0x7fb8a80afca0 2021-11-15T14:34:53.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.377+0000 7fb8ae528700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 0x7fb888055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.381+0000 7fb8ae528700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 0x7fb888055a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb89c01d000 tx=0x7fb8a80ae980).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.381+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8a4042b00 con 0x7fb8a80afca0 2021-11-15T14:34:53.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.493+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb8a80573d0 con 0x7fb8a80afca0 2021-11-15T14:34:53.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb89b7fe700 1 -- 172.21.2.135:0/1706957095 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb8a4046120 con 0x7fb8a80afca0 2021-11-15T14:34:53.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 msgr2=0x7fb888055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 0x7fb888055a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb89c01d000 tx=0x7fb8a80ae980).stop 2021-11-15T14:34:53.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 msgr2=0x7fb8a812ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb8a8060b80 tx=0x7fb8a4009120).stop 2021-11-15T14:34:53.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 shutdown_connections 2021-11-15T14:34:53.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8880535d0 0x7fb888055a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8a80b0bb0 0x7fb8a8131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8a80afca0 0x7fb8a812ea30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 --2- 172.21.2.135:0/1706957095 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8a80ad150 0x7fb8a812f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 >> 172.21.2.135:0/1706957095 conn(0x7fb8a8062cb0 msgr2=0x7fb8a81360d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 shutdown_connections 2021-11-15T14:34:53.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.505+0000 7fb8b078c700 1 -- 172.21.2.135:0/1706957095 wait complete. 2021-11-15T14:34:53.511 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:53.515 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-11-15T14:34:53.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.561+0000 7fd83a05c700 1 Processor -- start 2021-11-15T14:34:53.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.561+0000 7fd83a05c700 1 -- start start 2021-11-15T14:34:53.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd8340b6980 0x7fd8340acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340aa650 0x7fd83413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340b6d60 con 0x7fd834060990 2021-11-15T14:34:53.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834061260 con 0x7fd8340b6980 2021-11-15T14:34:53.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd834061500 con 0x7fd8340aa650 2021-11-15T14:34:53.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd832ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd834060990 0x7fd8340a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43560/0 (socket says 172.21.2.135:43560) 2021-11-15T14:34:53.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd832ffd700 1 -- 172.21.2.135:0/90698123 learned_addr learned my addr 172.21.2.135:0/90698123 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:53.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481167034 0 0) 0x7fd8340b6d60 con 0x7fd834060990 2021-11-15T14:34:53.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd814003260 con 0x7fd834060990 2021-11-15T14:34:53.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340aa650 0x7fd83413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 --2- 172.21.2.135:0/90698123 >> v2:172.21.2.119:3300/0 conn(0x7fd8340b6980 0x7fd8340acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319423543 0 0) 0x7fd814003260 con 0x7fd834060990 2021-11-15T14:34:53.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340aa650 msgr2=0x7fd83413c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340aa650 0x7fd83413c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 >> v2:172.21.2.119:3300/0 conn(0x7fd8340b6980 msgr2=0x7fd8340acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 --2- 172.21.2.135:0/90698123 >> v2:172.21.2.119:3300/0 conn(0x7fd8340b6980 0x7fd8340acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340617a0 con 0x7fd834060990 2021-11-15T14:34:53.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd81c001680 con 0x7fd834060990 2021-11-15T14:34:53.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 >> v1:172.21.2.135:6789/0 conn(0x7fd834060990 legacy=0x7fd8340a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd814003750 0x7fd814003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd814004500 0x7fd814004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814004e70 0x7fd81400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834061260 con 0x7fd814004e70 2021-11-15T14:34:53.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834061500 con 0x7fd814003750 2021-11-15T14:34:53.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81400cd50 con 0x7fd814004500 2021-11-15T14:34:53.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd814003750 0x7fd814003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd832ffd700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd814004500 0x7fd814004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814004e70 0x7fd81400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 -- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd814004500 msgr2=0x7fd814004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd814004500 0x7fd814004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 -- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814004e70 msgr2=0x7fd81400c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814004e70 0x7fd81400c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 -- 172.21.2.135:0/90698123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340617a0 con 0x7fd814003750 2021-11-15T14:34:53.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8337fe700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd814003750 0x7fd814003b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fd8140054d0 tx=0x7fd824008040).ready entity=mon.1 client_cookie=818b38a0303a8eac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd824013670 con 0x7fd814003750 2021-11-15T14:34:53.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240137d0 con 0x7fd814003750 2021-11-15T14:34:53.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd8327fc700 1 -- 172.21.2.135:0/90698123 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd824013b30 con 0x7fd814003750 2021-11-15T14:34:53.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- 172.21.2.135:0/90698123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd814003750 msgr2=0x7fd814003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- 172.21.2.135:0/90698123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd814003750 0x7fd814003b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fd8140054d0 tx=0x7fd824008040).stop 2021-11-15T14:34:53.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 -- 172.21.2.135:0/90698123 reap_dead start 2021-11-15T14:34:53.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- 172.21.2.135:0/90698123 shutdown_connections 2021-11-15T14:34:53.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- 172.21.2.135:0/90698123 >> 172.21.2.135:0/90698123 conn(0x7fd8340b3500 msgr2=0x7fd8340b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- 172.21.2.135:0/90698123 shutdown_connections 2021-11-15T14:34:53.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- 172.21.2.135:0/90698123 wait complete. 2021-11-15T14:34:53.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 Processor -- start 2021-11-15T14:34:53.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- start start 2021-11-15T14:34:53.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 0x7fd83413b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340630b0 0x7fd8340aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83413f840 con 0x7fd814003750 2021-11-15T14:34:53.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834154430 con 0x7fd8341508c0 2021-11-15T14:34:53.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd83a05c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341546d0 con 0x7fd8340630b0 2021-11-15T14:34:53.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55982/0 (socket says 172.21.2.135:55982) 2021-11-15T14:34:53.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd833fff700 1 -- 172.21.2.135:0/1495280920 learned_addr learned my addr 172.21.2.135:0/1495280920 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.565+0000 7fd832ffd700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340630b0 0x7fd8340aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd8337fe700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 0x7fd83413b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 -- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340630b0 msgr2=0x7fd8340aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340630b0 0x7fd8340aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 -- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 msgr2=0x7fd83413b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 0x7fd83413b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 -- 172.21.2.135:0/1495280920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8341400f0 con 0x7fd8341508c0 2021-11-15T14:34:53.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd8337fe700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 0x7fd83413b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:53.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd833fff700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd82c008000 tx=0x7fd82c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c019070 con 0x7fd8341508c0 2021-11-15T14:34:53.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00c030 con 0x7fd8341508c0 2021-11-15T14:34:53.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c014a00 con 0x7fd8341508c0 2021-11-15T14:34:53.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83413bd80 con 0x7fd8341508c0 2021-11-15T14:34:53.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834140590 con 0x7fd8341508c0 2021-11-15T14:34:53.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8341504f0 con 0x7fd8341508c0 2021-11-15T14:34:53.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd82c012040 con 0x7fd8341508c0 2021-11-15T14:34:53.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 0x7fd818055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fd82c06b4b0 con 0x7fd8341508c0 2021-11-15T14:34:53.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd8337fe700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 0x7fd818055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd8337fe700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 0x7fd818055b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd824002000 tx=0x7fd824018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.569+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8341504f0 con 0x7fd8341508c0 2021-11-15T14:34:53.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.685+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd8341504f0 con 0x7fd8341508c0 2021-11-15T14:34:53.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd830ff9700 1 -- 172.21.2.135:0/1495280920 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd8341504f0 con 0x7fd8341508c0 2021-11-15T14:34:53.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 msgr2=0x7fd818055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 0x7fd818055b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd824002000 tx=0x7fd824018000).stop 2021-11-15T14:34:53.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 msgr2=0x7fd834150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd82c008000 tx=0x7fd82c008040).stop 2021-11-15T14:34:53.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 shutdown_connections 2021-11-15T14:34:53.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd818053640 0x7fd818055b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8341508c0 0x7fd834150d40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8340630b0 0x7fd8340aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 --2- 172.21.2.135:0/1495280920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd814003750 0x7fd83413b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 >> 172.21.2.135:0/1495280920 conn(0x7fd8340b3500 msgr2=0x7fd83413cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 shutdown_connections 2021-11-15T14:34:53.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.697+0000 7fd83a05c700 1 -- 172.21.2.135:0/1495280920 wait complete. 2021-11-15T14:34:53.703 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:53.707 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-11-15T14:34:53.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.753+0000 7f4809eab700 1 Processor -- start 2021-11-15T14:34:53.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.753+0000 7f4809eab700 1 -- start start 2021-11-15T14:34:53.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4804139b60 0x7f4804142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4804143320 0x7f48040ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f48040b1cd0 0x7f48040abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040b3090 con 0x7f4804139b60 2021-11-15T14:34:53.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040af3a0 con 0x7f4804143320 2021-11-15T14:34:53.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040ac4f0 con 0x7f48040b1cd0 2021-11-15T14:34:53.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4804143320 0x7f48040ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4804143320 0x7f48040ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55990/0 (socket says 172.21.2.135:55990) 2021-11-15T14:34:53.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 -- 172.21.2.135:0/1199100726 learned_addr learned my addr 172.21.2.135:0/1199100726 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 -- 172.21.2.135:0/1199100726 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f48040b1cd0 msgr2=0x7f48040abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 --2- 172.21.2.135:0/1199100726 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f48040b1cd0 0x7f48040abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 -- 172.21.2.135:0/1199100726 >> v2:172.21.2.119:3300/0 conn(0x7f4804139b60 msgr2=0x7f4804142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 --2- 172.21.2.135:0/1199100726 >> v2:172.21.2.119:3300/0 conn(0x7f4804139b60 0x7f4804142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 -- 172.21.2.135:0/1199100726 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48041437b0 con 0x7f4804143320 2021-11-15T14:34:53.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4802ffd700 1 --2- 172.21.2.135:0/1199100726 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4804143320 0x7f48040ab5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f47f4002f70 tx=0x7f47f4006eb0).ready entity=mon.1 client_cookie=cd136dfc38e921b0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48027fc700 1 -- 172.21.2.135:0/1199100726 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f400d570 con 0x7f4804143320 2021-11-15T14:34:53.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48027fc700 1 -- 172.21.2.135:0/1199100726 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4000e90 con 0x7f4804143320 2021-11-15T14:34:53.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48027fc700 1 -- 172.21.2.135:0/1199100726 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f400d900 con 0x7f4804143320 2021-11-15T14:34:53.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- 172.21.2.135:0/1199100726 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4804143320 msgr2=0x7f48040ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- 172.21.2.135:0/1199100726 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4804143320 0x7f48040ab5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f47f4002f70 tx=0x7f47f4006eb0).stop 2021-11-15T14:34:53.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- 172.21.2.135:0/1199100726 shutdown_connections 2021-11-15T14:34:53.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- 172.21.2.135:0/1199100726 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f48040b1cd0 0x7f48040abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- 172.21.2.135:0/1199100726 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4804143320 0x7f48040ab5b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- 172.21.2.135:0/1199100726 >> v2:172.21.2.119:3300/0 conn(0x7f4804139b60 0x7f4804142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- 172.21.2.135:0/1199100726 >> 172.21.2.135:0/1199100726 conn(0x7f480405f730 msgr2=0x7f480405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- 172.21.2.135:0/1199100726 shutdown_connections 2021-11-15T14:34:53.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- 172.21.2.135:0/1199100726 wait complete. 2021-11-15T14:34:53.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 Processor -- start 2021-11-15T14:34:53.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- start start 2021-11-15T14:34:53.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f480412fe30 0x7f480412c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f480412f0c0 0x7f480412cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804130510 con 0x7f480412fe30 2021-11-15T14:34:53.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480413a490 con 0x7f48040b1cd0 2021-11-15T14:34:53.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f4809eab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4804154940 con 0x7f480412f0c0 2021-11-15T14:34:53.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:55996/0 (socket says 172.21.2.135:55996) 2021-11-15T14:34:53.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 -- 172.21.2.135:0/1841413620 learned_addr learned my addr 172.21.2.135:0/1841413620 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 -- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f480412f0c0 msgr2=0x7f480412cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f480412f0c0 0x7f480412cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 -- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f480412fe30 msgr2=0x7f480412c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f480412fe30 0x7f480412c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 -- 172.21.2.135:0/1841413620 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f400b1e0 con 0x7f48040b1cd0 2021-11-15T14:34:53.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.757+0000 7f48037fe700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f480413c6d0 tx=0x7f47ec006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ec013460 con 0x7f48040b1cd0 2021-11-15T14:34:53.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0135c0 con 0x7f48040b1cd0 2021-11-15T14:34:53.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480413a6c0 con 0x7f48040b1cd0 2021-11-15T14:34:53.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ec013920 con 0x7f48040b1cd0 2021-11-15T14:34:53.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480412d290 con 0x7f48040b1cd0 2021-11-15T14:34:53.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4804143a50 con 0x7f48040b1cd0 2021-11-15T14:34:53.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f47ec00f070 con 0x7f48040b1cd0 2021-11-15T14:34:53.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 0x7f47e80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f47ec06b040 con 0x7f48040b1cd0 2021-11-15T14:34:53.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4802ffd700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 0x7f47e80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.761+0000 7f4802ffd700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 0x7f47e80559b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f47f4002f70 tx=0x7f47f4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.765+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f47ec042380 con 0x7f48040b1cd0 2021-11-15T14:34:53.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.873+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f48040573d0 con 0x7f48040b1cd0 2021-11-15T14:34:53.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4800ff9700 1 -- 172.21.2.135:0/1841413620 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f47ec0459a0 con 0x7f48040b1cd0 2021-11-15T14:34:53.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 msgr2=0x7f47e80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 0x7f47e80559b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f47f4002f70 tx=0x7f47f4015000).stop 2021-11-15T14:34:53.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 msgr2=0x7f480412f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f480413c6d0 tx=0x7f47ec006e40).stop 2021-11-15T14:34:53.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 shutdown_connections 2021-11-15T14:34:53.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f47e80534f0 0x7f47e80559b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f480412f0c0 0x7f480412cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f480412fe30 0x7f480412c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 --2- 172.21.2.135:0/1841413620 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f48040b1cd0 0x7f480412f940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 >> 172.21.2.135:0/1841413620 conn(0x7f480405f730 msgr2=0x7f48040aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 shutdown_connections 2021-11-15T14:34:53.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.885+0000 7f4809eab700 1 -- 172.21.2.135:0/1841413620 wait complete. 2021-11-15T14:34:53.891 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:53.894 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-11-15T14:34:53.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 Processor -- start 2021-11-15T14:34:53.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 -- start start 2021-11-15T14:34:53.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 0x7f66880b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f66880af010 0x7f66880b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880b0b30 con 0x7f668805f730 2021-11-15T14:34:53.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880b0dd0 con 0x7f66880af010 2021-11-15T14:34:53.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668e306700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880ae8d0 con 0x7f66880ad560 2021-11-15T14:34:53.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668db05700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f668805f730 0x7f668805fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43590/0 (socket says 172.21.2.135:43590) 2021-11-15T14:34:53.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f668db05700 1 -- 172.21.2.135:0/1093755990 learned_addr learned my addr 172.21.2.135:0/1093755990 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:53.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440353336 0 0) 0x7f66880b0b30 con 0x7f668805f730 2021-11-15T14:34:53.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.941+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6670003260 con 0x7f668805f730 2021-11-15T14:34:53.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 628221238 0 0) 0x7f6670003260 con 0x7f668805f730 2021-11-15T14:34:53.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 0x7f66880b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 msgr2=0x7f66880b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 0x7f66880b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668cb03700 1 --2- 172.21.2.135:0/1093755990 >> v2:172.21.2.119:3300/0 conn(0x7f66880af010 0x7f66880b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 >> v2:172.21.2.119:3300/0 conn(0x7f66880af010 msgr2=0x7f66880b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 --2- 172.21.2.135:0/1093755990 >> v2:172.21.2.119:3300/0 conn(0x7f66880af010 0x7f66880b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:53.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880aeb70 con 0x7f668805f730 2021-11-15T14:34:53.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f66800019e0 con 0x7f668805f730 2021-11-15T14:34:53.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 >> v1:172.21.2.135:6789/0 conn(0x7f668805f730 legacy=0x7f668805fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6670003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6670004500 0x7f6670004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 0x7f667000c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b0dd0 con 0x7f6670004500 2021-11-15T14:34:53.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880ae8d0 con 0x7f66700037d0 2021-11-15T14:34:53.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6670005300 con 0x7f66880ad560 2021-11-15T14:34:53.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6670003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 msgr2=0x7f667000c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66880ad560 0x7f667000c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6670004500 msgr2=0x7f6670004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:53.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6670004500 0x7f6670004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/1093755990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670003260 con 0x7f66700037d0 2021-11-15T14:34:53.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6670003bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f667c007000 tx=0x7f667c008040).ready entity=mon.1 client_cookie=606d6fcfdfdb2ba2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667c012470 con 0x7f66700037d0 2021-11-15T14:34:53.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00c030 con 0x7f66700037d0 2021-11-15T14:34:53.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667bfff700 1 -- 172.21.2.135:0/1093755990 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667c0127c0 con 0x7f66700037d0 2021-11-15T14:34:53.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/1093755990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 msgr2=0x7f6670003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 --2- 172.21.2.135:0/1093755990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6670003bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f667c007000 tx=0x7f667c008040).stop 2021-11-15T14:34:53.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668db05700 1 -- 172.21.2.135:0/1093755990 reap_dead start 2021-11-15T14:34:53.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/1093755990 shutdown_connections 2021-11-15T14:34:53.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/1093755990 >> 172.21.2.135:0/1093755990 conn(0x7f6688061250 msgr2=0x7f6688062e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:53.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/1093755990 shutdown_connections 2021-11-15T14:34:53.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/1093755990 wait complete. 2021-11-15T14:34:53.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 Processor -- start 2021-11-15T14:34:53.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- start start 2021-11-15T14:34:53.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6688063b30 0x7f6688067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6688064140 0x7f66880645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b6060 con 0x7f6688064140 2021-11-15T14:34:53.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688152bf0 con 0x7f66700037d0 2021-11-15T14:34:53.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6688067980 con 0x7f6688063b30 2021-11-15T14:34:53.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56014/0 (socket says 172.21.2.135:56014) 2021-11-15T14:34:53.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/3635830708 learned_addr learned my addr 172.21.2.135:0/3635830708 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:53.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6688063b30 msgr2=0x7f6688067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6688063b30 0x7f6688067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6688064140 msgr2=0x7f66880645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:53.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6688064140 0x7f66880645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:53.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 -- 172.21.2.135:0/3635830708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880b6290 con 0x7f66700037d0 2021-11-15T14:34:53.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668d304700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f667c007000 tx=0x7f667c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667c021070 con 0x7f66700037d0 2021-11-15T14:34:53.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c000e90 con 0x7f66700037d0 2021-11-15T14:34:53.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f667c01dae0 con 0x7f66700037d0 2021-11-15T14:34:53.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6688064ae0 con 0x7f66700037d0 2021-11-15T14:34:53.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.945+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880b5170 con 0x7f66700037d0 2021-11-15T14:34:53.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6688152d60 con 0x7f66700037d0 2021-11-15T14:34:53.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f667c01dc40 con 0x7f66700037d0 2021-11-15T14:34:53.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f667a7fc700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 0x7f6668055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:53.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f667c06cae0 con 0x7f66700037d0 2021-11-15T14:34:53.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f668cb03700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 0x7f6668055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:53.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f668cb03700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 0x7f6668055ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6684007000 tx=0x7f6684008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:53.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:53.949+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f667c043d10 con 0x7f66700037d0 2021-11-15T14:34:54.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.061+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f66880b33d0 con 0x7f66700037d0 2021-11-15T14:34:54.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.073+0000 7f667a7fc700 1 -- 172.21.2.135:0/3635830708 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f667c047330 con 0x7f66700037d0 2021-11-15T14:34:54.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 msgr2=0x7f6668055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 0x7f6668055ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6684007000 tx=0x7f6684008040).stop 2021-11-15T14:34:54.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 msgr2=0x7f6688066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f667c007000 tx=0x7f667c008040).stop 2021-11-15T14:34:54.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 shutdown_connections 2021-11-15T14:34:54.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6668053610 0x7f6668055ad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6688064140 0x7f66880645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6688063b30 0x7f6688067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 --2- 172.21.2.135:0/3635830708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66700037d0 0x7f6688066e40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 >> 172.21.2.135:0/3635830708 conn(0x7f6688061250 msgr2=0x7f668813eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 shutdown_connections 2021-11-15T14:34:54.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.077+0000 7f668e306700 1 -- 172.21.2.135:0/3635830708 wait complete. 2021-11-15T14:34:54.082 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:54.086 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-11-15T14:34:54.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 Processor -- start 2021-11-15T14:34:54.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 -- start start 2021-11-15T14:34:54.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57580aa1a0 0x7f57580ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580b0900 0x7f5758140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57580b2b70 con 0x7f57580b0520 2021-11-15T14:34:54.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580b27f0 con 0x7f57580aa1a0 2021-11-15T14:34:54.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f575dd17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b2da0 con 0x7f57580b0900 2021-11-15T14:34:54.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f5756ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57580aa1a0 0x7f57580ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f5756ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57580aa1a0 0x7f57580ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56024/0 (socket says 172.21.2.135:56024) 2021-11-15T14:34:54.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.133+0000 7f5756ffd700 1 -- 172.21.2.135:0/57906323 learned_addr learned my addr 172.21.2.135:0/57906323 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5756ffd700 1 -- 172.21.2.135:0/57906323 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580b0900 msgr2=0x7f5758140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5756ffd700 1 --2- 172.21.2.135:0/57906323 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580b0900 0x7f5758140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5756ffd700 1 -- 172.21.2.135:0/57906323 >> v1:172.21.2.119:6789/0 conn(0x7f57580b0520 legacy=0x7f57580addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5756ffd700 1 -- 172.21.2.135:0/57906323 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580a9bf0 con 0x7f57580aa1a0 2021-11-15T14:34:54.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5756ffd700 1 --2- 172.21.2.135:0/57906323 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580aa1a0 0x7f57580ae4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f57580b77f0 tx=0x7f5748006f40).ready entity=mon.1 client_cookie=57d3be383d8d4685 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f57567fc700 1 -- 172.21.2.135:0/57906323 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574800dc30 con 0x7f57580aa1a0 2021-11-15T14:34:54.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f57567fc700 1 -- 172.21.2.135:0/57906323 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748000e90 con 0x7f57580aa1a0 2021-11-15T14:34:54.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f57567fc700 1 -- 172.21.2.135:0/57906323 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574800be90 con 0x7f57580aa1a0 2021-11-15T14:34:54.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/57906323 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580aa1a0 msgr2=0x7f57580ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- 172.21.2.135:0/57906323 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580aa1a0 0x7f57580ae4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f57580b77f0 tx=0x7f5748006f40).stop 2021-11-15T14:34:54.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/57906323 shutdown_connections 2021-11-15T14:34:54.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- 172.21.2.135:0/57906323 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580b0900 0x7f5758140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- 172.21.2.135:0/57906323 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580aa1a0 0x7f57580ae4c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/57906323 >> 172.21.2.135:0/57906323 conn(0x7f5758060840 msgr2=0x7f5758060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/57906323 shutdown_connections 2021-11-15T14:34:54.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/57906323 wait complete. 2021-11-15T14:34:54.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 Processor -- start 2021-11-15T14:34:54.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- start start 2021-11-15T14:34:54.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580aa1a0 0x7f5758140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57580b0520 0x7f575813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758141650 con 0x7f57580b0520 2021-11-15T14:34:54.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581418f0 con 0x7f57580b0900 2021-11-15T14:34:54.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758141b90 con 0x7f57580aa1a0 2021-11-15T14:34:54.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56028/0 (socket says 172.21.2.135:56028) 2021-11-15T14:34:54.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 -- 172.21.2.135:0/871307954 learned_addr learned my addr 172.21.2.135:0/871307954 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 -- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580aa1a0 msgr2=0x7f5758140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580aa1a0 0x7f5758140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 -- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57580b0520 msgr2=0x7f575813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57580b0520 0x7f575813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 -- 172.21.2.135:0/871307954 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574800b460 con 0x7f57580b0900 2021-11-15T14:34:54.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5757fff700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f57500032f0 tx=0x7f5750006f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f575000f510 con 0x7f57580b0900 2021-11-15T14:34:54.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5758141e30 con 0x7f57580b0900 2021-11-15T14:34:54.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57581422d0 con 0x7f57580b0900 2021-11-15T14:34:54.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575000f670 con 0x7f57580b0900 2021-11-15T14:34:54.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f575000f7e0 con 0x7f57580b0900 2021-11-15T14:34:54.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758141fc0 con 0x7f57580b0900 2021-11-15T14:34:54.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.137+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f575000f070 con 0x7f57580b0900 2021-11-15T14:34:54.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.141+0000 7f5754ff9700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 0x7f5738055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.141+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f575006b440 con 0x7f57580b0900 2021-11-15T14:34:54.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.141+0000 7f57577fe700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 0x7f5738055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.141+0000 7f57577fe700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 0x7f5738055ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f574c002f90 tx=0x7f574c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.141+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5750042670 con 0x7f57580b0900 2021-11-15T14:34:54.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.253+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f57580573d0 con 0x7f57580b0900 2021-11-15T14:34:54.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f5754ff9700 1 -- 172.21.2.135:0/871307954 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5750045c90 con 0x7f57580b0900 2021-11-15T14:34:54.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 msgr2=0x7f5738055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 0x7f5738055ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f574c002f90 tx=0x7f574c0069b0).stop 2021-11-15T14:34:54.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 msgr2=0x7f57581518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f57500032f0 tx=0x7f5750006f90).stop 2021-11-15T14:34:54.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 shutdown_connections 2021-11-15T14:34:54.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5738053610 0x7f5738055ad0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57580b0900 0x7f57581518d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57580b0520 0x7f575813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 --2- 172.21.2.135:0/871307954 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57580aa1a0 0x7f5758140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.265+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 >> 172.21.2.135:0/871307954 conn(0x7f5758060840 msgr2=0x7f57580b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.269+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 shutdown_connections 2021-11-15T14:34:54.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.269+0000 7f575dd17700 1 -- 172.21.2.135:0/871307954 wait complete. 2021-11-15T14:34:54.273 INFO:teuthology.orchestra.run.gibba035.stderr:updated 2021-11-15T14:34:54.277 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:54.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.321+0000 7f22bce32700 1 Processor -- start 2021-11-15T14:34:54.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.321+0000 7f22bce32700 1 -- start start 2021-11-15T14:34:54.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f22b80a9f30 0x7f22b80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80b31b0 0x7f22b80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f22b814b5e0 0x7f22b805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80ae380 con 0x7f22b80a9f30 2021-11-15T14:34:54.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80aa310 con 0x7f22b814b5e0 2021-11-15T14:34:54.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80af5e0 con 0x7f22b80b31b0 2021-11-15T14:34:54.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f22b814b5e0 0x7f22b805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f22b814b5e0 0x7f22b805f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56040/0 (socket says 172.21.2.135:56040) 2021-11-15T14:34:54.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 -- 172.21.2.135:0/926583365 learned_addr learned my addr 172.21.2.135:0/926583365 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 -- 172.21.2.135:0/926583365 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80b31b0 msgr2=0x7f22b80af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 --2- 172.21.2.135:0/926583365 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80b31b0 0x7f22b80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 -- 172.21.2.135:0/926583365 >> v2:172.21.2.119:3300/0 conn(0x7f22b80a9f30 msgr2=0x7f22b80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 --2- 172.21.2.135:0/926583365 >> v2:172.21.2.119:3300/0 conn(0x7f22b80a9f30 0x7f22b80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 -- 172.21.2.135:0/926583365 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b81481f0 con 0x7f22b814b5e0 2021-11-15T14:34:54.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b6d9d700 1 --2- 172.21.2.135:0/926583365 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b814b5e0 0x7f22b805f730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f22b00032f0 tx=0x7f22b0009290).ready entity=mon.1 client_cookie=dbcea24e46cc8826 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b559a700 1 -- 172.21.2.135:0/926583365 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b000b870 con 0x7f22b814b5e0 2021-11-15T14:34:54.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b559a700 1 -- 172.21.2.135:0/926583365 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000b9d0 con 0x7f22b814b5e0 2021-11-15T14:34:54.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b559a700 1 -- 172.21.2.135:0/926583365 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b000bb40 con 0x7f22b814b5e0 2021-11-15T14:34:54.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/926583365 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b814b5e0 msgr2=0x7f22b805f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- 172.21.2.135:0/926583365 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b814b5e0 0x7f22b805f730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f22b00032f0 tx=0x7f22b0009290).stop 2021-11-15T14:34:54.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/926583365 shutdown_connections 2021-11-15T14:34:54.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- 172.21.2.135:0/926583365 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b814b5e0 0x7f22b805f730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- 172.21.2.135:0/926583365 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80b31b0 0x7f22b80af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- 172.21.2.135:0/926583365 >> v2:172.21.2.119:3300/0 conn(0x7f22b80a9f30 0x7f22b80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/926583365 >> 172.21.2.135:0/926583365 conn(0x7f22b8060840 msgr2=0x7f22b8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/926583365 shutdown_connections 2021-11-15T14:34:54.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/926583365 wait complete. 2021-11-15T14:34:54.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 Processor -- start 2021-11-15T14:34:54.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- start start 2021-11-15T14:34:54.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80a9f30 0x7f22b8143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22b814b5e0 0x7f22b80b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8156a40 con 0x7f22b814b5e0 2021-11-15T14:34:54.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b815a150 con 0x7f22b80b31b0 2021-11-15T14:34:54.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8159eb0 con 0x7f22b80a9f30 2021-11-15T14:34:54.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56046/0 (socket says 172.21.2.135:56046) 2021-11-15T14:34:54.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 -- 172.21.2.135:0/3171221995 learned_addr learned my addr 172.21.2.135:0/3171221995 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 -- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80a9f30 msgr2=0x7f22b8143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80a9f30 0x7f22b8143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 -- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22b814b5e0 msgr2=0x7f22b80b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22b814b5e0 0x7f22b80b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 -- 172.21.2.135:0/3171221995 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009530 con 0x7f22b80b31b0 2021-11-15T14:34:54.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22b5d9b700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f22a0002f70 tx=0x7f22a0006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22a0013460 con 0x7f22b80b31b0 2021-11-15T14:34:54.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a00135c0 con 0x7f22b80b31b0 2021-11-15T14:34:54.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b8156ca0 con 0x7f22b80b31b0 2021-11-15T14:34:54.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22a0013920 con 0x7f22b80b31b0 2021-11-15T14:34:54.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.325+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b8157630 con 0x7f22b80b31b0 2021-11-15T14:34:54.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b8156e30 con 0x7f22b80b31b0 2021-11-15T14:34:54.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f22a001a060 con 0x7f22b80b31b0 2021-11-15T14:34:54.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22af7fe700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 0x7f229c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f22a006b0d0 con 0x7f22b80b31b0 2021-11-15T14:34:54.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22b659c700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 0x7f229c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22b659c700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 0x7f229c055b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f22a8002f70 tx=0x7f22a8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.329+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f22a0042410 con 0x7f22b80b31b0 2021-11-15T14:34:54.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b8148490 con 0x7f22b80b31b0 2021-11-15T14:34:54.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22af7fe700 1 -- 172.21.2.135:0/3171221995 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f22a0018070 con 0x7f22b80b31b0 2021-11-15T14:34:54.417 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:54.418 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":30,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:52.880610+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:54.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 msgr2=0x7f229c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 0x7f229c055b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f22a8002f70 tx=0x7f22a8006a80).stop 2021-11-15T14:34:54.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 msgr2=0x7f22b8157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f22a0002f70 tx=0x7f22a0006e40).stop 2021-11-15T14:34:54.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 shutdown_connections 2021-11-15T14:34:54.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f229c0536a0 0x7f229c055b60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22b814b5e0 0x7f22b80b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22b80b31b0 0x7f22b8157140 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 --2- 172.21.2.135:0/3171221995 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22b80a9f30 0x7f22b8143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 >> 172.21.2.135:0/3171221995 conn(0x7f22b8060840 msgr2=0x7f22b8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 shutdown_connections 2021-11-15T14:34:54.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.413+0000 7f22bce32700 1 -- 172.21.2.135:0/3171221995 wait complete. 2021-11-15T14:34:54.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:34:54.425 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:34:54.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 Processor -- start 2021-11-15T14:34:54.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 -- start start 2021-11-15T14:34:54.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3f480b1f40 0x7f3f480b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480b04a0 con 0x7f3f480b2320 2021-11-15T14:34:54.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480a7850 con 0x7f3f480b0030 2021-11-15T14:34:54.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f4e0db700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f480b06d0 con 0x7f3f480b1f40 2021-11-15T14:34:54.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f46ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3f480b0030 0x7f3f480a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43642/0 (socket says 172.21.2.135:43642) 2021-11-15T14:34:54.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f46ffd700 1 -- 172.21.2.135:0/807724957 learned_addr learned my addr 172.21.2.135:0/807724957 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:54.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f477fe700 1 --2- 172.21.2.135:0/807724957 >> v2:172.21.2.135:3300/0 conn(0x7f3f480b1f40 0x7f3f480b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f467fc700 1 -- 172.21.2.135:0/807724957 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553064961 0 0) 0x7f3f480a7850 con 0x7f3f480b0030 2021-11-15T14:34:54.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f477fe700 1 -- 172.21.2.135:0/807724957 >> v1:172.21.2.135:6789/0 conn(0x7f3f480b0030 legacy=0x7f3f480a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f477fe700 1 -- 172.21.2.135:0/807724957 >> v1:172.21.2.119:6789/0 conn(0x7f3f480b2320 legacy=0x7f3f481412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f477fe700 1 -- 172.21.2.135:0/807724957 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480b0970 con 0x7f3f480b1f40 2021-11-15T14:34:54.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f477fe700 1 --2- 172.21.2.135:0/807724957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b1f40 0x7f3f480b1350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f3f480ad350 tx=0x7f3f30006df0).ready entity=mon.1 client_cookie=a3aa3c836c2f3bef server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f467fc700 1 -- 172.21.2.135:0/807724957 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3000d5c0 con 0x7f3f480b1f40 2021-11-15T14:34:54.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f467fc700 1 -- 172.21.2.135:0/807724957 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30000e90 con 0x7f3f480b1f40 2021-11-15T14:34:54.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.473+0000 7f3f467fc700 1 -- 172.21.2.135:0/807724957 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3000d910 con 0x7f3f480b1f40 2021-11-15T14:34:54.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/807724957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b1f40 msgr2=0x7f3f480b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/807724957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b1f40 0x7f3f480b1350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f3f480ad350 tx=0x7f3f30006df0).stop 2021-11-15T14:34:54.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/807724957 shutdown_connections 2021-11-15T14:34:54.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/807724957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b1f40 0x7f3f480b1350 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/807724957 >> 172.21.2.135:0/807724957 conn(0x7f3f4805f730 msgr2=0x7f3f4805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/807724957 shutdown_connections 2021-11-15T14:34:54.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/807724957 wait complete. 2021-11-15T14:34:54.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 Processor -- start 2021-11-15T14:34:54.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- start start 2021-11-15T14:34:54.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f480b0030 0x7f3f480ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f480b1f40 0x7f3f4813ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480b4870 con 0x7f3f480b1f40 2021-11-15T14:34:54.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480ac1f0 con 0x7f3f480b2320 2021-11-15T14:34:54.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4814b980 con 0x7f3f480b0030 2021-11-15T14:34:54.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56060/0 (socket says 172.21.2.135:56060) 2021-11-15T14:34:54.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 -- 172.21.2.135:0/2577801824 learned_addr learned my addr 172.21.2.135:0/2577801824 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 -- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f480b0030 msgr2=0x7f3f480ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f480b0030 0x7f3f480ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 -- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f480b1f40 msgr2=0x7f3f4813ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f480b1f40 0x7f3f4813ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 -- 172.21.2.135:0/2577801824 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3000b180 con 0x7f3f480b2320 2021-11-15T14:34:54.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f47fff700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f3f40003290 tx=0x7f3f400090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4000f510 con 0x7f3f480b2320 2021-11-15T14:34:54.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4000f670 con 0x7f3f480b2320 2021-11-15T14:34:54.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f48148e50 con 0x7f3f480b2320 2021-11-15T14:34:54.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4000f7e0 con 0x7f3f480b2320 2021-11-15T14:34:54.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f480aadc0 con 0x7f3f480b2320 2021-11-15T14:34:54.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480aa7e0 con 0x7f3f480b2320 2021-11-15T14:34:54.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3f4000f070 con 0x7f3f480b2320 2021-11-15T14:34:54.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 0x7f3f2c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f3f4006b370 con 0x7f3f480b2320 2021-11-15T14:34:54.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.477+0000 7f3f477fe700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 0x7f3f2c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.481+0000 7f3f477fe700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 0x7f3f2c055a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3f480ad350 tx=0x7f3f30012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.481+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f400426b0 con 0x7f3f480b2320 2021-11-15T14:34:54.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.561+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f480b0c10 con 0x7f3f480b2320 2021-11-15T14:34:54.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.561+0000 7f3f44ff9700 1 -- 172.21.2.135:0/2577801824 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f40045cd0 con 0x7f3f480b2320 2021-11-15T14:34:54.566 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:34:54.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 msgr2=0x7f3f2c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 0x7f3f2c055a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3f480ad350 tx=0x7f3f30012000).stop 2021-11-15T14:34:54.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 msgr2=0x7f3f48148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f3f40003290 tx=0x7f3f400090f0).stop 2021-11-15T14:34:54.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 shutdown_connections 2021-11-15T14:34:54.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3f2c053580 0x7f3f2c055a40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f480b2320 0x7f3f48148960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f480b1f40 0x7f3f4813ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 --2- 172.21.2.135:0/2577801824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f480b0030 0x7f3f480ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 >> 172.21.2.135:0/2577801824 conn(0x7f3f4805f730 msgr2=0x7f3f4813def0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 shutdown_connections 2021-11-15T14:34:54.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.565+0000 7f3f4e0db700 1 -- 172.21.2.135:0/2577801824 wait complete. 2021-11-15T14:34:54.574 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:34:54.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.625+0000 7efe98477700 1 Processor -- start 2021-11-15T14:34:54.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.625+0000 7efe98477700 1 -- start start 2021-11-15T14:34:54.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7efe900ad0c0 0x7efe900b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900b5fc0 con 0x7efe9013ca40 2021-11-15T14:34:54.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ad4a0 con 0x7efe900afb70 2021-11-15T14:34:54.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900aebe0 con 0x7efe900ad0c0 2021-11-15T14:34:54.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95a12700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7efe900afb70 0x7efe9013c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43656/0 (socket says 172.21.2.135:43656) 2021-11-15T14:34:54.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95a12700 1 -- 172.21.2.135:0/330116779 learned_addr learned my addr 172.21.2.135:0/330116779 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:54.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089472999 0 0) 0x7efe900ad4a0 con 0x7efe900afb70 2021-11-15T14:34:54.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe78003260 con 0x7efe900afb70 2021-11-15T14:34:54.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887095505 0 0) 0x7efe78003260 con 0x7efe900afb70 2021-11-15T14:34:54.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 >> v2:172.21.2.119:3300/0 conn(0x7efe900ad0c0 msgr2=0x7efe900b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 --2- 172.21.2.135:0/330116779 >> v2:172.21.2.119:3300/0 conn(0x7efe900ad0c0 0x7efe900b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 >> v1:172.21.2.119:6789/0 conn(0x7efe9013ca40 legacy=0x7efe9013f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900aee80 con 0x7efe900afb70 2021-11-15T14:34:54.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7efe8c001680 con 0x7efe900afb70 2021-11-15T14:34:54.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 >> v1:172.21.2.135:6789/0 conn(0x7efe900afb70 legacy=0x7efe9013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe78003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe78004500 0x7efe78004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe78005050 0x7efe78007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900aebe0 con 0x7efe78004500 2021-11-15T14:34:54.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78007f20 con 0x7efe78003820 2021-11-15T14:34:54.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780080e0 con 0x7efe78005050 2021-11-15T14:34:54.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe78003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95a12700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe78004500 0x7efe78004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 -- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe78005050 msgr2=0x7efe78007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96a14700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe78005050 0x7efe78007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe78005050 0x7efe78007730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 -- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe78004500 msgr2=0x7efe78004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe78004500 0x7efe78004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 -- 172.21.2.135:0/330116779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78003260 con 0x7efe78003820 2021-11-15T14:34:54.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96a14700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe78005050 0x7efe78007730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:54.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96a14700 1 -- 172.21.2.135:0/330116779 reap_dead start 2021-11-15T14:34:54.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe96213700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe78003c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7efe84002f70 tx=0x7efe84006ca0).ready entity=mon.1 client_cookie=57a618d154b7c190 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe84013410 con 0x7efe78003820 2021-11-15T14:34:54.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84013570 con 0x7efe78003820 2021-11-15T14:34:54.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe95211700 1 -- 172.21.2.135:0/330116779 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe840138d0 con 0x7efe78003820 2021-11-15T14:34:54.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 msgr2=0x7efe78003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe78003c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7efe84002f70 tx=0x7efe84006ca0).stop 2021-11-15T14:34:54.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- 172.21.2.135:0/330116779 shutdown_connections 2021-11-15T14:34:54.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 --2- 172.21.2.135:0/330116779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe78003c20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- 172.21.2.135:0/330116779 >> 172.21.2.135:0/330116779 conn(0x7efe9005c510 msgr2=0x7efe9005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- 172.21.2.135:0/330116779 shutdown_connections 2021-11-15T14:34:54.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- 172.21.2.135:0/330116779 wait complete. 2021-11-15T14:34:54.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 Processor -- start 2021-11-15T14:34:54.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.629+0000 7efe98477700 1 -- start start 2021-11-15T14:34:54.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe90134a00 0x7efe9014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe901520c0 0x7efe9014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901514b0 con 0x7efe901520c0 2021-11-15T14:34:54.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901516e0 con 0x7efe78003820 2021-11-15T14:34:54.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe90151980 con 0x7efe90134a00 2021-11-15T14:34:54.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56076/0 (socket says 172.21.2.135:56076) 2021-11-15T14:34:54.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 -- 172.21.2.135:0/3440759199 learned_addr learned my addr 172.21.2.135:0/3440759199 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 -- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe90134a00 msgr2=0x7efe9014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe90134a00 0x7efe9014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 -- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe901520c0 msgr2=0x7efe9014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe901520c0 0x7efe9014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 -- 172.21.2.135:0/3440759199 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90151c20 con 0x7efe78003820 2021-11-15T14:34:54.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe96213700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7efe84002f70 tx=0x7efe84014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe84012940 con 0x7efe78003820 2021-11-15T14:34:54.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84012aa0 con 0x7efe78003820 2021-11-15T14:34:54.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900b5d50 con 0x7efe78003820 2021-11-15T14:34:54.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe84012e00 con 0x7efe78003820 2021-11-15T14:34:54.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe90146660 con 0x7efe78003820 2021-11-15T14:34:54.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90151620 con 0x7efe78003820 2021-11-15T14:34:54.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe84029030 con 0x7efe78003820 2021-11-15T14:34:54.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 0x7efe70055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7efe8401b040 con 0x7efe78003820 2021-11-15T14:34:54.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe95a12700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 0x7efe70055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.633+0000 7efe95a12700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 0x7efe70055b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efe8c008000 tx=0x7efe8c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.637+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe84044120 con 0x7efe78003820 2021-11-15T14:34:54.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efe900af120 con 0x7efe78003820 2021-11-15T14:34:54.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe837fe700 1 -- 172.21.2.135:0/3440759199 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7efe84047740 con 0x7efe78003820 2021-11-15T14:34:54.724 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:34:54.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 msgr2=0x7efe70055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 0x7efe70055b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efe8c008000 tx=0x7efe8c009040).stop 2021-11-15T14:34:54.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 msgr2=0x7efe900b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7efe84002f70 tx=0x7efe84014000).stop 2021-11-15T14:34:54.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 shutdown_connections 2021-11-15T14:34:54.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe700536a0 0x7efe70055b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe901520c0 0x7efe9014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe90134a00 0x7efe9014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 --2- 172.21.2.135:0/3440759199 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe78003820 0x7efe900b5160 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 >> 172.21.2.135:0/3440759199 conn(0x7efe9005c510 msgr2=0x7efe9013b150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 shutdown_connections 2021-11-15T14:34:54.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.721+0000 7efe98477700 1 -- 172.21.2.135:0/3440759199 wait complete. 2021-11-15T14:34:54.731 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:34:54.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 Processor -- start 2021-11-15T14:34:54.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 -- start start 2021-11-15T14:34:54.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11900b1e30 0x7f11900b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1190148420 0x7f11900b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900b03d0 con 0x7f11900a7140 2021-11-15T14:34:54.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.777+0000 7f1196d8f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900a9140 con 0x7f1190148420 2021-11-15T14:34:54.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900b0670 con 0x7f11900b1e30 2021-11-15T14:34:54.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11900b1e30 0x7f11900b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f119532c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f11900a7140 0x7f11901447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43674/0 (socket says 172.21.2.135:43674) 2021-11-15T14:34:54.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f119532c700 1 -- 172.21.2.135:0/3861010193 learned_addr learned my addr 172.21.2.135:0/3861010193 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:54.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/3861010193 >> v2:172.21.2.119:3300/0 conn(0x7f1190148420 msgr2=0x7f11900b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- 172.21.2.135:0/3861010193 >> v2:172.21.2.119:3300/0 conn(0x7f1190148420 0x7f11900b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/3861010193 >> v1:172.21.2.135:6789/0 conn(0x7f11900a7140 legacy=0x7f11901447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/3861010193 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900b0910 con 0x7f11900b1e30 2021-11-15T14:34:54.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- 172.21.2.135:0/3861010193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900b1e30 0x7f11900b1050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f11901477b0 tx=0x7f1178006df0).ready entity=mon.1 client_cookie=674ff9f1ca068686 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118f7fe700 1 -- 172.21.2.135:0/3861010193 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117800d5c0 con 0x7f11900b1e30 2021-11-15T14:34:54.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118f7fe700 1 -- 172.21.2.135:0/3861010193 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178000e90 con 0x7f11900b1e30 2021-11-15T14:34:54.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118f7fe700 1 -- 172.21.2.135:0/3861010193 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117800d910 con 0x7f11900b1e30 2021-11-15T14:34:54.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/3861010193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900b1e30 msgr2=0x7f11900b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- 172.21.2.135:0/3861010193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900b1e30 0x7f11900b1050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f11901477b0 tx=0x7f1178006df0).stop 2021-11-15T14:34:54.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/3861010193 shutdown_connections 2021-11-15T14:34:54.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- 172.21.2.135:0/3861010193 >> v2:172.21.2.119:3300/0 conn(0x7f1190148420 0x7f11900b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- 172.21.2.135:0/3861010193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900b1e30 0x7f11900b1050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/3861010193 >> 172.21.2.135:0/3861010193 conn(0x7f119005f730 msgr2=0x7f119005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/3861010193 shutdown_connections 2021-11-15T14:34:54.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/3861010193 wait complete. 2021-11-15T14:34:54.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 Processor -- start 2021-11-15T14:34:54.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- start start 2021-11-15T14:34:54.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11900b1e30 0x7f119014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1190148420 0x7f119014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119014ba20 con 0x7f1190148420 2021-11-15T14:34:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900ab340 con 0x7f11900a7140 2021-11-15T14:34:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900abaf0 con 0x7f11900b1e30 2021-11-15T14:34:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56094/0 (socket says 172.21.2.135:56094) 2021-11-15T14:34:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/1793642448 learned_addr learned my addr 172.21.2.135:0/1793642448 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11900b1e30 msgr2=0x7f119014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11900b1e30 0x7f119014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1190148420 msgr2=0x7f119014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1190148420 0x7f119014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 -- 172.21.2.135:0/1793642448 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117800b180 con 0x7f11900a7140 2021-11-15T14:34:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1194b2b700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f11901477b0 tx=0x7f1178012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1178016070 con 0x7f11900a7140 2021-11-15T14:34:54.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178002f70 con 0x7f11900a7140 2021-11-15T14:34:54.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11900abd90 con 0x7f11900a7140 2021-11-15T14:34:54.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117801e450 con 0x7f11900a7140 2021-11-15T14:34:54.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.781+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900ac4d0 con 0x7f11900a7140 2021-11-15T14:34:54.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900b0bb0 con 0x7f11900a7140 2021-11-15T14:34:54.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1178025030 con 0x7f11900a7140 2021-11-15T14:34:54.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118dffb700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 0x7f1174055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f117806c8b0 con 0x7f11900a7140 2021-11-15T14:34:54.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118ffff700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 0x7f1174055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118ffff700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 0x7f1174055b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1180002f70 tx=0x7f11800069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.785+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1178043bf0 con 0x7f11900a7140 2021-11-15T14:34:54.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11900573d0 con 0x7f11900a7140 2021-11-15T14:34:54.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f118dffb700 1 -- 172.21.2.135:0/1793642448 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1178023020 con 0x7f11900a7140 2021-11-15T14:34:54.873 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:54.873 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:34:54.873 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:54.873 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:34:54.874 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:34:54.874 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:34:54.874 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:34:54.874 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:34:54.874 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:34:54.875 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:34:54.875 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:34:54.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 msgr2=0x7f1174055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 0x7f1174055b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1180002f70 tx=0x7f11800069e0).stop 2021-11-15T14:34:54.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 msgr2=0x7f11900ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f11901477b0 tx=0x7f1178012000).stop 2021-11-15T14:34:54.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 shutdown_connections 2021-11-15T14:34:54.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11740536a0 0x7f1174055b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1190148420 0x7f119014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11900b1e30 0x7f119014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 --2- 172.21.2.135:0/1793642448 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11900a7140 0x7f11900ae410 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 >> 172.21.2.135:0/1793642448 conn(0x7f119005f730 msgr2=0x7f11900b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 shutdown_connections 2021-11-15T14:34:54.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.869+0000 7f1196d8f700 1 -- 172.21.2.135:0/1793642448 wait complete. 2021-11-15T14:34:54.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:34:54.880 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:34:54.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 Processor -- start 2021-11-15T14:34:54.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 -- start start 2021-11-15T14:34:54.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 0x7f20540b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 0x7f20541412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540a7850 con 0x7f20540b1f40 2021-11-15T14:34:54.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540b17c0 con 0x7f20540b1350 2021-11-15T14:34:54.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f20589d6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540b06d0 con 0x7f20540b2320 2021-11-15T14:34:54.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 0x7f20541412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2051d9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 0x7f20540b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2051d9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 0x7f20540b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:49916/0 (socket says 172.21.2.135:49916) 2021-11-15T14:34:54.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f205259c700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f20540b1f40 0x7f20540a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53102/0 (socket says 172.21.2.135:53102) 2021-11-15T14:34:54.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2051d9b700 1 -- 172.21.2.135:0/2926918656 learned_addr learned my addr 172.21.2.135:0/2926918656 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 -- 172.21.2.135:0/2926918656 >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 msgr2=0x7f20540b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:54.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 --2- 172.21.2.135:0/2926918656 >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 0x7f20540b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 -- 172.21.2.135:0/2926918656 >> v1:172.21.2.119:6789/0 conn(0x7f20540b1f40 legacy=0x7f20540a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 -- 172.21.2.135:0/2926918656 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540b0970 con 0x7f20540b2320 2021-11-15T14:34:54.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.929+0000 7f2052d9d700 1 --2- 172.21.2.135:0/2926918656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 0x7f20541412d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f204c0032f0 tx=0x7f204c0091d0).ready entity=mon.2 client_cookie=8b0afeb4d18657d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f205159a700 1 -- 172.21.2.135:0/2926918656 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204c00b6c0 con 0x7f20540b2320 2021-11-15T14:34:54.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f205159a700 1 -- 172.21.2.135:0/2926918656 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c00b820 con 0x7f20540b2320 2021-11-15T14:34:54.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f205159a700 1 -- 172.21.2.135:0/2926918656 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204c00b990 con 0x7f20540b2320 2021-11-15T14:34:54.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/2926918656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 msgr2=0x7f20541412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- 172.21.2.135:0/2926918656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 0x7f20541412d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f204c0032f0 tx=0x7f204c0091d0).stop 2021-11-15T14:34:54.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/2926918656 shutdown_connections 2021-11-15T14:34:54.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- 172.21.2.135:0/2926918656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b2320 0x7f20541412d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- 172.21.2.135:0/2926918656 >> v2:172.21.2.119:3300/0 conn(0x7f20540b1350 0x7f20540b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:54.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/2926918656 >> 172.21.2.135:0/2926918656 conn(0x7f205405f730 msgr2=0x7f205405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:54.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/2926918656 shutdown_connections 2021-11-15T14:34:54.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/2926918656 wait complete. 2021-11-15T14:34:54.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 Processor -- start 2021-11-15T14:34:54.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- start start 2021-11-15T14:34:54.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b1350 0x7f20540af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20540b2320 0x7f2054156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20540adb40 con 0x7f20540b2320 2021-11-15T14:34:54.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205415ac80 con 0x7f20540b1f40 2021-11-15T14:34:54.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205415af20 con 0x7f20540b1350 2021-11-15T14:34:54.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56106/0 (socket says 172.21.2.135:56106) 2021-11-15T14:34:54.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 -- 172.21.2.135:0/4056505433 learned_addr learned my addr 172.21.2.135:0/4056505433 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:54.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 -- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b1350 msgr2=0x7f20540af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b1350 0x7f20540af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 -- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20540b2320 msgr2=0x7f2054156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:54.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20540b2320 0x7f2054156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:54.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 -- 172.21.2.135:0/4056505433 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c009470 con 0x7f20540b1f40 2021-11-15T14:34:54.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f2051d9b700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f204400c000 tx=0x7f2044008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20440136e0 con 0x7f20540b1f40 2021-11-15T14:34:54.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044013840 con 0x7f20540b1f40 2021-11-15T14:34:54.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540adda0 con 0x7f20540b1f40 2021-11-15T14:34:54.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044013ba0 con 0x7f20540b1f40 2021-11-15T14:34:54.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540ae280 con 0x7f20540b1f40 2021-11-15T14:34:54.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20540adf30 con 0x7f20540b1f40 2021-11-15T14:34:54.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.933+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2044023070 con 0x7f20540b1f40 2021-11-15T14:34:54.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.937+0000 7f204b7fe700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 0x7f2038055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:54.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.937+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f204406ba60 con 0x7f20540b1f40 2021-11-15T14:34:54.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.937+0000 7f205259c700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 0x7f2038055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:54.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.937+0000 7f205259c700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 0x7f2038055be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f20540b2fd0 tx=0x7f203c007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:54.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:54.937+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2044042da0 con 0x7f20540b1f40 2021-11-15T14:34:55.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.021+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f20540573d0 con 0x7f20540b1f40 2021-11-15T14:34:55.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f204b7fe700 1 -- 172.21.2.135:0/4056505433 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7f20440463c0 con 0x7f20540b1f40 2021-11-15T14:34:55.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 msgr2=0x7f2038055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:55.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 0x7f2038055be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f20540b2fd0 tx=0x7f203c007800).stop 2021-11-15T14:34:55.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 msgr2=0x7f20540afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:55.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f204400c000 tx=0x7f2044008040).stop 2021-11-15T14:34:55.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 shutdown_connections 2021-11-15T14:34:55.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2038053720 0x7f2038055be0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:55.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f20540b2320 0x7f2054156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f20540b1f40 0x7f20540afde0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:55.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 --2- 172.21.2.135:0/4056505433 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f20540b1350 0x7f20540af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 >> 172.21.2.135:0/4056505433 conn(0x7f205405f730 msgr2=0x7f205413cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:55.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 shutdown_connections 2021-11-15T14:34:55.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.805+0000 7f20589d6700 1 -- 172.21.2.135:0/4056505433 wait complete. 2021-11-15T14:34:55.811 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:34:55.815 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:34:55.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 Processor -- start 2021-11-15T14:34:55.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- start start 2021-11-15T14:34:55.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b1350 0x7f11880b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11880b2320 0x7f11881412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11880a7850 con 0x7f11880b1f40 2021-11-15T14:34:55.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11880b17c0 con 0x7f11880b2320 2021-11-15T14:34:55.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11880b06d0 con 0x7f11880b1350 2021-11-15T14:34:55.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11880b2320 0x7f11881412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:55.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11880b2320 0x7f11881412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56116/0 (socket says 172.21.2.135:56116) 2021-11-15T14:34:55.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 -- 172.21.2.135:0/1824520325 learned_addr learned my addr 172.21.2.135:0/1824520325 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:55.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 -- 172.21.2.135:0/1824520325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b1350 msgr2=0x7f11880b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:55.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 --2- 172.21.2.135:0/1824520325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b1350 0x7f11880b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 -- 172.21.2.135:0/1824520325 >> v1:172.21.2.119:6789/0 conn(0x7f11880b1f40 legacy=0x7f11880a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:55.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 -- 172.21.2.135:0/1824520325 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880b0970 con 0x7f11880b2320 2021-11-15T14:34:55.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f11877fe700 1 --2- 172.21.2.135:0/1824520325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b2320 0x7f11881412d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f118806a170 tx=0x7f1180009290).ready entity=mon.1 client_cookie=3a955fdedf3d92da server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:55.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f1185ffb700 1 -- 172.21.2.135:0/1824520325 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118000b860 con 0x7f11880b2320 2021-11-15T14:34:55.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f1185ffb700 1 -- 172.21.2.135:0/1824520325 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000b9c0 con 0x7f11880b2320 2021-11-15T14:34:55.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f1185ffb700 1 -- 172.21.2.135:0/1824520325 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118000bb70 con 0x7f11880b2320 2021-11-15T14:34:55.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- 172.21.2.135:0/1824520325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b2320 msgr2=0x7f11881412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:55.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 --2- 172.21.2.135:0/1824520325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b2320 0x7f11881412d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f118806a170 tx=0x7f1180009290).stop 2021-11-15T14:34:55.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- 172.21.2.135:0/1824520325 shutdown_connections 2021-11-15T14:34:55.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 --2- 172.21.2.135:0/1824520325 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b2320 0x7f11881412d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:55.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 --2- 172.21.2.135:0/1824520325 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b1350 0x7f11880b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- 172.21.2.135:0/1824520325 >> 172.21.2.135:0/1824520325 conn(0x7f118805f730 msgr2=0x7f118805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:55.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- 172.21.2.135:0/1824520325 shutdown_connections 2021-11-15T14:34:55.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.869+0000 7f118d667700 1 -- 172.21.2.135:0/1824520325 wait complete. 2021-11-15T14:34:55.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 Processor -- start 2021-11-15T14:34:55.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- start start 2021-11-15T14:34:55.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11880b1350 0x7f1188148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b2320 0x7f11880ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11880af170 con 0x7f11880b1350 2021-11-15T14:34:55.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118814a540 con 0x7f11880b1f40 2021-11-15T14:34:55.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11881409f0 con 0x7f11880b2320 2021-11-15T14:34:55.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:55.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56120/0 (socket says 172.21.2.135:56120) 2021-11-15T14:34:55.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 -- 172.21.2.135:0/3246568131 learned_addr learned my addr 172.21.2.135:0/3246568131 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:55.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 -- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b2320 msgr2=0x7f11880ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:55.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b2320 0x7f11880ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 -- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11880b1350 msgr2=0x7f1188148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:55.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11880b1350 0x7f1188148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:55.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 -- 172.21.2.135:0/3246568131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009530 con 0x7f11880b1f40 2021-11-15T14:34:55.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f11867fc700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f1178002f70 tx=0x7f1178006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:55.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1178013460 con 0x7f11880b1f40 2021-11-15T14:34:55.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780135c0 con 0x7f11880b1f40 2021-11-15T14:34:55.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11880aabc0 con 0x7f11880b1f40 2021-11-15T14:34:55.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1178013920 con 0x7f11880b1f40 2021-11-15T14:34:55.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11880aeed0 con 0x7f11880b1f40 2021-11-15T14:34:55.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11880573d0 con 0x7f11880b1f40 2021-11-15T14:34:55.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f117801a060 con 0x7f11880b1f40 2021-11-15T14:34:55.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 0x7f116c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:55.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f117806b340 con 0x7f11880b1f40 2021-11-15T14:34:55.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f1186ffd700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 0x7f116c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:55.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.873+0000 7f1186ffd700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 0x7f116c055b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1170002f90 tx=0x7f11700069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:55.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.877+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1178042520 con 0x7f11880b1f40 2021-11-15T14:34:55.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:55.961+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f118814a6d0 con 0x7f11880b1f40 2021-11-15T14:34:56.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.845+0000 7f117ffff700 1 -- 172.21.2.135:0/3246568131 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v33) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1178018030 con 0x7f11880b1f40 2021-11-15T14:34:56.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 msgr2=0x7f116c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 0x7f116c055b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1170002f90 tx=0x7f11700069b0).stop 2021-11-15T14:34:56.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 msgr2=0x7f118814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f1178002f70 tx=0x7f1178006ec0).stop 2021-11-15T14:34:56.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 shutdown_connections 2021-11-15T14:34:56.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f116c053690 0x7f116c055b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:56.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11880b2320 0x7f11880ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11880b1f40 0x7f118814a9a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:56.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 --2- 172.21.2.135:0/3246568131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11880b1350 0x7f1188148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 >> 172.21.2.135:0/3246568131 conn(0x7f118805f730 msgr2=0x7f11880a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:56.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 shutdown_connections 2021-11-15T14:34:56.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.849+0000 7f118d667700 1 -- 172.21.2.135:0/3246568131 wait complete. 2021-11-15T14:34:56.855 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:34:56.859 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:34:56.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 Processor -- start 2021-11-15T14:34:56.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 -- start start 2021-11-15T14:34:56.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f41780acdd0 0x7f417814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780b6d60 con 0x7f41780b6980 2021-11-15T14:34:56.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178061260 con 0x7f4178060990 2021-11-15T14:34:56.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417ede1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4178061500 con 0x7f41780acdd0 2021-11-15T14:34:56.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f4177fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f4178060990 0x7f41780aa650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43718/0 (socket says 172.21.2.135:43718) 2021-11-15T14:34:56.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f4177fff700 1 -- 172.21.2.135:0/2972476457 learned_addr learned my addr 172.21.2.135:0/2972476457 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:56.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287504195 0 0) 0x7f4178061260 con 0x7f4178060990 2021-11-15T14:34:56.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4158003260 con 0x7f4178060990 2021-11-15T14:34:56.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2501567343 0 0) 0x7f4158003260 con 0x7f4178060990 2021-11-15T14:34:56.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 >> v2:172.21.2.119:3300/0 conn(0x7f41780acdd0 msgr2=0x7f417814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:56.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 --2- 172.21.2.135:0/2972476457 >> v2:172.21.2.119:3300/0 conn(0x7f41780acdd0 0x7f417814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 >> v1:172.21.2.119:6789/0 conn(0x7f41780b6980 legacy=0x7f41780a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:56.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780617a0 con 0x7f4178060990 2021-11-15T14:34:56.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f4160001660 con 0x7f4178060990 2021-11-15T14:34:56.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 >> v1:172.21.2.135:6789/0 conn(0x7f4178060990 legacy=0x7f41780aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 0x7f4158003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4158004500 0x7f4158004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158005070 0x7f415800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178061500 con 0x7f4158005070 2021-11-15T14:34:56.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415800e170 con 0x7f4158003820 2021-11-15T14:34:56.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415800e330 con 0x7f4158004500 2021-11-15T14:34:56.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 0x7f4158003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:56.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f4177fff700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4158004500 0x7f4158004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:56.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 -- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4158004500 msgr2=0x7f4158004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:56.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4158004500 0x7f4158004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:56.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 -- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158005070 msgr2=0x7f415800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:56.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158005070 0x7f415800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 -- 172.21.2.135:0/2972476457 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158003260 con 0x7f4158003820 2021-11-15T14:34:56.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417d37e700 1 -- 172.21.2.135:0/2972476457 reap_dead start 2021-11-15T14:34:56.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f4177fff700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4158004500 0x7f4158004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:56.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f417cb7d700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 0x7f4158003c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4168001fa0 tx=0x7f4168007a00).ready entity=mon.1 client_cookie=597e2b756eb712dc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:56.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4168007070 con 0x7f4158003820 2021-11-15T14:34:56.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680071d0 con 0x7f4158003820 2021-11-15T14:34:56.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.921+0000 7f41777fe700 1 -- 172.21.2.135:0/2972476457 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4168006510 con 0x7f4158003820 2021-11-15T14:34:56.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 msgr2=0x7f4158003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 0x7f4158003c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4168001fa0 tx=0x7f4168007a00).stop 2021-11-15T14:34:56.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/2972476457 shutdown_connections 2021-11-15T14:34:56.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 --2- 172.21.2.135:0/2972476457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158003820 0x7f4158003c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:56.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/2972476457 >> 172.21.2.135:0/2972476457 conn(0x7f41780b3500 msgr2=0x7f41780b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:56.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/2972476457 shutdown_connections 2021-11-15T14:34:56.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/2972476457 wait complete. 2021-11-15T14:34:56.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 Processor -- start 2021-11-15T14:34:56.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- start start 2021-11-15T14:34:56.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158003820 0x7f417814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4178152010 0x7f4178141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417814f0c0 con 0x7f4158003820 2021-11-15T14:34:56.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178143800 con 0x7f41781516a0 2021-11-15T14:34:56.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417813ed00 con 0x7f4178152010 2021-11-15T14:34:56.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:56.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56140/0 (socket says 172.21.2.135:56140) 2021-11-15T14:34:56.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 -- 172.21.2.135:0/3119397412 learned_addr learned my addr 172.21.2.135:0/3119397412 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:56.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 -- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4178152010 msgr2=0x7f4178141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4178152010 0x7f4178141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 -- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158003820 msgr2=0x7f417814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:56.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158003820 0x7f417814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:56.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 -- 172.21.2.135:0/3119397412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417813b890 con 0x7f41781516a0 2021-11-15T14:34:56.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4177fff700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f4160008000 tx=0x7f4160009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:56.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4160007170 con 0x7f41781516a0 2021-11-15T14:34:56.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4178152490 con 0x7f41781516a0 2021-11-15T14:34:56.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417813a7c0 con 0x7f41781516a0 2021-11-15T14:34:56.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41600072d0 con 0x7f41781516a0 2021-11-15T14:34:56.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4160004920 con 0x7f41781516a0 2021-11-15T14:34:56.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4150003410 con 0x7f41781516a0 2021-11-15T14:34:56.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f416001a020 con 0x7f41781516a0 2021-11-15T14:34:56.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 0x7f415c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:56.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f416006bc20 con 0x7f41781516a0 2021-11-15T14:34:56.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.925+0000 7f417cb7d700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 0x7f415c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:56.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.929+0000 7f417cb7d700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 0x7f415c055a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f4168001fa0 tx=0x7f4168015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:56.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:56.929+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4160042b30 con 0x7f41781516a0 2021-11-15T14:34:57.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.045+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4150003c40 con 0x7f41781516a0 2021-11-15T14:34:57.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.057+0000 7f4175ffb700 1 -- 172.21.2.135:0/3119397412 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4160046150 con 0x7f41781516a0 2021-11-15T14:34:57.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 msgr2=0x7f415c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 0x7f415c055a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f4168001fa0 tx=0x7f4168015000).stop 2021-11-15T14:34:57.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 msgr2=0x7f4178151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f4160008000 tx=0x7f4160009040).stop 2021-11-15T14:34:57.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 shutdown_connections 2021-11-15T14:34:57.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f415c0535b0 0x7f415c055a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4178152010 0x7f4178141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41781516a0 0x7f4178151b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 --2- 172.21.2.135:0/3119397412 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4158003820 0x7f417814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 >> 172.21.2.135:0/3119397412 conn(0x7f41780b3500 msgr2=0x7f41780b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 shutdown_connections 2021-11-15T14:34:57.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.061+0000 7f417ede1700 1 -- 172.21.2.135:0/3119397412 wait complete. 2021-11-15T14:34:57.066 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 5 and data pool 6 2021-11-15T14:34:57.070 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:57.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 Processor -- start 2021-11-15T14:34:57.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- start start 2021-11-15T14:34:57.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f88480b1e30 0x7f88480b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8848148420 0x7f88480b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88480b03d0 con 0x7f88480a7140 2021-11-15T14:34:57.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480a9140 con 0x7f8848148420 2021-11-15T14:34:57.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480b0670 con 0x7f88480b1e30 2021-11-15T14:34:57.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f88477fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f88480a7140 0x7f88481447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43748/0 (socket says 172.21.2.135:43748) 2021-11-15T14:34:57.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f88477fe700 1 -- 172.21.2.135:0/3604123334 learned_addr learned my addr 172.21.2.135:0/3604123334 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:57.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3604123334 >> v2:172.21.2.135:3300/0 conn(0x7f88480b1e30 0x7f88480b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 -- 172.21.2.135:0/3604123334 >> v2:172.21.2.119:3300/0 conn(0x7f8848148420 msgr2=0x7f88480b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3604123334 >> v2:172.21.2.119:3300/0 conn(0x7f8848148420 0x7f88480b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 -- 172.21.2.135:0/3604123334 >> v1:172.21.2.135:6789/0 conn(0x7f88480a7140 legacy=0x7f88481447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 -- 172.21.2.135:0/3604123334 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480b0910 con 0x7f88480b1e30 2021-11-15T14:34:57.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3604123334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f88480b1050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f88481477b0 tx=0x7f8838006df0).ready entity=mon.1 client_cookie=718507a863612ce5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8845ffb700 1 -- 172.21.2.135:0/3604123334 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d5c0 con 0x7f88480b1e30 2021-11-15T14:34:57.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8845ffb700 1 -- 172.21.2.135:0/3604123334 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838000e90 con 0x7f88480b1e30 2021-11-15T14:34:57.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f8845ffb700 1 -- 172.21.2.135:0/3604123334 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d910 con 0x7f88480b1e30 2021-11-15T14:34:57.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- 172.21.2.135:0/3604123334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 msgr2=0x7f88480b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 --2- 172.21.2.135:0/3604123334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f88480b1050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f88481477b0 tx=0x7f8838006df0).stop 2021-11-15T14:34:57.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- 172.21.2.135:0/3604123334 shutdown_connections 2021-11-15T14:34:57.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 --2- 172.21.2.135:0/3604123334 >> v2:172.21.2.119:3300/0 conn(0x7f8848148420 0x7f88480b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 --2- 172.21.2.135:0/3604123334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f88480b1050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- 172.21.2.135:0/3604123334 >> 172.21.2.135:0/3604123334 conn(0x7f884805f730 msgr2=0x7f884805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- 172.21.2.135:0/3604123334 shutdown_connections 2021-11-15T14:34:57.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.117+0000 7f884d427700 1 -- 172.21.2.135:0/3604123334 wait complete. 2021-11-15T14:34:57.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 Processor -- start 2021-11-15T14:34:57.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- start start 2021-11-15T14:34:57.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88480a7140 0x7f88480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8848148420 0x7f884814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884814ba20 con 0x7f88480a7140 2021-11-15T14:34:57.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480ab340 con 0x7f88480b1e30 2021-11-15T14:34:57.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480abaf0 con 0x7f8848148420 2021-11-15T14:34:57.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56162/0 (socket says 172.21.2.135:56162) 2021-11-15T14:34:57.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 -- 172.21.2.135:0/3663711928 learned_addr learned my addr 172.21.2.135:0/3663711928 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:57.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 -- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8848148420 msgr2=0x7f884814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88480a7140 0x7f88480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8848148420 0x7f884814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 -- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88480a7140 msgr2=0x7f88480ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88480a7140 0x7f88480ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 -- 172.21.2.135:0/3663711928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883800b180 con 0x7f88480b1e30 2021-11-15T14:34:57.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f88467fc700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f883c002f70 tx=0x7f883c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c013460 con 0x7f88480b1e30 2021-11-15T14:34:57.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0135c0 con 0x7f88480b1e30 2021-11-15T14:34:57.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88480abd90 con 0x7f88480b1e30 2021-11-15T14:34:57.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c013920 con 0x7f88480b1e30 2021-11-15T14:34:57.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88480ac4d0 con 0x7f88480b1e30 2021-11-15T14:34:57.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88480b0bb0 con 0x7f88480b1e30 2021-11-15T14:34:57.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f883c00f070 con 0x7f88480b1e30 2021-11-15T14:34:57.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 0x7f8824055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f883c06b370 con 0x7f88480b1e30 2021-11-15T14:34:57.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 0x7f8824055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.121+0000 7f8846ffd700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 0x7f8824055b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8838015000 tx=0x7f8838012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.125+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f883c042380 con 0x7f88480b1e30 2021-11-15T14:34:57.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.209+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88480573d0 con 0x7f88480b1e30 2021-11-15T14:34:57.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f8837fff700 1 -- 172.21.2.135:0/3663711928 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f883c0459a0 con 0x7f88480b1e30 2021-11-15T14:34:57.216 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:57.216 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":34,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:57.051753+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:55.042943+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:55.985686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:57.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 msgr2=0x7f8824055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 0x7f8824055b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8838015000 tx=0x7f8838012000).stop 2021-11-15T14:34:57.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 msgr2=0x7f884814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f883c002f70 tx=0x7f883c006df0).stop 2021-11-15T14:34:57.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 shutdown_connections 2021-11-15T14:34:57.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88240536a0 0x7f8824055b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8848148420 0x7f884814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88480b1e30 0x7f884814b040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 --2- 172.21.2.135:0/3663711928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88480a7140 0x7f88480ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 >> 172.21.2.135:0/3663711928 conn(0x7f884805f730 msgr2=0x7f88480b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 shutdown_connections 2021-11-15T14:34:57.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.213+0000 7f884d427700 1 -- 172.21.2.135:0/3663711928 wait complete. 2021-11-15T14:34:57.223 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:57.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 Processor -- start 2021-11-15T14:34:57.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 -- start start 2021-11-15T14:34:57.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b1e30 0x7fdd0c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd0c0a7140 0x7fdd0c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0b03d0 con 0x7fdd0c148420 2021-11-15T14:34:57.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0a9140 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd1334c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b0670 con 0x7fdd0c0a7140 2021-11-15T14:34:57.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd108e7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fdd0c148420 0x7fdd0c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43760/0 (socket says 172.21.2.135:43760) 2021-11-15T14:34:57.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd0c0a7140 0x7fdd0c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd108e7700 1 -- 172.21.2.135:0/2773297294 learned_addr learned my addr 172.21.2.135:0/2773297294 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:57.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 -- 172.21.2.135:0/2773297294 >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b1e30 msgr2=0x7fdd0c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 --2- 172.21.2.135:0/2773297294 >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b1e30 0x7fdd0c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 -- 172.21.2.135:0/2773297294 >> v1:172.21.2.135:6789/0 conn(0x7fdd0c148420 legacy=0x7fdd0c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 -- 172.21.2.135:0/2773297294 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0b0910 con 0x7fdd0c0a7140 2021-11-15T14:34:57.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdd118e9700 1 --2- 172.21.2.135:0/2773297294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0a7140 0x7fdd0c1447a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fdd0c1477b0 tx=0x7fdd040091d0).ready entity=mon.1 client_cookie=fb4bd051ef88019b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.269+0000 7fdcfffff700 1 -- 172.21.2.135:0/2773297294 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd04009ea0 con 0x7fdd0c0a7140 2021-11-15T14:34:57.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfffff700 1 -- 172.21.2.135:0/2773297294 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400b860 con 0x7fdd0c0a7140 2021-11-15T14:34:57.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfffff700 1 -- 172.21.2.135:0/2773297294 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0400b9d0 con 0x7fdd0c0a7140 2021-11-15T14:34:57.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/2773297294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0a7140 msgr2=0x7fdd0c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- 172.21.2.135:0/2773297294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0a7140 0x7fdd0c1447a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fdd0c1477b0 tx=0x7fdd040091d0).stop 2021-11-15T14:34:57.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/2773297294 shutdown_connections 2021-11-15T14:34:57.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- 172.21.2.135:0/2773297294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0a7140 0x7fdd0c1447a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- 172.21.2.135:0/2773297294 >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b1e30 0x7fdd0c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/2773297294 >> 172.21.2.135:0/2773297294 conn(0x7fdd0c05f730 msgr2=0x7fdd0c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/2773297294 shutdown_connections 2021-11-15T14:34:57.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/2773297294 wait complete. 2021-11-15T14:34:57.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 Processor -- start 2021-11-15T14:34:57.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- start start 2021-11-15T14:34:57.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c148420 0x7fdd0c143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0afc80 con 0x7fdd0c148420 2021-11-15T14:34:57.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0af590 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0ae8d0 con 0x7fdd0c0a7140 2021-11-15T14:34:57.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56178/0 (socket says 172.21.2.135:56178) 2021-11-15T14:34:57.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 -- 172.21.2.135:0/3907197404 learned_addr learned my addr 172.21.2.135:0/3907197404 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:57.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 -- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 msgr2=0x7fdd0c0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 -- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c148420 msgr2=0x7fdd0c143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c148420 0x7fdd0c143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 -- 172.21.2.135:0/3907197404 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009470 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd108e7700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fdd0c0afdc0 tx=0x7fdd00007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0000ce20 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000072e0 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c0aeb70 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd00005800 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c0ab980 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c1444b0 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd00010070 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 0x7fdcec055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.273+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fdd0006b270 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.277+0000 7fdd110e8700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 0x7fdcec055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.277+0000 7fdd110e8700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 0x7fdcec055be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdd08002f70 tx=0x7fdd08006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.277+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd00042170 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0c0aed00 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdcfe7fc700 1 -- 172.21.2.135:0/3907197404 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fdd0004cfc0 con 0x7fdd0c0b1e30 2021-11-15T14:34:57.364 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:57.364 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":34,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:57.051753+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:55.042943+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:55.985686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:57.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 msgr2=0x7fdcec055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 0x7fdcec055be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdd08002f70 tx=0x7fdd08006a80).stop 2021-11-15T14:34:57.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 msgr2=0x7fdd0c143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fdd0c0afdc0 tx=0x7fdd00007c70).stop 2021-11-15T14:34:57.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 shutdown_connections 2021-11-15T14:34:57.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcec053720 0x7fdcec055be0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c148420 0x7fdd0c143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd0c0b1e30 0x7fdd0c143930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 --2- 172.21.2.135:0/3907197404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 >> 172.21.2.135:0/3907197404 conn(0x7fdd0c05f730 msgr2=0x7fdd0c147c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 shutdown_connections 2021-11-15T14:34:57.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.361+0000 7fdd1334c700 1 -- 172.21.2.135:0/3907197404 wait complete. 2021-11-15T14:34:57.371 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:34:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 Processor -- start 2021-11-15T14:34:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- start start 2021-11-15T14:34:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 0x7f71b01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00b2430 con 0x7f71b0060040 2021-11-15T14:34:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00b26d0 con 0x7f71b00b3950 2021-11-15T14:34:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00b2970 con 0x7f71b00654a0 2021-11-15T14:34:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71af7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f71b00b3950 0x7f71b01449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43776/0 (socket says 172.21.2.135:43776) 2021-11-15T14:34:57.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71af7fe700 1 -- 172.21.2.135:0/681952131 learned_addr learned my addr 172.21.2.135:0/681952131 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:57.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619926103 0 0) 0x7f71b00b26d0 con 0x7f71b00b3950 2021-11-15T14:34:57.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003260 con 0x7f71b00b3950 2021-11-15T14:34:57.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 0x7f71b01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3516178813 0 0) 0x7f7190003260 con 0x7f71b00b3950 2021-11-15T14:34:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 msgr2=0x7f71b01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 0x7f71b01444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 >> v1:172.21.2.119:6789/0 conn(0x7f71b0060040 legacy=0x7f71b0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00648f0 con 0x7f71b00b3950 2021-11-15T14:34:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f71a80019e0 con 0x7f71b00b3950 2021-11-15T14:34:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 >> v1:172.21.2.135:6789/0 conn(0x7f71b00b3950 legacy=0x7f71b01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71900037d0 0x7f7190003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7190004500 0x7f7190004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 0x7f7190005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00b2970 con 0x7f71900037d0 2021-11-15T14:34:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719000fcf0 con 0x7f7190004500 2021-11-15T14:34:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719000feb0 con 0x7f71b00654a0 2021-11-15T14:34:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7190004500 0x7f7190004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 -- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 msgr2=0x7f7190005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00654a0 0x7f7190005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 -- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71900037d0 msgr2=0x7f7190003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71900037d0 0x7f7190003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 -- 172.21.2.135:0/681952131 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190003260 con 0x7f7190004500 2021-11-15T14:34:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7190004500 0x7f7190004980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f719800a000 tx=0x7f7198008040).ready entity=mon.1 client_cookie=5380a86af960cc2e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7198013670 con 0x7f7190004500 2021-11-15T14:34:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71980137d0 con 0x7f7190004500 2021-11-15T14:34:57.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71adffb700 1 -- 172.21.2.135:0/681952131 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7198013b30 con 0x7f7190004500 2021-11-15T14:34:57.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- 172.21.2.135:0/681952131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7190004500 msgr2=0x7f7190004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 --2- 172.21.2.135:0/681952131 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7190004500 0x7f7190004980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f719800a000 tx=0x7f7198008040).stop 2021-11-15T14:34:57.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71af7fe700 1 -- 172.21.2.135:0/681952131 reap_dead start 2021-11-15T14:34:57.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- 172.21.2.135:0/681952131 shutdown_connections 2021-11-15T14:34:57.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- 172.21.2.135:0/681952131 >> 172.21.2.135:0/681952131 conn(0x7f71b005cfe0 msgr2=0x7f71b005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:57.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- 172.21.2.135:0/681952131 shutdown_connections 2021-11-15T14:34:57.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.421+0000 7f71b55df700 1 -- 172.21.2.135:0/681952131 wait complete. 2021-11-15T14:34:57.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 Processor -- start 2021-11-15T14:34:57.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- start start 2021-11-15T14:34:57.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 0x7f71b00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 0x7f71b01388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00ade30 con 0x7f7190004500 2021-11-15T14:34:57.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b013ef20 con 0x7f71b0138d90 2021-11-15T14:34:57.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00ae090 con 0x7f71b00b0190 2021-11-15T14:34:57.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56196/0 (socket says 172.21.2.135:56196) 2021-11-15T14:34:57.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 -- 172.21.2.135:0/235774991 learned_addr learned my addr 172.21.2.135:0/235774991 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:57.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 -- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 msgr2=0x7f71b01388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 0x7f71b01388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71aeffd700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 0x7f71b00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 0x7f71b01388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 -- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 msgr2=0x7f71b00afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:57.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 0x7f71b00afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:57.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 -- 172.21.2.135:0/235774991 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00ab550 con 0x7f71b0138d90 2021-11-15T14:34:57.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71ae7fc700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 0x7f71b01388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:57.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71aeffd700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 0x7f71b00afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:57.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71af7fe700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f71a80016f0 tx=0x7f71b00b2860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a8004ab0 con 0x7f71b0138d90 2021-11-15T14:34:57.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8004c10 con 0x7f71b0138d90 2021-11-15T14:34:57.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b01391f0 con 0x7f71b0138d90 2021-11-15T14:34:57.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00b7140 con 0x7f71b0138d90 2021-11-15T14:34:57.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a80070d0 con 0x7f71b0138d90 2021-11-15T14:34:57.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00674f0 con 0x7f71b0138d90 2021-11-15T14:34:57.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71a801a070 con 0x7f71b0138d90 2021-11-15T14:34:57.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 0x7f7194055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:57.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f71a806af50 con 0x7f71b0138d90 2021-11-15T14:34:57.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.425+0000 7f71aeffd700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 0x7f7194055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:57.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.429+0000 7f71aeffd700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 0x7f7194055b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f71a0008000 tx=0x7f71a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:57.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.429+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71a8041e50 con 0x7f71b0138d90 2021-11-15T14:34:57.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:57.537+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f71b00573d0 con 0x7f71b0138d90 2021-11-15T14:34:58.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71a7fff700 1 -- 172.21.2.135:0/235774991 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f71a8045470 con 0x7f71b0138d90 2021-11-15T14:34:58.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 msgr2=0x7f7194055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 0x7f7194055b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f71a0008000 tx=0x7f71a0009040).stop 2021-11-15T14:34:58.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 msgr2=0x7f71b00abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f71a80016f0 tx=0x7f71b00b2860).stop 2021-11-15T14:34:58.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 shutdown_connections 2021-11-15T14:34:58.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71940536a0 0x7f7194055b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b0138d90 0x7f71b00abbc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b00b0190 0x7f71b01388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 --2- 172.21.2.135:0/235774991 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7190004500 0x7f71b00afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 >> 172.21.2.135:0/235774991 conn(0x7f71b005cfe0 msgr2=0x7f71b0144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 shutdown_connections 2021-11-15T14:34:58.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.545+0000 7f71b55df700 1 -- 172.21.2.135:0/235774991 wait complete. 2021-11-15T14:34:58.556 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:58.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 Processor -- start 2021-11-15T14:34:58.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 -- start start 2021-11-15T14:34:58.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f590c0b1e30 0x7f590c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f590c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0b03d0 con 0x7f590c148420 2021-11-15T14:34:58.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c0a9140 con 0x7f590c0b1e30 2021-11-15T14:34:58.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f59125b5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0b0670 con 0x7f590c0a7140 2021-11-15T14:34:58.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f590c148420 0x7f590c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43796/0 (socket says 172.21.2.135:43796) 2021-11-15T14:34:58.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590b7fe700 1 -- 172.21.2.135:0/2956108764 learned_addr learned my addr 172.21.2.135:0/2956108764 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:58.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f590c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210768272 0 0) 0x7f590c0b03d0 con 0x7f590c148420 2021-11-15T14:34:58.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590bfff700 1 --2- 172.21.2.135:0/2956108764 >> v2:172.21.2.119:3300/0 conn(0x7f590c0b1e30 0x7f590c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec003260 con 0x7f590c148420 2021-11-15T14:34:58.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717558466 0 0) 0x7f58ec003260 con 0x7f590c148420 2021-11-15T14:34:58.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 msgr2=0x7f590c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f590c1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 >> v2:172.21.2.119:3300/0 conn(0x7f590c0b1e30 msgr2=0x7f590c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 --2- 172.21.2.135:0/2956108764 >> v2:172.21.2.119:3300/0 conn(0x7f590c0b1e30 0x7f590c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0b0910 con 0x7f590c148420 2021-11-15T14:34:58.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f58fc001660 con 0x7f590c148420 2021-11-15T14:34:58.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 >> v1:172.21.2.135:6789/0 conn(0x7f590c148420 legacy=0x7f590c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f58ec0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58ec003d50 0x7f58ec004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58ec0049f0 0x7f58ec004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0b0670 con 0x7f58ec003d50 2021-11-15T14:34:58.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec00b750 con 0x7f58ec0049f0 2021-11-15T14:34:58.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec00b8c0 con 0x7f590c0a7140 2021-11-15T14:34:58.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58ec0049f0 0x7f58ec004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590bfff700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f58ec0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 -- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 msgr2=0x7f58ec0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f58ec0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 -- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58ec003d50 msgr2=0x7f58ec004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58ec003d50 0x7f58ec004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f5910b52700 1 -- 172.21.2.135:0/2956108764 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec003260 con 0x7f58ec0049f0 2021-11-15T14:34:58.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.605+0000 7f590bfff700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f590c0a7140 0x7f58ec0037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:58.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58ec0049f0 0x7f58ec004e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f590400c000 tx=0x7f59040091d0).ready entity=mon.1 client_cookie=2cf8b9aa46e85a91 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590400e7e0 con 0x7f58ec0049f0 2021-11-15T14:34:58.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400e940 con 0x7f58ec0049f0 2021-11-15T14:34:58.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590affd700 1 -- 172.21.2.135:0/2956108764 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590400eca0 con 0x7f58ec0049f0 2021-11-15T14:34:58.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2956108764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58ec0049f0 msgr2=0x7f58ec004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 --2- 172.21.2.135:0/2956108764 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58ec0049f0 0x7f58ec004e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f590400c000 tx=0x7f59040091d0).stop 2021-11-15T14:34:58.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 -- 172.21.2.135:0/2956108764 reap_dead start 2021-11-15T14:34:58.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2956108764 shutdown_connections 2021-11-15T14:34:58.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2956108764 >> 172.21.2.135:0/2956108764 conn(0x7f590c05f730 msgr2=0x7f590c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2956108764 shutdown_connections 2021-11-15T14:34:58.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2956108764 wait complete. 2021-11-15T14:34:58.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 Processor -- start 2021-11-15T14:34:58.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- start start 2021-11-15T14:34:58.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 0x7f590c0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f590c14b2e0 0x7f590c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 0x7f590c143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ab3a0 con 0x7f590c14b2e0 2021-11-15T14:34:58.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ab640 con 0x7f590c14a2e0 2021-11-15T14:34:58.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ab8e0 con 0x7f58ec0049f0 2021-11-15T14:34:58.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 0x7f590c0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 0x7f590c143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 0x7f590c0abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:37760/0 (socket says 172.21.2.135:37760) 2021-11-15T14:34:58.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590bfff700 1 -- 172.21.2.135:0/2240598866 learned_addr learned my addr 172.21.2.135:0/2240598866 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:58.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f590b7fe700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f590c14b2e0 0x7f590c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 -- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 msgr2=0x7f590c0abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 0x7f590c0abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 -- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f590c14b2e0 msgr2=0x7f590c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f590c14b2e0 0x7f590c0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 -- 172.21.2.135:0/2240598866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0ab020 con 0x7f590c14a2e0 2021-11-15T14:34:58.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f5910b52700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 0x7f590c143560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f58fc001840 tx=0x7f590401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5904009600 con 0x7f590c14a2e0 2021-11-15T14:34:58.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400eed0 con 0x7f590c14a2e0 2021-11-15T14:34:58.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c14b860 con 0x7f590c14a2e0 2021-11-15T14:34:58.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590401dd80 con 0x7f590c14a2e0 2021-11-15T14:34:58.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c14a980 con 0x7f590c14a2e0 2021-11-15T14:34:58.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c0abaa0 con 0x7f590c14a2e0 2021-11-15T14:34:58.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f590401b450 con 0x7f590c14a2e0 2021-11-15T14:34:58.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 0x7f58f0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.609+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f590406d0a0 con 0x7f590c14a2e0 2021-11-15T14:34:58.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.613+0000 7f590bfff700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 0x7f58f0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.613+0000 7f590bfff700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 0x7f58f0055b90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f58f400b000 tx=0x7f58f4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.613+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5904044050 con 0x7f590c14a2e0 2021-11-15T14:34:58.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f590c0573d0 con 0x7f590c14a2e0 2021-11-15T14:34:58.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59097fa700 1 -- 172.21.2.135:0/2240598866 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f5904047670 con 0x7f590c14a2e0 2021-11-15T14:34:58.728 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:58.728 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:34:58.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 msgr2=0x7f58f0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 0x7f58f0055b90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f58f400b000 tx=0x7f58f4008040).stop 2021-11-15T14:34:58.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 msgr2=0x7f590c143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 0x7f590c143560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f58fc001840 tx=0x7f590401a000).stop 2021-11-15T14:34:58.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 shutdown_connections 2021-11-15T14:34:58.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58f00536d0 0x7f58f0055b90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f590c14a2e0 0x7f590c143560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f590c14b2e0 0x7f590c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 --2- 172.21.2.135:0/2240598866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58ec0049f0 0x7f590c0abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 >> 172.21.2.135:0/2240598866 conn(0x7f590c05f730 msgr2=0x7f590c0b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 shutdown_connections 2021-11-15T14:34:58.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.725+0000 7f59125b5700 1 -- 172.21.2.135:0/2240598866 wait complete. 2021-11-15T14:34:58.732 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:34:58.735 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:58.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.781+0000 7fe98dfda700 1 Processor -- start 2021-11-15T14:34:58.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.781+0000 7fe98dfda700 1 -- start start 2021-11-15T14:34:58.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe988148420 0x7fe9880b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9880b03d0 con 0x7fe9880a7140 2021-11-15T14:34:58.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880a9140 con 0x7fe988148420 2021-11-15T14:34:58.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880b0670 con 0x7fe9880b1e30 2021-11-15T14:34:58.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe988148420 0x7fe9880b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe988148420 0x7fe9880b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56226/0 (socket says 172.21.2.135:56226) 2021-11-15T14:34:58.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 -- 172.21.2.135:0/3231297508 learned_addr learned my addr 172.21.2.135:0/3231297508 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:58.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 -- 172.21.2.135:0/3231297508 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 msgr2=0x7fe9880b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 --2- 172.21.2.135:0/3231297508 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 -- 172.21.2.135:0/3231297508 >> v1:172.21.2.119:6789/0 conn(0x7fe9880a7140 legacy=0x7fe9881447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 -- 172.21.2.135:0/3231297508 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880b0910 con 0x7fe988148420 2021-11-15T14:34:58.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe986ffd700 1 --2- 172.21.2.135:0/3231297508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9880b2210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe988061420 tx=0x7fe970006eb0).ready entity=mon.1 client_cookie=e01d4413c24f6028 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe9867fc700 1 -- 172.21.2.135:0/3231297508 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97000d570 con 0x7fe988148420 2021-11-15T14:34:58.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe9867fc700 1 -- 172.21.2.135:0/3231297508 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970000e90 con 0x7fe988148420 2021-11-15T14:34:58.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe9867fc700 1 -- 172.21.2.135:0/3231297508 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97000d8c0 con 0x7fe988148420 2021-11-15T14:34:58.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- 172.21.2.135:0/3231297508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 msgr2=0x7fe9880b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- 172.21.2.135:0/3231297508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9880b2210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fe988061420 tx=0x7fe970006eb0).stop 2021-11-15T14:34:58.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- 172.21.2.135:0/3231297508 shutdown_connections 2021-11-15T14:34:58.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- 172.21.2.135:0/3231297508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9880b2210 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- 172.21.2.135:0/3231297508 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- 172.21.2.135:0/3231297508 >> 172.21.2.135:0/3231297508 conn(0x7fe98805f730 msgr2=0x7fe98805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- 172.21.2.135:0/3231297508 shutdown_connections 2021-11-15T14:34:58.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- 172.21.2.135:0/3231297508 wait complete. 2021-11-15T14:34:58.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 Processor -- start 2021-11-15T14:34:58.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- start start 2021-11-15T14:34:58.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9880a7140 0x7fe988147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988156ca0 con 0x7fe9880a7140 2021-11-15T14:34:58.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98815a430 con 0x7fe988148420 2021-11-15T14:34:58.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe98dfda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98815a190 con 0x7fe9880b1e30 2021-11-15T14:34:58.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56234/0 (socket says 172.21.2.135:56234) 2021-11-15T14:34:58.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 -- 172.21.2.135:0/2853338793 learned_addr learned my addr 172.21.2.135:0/2853338793 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:58.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 -- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 msgr2=0x7fe9880a9b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:58.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880a9b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 -- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9880a7140 msgr2=0x7fe988147ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:34:58.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9880a7140 0x7fe988147ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.785+0000 7fe987fff700 1 -- 172.21.2.135:0/2853338793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97000b1e0 con 0x7fe988148420 2021-11-15T14:34:58.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe987fff700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe980003310 tx=0x7fe9800091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe980001500 con 0x7fe988148420 2021-11-15T14:34:58.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980001660 con 0x7fe988148420 2021-11-15T14:34:58.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988156f00 con 0x7fe988148420 2021-11-15T14:34:58.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9800019c0 con 0x7fe988148420 2021-11-15T14:34:58.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe988157890 con 0x7fe988148420 2021-11-15T14:34:58.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe988157090 con 0x7fe988148420 2021-11-15T14:34:58.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe980018030 con 0x7fe988148420 2021-11-15T14:34:58.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 0x7fe96c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe98006b480 con 0x7fe988148420 2021-11-15T14:34:58.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe9877fe700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 0x7fe96c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe9877fe700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 0x7fe96c055b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe978002f70 tx=0x7fe978006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.789+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe980042540 con 0x7fe988148420 2021-11-15T14:34:58.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9880b0bb0 con 0x7fe988148420 2021-11-15T14:34:58.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe984ff9700 1 -- 172.21.2.135:0/2853338793 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16284 (secure 0 0 0) 0x7fe980045b60 con 0x7fe988148420 2021-11-15T14:34:58.878 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:58.879 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":35,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:58.058161+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:55.042943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:55.985686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:58.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 msgr2=0x7fe96c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 0x7fe96c055b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe978002f70 tx=0x7fe978006a00).stop 2021-11-15T14:34:58.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 msgr2=0x7fe9881573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.873+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe980003310 tx=0x7fe9800091a0).stop 2021-11-15T14:34:58.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 shutdown_connections 2021-11-15T14:34:58.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe96c0536a0 0x7fe96c055b60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe988148420 0x7fe9881573a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9880b1e30 0x7fe9880a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 --2- 172.21.2.135:0/2853338793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9880a7140 0x7fe988147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 >> 172.21.2.135:0/2853338793 conn(0x7fe98805f730 msgr2=0x7fe98814cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 shutdown_connections 2021-11-15T14:34:58.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.877+0000 7fe98dfda700 1 -- 172.21.2.135:0/2853338793 wait complete. 2021-11-15T14:34:58.886 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:34:58.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 Processor -- start 2021-11-15T14:34:58.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 -- start start 2021-11-15T14:34:58.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24800acdd0 0x7f248014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800b6d60 con 0x7f2480060990 2021-11-15T14:34:58.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2480061260 con 0x7f24800b6980 2021-11-15T14:34:58.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2486ddf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2480061500 con 0x7f24800acdd0 2021-11-15T14:34:58.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2484b7b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f24800b6980 0x7f24800a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43826/0 (socket says 172.21.2.135:43826) 2021-11-15T14:34:58.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f2484b7b700 1 -- 172.21.2.135:0/4173003659 learned_addr learned my addr 172.21.2.135:0/4173003659 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:58.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082523351 0 0) 0x7f2480061260 con 0x7f24800b6980 2021-11-15T14:34:58.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2460003260 con 0x7f24800b6980 2021-11-15T14:34:58.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58601867 0 0) 0x7f2460003260 con 0x7f24800b6980 2021-11-15T14:34:58.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24800acdd0 msgr2=0x7f248014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24800acdd0 0x7f248014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24800acdd0 0x7f248014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 >> v1:172.21.2.119:6789/0 conn(0x7f2480060990 legacy=0x7f24800aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800617a0 con 0x7f24800b6980 2021-11-15T14:34:58.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2468001660 con 0x7f24800b6980 2021-11-15T14:34:58.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 >> v1:172.21.2.135:6789/0 conn(0x7f24800b6980 legacy=0x7f24800a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24600037d0 0x7f2460003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2460004500 0x7f2460004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f246000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480061500 con 0x7f2460004500 2021-11-15T14:34:58.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246000be80 con 0x7f2460005070 2021-11-15T14:34:58.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246000c040 con 0x7f24600037d0 2021-11-15T14:34:58.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24800acdd0 0x7f248014a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:58.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f246000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 -- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24600037d0 msgr2=0x7f2460003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24600037d0 0x7f2460003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 -- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2460004500 msgr2=0x7f2460004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:58.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2460004500 0x7f2460004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:58.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.937+0000 7f248537c700 1 -- 172.21.2.135:0/4173003659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460003260 con 0x7f2460005070 2021-11-15T14:34:58.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f248537c700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f246000b750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2478000b60 tx=0x7f2478008040).ready entity=mon.1 client_cookie=f999e401e62d027 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2478015070 con 0x7f2460005070 2021-11-15T14:34:58.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2478011410 con 0x7f2460005070 2021-11-15T14:34:58.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247f7fe700 1 -- 172.21.2.135:0/4173003659 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2478011770 con 0x7f2460005070 2021-11-15T14:34:58.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/4173003659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 msgr2=0x7f246000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 --2- 172.21.2.135:0/4173003659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f246000b750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2478000b60 tx=0x7f2478008040).stop 2021-11-15T14:34:58.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f248537c700 1 -- 172.21.2.135:0/4173003659 reap_dead start 2021-11-15T14:34:58.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/4173003659 shutdown_connections 2021-11-15T14:34:58.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/4173003659 >> 172.21.2.135:0/4173003659 conn(0x7f24800b3500 msgr2=0x7f24800b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:58.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/4173003659 shutdown_connections 2021-11-15T14:34:58.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/4173003659 wait complete. 2021-11-15T14:34:58.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 Processor -- start 2021-11-15T14:34:58.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- start start 2021-11-15T14:34:58.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 0x7f2480063350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 0x7f24800ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480063840 con 0x7f248013c790 2021-11-15T14:34:58.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248013ac30 con 0x7f2460005070 2021-11-15T14:34:58.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800ad440 con 0x7f248013e590 2021-11-15T14:34:58.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56252/0 (socket says 172.21.2.135:56252) 2021-11-15T14:34:58.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 -- 172.21.2.135:0/2078955352 learned_addr learned my addr 172.21.2.135:0/2078955352 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:58.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f248537c700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 0x7f24800ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 -- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 msgr2=0x7f24800ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247ffff700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 0x7f2480063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 0x7f24800ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 -- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 msgr2=0x7f2480063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:58.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 0x7f2480063350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:58.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 -- 172.21.2.135:0/2078955352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248013aeb0 con 0x7f2460005070 2021-11-15T14:34:58.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f248537c700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 0x7f24800ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:58.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247ffff700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 0x7f2480063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:58.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2484b7b700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2480060380 tx=0x7f248005fe30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2468007170 con 0x7f2460005070 2021-11-15T14:34:58.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680072d0 con 0x7f2460005070 2021-11-15T14:34:58.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2468004920 con 0x7f2460005070 2021-11-15T14:34:58.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248013b150 con 0x7f2460005070 2021-11-15T14:34:58.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248013ea40 con 0x7f2460005070 2021-11-15T14:34:58.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f246801b070 con 0x7f2460005070 2021-11-15T14:34:58.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248013cb70 con 0x7f2460005070 2021-11-15T14:34:58.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 0x7f2464055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:58.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.941+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f246806b320 con 0x7f2460005070 2021-11-15T14:34:58.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.945+0000 7f247ffff700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 0x7f2464055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:58.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.945+0000 7f247ffff700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 0x7f2464055b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2470008000 tx=0x7f2470009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:58.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:58.945+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2468042220 con 0x7f2460005070 2021-11-15T14:34:59.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.057+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f24800ad5b0 con 0x7f2460005070 2021-11-15T14:34:59.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f247dffb700 1 -- 172.21.2.135:0/2078955352 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2468045840 con 0x7f2460005070 2021-11-15T14:34:59.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 msgr2=0x7f2464055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 0x7f2464055b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2470008000 tx=0x7f2470009040).stop 2021-11-15T14:34:59.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 msgr2=0x7f24800ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2480060380 tx=0x7f248005fe30).stop 2021-11-15T14:34:59.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 shutdown_connections 2021-11-15T14:34:59.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2464053640 0x7f2464055b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f248013e590 0x7f24800ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f248013c790 0x7f2480063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 --2- 172.21.2.135:0/2078955352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2460005070 0x7f24800ae8b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 >> 172.21.2.135:0/2078955352 conn(0x7f24800b3500 msgr2=0x7f24800b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 shutdown_connections 2021-11-15T14:34:59.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.069+0000 7f2486ddf700 1 -- 172.21.2.135:0/2078955352 wait complete. 2021-11-15T14:34:59.077 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:34:59.081 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:34:59.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.129+0000 7f1fa5774700 1 Processor -- start 2021-11-15T14:34:59.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- start start 2021-11-15T14:34:59.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1fa0060990 0x7f1fa00acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1fa00aa650 0x7f1fa013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa00b6d60 con 0x7f1fa00b6980 2021-11-15T14:34:59.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa0061260 con 0x7f1fa0060990 2021-11-15T14:34:59.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa0061500 con 0x7f1fa00aa650 2021-11-15T14:34:59.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1fa00aa650 0x7f1fa013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1fa00aa650 0x7f1fa013c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56262/0 (socket says 172.21.2.135:56262) 2021-11-15T14:34:59.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 -- 172.21.2.135:0/2327613296 learned_addr learned my addr 172.21.2.135:0/2327613296 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:59.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 -- 172.21.2.135:0/2327613296 >> v2:172.21.2.119:3300/0 conn(0x7f1fa0060990 msgr2=0x7f1fa00acdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:59.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 --2- 172.21.2.135:0/2327613296 >> v2:172.21.2.119:3300/0 conn(0x7f1fa0060990 0x7f1fa00acdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 -- 172.21.2.135:0/2327613296 >> v1:172.21.2.119:6789/0 conn(0x7f1fa00b6980 legacy=0x7f1fa00a9f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:34:59.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 -- 172.21.2.135:0/2327613296 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00617a0 con 0x7f1fa00aa650 2021-11-15T14:34:59.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9f7fe700 1 --2- 172.21.2.135:0/2327613296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa013c4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f1fa0060380 tx=0x7f1f9800b530).ready entity=mon.1 client_cookie=637fe93cb7550f4b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9dffb700 1 -- 172.21.2.135:0/2327613296 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f980155e0 con 0x7f1fa00aa650 2021-11-15T14:34:59.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9dffb700 1 -- 172.21.2.135:0/2327613296 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98015740 con 0x7f1fa00aa650 2021-11-15T14:34:59.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9dffb700 1 -- 172.21.2.135:0/2327613296 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f98015ae0 con 0x7f1fa00aa650 2021-11-15T14:34:59.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/2327613296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 msgr2=0x7f1fa013c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- 172.21.2.135:0/2327613296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa013c4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f1fa0060380 tx=0x7f1f9800b530).stop 2021-11-15T14:34:59.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/2327613296 shutdown_connections 2021-11-15T14:34:59.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- 172.21.2.135:0/2327613296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa013c4f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- 172.21.2.135:0/2327613296 >> v2:172.21.2.119:3300/0 conn(0x7f1fa0060990 0x7f1fa00acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/2327613296 >> 172.21.2.135:0/2327613296 conn(0x7f1fa00b3500 msgr2=0x7f1fa00b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/2327613296 shutdown_connections 2021-11-15T14:34:59.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/2327613296 wait complete. 2021-11-15T14:34:59.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 Processor -- start 2021-11-15T14:34:59.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- start start 2021-11-15T14:34:59.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1fa0060990 0x7f1fa013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1fa00b6980 0x7f1fa013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b1fa0 con 0x7f1fa0060990 2021-11-15T14:34:59.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa013d780 con 0x7f1fa00aa650 2021-11-15T14:34:59.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b1a60 con 0x7f1fa00b6980 2021-11-15T14:34:59.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56266/0 (socket says 172.21.2.135:56266) 2021-11-15T14:34:59.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 -- 172.21.2.135:0/4060996239 learned_addr learned my addr 172.21.2.135:0/4060996239 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:59.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 -- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1fa00b6980 msgr2=0x7f1fa013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1fa00b6980 0x7f1fa013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 -- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1fa0060990 msgr2=0x7f1fa013ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1fa0060990 0x7f1fa013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 -- 172.21.2.135:0/4060996239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9800b7d0 con 0x7f1fa00aa650 2021-11-15T14:34:59.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f9e7fc700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f1fa014e340 tx=0x7f1f90006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f90009e90 con 0x7f1fa00aa650 2021-11-15T14:34:59.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90002320 con 0x7f1fa00aa650 2021-11-15T14:34:59.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa00b1d00 con 0x7f1fa00aa650 2021-11-15T14:34:59.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f90002680 con 0x7f1fa00aa650 2021-11-15T14:34:59.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.133+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa011f900 con 0x7f1fa00aa650 2021-11-15T14:34:59.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa013d8f0 con 0x7f1fa00aa650 2021-11-15T14:34:59.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f9000f030 con 0x7f1fa00aa650 2021-11-15T14:34:59.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f97fff700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 0x7f1f84055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1f9006b880 con 0x7f1fa00aa650 2021-11-15T14:34:59.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f9effd700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 0x7f1f84055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f9effd700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 0x7f1f84055a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1f88002fb0 tx=0x7f1f880069d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.137+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f90042780 con 0x7f1fa00aa650 2021-11-15T14:34:59.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.249+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1fa0061a40 con 0x7f1fa00aa650 2021-11-15T14:34:59.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.260+0000 7f1f97fff700 1 -- 172.21.2.135:0/4060996239 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1f90069e60 con 0x7f1fa00aa650 2021-11-15T14:34:59.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 msgr2=0x7f1f84055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 0x7f1f84055a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1f88002fb0 tx=0x7f1f880069d0).stop 2021-11-15T14:34:59.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 msgr2=0x7f1fa00b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f1fa014e340 tx=0x7f1f90006d50).stop 2021-11-15T14:34:59.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 shutdown_connections 2021-11-15T14:34:59.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f84053580 0x7f1f84055a40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1fa00b6980 0x7f1fa013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1fa00aa650 0x7f1fa00b22e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 --2- 172.21.2.135:0/4060996239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1fa0060990 0x7f1fa013ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 >> 172.21.2.135:0/4060996239 conn(0x7f1fa00b3500 msgr2=0x7f1fa00b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 shutdown_connections 2021-11-15T14:34:59.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.264+0000 7f1fa5774700 1 -- 172.21.2.135:0/4060996239 wait complete. 2021-11-15T14:34:59.270 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:34:59.274 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:34:59.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 Processor -- start 2021-11-15T14:34:59.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- start start 2021-11-15T14:34:59.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f38cc0b1e30 0x7f38cc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 0x7f38cc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0a9140 con 0x7f38cc0a7140 2021-11-15T14:34:59.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0b03d0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0b0670 con 0x7f38cc148420 2021-11-15T14:34:59.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f38cc0b1e30 0x7f38cc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f38cc0b1e30 0x7f38cc0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56272/0 (socket says 172.21.2.135:56272) 2021-11-15T14:34:59.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 -- 172.21.2.135:0/2502713534 learned_addr learned my addr 172.21.2.135:0/2502713534 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:59.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38c9d9b700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38cad9d700 1 --2- 172.21.2.135:0/2502713534 >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 0x7f38cc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 -- 172.21.2.135:0/2502713534 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 msgr2=0x7f38cc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 -- 172.21.2.135:0/2502713534 >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 msgr2=0x7f38cc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 --2- 172.21.2.135:0/2502713534 >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 0x7f38cc1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 -- 172.21.2.135:0/2502713534 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0b0910 con 0x7f38cc0b1e30 2021-11-15T14:34:59.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38cad9d700 1 --2- 172.21.2.135:0/2502713534 >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 0x7f38cc1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:34:59.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38ca59c700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc0b1050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f38bc002f70 tx=0x7f38bc006eb0).ready entity=mon.1 client_cookie=23a71a6050cd679e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38c959a700 1 -- 172.21.2.135:0/2502713534 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38bc00d570 con 0x7f38cc0b1e30 2021-11-15T14:34:59.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38c959a700 1 -- 172.21.2.135:0/2502713534 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc000e90 con 0x7f38cc0b1e30 2021-11-15T14:34:59.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38c959a700 1 -- 172.21.2.135:0/2502713534 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38bc00d900 con 0x7f38cc0b1e30 2021-11-15T14:34:59.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- 172.21.2.135:0/2502713534 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 msgr2=0x7f38cc0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc0b1050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f38bc002f70 tx=0x7f38bc006eb0).stop 2021-11-15T14:34:59.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- 172.21.2.135:0/2502713534 shutdown_connections 2021-11-15T14:34:59.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/2502713534 >> v2:172.21.2.119:3300/0 conn(0x7f38cc0a7140 0x7f38cc1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/2502713534 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc0b1050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.320+0000 7f38d0c2a700 1 -- 172.21.2.135:0/2502713534 >> 172.21.2.135:0/2502713534 conn(0x7f38cc05f730 msgr2=0x7f38cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- 172.21.2.135:0/2502713534 shutdown_connections 2021-11-15T14:34:59.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- 172.21.2.135:0/2502713534 wait complete. 2021-11-15T14:34:59.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 Processor -- start 2021-11-15T14:34:59.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- start start 2021-11-15T14:34:59.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38cc0a7140 0x7f38cc0ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0aaf10 con 0x7f38cc0a7140 2021-11-15T14:34:59.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0ab5a0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc14a1b0 con 0x7f38cc148420 2021-11-15T14:34:59.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56278/0 (socket says 172.21.2.135:56278) 2021-11-15T14:34:59.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 -- 172.21.2.135:0/4098003758 learned_addr learned my addr 172.21.2.135:0/4098003758 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:59.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38cad9d700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38ca59c700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38cc0a7140 0x7f38cc0ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 -- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 msgr2=0x7f38cc143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 -- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38cc0a7140 msgr2=0x7f38cc0ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38cc0a7140 0x7f38cc0ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 -- 172.21.2.135:0/4098003758 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc00b1e0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38c9d9b700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f38c000a000 tx=0x7f38c0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c0011780 con 0x7f38cc0b1e30 2021-11-15T14:34:59.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00118e0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc0af2a0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c0011c40 con 0x7f38cc0b1e30 2021-11-15T14:34:59.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc0ac2b0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc14a370 con 0x7f38cc0b1e30 2021-11-15T14:34:59.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38c0012420 con 0x7f38cc0b1e30 2021-11-15T14:34:59.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 0x7f38a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f38c006ba40 con 0x7f38cc0b1e30 2021-11-15T14:34:59.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.324+0000 7f38ca59c700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 0x7f38a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.328+0000 7f38ca59c700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 0x7f38a8055ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38bc01a000 tx=0x7f38bc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.328+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38c00428e0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38cc0b0bb0 con 0x7f38cc0b1e30 2021-11-15T14:34:59.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38bb7fe700 1 -- 172.21.2.135:0/4098003758 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f38c0018270 con 0x7f38cc0b1e30 2021-11-15T14:34:59.445 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:59.445 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:34:59.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 msgr2=0x7f38a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 0x7f38a8055ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38bc01a000 tx=0x7f38bc015000).stop 2021-11-15T14:34:59.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 msgr2=0x7f38cc159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f38c000a000 tx=0x7f38c0008040).stop 2021-11-15T14:34:59.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 shutdown_connections 2021-11-15T14:34:59.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38a8053610 0x7f38a8055ad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38cc148420 0x7f38cc143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f38cc0b1e30 0x7f38cc159ea0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 --2- 172.21.2.135:0/4098003758 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38cc0a7140 0x7f38cc0ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 >> 172.21.2.135:0/4098003758 conn(0x7f38cc05f730 msgr2=0x7f38cc0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 shutdown_connections 2021-11-15T14:34:59.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.440+0000 7f38d0c2a700 1 -- 172.21.2.135:0/4098003758 wait complete. 2021-11-15T14:34:59.449 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:34:59.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:34:57.052244+0000', 'modified': '2021-11-15T14:34:58.540494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4861': {'gid': 4861, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/1684531282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 1684531282}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 1684531282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:34:59.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:34:59.755 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:34:59.819 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":4861,"want_state":"up:active","state":"up:active","rank_uptime":2.7587389550000001,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":35,"uptime":7.9422335559999997} 2021-11-15T14:34:59.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 4861, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 35, "rank_uptime": 2.758738955, "state": "up:active", "uptime": 7.942233556, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:34:59.820 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:34:59.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.864+0000 7f0eb38e3700 1 Processor -- start 2021-11-15T14:34:59.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.864+0000 7f0eb38e3700 1 -- start start 2021-11-15T14:34:59.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac148420 0x7f0eac0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0eac0a7140 0x7f0eac1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0b03d0 con 0x7f0eac0b1e30 2021-11-15T14:34:59.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0a9140 con 0x7f0eac0a7140 2021-11-15T14:34:59.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b0670 con 0x7f0eac148420 2021-11-15T14:34:59.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb167f700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0eac0b1e30 0x7f0eac0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43874/0 (socket says 172.21.2.135:43874) 2021-11-15T14:34:59.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb167f700 1 -- 172.21.2.135:0/1740328523 learned_addr learned my addr 172.21.2.135:0/1740328523 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:34:59.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675036881 0 0) 0x7f0eac0b03d0 con 0x7f0eac0b1e30 2021-11-15T14:34:59.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94003260 con 0x7f0eac0b1e30 2021-11-15T14:34:59.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb0e7e700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac148420 0x7f0eac0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> v2:172.21.2.119:3300/0 conn(0x7f0eac0a7140 0x7f0eac1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478121840 0 0) 0x7f0e94003260 con 0x7f0eac0b1e30 2021-11-15T14:34:59.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac148420 msgr2=0x7f0eac0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac148420 0x7f0eac0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 >> v2:172.21.2.119:3300/0 conn(0x7f0eac0a7140 msgr2=0x7f0eac1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 --2- 172.21.2.135:0/1740328523 >> v2:172.21.2.119:3300/0 conn(0x7f0eac0a7140 0x7f0eac1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0b0910 con 0x7f0eac0b1e30 2021-11-15T14:34:59.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0ea0001660 con 0x7f0eac0b1e30 2021-11-15T14:34:59.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 >> v1:172.21.2.135:6789/0 conn(0x7f0eac0b1e30 legacy=0x7f0eac0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e940037d0 0x7f0e94003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004500 0x7f0e94004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e94004e70 0x7f0e9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b0670 con 0x7f0e94004500 2021-11-15T14:34:59.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400bdd0 con 0x7f0e94004e70 2021-11-15T14:34:59.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400bf40 con 0x7f0e940037d0 2021-11-15T14:34:59.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> v2:172.21.2.119:3300/0 conn(0x7f0eac0a7140 0x7f0eac1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:59.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb0e7e700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac148420 0x7f0eac0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:34:59.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e94004e70 0x7f0e9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 -- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e940037d0 msgr2=0x7f0e94003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e940037d0 0x7f0e94003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 -- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004500 msgr2=0x7f0e94004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:34:59.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004500 0x7f0e94004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:34:59.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 -- 172.21.2.135:0/1740328523 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94003260 con 0x7f0e94004e70 2021-11-15T14:34:59.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e94004e70 0x7f0e9400b750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0ea400a000 tx=0x7f0ea4008040).ready entity=mon.1 client_cookie=454fc31a59e60135 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea400c070 con 0x7f0e94004e70 2021-11-15T14:34:59.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400e620 con 0x7f0e94004e70 2021-11-15T14:34:59.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0e9ffff700 1 -- 172.21.2.135:0/1740328523 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea4009530 con 0x7f0e94004e70 2021-11-15T14:34:59.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- 172.21.2.135:0/1740328523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e94004e70 msgr2=0x7f0e9400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/1740328523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e94004e70 0x7f0e9400b750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0ea400a000 tx=0x7f0ea4008040).stop 2021-11-15T14:34:59.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb1e80700 1 -- 172.21.2.135:0/1740328523 reap_dead start 2021-11-15T14:34:59.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- 172.21.2.135:0/1740328523 shutdown_connections 2021-11-15T14:34:59.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- 172.21.2.135:0/1740328523 >> 172.21.2.135:0/1740328523 conn(0x7f0eac05f730 msgr2=0x7f0eac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- 172.21.2.135:0/1740328523 shutdown_connections 2021-11-15T14:34:59.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- 172.21.2.135:0/1740328523 wait complete. 2021-11-15T14:34:59.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 Processor -- start 2021-11-15T14:34:59.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.868+0000 7f0eb38e3700 1 -- start start 2021-11-15T14:34:59.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004e70 0x7f0eac0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac149eb0 0x7f0eac0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac14b5a0 con 0x7f0e94004e70 2021-11-15T14:34:59.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0aed20 con 0x7f0eac14af30 2021-11-15T14:34:59.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac14a430 con 0x7f0eac149eb0 2021-11-15T14:34:59.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56302/0 (socket says 172.21.2.135:56302) 2021-11-15T14:34:59.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 -- 172.21.2.135:0/3893365019 learned_addr learned my addr 172.21.2.135:0/3893365019 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:34:59.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb167f700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004e70 0x7f0eac0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb0e7e700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac149eb0 0x7f0eac0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 -- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac149eb0 msgr2=0x7f0eac0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac149eb0 0x7f0eac0adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 -- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004e70 msgr2=0x7f0eac0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004e70 0x7f0eac0a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 -- 172.21.2.135:0/3893365019 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac14b7f0 con 0x7f0eac14af30 2021-11-15T14:34:59.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb1e80700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0ea0001110 tx=0x7f0ea4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea4021070 con 0x7f0eac14af30 2021-11-15T14:34:59.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400edd0 con 0x7f0eac14af30 2021-11-15T14:34:59.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac14ba90 con 0x7f0eac14af30 2021-11-15T14:34:59.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0ab3b0 con 0x7f0eac14af30 2021-11-15T14:34:59.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea40032f0 con 0x7f0eac14af30 2021-11-15T14:34:59.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac14bc20 con 0x7f0eac14af30 2021-11-15T14:34:59.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ea401d630 con 0x7f0eac14af30 2021-11-15T14:34:59.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 0x7f0e8c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:34:59.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0ea406c620 con 0x7f0eac14af30 2021-11-15T14:34:59.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb167f700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 0x7f0e8c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:34:59.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.872+0000 7f0eb167f700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 0x7f0e8c055b90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0ea000d000 tx=0x7f0ea0000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:34:59.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.876+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ea40435d0 con 0x7f0eac14af30 2021-11-15T14:34:59.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eac0573d0 con 0x7f0eac14af30 2021-11-15T14:34:59.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0e9e7fc700 1 -- 172.21.2.135:0/3893365019 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f0ea4046bf0 con 0x7f0eac14af30 2021-11-15T14:34:59.964 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:34:59.964 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":36,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:34:59.069082+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:34:55.042943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-15T14:34:55.985686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:34:59.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 msgr2=0x7f0e8c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 0x7f0e8c055b90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0ea000d000 tx=0x7f0ea0000bc0).stop 2021-11-15T14:34:59.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 msgr2=0x7f0eac0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:34:59.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0ea0001110 tx=0x7f0ea4008040).stop 2021-11-15T14:34:59.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 shutdown_connections 2021-11-15T14:34:59.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e8c0536d0 0x7f0e8c055b90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0eac14af30 0x7f0eac0ae480 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0eac149eb0 0x7f0eac0adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 --2- 172.21.2.135:0/3893365019 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e94004e70 0x7f0eac0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:34:59.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 >> 172.21.2.135:0/3893365019 conn(0x7f0eac05f730 msgr2=0x7f0eac0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:34:59.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 shutdown_connections 2021-11-15T14:34:59.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:34:59.960+0000 7f0eb38e3700 1 -- 172.21.2.135:0/3893365019 wait complete. 2021-11-15T14:34:59.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:34:55.042943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:34:55.985686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:34:59.972 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:35:00.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 Processor -- start 2021-11-15T14:35:00.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- start start 2021-11-15T14:35:00.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0d580b3790 0x7f0d580b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d580b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d581439a0 con 0x7f0d580b0630 2021-11-15T14:35:00.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d58143c40 con 0x7f0d580b3790 2021-11-15T14:35:00.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58143ee0 con 0x7f0d580a9c90 2021-11-15T14:35:00.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0d580b3790 0x7f0d580b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0d580b3790 0x7f0d580b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56308/0 (socket says 172.21.2.135:56308) 2021-11-15T14:35:00.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 -- 172.21.2.135:0/3003268801 learned_addr learned my addr 172.21.2.135:0/3003268801 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d577fe700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d580b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 -- 172.21.2.135:0/3003268801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 msgr2=0x7f0d580b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d580b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 -- 172.21.2.135:0/3003268801 >> v1:172.21.2.119:6789/0 conn(0x7f0d580b0630 legacy=0x7f0d5813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 -- 172.21.2.135:0/3003268801 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58144180 con 0x7f0d580b3790 2021-11-15T14:35:00.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b3790 0x7f0d580b0a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0d5806aad0 tx=0x7f0d40006eb0).ready entity=mon.1 client_cookie=171bedd0f8c50ac5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d55ffb700 1 -- 172.21.2.135:0/3003268801 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4000d570 con 0x7f0d580b3790 2021-11-15T14:35:00.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d55ffb700 1 -- 172.21.2.135:0/3003268801 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40000e90 con 0x7f0d580b3790 2021-11-15T14:35:00.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d55ffb700 1 -- 172.21.2.135:0/3003268801 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4000d8c0 con 0x7f0d580b3790 2021-11-15T14:35:00.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- 172.21.2.135:0/3003268801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b3790 msgr2=0x7f0d580b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b3790 0x7f0d580b0a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f0d5806aad0 tx=0x7f0d40006eb0).stop 2021-11-15T14:35:00.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- 172.21.2.135:0/3003268801 shutdown_connections 2021-11-15T14:35:00.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d580b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/3003268801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b3790 0x7f0d580b0a10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- 172.21.2.135:0/3003268801 >> 172.21.2.135:0/3003268801 conn(0x7f0d58060840 msgr2=0x7f0d58060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- 172.21.2.135:0/3003268801 shutdown_connections 2021-11-15T14:35:00.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- 172.21.2.135:0/3003268801 wait complete. 2021-11-15T14:35:00.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 Processor -- start 2021-11-15T14:35:00.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- start start 2021-11-15T14:35:00.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d58063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d580b3790 0x7f0d58065db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58064c50 con 0x7f0d580b3790 2021-11-15T14:35:00.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58140050 con 0x7f0d580b0630 2021-11-15T14:35:00.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d5d35d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580662a0 con 0x7f0d580a9c90 2021-11-15T14:35:00.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56312/0 (socket says 172.21.2.135:56312) 2021-11-15T14:35:00.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.076+0000 7f0d567fc700 1 -- 172.21.2.135:0/1468484319 learned_addr learned my addr 172.21.2.135:0/1468484319 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 -- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 msgr2=0x7f0d58063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d58063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 -- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d580b3790 msgr2=0x7f0d58065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d580b3790 0x7f0d58065db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 -- 172.21.2.135:0/1468484319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4000b1e0 con 0x7f0d580b0630 2021-11-15T14:35:00.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d567fc700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f0d58141260 tx=0x7f0d40015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d400067e0 con 0x7f0d580b0630 2021-11-15T14:35:00.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40011790 con 0x7f0d580b0630 2021-11-15T14:35:00.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58064710 con 0x7f0d580b0630 2021-11-15T14:35:00.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d40011af0 con 0x7f0d580b0630 2021-11-15T14:35:00.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d580677a0 con 0x7f0d580b0630 2021-11-15T14:35:00.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5813dce0 con 0x7f0d580b0630 2021-11-15T14:35:00.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d40025030 con 0x7f0d580b0630 2021-11-15T14:35:00.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 0x7f0d3c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0d4006cc20 con 0x7f0d580b0630 2021-11-15T14:35:00.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d56ffd700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 0x7f0d3c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.080+0000 7f0d56ffd700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 0x7f0d3c055b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0d48001fa0 tx=0x7f0d480077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.084+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d40043c30 con 0x7f0d580b0630 2021-11-15T14:35:00.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0d581401e0 con 0x7f0d580b0630 2021-11-15T14:35:00.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d4ffff700 1 -- 172.21.2.135:0/1468484319 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0d40023020 con 0x7f0d580b0630 2021-11-15T14:35:00.170 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:35:00.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 msgr2=0x7f0d3c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 0x7f0d3c055b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0d48001fa0 tx=0x7f0d480077f0).stop 2021-11-15T14:35:00.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 msgr2=0x7f0d580658c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.164+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f0d58141260 tx=0x7f0d40015000).stop 2021-11-15T14:35:00.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 shutdown_connections 2021-11-15T14:35:00.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d3c053640 0x7f0d3c055b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d580b3790 0x7f0d58065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d580b0630 0x7f0d580658c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 --2- 172.21.2.135:0/1468484319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d580a9c90 0x7f0d58063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 >> 172.21.2.135:0/1468484319 conn(0x7f0d58060840 msgr2=0x7f0d58135880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 shutdown_connections 2021-11-15T14:35:00.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.168+0000 7f0d5d35d700 1 -- 172.21.2.135:0/1468484319 wait complete. 2021-11-15T14:35:00.177 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:35:00.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 Processor -- start 2021-11-15T14:35:00.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 -- start start 2021-11-15T14:35:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa4000b1f40 0x7fa4000b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 0x7fa4001412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000b04a0 con 0x7fa4000b0030 2021-11-15T14:35:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4000a7850 con 0x7fa4000b1f40 2021-11-15T14:35:00.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.224+0000 7fa4071c5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000b06d0 con 0x7fa4000b2320 2021-11-15T14:35:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 0x7fa4001412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa3fffff700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa4000b0030 0x7fa4000a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53328/0 (socket says 172.21.2.135:53328) 2021-11-15T14:35:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa3fffff700 1 -- 172.21.2.135:0/193836902 learned_addr learned my addr 172.21.2.135:0/193836902 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa404f61700 1 --2- 172.21.2.135:0/193836902 >> v2:172.21.2.119:3300/0 conn(0x7fa4000b1f40 0x7fa4000b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 -- 172.21.2.135:0/193836902 >> v2:172.21.2.119:3300/0 conn(0x7fa4000b1f40 msgr2=0x7fa4000b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 --2- 172.21.2.135:0/193836902 >> v2:172.21.2.119:3300/0 conn(0x7fa4000b1f40 0x7fa4000b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 -- 172.21.2.135:0/193836902 >> v1:172.21.2.119:6789/0 conn(0x7fa4000b0030 legacy=0x7fa4000a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 -- 172.21.2.135:0/193836902 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000b0970 con 0x7fa4000b2320 2021-11-15T14:35:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa405762700 1 --2- 172.21.2.135:0/193836902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 0x7fa4001412d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa3f0002f70 tx=0x7fa3f0006df0).ready entity=mon.2 client_cookie=f5497562fe51655b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa3ff7fe700 1 -- 172.21.2.135:0/193836902 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f000d570 con 0x7fa4000b2320 2021-11-15T14:35:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa3ff7fe700 1 -- 172.21.2.135:0/193836902 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0000e90 con 0x7fa4000b2320 2021-11-15T14:35:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa3ff7fe700 1 -- 172.21.2.135:0/193836902 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f000d8c0 con 0x7fa4000b2320 2021-11-15T14:35:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- 172.21.2.135:0/193836902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 msgr2=0x7fa4001412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 --2- 172.21.2.135:0/193836902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 0x7fa4001412d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa3f0002f70 tx=0x7fa3f0006df0).stop 2021-11-15T14:35:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- 172.21.2.135:0/193836902 shutdown_connections 2021-11-15T14:35:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 --2- 172.21.2.135:0/193836902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b2320 0x7fa4001412d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 --2- 172.21.2.135:0/193836902 >> v2:172.21.2.119:3300/0 conn(0x7fa4000b1f40 0x7fa4000b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- 172.21.2.135:0/193836902 >> 172.21.2.135:0/193836902 conn(0x7fa40005f730 msgr2=0x7fa40005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- 172.21.2.135:0/193836902 shutdown_connections 2021-11-15T14:35:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- 172.21.2.135:0/193836902 wait complete. 2021-11-15T14:35:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 Processor -- start 2021-11-15T14:35:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.228+0000 7fa4071c5700 1 -- start start 2021-11-15T14:35:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b0030 0x7fa4000aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4000b1f40 0x7fa40014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000ab3c0 con 0x7fa4000b1f40 2021-11-15T14:35:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40014b140 con 0x7fa4000b2320 2021-11-15T14:35:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000aa6f0 con 0x7fa4000b0030 2021-11-15T14:35:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56326/0 (socket says 172.21.2.135:56326) 2021-11-15T14:35:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 -- 172.21.2.135:0/3268859052 learned_addr learned my addr 172.21.2.135:0/3268859052 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 -- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b0030 msgr2=0x7fa4000aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b0030 0x7fa4000aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 -- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4000b1f40 msgr2=0x7fa40014b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4000b1f40 0x7fa40014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 -- 172.21.2.135:0/3268859052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f000b180 con 0x7fa4000b2320 2021-11-15T14:35:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa405762700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa400149ff0 tx=0x7fa3f0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f0013bf0 con 0x7fa4000b2320 2021-11-15T14:35:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0013d50 con 0x7fa4000b2320 2021-11-15T14:35:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40014b390 con 0x7fa4000b2320 2021-11-15T14:35:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40014ae30 con 0x7fa4000b2320 2021-11-15T14:35:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f001e5f0 con 0x7fa4000b2320 2021-11-15T14:35:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4000b0c10 con 0x7fa4000b2320 2021-11-15T14:35:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3f0025030 con 0x7fa4000b2320 2021-11-15T14:35:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 0x7fa3e0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa3f006caa0 con 0x7fa4000b2320 2021-11-15T14:35:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa404f61700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 0x7fa3e0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.232+0000 7fa404f61700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 0x7fa3e0055bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa3f800c000 tx=0x7fa3f80091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.236+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3f00439e0 con 0x7fa4000b2320 2021-11-15T14:35:00.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4000573d0 con 0x7fa4000b2320 2021-11-15T14:35:00.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa3fdffb700 1 -- 172.21.2.135:0/3268859052 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3f0046fc0 con 0x7fa4000b2320 2021-11-15T14:35:00.324 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:35:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 msgr2=0x7fa3e0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 0x7fa3e0055bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa3f800c000 tx=0x7fa3f80091d0).stop 2021-11-15T14:35:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 msgr2=0x7fa4000abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa400149ff0 tx=0x7fa3f0014000).stop 2021-11-15T14:35:00.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 shutdown_connections 2021-11-15T14:35:00.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa3e00536f0 0x7fa3e0055bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4000b2320 0x7fa4000abba0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4000b1f40 0x7fa40014b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 --2- 172.21.2.135:0/3268859052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4000b0030 0x7fa4000aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 >> 172.21.2.135:0/3268859052 conn(0x7fa40005f730 msgr2=0x7fa4000ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 shutdown_connections 2021-11-15T14:35:00.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.320+0000 7fa4071c5700 1 -- 172.21.2.135:0/3268859052 wait complete. 2021-11-15T14:35:00.331 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:35:00.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.376+0000 7f2a2018d700 1 Processor -- start 2021-11-15T14:35:00.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.376+0000 7f2a2018d700 1 -- start start 2021-11-15T14:35:00.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 0x7f2a180b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180a7850 con 0x7f2a180b1350 2021-11-15T14:35:00.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180b06d0 con 0x7f2a180b1f40 2021-11-15T14:35:00.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180b17c0 con 0x7f2a181419e0 2021-11-15T14:35:00.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1df29700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2a180b1f40 0x7f2a180a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43922/0 (socket says 172.21.2.135:43922) 2021-11-15T14:35:00.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1df29700 1 -- 172.21.2.135:0/3487068610 learned_addr learned my addr 172.21.2.135:0/3487068610 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:00.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595710490 0 0) 0x7f2a180b06d0 con 0x7f2a180b1f40 2021-11-15T14:35:00.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a00003260 con 0x7f2a180b1f40 2021-11-15T14:35:00.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887897956 0 0) 0x7f2a00003260 con 0x7f2a180b1f40 2021-11-15T14:35:00.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 msgr2=0x7f2a180b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 0x7f2a180b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 >> v1:172.21.2.119:6789/0 conn(0x7f2a180b1350 legacy=0x7f2a181412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180b0970 con 0x7f2a180b1f40 2021-11-15T14:35:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2a14001660 con 0x7f2a180b1f40 2021-11-15T14:35:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 >> v1:172.21.2.135:6789/0 conn(0x7f2a180b1f40 legacy=0x7f2a180a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a000037d0 0x7f2a00003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a00004500 0x7f2a00004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 0x7f2a0000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180b17c0 con 0x7f2a000037d0 2021-11-15T14:35:00.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000052e0 con 0x7f2a00004500 2021-11-15T14:35:00.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0000bc40 con 0x7f2a181419e0 2021-11-15T14:35:00.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a00004500 0x7f2a00004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 -- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 msgr2=0x7f2a0000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181419e0 0x7f2a0000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 -- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a000037d0 msgr2=0x7f2a00003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a000037d0 0x7f2a00003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 -- 172.21.2.135:0/3487068610 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00003260 con 0x7f2a00004500 2021-11-15T14:35:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1d728700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a00004500 0x7f2a00004980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2a0c000f70 tx=0x7f2a0c0079e0).ready entity=mon.1 client_cookie=d5d9f687da2c4729 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a0c007cf0 con 0x7f2a00004500 2021-11-15T14:35:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c014410 con 0x7f2a00004500 2021-11-15T14:35:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1cf27700 1 -- 172.21.2.135:0/3487068610 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a0c014770 con 0x7f2a00004500 2021-11-15T14:35:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- 172.21.2.135:0/3487068610 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a00004500 msgr2=0x7f2a00004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 --2- 172.21.2.135:0/3487068610 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a00004500 0x7f2a00004980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2a0c000f70 tx=0x7f2a0c0079e0).stop 2021-11-15T14:35:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a1e72a700 1 -- 172.21.2.135:0/3487068610 reap_dead start 2021-11-15T14:35:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- 172.21.2.135:0/3487068610 shutdown_connections 2021-11-15T14:35:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- 172.21.2.135:0/3487068610 >> 172.21.2.135:0/3487068610 conn(0x7f2a1805f730 msgr2=0x7f2a1805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- 172.21.2.135:0/3487068610 shutdown_connections 2021-11-15T14:35:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- 172.21.2.135:0/3487068610 wait complete. 2021-11-15T14:35:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 Processor -- start 2021-11-15T14:35:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- start start 2021-11-15T14:35:00.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a00004500 0x7f2a1814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 0x7f2a1815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180abd50 con 0x7f2a00004500 2021-11-15T14:35:00.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180b3290 con 0x7f2a180ab8f0 2021-11-15T14:35:00.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.380+0000 7f2a2018d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1814b7e0 con 0x7f2a181490a0 2021-11-15T14:35:00.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56346/0 (socket says 172.21.2.135:56346) 2021-11-15T14:35:00.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 -- 172.21.2.135:0/2763859266 learned_addr learned my addr 172.21.2.135:0/2763859266 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1df29700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a00004500 0x7f2a1814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1e72a700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 0x7f2a1815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 -- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 msgr2=0x7f2a1815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 0x7f2a1815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 -- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a00004500 msgr2=0x7f2a1814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a00004500 0x7f2a1814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 -- 172.21.2.135:0/2763859266 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1814ba80 con 0x7f2a180ab8f0 2021-11-15T14:35:00.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1e72a700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 0x7f2a1815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:35:00.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1d728700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2a180b3840 tx=0x7f2a0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a0c0137c0 con 0x7f2a180ab8f0 2021-11-15T14:35:00.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c013920 con 0x7f2a180ab8f0 2021-11-15T14:35:00.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a180b34c0 con 0x7f2a180ab8f0 2021-11-15T14:35:00.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a0c013c80 con 0x7f2a180ab8f0 2021-11-15T14:35:00.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a18149dc0 con 0x7f2a180ab8f0 2021-11-15T14:35:00.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a180b3650 con 0x7f2a180ab8f0 2021-11-15T14:35:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a0c02b3f0 con 0x7f2a180ab8f0 2021-11-15T14:35:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 0x7f29f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2a0c01c040 con 0x7f2a180ab8f0 2021-11-15T14:35:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1df29700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 0x7f29f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.384+0000 7f2a1df29700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 0x7f29f8055ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f2a1400b000 tx=0x7f2a14000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.388+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a0c043f40 con 0x7f2a180ab8f0 2021-11-15T14:35:00.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a180b0c10 con 0x7f2a180ab8f0 2021-11-15T14:35:00.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a0affd700 1 -- 172.21.2.135:0/2763859266 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2a0c047560 con 0x7f2a180ab8f0 2021-11-15T14:35:00.474 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:35:00.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 msgr2=0x7f29f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 0x7f29f8055ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f2a1400b000 tx=0x7f2a14000bc0).stop 2021-11-15T14:35:00.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 msgr2=0x7f2a18148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f2a180b3840 tx=0x7f2a0c015000).stop 2021-11-15T14:35:00.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 shutdown_connections 2021-11-15T14:35:00.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29f8053610 0x7f29f8055ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a181490a0 0x7f2a1815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a180ab8f0 0x7f2a18148bb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 --2- 172.21.2.135:0/2763859266 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a00004500 0x7f2a1814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 >> 172.21.2.135:0/2763859266 conn(0x7f2a1805f730 msgr2=0x7f2a1813ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 shutdown_connections 2021-11-15T14:35:00.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.468+0000 7f2a2018d700 1 -- 172.21.2.135:0/2763859266 wait complete. 2021-11-15T14:35:00.480 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:35:00.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 Processor -- start 2021-11-15T14:35:00.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- start start 2021-11-15T14:35:00.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9ab81419e0 0x7f9ab80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80a7850 con 0x7f9ab80b1350 2021-11-15T14:35:00.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80b06d0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab80b17c0 con 0x7f9ab81419e0 2021-11-15T14:35:00.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abdfa6700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9ab80b1f40 0x7f9ab80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43942/0 (socket says 172.21.2.135:43942) 2021-11-15T14:35:00.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abdfa6700 1 -- 172.21.2.135:0/347864321 learned_addr learned my addr 172.21.2.135:0/347864321 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:00.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abe7a7700 1 --2- 172.21.2.135:0/347864321 >> v2:172.21.2.135:3300/0 conn(0x7f9ab81419e0 0x7f9ab80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abe7a7700 1 -- 172.21.2.135:0/347864321 >> v1:172.21.2.135:6789/0 conn(0x7f9ab80b1f40 legacy=0x7f9ab80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abe7a7700 1 -- 172.21.2.135:0/347864321 >> v1:172.21.2.119:6789/0 conn(0x7f9ab80b1350 legacy=0x7f9ab81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abe7a7700 1 -- 172.21.2.135:0/347864321 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80b0970 con 0x7f9ab81419e0 2021-11-15T14:35:00.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abe7a7700 1 --2- 172.21.2.135:0/347864321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab81419e0 0x7f9ab80b0030 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9ab80ad350 tx=0x7f9ab00091d0).ready entity=mon.1 client_cookie=8e764842352d06c0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abcfa4700 1 -- 172.21.2.135:0/347864321 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab0009ea0 con 0x7f9ab81419e0 2021-11-15T14:35:00.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abcfa4700 1 -- 172.21.2.135:0/347864321 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000b860 con 0x7f9ab81419e0 2021-11-15T14:35:00.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9abcfa4700 1 -- 172.21.2.135:0/347864321 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab000b9d0 con 0x7f9ab81419e0 2021-11-15T14:35:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- 172.21.2.135:0/347864321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab81419e0 msgr2=0x7f9ab80b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 --2- 172.21.2.135:0/347864321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab81419e0 0x7f9ab80b0030 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9ab80ad350 tx=0x7f9ab00091d0).stop 2021-11-15T14:35:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- 172.21.2.135:0/347864321 shutdown_connections 2021-11-15T14:35:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 --2- 172.21.2.135:0/347864321 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab81419e0 0x7f9ab80b0030 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- 172.21.2.135:0/347864321 >> 172.21.2.135:0/347864321 conn(0x7f9ab805f730 msgr2=0x7f9ab805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- 172.21.2.135:0/347864321 shutdown_connections 2021-11-15T14:35:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.528+0000 7f9ac020a700 1 -- 172.21.2.135:0/347864321 wait complete. 2021-11-15T14:35:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 Processor -- start 2021-11-15T14:35:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- start start 2021-11-15T14:35:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ab80b1350 0x7f9ab80ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ab81419e0 0x7f9ab815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80aa6c0 con 0x7f9ab81419e0 2021-11-15T14:35:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80aa960 con 0x7f9ab80b1f40 2021-11-15T14:35:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80aac00 con 0x7f9ab80b1350 2021-11-15T14:35:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56362/0 (socket says 172.21.2.135:56362) 2021-11-15T14:35:00.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 -- 172.21.2.135:0/2936589312 learned_addr learned my addr 172.21.2.135:0/2936589312 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 -- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ab80b1350 msgr2=0x7f9ab80ad730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:35:00.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ab80b1350 0x7f9ab80ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 -- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ab81419e0 msgr2=0x7f9ab815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ab81419e0 0x7f9ab815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 -- 172.21.2.135:0/2936589312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009470 con 0x7f9ab80b1f40 2021-11-15T14:35:00.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abd7a5700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9ab4002f90 tx=0x7f9ab4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab4013460 con 0x7f9ab80b1f40 2021-11-15T14:35:00.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40135c0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80aaea0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab8142ef0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab4013920 con 0x7f9ab80b1f40 2021-11-15T14:35:00.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab80ab030 con 0x7f9ab80b1f40 2021-11-15T14:35:00.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ab401a060 con 0x7f9ab80b1f40 2021-11-15T14:35:00.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 0x7f9a98055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9ab406b3e0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.532+0000 7f9abdfa6700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 0x7f9a98055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.536+0000 7f9abdfa6700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 0x7f9a98055a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9ab80b2fd0 tx=0x7f9aac007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.536+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ab40422e0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.616+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ab80573d0 con 0x7f9ab80b1f40 2021-11-15T14:35:00.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.616+0000 7f9aaaffd700 1 -- 172.21.2.135:0/2936589312 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9ab4018020 con 0x7f9ab80b1f40 2021-11-15T14:35:00.623 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:35:00.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 msgr2=0x7f9a98055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 0x7f9a98055a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9ab80b2fd0 tx=0x7f9aac007800).stop 2021-11-15T14:35:00.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 msgr2=0x7f9ab815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9ab4002f90 tx=0x7f9ab4006df0).stop 2021-11-15T14:35:00.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 shutdown_connections 2021-11-15T14:35:00.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9a98053580 0x7f9a98055a40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ab81419e0 0x7f9ab815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ab80b1f40 0x7f9ab815a360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 --2- 172.21.2.135:0/2936589312 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ab80b1350 0x7f9ab80ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 >> 172.21.2.135:0/2936589312 conn(0x7f9ab805f730 msgr2=0x7f9ab8145770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 shutdown_connections 2021-11-15T14:35:00.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.620+0000 7f9ac020a700 1 -- 172.21.2.135:0/2936589312 wait complete. 2021-11-15T14:35:00.630 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:35:00.631 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:35:00.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 Processor -- start 2021-11-15T14:35:00.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 -- start start 2021-11-15T14:35:00.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f36b4148420 0x7f36b40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40b03d0 con 0x7f36b40b1e30 2021-11-15T14:35:00.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40a9140 con 0x7f36b4148420 2021-11-15T14:35:00.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b8f1f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40b0670 con 0x7f36b40a7140 2021-11-15T14:35:00.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f36b40b1e30 0x7f36b40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43956/0 (socket says 172.21.2.135:43956) 2021-11-15T14:35:00.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b259c700 1 -- 172.21.2.135:0/1171389087 learned_addr learned my addr 172.21.2.135:0/1171389087 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:00.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 --2- 172.21.2.135:0/1171389087 >> v2:172.21.2.135:3300/0 conn(0x7f36b4148420 0x7f36b40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 -- 172.21.2.135:0/1171389087 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 msgr2=0x7f36b41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:00.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 --2- 172.21.2.135:0/1171389087 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 -- 172.21.2.135:0/1171389087 >> v1:172.21.2.135:6789/0 conn(0x7f36b40b1e30 legacy=0x7f36b40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 -- 172.21.2.135:0/1171389087 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40b0910 con 0x7f36b4148420 2021-11-15T14:35:00.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b1d9b700 1 --2- 172.21.2.135:0/1171389087 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b40b1050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f36b41477b0 tx=0x7f369c006df0).ready entity=mon.1 client_cookie=8998f3bb0af17dbd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b159a700 1 -- 172.21.2.135:0/1171389087 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c00d570 con 0x7f36b4148420 2021-11-15T14:35:00.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b159a700 1 -- 172.21.2.135:0/1171389087 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c000e90 con 0x7f36b4148420 2021-11-15T14:35:00.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.676+0000 7f36b159a700 1 -- 172.21.2.135:0/1171389087 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c00d8c0 con 0x7f36b4148420 2021-11-15T14:35:00.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1171389087 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 msgr2=0x7f36b40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1171389087 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b40b1050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f36b41477b0 tx=0x7f369c006df0).stop 2021-11-15T14:35:00.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1171389087 shutdown_connections 2021-11-15T14:35:00.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1171389087 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b40b1050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1171389087 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1171389087 >> 172.21.2.135:0/1171389087 conn(0x7f36b405f730 msgr2=0x7f36b405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1171389087 shutdown_connections 2021-11-15T14:35:00.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1171389087 wait complete. 2021-11-15T14:35:00.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 Processor -- start 2021-11-15T14:35:00.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- start start 2021-11-15T14:35:00.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b40a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36b40b1e30 0x7f36b40aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40adf20 con 0x7f36b40b1e30 2021-11-15T14:35:00.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40ad360 con 0x7f36b4148420 2021-11-15T14:35:00.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40ae150 con 0x7f36b40a7140 2021-11-15T14:35:00.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56378/0 (socket says 172.21.2.135:56378) 2021-11-15T14:35:00.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 -- 172.21.2.135:0/1450650162 learned_addr learned my addr 172.21.2.135:0/1450650162 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:00.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 -- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 msgr2=0x7f36b40a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b40a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 -- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36b40b1e30 msgr2=0x7f36b40aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36b40b1e30 0x7f36b40aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 -- 172.21.2.135:0/1450650162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c00b180 con 0x7f36b4148420 2021-11-15T14:35:00.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b2d9d700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f36b414a960 tx=0x7f36ac0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ac00d4a0 con 0x7f36b4148420 2021-11-15T14:35:00.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00d600 con 0x7f36b4148420 2021-11-15T14:35:00.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ac00d960 con 0x7f36b4148420 2021-11-15T14:35:00.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b40ad5c0 con 0x7f36b4148420 2021-11-15T14:35:00.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40ac510 con 0x7f36b4148420 2021-11-15T14:35:00.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b40ab810 con 0x7f36b4148420 2021-11-15T14:35:00.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f36ac018030 con 0x7f36b4148420 2021-11-15T14:35:00.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 0x7f3698055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:00.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f36ac06b3b0 con 0x7f36b4148420 2021-11-15T14:35:00.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.680+0000 7f36b259c700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 0x7f3698055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:00.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.684+0000 7f36b259c700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 0x7f3698055b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f36b40b31f0 tx=0x7f36a4007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:00.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.684+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f36ac042470 con 0x7f36b4148420 2021-11-15T14:35:00.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36b40b0af0 con 0x7f36b4148420 2021-11-15T14:35:00.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36ab7fe700 1 -- 172.21.2.135:0/1450650162 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f36ac045a90 con 0x7f36b4148420 2021-11-15T14:35:00.797 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:35:00.797 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:35:00.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 msgr2=0x7f3698055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 0x7f3698055b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f36b40b31f0 tx=0x7f36a4007800).stop 2021-11-15T14:35:00.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 msgr2=0x7f36b41438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:00.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f36b414a960 tx=0x7f36ac0091a0).stop 2021-11-15T14:35:00.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 shutdown_connections 2021-11-15T14:35:00.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f36980536a0 0x7f3698055b60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f36b4148420 0x7f36b41438c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:00.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f36b40b1e30 0x7f36b40aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 --2- 172.21.2.135:0/1450650162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f36b40a7140 0x7f36b40a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:00.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 >> 172.21.2.135:0/1450650162 conn(0x7f36b405f730 msgr2=0x7f36b40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:00.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 shutdown_connections 2021-11-15T14:35:00.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:00.792+0000 7f36b8f1f700 1 -- 172.21.2.135:0/1450650162 wait complete. 2021-11-15T14:35:00.802 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:35:01.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:34:57.052244+0000', 'modified': '2021-11-15T14:34:58.540494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4861': {'gid': 4861, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/1684531282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 1684531282}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 1684531282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:35:01.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:35:01.110 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:35:01.194 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":4861,"want_state":"up:active","state":"up:active","rank_uptime":4.1329351489999997,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":35,"uptime":9.3164284810000009} 2021-11-15T14:35:01.195 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 4861, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 35, "rank_uptime": 4.132935149, "state": "up:active", "uptime": 9.316428481, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:35:01.195 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:35:01.196 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:35:01.196 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:35:01.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:01.197 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:35:01.213 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:35:01.275 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:35:01.276 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:35:01.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:35:01.291 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:35:01.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:01.292 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:35:01.348 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:35:01.349 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:35:01.394 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:35:01.406 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:35:01.407 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:35:01.414 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:35:01.415 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:35:01.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:01.416 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:35:01.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14039]: starting ceph client 2021-11-15T14:35:01.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:35:01.433+0000 7f1355ffd080 -1 init, newargv = 0x5586400ab930 newargc=9 2021-11-15T14:35:01.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14039]: starting fuse 2021-11-15T14:35:02.542 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:35:02.555 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:35:02.555 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:35:02.561 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:35:02.562 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:35:02.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.564 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:35:02.567 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:35:02.568 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:35:02.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.569 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:35:02.569 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:35:02.569 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:35:02.570 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:35:02.570 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:35:02.571 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.571 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:35:02.572 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:35:02.572 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:35:02.572 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.573 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:35:02.573 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:35:02.574 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:35:02.574 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:35:02.574 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.575 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:35:02.575 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:35:02.576 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:35:02.576 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:35:02.577 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:35:02.577 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.577 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:35:02.578 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:35:02.633 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14039.asok 2021-11-15T14:35:02.635 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14039.asok 2021-11-15T14:35:02.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.637 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14039.asok status 2021-11-15T14:35:02.684 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:35:02.684 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:35:02.685 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:35:02.685 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:35:02.685 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:35:02.685 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:35:02.686 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:35:02.686 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14039", 2021-11-15T14:35:02.686 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:35:02.686 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:35:02.687 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:35:02.687 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:35:02.687 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5056, 2021-11-15T14:35:02.687 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:35:02.688 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:35:02.688 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:35:02.688 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5056 2021-11-15T14:35:02.688 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:35:02.689 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:35:02.689 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:35:02.689 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:35:02.689 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3114478371 2021-11-15T14:35:02.690 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:35:02.690 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:35:02.690 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:35:02.690 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:35:02.690 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:35:02.691 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3114478371 2021-11-15T14:35:02.691 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:35:02.691 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5056 172.21.2.138:0/3114478371", 2021-11-15T14:35:02.691 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/3114478371", 2021-11-15T14:35:02.692 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:35:02.692 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 13, 2021-11-15T14:35:02.692 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 36, 2021-11-15T14:35:02.692 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:35:02.693 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:35:02.693 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:35:02.693 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:35:02.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.695 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:35:02.696 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:35:02.701 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:35:02.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:35:02.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.703 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:35:02.755 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-11-15T14:35:02.813 INFO:teuthology.orchestra.run.gibba035.stdout:{"mds_min_caps_per_client":"100"} 2021-11-15T14:35:02.813 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-11-15T14:35:02.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:35:02.814 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:35:02.814 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:35:02.825 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:35:02.827 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:35:02.827 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:35:02.828 DEBUG:teuthology.orchestra.run.gibba038:> import sys 2021-11-15T14:35:02.828 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:35:02.828 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:35:02.829 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.829 DEBUG:teuthology.orchestra.run.gibba038:> n = 1000 2021-11-15T14:35:02.830 DEBUG:teuthology.orchestra.run.gibba038:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T14:35:02.830 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.830 DEBUG:teuthology.orchestra.run.gibba038:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T14:35:02.831 DEBUG:teuthology.orchestra.run.gibba038:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T14:35:02.831 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:35:02.832 DEBUG:teuthology.orchestra.run.gibba038:> for i in range(0, n): 2021-11-15T14:35:02.832 DEBUG:teuthology.orchestra.run.gibba038:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T14:35:02.832 DEBUG:teuthology.orchestra.run.gibba038:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T14:35:02.833 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:35:02.833 DEBUG:teuthology.orchestra.run.gibba038:> if True: 2021-11-15T14:35:02.833 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:35:02.834 DEBUG:teuthology.orchestra.run.gibba038:> os.fsync(f.fileno()) 2021-11-15T14:35:02.834 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:35:11.318 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:11.322 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:11.325 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:11.328 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:20.350 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:35:20.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.456+0000 7fd8cf87b700 1 Processor -- start 2021-11-15T14:35:20.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.456+0000 7fd8cf87b700 1 -- start start 2021-11-15T14:35:20.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 0x7fd8c81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c80b03d0 con 0x7fd8c8148420 2021-11-15T14:35:20.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c80b0670 con 0x7fd8c80b1e30 2021-11-15T14:35:20.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80a9140 con 0x7fd8c80b1050 2021-11-15T14:35:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cd617700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd8c80b1e30 0x7fd8c80b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:43970/0 (socket says 172.21.2.135:43970) 2021-11-15T14:35:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cd617700 1 -- 172.21.2.135:0/2592561639 learned_addr learned my addr 172.21.2.135:0/2592561639 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033967802 0 0) 0x7fd8c80b0670 con 0x7fd8c80b1e30 2021-11-15T14:35:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b0003260 con 0x7fd8c80b1e30 2021-11-15T14:35:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586986700 0 0) 0x7fd8b0003260 con 0x7fd8c80b1e30 2021-11-15T14:35:20.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 msgr2=0x7fd8c81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 0x7fd8c81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 >> v1:172.21.2.119:6789/0 conn(0x7fd8c8148420 legacy=0x7fd8c80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80b0910 con 0x7fd8c80b1e30 2021-11-15T14:35:20.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd8c4001660 con 0x7fd8c80b1e30 2021-11-15T14:35:20.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 >> v1:172.21.2.135:6789/0 conn(0x7fd8c80b1e30 legacy=0x7fd8c80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 0x7fd8b0003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8b0003ef0 0x7fd8b0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8b0004bf0 0x7fd8b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00052c0 con 0x7fd8b0004bf0 2021-11-15T14:35:20.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b000bc40 con 0x7fd8b0003ef0 2021-11-15T14:35:20.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b000bd80 con 0x7fd8c80b1050 2021-11-15T14:35:20.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8b0003ef0 0x7fd8b0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 -- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 msgr2=0x7fd8b0003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8c80b1050 0x7fd8b0003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 -- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8b0004bf0 msgr2=0x7fd8b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8b0004bf0 0x7fd8b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 -- 172.21.2.135:0/2592561639 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0003260 con 0x7fd8b0003ef0 2021-11-15T14:35:20.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cce16700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8b0003ef0 0x7fd8b0004500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd8bc000f70 tx=0x7fd8bc0079e0).ready entity=mon.1 client_cookie=a3ffce164e6989c5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc007cf0 con 0x7fd8b0003ef0 2021-11-15T14:35:20.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc001d40 con 0x7fd8b0003ef0 2021-11-15T14:35:20.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8bbfff700 1 -- 172.21.2.135:0/2592561639 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc014600 con 0x7fd8b0003ef0 2021-11-15T14:35:20.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- 172.21.2.135:0/2592561639 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8b0003ef0 msgr2=0x7fd8b0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/2592561639 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8b0003ef0 0x7fd8b0004500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd8bc000f70 tx=0x7fd8bc0079e0).stop 2021-11-15T14:35:20.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cde18700 1 -- 172.21.2.135:0/2592561639 reap_dead start 2021-11-15T14:35:20.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- 172.21.2.135:0/2592561639 shutdown_connections 2021-11-15T14:35:20.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- 172.21.2.135:0/2592561639 >> 172.21.2.135:0/2592561639 conn(0x7fd8c805f730 msgr2=0x7fd8c805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:20.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- 172.21.2.135:0/2592561639 shutdown_connections 2021-11-15T14:35:20.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- 172.21.2.135:0/2592561639 wait complete. 2021-11-15T14:35:20.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 Processor -- start 2021-11-15T14:35:20.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.460+0000 7fd8cf87b700 1 -- start start 2021-11-15T14:35:20.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 0x7fd8c813cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8c80af7a0 0x7fd8c8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8146d50 con 0x7fd8c80af7a0 2021-11-15T14:35:20.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8141db0 con 0x7fd8c8141580 2021-11-15T14:35:20.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8141b50 con 0x7fd8b0003ef0 2021-11-15T14:35:20.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56398/0 (socket says 172.21.2.135:56398) 2021-11-15T14:35:20.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 -- 172.21.2.135:0/4227544709 learned_addr learned my addr 172.21.2.135:0/4227544709 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:20.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cd617700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 0x7fd8c813cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cde18700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8c80af7a0 0x7fd8c8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 -- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 msgr2=0x7fd8c813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 0x7fd8c813cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 -- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8c80af7a0 msgr2=0x7fd8c8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8c80af7a0 0x7fd8c8156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 -- 172.21.2.135:0/4227544709 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c81460d0 con 0x7fd8c8141580 2021-11-15T14:35:20.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cd617700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 0x7fd8c813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:35:20.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cce16700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fd8bc000f70 tx=0x7fd8bc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc0137c0 con 0x7fd8c8141580 2021-11-15T14:35:20.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc013920 con 0x7fd8c8141580 2021-11-15T14:35:20.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c80afc20 con 0x7fd8c8141580 2021-11-15T14:35:20.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc013c80 con 0x7fd8c8141580 2021-11-15T14:35:20.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c81429a0 con 0x7fd8c8141580 2021-11-15T14:35:20.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c80573d0 con 0x7fd8c8141580 2021-11-15T14:35:20.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8bc022470 con 0x7fd8c8141580 2021-11-15T14:35:20.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd8bc01c040 con 0x7fd8c8141580 2021-11-15T14:35:20.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.464+0000 7fd8cd617700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.468+0000 7fd8cd617700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 0x7fd8a8055b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd8c4008000 tx=0x7fd8c4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.468+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8bc043f60 con 0x7fd8c8141580 2021-11-15T14:35:20.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8c80446d0 con 0x7fd8c8141580 2021-11-15T14:35:20.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8ba7fc700 1 -- 172.21.2.135:0/4227544709 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7fd8bc047540 con 0x7fd8c8141580 2021-11-15T14:35:20.581 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:35:20.582 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:35:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 msgr2=0x7fd8a8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 0x7fd8a8055b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd8c4008000 tx=0x7fd8c4009040).stop 2021-11-15T14:35:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 msgr2=0x7fd8c80af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fd8bc000f70 tx=0x7fd8bc015000).stop 2021-11-15T14:35:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 shutdown_connections 2021-11-15T14:35:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8c80af7a0 0x7fd8c8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8c8141580 0x7fd8c80af2b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 --2- 172.21.2.135:0/4227544709 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8b0003ef0 0x7fd8c813cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 >> 172.21.2.135:0/4227544709 conn(0x7fd8c805f730 msgr2=0x7fd8c80b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:20.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 shutdown_connections 2021-11-15T14:35:20.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.576+0000 7fd8cf87b700 1 -- 172.21.2.135:0/4227544709 wait complete. 2021-11-15T14:35:20.585 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:35:20.588 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T14:35:20.646 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T14:35:20.646 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T14:35:20.647 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:35:20.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 Processor -- start 2021-11-15T14:35:20.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 -- start start 2021-11-15T14:35:20.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f09400b1e30 0x7f09400b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f09400a7140 0x7f09401447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09400b03d0 con 0x7f0940148420 2021-11-15T14:35:20.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400a9140 con 0x7f09400b1e30 2021-11-15T14:35:20.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f0945c66700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400b0670 con 0x7f09400a7140 2021-11-15T14:35:20.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f09400a7140 0x7f09401447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f09400a7140 0x7f09401447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56406/0 (socket says 172.21.2.135:56406) 2021-11-15T14:35:20.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 -- 172.21.2.135:0/2183010404 learned_addr learned my addr 172.21.2.135:0/2183010404 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:20.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093f7fe700 1 --2- 172.21.2.135:0/2183010404 >> v2:172.21.2.119:3300/0 conn(0x7f09400b1e30 0x7f09400b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 -- 172.21.2.135:0/2183010404 >> v2:172.21.2.119:3300/0 conn(0x7f09400b1e30 msgr2=0x7f09400b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 --2- 172.21.2.135:0/2183010404 >> v2:172.21.2.119:3300/0 conn(0x7f09400b1e30 0x7f09400b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 -- 172.21.2.135:0/2183010404 >> v1:172.21.2.135:6789/0 conn(0x7f0940148420 legacy=0x7f09400b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 -- 172.21.2.135:0/2183010404 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400b0910 con 0x7f09400a7140 2021-11-15T14:35:20.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093ffff700 1 --2- 172.21.2.135:0/2183010404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09400a7140 0x7f09401447a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f09401477b0 tx=0x7f0930006eb0).ready entity=mon.1 client_cookie=698a52d5ca60e6b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093e7fc700 1 -- 172.21.2.135:0/2183010404 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093000d610 con 0x7f09400a7140 2021-11-15T14:35:20.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093e7fc700 1 -- 172.21.2.135:0/2183010404 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0930000e90 con 0x7f09400a7140 2021-11-15T14:35:20.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.692+0000 7f093e7fc700 1 -- 172.21.2.135:0/2183010404 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093000d960 con 0x7f09400a7140 2021-11-15T14:35:20.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2183010404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09400a7140 msgr2=0x7f09401447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- 172.21.2.135:0/2183010404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09400a7140 0x7f09401447a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f09401477b0 tx=0x7f0930006eb0).stop 2021-11-15T14:35:20.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2183010404 shutdown_connections 2021-11-15T14:35:20.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- 172.21.2.135:0/2183010404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09400a7140 0x7f09401447a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- 172.21.2.135:0/2183010404 >> v2:172.21.2.119:3300/0 conn(0x7f09400b1e30 0x7f09400b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2183010404 >> 172.21.2.135:0/2183010404 conn(0x7f094005f730 msgr2=0x7f094005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:20.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2183010404 shutdown_connections 2021-11-15T14:35:20.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2183010404 wait complete. 2021-11-15T14:35:20.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 Processor -- start 2021-11-15T14:35:20.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- start start 2021-11-15T14:35:20.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09400a7140 0x7f09400af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09400b1e30 0x7f09400a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400ac500 con 0x7f09400b1e30 2021-11-15T14:35:20.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094015a270 con 0x7f0940148420 2021-11-15T14:35:20.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094015a510 con 0x7f09400a7140 2021-11-15T14:35:20.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56410/0 (socket says 172.21.2.135:56410) 2021-11-15T14:35:20.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 -- 172.21.2.135:0/2439321783 learned_addr learned my addr 172.21.2.135:0/2439321783 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:20.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093effd700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09400b1e30 0x7f09400a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093f7fe700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09400a7140 0x7f09400af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 -- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09400a7140 msgr2=0x7f09400af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09400a7140 0x7f09400af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 -- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09400b1e30 msgr2=0x7f09400a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09400b1e30 0x7f09400a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 -- 172.21.2.135:0/2439321783 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093000b1e0 con 0x7f0940148420 2021-11-15T14:35:20.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093ffff700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f09401477b0 tx=0x7f0930015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0930011860 con 0x7f0940148420 2021-11-15T14:35:20.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09300119c0 con 0x7f0940148420 2021-11-15T14:35:20.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094015a7b0 con 0x7f0940148420 2021-11-15T14:35:20.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094015aef0 con 0x7f0940148420 2021-11-15T14:35:20.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0930011d20 con 0x7f0940148420 2021-11-15T14:35:20.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09400af270 con 0x7f0940148420 2021-11-15T14:35:20.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0930025030 con 0x7f0940148420 2021-11-15T14:35:20.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 0x7f0924055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.696+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f093006ccd0 con 0x7f0940148420 2021-11-15T14:35:20.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.700+0000 7f093f7fe700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 0x7f0924055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.700+0000 7f093f7fe700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 0x7f0924055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f093800d000 tx=0x7f0938008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.700+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09400af270 con 0x7f0940148420 2021-11-15T14:35:20.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.812+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09400af270 con 0x7f0940148420 2021-11-15T14:35:20.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.812+0000 7f093cff9700 1 -- 172.21.2.135:0/2439321783 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f09400af270 con 0x7f0940148420 2021-11-15T14:35:20.819 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:35:20.819 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:35:20.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 msgr2=0x7f0924055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 0x7f0924055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f093800d000 tx=0x7f0938008040).stop 2021-11-15T14:35:20.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 msgr2=0x7f0940156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f09401477b0 tx=0x7f0930015000).stop 2021-11-15T14:35:20.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 shutdown_connections 2021-11-15T14:35:20.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0924053610 0x7f0924055ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0940148420 0x7f0940156b20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09400b1e30 0x7f09400a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 --2- 172.21.2.135:0/2439321783 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09400a7140 0x7f09400af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 >> 172.21.2.135:0/2439321783 conn(0x7f094005f730 msgr2=0x7f0940144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:20.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 shutdown_connections 2021-11-15T14:35:20.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.816+0000 7f0945c66700 1 -- 172.21.2.135:0/2439321783 wait complete. 2021-11-15T14:35:20.823 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:35:20.826 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T14:35:20.885 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T14:35:20.886 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T14:35:20.886 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:35:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 Processor -- start 2021-11-15T14:35:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- start start 2021-11-15T14:35:20.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f15d40b1e30 0x7f15d40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15d4148420 0x7f15d40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40b03d0 con 0x7f15d40a7140 2021-11-15T14:35:20.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40a9140 con 0x7f15d40b1e30 2021-11-15T14:35:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40b0670 con 0x7f15d4148420 2021-11-15T14:35:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15d4148420 0x7f15d40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f15d40a7140 0x7f15d41447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44008/0 (socket says 172.21.2.135:44008) 2021-11-15T14:35:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d37fe700 1 -- 172.21.2.135:0/1472394778 learned_addr learned my addr 172.21.2.135:0/1472394778 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 -- 172.21.2.135:0/1472394778 >> v2:172.21.2.119:3300/0 conn(0x7f15d40b1e30 msgr2=0x7f15d40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 --2- 172.21.2.135:0/1472394778 >> v2:172.21.2.119:3300/0 conn(0x7f15d40b1e30 0x7f15d40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 -- 172.21.2.135:0/1472394778 >> v1:172.21.2.135:6789/0 conn(0x7f15d40a7140 legacy=0x7f15d41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 -- 172.21.2.135:0/1472394778 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40b0910 con 0x7f15d4148420 2021-11-15T14:35:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d27fc700 1 --2- 172.21.2.135:0/1472394778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d4148420 0x7f15d40b2210 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f15cc001490 tx=0x7f15c4006df0).ready entity=mon.1 client_cookie=ab0b78a7d011538e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d1ffb700 1 -- 172.21.2.135:0/1472394778 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c400d4a0 con 0x7f15d4148420 2021-11-15T14:35:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d1ffb700 1 -- 172.21.2.135:0/1472394778 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4000e90 con 0x7f15d4148420 2021-11-15T14:35:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d1ffb700 1 -- 172.21.2.135:0/1472394778 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c400d7f0 con 0x7f15d4148420 2021-11-15T14:35:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- 172.21.2.135:0/1472394778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d4148420 msgr2=0x7f15d40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 --2- 172.21.2.135:0/1472394778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d4148420 0x7f15d40b2210 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f15cc001490 tx=0x7f15c4006df0).stop 2021-11-15T14:35:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- 172.21.2.135:0/1472394778 shutdown_connections 2021-11-15T14:35:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 --2- 172.21.2.135:0/1472394778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d4148420 0x7f15d40b2210 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 --2- 172.21.2.135:0/1472394778 >> v2:172.21.2.119:3300/0 conn(0x7f15d40b1e30 0x7f15d40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- 172.21.2.135:0/1472394778 >> 172.21.2.135:0/1472394778 conn(0x7f15d405f730 msgr2=0x7f15d405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- 172.21.2.135:0/1472394778 shutdown_connections 2021-11-15T14:35:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.932+0000 7f15d994d700 1 -- 172.21.2.135:0/1472394778 wait complete. 2021-11-15T14:35:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 Processor -- start 2021-11-15T14:35:20.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- start start 2021-11-15T14:35:20.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15d40a7140 0x7f15d40af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15d4148420 0x7f15d40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40ab130 con 0x7f15d4148420 2021-11-15T14:35:20.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40a9eb0 con 0x7f15d40b1e30 2021-11-15T14:35:20.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d414ba80 con 0x7f15d40a7140 2021-11-15T14:35:20.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56426/0 (socket says 172.21.2.135:56426) 2021-11-15T14:35:20.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 -- 172.21.2.135:0/108447741 learned_addr learned my addr 172.21.2.135:0/108447741 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:20.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 -- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15d40a7140 msgr2=0x7f15d40af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15d40a7140 0x7f15d40af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 -- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15d4148420 msgr2=0x7f15d40abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:20.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15d4148420 0x7f15d40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:20.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 -- 172.21.2.135:0/108447741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c400b180 con 0x7f15d40b1e30 2021-11-15T14:35:20.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d27fc700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f15cc001490 tx=0x7f15c4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c4016070 con 0x7f15d40b1e30 2021-11-15T14:35:20.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c40067c0 con 0x7f15d40b1e30 2021-11-15T14:35:20.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c4013b60 con 0x7f15d40b1e30 2021-11-15T14:35:20.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d40ab390 con 0x7f15d40b1e30 2021-11-15T14:35:20.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d414a6b0 con 0x7f15d40b1e30 2021-11-15T14:35:20.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d40b0bb0 con 0x7f15d40b1e30 2021-11-15T14:35:20.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f15c4025030 con 0x7f15d40b1e30 2021-11-15T14:35:20.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 0x7f15b8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:20.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f15c406cbf0 con 0x7f15d40b1e30 2021-11-15T14:35:20.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.936+0000 7f15d2ffd700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 0x7f15b8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:20.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.940+0000 7f15d2ffd700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 0x7f15b8055be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f15bc002f70 tx=0x7f15bc006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:20.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:20.940+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15c4043b30 con 0x7f15d40b1e30 2021-11-15T14:35:21.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.048+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15d40573d0 con 0x7f15d40b1e30 2021-11-15T14:35:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.048+0000 7f15cbfff700 1 -- 172.21.2.135:0/108447741 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f15c4023020 con 0x7f15d40b1e30 2021-11-15T14:35:21.055 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:35:21.055 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:35:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 msgr2=0x7f15b8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 0x7f15b8055be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f15bc002f70 tx=0x7f15bc006a80).stop 2021-11-15T14:35:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 msgr2=0x7f15d40abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f15cc001490 tx=0x7f15c4014000).stop 2021-11-15T14:35:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 shutdown_connections 2021-11-15T14:35:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15b8053720 0x7f15b8055be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15d4148420 0x7f15d40abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15d40b1e30 0x7f15d40abad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 --2- 172.21.2.135:0/108447741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15d40a7140 0x7f15d40af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 >> 172.21.2.135:0/108447741 conn(0x7f15d405f730 msgr2=0x7f15d40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:21.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 shutdown_connections 2021-11-15T14:35:21.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.052+0000 7f15d994d700 1 -- 172.21.2.135:0/108447741 wait complete. 2021-11-15T14:35:21.060 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:35:21.063 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-11-15T14:35:21.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 Processor -- start 2021-11-15T14:35:21.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 -- start start 2021-11-15T14:35:21.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 0x7fa1501402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa1500b4200 0x7fa1501407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa150143be0 con 0x7fa1500b4710 2021-11-15T14:35:21.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa150147590 con 0x7fa1500b4200 2021-11-15T14:35:21.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.108+0000 7fa15830d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150143e80 con 0x7fa1501469d0 2021-11-15T14:35:21.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1568aa700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa1500b4710 0x7fa1500b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53436/0 (socket says 172.21.2.135:53436) 2021-11-15T14:35:21.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1568aa700 1 -- 172.21.2.135:0/2723431045 learned_addr learned my addr 172.21.2.135:0/2723431045 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:35:21.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2723431045 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 0x7fa1501402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1558a8700 1 --2- 172.21.2.135:0/2723431045 >> v2:172.21.2.119:3300/0 conn(0x7fa1500b4200 0x7fa1501407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 -- 172.21.2.135:0/2723431045 >> v2:172.21.2.119:3300/0 conn(0x7fa1500b4200 msgr2=0x7fa1501407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2723431045 >> v2:172.21.2.119:3300/0 conn(0x7fa1500b4200 0x7fa1501407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 -- 172.21.2.135:0/2723431045 >> v1:172.21.2.119:6789/0 conn(0x7fa1500b4710 legacy=0x7fa1500b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 -- 172.21.2.135:0/2723431045 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500b0d10 con 0x7fa1501469d0 2021-11-15T14:35:21.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2723431045 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 0x7fa1501402b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa14c002f70 tx=0x7fa14c006df0).ready entity=mon.2 client_cookie=41453926ca42822d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1550a7700 1 -- 172.21.2.135:0/2723431045 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c00d570 con 0x7fa1501469d0 2021-11-15T14:35:21.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1550a7700 1 -- 172.21.2.135:0/2723431045 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c000e90 con 0x7fa1501469d0 2021-11-15T14:35:21.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa1550a7700 1 -- 172.21.2.135:0/2723431045 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c00d8c0 con 0x7fa1501469d0 2021-11-15T14:35:21.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- 172.21.2.135:0/2723431045 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 msgr2=0x7fa1501402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 --2- 172.21.2.135:0/2723431045 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 0x7fa1501402b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa14c002f70 tx=0x7fa14c006df0).stop 2021-11-15T14:35:21.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- 172.21.2.135:0/2723431045 shutdown_connections 2021-11-15T14:35:21.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 --2- 172.21.2.135:0/2723431045 >> v2:172.21.2.119:3300/0 conn(0x7fa1500b4200 0x7fa1501407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 --2- 172.21.2.135:0/2723431045 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1501469d0 0x7fa1501402b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- 172.21.2.135:0/2723431045 >> 172.21.2.135:0/2723431045 conn(0x7fa15005c510 msgr2=0x7fa15005c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:21.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- 172.21.2.135:0/2723431045 shutdown_connections 2021-11-15T14:35:21.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- 172.21.2.135:0/2723431045 wait complete. 2021-11-15T14:35:21.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 Processor -- start 2021-11-15T14:35:21.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.112+0000 7fa15830d700 1 -- start start 2021-11-15T14:35:21.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 0x7fa150114d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1500b4710 0x7fa150143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150114610 con 0x7fa1500b4710 2021-11-15T14:35:21.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501131b0 con 0x7fa1501469d0 2021-11-15T14:35:21.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500b06a0 con 0x7fa1500b4200 2021-11-15T14:35:21.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56438/0 (socket says 172.21.2.135:56438) 2021-11-15T14:35:21.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2027103839 learned_addr learned my addr 172.21.2.135:0/2027103839 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:21.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 0x7fa150114d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 msgr2=0x7fa150114d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1558a8700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1500b4710 0x7fa150143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 0x7fa150114d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1500b4710 msgr2=0x7fa150143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1500b4710 0x7fa150143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2027103839 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c00b180 con 0x7fa1501469d0 2021-11-15T14:35:21.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 0x7fa150114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:35:21.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa150060cd0 tx=0x7fa148007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 -- 172.21.2.135:0/2027103839 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148005ba0 con 0x7fa1501469d0 2021-11-15T14:35:21.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 -- 172.21.2.135:0/2027103839 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148005d00 con 0x7fa1501469d0 2021-11-15T14:35:21.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150112f10 con 0x7fa1501469d0 2021-11-15T14:35:21.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 -- 172.21.2.135:0/2027103839 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1480072c0 con 0x7fa1501469d0 2021-11-15T14:35:21.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500af420 con 0x7fa1501469d0 2021-11-15T14:35:21.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 -- 172.21.2.135:0/2027103839 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa14801a060 con 0x7fa1501469d0 2021-11-15T14:35:21.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 0x7fa130055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa13f7fe700 1 -- 172.21.2.135:0/2027103839 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa14806b580 con 0x7fa1501469d0 2021-11-15T14:35:21.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 Processor -- start 2021-11-15T14:35:21.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 0x7fa130055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 -- start start 2021-11-15T14:35:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x21dfec0 0x22162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2212ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x213cd50 con 0x22167c0 2021-11-15T14:35:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x21504b0 con 0x2216c40 2021-11-15T14:35:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x2130c20 con 0x21dfec0 2021-11-15T14:35:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56446/0 (socket says 172.21.2.135:56446) 2021-11-15T14:35:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2891432896 learned_addr learned my addr 172.21.2.135:0/2891432896 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x21dfec0 msgr2=0x22162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x21dfec0 0x22162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 msgr2=0x2212ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2212ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 -- 172.21.2.135:0/2891432896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2188cb0 con 0x2216c40 2021-11-15T14:35:21.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x2157360 tx=0x7fa148010000).ready entity=mon.1 client_cookie=ba84dd30e79acfad server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- 172.21.2.135:0/2891432896 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14804c070 con 0x2216c40 2021-11-15T14:35:21.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa1560a9700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 0x7fa130055a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa14c00bea0 tx=0x7fa14c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- 172.21.2.135:0/2891432896 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14806b110 con 0x2216c40 2021-11-15T14:35:21.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.116+0000 7fa15830d700 1 -- 172.21.2.135:0/2891432896 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148042040 con 0x2216c40 2021-11-15T14:35:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/2891432896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 msgr2=0x2212fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x2157360 tx=0x7fa148010000).stop 2021-11-15T14:35:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/2891432896 shutdown_connections 2021-11-15T14:35:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2212fc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2212ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- 172.21.2.135:0/2891432896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x21dfec0 0x22162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/2891432896 >> 172.21.2.135:0/2891432896 conn(0x21dd630 msgr2=0x21de2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/2891432896 shutdown_connections 2021-11-15T14:35:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/2891432896 wait complete. 2021-11-15T14:35:21.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- start start 2021-11-15T14:35:21.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 Processor -- start 2021-11-15T14:35:21.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x22286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x2218e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x21d7e60 con 0x22167c0 2021-11-15T14:35:21.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x22290b0 con 0x2216c40 2021-11-15T14:35:21.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x22121d0 con 0x2218980 2021-11-15T14:35:21.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 10 client.0 ll_register_callbacks cb 0x21442a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:35:21.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56454/0 (socket says 172.21.2.135:56454) 2021-11-15T14:35:21.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 -- 172.21.2.135:0/3073789510 learned_addr learned my addr 172.21.2.135:0/3073789510 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:21.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1568aa700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x2218e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 -- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 msgr2=0x2218e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x2218e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 -- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 msgr2=0x22286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x22286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 -- 172.21.2.135:0/3073789510 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500af420 con 0x2216c40 2021-11-15T14:35:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1558a8700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fa14000b000 tx=0x7fa140008040).ready entity=mon.1 client_cookie=9359f0271de5c2f6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:35:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14000fe60 con 0x2216c40 2021-11-15T14:35:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa140013400 con 0x2216c40 2021-11-15T14:35:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2146570 con 0x2216c40 2021-11-15T14:35:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1400135c0 con 0x2216c40 2021-11-15T14:35:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 10 client.5089 fetch_fsmap learned FSMap version 13 2021-11-15T14:35:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x213fe50 con 0x2216c40 2021-11-15T14:35:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2146570 con 0x2216c40 2021-11-15T14:35:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa14001b350 con 0x2216c40 2021-11-15T14:35:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 10 client.5089 fetch_fsmap finished waiting for FSMap version 13 2021-11-15T14:35:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 10 client.5089 resolve_mds: resolved ID 'a' to GID 4861 2021-11-15T14:35:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 20 client.5089 populate_metadata read hostname 'gibba035' 2021-11-15T14:35:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2210070 0x2210450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 4 client.5089 mds_command: new command op to 4861 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T14:35:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 --> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x213e8e0 con 0x2210070 2021-11-15T14:35:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1560a9700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2210070 0x2210450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa1560a9700 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2210070 0x2210450 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f6899a7a2dd725ef server_cookie=89734dfebc401f99 in_seq=0 out_seq=0 2021-11-15T14:35:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 10 client.5089 ms_handle_connect on v2:172.21.2.135:6834/1684531282 2021-11-15T14:35:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 1 -- 172.21.2.135:0/3073789510 <== mds.0 v2:172.21.2.135:6834/1684531282 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x213e8e0 con 0x2210070 2021-11-15T14:35:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa12d7fa700 10 client.5089 handle_command_reply: tid=0 2021-11-15T14:35:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.120+0000 7fa162551740 1 client.5089 shutdown 2021-11-15T14:35:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 msgr2=0x2228bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fa14000b000 tx=0x7fa140008040).stop 2021-11-15T14:35:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 shutdown_connections 2021-11-15T14:35:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2210070 0x2210450 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x2218e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x2228bc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 --2- 172.21.2.135:0/3073789510 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x22286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa12d7fa700 0 client.5089 ms_handle_reset on v2:172.21.2.135:6834/1684531282 2021-11-15T14:35:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 >> 172.21.2.135:0/3073789510 conn(0x21dfec0 msgr2=0x22132c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 shutdown_connections 2021-11-15T14:35:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 1 -- 172.21.2.135:0/3073789510 wait complete. 2021-11-15T14:35:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.124+0000 7fa162551740 20 client.5089 trim_cache size 0 max 16384 2021-11-15T14:35:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 Processor -- start 2021-11-15T14:35:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 -- start start 2021-11-15T14:35:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x22167c0 0x2210c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x2216c40 0x2219c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x2136500 con 0x2216c40 2021-11-15T14:35:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x2211d40 con 0x2218980 2021-11-15T14:35:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x217db60 con 0x22167c0 2021-11-15T14:35:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56460/0 (socket says 172.21.2.135:56460) 2021-11-15T14:35:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 -- 172.21.2.135:0/2235191229 learned_addr learned my addr 172.21.2.135:0/2235191229 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 -- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x22167c0 msgr2=0x2210c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x22167c0 0x2210c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 -- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x2216c40 msgr2=0x2219c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x2216c40 0x2219c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 -- 172.21.2.135:0/2235191229 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2148750 con 0x2218980 2021-11-15T14:35:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa1568aa700 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa148047000 tx=0x7fa14806a000).ready entity=mon.1 client_cookie=4100d3d636b98c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa12f7fe700 1 -- 172.21.2.135:0/2235191229 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14806b280 con 0x2218980 2021-11-15T14:35:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa12f7fe700 1 -- 172.21.2.135:0/2235191229 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148042040 con 0x2218980 2021-11-15T14:35:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.128+0000 7fa12f7fe700 1 -- 172.21.2.135:0/2235191229 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14806b3e0 con 0x2218980 2021-11-15T14:35:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/2235191229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 msgr2=0x221a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:35:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa148047000 tx=0x7fa14806a000).stop 2021-11-15T14:35:21.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/2235191229 shutdown_connections 2021-11-15T14:35:21.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2218980 0x221a160 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x2216c40 0x2219c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- 172.21.2.135:0/2235191229 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x22167c0 0x2210c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:35:21.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/2235191229 >> 172.21.2.135:0/2235191229 conn(0x21dfec0 msgr2=0x21ddc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:35:21.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/2235191229 shutdown_connections 2021-11-15T14:35:21.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/2235191229 wait complete. 2021-11-15T14:35:21.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- start start 2021-11-15T14:35:21.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 Processor -- start 2021-11-15T14:35:21.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2286140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x227f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x221c700 con 0x22167c0 2021-11-15T14:35:21.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x2235bc0 con 0x2216c40 2021-11-15T14:35:21.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x21de740 con 0x2218980 2021-11-15T14:35:21.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 10 client.0 ll_register_callbacks cb 0x221ce40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:35:21.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56466/0 (socket says 172.21.2.135:56466) 2021-11-15T14:35:21.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 -- 172.21.2.135:0/381356142 learned_addr learned my addr 172.21.2.135:0/381356142 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:35:21.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1560a9700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2286140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1568aa700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x227f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 -- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 msgr2=0x227f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x227f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 -- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 msgr2=0x2286140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:35:21.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2286140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:35:21.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 -- 172.21.2.135:0/381356142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2188cb0 con 0x2216c40 2021-11-15T14:35:21.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1558a8700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa14000b000 tx=0x7fa14001e000).ready entity=mon.1 client_cookie=dc0a62c96b911cf1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:35:21.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:35:21.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14000bad0 con 0x2216c40 2021-11-15T14:35:21.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa14002d430 con 0x2216c40 2021-11-15T14:35:21.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa14806b110 con 0x2216c40 2021-11-15T14:35:21.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14002d5f0 con 0x2216c40 2021-11-15T14:35:21.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 10 client.5095 fetch_fsmap learned FSMap version 13 2021-11-15T14:35:21.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x2145140 con 0x2216c40 2021-11-15T14:35:21.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14806b110 con 0x2216c40 2021-11-15T14:35:21.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa140013400 con 0x2216c40 2021-11-15T14:35:21.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 10 client.5095 fetch_fsmap finished waiting for FSMap version 13 2021-11-15T14:35:21.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 10 client.5095 resolve_mds: resolved ID 'a' to GID 4861 2021-11-15T14:35:21.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 20 client.5095 populate_metadata read hostname 'gibba035' 2021-11-15T14:35:21.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2220690 0x227fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:35:21.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 4 client.5095 mds_command: new command op to 4861 tid=0[{"prefix": "cache drop"}] 2021-11-15T14:35:21.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 --> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x2034590 con 0x2220690 2021-11-15T14:35:21.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1560a9700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2220690 0x227fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:35:21.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa1560a9700 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2220690 0x227fa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1a3af0063ddd11f0 server_cookie=e6702ea2844e60fb in_seq=0 out_seq=0 2021-11-15T14:35:21.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:35:21.132+0000 7fa12e7fc700 10 client.5095 ms_handle_connect on v2:172.21.2.135:6834/1684531282 2021-11-15T14:35:41.371 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:41.374 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:41.377 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:35:41.381 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:05.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa12e7fc700 1 -- 172.21.2.135:0/381356142 <== mds.0 v2:172.21.2.135:6834/1684531282 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x2034590 con 0x2220690 2021-11-15T14:36:05.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa12e7fc700 10 client.5095 handle_command_reply: tid=0 2021-11-15T14:36:05.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 client.5095 shutdown 2021-11-15T14:36:05.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 msgr2=0x227f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa14000b000 tx=0x7fa14001e000).stop 2021-11-15T14:36:05.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 shutdown_connections 2021-11-15T14:36:05.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:6834/1684531282,v1:172.21.2.135:6835/1684531282] conn(0x2220690 0x227fa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x2218980 0x227f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x2216c40 0x227f090 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 --2- 172.21.2.135:0/381356142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x22167c0 0x2286140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 >> 172.21.2.135:0/381356142 conn(0x21dfec0 msgr2=0x2210450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:05.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa12e7fc700 0 client.5095 ms_handle_reset on v2:172.21.2.135:6834/1684531282 2021-11-15T14:36:05.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 shutdown_connections 2021-11-15T14:36:05.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 1 -- 172.21.2.135:0/381356142 wait complete. 2021-11-15T14:36:05.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.460+0000 7fa162551740 20 client.5095 trim_cache size 0 max 16384 2021-11-15T14:36:05.471 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:36:05.471 INFO:teuthology.orchestra.run.gibba035.stdout: "client_recall": { 2021-11-15T14:36:05.471 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:36:05.472 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "(0) Success", 2021-11-15T14:36:05.472 INFO:teuthology.orchestra.run.gibba035.stdout: "recalled": 920 2021-11-15T14:36:05.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.472 INFO:teuthology.orchestra.run.gibba035.stdout: "flush_journal": { 2021-11-15T14:36:05.473 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:36:05.473 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "" 2021-11-15T14:36:05.473 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.473 INFO:teuthology.orchestra.run.gibba035.stdout: "trim_cache": { 2021-11-15T14:36:05.473 INFO:teuthology.orchestra.run.gibba035.stdout: "trimmed": 900 2021-11-15T14:36:05.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.474 INFO:teuthology.orchestra.run.gibba035.stdout: "cache": { 2021-11-15T14:36:05.474 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": { 2021-11-15T14:36:05.474 INFO:teuthology.orchestra.run.gibba035.stdout: "items": 2511, 2021-11-15T14:36:05.475 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes": 431808 2021-11-15T14:36:05.475 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:05.475 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.475 INFO:teuthology.orchestra.run.gibba035.stdout: "duration": 44.327152396000002 2021-11-15T14:36:05.475 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:36:05.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 msgr2=0x7fa130055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 0x7fa130055a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa14c00bea0 tx=0x7fa14c014000).stop 2021-11-15T14:36:05.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 msgr2=0x7fa15013e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa150060cd0 tx=0x7fa148007f40).stop 2021-11-15T14:36:05.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 shutdown_connections 2021-11-15T14:36:05.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa130053580 0x7fa130055a40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1501469d0 0x7fa15013e500 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1500b4710 0x7fa150143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 --2- 172.21.2.135:0/2027103839 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1500b4200 0x7fa150114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 >> 172.21.2.135:0/2027103839 conn(0x7fa15005c510 msgr2=0x7fa150145b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:05.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 shutdown_connections 2021-11-15T14:36:05.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.464+0000 7fa15830d700 1 -- 172.21.2.135:0/2027103839 wait complete. 2021-11-15T14:36:05.480 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:36:05.481 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:05.489 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:05.502 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:05.510 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:05.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:36:05.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:05.524 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:05.524 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:05.569 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:36:05.569 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:05.570 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:36:05.570 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:36:05.571 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:05.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14039]: fuse finished with error 0 and tester_r 0 2021-11-15T14:36:05.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:05.580 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:05.581 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:05.585 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:36:05.585 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:36:05.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:36:05.695 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:05.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:05.741 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:05.741 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:36:05.751 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:36:05.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:36:05.752 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:36:05.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:36:05.753 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:36:05.762 INFO:teuthology.orchestra.run.gibba032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:36:05.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:36:05.764 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:36:05.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.868+0000 7fa9cb77b700 1 Processor -- start 2021-11-15T14:36:05.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- start start 2021-11-15T14:36:05.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa9c40b1300 0x7fa9c40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa9c40aee40 0x7fa9c40b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c4140390 con 0x7fa9c4140d70 2021-11-15T14:36:05.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c4140630 con 0x7fa9c40aee40 2021-11-15T14:36:05.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c41408d0 con 0x7fa9c40b1300 2021-11-15T14:36:05.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c8d16700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa9c4140d70 0x7fa9c40ae730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44064/0 (socket says 172.21.2.135:44064) 2021-11-15T14:36:05.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c8d16700 1 -- 172.21.2.135:0/118311404 learned_addr learned my addr 172.21.2.135:0/118311404 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:05.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 --2- 172.21.2.135:0/118311404 >> v2:172.21.2.135:3300/0 conn(0x7fa9c40b1300 0x7fa9c40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:05.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9b7fff700 1 -- 172.21.2.135:0/118311404 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098405827 0 0) 0x7fa9c4140390 con 0x7fa9c4140d70 2021-11-15T14:36:05.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9b7fff700 1 -- 172.21.2.135:0/118311404 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9ac003260 con 0x7fa9c4140d70 2021-11-15T14:36:05.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 -- 172.21.2.135:0/118311404 >> v2:172.21.2.119:3300/0 conn(0x7fa9c40aee40 msgr2=0x7fa9c40b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:05.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 --2- 172.21.2.135:0/118311404 >> v2:172.21.2.119:3300/0 conn(0x7fa9c40aee40 0x7fa9c40b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:05.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 -- 172.21.2.135:0/118311404 >> v1:172.21.2.135:6789/0 conn(0x7fa9c4140d70 legacy=0x7fa9c40ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 -- 172.21.2.135:0/118311404 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4140080 con 0x7fa9c40b1300 2021-11-15T14:36:05.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9517700 1 --2- 172.21.2.135:0/118311404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c40b1300 0x7fa9c40b1cf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fa9c40b2700 tx=0x7fa9c0006df0).ready entity=mon.1 client_cookie=c49506191535e85c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:05.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9b7fff700 1 -- 172.21.2.135:0/118311404 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c000d5c0 con 0x7fa9c40b1300 2021-11-15T14:36:05.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9b7fff700 1 -- 172.21.2.135:0/118311404 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0000e90 con 0x7fa9c40b1300 2021-11-15T14:36:05.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9b7fff700 1 -- 172.21.2.135:0/118311404 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c000d950 con 0x7fa9c40b1300 2021-11-15T14:36:05.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- 172.21.2.135:0/118311404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c40b1300 msgr2=0x7fa9c40b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/118311404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c40b1300 0x7fa9c40b1cf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fa9c40b2700 tx=0x7fa9c0006df0).stop 2021-11-15T14:36:05.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- 172.21.2.135:0/118311404 shutdown_connections 2021-11-15T14:36:05.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/118311404 >> v2:172.21.2.119:3300/0 conn(0x7fa9c40aee40 0x7fa9c40b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:05.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/118311404 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c40b1300 0x7fa9c40b1cf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:05.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- 172.21.2.135:0/118311404 >> 172.21.2.135:0/118311404 conn(0x7fa9c405f730 msgr2=0x7fa9c405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:05.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- 172.21.2.135:0/118311404 shutdown_connections 2021-11-15T14:36:05.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- 172.21.2.135:0/118311404 wait complete. 2021-11-15T14:36:05.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 Processor -- start 2021-11-15T14:36:05.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- start start 2021-11-15T14:36:05.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c40aee40 0x7fa9c40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c40b1300 0x7fa9c40ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4145d70 con 0x7fa9c40aee40 2021-11-15T14:36:05.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4144d60 con 0x7fa9c4140d70 2021-11-15T14:36:05.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9cb77b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c40abe20 con 0x7fa9c40b1300 2021-11-15T14:36:05.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:05.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56482/0 (socket says 172.21.2.135:56482) 2021-11-15T14:36:05.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 -- 172.21.2.135:0/1585527644 learned_addr learned my addr 172.21.2.135:0/1585527644 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:05.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 -- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c40b1300 msgr2=0x7fa9c40ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c40b1300 0x7fa9c40ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:05.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 -- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c40aee40 msgr2=0x7fa9c40b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:05.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c40aee40 0x7fa9c40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:05.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.872+0000 7fa9c9d18700 1 -- 172.21.2.135:0/1585527644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c000b180 con 0x7fa9c4140d70 2021-11-15T14:36:05.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9c9d18700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fa9bc0032f0 tx=0x7fa9bc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:05.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc00d6f0 con 0x7fa9c4140d70 2021-11-15T14:36:05.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc00d850 con 0x7fa9c4140d70 2021-11-15T14:36:05.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c405efb0 con 0x7fa9c4140d70 2021-11-15T14:36:05.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c40aa870 con 0x7fa9c4140d70 2021-11-15T14:36:05.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9bc00dbb0 con 0x7fa9c4140d70 2021-11-15T14:36:05.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c40aa410 con 0x7fa9c4140d70 2021-11-15T14:36:05.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9bc018030 con 0x7fa9c4140d70 2021-11-15T14:36:05.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 0x7fa9a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:05.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa9bc06b880 con 0x7fa9c4140d70 2021-11-15T14:36:05.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9c9517700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 0x7fa9a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:05.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.876+0000 7fa9c9517700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 0x7fa9a4055ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa9c40b2700 tx=0x7fa9c0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:05.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.880+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9bc041e90 con 0x7fa9c4140d70 2021-11-15T14:36:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa9c40573d0 con 0x7fa9c4140d70 2021-11-15T14:36:05.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9b67fc700 1 -- 172.21.2.135:0/1585527644 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+34037 (secure 0 0 0) 0x7fa9bc028510 con 0x7fa9c4140d70 2021-11-15T14:36:05.966 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:05.966 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:36:05.966 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 36, 2021-11-15T14:36:05.966 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:36:05.967 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:36:05.967 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:34:59.069082+0000", 2021-11-15T14:36:05.967 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:36:05.967 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:36:05.967 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:36:05.968 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:36:05.968 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:36:05.968 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:36:05.968 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:36:05.969 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:36:05.969 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:36:05.969 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:05.969 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:36:05.970 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:36:05.970 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:36:05.970 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:36:05.970 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:36:05.971 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 6, 2021-11-15T14:36:05.971 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:36:05.971 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:36:05.971 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:36:05.971 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:36:05.972 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:36:05.972 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:05.972 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:36:05.972 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:36:05.973 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:36:05.973 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:05.973 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:05.973 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:05.974 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:05.974 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:05.974 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:05.974 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:05.974 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:05.975 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:36:05.975 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:36:05.975 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:36:05.975 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:36:05.976 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:36:05.976 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:05.976 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:05.976 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:05.977 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:05.977 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:05.977 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:05.977 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:05.977 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.978 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:36:05.978 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:05.978 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:05.978 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:05.979 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:05.979 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:05.979 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:05.979 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:05.979 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:05.980 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:05.980 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:05.980 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:05.980 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:05.981 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:05.981 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:05.981 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:05.981 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:05.982 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:05.982 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:05.982 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:05.982 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:05.983 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:05.983 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:05.983 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:05.983 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:05.983 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:05.984 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:05.984 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.984 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:05.984 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:05.985 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:05.985 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:05.985 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:05.985 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:05.985 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:05.986 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:05.986 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:05.986 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:05.986 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:05.987 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:36:05.987 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:36:05.987 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.987 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:05.988 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:36:05.988 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:05.988 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.988 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:05.988 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:36:05.989 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:36:05.989 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:36:05.989 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:05.989 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:05.990 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:05.990 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:05.990 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:05.990 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:05.990 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:05.991 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:05.991 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:36:05.991 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:36:05.991 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:36:05.992 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:36:05.992 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:36:05.992 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:05.992 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:05.993 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:05.993 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:05.993 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:05.993 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:05.993 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:05.994 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:05.994 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:36:05.994 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:05.994 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:05.995 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:05.995 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:05.995 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:05.995 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:05.995 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:05.996 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:05.996 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:05.996 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:05.996 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:05.997 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:05.997 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:05.997 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:05.997 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:05.998 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:05.998 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:05.998 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:05.998 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:05.998 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:05.999 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:05.999 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:05.999 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:05.999 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:06.000 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:06.000 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:06.000 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.000 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:06.001 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:06.001 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:06.001 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:06.001 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:06.001 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:06.002 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:06.002 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:06.002 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:06.002 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:06.003 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:06.003 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:36:06.003 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:06.003 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:36:06.003 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.004 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.004 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.004 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 5, 2021-11-15T14:36:06.004 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:36:06.005 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:55.042943+0000", 2021-11-15T14:36:06.005 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:06.005 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:06.005 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:06.006 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:06.006 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:06.006 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:06.006 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:06.007 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:06.007 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:36:06.007 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:36:06.007 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:36:06.008 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:36:06.008 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:36:06.008 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:06.008 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:06.008 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:06.009 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:06.009 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:06.009 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:06.009 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:06.010 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.010 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "35", 2021-11-15T14:36:06.010 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:06.010 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:06.011 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:06.011 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:06.011 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:06.011 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:06.012 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:06.012 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:06.012 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:06.012 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:06.013 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:06.013 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:06.013 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:06.013 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:06.014 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:06.014 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:06.014 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:06.014 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:06.015 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:06.015 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:06.015 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:06.015 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:06.016 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:06.016 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:06.016 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:06.016 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:06.016 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.017 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:06.017 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:06.017 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:06.017 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:06.018 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:06.018 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:06.018 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:06.018 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:06.019 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:06.019 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:06.019 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:06.019 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:36:06.020 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:36:06.020 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:36:06.020 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:36:06.020 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.021 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:06.021 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:36:06.021 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:36:06.021 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.021 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.022 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.022 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.022 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 6, 2021-11-15T14:36:06.022 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:36:06.023 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:55.985686+0000", 2021-11-15T14:36:06.023 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:06.023 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:06.024 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:06.024 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:06.024 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:06.024 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:06.024 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:06.025 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:06.025 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:36:06.025 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:36:06.025 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:36:06.026 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:36:06.026 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:36:06.026 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:06.026 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:06.026 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:06.027 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:06.027 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:06.027 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:06.027 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:06.028 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.028 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "36", 2021-11-15T14:36:06.028 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:06.028 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:06.028 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:06.029 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:06.029 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:06.029 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:06.029 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:06.030 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:06.030 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:06.030 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:06.030 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:06.031 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:06.031 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:06.031 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:06.031 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:06.031 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:06.032 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:06.032 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:06.032 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:06.032 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:06.033 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:06.033 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:06.033 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:06.033 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:06.033 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:06.034 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:06.034 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.034 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:06.034 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:06.035 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:06.035 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:06.035 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:06.035 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:06.035 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:06.036 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:06.036 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:06.036 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:06.036 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:06.037 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:36:06.037 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:06.037 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:36:06.037 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:36:06.037 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.038 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.038 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.038 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:06.038 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:36:06.039 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.039 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:36:06.039 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:36:06.039 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.040 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.040 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.040 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.040 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.040 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.041 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.041 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:06.041 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.041 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.042 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.042 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.042 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.042 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.043 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:36:06.043 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.043 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.043 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.043 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.044 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:36:06.044 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.044 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.044 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.045 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.045 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.045 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.045 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.046 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.046 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:36:06.046 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.046 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.047 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.047 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.047 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:36:06.047 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.047 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.048 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.048 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.048 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.048 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.049 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.049 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.049 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:36:06.049 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.049 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.050 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.050 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.050 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:36:06.050 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.051 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.051 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.051 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.051 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.052 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.052 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.052 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.052 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:36:06.053 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.053 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.053 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.053 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.054 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:36:06.054 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:06.054 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.054 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.055 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.055 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:36:06.055 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:36:06.055 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:36:06.056 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:36:06.056 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.056 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.056 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.057 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.057 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.057 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.057 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:36:06.057 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:36:06.058 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.058 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.058 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.058 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.059 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.059 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.059 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.059 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 14, 2021-11-15T14:36:06.060 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.060 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.060 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.060 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.061 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.061 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.061 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:36:06.061 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.061 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.062 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.062 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.062 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:36:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.063 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.064 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:36:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.065 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:36:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.066 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.067 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:36:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.068 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:36:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.069 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.070 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.070 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.070 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.070 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.071 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.071 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:36:06.071 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.071 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.071 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.072 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.072 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:36:06.072 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:06.072 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.073 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.073 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.073 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:36:06.073 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:36:06.073 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:36:06.074 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:36:06.074 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.074 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.074 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.075 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.075 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.075 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.075 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:36:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:36:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.077 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.077 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.077 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.077 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:36:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.079 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.079 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:36:06.079 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.079 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.080 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.080 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.080 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:36:06.080 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.080 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.081 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.081 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.081 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.081 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:36:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:36:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:36:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.086 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.086 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.086 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.086 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:36:06.087 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.087 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.087 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.087 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.088 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.088 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.088 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.088 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.089 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:36:06.089 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.089 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.089 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.089 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.090 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:36:06.090 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:06.090 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.090 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.091 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.091 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:36:06.091 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:36:06.091 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:36:06.092 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:36:06.092 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.092 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.092 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.093 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.093 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.093 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.093 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:36:06.093 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:36:06.094 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.094 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.094 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.094 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.095 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.095 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.095 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.095 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:06.096 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.096 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.096 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.096 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.096 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.097 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.097 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:36:06.097 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.097 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.098 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.098 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.098 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:36:06.098 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.099 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.099 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.099 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.099 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.100 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.100 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.100 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.100 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:36:06.101 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.101 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.101 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.101 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.101 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:36:06.102 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.102 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.102 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.102 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.103 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.103 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.103 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.103 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.104 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:36:06.104 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.104 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.104 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.105 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.105 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:36:06.105 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.105 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.106 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.106 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.106 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.106 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.107 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.107 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.107 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:36:06.107 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.107 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.108 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.108 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.108 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:36:06.109 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:06.109 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.109 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.109 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.109 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:36:06.110 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:36:06.110 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:36:06.110 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:36:06.110 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.111 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.111 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.111 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.111 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.112 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.112 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:36:06.112 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:36:06.112 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.113 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.113 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.113 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.113 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.113 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.114 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.114 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 31, 2021-11-15T14:36:06.114 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.114 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.115 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.115 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.115 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.115 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.116 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:36:06.116 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.116 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.116 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.117 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.117 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:36:06.117 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.117 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.118 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.118 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.118 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.118 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.118 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.119 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.119 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:36:06.119 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.119 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.120 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.120 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.120 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:36:06.120 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.121 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.121 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.121 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.121 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.122 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.122 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.122 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.122 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:36:06.123 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.123 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.123 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.123 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.123 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:36:06.124 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.124 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.124 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.124 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.125 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.125 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.125 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.125 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.125 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:36:06.126 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.126 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.126 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.126 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.127 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:36:06.127 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:06.127 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.127 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.127 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.128 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:36:06.128 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:36:06.128 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:36:06.128 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:36:06.129 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.129 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.129 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.129 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.130 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.130 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.130 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:36:06.130 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:36:06.130 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.131 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.131 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.131 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.131 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.132 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.132 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.132 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:06.132 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.132 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.133 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.133 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.133 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.133 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.134 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:36:06.134 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.134 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.134 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.135 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.135 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:36:06.135 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.135 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.135 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.136 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.136 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.136 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.136 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.137 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.137 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:36:06.137 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.137 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.137 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.138 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.138 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:36:06.138 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.138 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.139 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.139 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.139 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.139 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.140 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.140 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.140 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:36:06.140 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.140 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.141 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.141 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.141 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:36:06.141 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.142 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.142 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.142 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.142 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.143 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.143 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.143 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.143 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:36:06.143 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.144 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.144 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.144 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.144 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:36:06.145 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:06.145 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.145 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.145 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.145 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:36:06.146 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:36:06.146 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:36:06.146 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:36:06.146 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.147 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.147 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.147 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.147 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.148 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.148 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:36:06.148 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:36:06.148 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.149 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.149 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.149 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.149 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.149 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.150 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.150 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:06.150 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.150 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.151 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.151 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.151 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.151 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.152 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:36:06.152 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.152 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.152 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.153 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.153 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:36:06.153 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.153 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.153 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.154 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.154 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.154 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.154 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.155 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.155 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:36:06.155 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.155 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.156 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.156 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.156 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:36:06.156 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.157 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.157 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.157 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.157 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.157 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.158 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.158 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.158 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:36:06.158 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.159 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.159 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.159 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.159 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:36:06.160 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.160 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.160 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.160 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.161 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.161 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.161 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.161 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.162 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:36:06.162 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.162 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.162 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.163 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.163 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:36:06.163 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:06.163 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.163 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.164 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.164 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:36:06.164 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:36:06.164 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:36:06.165 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:36:06.165 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.165 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.165 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.165 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.166 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.166 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.166 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:36:06.166 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:36:06.167 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:06.167 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:06.167 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:06.167 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:06.167 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:06.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:06.168 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:06.168 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 34, 2021-11-15T14:36:06.168 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:06.169 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:06.169 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:06.169 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.169 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.169 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.170 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:36:06.170 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.170 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.170 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.171 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.171 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:36:06.171 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.171 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.172 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.172 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.172 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:06.172 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.172 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.173 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.173 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:36:06.173 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.173 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.174 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.174 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.174 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:36:06.174 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.175 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.175 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.175 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.175 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:06.175 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.176 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.176 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.176 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:36:06.176 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.177 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.177 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.177 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.177 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:36:06.177 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.178 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.178 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.178 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.178 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:06.179 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:06.179 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.179 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:06.179 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:36:06.179 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.180 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.180 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.180 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:06.180 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:36:06.181 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:06.181 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.181 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.181 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.181 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:36:06.182 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:36:06.182 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:36:06.182 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:36:06.182 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:06.183 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:06.183 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:06.183 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:06.183 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.183 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:06.184 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:36:06.184 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.184 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:36:06.184 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.185 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.185 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.185 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.185 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:36:06.186 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.186 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.186 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.186 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:36:06.187 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.187 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.187 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.187 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.188 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.188 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:36:06.188 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.188 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.188 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.189 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:36:06.189 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.189 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.189 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.190 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.190 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.190 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:36:06.190 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.190 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.191 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.191 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:36:06.191 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.191 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.192 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.192 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.192 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.192 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:36:06.193 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.193 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.193 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.193 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:36:06.194 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.194 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.194 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.194 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.195 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.195 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:36:06.195 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.195 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.196 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.196 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:36:06.196 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.196 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.197 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.197 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.197 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.197 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:36:06.198 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.198 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.198 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.198 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:36:06.198 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.199 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.199 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.199 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.199 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:36:06.200 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.200 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.200 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:06.201 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:36:06.201 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:06.201 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:06.201 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:06.202 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:06.202 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:06.202 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:36:06.202 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:06.203 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.203 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:06.203 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:36:06.203 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:36:06.204 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:36:06.204 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:36:06.204 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:36:06.204 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:36:06.205 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:36:06.205 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:36:06.205 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:36:06.205 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:36:06.206 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:36:06.206 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:36:06.206 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:36:06.206 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:36:06.207 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:36:06.207 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:36:06.207 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:36:06.207 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.207 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:36:06.208 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:36:06.208 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:36:06.208 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:36:06.208 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:36:06.209 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:36:06.209 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:36:06.209 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:06.209 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:06.209 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:36:06.210 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:36:06.210 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:36:06.210 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:36:06.210 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:36:06.211 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:36:06.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 msgr2=0x7fa9a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 0x7fa9a4055ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa9c40b2700 tx=0x7fa9c0014000).stop 2021-11-15T14:36:06.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 msgr2=0x7fa9c40ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fa9bc0032f0 tx=0x7fa9bc0091d0).stop 2021-11-15T14:36:06.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 shutdown_connections 2021-11-15T14:36:06.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a4053610 0x7fa9a4055ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c4140d70 0x7fa9c40ab930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c40b1300 0x7fa9c40ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 --2- 172.21.2.135:0/1585527644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c40aee40 0x7fa9c40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 >> 172.21.2.135:0/1585527644 conn(0x7fa9c405f730 msgr2=0x7fa9c40ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 shutdown_connections 2021-11-15T14:36:06.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:05.960+0000 7fa9cb77b700 1 -- 172.21.2.135:0/1585527644 wait complete. 2021-11-15T14:36:06.216 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:06.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 Processor -- start 2021-11-15T14:36:06.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- start start 2021-11-15T14:36:06.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e340b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3e340b1f90 0x7f3e340aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e340aa410 con 0x7f3e340a9bf0 2021-11-15T14:36:06.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e340b0520 con 0x7f3e340b1f90 2021-11-15T14:36:06.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340aa170 con 0x7f3e340b0140 2021-11-15T14:36:06.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3e340b1f90 0x7f3e340aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3e340b1f90 0x7f3e340aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56488/0 (socket says 172.21.2.135:56488) 2021-11-15T14:36:06.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 -- 172.21.2.135:0/1026487499 learned_addr learned my addr 172.21.2.135:0/1026487499 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:06.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 -- 172.21.2.135:0/1026487499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 msgr2=0x7f3e340b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:06.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 --2- 172.21.2.135:0/1026487499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e340b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 -- 172.21.2.135:0/1026487499 >> v1:172.21.2.119:6789/0 conn(0x7f3e340a9bf0 legacy=0x7f3e34141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:06.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 -- 172.21.2.135:0/1026487499 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340b1260 con 0x7f3e340b1f90 2021-11-15T14:36:06.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e32ffd700 1 --2- 172.21.2.135:0/1026487499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340aabd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3e340b1880 tx=0x7f3e1c006eb0).ready entity=mon.1 client_cookie=6a794427d4ef9f60 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e327fc700 1 -- 172.21.2.135:0/1026487499 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e1c00d570 con 0x7f3e340b1f90 2021-11-15T14:36:06.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e327fc700 1 -- 172.21.2.135:0/1026487499 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c000e90 con 0x7f3e340b1f90 2021-11-15T14:36:06.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e327fc700 1 -- 172.21.2.135:0/1026487499 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e1c00d8c0 con 0x7f3e340b1f90 2021-11-15T14:36:06.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- 172.21.2.135:0/1026487499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 msgr2=0x7f3e340aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/1026487499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340aabd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3e340b1880 tx=0x7f3e1c006eb0).stop 2021-11-15T14:36:06.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- 172.21.2.135:0/1026487499 shutdown_connections 2021-11-15T14:36:06.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/1026487499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340aabd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/1026487499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e340b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- 172.21.2.135:0/1026487499 >> 172.21.2.135:0/1026487499 conn(0x7f3e34060840 msgr2=0x7f3e34060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- 172.21.2.135:0/1026487499 shutdown_connections 2021-11-15T14:36:06.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- 172.21.2.135:0/1026487499 wait complete. 2021-11-15T14:36:06.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 Processor -- start 2021-11-15T14:36:06.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.268+0000 7f3e39ec1700 1 -- start start 2021-11-15T14:36:06.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e340a9bf0 0x7f3e340abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e3409ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3409fba0 con 0x7f3e340a9bf0 2021-11-15T14:36:06.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e34066fb0 con 0x7f3e340b1f90 2021-11-15T14:36:06.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e34067250 con 0x7f3e340b0140 2021-11-15T14:36:06.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56498/0 (socket says 172.21.2.135:56498) 2021-11-15T14:36:06.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 -- 172.21.2.135:0/3458782149 learned_addr learned my addr 172.21.2.135:0/3458782149 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:06.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 -- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 msgr2=0x7f3e3409ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e3409ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 -- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e340a9bf0 msgr2=0x7f3e340abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e340a9bf0 0x7f3e340abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 -- 172.21.2.135:0/3458782149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c00b1e0 con 0x7f3e340b1f90 2021-11-15T14:36:06.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e33fff700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f3e2c003310 tx=0x7f3e2c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2c001500 con 0x7f3e340b1f90 2021-11-15T14:36:06.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c001660 con 0x7f3e340b1f90 2021-11-15T14:36:06.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e2c0019c0 con 0x7f3e340b1f90 2021-11-15T14:36:06.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e340674f0 con 0x7f3e340b1f90 2021-11-15T14:36:06.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e341519a0 con 0x7f3e340b1f90 2021-11-15T14:36:06.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e340573d0 con 0x7f3e340b1f90 2021-11-15T14:36:06.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e2c018030 con 0x7f3e340b1f90 2021-11-15T14:36:06.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 0x7f3e18055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3e2c06b5d0 con 0x7f3e340b1f90 2021-11-15T14:36:06.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.272+0000 7f3e337fe700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 0x7f3e18055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.276+0000 7f3e337fe700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 0x7f3e18055a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3e24002f70 tx=0x7f3e24006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.276+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e2c042580 con 0x7f3e340b1f90 2021-11-15T14:36:06.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.380+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e340446d0 con 0x7f3e340b1f90 2021-11-15T14:36:06.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.380+0000 7f3e30ff9700 1 -- 172.21.2.135:0/3458782149 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2488 (secure 0 0 0) 0x7f3e2c045ba0 con 0x7f3e340b1f90 2021-11-15T14:36:06.388 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:06.388 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:34:58.540494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4861":{"gid":4861,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1684531282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1684531282},{"type":"v1","addr":"172.21.2.135:6835","nonce":1684531282}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:36:06.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 msgr2=0x7f3e18055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 0x7f3e18055a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3e24002f70 tx=0x7f3e24006a80).stop 2021-11-15T14:36:06.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 msgr2=0x7f3e340a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f3e2c003310 tx=0x7f3e2c0091a0).stop 2021-11-15T14:36:06.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 shutdown_connections 2021-11-15T14:36:06.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e180535d0 0x7f3e18055a90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e340b1f90 0x7f3e340a0480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e340b0140 0x7f3e3409ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 --2- 172.21.2.135:0/3458782149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e340a9bf0 0x7f3e340abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 >> 172.21.2.135:0/3458782149 conn(0x7f3e34060840 msgr2=0x7f3e34145060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 shutdown_connections 2021-11-15T14:36:06.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.384+0000 7f3e39ec1700 1 -- 172.21.2.135:0/3458782149 wait complete. 2021-11-15T14:36:06.392 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 13 2021-11-15T14:36:06.394 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:36:06.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 Processor -- start 2021-11-15T14:36:06.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 -- start start 2021-11-15T14:36:06.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0340067380 0x7f0340143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0340143e60 0x7f034014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03400aac30 con 0x7f0340060180 2021-11-15T14:36:06.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0340060560 con 0x7f0340143e60 2021-11-15T14:36:06.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0347f6f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0340066f20 con 0x7f0340067380 2021-11-15T14:36:06.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0340067380 0x7f0340143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0340067380 0x7f0340143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56504/0 (socket says 172.21.2.135:56504) 2021-11-15T14:36:06.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 -- 172.21.2.135:0/3523372715 learned_addr learned my addr 172.21.2.135:0/3523372715 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:06.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 -- 172.21.2.135:0/3523372715 >> v2:172.21.2.119:3300/0 conn(0x7f0340143e60 msgr2=0x7f034014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:06.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 --2- 172.21.2.135:0/3523372715 >> v2:172.21.2.119:3300/0 conn(0x7f0340143e60 0x7f034014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 -- 172.21.2.135:0/3523372715 >> v1:172.21.2.119:6789/0 conn(0x7f0340060180 legacy=0x7f03400b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:06.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 -- 172.21.2.135:0/3523372715 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03400b3430 con 0x7f0340067380 2021-11-15T14:36:06.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f034550a700 1 --2- 172.21.2.135:0/3523372715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340067380 0x7f0340143970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f034005f260 tx=0x7f0334006eb0).ready entity=mon.1 client_cookie=48fbe2b07dd129fb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0344d09700 1 -- 172.21.2.135:0/3523372715 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d5c0 con 0x7f0340067380 2021-11-15T14:36:06.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0344d09700 1 -- 172.21.2.135:0/3523372715 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334000e90 con 0x7f0340067380 2021-11-15T14:36:06.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.440+0000 7f0344d09700 1 -- 172.21.2.135:0/3523372715 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033400d910 con 0x7f0340067380 2021-11-15T14:36:06.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/3523372715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340067380 msgr2=0x7f0340143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- 172.21.2.135:0/3523372715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340067380 0x7f0340143970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f034005f260 tx=0x7f0334006eb0).stop 2021-11-15T14:36:06.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/3523372715 shutdown_connections 2021-11-15T14:36:06.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- 172.21.2.135:0/3523372715 >> v2:172.21.2.119:3300/0 conn(0x7f0340143e60 0x7f034014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- 172.21.2.135:0/3523372715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340067380 0x7f0340143970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/3523372715 >> 172.21.2.135:0/3523372715 conn(0x7f034005cfb0 msgr2=0x7f034005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/3523372715 shutdown_connections 2021-11-15T14:36:06.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/3523372715 wait complete. 2021-11-15T14:36:06.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 Processor -- start 2021-11-15T14:36:06.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- start start 2021-11-15T14:36:06.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0340060180 0x7f0340141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0340067380 0x7f0340156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340062710 con 0x7f0340060180 2021-11-15T14:36:06.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03400ad940 con 0x7f0340143e60 2021-11-15T14:36:06.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03400adbe0 con 0x7f0340067380 2021-11-15T14:36:06.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56512/0 (socket says 172.21.2.135:56512) 2021-11-15T14:36:06.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 -- 172.21.2.135:0/2178823122 learned_addr learned my addr 172.21.2.135:0/2178823122 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:06.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034550a700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0340067380 0x7f0340156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0345d0b700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0340060180 0x7f0340141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 -- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0340067380 msgr2=0x7f0340156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0340067380 0x7f0340156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 -- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0340060180 msgr2=0x7f0340141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0340060180 0x7f0340141b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 -- 172.21.2.135:0/2178823122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033400b1e0 con 0x7f0340143e60 2021-11-15T14:36:06.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f034650c700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f03380032f0 tx=0x7f03380091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800d4a0 con 0x7f0340143e60 2021-11-15T14:36:06.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800d600 con 0x7f0340143e60 2021-11-15T14:36:06.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033800d960 con 0x7f0340143e60 2021-11-15T14:36:06.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03400ade80 con 0x7f0340143e60 2021-11-15T14:36:06.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03400ae320 con 0x7f0340143e60 2021-11-15T14:36:06.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.444+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03400ae010 con 0x7f0340143e60 2021-11-15T14:36:06.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0338018030 con 0x7f0340143e60 2021-11-15T14:36:06.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0332ffd700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 0x7f0320055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f033806b480 con 0x7f0340143e60 2021-11-15T14:36:06.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0345d0b700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 0x7f0320055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0345d0b700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 0x7f0320055ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f033c007000 tx=0x7f033c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.448+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0338042430 con 0x7f0340143e60 2021-11-15T14:36:06.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.556+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f03400620e0 con 0x7f0340143e60 2021-11-15T14:36:06.848 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:36:06.843+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:36:06.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0332ffd700 1 -- 172.21.2.135:0/2178823122 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0338045a50 con 0x7f0340143e60 2021-11-15T14:36:06.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 msgr2=0x7f0320055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 0x7f0320055ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f033c007000 tx=0x7f033c008040).stop 2021-11-15T14:36:06.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 msgr2=0x7f0340157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f03380032f0 tx=0x7f03380091a0).stop 2021-11-15T14:36:06.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 shutdown_connections 2021-11-15T14:36:06.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0320053610 0x7f0320055ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0340143e60 0x7f0340157020 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0340067380 0x7f0340156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 --2- 172.21.2.135:0/2178823122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0340060180 0x7f0340141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 >> 172.21.2.135:0/2178823122 conn(0x7f034005cfb0 msgr2=0x7f0340143740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 shutdown_connections 2021-11-15T14:36:06.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.856+0000 7f0347f6f700 1 -- 172.21.2.135:0/2178823122 wait complete. 2021-11-15T14:36:06.865 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:36:06.869 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:06.880 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:36:06.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 Processor -- start 2021-11-15T14:36:06.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 -- start start 2021-11-15T14:36:06.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 0x7ff5c00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 0x7ff5c01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c00b03d0 con 0x7ff5c00b1e30 2021-11-15T14:36:06.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00a9140 con 0x7ff5c00a7140 2021-11-15T14:36:06.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5c599a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00b0670 con 0x7ff5c0148420 2021-11-15T14:36:06.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5bf7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 0x7ff5c01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5beffd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7ff5c00b1e30 0x7ff5c00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53532/0 (socket says 172.21.2.135:53532) 2021-11-15T14:36:06.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5beffd700 1 -- 172.21.2.135:0/3290561529 learned_addr learned my addr 172.21.2.135:0/3290561529 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:06.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.916+0000 7ff5be7fc700 1 --2- 172.21.2.135:0/3290561529 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 0x7ff5c00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5be7fc700 1 -- 172.21.2.135:0/3290561529 >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 msgr2=0x7ff5c01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:06.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5be7fc700 1 --2- 172.21.2.135:0/3290561529 >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 0x7ff5c01447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5be7fc700 1 -- 172.21.2.135:0/3290561529 >> v1:172.21.2.119:6789/0 conn(0x7ff5c00b1e30 legacy=0x7ff5c00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5be7fc700 1 -- 172.21.2.135:0/3290561529 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00b0910 con 0x7ff5c0148420 2021-11-15T14:36:06.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- 172.21.2.135:0/3290561529 >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 0x7ff5c01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:36:06.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5be7fc700 1 --2- 172.21.2.135:0/3290561529 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 0x7ff5c00b1050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff5b4002f70 tx=0x7ff5b4006df0).ready entity=mon.2 client_cookie=a3d68da9a68564be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bdffb700 1 -- 172.21.2.135:0/3290561529 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b400d570 con 0x7ff5c0148420 2021-11-15T14:36:06.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bdffb700 1 -- 172.21.2.135:0/3290561529 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4000e90 con 0x7ff5c0148420 2021-11-15T14:36:06.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bdffb700 1 -- 172.21.2.135:0/3290561529 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b400d8c0 con 0x7ff5c0148420 2021-11-15T14:36:06.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- 172.21.2.135:0/3290561529 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 msgr2=0x7ff5c00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- 172.21.2.135:0/3290561529 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 0x7ff5c00b1050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff5b4002f70 tx=0x7ff5b4006df0).stop 2021-11-15T14:36:06.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- 172.21.2.135:0/3290561529 shutdown_connections 2021-11-15T14:36:06.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- 172.21.2.135:0/3290561529 >> v2:172.21.2.119:3300/0 conn(0x7ff5c00a7140 0x7ff5c01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- 172.21.2.135:0/3290561529 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c0148420 0x7ff5c00b1050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:06.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- 172.21.2.135:0/3290561529 >> 172.21.2.135:0/3290561529 conn(0x7ff5c005f730 msgr2=0x7ff5c005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:06.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- 172.21.2.135:0/3290561529 shutdown_connections 2021-11-15T14:36:06.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- 172.21.2.135:0/3290561529 wait complete. 2021-11-15T14:36:06.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 Processor -- start 2021-11-15T14:36:06.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- start start 2021-11-15T14:36:06.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5c00a7140 0x7ff5c01576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c00b1e30 0x7ff5c00af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c013d8d0 con 0x7ff5c00a7140 2021-11-15T14:36:06.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c015b060 con 0x7ff5c0148420 2021-11-15T14:36:06.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5c599a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0157bc0 con 0x7ff5c00b1e30 2021-11-15T14:36:06.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56538/0 (socket says 172.21.2.135:56538) 2021-11-15T14:36:06.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 -- 172.21.2.135:0/2219185802 learned_addr learned my addr 172.21.2.135:0/2219185802 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:06.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 -- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c00b1e30 msgr2=0x7ff5c00af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c00b1e30 0x7ff5c00af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 -- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5c00a7140 msgr2=0x7ff5c01576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:06.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5c00a7140 0x7ff5c01576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:06.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 -- 172.21.2.135:0/2219185802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8009470 con 0x7ff5c0148420 2021-11-15T14:36:06.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5bf7fe700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff5c00acc20 tx=0x7ff5b80091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.920+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b800c9d0 con 0x7ff5c0148420 2021-11-15T14:36:06.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800cb30 con 0x7ff5c0148420 2021-11-15T14:36:06.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b400b180 con 0x7ff5c0148420 2021-11-15T14:36:06.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b800ce90 con 0x7ff5c0148420 2021-11-15T14:36:06.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c0156f90 con 0x7ff5c0148420 2021-11-15T14:36:06.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c00573d0 con 0x7ff5c0148420 2021-11-15T14:36:06.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff5b8022070 con 0x7ff5c0148420 2021-11-15T14:36:06.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 0x7ff59c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:06.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6502+0+0 (secure 0 0 0) 0x7ff5b806c4c0 con 0x7ff5c0148420 2021-11-15T14:36:06.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5beffd700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 0x7ff59c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:06.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5beffd700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 0x7ff59c055ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff5c0061420 tx=0x7ff5b0007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:06.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:06.924+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5b8043360 con 0x7ff5c0148420 2021-11-15T14:36:07.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5c00b17b0 con 0x7ff5c0148420 2021-11-15T14:36:07.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5affff700 1 -- 172.21.2.135:0/2219185802 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2127 (secure 0 0 0) 0x7ff5b8016860 con 0x7ff5c0148420 2021-11-15T14:36:07.040 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:07.040 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:34:57.052244+0000","modified":"2021-11-15T14:36:06.849675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-15T14:36:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 msgr2=0x7ff59c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 0x7ff59c055ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff5c0061420 tx=0x7ff5b0007800).stop 2021-11-15T14:36:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 msgr2=0x7ff5c00aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff5c00acc20 tx=0x7ff5b80091d0).stop 2021-11-15T14:36:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 shutdown_connections 2021-11-15T14:36:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff59c053610 0x7ff59c055ad0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5c0148420 0x7ff5c00aa9e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5c00b1e30 0x7ff5c00af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:07.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 --2- 172.21.2.135:0/2219185802 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5c00a7140 0x7ff5c01576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:07.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 >> 172.21.2.135:0/2219185802 conn(0x7ff5c005f730 msgr2=0x7ff5c00b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:07.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 shutdown_connections 2021-11-15T14:36:07.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.036+0000 7ff5c599a700 1 -- 172.21.2.135:0/2219185802 wait complete. 2021-11-15T14:36:07.044 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 14 2021-11-15T14:36:07.047 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:36:07.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 Processor -- start 2021-11-15T14:36:07.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 -- start start 2021-11-15T14:36:07.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 0x7f33e00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 0x7f33e00b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e00b2810 con 0x7f33e00a7140 2021-11-15T14:36:07.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00b0470 con 0x7f33e00b0030 2021-11-15T14:36:07.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.092+0000 7f33e873a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00b06d0 con 0x7f33e00b1f40 2021-11-15T14:36:07.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e5cd5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 0x7f33e00b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 0x7f33e00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e6cd7700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f33e00a7140 0x7f33e01412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53548/0 (socket says 172.21.2.135:53548) 2021-11-15T14:36:07.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e6cd7700 1 -- 172.21.2.135:0/3969836011 learned_addr learned my addr 172.21.2.135:0/3969836011 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:07.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 -- 172.21.2.135:0/3969836011 >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 msgr2=0x7f33e00b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:07.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 --2- 172.21.2.135:0/3969836011 >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 0x7f33e00b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 -- 172.21.2.135:0/3969836011 >> v1:172.21.2.119:6789/0 conn(0x7f33e00a7140 legacy=0x7f33e01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 -- 172.21.2.135:0/3969836011 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00b0970 con 0x7f33e00b1f40 2021-11-15T14:36:07.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e5cd5700 1 --2- 172.21.2.135:0/3969836011 >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 0x7f33e00b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:36:07.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e64d6700 1 --2- 172.21.2.135:0/3969836011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 0x7f33e00b1350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33dc002f70 tx=0x7f33dc006df0).ready entity=mon.2 client_cookie=4b4a6b6358784917 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e54d4700 1 -- 172.21.2.135:0/3969836011 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33dc00d570 con 0x7f33e00b1f40 2021-11-15T14:36:07.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e54d4700 1 -- 172.21.2.135:0/3969836011 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc000e90 con 0x7f33e00b1f40 2021-11-15T14:36:07.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e54d4700 1 -- 172.21.2.135:0/3969836011 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33dc00d8c0 con 0x7f33e00b1f40 2021-11-15T14:36:07.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- 172.21.2.135:0/3969836011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 msgr2=0x7f33e00b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- 172.21.2.135:0/3969836011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 0x7f33e00b1350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33dc002f70 tx=0x7f33dc006df0).stop 2021-11-15T14:36:07.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- 172.21.2.135:0/3969836011 shutdown_connections 2021-11-15T14:36:07.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- 172.21.2.135:0/3969836011 >> v2:172.21.2.119:3300/0 conn(0x7f33e00b0030 0x7f33e00b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- 172.21.2.135:0/3969836011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b1f40 0x7f33e00b1350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- 172.21.2.135:0/3969836011 >> 172.21.2.135:0/3969836011 conn(0x7f33e005f730 msgr2=0x7f33e005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:07.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- 172.21.2.135:0/3969836011 shutdown_connections 2021-11-15T14:36:07.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- 172.21.2.135:0/3969836011 wait complete. 2021-11-15T14:36:07.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 Processor -- start 2021-11-15T14:36:07.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- start start 2021-11-15T14:36:07.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f33e00a7140 0x7f33e00b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b0030 0x7f33e00ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e014bc30 con 0x7f33e00a7140 2021-11-15T14:36:07.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00abb90 con 0x7f33e00b1f40 2021-11-15T14:36:07.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e873a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00abe30 con 0x7f33e00b0030 2021-11-15T14:36:07.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.096+0000 7f33e6cd7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56552/0 (socket says 172.21.2.135:56552) 2021-11-15T14:36:07.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 -- 172.21.2.135:0/232482064 learned_addr learned my addr 172.21.2.135:0/232482064 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:07.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e5cd5700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b0030 0x7f33e00ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e64d6700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f33e00a7140 0x7f33e00b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 -- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b0030 msgr2=0x7f33e00ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b0030 0x7f33e00ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 -- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f33e00a7140 msgr2=0x7f33e00b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f33e00a7140 0x7f33e00b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 -- 172.21.2.135:0/232482064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d400b180 con 0x7f33e00b1f40 2021-11-15T14:36:07.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e6cd7700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f33e006a170 tx=0x7f33d8007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d8005ba0 con 0x7f33e00b1f40 2021-11-15T14:36:07.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8005d00 con 0x7f33e00b1f40 2021-11-15T14:36:07.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d80072c0 con 0x7f33e00b1f40 2021-11-15T14:36:07.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc00b180 con 0x7f33e00b1f40 2021-11-15T14:36:07.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e00b4930 con 0x7f33e00b1f40 2021-11-15T14:36:07.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00b3730 con 0x7f33e00b1f40 2021-11-15T14:36:07.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f33d8010070 con 0x7f33e00b1f40 2021-11-15T14:36:07.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 0x7f33c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f33d806b450 con 0x7f33e00b1f40 2021-11-15T14:36:07.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e64d6700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 0x7f33c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.100+0000 7f33e64d6700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 0x7f33c0055ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f33dc015000 tx=0x7f33dc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.104+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f33d8042400 con 0x7f33e00b1f40 2021-11-15T14:36:07.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.212+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33e00b0c10 con 0x7f33e00b1f40 2021-11-15T14:36:07.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33d37fe700 1 -- 172.21.2.135:0/232482064 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33d8018020 con 0x7f33e00b1f40 2021-11-15T14:36:07.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 msgr2=0x7f33c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 0x7f33c0055ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f33dc015000 tx=0x7f33dc014000).stop 2021-11-15T14:36:07.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 msgr2=0x7f33e0148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f33e006a170 tx=0x7f33d8007f00).stop 2021-11-15T14:36:07.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 shutdown_connections 2021-11-15T14:36:07.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33c0053610 0x7f33c0055ad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f33e00b1f40 0x7f33e0148960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f33e00b0030 0x7f33e00ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 --2- 172.21.2.135:0/232482064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f33e00a7140 0x7f33e00b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 >> 172.21.2.135:0/232482064 conn(0x7f33e005f730 msgr2=0x7f33e005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:07.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 shutdown_connections 2021-11-15T14:36:07.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.872+0000 7f33e873a700 1 -- 172.21.2.135:0/232482064 wait complete. 2021-11-15T14:36:07.885 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:36:07.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 Processor -- start 2021-11-15T14:36:07.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 -- start start 2021-11-15T14:36:07.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6d600b6980 0x7f6d600acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600b6d60 con 0x7f6d60060990 2021-11-15T14:36:07.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d60061260 con 0x7f6d600b6980 2021-11-15T14:36:07.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.932+0000 7f6d6786c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60061500 con 0x7f6d600aa650 2021-11-15T14:36:07.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65608700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6d600b6980 0x7f6d600acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:38104/0 (socket says 172.21.2.135:38104) 2021-11-15T14:36:07.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 -- 172.21.2.135:0/338527756 learned_addr learned my addr 172.21.2.135:0/338527756 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:07.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d64e07700 1 --1- 172.21.2.135:0/338527756 >> v1:172.21.2.119:6789/0 conn(0x7f6d60060990 0x7f6d600a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53562/0 (socket says 172.21.2.135:53562) 2021-11-15T14:36:07.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 -- 172.21.2.135:0/338527756 >> v2:172.21.2.119:3300/0 conn(0x7f6d600b6980 msgr2=0x7f6d600acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:07.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 --2- 172.21.2.135:0/338527756 >> v2:172.21.2.119:3300/0 conn(0x7f6d600b6980 0x7f6d600acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 -- 172.21.2.135:0/338527756 >> v1:172.21.2.119:6789/0 conn(0x7f6d60060990 legacy=0x7f6d600a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 -- 172.21.2.135:0/338527756 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600617a0 con 0x7f6d600aa650 2021-11-15T14:36:07.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d65e09700 1 --2- 172.21.2.135:0/338527756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6d580032f0 tx=0x7f6d58009290).ready entity=mon.2 client_cookie=6a3b8f242f78819e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d4ffff700 1 -- 172.21.2.135:0/338527756 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5800b8a0 con 0x7f6d600aa650 2021-11-15T14:36:07.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d4ffff700 1 -- 172.21.2.135:0/338527756 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5800ba00 con 0x7f6d600aa650 2021-11-15T14:36:07.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d4ffff700 1 -- 172.21.2.135:0/338527756 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5800bb70 con 0x7f6d600aa650 2021-11-15T14:36:07.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 -- 172.21.2.135:0/338527756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 msgr2=0x7f6d6013c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 --2- 172.21.2.135:0/338527756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6d580032f0 tx=0x7f6d58009290).stop 2021-11-15T14:36:07.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 -- 172.21.2.135:0/338527756 shutdown_connections 2021-11-15T14:36:07.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 --2- 172.21.2.135:0/338527756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600aa650 0x7f6d6013c4f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 --2- 172.21.2.135:0/338527756 >> v2:172.21.2.119:3300/0 conn(0x7f6d600b6980 0x7f6d600acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 -- 172.21.2.135:0/338527756 >> 172.21.2.135:0/338527756 conn(0x7f6d600b3500 msgr2=0x7f6d600b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:07.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 -- 172.21.2.135:0/338527756 shutdown_connections 2021-11-15T14:36:07.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 -- 172.21.2.135:0/338527756 wait complete. 2021-11-15T14:36:07.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.936+0000 7f6d6786c700 1 Processor -- start 2021-11-15T14:36:07.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- start start 2021-11-15T14:36:07.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 0x7f6d601330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 0x7f6d601335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60141030 con 0x7f6d600aa650 2021-11-15T14:36:07.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6013f360 con 0x7f6d60060990 2021-11-15T14:36:07.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601519a0 con 0x7f6d600b6980 2021-11-15T14:36:07.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56562/0 (socket says 172.21.2.135:56562) 2021-11-15T14:36:07.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 -- 172.21.2.135:0/834804791 learned_addr learned my addr 172.21.2.135:0/834804791 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:07.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d64e07700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 0x7f6d601330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65e09700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 0x7f6d601335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 -- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 msgr2=0x7f6d601335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 0x7f6d601335b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 -- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 msgr2=0x7f6d601330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:07.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 0x7f6d601330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:07.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 -- 172.21.2.135:0/834804791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009530 con 0x7f6d60060990 2021-11-15T14:36:07.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d64e07700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 0x7f6d601330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:07.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65e09700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 0x7f6d601335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:07.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d65608700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f6d6013f280 tx=0x7f6d5c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5c010780 con 0x7f6d60060990 2021-11-15T14:36:07.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0108e0 con 0x7f6d60060990 2021-11-15T14:36:07.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5c010c40 con 0x7f6d60060990 2021-11-15T14:36:07.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d601434f0 con 0x7f6d60060990 2021-11-15T14:36:07.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d60151700 con 0x7f6d60060990 2021-11-15T14:36:07.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60061a40 con 0x7f6d60060990 2021-11-15T14:36:07.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d5c01c460 con 0x7f6d60060990 2021-11-15T14:36:07.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 0x7f6d40055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:07.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f6d5c06bef0 con 0x7f6d60060990 2021-11-15T14:36:07.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.940+0000 7f6d64e07700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 0x7f6d40055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:07.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.944+0000 7f6d64e07700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 0x7f6d40055a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6d5000a000 tx=0x7f6d5000b040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:07.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:07.944+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d5c042e40 con 0x7f6d60060990 2021-11-15T14:36:08.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.024+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d600573d0 con 0x7f6d60060990 2021-11-15T14:36:08.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.876+0000 7f6d4e7fc700 1 -- 172.21.2.135:0/834804791 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6d5c046460 con 0x7f6d60060990 2021-11-15T14:36:08.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 msgr2=0x7f6d40055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 0x7f6d40055a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6d5000a000 tx=0x7f6d5000b040).stop 2021-11-15T14:36:08.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 msgr2=0x7f6d6013e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f6d6013f280 tx=0x7f6d5c006df0).stop 2021-11-15T14:36:08.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 shutdown_connections 2021-11-15T14:36:08.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d40053580 0x7f6d40055a40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:08.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d600b6980 0x7f6d601335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:08.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d600aa650 0x7f6d601330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:08.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 --2- 172.21.2.135:0/834804791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d60060990 0x7f6d6013e890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:08.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 >> 172.21.2.135:0/834804791 conn(0x7f6d600b3500 msgr2=0x7f6d600b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:08.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 shutdown_connections 2021-11-15T14:36:08.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.880+0000 7f6d6786c700 1 -- 172.21.2.135:0/834804791 wait complete. 2021-11-15T14:36:08.887 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:36:08.891 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:36:08.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 Processor -- start 2021-11-15T14:36:08.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 -- start start 2021-11-15T14:36:08.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f15e8060180 0x7f15e80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80aac30 con 0x7f15e80b4cc0 2021-11-15T14:36:08.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8060560 con 0x7f15e8067380 2021-11-15T14:36:08.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15eda0c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e8066f20 con 0x7f15e8060180 2021-11-15T14:36:08.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e67fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f15e8067380 0x7f15e8143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44162/0 (socket says 172.21.2.135:44162) 2021-11-15T14:36:08.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e67fc700 1 -- 172.21.2.135:0/4029853516 learned_addr learned my addr 172.21.2.135:0/4029853516 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:08.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599666356 0 0) 0x7f15e8060560 con 0x7f15e8067380 2021-11-15T14:36:08.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c8003260 con 0x7f15e8067380 2021-11-15T14:36:08.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877896499 0 0) 0x7f15c8003260 con 0x7f15e8067380 2021-11-15T14:36:08.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 >> v2:172.21.2.119:3300/0 conn(0x7f15e8060180 msgr2=0x7f15e80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:08.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 --2- 172.21.2.135:0/4029853516 >> v2:172.21.2.119:3300/0 conn(0x7f15e8060180 0x7f15e80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:08.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 >> v1:172.21.2.119:6789/0 conn(0x7f15e80b4cc0 legacy=0x7f15e814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:08.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80b3430 con 0x7f15e8067380 2021-11-15T14:36:08.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f15d8001660 con 0x7f15e8067380 2021-11-15T14:36:08.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 >> v1:172.21.2.135:6789/0 conn(0x7f15e8067380 legacy=0x7f15e8143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8003820 0x7f15c8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15c8004500 0x7f15c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 0x7f15c800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8066f20 con 0x7f15c8004500 2021-11-15T14:36:08.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8010350 con 0x7f15c8005050 2021-11-15T14:36:08.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8010510 con 0x7f15c8003820 2021-11-15T14:36:08.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.944+0000 7f15e77fe700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 0x7f15c800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:08.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 -- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8003820 msgr2=0x7f15c8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:08.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8003820 0x7f15c8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:08.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 -- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15c8004500 msgr2=0x7f15c8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:08.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15c8004500 0x7f15c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:08.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 -- 172.21.2.135:0/4029853516 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8003260 con 0x7f15c8005050 2021-11-15T14:36:08.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 -- 172.21.2.135:0/4029853516 reap_dead start 2021-11-15T14:36:08.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e77fe700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 0x7f15c800fb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f15e00012f0 tx=0x7f15e0007d60).ready entity=mon.1 client_cookie=5c0a0b1ebe9978f8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:08.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e00014c0 con 0x7f15c8005050 2021-11-15T14:36:08.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0006870 con 0x7f15c8005050 2021-11-15T14:36:08.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e5ffb700 1 -- 172.21.2.135:0/4029853516 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e0006bd0 con 0x7f15c8005050 2021-11-15T14:36:08.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 msgr2=0x7f15c800fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 0x7f15c800fb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f15e00012f0 tx=0x7f15e0007d60).stop 2021-11-15T14:36:08.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/4029853516 shutdown_connections 2021-11-15T14:36:08.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 --2- 172.21.2.135:0/4029853516 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15c8005050 0x7f15c800fb60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:08.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/4029853516 >> 172.21.2.135:0/4029853516 conn(0x7f15e805cfb0 msgr2=0x7f15e805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:08.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/4029853516 shutdown_connections 2021-11-15T14:36:08.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/4029853516 wait complete. 2021-11-15T14:36:08.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 Processor -- start 2021-11-15T14:36:08.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- start start 2021-11-15T14:36:08.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8005050 0x7f15e814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e813c990 0x7f15e8141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e814e440 con 0x7f15e813c990 2021-11-15T14:36:08.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8151630 con 0x7f15e8151d30 2021-11-15T14:36:08.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8062340 con 0x7f15c8005050 2021-11-15T14:36:08.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:08.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56584/0 (socket says 172.21.2.135:56584) 2021-11-15T14:36:08.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 -- 172.21.2.135:0/2863768672 learned_addr learned my addr 172.21.2.135:0/2863768672 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:08.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 -- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8005050 msgr2=0x7f15e814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8005050 0x7f15e814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:08.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 -- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e813c990 msgr2=0x7f15e8141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:08.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e813c990 0x7f15e8141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:08.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 -- 172.21.2.135:0/2863768672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80620a0 con 0x7f15e8151d30 2021-11-15T14:36:08.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15e67fc700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f15e805f260 tx=0x7f15d8001810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:08.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d8007170 con 0x7f15e8151d30 2021-11-15T14:36:08.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80072d0 con 0x7f15e8151d30 2021-11-15T14:36:08.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d8004920 con 0x7f15e8151d30 2021-11-15T14:36:08.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e8151890 con 0x7f15e8151d30 2021-11-15T14:36:08.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e80ac790 con 0x7f15e8151d30 2021-11-15T14:36:08.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e80573d0 con 0x7f15e8151d30 2021-11-15T14:36:08.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.948+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f15d8004a80 con 0x7f15e8151d30 2021-11-15T14:36:08.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.952+0000 7f15dffff700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 0x7f15cc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:08.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.952+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f15d806b1f0 con 0x7f15e8151d30 2021-11-15T14:36:08.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.952+0000 7f15e6ffd700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 0x7f15cc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:08.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.952+0000 7f15e6ffd700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 0x7f15cc055a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f15d0002f70 tx=0x7f15d0006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:08.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:08.952+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15d8042360 con 0x7f15e8151d30 2021-11-15T14:36:09.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.036+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f15e80ac790 con 0x7f15e8151d30 2021-11-15T14:36:09.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.896+0000 7f15dffff700 1 -- 172.21.2.135:0/2863768672 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 173+0+0 (secure 0 0 0) 0x7f15e80ac790 con 0x7f15e8151d30 2021-11-15T14:36:09.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 msgr2=0x7f15cc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 0x7f15cc055a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f15d0002f70 tx=0x7f15d0006a00).stop 2021-11-15T14:36:09.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 msgr2=0x7f15e813c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f15e805f260 tx=0x7f15d8001810).stop 2021-11-15T14:36:09.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 shutdown_connections 2021-11-15T14:36:09.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15cc0535b0 0x7f15cc055a70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:09.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15e813c990 0x7f15e8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15e8151d30 0x7f15e813c4a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:09.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 --2- 172.21.2.135:0/2863768672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15c8005050 0x7f15e814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 >> 172.21.2.135:0/2863768672 conn(0x7f15e805cfb0 msgr2=0x7f15e80b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:09.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 shutdown_connections 2021-11-15T14:36:09.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.900+0000 7f15eda0c700 1 -- 172.21.2.135:0/2863768672 wait complete. 2021-11-15T14:36:09.907 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:36:09.911 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:36:09.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 Processor -- start 2021-11-15T14:36:09.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- start start 2021-11-15T14:36:09.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9bb00b1350 0x7f9bb00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb00a7850 con 0x7f9bb00b2320 2021-11-15T14:36:09.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb00b06d0 con 0x7f9bb00b1f40 2021-11-15T14:36:09.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb00b17c0 con 0x7f9bb00b1350 2021-11-15T14:36:09.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9bb00b1f40 0x7f9bb00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44180/0 (socket says 172.21.2.135:44180) 2021-11-15T14:36:09.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 -- 172.21.2.135:0/186143907 learned_addr learned my addr 172.21.2.135:0/186143907 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:09.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461650262 0 0) 0x7f9bb00b06d0 con 0x7f9bb00b1f40 2021-11-15T14:36:09.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b9c003260 con 0x7f9bb00b1f40 2021-11-15T14:36:09.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496222498 0 0) 0x7f9b9c003260 con 0x7f9bb00b1f40 2021-11-15T14:36:09.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 >> v2:172.21.2.119:3300/0 conn(0x7f9bb00b1350 msgr2=0x7f9bb00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:09.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 --2- 172.21.2.135:0/186143907 >> v2:172.21.2.119:3300/0 conn(0x7f9bb00b1350 0x7f9bb00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 >> v1:172.21.2.119:6789/0 conn(0x7f9bb00b2320 legacy=0x7f9bb01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:09.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00b0970 con 0x7f9bb00b1f40 2021-11-15T14:36:09.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9ba4001660 con 0x7f9bb00b1f40 2021-11-15T14:36:09.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 >> v1:172.21.2.135:6789/0 conn(0x7f9bb00b1f40 legacy=0x7f9bb00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 0x7f9b9c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c004500 0x7f9b9c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b9c005050 0x7f9b9c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00b17c0 con 0x7f9b9c004500 2021-11-15T14:36:09.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c00bf40 con 0x7f9b9c003820 2021-11-15T14:36:09.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c00c100 con 0x7f9b9c005050 2021-11-15T14:36:09.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 0x7f9b9c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:09.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 -- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b9c005050 msgr2=0x7f9b9c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:09.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b9c005050 0x7f9b9c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 -- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c004500 msgr2=0x7f9b9c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:09.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c004500 0x7f9b9c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 -- 172.21.2.135:0/186143907 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c003260 con 0x7f9b9c003820 2021-11-15T14:36:09.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb543d700 1 -- 172.21.2.135:0/186143907 reap_dead start 2021-11-15T14:36:09.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 0x7f9b9c003c20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9bb00ad350 tx=0x7f9bb00b0b00).ready entity=mon.1 client_cookie=8e4d6a093fa59f1c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:09.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba40070d0 con 0x7f9b9c003820 2021-11-15T14:36:09.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4007230 con 0x7f9b9c003820 2021-11-15T14:36:09.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9baf7fe700 1 -- 172.21.2.135:0/186143907 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba400c8f0 con 0x7f9b9c003820 2021-11-15T14:36:09.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 msgr2=0x7f9b9c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 0x7f9b9c003c20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9bb00ad350 tx=0x7f9bb00b0b00).stop 2021-11-15T14:36:09.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/186143907 shutdown_connections 2021-11-15T14:36:09.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/186143907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b9c003820 0x7f9b9c003c20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:09.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/186143907 >> 172.21.2.135:0/186143907 conn(0x7f9bb005f730 msgr2=0x7f9bb005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:09.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/186143907 shutdown_connections 2021-11-15T14:36:09.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.960+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/186143907 wait complete. 2021-11-15T14:36:09.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 Processor -- start 2021-11-15T14:36:09.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- start start 2021-11-15T14:36:09.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c003820 0x7f9bb0140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9bb015a450 0x7f9bb015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0146150 con 0x7f9b9c003820 2021-11-15T14:36:09.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00aa9c0 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00ab930 con 0x7f9bb015a450 2021-11-15T14:36:09.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:09.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56604/0 (socket says 172.21.2.135:56604) 2021-11-15T14:36:09.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 -- 172.21.2.135:0/1091172 learned_addr learned my addr 172.21.2.135:0/1091172 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:09.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 -- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9bb015a450 msgr2=0x7f9bb015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9bb015a450 0x7f9bb015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 -- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c003820 msgr2=0x7f9bb0140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:09.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c003820 0x7f9bb0140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:09.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 -- 172.21.2.135:0/1091172 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0146ea0 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9baffff700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9bb01471e0 tx=0x7f9ba0006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:09.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba0009e00 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0013460 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba00137c0 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb0145920 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb00ac5a0 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb00b0c10 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ba000f070 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 0x7f9b90055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:09.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f9ba006afc0 con 0x7f9bb00ab4b0 2021-11-15T14:36:09.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.964+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 0x7f9b90055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:09.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.968+0000 7f9bb4c3c700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 0x7f9b90055a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9bb00ad350 tx=0x7f9ba4013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:09.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:09.968+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ba00422a0 con 0x7f9bb00ab4b0 2021-11-15T14:36:10.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.052+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9bb0147030 con 0x7f9bb00ab4b0 2021-11-15T14:36:10.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9badffb700 1 -- 172.21.2.135:0/1091172 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ba00458c0 con 0x7f9bb00ab4b0 2021-11-15T14:36:10.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 msgr2=0x7f9b90055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 0x7f9b90055a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9bb00ad350 tx=0x7f9ba4013000).stop 2021-11-15T14:36:10.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 msgr2=0x7f9bb0147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9bb01471e0 tx=0x7f9ba0006de0).stop 2021-11-15T14:36:10.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 shutdown_connections 2021-11-15T14:36:10.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b900535b0 0x7f9b90055a70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9bb015a450 0x7f9bb015a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9bb00ab4b0 0x7f9bb0147300 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 --2- 172.21.2.135:0/1091172 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b9c003820 0x7f9bb0140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 >> 172.21.2.135:0/1091172 conn(0x7f9bb005f730 msgr2=0x7f9bb013e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:10.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 shutdown_connections 2021-11-15T14:36:10.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.056+0000 7f9bb6ea0700 1 -- 172.21.2.135:0/1091172 wait complete. 2021-11-15T14:36:10.069 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-15T14:36:10.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 Processor -- start 2021-11-15T14:36:10.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- start start 2021-11-15T14:36:10.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff808060180 0x7ff8080b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff8080b4cc0 0x7ff80814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8080aac30 con 0x7ff808067380 2021-11-15T14:36:10.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff808060560 con 0x7ff8080b4cc0 2021-11-15T14:36:10.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff808066f20 con 0x7ff808060180 2021-11-15T14:36:10.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff808060180 0x7ff8080b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff808060180 0x7ff8080b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56610/0 (socket says 172.21.2.135:56610) 2021-11-15T14:36:10.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 -- 172.21.2.135:0/3171520140 learned_addr learned my addr 172.21.2.135:0/3171520140 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:10.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 -- 172.21.2.135:0/3171520140 >> v2:172.21.2.119:3300/0 conn(0x7ff8080b4cc0 msgr2=0x7ff80814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:10.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 --2- 172.21.2.135:0/3171520140 >> v2:172.21.2.119:3300/0 conn(0x7ff8080b4cc0 0x7ff80814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 -- 172.21.2.135:0/3171520140 >> v1:172.21.2.119:6789/0 conn(0x7ff808067380 legacy=0x7ff808143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:10.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 -- 172.21.2.135:0/3171520140 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080b3430 con 0x7ff808060180 2021-11-15T14:36:10.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80659c700 1 --2- 172.21.2.135:0/3171520140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff808060180 0x7ff8080b47d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7ff80805f260 tx=0x7ff7f8006eb0).ready entity=mon.1 client_cookie=e076b4f7a0eeae6c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80559a700 1 -- 172.21.2.135:0/3171520140 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f800d5c0 con 0x7ff808060180 2021-11-15T14:36:10.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80559a700 1 -- 172.21.2.135:0/3171520140 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8000e90 con 0x7ff808060180 2021-11-15T14:36:10.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80559a700 1 -- 172.21.2.135:0/3171520140 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f800d910 con 0x7ff808060180 2021-11-15T14:36:10.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- 172.21.2.135:0/3171520140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff808060180 msgr2=0x7ff8080b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3171520140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff808060180 0x7ff8080b47d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7ff80805f260 tx=0x7ff7f8006eb0).stop 2021-11-15T14:36:10.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- 172.21.2.135:0/3171520140 shutdown_connections 2021-11-15T14:36:10.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3171520140 >> v2:172.21.2.119:3300/0 conn(0x7ff8080b4cc0 0x7ff80814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3171520140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff808060180 0x7ff8080b47d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- 172.21.2.135:0/3171520140 >> 172.21.2.135:0/3171520140 conn(0x7ff80805cfb0 msgr2=0x7ff80805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:10.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- 172.21.2.135:0/3171520140 shutdown_connections 2021-11-15T14:36:10.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- 172.21.2.135:0/3171520140 wait complete. 2021-11-15T14:36:10.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 Processor -- start 2021-11-15T14:36:10.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- start start 2021-11-15T14:36:10.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff808060180 0x7ff8080b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff808067380 0x7ff8081505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080adb50 con 0x7ff808060180 2021-11-15T14:36:10.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080ad6c0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff80cddf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080ac830 con 0x7ff808067380 2021-11-15T14:36:10.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56618/0 (socket says 172.21.2.135:56618) 2021-11-15T14:36:10.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 -- 172.21.2.135:0/3552501407 learned_addr learned my addr 172.21.2.135:0/3552501407 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:10.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 -- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff808067380 msgr2=0x7ff8081505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff808067380 0x7ff8081505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 -- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff808060180 msgr2=0x7ff8080b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff808060180 0x7ff8080b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.116+0000 7ff806d9d700 1 -- 172.21.2.135:0/3552501407 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f800b1e0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff806d9d700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7ff8000032f0 tx=0x7ff8000091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80000d4a0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80000d600 con 0x7ff8080b4cc0 2021-11-15T14:36:10.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8080acad0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80000d960 con 0x7ff8080b4cc0 2021-11-15T14:36:10.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8080add40 con 0x7ff8080b4cc0 2021-11-15T14:36:10.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8080573d0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff800018030 con 0x7ff8080b4cc0 2021-11-15T14:36:10.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 0x7ff7ec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff80006b240 con 0x7ff8080b4cc0 2021-11-15T14:36:10.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff80659c700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 0x7ff7ec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff80659c700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 0x7ff7ec055b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff80805f260 tx=0x7ff7f8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.120+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8000424c0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.240+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7ff8080aded0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff7ff7fe700 1 -- 172.21.2.135:0/3552501407 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v87) v1 ==== 139+0+0 (secure 0 0 0) 0x7ff800045ae0 con 0x7ff8080b4cc0 2021-11-15T14:36:10.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 msgr2=0x7ff7ec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 0x7ff7ec055b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff80805f260 tx=0x7ff7f8015000).stop 2021-11-15T14:36:10.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 msgr2=0x7ff808150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7ff8000032f0 tx=0x7ff8000091a0).stop 2021-11-15T14:36:10.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 shutdown_connections 2021-11-15T14:36:10.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7ec053660 0x7ff7ec055b20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8080b4cc0 0x7ff808150a90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff808067380 0x7ff8081505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 --2- 172.21.2.135:0/3552501407 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff808060180 0x7ff8080b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 >> 172.21.2.135:0/3552501407 conn(0x7ff80805cfb0 msgr2=0x7ff808144830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:10.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 shutdown_connections 2021-11-15T14:36:10.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.896+0000 7ff80cddf700 1 -- 172.21.2.135:0/3552501407 wait complete. 2021-11-15T14:36:10.908 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T14:36:10.908 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T14:36:10.909 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-15T14:36:10.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 Processor -- start 2021-11-15T14:36:10.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- start start 2021-11-15T14:36:10.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff9880b1e30 0x7ff9880b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff988148420 0x7ff9880b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9881447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880a9140 con 0x7ff9880b1e30 2021-11-15T14:36:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880b03d0 con 0x7ff988148420 2021-11-15T14:36:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b0670 con 0x7ff9880a7140 2021-11-15T14:36:10.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff988148420 0x7ff9880b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff988148420 0x7ff9880b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56622/0 (socket says 172.21.2.135:56622) 2021-11-15T14:36:10.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 -- 172.21.2.135:0/728369012 learned_addr learned my addr 172.21.2.135:0/728369012 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:10.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 -- 172.21.2.135:0/728369012 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 msgr2=0x7ff9881447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:10.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 --2- 172.21.2.135:0/728369012 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9881447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 -- 172.21.2.135:0/728369012 >> v2:172.21.2.119:3300/0 conn(0x7ff9880b1e30 msgr2=0x7ff9880b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:10.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 --2- 172.21.2.135:0/728369012 >> v2:172.21.2.119:3300/0 conn(0x7ff9880b1e30 0x7ff9880b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 -- 172.21.2.135:0/728369012 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880b0910 con 0x7ff988148420 2021-11-15T14:36:10.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff9877fe700 1 --2- 172.21.2.135:0/728369012 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff9880b2210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff9881477b0 tx=0x7ff978006eb0).ready entity=mon.1 client_cookie=caaeb0107a9ab6a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff986ffd700 1 -- 172.21.2.135:0/728369012 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97800d570 con 0x7ff988148420 2021-11-15T14:36:10.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff986ffd700 1 -- 172.21.2.135:0/728369012 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978000e90 con 0x7ff988148420 2021-11-15T14:36:10.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff986ffd700 1 -- 172.21.2.135:0/728369012 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97800d8c0 con 0x7ff988148420 2021-11-15T14:36:10.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- 172.21.2.135:0/728369012 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 msgr2=0x7ff9880b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- 172.21.2.135:0/728369012 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff9880b2210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff9881477b0 tx=0x7ff978006eb0).stop 2021-11-15T14:36:10.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- 172.21.2.135:0/728369012 shutdown_connections 2021-11-15T14:36:10.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- 172.21.2.135:0/728369012 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9881447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- 172.21.2.135:0/728369012 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff9880b2210 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 --2- 172.21.2.135:0/728369012 >> v2:172.21.2.119:3300/0 conn(0x7ff9880b1e30 0x7ff9880b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:10.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- 172.21.2.135:0/728369012 >> 172.21.2.135:0/728369012 conn(0x7ff98805f730 msgr2=0x7ff98805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:10.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- 172.21.2.135:0/728369012 shutdown_connections 2021-11-15T14:36:10.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.956+0000 7ff98e94f700 1 -- 172.21.2.135:0/728369012 wait complete. 2021-11-15T14:36:10.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 Processor -- start 2021-11-15T14:36:10.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- start start 2021-11-15T14:36:10.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9880aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 0x7ff98815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880ac100 con 0x7ff9880b1e30 2021-11-15T14:36:10.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880a9a40 con 0x7ff988148420 2021-11-15T14:36:10.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880ab4a0 con 0x7ff9880a7140 2021-11-15T14:36:10.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56632/0 (socket says 172.21.2.135:56632) 2021-11-15T14:36:10.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 -- 172.21.2.135:0/2736617143 learned_addr learned my addr 172.21.2.135:0/2736617143 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:10.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9877fe700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 0x7ff98815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff987fff700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9880aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 -- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 msgr2=0x7ff9880aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9880aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 -- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 msgr2=0x7ff98815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:10.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 0x7ff98815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:10.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 -- 172.21.2.135:0/2736617143 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97800b1e0 con 0x7ff988148420 2021-11-15T14:36:10.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9877fe700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 0x7ff98815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff987fff700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9880aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98ceec700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff980003330 tx=0x7ff9800091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff980001520 con 0x7ff988148420 2021-11-15T14:36:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980001680 con 0x7ff988148420 2021-11-15T14:36:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9800019e0 con 0x7ff988148420 2021-11-15T14:36:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880ab740 con 0x7ff988148420 2021-11-15T14:36:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9880af760 con 0x7ff988148420 2021-11-15T14:36:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9880a9c40 con 0x7ff988148420 2021-11-15T14:36:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff980018030 con 0x7ff988148420 2021-11-15T14:36:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 0x7ff968055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff98006b2c0 con 0x7ff988148420 2021-11-15T14:36:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.960+0000 7ff987fff700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 0x7ff968055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.964+0000 7ff987fff700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 0x7ff968055b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff97c007000 tx=0x7ff97c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:10.964+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff980042540 con 0x7ff988148420 2021-11-15T14:36:11.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.076+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7ff9880ab8d0 con 0x7ff988148420 2021-11-15T14:36:11.422 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:11.425 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:11.429 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:11.432 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:11.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.904+0000 7ff9857fa700 1 -- 172.21.2.135:0/2736617143 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v88) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff980045b60 con 0x7ff988148420 2021-11-15T14:36:11.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 msgr2=0x7ff968055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:11.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 0x7ff968055b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff97c007000 tx=0x7ff97c008040).stop 2021-11-15T14:36:11.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 msgr2=0x7ff98815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:11.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff980003330 tx=0x7ff9800091a0).stop 2021-11-15T14:36:11.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 shutdown_connections 2021-11-15T14:36:11.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff968053640 0x7ff968055b00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:11.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff988148420 0x7ff98815a600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:11.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9880b1e30 0x7ff98815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:11.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 --2- 172.21.2.135:0/2736617143 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9880a7140 0x7ff9880aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:11.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 >> 172.21.2.135:0/2736617143 conn(0x7ff98805f730 msgr2=0x7ff9881448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:11.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 shutdown_connections 2021-11-15T14:36:11.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.908+0000 7ff98e94f700 1 -- 172.21.2.135:0/2736617143 wait complete. 2021-11-15T14:36:11.918 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:36:11.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 Processor -- start 2021-11-15T14:36:11.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- start start 2021-11-15T14:36:11.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b1f40 0x7fa9c00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa9c00b2320 0x7fa9c01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c00a7850 con 0x7fa9c00b0030 2021-11-15T14:36:11.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c00b0470 con 0x7fa9c00b2320 2021-11-15T14:36:11.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00b06d0 con 0x7fa9c00b1f40 2021-11-15T14:36:11.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9bf7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa9c00b0030 0x7fa9c00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44230/0 (socket says 172.21.2.135:44230) 2021-11-15T14:36:11.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9bf7fe700 1 -- 172.21.2.135:0/2694110258 learned_addr learned my addr 172.21.2.135:0/2694110258 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:11.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2694110258 >> v2:172.21.2.135:3300/0 conn(0x7fa9c00b2320 0x7fa9c01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:11.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2694110258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b1f40 msgr2=0x7fa9c00b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:11.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2694110258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b1f40 0x7fa9c00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:11.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2694110258 >> v1:172.21.2.135:6789/0 conn(0x7fa9c00b0030 legacy=0x7fa9c00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:11.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2694110258 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c00b0970 con 0x7fa9c00b2320 2021-11-15T14:36:11.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2694110258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c01412d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fa9b80032f0 tx=0x7fa9b80091d0).ready entity=mon.1 client_cookie=4355b20a50e1e08e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:11.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9beffd700 1 -- 172.21.2.135:0/2694110258 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b8009ea0 con 0x7fa9c00b2320 2021-11-15T14:36:11.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9beffd700 1 -- 172.21.2.135:0/2694110258 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b800b8a0 con 0x7fa9c00b2320 2021-11-15T14:36:11.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9beffd700 1 -- 172.21.2.135:0/2694110258 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b800ba10 con 0x7fa9c00b2320 2021-11-15T14:36:11.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- 172.21.2.135:0/2694110258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 msgr2=0x7fa9c01412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:11.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2694110258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c01412d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fa9b80032f0 tx=0x7fa9b80091d0).stop 2021-11-15T14:36:11.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- 172.21.2.135:0/2694110258 shutdown_connections 2021-11-15T14:36:11.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2694110258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c01412d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:11.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2694110258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b1f40 0x7fa9c00b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:11.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- 172.21.2.135:0/2694110258 >> 172.21.2.135:0/2694110258 conn(0x7fa9c005f730 msgr2=0x7fa9c005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:11.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- 172.21.2.135:0/2694110258 shutdown_connections 2021-11-15T14:36:11.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.964+0000 7fa9c696b700 1 -- 172.21.2.135:0/2694110258 wait complete. 2021-11-15T14:36:11.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 Processor -- start 2021-11-15T14:36:11.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- start start 2021-11-15T14:36:11.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b0030 0x7fa9c0145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c00b1f40 0x7fa9c00aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00a9580 con 0x7fa9c00b1f40 2021-11-15T14:36:11.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00a9770 con 0x7fa9c00b2320 2021-11-15T14:36:11.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00aa6c0 con 0x7fa9c00b0030 2021-11-15T14:36:11.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:11.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56646/0 (socket says 172.21.2.135:56646) 2021-11-15T14:36:11.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2129019934 learned_addr learned my addr 172.21.2.135:0/2129019934 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:11.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b0030 msgr2=0x7fa9c0145330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:11.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b0030 0x7fa9c0145330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:11.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c00b1f40 msgr2=0x7fa9c00aa010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:11.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c00b1f40 0x7fa9c00aa010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 -- 172.21.2.135:0/2129019934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8009470 con 0x7fa9c00b2320 2021-11-15T14:36:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c4f08700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fa9b80032f0 tx=0x7fa9b8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b8011e40 con 0x7fa9c00b2320 2021-11-15T14:36:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b801f3f0 con 0x7fa9c00b2320 2021-11-15T14:36:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b801f750 con 0x7fa9c00b2320 2021-11-15T14:36:11.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c00aaa00 con 0x7fa9c00b2320 2021-11-15T14:36:11.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c014aa20 con 0x7fa9c00b2320 2021-11-15T14:36:11.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c00aa500 con 0x7fa9c00b2320 2021-11-15T14:36:11.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9b8026030 con 0x7fa9c00b2320 2021-11-15T14:36:11.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 0x7fa9a0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:11.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa9b806c540 con 0x7fa9c00b2320 2021-11-15T14:36:11.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bffff700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 0x7fa9a0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.968+0000 7fa9bffff700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 0x7fa9a0055a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fa9b0002f70 tx=0x7fa9b0006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:11.972+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9b8043860 con 0x7fa9c00b2320 2021-11-15T14:36:12.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.052+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa9c00aab90 con 0x7fa9c00b2320 2021-11-15T14:36:12.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.064+0000 7fa9bd7fa700 1 -- 172.21.2.135:0/2129019934 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa9b80150c0 con 0x7fa9c00b2320 2021-11-15T14:36:12.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 msgr2=0x7fa9a0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 0x7fa9a0055a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fa9b0002f70 tx=0x7fa9b0006a00).stop 2021-11-15T14:36:12.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 msgr2=0x7fa9c014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fa9b80032f0 tx=0x7fa9b8016000).stop 2021-11-15T14:36:12.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 shutdown_connections 2021-11-15T14:36:12.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9a00535b0 0x7fa9a0055a70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9c00b2320 0x7fa9c014c1a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9c00b1f40 0x7fa9c00aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 --2- 172.21.2.135:0/2129019934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9c00b0030 0x7fa9c0145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 >> 172.21.2.135:0/2129019934 conn(0x7fa9c005f730 msgr2=0x7fa9c00ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 shutdown_connections 2021-11-15T14:36:12.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.068+0000 7fa9c696b700 1 -- 172.21.2.135:0/2129019934 wait complete. 2021-11-15T14:36:12.078 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:36:12.079 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:12.087 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:12.100 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:12.109 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:36:12.121 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:36:12.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:12.122 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:12.123 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:12.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:36:12.127 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:36:12.127 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:12.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:12.128 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:12.128 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:36:12.150 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:36:12.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:36:12.151 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:36:12.152 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:36:12.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 Processor -- start 2021-11-15T14:36:12.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 -- start start 2021-11-15T14:36:12.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 0x7f0d440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440b03d0 con 0x7f0d440b1e30 2021-11-15T14:36:12.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440b0670 con 0x7f0d440a7140 2021-11-15T14:36:12.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d498c7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440a9140 con 0x7f0d44148420 2021-11-15T14:36:12.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d437fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0d440a7140 0x7f0d441447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44246/0 (socket says 172.21.2.135:44246) 2021-11-15T14:36:12.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d437fe700 1 -- 172.21.2.135:0/1767413731 learned_addr learned my addr 172.21.2.135:0/1767413731 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:12.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661089284 0 0) 0x7f0d440b0670 con 0x7f0d440a7140 2021-11-15T14:36:12.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d24003260 con 0x7f0d440a7140 2021-11-15T14:36:12.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.244+0000 7f0d427fc700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 0x7f0d440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073744560 0 0) 0x7f0d24003260 con 0x7f0d440a7140 2021-11-15T14:36:12.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 msgr2=0x7f0d440b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 0x7f0d440b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 >> v1:172.21.2.119:6789/0 conn(0x7f0d440b1e30 legacy=0x7f0d440b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440b0910 con 0x7f0d440a7140 2021-11-15T14:36:12.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0d3c0019e0 con 0x7f0d440a7140 2021-11-15T14:36:12.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 >> v1:172.21.2.135:6789/0 conn(0x7f0d440a7140 legacy=0x7f0d441447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d24003750 0x7f0d24003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d24004500 0x7f0d24004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 0x7f0d24004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400b800 con 0x7f0d24003750 2021-11-15T14:36:12.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400b940 con 0x7f0d24004500 2021-11-15T14:36:12.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400bb00 con 0x7f0d44148420 2021-11-15T14:36:12.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d24004500 0x7f0d24004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 -- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 msgr2=0x7f0d24004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d44148420 0x7f0d24004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 -- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d24003750 msgr2=0x7f0d24003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d24003750 0x7f0d24003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 -- 172.21.2.135:0/1767413731 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24003260 con 0x7f0d24004500 2021-11-15T14:36:12.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d427fc700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d24004500 0x7f0d24004980 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f0d2c00a000 tx=0x7f0d2c008040).ready entity=mon.1 client_cookie=5fb7b1982afbc85d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c013670 con 0x7f0d24004500 2021-11-15T14:36:12.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0137d0 con 0x7f0d24004500 2021-11-15T14:36:12.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d41ffb700 1 -- 172.21.2.135:0/1767413731 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c013b30 con 0x7f0d24004500 2021-11-15T14:36:12.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/1767413731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d24004500 msgr2=0x7f0d24004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 --2- 172.21.2.135:0/1767413731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d24004500 0x7f0d24004980 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f0d2c00a000 tx=0x7f0d2c008040).stop 2021-11-15T14:36:12.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 -- 172.21.2.135:0/1767413731 reap_dead start 2021-11-15T14:36:12.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/1767413731 shutdown_connections 2021-11-15T14:36:12.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/1767413731 >> 172.21.2.135:0/1767413731 conn(0x7f0d4405f730 msgr2=0x7f0d4405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/1767413731 shutdown_connections 2021-11-15T14:36:12.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/1767413731 wait complete. 2021-11-15T14:36:12.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 Processor -- start 2021-11-15T14:36:12.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- start start 2021-11-15T14:36:12.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d24004500 0x7f0d441569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d4414ba20 0x7f0d441434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44149370 con 0x7f0d4414ba20 2021-11-15T14:36:12.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44149610 con 0x7f0d44148b80 2021-11-15T14:36:12.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44159f10 con 0x7f0d24004500 2021-11-15T14:36:12.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56668/0 (socket says 172.21.2.135:56668) 2021-11-15T14:36:12.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 -- 172.21.2.135:0/2331536473 learned_addr learned my addr 172.21.2.135:0/2331536473 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:12.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d42ffd700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d24004500 0x7f0d441569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 -- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d24004500 msgr2=0x7f0d441569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d24004500 0x7f0d441569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 -- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d4414ba20 msgr2=0x7f0d441434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d4414ba20 0x7f0d441434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 -- 172.21.2.135:0/2331536473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4415a1b0 con 0x7f0d44148b80 2021-11-15T14:36:12.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d437fe700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0d3c0016f0 tx=0x7f0d440b0800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d3c004ab0 con 0x7f0d44148b80 2021-11-15T14:36:12.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d44143990 con 0x7f0d44148b80 2021-11-15T14:36:12.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c004c10 con 0x7f0d44148b80 2021-11-15T14:36:12.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d3c007170 con 0x7f0d44148b80 2021-11-15T14:36:12.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.248+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4415ab40 con 0x7f0d44148b80 2021-11-15T14:36:12.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d441491a0 con 0x7f0d44148b80 2021-11-15T14:36:12.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d3c010070 con 0x7f0d44148b80 2021-11-15T14:36:12.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d3bfff700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 0x7f0d28055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0d3c06b690 con 0x7f0d44148b80 2021-11-15T14:36:12.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d42ffd700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 0x7f0d28055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d42ffd700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 0x7f0d28055b60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0d34008000 tx=0x7f0d34009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.252+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d3c042860 con 0x7f0d44148b80 2021-11-15T14:36:12.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0d4415a340 con 0x7f0d44148b80 2021-11-15T14:36:12.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d3bfff700 1 -- 172.21.2.135:0/2331536473 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v39) v1 ==== 81+0+29219 (secure 0 0 0) 0x7f0d3c045e80 con 0x7f0d44148b80 2021-11-15T14:36:12.343 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:12.343 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:36:12.343 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 39, 2021-11-15T14:36:12.343 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:36:12.344 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:36:12.344 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:36:09.883433+0000", 2021-11-15T14:36:12.344 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:36:12.344 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:36:12.344 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:36:12.345 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:36:12.345 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:36:12.345 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:36:12.345 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:36:12.346 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:36:12.346 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:36:12.346 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:12.346 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:36:12.347 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:36:12.347 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:36:12.347 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:36:12.347 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:36:12.347 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 6, 2021-11-15T14:36:12.348 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:36:12.348 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:36:12.348 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:36:12.348 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:36:12.349 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:36:12.349 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.349 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:36:12.349 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:36:12.349 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:36:12.350 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:12.350 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:12.350 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:12.350 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:12.351 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:12.351 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:12.351 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:12.351 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:12.351 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:36:12.352 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:36:12.352 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:36:12.352 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:36:12.352 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:36:12.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:12.353 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:12.353 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:12.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:12.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:12.354 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:12.354 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:12.354 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.354 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:36:12.354 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:12.355 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:12.355 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:12.355 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:12.355 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:12.356 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:12.356 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:12.356 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:12.356 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:12.357 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:12.357 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:12.357 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:12.357 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:12.357 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:12.358 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:12.358 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:12.358 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:12.358 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:12.359 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:12.359 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:12.359 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:12.359 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:12.359 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:12.360 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:12.360 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:12.360 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:12.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.361 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:12.361 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:12.361 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:12.361 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:12.361 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:12.362 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:12.362 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:12.362 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:12.362 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:12.362 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:12.363 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:12.363 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:36:12.363 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:36:12.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.364 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:12.364 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:36:12.364 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.364 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.365 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.365 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:36:12.365 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:36:12.365 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:36:12.365 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:36:12.366 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:36:12.366 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:36:12.366 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:36:12.366 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:36:12.367 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:36:12.367 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:36:12.367 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:36:12.367 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:36:12.367 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:36:12.368 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:36:12.368 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:36:12.368 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:36:12.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:36:12.368 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:36:12.369 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:36:12.369 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:36:12.369 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:36:12.369 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:36:12.370 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:36:12.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.370 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:36:12.370 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:36:12.371 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:36:12.371 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:36:12.371 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:36:12.371 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:36:12.371 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:36:12.372 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:36:12.372 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:36:12.372 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:36:12.372 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:36:12.372 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:36:12.373 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:36:12.373 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:36:12.373 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:36:12.373 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:36:12.374 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:36:12.374 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:36:12.374 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:36:12.374 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:36:12.374 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:36:12.375 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:36:12.375 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:36:12.375 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:36:12.375 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:36:12.376 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:36:12.376 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:36:12.376 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.376 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:36:12.376 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:36:12.377 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:36:12.377 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:36:12.377 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:36:12.377 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:36:12.377 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:36:12.378 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:36:12.378 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:36:12.378 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:36:12.378 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:36:12.378 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:36:12.379 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:36:12.379 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:36:12.379 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.379 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.380 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:12.380 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:36:12.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.380 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:36:12.380 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:36:12.381 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.381 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.381 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.381 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.382 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.382 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.382 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.382 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:12.382 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.383 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.383 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.383 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.383 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.384 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.384 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:36:12.384 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.384 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.385 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.385 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:36:12.385 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.385 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.385 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.386 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.386 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.386 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.386 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.387 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.387 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:36:12.387 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.387 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.387 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.388 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.388 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:36:12.388 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.388 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.389 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.389 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.389 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.390 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.390 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.390 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:36:12.390 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:36:12.391 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.392 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.392 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.392 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.392 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.393 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.393 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:36:12.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.394 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:36:12.394 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:36:12.395 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.395 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.395 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:36:12.395 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:36:12.396 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:36:12.396 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:36:12.396 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.396 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.396 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.397 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.397 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:36:12.398 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:36:12.398 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.398 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.398 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.398 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.399 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.399 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 14, 2021-11-15T14:36:12.399 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.400 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.400 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.401 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.401 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:36:12.401 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.401 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.401 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.402 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.402 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:36:12.402 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.402 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.402 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.403 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.403 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.404 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.404 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:36:12.404 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.404 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.405 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.405 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.405 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:36:12.405 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.406 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.406 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.406 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.406 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.407 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.407 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:36:12.407 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.408 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.408 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:36:12.408 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.409 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.409 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.409 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.409 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.410 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.410 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:36:12.410 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.411 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.411 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.411 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:36:12.411 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:36:12.412 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.412 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.412 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:36:12.413 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:36:12.413 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:36:12.413 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:36:12.413 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.413 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.414 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.414 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.414 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:36:12.415 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:36:12.415 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.415 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.415 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.416 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.416 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.416 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.416 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.416 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 22, 2021-11-15T14:36:12.417 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.417 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.417 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.417 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.418 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.418 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:36:12.418 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.418 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.419 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.419 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.419 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:36:12.419 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.420 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.420 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.420 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.420 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.421 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.421 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.421 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:36:12.421 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.421 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.422 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.422 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.422 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:36:12.422 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.423 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.423 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.423 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.423 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.423 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.424 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.424 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.424 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:36:12.424 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.425 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.425 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.425 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:36:12.425 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.425 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.426 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.426 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.427 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.427 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.427 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:36:12.427 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.427 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.428 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.428 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.428 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:36:12.428 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:36:12.428 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.429 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.429 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.429 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:36:12.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:36:12.429 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:36:12.430 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:36:12.430 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.430 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.430 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.431 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.431 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.431 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:36:12.431 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:36:12.432 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.432 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.432 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.432 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.432 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.433 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.433 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.433 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:12.433 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.434 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.434 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.434 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.434 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:36:12.435 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.436 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:36:12.436 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.436 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.436 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.437 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.437 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.437 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.437 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.438 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:36:12.438 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.438 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.438 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.439 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.439 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:36:12.439 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.439 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.439 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.440 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.440 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.440 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.441 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.441 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:36:12.441 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.441 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.442 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.442 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:36:12.442 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.442 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.443 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.443 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.443 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.443 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.444 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:36:12.444 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.445 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.445 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.445 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:36:12.445 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:36:12.445 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.446 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.446 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.446 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:36:12.446 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:36:12.447 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:36:12.447 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:36:12.447 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.447 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.447 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.448 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.448 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.448 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.448 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:36:12.448 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:36:12.449 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.449 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.449 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.449 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.450 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.450 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.450 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.450 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 31, 2021-11-15T14:36:12.450 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.451 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.451 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:36:12.452 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.452 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.452 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.453 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:36:12.453 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.453 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.453 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.454 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.454 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.454 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.455 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:36:12.455 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.455 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.455 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.456 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:36:12.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.456 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.456 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.457 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.457 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.457 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.458 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:36:12.458 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.458 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:36:12.459 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.459 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.459 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.459 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.460 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.460 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.460 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:36:12.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.461 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.461 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.461 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:36:12.462 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:36:12.462 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.462 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.463 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:36:12.463 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:36:12.463 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:36:12.463 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:36:12.464 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.464 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.464 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.465 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.465 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:36:12.465 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:36:12.465 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.466 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.466 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.466 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.466 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.466 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.467 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.467 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:12.467 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.467 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.468 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:36:12.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:36:12.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.470 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.471 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.471 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.471 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:36:12.472 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.472 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.473 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:36:12.473 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.473 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.473 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.473 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.474 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.474 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.474 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.474 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.474 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:36:12.475 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.475 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.475 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.475 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:36:12.476 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.476 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.476 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.476 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.477 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.477 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:36:12.478 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.478 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.478 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.478 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:36:12.479 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:36:12.479 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.479 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.480 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:36:12.480 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:36:12.480 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:36:12.480 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:36:12.480 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.481 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.481 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.481 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.482 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.482 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:36:12.482 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:36:12.482 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.482 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.483 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.483 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.483 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.483 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.484 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.484 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:36:12.484 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.484 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.484 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.485 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:36:12.486 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:36:12.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.487 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.487 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.487 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.488 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.488 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:36:12.489 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.489 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.490 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:36:12.490 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.490 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.490 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.491 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.491 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.491 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.492 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:36:12.492 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.492 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.492 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.492 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.493 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:36:12.493 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.493 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.493 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.494 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.494 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.494 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.494 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:36:12.495 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.495 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.495 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.496 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:36:12.496 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:36:12.496 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.496 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.497 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.497 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:36:12.497 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:36:12.497 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:36:12.497 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:36:12.498 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.498 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.498 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.498 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.499 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:36:12.499 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:36:12.499 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:36:12.500 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:36:12.500 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:36:12.500 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:36:12.500 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:36:12.500 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:36:12.501 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:36:12.501 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 34, 2021-11-15T14:36:12.501 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:36:12.501 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:36:12.501 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:36:12.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.502 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:36:12.503 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.503 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.503 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:36:12.504 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.504 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.504 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.505 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:36:12.505 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.505 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.505 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.505 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:36:12.506 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.506 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.506 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.506 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.507 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:36:12.507 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.507 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.507 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.508 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:36:12.508 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.508 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.508 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:36:12.509 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.509 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.509 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.510 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:36:12.510 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.510 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.510 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.511 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:36:12.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:36:12.511 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.511 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:36:12.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:36:12.512 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.512 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.512 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:36:12.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:36:12.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:36:12.513 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.513 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.513 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.514 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:36:12.514 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:36:12.514 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:36:12.514 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:36:12.514 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:36:12.515 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:36:12.515 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:36:12.515 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:12.515 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.515 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:12.516 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:36:12.516 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.516 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:36:12.516 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.517 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.517 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.517 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.517 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.517 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:36:12.518 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.518 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.518 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:36:12.518 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.519 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.519 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.519 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.519 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.520 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:36:12.520 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.520 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.520 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:36:12.521 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.521 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.521 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.521 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.521 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.522 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:36:12.522 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.522 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.523 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:36:12.523 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.523 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.523 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.523 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.524 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.524 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:36:12.524 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.524 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.524 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.525 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:36:12.525 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.525 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.525 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.526 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.526 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.526 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:36:12.526 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.526 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.527 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.527 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:36:12.527 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.527 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.527 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.528 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.528 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.528 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:36:12.528 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.529 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.529 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.529 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:36:12.529 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.529 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.530 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.530 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.530 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.530 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:36:12.530 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.531 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.531 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:12.531 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:36:12.531 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:36:12.532 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:36:12.532 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:36:12.532 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:36:12.532 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:36:12.532 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:36:12.533 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:36:12.533 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.533 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:36:12.533 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:36:12.534 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:36:12.534 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:36:12.534 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:36:12.534 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:36:12.534 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/1684531282": "2021-11-16T14:36:06.563015+0000", 2021-11-15T14:36:12.535 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/1684531282": "2021-11-16T14:36:06.563015+0000" 2021-11-15T14:36:12.535 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.535 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:36:12.535 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:36:12.536 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:36:12.536 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:36:12.536 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:36:12.536 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:36:12.536 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:36:12.537 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:36:12.537 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:36:12.537 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:36:12.537 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:36:12.537 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:36:12.538 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.538 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:36:12.538 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:36:12.538 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:36:12.538 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:36:12.539 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:36:12.539 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:36:12.539 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:36:12.539 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:12.540 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:12.540 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:36:12.540 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:36:12.540 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:36:12.540 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:36:12.541 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:36:12.541 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:36:12.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 msgr2=0x7f0d28055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 0x7f0d28055b60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0d34008000 tx=0x7f0d34009040).stop 2021-11-15T14:36:12.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 msgr2=0x7f0d4415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.336+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0d3c0016f0 tx=0x7f0d440b0800).stop 2021-11-15T14:36:12.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 shutdown_connections 2021-11-15T14:36:12.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0d280536a0 0x7f0d28055b60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d44148b80 0x7f0d4415a650 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d4414ba20 0x7f0d441434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 --2- 172.21.2.135:0/2331536473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d24004500 0x7f0d441569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 >> 172.21.2.135:0/2331536473 conn(0x7f0d4405f730 msgr2=0x7f0d44147010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 shutdown_connections 2021-11-15T14:36:12.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.340+0000 7f0d498c7700 1 -- 172.21.2.135:0/2331536473 wait complete. 2021-11-15T14:36:12.546 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:12.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 Processor -- start 2021-11-15T14:36:12.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 -- start start 2021-11-15T14:36:12.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3e5c067070 0x7f3e5c143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c067450 con 0x7f3e5c0b0760 2021-11-15T14:36:12.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0b0050 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e613e3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b02f0 con 0x7f3e5c067070 2021-11-15T14:36:12.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e5a7fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3e5c0ad0b0 0x7f3e5c143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44266/0 (socket says 172.21.2.135:44266) 2021-11-15T14:36:12.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e5a7fc700 1 -- 172.21.2.135:0/3255021908 learned_addr learned my addr 172.21.2.135:0/3255021908 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:12.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235046010 0 0) 0x7f3e5c0b0050 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c003260 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.612+0000 7f3e5affd700 1 --2- 172.21.2.135:0/3255021908 >> v2:172.21.2.119:3300/0 conn(0x7f3e5c067070 0x7f3e5c143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333859418 0 0) 0x7f3e3c003260 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 >> v2:172.21.2.119:3300/0 conn(0x7f3e5c067070 msgr2=0x7f3e5c143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 --2- 172.21.2.135:0/3255021908 >> v2:172.21.2.119:3300/0 conn(0x7f3e5c067070 0x7f3e5c143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 >> v1:172.21.2.119:6789/0 conn(0x7f3e5c0b0760 legacy=0x7f3e5c0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0af420 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f3e44001660 con 0x7f3e5c0ad0b0 2021-11-15T14:36:12.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 >> v1:172.21.2.135:6789/0 conn(0x7f3e5c0ad0b0 legacy=0x7f3e5c143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e3c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e3c004500 0x7f3e3c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e3c004ec0 0x7f3e3c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b02f0 con 0x7f3e3c004500 2021-11-15T14:36:12.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00be50 con 0x7f3e3c003750 2021-11-15T14:36:12.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00c010 con 0x7f3e3c004ec0 2021-11-15T14:36:12.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e3c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5b7fe700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e3c004ec0 0x7f3e3c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5a7fc700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e3c004500 0x7f3e3c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e3c004ec0 msgr2=0x7f3e3c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e3c004ec0 0x7f3e3c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e3c004500 msgr2=0x7f3e3c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e3c004500 0x7f3e3c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5b7fe700 1 -- 172.21.2.135:0/3255021908 reap_dead start 2021-11-15T14:36:12.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/3255021908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c003260 con 0x7f3e3c003750 2021-11-15T14:36:12.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e3c003b70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3e4c00a000 tx=0x7f3e4c008040).ready entity=mon.1 client_cookie=21758bb4d278654b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c013670 con 0x7f3e3c003750 2021-11-15T14:36:12.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0137d0 con 0x7f3e3c003750 2021-11-15T14:36:12.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e59ffb700 1 -- 172.21.2.135:0/3255021908 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c013b30 con 0x7f3e3c003750 2021-11-15T14:36:12.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 msgr2=0x7f3e3c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e3c003b70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3e4c00a000 tx=0x7f3e4c008040).stop 2021-11-15T14:36:12.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/3255021908 shutdown_connections 2021-11-15T14:36:12.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 --2- 172.21.2.135:0/3255021908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e3c003b70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/3255021908 >> 172.21.2.135:0/3255021908 conn(0x7f3e5c05f730 msgr2=0x7f3e5c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/3255021908 shutdown_connections 2021-11-15T14:36:12.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/3255021908 wait complete. 2021-11-15T14:36:12.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 Processor -- start 2021-11-15T14:36:12.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- start start 2021-11-15T14:36:12.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e5c0a0420 0x7f3e5c152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 0x7f3e5c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b1b50 con 0x7f3e5c153220 2021-11-15T14:36:12.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1536b0 con 0x7f3e3c003750 2021-11-15T14:36:12.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a11d0 con 0x7f3e5c0a0420 2021-11-15T14:36:12.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56686/0 (socket says 172.21.2.135:56686) 2021-11-15T14:36:12.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/2651225891 learned_addr learned my addr 172.21.2.135:0/2651225891 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:12.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5b7fe700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 0x7f3e5c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5a7fc700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e5c0a0420 0x7f3e5c152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e5c0a0420 msgr2=0x7f3e5c152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e5c0a0420 0x7f3e5c152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 msgr2=0x7f3e5c155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 0x7f3e5c155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 -- 172.21.2.135:0/2651225891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0a1470 con 0x7f3e3c003750 2021-11-15T14:36:12.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5b7fe700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 0x7f3e5c155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:36:12.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e5affd700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f3e4c00a000 tx=0x7f3e4c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c012c40 con 0x7f3e3c003750 2021-11-15T14:36:12.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c000e90 con 0x7f3e3c003750 2021-11-15T14:36:12.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c0a1710 con 0x7f3e3c003750 2021-11-15T14:36:12.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e4c01d410 con 0x7f3e3c003750 2021-11-15T14:36:12.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c09e930 con 0x7f3e3c003750 2021-11-15T14:36:12.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c0a0a40 con 0x7f3e3c003750 2021-11-15T14:36:12.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e4c01d570 con 0x7f3e3c003750 2021-11-15T14:36:12.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 0x7f3e40055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.616+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f3e4c06d0e0 con 0x7f3e3c003750 2021-11-15T14:36:12.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.620+0000 7f3e5a7fc700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 0x7f3e40055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.620+0000 7f3e5a7fc700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 0x7f3e40055a40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3e44005000 tx=0x7f3e44009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.620+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e4c044360 con 0x7f3e3c003750 2021-11-15T14:36:12.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c0573d0 con 0x7f3e3c003750 2021-11-15T14:36:12.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e53fff700 1 -- 172.21.2.135:0/2651225891 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f3e4c047980 con 0x7f3e3c003750 2021-11-15T14:36:12.736 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:12.737 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":5125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/200487926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":200487926},{"type":"v1","addr":"172.21.2.135:6835","nonce":200487926}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[]} 2021-11-15T14:36:12.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 msgr2=0x7f3e40055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 0x7f3e40055a40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3e44005000 tx=0x7f3e44009040).stop 2021-11-15T14:36:12.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 msgr2=0x7f3e5c0a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f3e4c00a000 tx=0x7f3e4c008040).stop 2021-11-15T14:36:12.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 shutdown_connections 2021-11-15T14:36:12.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3e40053580 0x7f3e40055a40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e5c153220 0x7f3e5c155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e5c0a0420 0x7f3e5c152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 --2- 172.21.2.135:0/2651225891 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e3c003750 0x7f3e5c0a1cf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 >> 172.21.2.135:0/2651225891 conn(0x7f3e5c05f730 msgr2=0x7f3e5c0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 shutdown_connections 2021-11-15T14:36:12.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.732+0000 7f3e613e3700 1 -- 172.21.2.135:0/2651225891 wait complete. 2021-11-15T14:36:12.741 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 16 2021-11-15T14:36:12.743 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:12.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 Processor -- start 2021-11-15T14:36:12.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 -- start start 2021-11-15T14:36:12.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 0x7f43940b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940b03d0 con 0x7f4394148420 2021-11-15T14:36:12.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940b0670 con 0x7f43940a7140 2021-11-15T14:36:12.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f439aee9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940a9140 con 0x7f43940b1e30 2021-11-15T14:36:12.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f43940a7140 0x7f43941447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44284/0 (socket says 172.21.2.135:44284) 2021-11-15T14:36:12.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 -- 172.21.2.135:0/2203108910 learned_addr learned my addr 172.21.2.135:0/2203108910 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:12.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965304009 0 0) 0x7f43940b0670 con 0x7f43940a7140 2021-11-15T14:36:12.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4374003260 con 0x7f43940a7140 2021-11-15T14:36:12.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4398c85700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 0x7f43940b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864218553 0 0) 0x7f4374003260 con 0x7f43940a7140 2021-11-15T14:36:12.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 msgr2=0x7f43940b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 0x7f43940b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 >> v1:172.21.2.119:6789/0 conn(0x7f4394148420 legacy=0x7f43940b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940b0910 con 0x7f43940a7140 2021-11-15T14:36:12.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f438c0019e0 con 0x7f43940a7140 2021-11-15T14:36:12.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 >> v1:172.21.2.135:6789/0 conn(0x7f43940a7140 legacy=0x7f43941447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 0x7f43740037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4374003de0 0x7f4374004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f4374004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437400b8e0 con 0x7f4374003de0 2021-11-15T14:36:12.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437400ba50 con 0x7f4374004a60 2021-11-15T14:36:12.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437400bc10 con 0x7f43940b1e30 2021-11-15T14:36:12.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f4374004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 -- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 msgr2=0x7f43740037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940b1e30 0x7f43740037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 -- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4374003de0 msgr2=0x7f4374004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:12.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4374003de0 0x7f4374004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:12.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 -- 172.21.2.135:0/2203108910 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374003260 con 0x7f4374004a60 2021-11-15T14:36:12.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f4399486700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f4374004ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f4394061420 tx=0x7f43940b0800).ready entity=mon.1 client_cookie=a3ebabac7afb9ab2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f438c00cb80 con 0x7f4374004a60 2021-11-15T14:36:12.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c00cce0 con 0x7f4374004a60 2021-11-15T14:36:12.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.788+0000 7f43937fe700 1 -- 172.21.2.135:0/2203108910 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f438c005b80 con 0x7f4374004a60 2021-11-15T14:36:12.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2203108910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 msgr2=0x7f4374004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 --2- 172.21.2.135:0/2203108910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f4374004ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f4394061420 tx=0x7f43940b0800).stop 2021-11-15T14:36:12.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4399486700 1 -- 172.21.2.135:0/2203108910 reap_dead start 2021-11-15T14:36:12.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2203108910 shutdown_connections 2021-11-15T14:36:12.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2203108910 >> 172.21.2.135:0/2203108910 conn(0x7f439405f730 msgr2=0x7f439405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2203108910 shutdown_connections 2021-11-15T14:36:12.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2203108910 wait complete. 2021-11-15T14:36:12.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 Processor -- start 2021-11-15T14:36:12.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- start start 2021-11-15T14:36:12.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940acf20 0x7f4394146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4394146540 0x7f43940aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394145c60 con 0x7f4394146540 2021-11-15T14:36:12.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394146f40 con 0x7f4374004a60 2021-11-15T14:36:12.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4394145e90 con 0x7f43940acf20 2021-11-15T14:36:12.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56706/0 (socket says 172.21.2.135:56706) 2021-11-15T14:36:12.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 -- 172.21.2.135:0/2663081650 learned_addr learned my addr 172.21.2.135:0/2663081650 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:12.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4393fff700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940acf20 0x7f4394146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4399486700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4394146540 0x7f43940aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 -- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940acf20 msgr2=0x7f4394146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940acf20 0x7f4394146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 -- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4394146540 msgr2=0x7f43940aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4394146540 0x7f43940aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 -- 172.21.2.135:0/2663081650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394146130 con 0x7f4374004a60 2021-11-15T14:36:12.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4398c85700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f438400a000 tx=0x7f4384008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4384016070 con 0x7f4374004a60 2021-11-15T14:36:12.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384000e90 con 0x7f4374004a60 2021-11-15T14:36:12.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4384011970 con 0x7f4374004a60 2021-11-15T14:36:12.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43940af130 con 0x7f4374004a60 2021-11-15T14:36:12.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394145850 con 0x7f4374004a60 2021-11-15T14:36:12.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43940573d0 con 0x7f4374004a60 2021-11-15T14:36:12.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4384011ad0 con 0x7f4374004a60 2021-11-15T14:36:12.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 0x7f4378055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:12.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.792+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f438406b6a0 con 0x7f4374004a60 2021-11-15T14:36:12.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.796+0000 7f4393fff700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 0x7f4378055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:12.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.796+0000 7f4393fff700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 0x7f4378055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f437c00b000 tx=0x7f437c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:12.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.796+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4384042870 con 0x7f4374004a60 2021-11-15T14:36:12.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.904+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43940446d0 con 0x7f4374004a60 2021-11-15T14:36:12.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f4391ffb700 1 -- 172.21.2.135:0/2663081650 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f4384045e90 con 0x7f4374004a60 2021-11-15T14:36:12.914 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:12.914 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/1088945093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1088945093},{"type":"v1","addr":"172.21.2.119:6835","nonce":1088945093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6833/197029397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":197029397},{"type":"v1","addr":"172.21.2.135:6833","nonce":197029397}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":5125,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/200487926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":200487926},{"type":"v1","addr":"172.21.2.135:6835","nonce":200487926}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[]} 2021-11-15T14:36:12.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 msgr2=0x7f4378055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 0x7f4378055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f437c00b000 tx=0x7f437c009040).stop 2021-11-15T14:36:12.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 msgr2=0x7f439414d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:12.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f438400a000 tx=0x7f4384008040).stop 2021-11-15T14:36:12.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 shutdown_connections 2021-11-15T14:36:12.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4378053580 0x7f4378055a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4394146540 0x7f43940aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43940acf20 0x7f4394146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 --2- 172.21.2.135:0/2663081650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4374004a60 0x7f439414d350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:12.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 >> 172.21.2.135:0/2663081650 conn(0x7f439405f730 msgr2=0x7f43940a7560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:12.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 shutdown_connections 2021-11-15T14:36:12.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:12.912+0000 7f439aee9700 1 -- 172.21.2.135:0/2663081650 wait complete. 2021-11-15T14:36:12.918 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 16 2021-11-15T14:36:12.922 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:36:12.922 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:36:12.922 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:36:12.923 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:36:12.923 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:36:12.923 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:36:12.924 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:36:12.924 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:36:12.924 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:36:12.924 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:36:12.925 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:36:12.925 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:36:12.928 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:36:12.928 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:36:12.929 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:36:12.930 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:36:12.931 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:36:12.932 DEBUG:teuthology.parallel:result is None 2021-11-15T14:36:12.933 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:36:12.933 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:36:12.934 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:36:12.934 DEBUG:teuthology.parallel:result is None 2021-11-15T14:36:12.963 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:36:12.963 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:36:12.978 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:36:12.978 DEBUG:teuthology.parallel:result is None 2021-11-15T14:36:12.979 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:36:13.013 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:36:13.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 Processor -- start 2021-11-15T14:36:13.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- start start 2021-11-15T14:36:13.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 0x7f5cd00b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:13.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd0144130 con 0x7f5cd00b69e0 2021-11-15T14:36:13.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd0143bf0 con 0x7f5cd00b4440 2021-11-15T14:36:13.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0143e90 con 0x7f5cd00b6600 2021-11-15T14:36:13.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd4898700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5cd00b4440 0x7f5cd0061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44330/0 (socket says 172.21.2.135:44330) 2021-11-15T14:36:13.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd4898700 1 -- 172.21.2.135:0/3049118684 learned_addr learned my addr 172.21.2.135:0/3049118684 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:13.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd5099700 1 --2- 172.21.2.135:0/3049118684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 0x7f5cd00b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:13.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169717110 0 0) 0x7f5cd0143bf0 con 0x7f5cd00b4440 2021-11-15T14:36:13.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb8003260 con 0x7f5cd00b4440 2021-11-15T14:36:13.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225798892 0 0) 0x7f5cd0144130 con 0x7f5cd00b69e0 2021-11-15T14:36:13.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd0143bf0 con 0x7f5cd00b69e0 2021-11-15T14:36:13.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd5099700 1 -- 172.21.2.135:0/3049118684 >> v1:172.21.2.135:6789/0 conn(0x7f5cd00b4440 legacy=0x7f5cd0061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:13.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd5099700 1 -- 172.21.2.135:0/3049118684 >> v1:172.21.2.119:6789/0 conn(0x7f5cd00b69e0 legacy=0x7f5cd012ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:13.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd5099700 1 -- 172.21.2.135:0/3049118684 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0061670 con 0x7f5cd00b6600 2021-11-15T14:36:13.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd5099700 1 --2- 172.21.2.135:0/3049118684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 0x7f5cd00b5c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5cc4002f70 tx=0x7f5cc4006df0).ready entity=mon.2 client_cookie=d8b75e9dfa6fa275 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:13.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc400d5c0 con 0x7f5cd00b6600 2021-11-15T14:36:13.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4000e90 con 0x7f5cd00b6600 2021-11-15T14:36:13.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cc3fff700 1 -- 172.21.2.135:0/3049118684 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc400d910 con 0x7f5cd00b6600 2021-11-15T14:36:13.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- 172.21.2.135:0/3049118684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 msgr2=0x7f5cd00b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:13.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/3049118684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 0x7f5cd00b5c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5cc4002f70 tx=0x7f5cc4006df0).stop 2021-11-15T14:36:13.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- 172.21.2.135:0/3049118684 shutdown_connections 2021-11-15T14:36:13.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/3049118684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b6600 0x7f5cd00b5c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:13.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- 172.21.2.135:0/3049118684 >> 172.21.2.135:0/3049118684 conn(0x7f5cd005c510 msgr2=0x7f5cd005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- 172.21.2.135:0/3049118684 shutdown_connections 2021-11-15T14:36:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.032+0000 7f5cd72fd700 1 -- 172.21.2.135:0/3049118684 wait complete. 2021-11-15T14:36:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 Processor -- start 2021-11-15T14:36:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- start start 2021-11-15T14:36:13.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b4440 0x7f5cd01257d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:13.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 0x7f5cd0152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:13.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:13.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0152460 con 0x7f5cd00b6600 2021-11-15T14:36:13.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0150000 con 0x7f5cd00b69e0 2021-11-15T14:36:13.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0156240 con 0x7f5cd00b4440 2021-11-15T14:36:13.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:13.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd5099700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b4440 0x7f5cd01257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:13.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56746/0 (socket says 172.21.2.135:56746) 2021-11-15T14:36:13.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 -- 172.21.2.135:0/168926402 learned_addr learned my addr 172.21.2.135:0/168926402 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:13.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd4898700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 0x7f5cd0152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:13.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 -- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b4440 msgr2=0x7f5cd01257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:13.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b4440 0x7f5cd01257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:13.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 -- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 msgr2=0x7f5cd0152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:13.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 0x7f5cd0152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:13.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 -- 172.21.2.135:0/168926402 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc400b180 con 0x7f5cd00b69e0 2021-11-15T14:36:13.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd4898700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 0x7f5cd0152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:36:13.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd589a700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f5cc8001490 tx=0x7f5cc8007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:13.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc8002310 con 0x7f5cd00b69e0 2021-11-15T14:36:13.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8002470 con 0x7f5cd00b69e0 2021-11-15T14:36:13.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd0153270 con 0x7f5cd00b69e0 2021-11-15T14:36:13.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc80017a0 con 0x7f5cd00b69e0 2021-11-15T14:36:13.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd0156750 con 0x7f5cd00b69e0 2021-11-15T14:36:13.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd01525a0 con 0x7f5cd00b69e0 2021-11-15T14:36:13.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5cc8010030 con 0x7f5cd00b69e0 2021-11-15T14:36:13.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 0x7f5cb0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:13.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5cc806b6e0 con 0x7f5cd00b69e0 2021-11-15T14:36:13.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd5099700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 0x7f5cb0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:13.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.036+0000 7f5cd5099700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 0x7f5cb0055ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5cc401a000 tx=0x7f5cc4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:13.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.040+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5cc80429c0 con 0x7f5cd00b69e0 2021-11-15T14:36:13.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:13.132+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5cd0061910 con 0x7f5cd00b69e0 2021-11-15T14:36:14.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.036+0000 7f5cc27fc700 1 -- 172.21.2.135:0/168926402 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cc8045fe0 con 0x7f5cd00b69e0 2021-11-15T14:36:14.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.036+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 msgr2=0x7f5cb0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.036+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 0x7f5cb0055ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5cc401a000 tx=0x7f5cc4014000).stop 2021-11-15T14:36:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.036+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 msgr2=0x7f5cd0152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.036+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f5cc8001490 tx=0x7f5cc8007dd0).stop 2021-11-15T14:36:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 shutdown_connections 2021-11-15T14:36:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5cb0053610 0x7f5cb0055ad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cd00b69e0 0x7f5cd0152d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cd00b6600 0x7f5cd0152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 --2- 172.21.2.135:0/168926402 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cd00b4440 0x7f5cd01257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 >> 172.21.2.135:0/168926402 conn(0x7f5cd005c510 msgr2=0x7f5cd0144570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 shutdown_connections 2021-11-15T14:36:14.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.040+0000 7f5cd72fd700 1 -- 172.21.2.135:0/168926402 wait complete. 2021-11-15T14:36:14.046 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:36:14.049 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:36:14.050 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:36:14.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 Processor -- start 2021-11-15T14:36:14.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 -- start start 2021-11-15T14:36:14.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f52480ad150 0x7f524813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f524805d7e0 0x7f52481426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f52480afca0 0x7f524813f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480b04b0 con 0x7f52480afca0 2021-11-15T14:36:14.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480ad530 con 0x7f52480ad150 2021-11-15T14:36:14.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f524d97c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b57d0 con 0x7f524805d7e0 2021-11-15T14:36:14.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f52480ad150 0x7f524813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f52480ad150 0x7f524813f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56756/0 (socket says 172.21.2.135:56756) 2021-11-15T14:36:14.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 -- 172.21.2.135:0/2614820385 learned_addr learned my addr 172.21.2.135:0/2614820385 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 -- 172.21.2.135:0/2614820385 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f524805d7e0 msgr2=0x7f52481426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2614820385 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f524805d7e0 0x7f52481426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 -- 172.21.2.135:0/2614820385 >> v2:172.21.2.119:3300/0 conn(0x7f52480afca0 msgr2=0x7f524813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2614820385 >> v2:172.21.2.119:3300/0 conn(0x7f52480afca0 0x7f524813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.096+0000 7f5246ffd700 1 -- 172.21.2.135:0/2614820385 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480b06e0 con 0x7f52480ad150 2021-11-15T14:36:14.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2614820385 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52480ad150 0x7f524813f150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230006eb0).ready entity=mon.1 client_cookie=149b3dda65870773 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5245ffb700 1 -- 172.21.2.135:0/2614820385 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f523000d570 con 0x7f52480ad150 2021-11-15T14:36:14.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5245ffb700 1 -- 172.21.2.135:0/2614820385 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230000e90 con 0x7f52480ad150 2021-11-15T14:36:14.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5245ffb700 1 -- 172.21.2.135:0/2614820385 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f523000d900 con 0x7f52480ad150 2021-11-15T14:36:14.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2614820385 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52480ad150 msgr2=0x7f524813f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- 172.21.2.135:0/2614820385 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52480ad150 0x7f524813f150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230006eb0).stop 2021-11-15T14:36:14.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2614820385 shutdown_connections 2021-11-15T14:36:14.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- 172.21.2.135:0/2614820385 >> v2:172.21.2.119:3300/0 conn(0x7f52480afca0 0x7f524813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- 172.21.2.135:0/2614820385 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f524805d7e0 0x7f52481426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- 172.21.2.135:0/2614820385 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52480ad150 0x7f524813f150 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2614820385 >> 172.21.2.135:0/2614820385 conn(0x7f5248062cb0 msgr2=0x7f5248063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2614820385 shutdown_connections 2021-11-15T14:36:14.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2614820385 wait complete. 2021-11-15T14:36:14.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 Processor -- start 2021-11-15T14:36:14.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- start start 2021-11-15T14:36:14.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52480ad150 0x7f524815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52480afca0 0x7f5248156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524812ec50 con 0x7f52480afca0 2021-11-15T14:36:14.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524812ee80 con 0x7f524805d7e0 2021-11-15T14:36:14.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524812f120 con 0x7f52480ad150 2021-11-15T14:36:14.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56762/0 (socket says 172.21.2.135:56762) 2021-11-15T14:36:14.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 -- 172.21.2.135:0/2578759737 learned_addr learned my addr 172.21.2.135:0/2578759737 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 -- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52480ad150 msgr2=0x7f524815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52480ad150 0x7f524815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 -- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52480afca0 msgr2=0x7f5248156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52480afca0 0x7f5248156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 -- 172.21.2.135:0/2578759737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523000b1e0 con 0x7f524805d7e0 2021-11-15T14:36:14.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f5246ffd700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5230006be0 con 0x7f524805d7e0 2021-11-15T14:36:14.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000de00 con 0x7f524805d7e0 2021-11-15T14:36:14.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524812f3c0 con 0x7f524805d7e0 2021-11-15T14:36:14.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f523001e460 con 0x7f524805d7e0 2021-11-15T14:36:14.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524815ac10 con 0x7f524805d7e0 2021-11-15T14:36:14.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.100+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52480b5a30 con 0x7f524805d7e0 2021-11-15T14:36:14.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f523001a040 con 0x7f524805d7e0 2021-11-15T14:36:14.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f523ffff700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 0x7f522c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f523006c730 con 0x7f524805d7e0 2021-11-15T14:36:14.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f52467fc700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 0x7f522c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f52467fc700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 0x7f522c055b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5238002f70 tx=0x7f5238006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.104+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5230043b30 con 0x7f524805d7e0 2021-11-15T14:36:14.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52480573d0 con 0x7f524805d7e0 2021-11-15T14:36:14.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f523ffff700 1 -- 172.21.2.135:0/2578759737 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5230047090 con 0x7f524805d7e0 2021-11-15T14:36:14.225 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:14.225 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:36:14.226 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:36:14.226 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.226 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:36:14.227 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:36:14.227 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.227 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:36:14.227 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.227 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.228 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.228 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.228 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.228 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.229 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:36:14.229 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:36:14.229 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.229 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:36:14.230 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.230 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.230 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.230 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.231 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.231 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.231 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:36:14.231 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:36:14.232 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.232 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:36:14.232 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.232 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.233 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.233 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.233 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.234 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:36:14.234 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:36:14.234 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.234 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.234 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.235 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.235 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.235 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.236 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:36:14.236 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:36:14.236 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.236 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.237 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.237 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.237 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.237 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.238 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:36:14.238 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:36:14.238 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.238 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.239 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.239 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.239 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.239 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.239 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.240 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:36:14.240 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:36:14.240 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.240 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.241 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.241 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.241 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.241 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.242 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.242 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:36:14.242 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:36:14.242 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.243 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.243 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.243 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.243 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.243 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.244 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.244 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:36:14.244 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:36:14.245 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.245 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.245 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.245 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.245 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.246 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.246 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.246 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:36:14.246 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:36:14.247 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.247 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.247 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.247 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.248 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.248 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.248 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.248 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:36:14.249 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:36:14.249 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.249 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.249 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.249 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.250 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.250 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.250 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.250 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:36:14.251 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:36:14.251 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.251 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:36:14.251 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:36:14.252 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:36:14.252 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.252 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.252 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.252 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:36:14.253 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:36:14.253 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.253 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:36:14.253 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:36:14.254 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:36:14.254 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.254 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.254 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.255 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:36:14.255 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:36:14.255 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.255 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:36:14.256 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:36:14.256 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:36:14.256 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.256 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.256 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.257 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.257 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:36:14.257 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:36:14.257 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.258 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:36:14.258 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:36:14.258 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.258 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.259 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.259 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.259 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:36:14.259 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:36:14.259 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:36:14.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:36:14.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:36:14.260 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:36:14.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.261 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.261 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:36:14.261 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:36:14.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 msgr2=0x7f522c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 0x7f522c055b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5238002f70 tx=0x7f5238006a80).stop 2021-11-15T14:36:14.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 msgr2=0x7f52480b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230015000).stop 2021-11-15T14:36:14.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 shutdown_connections 2021-11-15T14:36:14.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f522c0536a0 0x7f522c055b60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52480afca0 0x7f5248156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52480ad150 0x7f524815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 --2- 172.21.2.135:0/2578759737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f524805d7e0 0x7f52480b5160 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 >> 172.21.2.135:0/2578759737 conn(0x7f5248062cb0 msgr2=0x7f524813b240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 shutdown_connections 2021-11-15T14:36:14.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.220+0000 7f524d97c700 1 -- 172.21.2.135:0/2578759737 wait complete. 2021-11-15T14:36:14.266 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:14.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 Processor -- start 2021-11-15T14:36:14.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 -- start start 2021-11-15T14:36:14.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec060990 0x7f4aec0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4aec0aa650 0x7f4aec13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec0b6d60 con 0x7f4aec0b6980 2021-11-15T14:36:14.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec061260 con 0x7f4aec0aa650 2021-11-15T14:36:14.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.312+0000 7f4af2fdf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec061500 con 0x7f4aec060990 2021-11-15T14:36:14.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4aec0aa650 0x7f4aec13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4aec0aa650 0x7f4aec13c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:50584/0 (socket says 172.21.2.135:50584) 2021-11-15T14:36:14.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 -- 172.21.2.135:0/1761094979 learned_addr learned my addr 172.21.2.135:0/1761094979 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4aebfff700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec060990 0x7f4aec0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 -- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec060990 msgr2=0x7f4aec0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec060990 0x7f4aec0acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 -- 172.21.2.135:0/1761094979 >> v1:172.21.2.119:6789/0 conn(0x7f4aec0b6980 legacy=0x7f4aec0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 -- 172.21.2.135:0/1761094979 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0617a0 con 0x7f4aec0aa650 2021-11-15T14:36:14.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af157c700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13c4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4ae40032f0 tx=0x7f4ae4009290).ready entity=mon.0 client_cookie=30cc32d5190a65ec server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4aeb7fe700 1 -- 172.21.2.135:0/1761094979 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae400b8a0 con 0x7f4aec0aa650 2021-11-15T14:36:14.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4aeb7fe700 1 -- 172.21.2.135:0/1761094979 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae400ba00 con 0x7f4aec0aa650 2021-11-15T14:36:14.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4aeb7fe700 1 -- 172.21.2.135:0/1761094979 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae400bb70 con 0x7f4aec0aa650 2021-11-15T14:36:14.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 msgr2=0x7f4aec13c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13c4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4ae40032f0 tx=0x7f4ae4009290).stop 2021-11-15T14:36:14.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- 172.21.2.135:0/1761094979 shutdown_connections 2021-11-15T14:36:14.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13c4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/1761094979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec060990 0x7f4aec0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- 172.21.2.135:0/1761094979 >> 172.21.2.135:0/1761094979 conn(0x7f4aec0b3500 msgr2=0x7f4aec0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- 172.21.2.135:0/1761094979 shutdown_connections 2021-11-15T14:36:14.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- 172.21.2.135:0/1761094979 wait complete. 2021-11-15T14:36:14.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 Processor -- start 2021-11-15T14:36:14.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- start start 2021-11-15T14:36:14.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec0b6980 0x7f4aec13f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec13d9c0 con 0x7f4aec0aa650 2021-11-15T14:36:14.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1542e0 con 0x7f4aec060990 2021-11-15T14:36:14.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af2fdf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec13dbf0 con 0x7f4aec0b6980 2021-11-15T14:36:14.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af0d7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af0d7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56778/0 (socket says 172.21.2.135:56778) 2021-11-15T14:36:14.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.316+0000 7f4af0d7b700 1 -- 172.21.2.135:0/3723979368 learned_addr learned my addr 172.21.2.135:0/3723979368 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 -- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec0b6980 msgr2=0x7f4aec13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec0b6980 0x7f4aec13f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 -- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 msgr2=0x7f4aec13f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 -- 172.21.2.135:0/3723979368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009530 con 0x7f4aec060990 2021-11-15T14:36:14.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af0d7b700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4aec0b5e80 tx=0x7f4adc007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00ce00 con 0x7f4aec060990 2021-11-15T14:36:14.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc007240 con 0x7f4aec060990 2021-11-15T14:36:14.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec13fc20 con 0x7f4aec060990 2021-11-15T14:36:14.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec14dcf0 con 0x7f4aec060990 2021-11-15T14:36:14.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc006700 con 0x7f4aec060990 2021-11-15T14:36:14.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec061a40 con 0x7f4aec060990 2021-11-15T14:36:14.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4adc006860 con 0x7f4aec060990 2021-11-15T14:36:14.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 0x7f4ad0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f4adc06b200 con 0x7f4aec060990 2021-11-15T14:36:14.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4aebfff700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 0x7f4ad0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4aebfff700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 0x7f4ad0055be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4ad400d000 tx=0x7f4ad4006e80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.320+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4adc042430 con 0x7f4aec060990 2021-11-15T14:36:14.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.404+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aec13ddf0 con 0x7f4aec060990 2021-11-15T14:36:14.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.404+0000 7f4ae9ffb700 1 -- 172.21.2.135:0/3723979368 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f4aec13ddf0 con 0x7f4aec060990 2021-11-15T14:36:14.411 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:14.411 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:14.023509+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:14.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 msgr2=0x7f4ad0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 0x7f4ad0055be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4ad400d000 tx=0x7f4ad4006e80).stop 2021-11-15T14:36:14.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 msgr2=0x7f4aec0af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4aec0b5e80 tx=0x7f4adc007be0).stop 2021-11-15T14:36:14.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 shutdown_connections 2021-11-15T14:36:14.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ad0053720 0x7f4ad0055be0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4aec0b6980 0x7f4aec13f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4aec0aa650 0x7f4aec13f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 --2- 172.21.2.135:0/3723979368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4aec060990 0x7f4aec0af840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 >> 172.21.2.135:0/3723979368 conn(0x7f4aec0b3500 msgr2=0x7f4aec13c460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 shutdown_connections 2021-11-15T14:36:14.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.408+0000 7f4af2fdf700 1 -- 172.21.2.135:0/3723979368 wait complete. 2021-11-15T14:36:14.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:36:14.418 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:36:14.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 Processor -- start 2021-11-15T14:36:14.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 -- start start 2021-11-15T14:36:14.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f92500b0630 0x7f92500b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f92500a9c90 0x7f92500b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92501439a0 con 0x7f92500b3790 2021-11-15T14:36:14.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9250143c40 con 0x7f92500b0630 2021-11-15T14:36:14.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f92548f2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9250143ee0 con 0x7f92500a9c90 2021-11-15T14:36:14.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924dd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f92500b3790 0x7f925013d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44374/0 (socket says 172.21.2.135:44374) 2021-11-15T14:36:14.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f92500a9c90 0x7f92500b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924dd9b700 1 -- 172.21.2.135:0/566137704 learned_addr learned my addr 172.21.2.135:0/566137704 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:14.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 -- 172.21.2.135:0/566137704 >> v2:172.21.2.119:3300/0 conn(0x7f92500b0630 msgr2=0x7f92500b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 --2- 172.21.2.135:0/566137704 >> v2:172.21.2.119:3300/0 conn(0x7f92500b0630 0x7f92500b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 -- 172.21.2.135:0/566137704 >> v1:172.21.2.135:6789/0 conn(0x7f92500b3790 legacy=0x7f925013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 -- 172.21.2.135:0/566137704 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250144180 con 0x7f92500a9c90 2021-11-15T14:36:14.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924ed9d700 1 --2- 172.21.2.135:0/566137704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500a9c90 0x7f92500b1130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f92480032f0 tx=0x7f92480091d0).ready entity=mon.1 client_cookie=e3fc912c254e71d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924d59a700 1 -- 172.21.2.135:0/566137704 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9248009ea0 con 0x7f92500a9c90 2021-11-15T14:36:14.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924d59a700 1 -- 172.21.2.135:0/566137704 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800b870 con 0x7f92500a9c90 2021-11-15T14:36:14.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.464+0000 7f924d59a700 1 -- 172.21.2.135:0/566137704 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f924800b9e0 con 0x7f92500a9c90 2021-11-15T14:36:14.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/566137704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500a9c90 msgr2=0x7f92500b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- 172.21.2.135:0/566137704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500a9c90 0x7f92500b1130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f92480032f0 tx=0x7f92480091d0).stop 2021-11-15T14:36:14.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/566137704 shutdown_connections 2021-11-15T14:36:14.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- 172.21.2.135:0/566137704 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500a9c90 0x7f92500b1130 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- 172.21.2.135:0/566137704 >> v2:172.21.2.119:3300/0 conn(0x7f92500b0630 0x7f92500b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/566137704 >> 172.21.2.135:0/566137704 conn(0x7f9250060840 msgr2=0x7f9250060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/566137704 shutdown_connections 2021-11-15T14:36:14.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/566137704 wait complete. 2021-11-15T14:36:14.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 Processor -- start 2021-11-15T14:36:14.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- start start 2021-11-15T14:36:14.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92500a9c90 0x7f92500a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f92500b0630 0x7f92500b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925013ebe0 con 0x7f92500a9c90 2021-11-15T14:36:14.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a7450 con 0x7f92500b3790 2021-11-15T14:36:14.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a7f70 con 0x7f92500b0630 2021-11-15T14:36:14.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56790/0 (socket says 172.21.2.135:56790) 2021-11-15T14:36:14.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 -- 172.21.2.135:0/938940957 learned_addr learned my addr 172.21.2.135:0/938940957 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 -- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f92500b0630 msgr2=0x7f92500b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f92500b0630 0x7f92500b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 -- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92500a9c90 msgr2=0x7f92500a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92500a9c90 0x7f92500a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 -- 172.21.2.135:0/938940957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009470 con 0x7f92500b3790 2021-11-15T14:36:14.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f924ed9d700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f92500a8a70 tx=0x7f9248016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9248006ea0 con 0x7f92500b3790 2021-11-15T14:36:14.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92500a7d90 con 0x7f92500b3790 2021-11-15T14:36:14.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248021440 con 0x7f92500b3790 2021-11-15T14:36:14.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92480217a0 con 0x7f92500b3790 2021-11-15T14:36:14.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92500a7af0 con 0x7f92500b3790 2021-11-15T14:36:14.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9250148810 con 0x7f92500b3790 2021-11-15T14:36:14.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9248027020 con 0x7f92500b3790 2021-11-15T14:36:14.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.468+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f924806cc10 con 0x7f92500b3790 2021-11-15T14:36:14.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.472+0000 7f924e59c700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.472+0000 7f924e59c700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 0x7f9234055ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9240002f70 tx=0x7f9240006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.472+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9248043eb0 con 0x7f92500b3790 2021-11-15T14:36:14.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.552+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f92500a7140 con 0x7f92500b3790 2021-11-15T14:36:14.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92477fe700 1 -- 172.21.2.135:0/938940957 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f92480150b0 con 0x7f92500b3790 2021-11-15T14:36:14.560 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:36:14.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 msgr2=0x7f9234055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 0x7f9234055ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9240002f70 tx=0x7f9240006a80).stop 2021-11-15T14:36:14.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 msgr2=0x7f9250147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f92500a8a70 tx=0x7f9248016000).stop 2021-11-15T14:36:14.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 shutdown_connections 2021-11-15T14:36:14.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9234053610 0x7f9234055ad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f92500b3790 0x7f9250147370 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f92500b0630 0x7f92500b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 --2- 172.21.2.135:0/938940957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92500a9c90 0x7f92500a81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 >> 172.21.2.135:0/938940957 conn(0x7f9250060840 msgr2=0x7f925005fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 shutdown_connections 2021-11-15T14:36:14.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.556+0000 7f92548f2700 1 -- 172.21.2.135:0/938940957 wait complete. 2021-11-15T14:36:14.567 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:36:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 Processor -- start 2021-11-15T14:36:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 -- start start 2021-11-15T14:36:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4fc00654a0 0x7f4fc01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc00b3950 0x7f4fc01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00b2430 con 0x7f4fc0060040 2021-11-15T14:36:14.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc00b26d0 con 0x7f4fc00654a0 2021-11-15T14:36:14.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc821c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00b2970 con 0x7f4fc00b3950 2021-11-15T14:36:14.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc57b7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4fc00654a0 0x7f4fc01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.612+0000 7f4fc5fb8700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f4fc0060040 0x7f4fc0064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44388/0 (socket says 172.21.2.135:44388) 2021-11-15T14:36:14.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc5fb8700 1 -- 172.21.2.135:0/881995549 learned_addr learned my addr 172.21.2.135:0/881995549 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:14.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc57b7700 1 -- 172.21.2.135:0/881995549 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc00b3950 msgr2=0x7f4fc01449b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:14.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc57b7700 1 --2- 172.21.2.135:0/881995549 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc00b3950 0x7f4fc01449b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc57b7700 1 -- 172.21.2.135:0/881995549 >> v1:172.21.2.135:6789/0 conn(0x7f4fc0060040 legacy=0x7f4fc0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc57b7700 1 -- 172.21.2.135:0/881995549 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00648f0 con 0x7f4fc00654a0 2021-11-15T14:36:14.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc57b7700 1 --2- 172.21.2.135:0/881995549 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00654a0 0x7f4fc01444c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f4fbc002f70 tx=0x7f4fbc006df0).ready entity=mon.1 client_cookie=2e23ff6a421bc544 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc4fb6700 1 -- 172.21.2.135:0/881995549 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fbc00d570 con 0x7f4fc00654a0 2021-11-15T14:36:14.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc4fb6700 1 -- 172.21.2.135:0/881995549 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc000e90 con 0x7f4fc00654a0 2021-11-15T14:36:14.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc4fb6700 1 -- 172.21.2.135:0/881995549 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fbc00d900 con 0x7f4fc00654a0 2021-11-15T14:36:14.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/881995549 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00654a0 msgr2=0x7f4fc01444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- 172.21.2.135:0/881995549 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00654a0 0x7f4fc01444c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f4fbc002f70 tx=0x7f4fbc006df0).stop 2021-11-15T14:36:14.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/881995549 shutdown_connections 2021-11-15T14:36:14.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- 172.21.2.135:0/881995549 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00654a0 0x7f4fc01444c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- 172.21.2.135:0/881995549 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc00b3950 0x7f4fc01449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/881995549 >> 172.21.2.135:0/881995549 conn(0x7f4fc005cfe0 msgr2=0x7f4fc005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/881995549 shutdown_connections 2021-11-15T14:36:14.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/881995549 wait complete. 2021-11-15T14:36:14.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 Processor -- start 2021-11-15T14:36:14.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- start start 2021-11-15T14:36:14.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc0060040 0x7f4fc0141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4fc00654a0 0x7f4fc00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01405e0 con 0x7f4fc00654a0 2021-11-15T14:36:14.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0062410 con 0x7f4fc00b3950 2021-11-15T14:36:14.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc013e280 con 0x7f4fc0060040 2021-11-15T14:36:14.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56806/0 (socket says 172.21.2.135:56806) 2021-11-15T14:36:14.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 -- 172.21.2.135:0/903396980 learned_addr learned my addr 172.21.2.135:0/903396980 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 -- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc0060040 msgr2=0x7f4fc0141800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:14.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc0060040 0x7f4fc0141800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 -- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4fc00654a0 msgr2=0x7f4fc00ada30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:14.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4fc00654a0 0x7f4fc00ada30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 -- 172.21.2.135:0/903396980 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc00b180 con 0x7f4fc00b3950 2021-11-15T14:36:14.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc67b9700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4fc013da10 tx=0x7f4fb8006f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800e540 con 0x7f4fc00b3950 2021-11-15T14:36:14.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800e6a0 con 0x7f4fc00b3950 2021-11-15T14:36:14.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc013e520 con 0x7f4fc00b3950 2021-11-15T14:36:14.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0062140 con 0x7f4fc00b3950 2021-11-15T14:36:14.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800ea40 con 0x7f4fc00b3950 2021-11-15T14:36:14.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.616+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc00627f0 con 0x7f4fc00b3950 2021-11-15T14:36:14.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4fb8018030 con 0x7f4fc00b3950 2021-11-15T14:36:14.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4faeffd700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 0x7f4fa0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f4fb806b1c0 con 0x7f4fc00b3950 2021-11-15T14:36:14.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4fc5fb8700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 0x7f4fa0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4fc5fb8700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 0x7f4fa0055b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4fc005d4e0 tx=0x7f4fb0007790).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.620+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4fb8042440 con 0x7f4fc00b3950 2021-11-15T14:36:14.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4fc00674f0 con 0x7f4fc00b3950 2021-11-15T14:36:14.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4faeffd700 1 -- 172.21.2.135:0/903396980 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4fb8045a60 con 0x7f4fc00b3950 2021-11-15T14:36:14.709 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:14.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 msgr2=0x7f4fa0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 0x7f4fa0055b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4fc005d4e0 tx=0x7f4fb0007790).stop 2021-11-15T14:36:14.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 msgr2=0x7f4fc00adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f4fc013da10 tx=0x7f4fb8006f90).stop 2021-11-15T14:36:14.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 shutdown_connections 2021-11-15T14:36:14.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4fa0053660 0x7f4fa0055b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4fc00b3950 0x7f4fc00adf20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4fc00654a0 0x7f4fc00ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 --2- 172.21.2.135:0/903396980 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4fc0060040 0x7f4fc0141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 >> 172.21.2.135:0/903396980 conn(0x7f4fc005cfe0 msgr2=0x7f4fc01407d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 shutdown_connections 2021-11-15T14:36:14.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.704+0000 7f4fc821c700 1 -- 172.21.2.135:0/903396980 wait complete. 2021-11-15T14:36:14.716 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:36:14.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 Processor -- start 2021-11-15T14:36:14.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 -- start start 2021-11-15T14:36:14.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7feed00b1300 0x7feed00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 0x7feed00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed0140390 con 0x7feed00a8cf0 2021-11-15T14:36:14.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed0140630 con 0x7feed00b1300 2021-11-15T14:36:14.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feed60e6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed01408d0 con 0x7feed0140d70 2021-11-15T14:36:14.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feed00a8cf0 0x7feed00ae730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44402/0 (socket says 172.21.2.135:44402) 2021-11-15T14:36:14.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecffff700 1 -- 172.21.2.135:0/970196189 learned_addr learned my addr 172.21.2.135:0/970196189 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:14.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498431360 0 0) 0x7feed0140390 con 0x7feed00a8cf0 2021-11-15T14:36:14.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb0003260 con 0x7feed00a8cf0 2021-11-15T14:36:14.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feeceffd700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 0x7feed00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 --2- 172.21.2.135:0/970196189 >> v2:172.21.2.119:3300/0 conn(0x7feed00b1300 0x7feed00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4019867847 0 0) 0x7feeb0003260 con 0x7feed00a8cf0 2021-11-15T14:36:14.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 msgr2=0x7feed00b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 0x7feed00b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 >> v2:172.21.2.119:3300/0 conn(0x7feed00b1300 msgr2=0x7feed00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 --2- 172.21.2.135:0/970196189 >> v2:172.21.2.119:3300/0 conn(0x7feed00b1300 0x7feed00b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0140080 con 0x7feed00a8cf0 2021-11-15T14:36:14.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7feec80019e0 con 0x7feed00a8cf0 2021-11-15T14:36:14.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 >> v1:172.21.2.135:6789/0 conn(0x7feed00a8cf0 legacy=0x7feed00ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feeb0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeb0004500 0x7feeb0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 0x7feeb0004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0140630 con 0x7feeb0004500 2021-11-15T14:36:14.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01408d0 con 0x7feeb00037d0 2021-11-15T14:36:14.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00057a0 con 0x7feed0140d70 2021-11-15T14:36:14.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feeb0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 -- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 msgr2=0x7feeb0004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed0140d70 0x7feeb0004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 -- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeb0004500 msgr2=0x7feeb0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeb0004500 0x7feeb0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.776+0000 7feecf7fe700 1 -- 172.21.2.135:0/970196189 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0003260 con 0x7feeb00037d0 2021-11-15T14:36:14.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feeb0003bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7feec0007000 tx=0x7feec0008040).ready entity=mon.1 client_cookie=ff28b5c516cc7375 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec0012470 con 0x7feeb00037d0 2021-11-15T14:36:14.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000c030 con 0x7feeb00037d0 2021-11-15T14:36:14.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feece7fc700 1 -- 172.21.2.135:0/970196189 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec00127c0 con 0x7feeb00037d0 2021-11-15T14:36:14.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/970196189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 msgr2=0x7feeb0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 --2- 172.21.2.135:0/970196189 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feeb0003bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7feec0007000 tx=0x7feec0008040).stop 2021-11-15T14:36:14.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecffff700 1 -- 172.21.2.135:0/970196189 reap_dead start 2021-11-15T14:36:14.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/970196189 shutdown_connections 2021-11-15T14:36:14.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/970196189 >> 172.21.2.135:0/970196189 conn(0x7feed005f730 msgr2=0x7feed005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/970196189 shutdown_connections 2021-11-15T14:36:14.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/970196189 wait complete. 2021-11-15T14:36:14.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 Processor -- start 2021-11-15T14:36:14.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- start start 2021-11-15T14:36:14.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed013a560 0x7feed013d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feed00aa730 0x7feed0133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0138260 con 0x7feed00aa730 2021-11-15T14:36:14.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed013d570 con 0x7feeb00037d0 2021-11-15T14:36:14.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00ac5a0 con 0x7feed013a560 2021-11-15T14:36:14.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56824/0 (socket says 172.21.2.135:56824) 2021-11-15T14:36:14.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 -- 172.21.2.135:0/353779424 learned_addr learned my addr 172.21.2.135:0/353779424 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 -- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed013a560 msgr2=0x7feed013d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed013a560 0x7feed013d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 -- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feed00aa730 msgr2=0x7feed0133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feed00aa730 0x7feed0133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 -- 172.21.2.135:0/353779424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0138490 con 0x7feeb00037d0 2021-11-15T14:36:14.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feecf7fe700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7feec0007000 tx=0x7feec0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec001c6f0 con 0x7feeb00037d0 2021-11-15T14:36:14.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0000e90 con 0x7feeb00037d0 2021-11-15T14:36:14.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed0138730 con 0x7feeb00037d0 2021-11-15T14:36:14.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00aabb0 con 0x7feeb00037d0 2021-11-15T14:36:14.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec001ca40 con 0x7feeb00037d0 2021-11-15T14:36:14.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00aa410 con 0x7feeb00037d0 2021-11-15T14:36:14.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.780+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feec001cba0 con 0x7feeb00037d0 2021-11-15T14:36:14.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.784+0000 7feeccff9700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 0x7feeb4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.784+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7feec006c380 con 0x7feeb00037d0 2021-11-15T14:36:14.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.784+0000 7feeceffd700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 0x7feeb4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.784+0000 7feeceffd700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 0x7feeb4055b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7feeb800a000 tx=0x7feeb8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.784+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feec00435b0 con 0x7feeb00037d0 2021-11-15T14:36:14.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feed00573d0 con 0x7feeb00037d0 2021-11-15T14:36:14.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feeccff9700 1 -- 172.21.2.135:0/353779424 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+143 (secure 0 0 0) 0x7feec0046bd0 con 0x7feeb00037d0 2021-11-15T14:36:14.874 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:14.874 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:36:14.874 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.875 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:36:14.875 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:36:14.875 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:14.875 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:36:14.876 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:36:14.876 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:36:14.876 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:14.876 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:36:14.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 msgr2=0x7feeb4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 0x7feeb4055b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7feeb800a000 tx=0x7feeb8008040).stop 2021-11-15T14:36:14.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 msgr2=0x7feed00b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7feec0007000 tx=0x7feec0017000).stop 2021-11-15T14:36:14.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 shutdown_connections 2021-11-15T14:36:14.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feeb4053690 0x7feeb4055b50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feed00aa730 0x7feed0133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feed013a560 0x7feed013d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 --2- 172.21.2.135:0/353779424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeb00037d0 0x7feed00b2a80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 >> 172.21.2.135:0/353779424 conn(0x7feed005f730 msgr2=0x7feed0144790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 shutdown_connections 2021-11-15T14:36:14.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.868+0000 7feed60e6700 1 -- 172.21.2.135:0/353779424 wait complete. 2021-11-15T14:36:14.881 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:36:14.882 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:36:14.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 Processor -- start 2021-11-15T14:36:14.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 -- start start 2021-11-15T14:36:14.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0bd40a9c90 0x7f0bd40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd41439a0 con 0x7f0bd40b0630 2021-11-15T14:36:14.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd4143c40 con 0x7f0bd40a9c90 2021-11-15T14:36:14.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd8855700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4143ee0 con 0x7f0bd40b3790 2021-11-15T14:36:14.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0bd40b0630 0x7f0bd413d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44420/0 (socket says 172.21.2.135:44420) 2021-11-15T14:36:14.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd259c700 1 -- 172.21.2.135:0/393175474 learned_addr learned my addr 172.21.2.135:0/393175474 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:14.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 --2- 172.21.2.135:0/393175474 >> v2:172.21.2.135:3300/0 conn(0x7f0bd40a9c90 0x7f0bd40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 -- 172.21.2.135:0/393175474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 msgr2=0x7f0bd40b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:14.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 --2- 172.21.2.135:0/393175474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd40b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 -- 172.21.2.135:0/393175474 >> v1:172.21.2.135:6789/0 conn(0x7f0bd40b0630 legacy=0x7f0bd413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 -- 172.21.2.135:0/393175474 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4144180 con 0x7f0bd40a9c90 2021-11-15T14:36:14.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd2d9d700 1 --2- 172.21.2.135:0/393175474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd40b1130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f0bcc0032f0 tx=0x7f0bcc0091d0).ready entity=mon.1 client_cookie=28ec701cd1b8f35 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd159a700 1 -- 172.21.2.135:0/393175474 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bcc009ea0 con 0x7f0bd40a9c90 2021-11-15T14:36:14.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd159a700 1 -- 172.21.2.135:0/393175474 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00b8a0 con 0x7f0bd40a9c90 2021-11-15T14:36:14.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.932+0000 7f0bd159a700 1 -- 172.21.2.135:0/393175474 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bcc00ba10 con 0x7f0bd40a9c90 2021-11-15T14:36:14.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/393175474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 msgr2=0x7f0bd40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:14.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/393175474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd40b1130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f0bcc0032f0 tx=0x7f0bcc0091d0).stop 2021-11-15T14:36:14.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/393175474 shutdown_connections 2021-11-15T14:36:14.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/393175474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd40b1130 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:14.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/393175474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd40b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/393175474 >> 172.21.2.135:0/393175474 conn(0x7f0bd4060840 msgr2=0x7f0bd4060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:14.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/393175474 shutdown_connections 2021-11-15T14:36:14.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/393175474 wait complete. 2021-11-15T14:36:14.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 Processor -- start 2021-11-15T14:36:14.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- start start 2021-11-15T14:36:14.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bd40b0630 0x7f0bd405fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd4156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40a74c0 con 0x7f0bd40b0630 2021-11-15T14:36:14.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd415a050 con 0x7f0bd40a9c90 2021-11-15T14:36:14.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd415a2f0 con 0x7f0bd40b3790 2021-11-15T14:36:14.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56836/0 (socket says 172.21.2.135:56836) 2021-11-15T14:36:14.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 -- 172.21.2.135:0/857482421 learned_addr learned my addr 172.21.2.135:0/857482421 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:14.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 -- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 msgr2=0x7f0bd4156970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:14.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd4156970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 -- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bd40b0630 msgr2=0x7f0bd405fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:14.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bd40b0630 0x7f0bd405fca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:14.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 -- 172.21.2.135:0/857482421 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009470 con 0x7f0bd40a9c90 2021-11-15T14:36:14.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd259c700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f0bd40b3df0 tx=0x7f0bc4007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc400ce30 con 0x7f0bd40a9c90 2021-11-15T14:36:14.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40072e0 con 0x7f0bd40a9c90 2021-11-15T14:36:14.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd415a590 con 0x7f0bd40a9c90 2021-11-15T14:36:14.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc4005800 con 0x7f0bd40a9c90 2021-11-15T14:36:14.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd40a7140 con 0x7f0bd40a9c90 2021-11-15T14:36:14.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd415a720 con 0x7f0bd40a9c90 2021-11-15T14:36:14.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0bc4010070 con 0x7f0bd40a9c90 2021-11-15T14:36:14.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 0x7f0bb0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:14.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0bc406af00 con 0x7f0bd40a9c90 2021-11-15T14:36:14.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.936+0000 7f0bd1d9b700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 0x7f0bb0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:14.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.940+0000 7f0bd1d9b700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 0x7f0bb0055b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f0bc8002f70 tx=0x7f0bc8006960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:14.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:14.940+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0bc4042130 con 0x7f0bd40a9c90 2021-11-15T14:36:15.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.024+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0bd413dce0 con 0x7f0bd40a9c90 2021-11-15T14:36:15.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bc37fe700 1 -- 172.21.2.135:0/857482421 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v44) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0bc4045750 con 0x7f0bd40a9c90 2021-11-15T14:36:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 msgr2=0x7f0bb0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 0x7f0bb0055b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f0bc8002f70 tx=0x7f0bc8006960).stop 2021-11-15T14:36:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 msgr2=0x7f0bd415aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f0bd40b3df0 tx=0x7f0bc4007c40).stop 2021-11-15T14:36:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 shutdown_connections 2021-11-15T14:36:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bb00536a0 0x7f0bb0055b60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bd40b3790 0x7f0bd4156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bd40b0630 0x7f0bd405fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 --2- 172.21.2.135:0/857482421 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bd40a9c90 0x7f0bd415aa30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 >> 172.21.2.135:0/857482421 conn(0x7f0bd4060840 msgr2=0x7f0bd40b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 shutdown_connections 2021-11-15T14:36:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.936+0000 7f0bd8855700 1 -- 172.21.2.135:0/857482421 wait complete. 2021-11-15T14:36:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:36:15.949 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:36:16.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 Processor -- start 2021-11-15T14:36:16.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 -- start start 2021-11-15T14:36:16.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c500b1f40 0x7f7c500b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7c500b2320 0x7f7c501412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500b04a0 con 0x7f7c500b0030 2021-11-15T14:36:16.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500a7850 con 0x7f7c500b2320 2021-11-15T14:36:16.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c585fb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500b06d0 con 0x7f7c500b1f40 2021-11-15T14:36:16.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c500b1f40 0x7f7c500b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:16.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c500b1f40 0x7f7c500b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56844/0 (socket says 172.21.2.135:56844) 2021-11-15T14:36:16.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 -- 172.21.2.135:0/208941848 learned_addr learned my addr 172.21.2.135:0/208941848 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:16.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 -- 172.21.2.135:0/208941848 >> v2:172.21.2.119:3300/0 conn(0x7f7c500b2320 msgr2=0x7f7c501412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:16.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 --2- 172.21.2.135:0/208941848 >> v2:172.21.2.119:3300/0 conn(0x7f7c500b2320 0x7f7c501412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:16.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 -- 172.21.2.135:0/208941848 >> v1:172.21.2.119:6789/0 conn(0x7f7c500b0030 legacy=0x7f7c500a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:16.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 -- 172.21.2.135:0/208941848 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500b0970 con 0x7f7c500b1f40 2021-11-15T14:36:16.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:15.996+0000 7f7c56397700 1 --2- 172.21.2.135:0/208941848 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b1f40 0x7f7c500b1350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7c500ad350 tx=0x7f7c40006eb0).ready entity=mon.1 client_cookie=4f064f4c126827a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:16.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c55395700 1 -- 172.21.2.135:0/208941848 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4000d5c0 con 0x7f7c500b1f40 2021-11-15T14:36:16.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c55395700 1 -- 172.21.2.135:0/208941848 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40000e90 con 0x7f7c500b1f40 2021-11-15T14:36:16.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c55395700 1 -- 172.21.2.135:0/208941848 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4000d910 con 0x7f7c500b1f40 2021-11-15T14:36:16.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/208941848 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b1f40 msgr2=0x7f7c500b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:16.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- 172.21.2.135:0/208941848 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b1f40 0x7f7c500b1350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7c500ad350 tx=0x7f7c40006eb0).stop 2021-11-15T14:36:16.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/208941848 shutdown_connections 2021-11-15T14:36:16.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- 172.21.2.135:0/208941848 >> v2:172.21.2.119:3300/0 conn(0x7f7c500b2320 0x7f7c501412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:16.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- 172.21.2.135:0/208941848 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b1f40 0x7f7c500b1350 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/208941848 >> 172.21.2.135:0/208941848 conn(0x7f7c5005f730 msgr2=0x7f7c5005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:16.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/208941848 shutdown_connections 2021-11-15T14:36:16.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/208941848 wait complete. 2021-11-15T14:36:16.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 Processor -- start 2021-11-15T14:36:16.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- start start 2021-11-15T14:36:16.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c500b0030 0x7f7c500a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 0x7f7c50156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015a220 con 0x7f7c500b1f40 2021-11-15T14:36:16.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015a450 con 0x7f7c500b2320 2021-11-15T14:36:16.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015a6f0 con 0x7f7c500b0030 2021-11-15T14:36:16.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:16.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56854/0 (socket says 172.21.2.135:56854) 2021-11-15T14:36:16.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 -- 172.21.2.135:0/3339759000 learned_addr learned my addr 172.21.2.135:0/3339759000 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:16.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56397700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c500b0030 0x7f7c500a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:16.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c55b96700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 0x7f7c50156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:16.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 -- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c500b0030 msgr2=0x7f7c500a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:16.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c500b0030 0x7f7c500a7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 -- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 msgr2=0x7f7c50156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:16.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 0x7f7c50156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 -- 172.21.2.135:0/3339759000 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4000b1e0 con 0x7f7c500b2320 2021-11-15T14:36:16.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c55b96700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 0x7f7c50156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:36:16.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c56b98700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7c480032f0 tx=0x7f7c480091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:16.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4800f510 con 0x7f7c500b2320 2021-11-15T14:36:16.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800f670 con 0x7f7c500b2320 2021-11-15T14:36:16.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5015a990 con 0x7f7c500b2320 2021-11-15T14:36:16.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4800f7e0 con 0x7f7c500b2320 2021-11-15T14:36:16.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c500af400 con 0x7f7c500b2320 2021-11-15T14:36:16.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.000+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5015ab20 con 0x7f7c500b2320 2021-11-15T14:36:16.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c4800f070 con 0x7f7c500b2320 2021-11-15T14:36:16.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c3f7fe700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 0x7f7c30055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:16.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f7c4806b510 con 0x7f7c500b2320 2021-11-15T14:36:16.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c56397700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 0x7f7c30055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:16.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c56397700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 0x7f7c30055be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7c4001c000 tx=0x7f7c40015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:16.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.004+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c480425e0 con 0x7f7c500b2320 2021-11-15T14:36:16.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.088+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7c500b0c10 con 0x7f7c500b2320 2021-11-15T14:36:16.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c3f7fe700 1 -- 172.21.2.135:0/3339759000 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7c48045c00 con 0x7f7c500b2320 2021-11-15T14:36:16.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 msgr2=0x7f7c30055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:16.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 0x7f7c30055be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7c4001c000 tx=0x7f7c40015000).stop 2021-11-15T14:36:16.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 msgr2=0x7f7c50157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:16.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7c480032f0 tx=0x7f7c480091a0).stop 2021-11-15T14:36:16.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 shutdown_connections 2021-11-15T14:36:16.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c30053720 0x7f7c30055be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c500b2320 0x7f7c50157140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c500b1f40 0x7f7c50156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 --2- 172.21.2.135:0/3339759000 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c500b0030 0x7f7c500a7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:16.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 >> 172.21.2.135:0/3339759000 conn(0x7f7c5005f730 msgr2=0x7f7c5005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:16.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 shutdown_connections 2021-11-15T14:36:16.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:16.948+0000 7f7c585fb700 1 -- 172.21.2.135:0/3339759000 wait complete. 2021-11-15T14:36:16.958 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:36:16.962 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:36:17.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 Processor -- start 2021-11-15T14:36:17.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 -- start start 2021-11-15T14:36:17.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 0x7f18200b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f18200a7140 0x7f18201447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200b03d0 con 0x7f18200b1e30 2021-11-15T14:36:17.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200a9140 con 0x7f18200a7140 2021-11-15T14:36:17.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f182495b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200b0670 con 0x7f1820148420 2021-11-15T14:36:17.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f18200a7140 0x7f18201447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f18200a7140 0x7f18201447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:50674/0 (socket says 172.21.2.135:50674) 2021-11-15T14:36:17.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 -- 172.21.2.135:0/829371854 learned_addr learned my addr 172.21.2.135:0/829371854 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:17.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181dd9b700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 0x7f18200b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 -- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 msgr2=0x7f18200b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 0x7f18200b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 -- 172.21.2.135:0/829371854 >> v1:172.21.2.119:6789/0 conn(0x7f18200b1e30 legacy=0x7f18200b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 -- 172.21.2.135:0/829371854 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200b0910 con 0x7f18200a7140 2021-11-15T14:36:17.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181dd9b700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 0x7f18200b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:36:17.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181ed9d700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18200a7140 0x7f18201447a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f18180032f0 tx=0x7f1818009290).ready entity=mon.0 client_cookie=7c5b80f3c571ea56 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.012+0000 7f181d59a700 1 -- 172.21.2.135:0/829371854 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181800b8a0 con 0x7f18200a7140 2021-11-15T14:36:17.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181d59a700 1 -- 172.21.2.135:0/829371854 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800ba00 con 0x7f18200a7140 2021-11-15T14:36:17.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181d59a700 1 -- 172.21.2.135:0/829371854 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181800bb70 con 0x7f18200a7140 2021-11-15T14:36:17.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18200a7140 msgr2=0x7f18201447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18200a7140 0x7f18201447a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f18180032f0 tx=0x7f1818009290).stop 2021-11-15T14:36:17.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/829371854 shutdown_connections 2021-11-15T14:36:17.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18200a7140 0x7f18201447a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- 172.21.2.135:0/829371854 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1820148420 0x7f18200b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/829371854 >> 172.21.2.135:0/829371854 conn(0x7f182005f730 msgr2=0x7f182005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/829371854 shutdown_connections 2021-11-15T14:36:17.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/829371854 wait complete. 2021-11-15T14:36:17.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 Processor -- start 2021-11-15T14:36:17.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- start start 2021-11-15T14:36:17.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18200a7140 0x7f1820144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1820148420 0x7f1820142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1820062c20 con 0x7f1820148420 2021-11-15T14:36:17.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200aa5e0 con 0x7f18200b1e30 2021-11-15T14:36:17.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1820063f40 con 0x7f18200a7140 2021-11-15T14:36:17.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56866/0 (socket says 172.21.2.135:56866) 2021-11-15T14:36:17.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 -- 172.21.2.135:0/966263302 learned_addr learned my addr 172.21.2.135:0/966263302 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:17.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181ed9d700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1820148420 0x7f1820142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181e59c700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18200a7140 0x7f1820144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 -- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18200a7140 msgr2=0x7f1820144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18200a7140 0x7f1820144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 -- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1820148420 msgr2=0x7f1820142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1820148420 0x7f1820142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 -- 172.21.2.135:0/966263302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181400b180 con 0x7f18200b1e30 2021-11-15T14:36:17.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f181dd9b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f181400c000 tx=0x7f1814006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181400c850 con 0x7f18200b1e30 2021-11-15T14:36:17.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181400c9b0 con 0x7f18200b1e30 2021-11-15T14:36:17.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1818009530 con 0x7f18200b1e30 2021-11-15T14:36:17.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181400cd10 con 0x7f18200b1e30 2021-11-15T14:36:17.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18200abe90 con 0x7f18200b1e30 2021-11-15T14:36:17.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18200aa9b0 con 0x7f18200b1e30 2021-11-15T14:36:17.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.016+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f181401c460 con 0x7f18200b1e30 2021-11-15T14:36:17.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.020+0000 7f180f7fe700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 0x7f17fc055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.020+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f181406c090 con 0x7f18200b1e30 2021-11-15T14:36:17.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.020+0000 7f181e59c700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 0x7f17fc055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.020+0000 7f181e59c700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 0x7f17fc055b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f181000b000 tx=0x7f1810009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.020+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1814042fa0 con 0x7f18200b1e30 2021-11-15T14:36:17.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.128+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f18200573d0 con 0x7f18200b1e30 2021-11-15T14:36:17.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f180f7fe700 1 -- 172.21.2.135:0/966263302 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 187+0+0 (secure 0 0 0) 0x7f18140465c0 con 0x7f18200b1e30 2021-11-15T14:36:17.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 msgr2=0x7f17fc055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 0x7f17fc055b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f181000b000 tx=0x7f1810009040).stop 2021-11-15T14:36:17.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 msgr2=0x7f1820142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f181400c000 tx=0x7f1814006df0).stop 2021-11-15T14:36:17.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 shutdown_connections 2021-11-15T14:36:17.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f17fc053690 0x7f17fc055b50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1820148420 0x7f1820142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18200b1e30 0x7f1820142ae0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 --2- 172.21.2.135:0/966263302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18200a7140 0x7f1820144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 >> 172.21.2.135:0/966263302 conn(0x7f182005f730 msgr2=0x7f18200aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 shutdown_connections 2021-11-15T14:36:17.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.144+0000 7f182495b700 1 -- 172.21.2.135:0/966263302 wait complete. 2021-11-15T14:36:17.154 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 7 and data pool 8 2021-11-15T14:36:17.157 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:17.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.200+0000 7f7d110d7700 1 Processor -- start 2021-11-15T14:36:17.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.200+0000 7f7d110d7700 1 -- start start 2021-11-15T14:36:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 0x7f7d0c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0b03d0 con 0x7f7d0c0b1e30 2021-11-15T14:36:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0b0670 con 0x7f7d0c148420 2021-11-15T14:36:17.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0a9140 con 0x7f7d0c0b1050 2021-11-15T14:36:17.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7d0c148420 0x7f7d0c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44468/0 (socket says 172.21.2.135:44468) 2021-11-15T14:36:17.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 -- 172.21.2.135:0/2174703810 learned_addr learned my addr 172.21.2.135:0/2174703810 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:17.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822766126 0 0) 0x7f7d0c0b0670 con 0x7f7d0c148420 2021-11-15T14:36:17.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cec003260 con 0x7f7d0c148420 2021-11-15T14:36:17.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102795170 0 0) 0x7f7cec003260 con 0x7f7d0c148420 2021-11-15T14:36:17.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 msgr2=0x7f7d0c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 0x7f7d0c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 >> v1:172.21.2.119:6789/0 conn(0x7f7d0c0b1e30 legacy=0x7f7d0c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0b0910 con 0x7f7d0c148420 2021-11-15T14:36:17.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7cfc001660 con 0x7f7d0c148420 2021-11-15T14:36:17.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 >> v1:172.21.2.135:6789/0 conn(0x7f7d0c148420 legacy=0x7f7d0c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 0x7f7cec003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cec003e20 0x7f7cec004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cec004b10 0x7f7cec004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec00b930 con 0x7f7cec004b10 2021-11-15T14:36:17.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec00baa0 con 0x7f7cec003e20 2021-11-15T14:36:17.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec00bc60 con 0x7f7d0c0b1050 2021-11-15T14:36:17.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cec003e20 0x7f7cec004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0ad9d700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 0x7f7cec003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0b59e700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cec004b10 0x7f7cec004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 -- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 msgr2=0x7f7cec003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c0b1050 0x7f7cec003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 -- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cec004b10 msgr2=0x7f7cec004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cec004b10 0x7f7cec004f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 -- 172.21.2.135:0/2174703810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec003260 con 0x7f7cec003e20 2021-11-15T14:36:17.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cec003e20 0x7f7cec004500 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7d0c1477b0 tx=0x7f7d0c0b0560).ready entity=mon.1 client_cookie=341f8bd135ab57d3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cfc0070d0 con 0x7f7cec003e20 2021-11-15T14:36:17.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc007230 con 0x7f7cec003e20 2021-11-15T14:36:17.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d09d9b700 1 -- 172.21.2.135:0/2174703810 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cfc00c8f0 con 0x7f7cec003e20 2021-11-15T14:36:17.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- 172.21.2.135:0/2174703810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cec003e20 msgr2=0x7f7cec004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 --2- 172.21.2.135:0/2174703810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cec003e20 0x7f7cec004500 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f7d0c1477b0 tx=0x7f7d0c0b0560).stop 2021-11-15T14:36:17.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0b59e700 1 -- 172.21.2.135:0/2174703810 reap_dead start 2021-11-15T14:36:17.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- 172.21.2.135:0/2174703810 shutdown_connections 2021-11-15T14:36:17.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- 172.21.2.135:0/2174703810 >> 172.21.2.135:0/2174703810 conn(0x7f7d0c05f730 msgr2=0x7f7d0c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- 172.21.2.135:0/2174703810 shutdown_connections 2021-11-15T14:36:17.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- 172.21.2.135:0/2174703810 wait complete. 2021-11-15T14:36:17.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 Processor -- start 2021-11-15T14:36:17.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- start start 2021-11-15T14:36:17.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c14a4a0 0x7f7d0c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d0c15a2b0 0x7f7d0c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c15ac20 con 0x7f7d0c15a2b0 2021-11-15T14:36:17.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0a9930 con 0x7f7d0c14b350 2021-11-15T14:36:17.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d110d7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0aa2a0 con 0x7f7d0c14a4a0 2021-11-15T14:36:17.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56894/0 (socket says 172.21.2.135:56894) 2021-11-15T14:36:17.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.204+0000 7f7d0a59c700 1 -- 172.21.2.135:0/1647120727 learned_addr learned my addr 172.21.2.135:0/1647120727 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:17.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 -- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c14a4a0 msgr2=0x7f7d0c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c14a4a0 0x7f7d0c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 -- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d0c15a2b0 msgr2=0x7f7d0c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d0c15a2b0 0x7f7d0c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 -- 172.21.2.135:0/1647120727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0ab520 con 0x7f7d0c14b350 2021-11-15T14:36:17.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0a59c700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f7d0c1477b0 tx=0x7f7cfc013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cfc01a070 con 0x7f7d0c14b350 2021-11-15T14:36:17.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0049e0 con 0x7f7d0c14b350 2021-11-15T14:36:17.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c14abc0 con 0x7f7d0c14b350 2021-11-15T14:36:17.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c14b7d0 con 0x7f7d0c14b350 2021-11-15T14:36:17.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cfc0070d0 con 0x7f7d0c14b350 2021-11-15T14:36:17.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0573d0 con 0x7f7d0c14b350 2021-11-15T14:36:17.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7cfc010070 con 0x7f7d0c14b350 2021-11-15T14:36:17.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 0x7f7cf0055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7cfc06bce0 con 0x7f7d0c14b350 2021-11-15T14:36:17.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0ad9d700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 0x7f7cf0055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.208+0000 7f7d0ad9d700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 0x7f7cf0055a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f7cf400b000 tx=0x7f7cf4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.212+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7cfc042be0 con 0x7f7d0c14b350 2021-11-15T14:36:17.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0c0446d0 con 0x7f7d0c14b350 2021-11-15T14:36:17.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d03fff700 1 -- 172.21.2.135:0/1647120727 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f7cfc046200 con 0x7f7d0c14b350 2021-11-15T14:36:17.301 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:17.301 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":46,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:17.138104+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:36:15.047541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T14:36:16.111420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:17.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 msgr2=0x7f7cf0055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 0x7f7cf0055a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f7cf400b000 tx=0x7f7cf4009040).stop 2021-11-15T14:36:17.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 msgr2=0x7f7d0c159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f7d0c1477b0 tx=0x7f7cfc013000).stop 2021-11-15T14:36:17.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 shutdown_connections 2021-11-15T14:36:17.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cf0053570 0x7f7cf0055a30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d0c15a2b0 0x7f7d0c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d0c14b350 0x7f7d0c159dc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 --2- 172.21.2.135:0/1647120727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d0c14a4a0 0x7f7d0c14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 >> 172.21.2.135:0/1647120727 conn(0x7f7d0c05f730 msgr2=0x7f7d0c14e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 shutdown_connections 2021-11-15T14:36:17.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.296+0000 7f7d110d7700 1 -- 172.21.2.135:0/1647120727 wait complete. 2021-11-15T14:36:17.309 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:17.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.352+0000 7f60a21ad700 1 Processor -- start 2021-11-15T14:36:17.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.352+0000 7f60a21ad700 1 -- start start 2021-11-15T14:36:17.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f609c0b1e30 0x7f609c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0b03d0 con 0x7f609c148420 2021-11-15T14:36:17.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0b0670 con 0x7f609c0a7140 2021-11-15T14:36:17.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0a9140 con 0x7f609c0b1e30 2021-11-15T14:36:17.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f609c0a7140 0x7f609c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44488/0 (socket says 172.21.2.135:44488) 2021-11-15T14:36:17.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609bfff700 1 -- 172.21.2.135:0/3625733847 learned_addr learned my addr 172.21.2.135:0/3625733847 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:17.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609b7fe700 1 --2- 172.21.2.135:0/3625733847 >> v2:172.21.2.135:3300/0 conn(0x7f609c0b1e30 0x7f609c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609b7fe700 1 -- 172.21.2.135:0/3625733847 >> v1:172.21.2.135:6789/0 conn(0x7f609c0a7140 legacy=0x7f609c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609b7fe700 1 -- 172.21.2.135:0/3625733847 >> v1:172.21.2.119:6789/0 conn(0x7f609c148420 legacy=0x7f609c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609b7fe700 1 -- 172.21.2.135:0/3625733847 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0b0910 con 0x7f609c0b1e30 2021-11-15T14:36:17.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609b7fe700 1 --2- 172.21.2.135:0/3625733847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c0b1050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f609c1477b0 tx=0x7f6084006df0).ready entity=mon.1 client_cookie=39cc2667acab10a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609a7fc700 1 -- 172.21.2.135:0/3625733847 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608400d5c0 con 0x7f609c0b1e30 2021-11-15T14:36:17.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609a7fc700 1 -- 172.21.2.135:0/3625733847 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084000e90 con 0x7f609c0b1e30 2021-11-15T14:36:17.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609a7fc700 1 -- 172.21.2.135:0/3625733847 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608400d910 con 0x7f609c0b1e30 2021-11-15T14:36:17.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/3625733847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 msgr2=0x7f609c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- 172.21.2.135:0/3625733847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c0b1050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f609c1477b0 tx=0x7f6084006df0).stop 2021-11-15T14:36:17.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/3625733847 shutdown_connections 2021-11-15T14:36:17.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- 172.21.2.135:0/3625733847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c0b1050 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/3625733847 >> 172.21.2.135:0/3625733847 conn(0x7f609c05f730 msgr2=0x7f609c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/3625733847 shutdown_connections 2021-11-15T14:36:17.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/3625733847 wait complete. 2021-11-15T14:36:17.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 Processor -- start 2021-11-15T14:36:17.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- start start 2021-11-15T14:36:17.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0a7140 0x7f609c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c148420 0x7f609c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c067450 con 0x7f609c148420 2021-11-15T14:36:17.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0676a0 con 0x7f609c0b1e30 2021-11-15T14:36:17.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c156ac0 con 0x7f609c0a7140 2021-11-15T14:36:17.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56908/0 (socket says 172.21.2.135:56908) 2021-11-15T14:36:17.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 -- 172.21.2.135:0/2279303098 learned_addr learned my addr 172.21.2.135:0/2279303098 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:17.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 -- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0a7140 msgr2=0x7f609c157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0a7140 0x7f609c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 -- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c148420 msgr2=0x7f609c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c148420 0x7f609c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 -- 172.21.2.135:0/2279303098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608400b180 con 0x7f609c0b1e30 2021-11-15T14:36:17.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f609affd700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f608c002ef0 tx=0x7f608c006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608c009e00 con 0x7f609c0b1e30 2021-11-15T14:36:17.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c002320 con 0x7f609c0b1e30 2021-11-15T14:36:17.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c156d60 con 0x7f609c0b1e30 2021-11-15T14:36:17.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.356+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608c002680 con 0x7f609c0b1e30 2021-11-15T14:36:17.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0ac300 con 0x7f609c0b1e30 2021-11-15T14:36:17.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c156ef0 con 0x7f609c0b1e30 2021-11-15T14:36:17.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f608c00f030 con 0x7f609c0b1e30 2021-11-15T14:36:17.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f6098ff9700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 0x7f6080055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f608c06b780 con 0x7f609c0b1e30 2021-11-15T14:36:17.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f609b7fe700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 0x7f6080055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f609b7fe700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 0x7f6080055b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f609c1477b0 tx=0x7f6084014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.360+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f608c042790 con 0x7f609c0b1e30 2021-11-15T14:36:17.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f609c0677e0 con 0x7f609c0b1e30 2021-11-15T14:36:17.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f6098ff9700 1 -- 172.21.2.135:0/2279303098 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f608c045db0 con 0x7f609c0b1e30 2021-11-15T14:36:17.449 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:17.449 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":46,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:17.138104+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:36:15.047541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T14:36:16.111420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:17.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 msgr2=0x7f6080055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 0x7f6080055b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f609c1477b0 tx=0x7f6084014000).stop 2021-11-15T14:36:17.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 msgr2=0x7f609c066910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f608c002ef0 tx=0x7f608c006d40).stop 2021-11-15T14:36:17.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 shutdown_connections 2021-11-15T14:36:17.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60800536d0 0x7f6080055b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c148420 0x7f609c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0b1e30 0x7f609c066910 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 --2- 172.21.2.135:0/2279303098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0a7140 0x7f609c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 >> 172.21.2.135:0/2279303098 conn(0x7f609c05f730 msgr2=0x7f609c144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 shutdown_connections 2021-11-15T14:36:17.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.444+0000 7f60a21ad700 1 -- 172.21.2.135:0/2279303098 wait complete. 2021-11-15T14:36:17.456 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:36:17.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 Processor -- start 2021-11-15T14:36:17.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 -- start start 2021-11-15T14:36:17.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ffa881419e0 0x7ffa880b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880a7850 con 0x7ffa880b1350 2021-11-15T14:36:17.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880b06d0 con 0x7ffa880b1f40 2021-11-15T14:36:17.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8f612700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880b17c0 con 0x7ffa881419e0 2021-11-15T14:36:17.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ffa880b1f40 0x7ffa880a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44500/0 (socket says 172.21.2.135:44500) 2021-11-15T14:36:17.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/9959941 learned_addr learned my addr 172.21.2.135:0/9959941 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:17.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576099859 0 0) 0x7ffa880b06d0 con 0x7ffa880b1f40 2021-11-15T14:36:17.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70003260 con 0x7ffa880b1f40 2021-11-15T14:36:17.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624301665 0 0) 0x7ffa70003260 con 0x7ffa880b1f40 2021-11-15T14:36:17.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 >> v2:172.21.2.119:3300/0 conn(0x7ffa881419e0 msgr2=0x7ffa880b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 --2- 172.21.2.135:0/9959941 >> v2:172.21.2.119:3300/0 conn(0x7ffa881419e0 0x7ffa880b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 >> v1:172.21.2.119:6789/0 conn(0x7ffa880b1350 legacy=0x7ffa881412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880b0970 con 0x7ffa880b1f40 2021-11-15T14:36:17.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ffa78001660 con 0x7ffa880b1f40 2021-11-15T14:36:17.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 >> v1:172.21.2.135:6789/0 conn(0x7ffa880b1f40 legacy=0x7ffa880a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa70003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa70004500 0x7ffa70004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa70005050 0x7ffa7000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880b17c0 con 0x7ffa70004500 2021-11-15T14:36:17.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000bf40 con 0x7ffa70003820 2021-11-15T14:36:17.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000c100 con 0x7ffa70005050 2021-11-15T14:36:17.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa70003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa70005050 msgr2=0x7ffa7000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa70005050 0x7ffa7000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa70004500 msgr2=0x7ffa70004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:17.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa70004500 0x7ffa70004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/9959941 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70003260 con 0x7ffa70003820 2021-11-15T14:36:17.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8dbaf700 1 -- 172.21.2.135:0/9959941 reap_dead start 2021-11-15T14:36:17.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa70003c20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa880ad350 tx=0x7ffa880b0b00).ready entity=mon.1 client_cookie=380875b706af68ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa780070d0 con 0x7ffa70003820 2021-11-15T14:36:17.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78007230 con 0x7ffa70003820 2021-11-15T14:36:17.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.504+0000 7ffa77fff700 1 -- 172.21.2.135:0/9959941 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa7800c8f0 con 0x7ffa70003820 2021-11-15T14:36:17.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 msgr2=0x7ffa70003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa70003c20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa880ad350 tx=0x7ffa880b0b00).stop 2021-11-15T14:36:17.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/9959941 shutdown_connections 2021-11-15T14:36:17.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 --2- 172.21.2.135:0/9959941 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa70003c20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:17.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/9959941 >> 172.21.2.135:0/9959941 conn(0x7ffa8805f730 msgr2=0x7ffa8805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:17.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/9959941 shutdown_connections 2021-11-15T14:36:17.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/9959941 wait complete. 2021-11-15T14:36:17.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 Processor -- start 2021-11-15T14:36:17.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- start start 2021-11-15T14:36:17.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa880b5020 0x7ffa880b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa880b54a0 0x7ffa8815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880b5a70 con 0x7ffa880b54a0 2021-11-15T14:36:17.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880b5f40 con 0x7ffa70003820 2021-11-15T14:36:17.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881481b0 con 0x7ffa880b5020 2021-11-15T14:36:17.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56924/0 (socket says 172.21.2.135:56924) 2021-11-15T14:36:17.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/2429701159 learned_addr learned my addr 172.21.2.135:0/2429701159 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:17.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa880b5020 msgr2=0x7ffa880b3d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:17.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa880b5020 0x7ffa880b3d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa880b54a0 msgr2=0x7ffa8815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:17.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa880b54a0 0x7ffa8815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:17.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 -- 172.21.2.135:0/2429701159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880b5ca0 con 0x7ffa70003820 2021-11-15T14:36:17.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8d3ae700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ffa88148d30 tx=0x7ffa78013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa7801a070 con 0x7ffa70003820 2021-11-15T14:36:17.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78004920 con 0x7ffa70003820 2021-11-15T14:36:17.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa880ab720 con 0x7ffa70003820 2021-11-15T14:36:17.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa780070d0 con 0x7ffa70003820 2021-11-15T14:36:17.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880ac230 con 0x7ffa70003820 2021-11-15T14:36:17.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa880b4570 con 0x7ffa70003820 2021-11-15T14:36:17.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa78010070 con 0x7ffa70003820 2021-11-15T14:36:17.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 0x7ffa68055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:17.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffa7806bed0 con 0x7ffa70003820 2021-11-15T14:36:17.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.508+0000 7ffa8cbad700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 0x7ffa68055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:17.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.512+0000 7ffa8cbad700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 0x7ffa68055a70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ffa84000f70 tx=0x7ffa84006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:17.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.512+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa78042dd0 con 0x7ffa70003820 2021-11-15T14:36:17.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:17.620+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffa880b0c10 con 0x7ffa70003820 2021-11-15T14:36:18.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.588+0000 7ffa767fc700 1 -- 172.21.2.135:0/2429701159 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffa780463f0 con 0x7ffa70003820 2021-11-15T14:36:18.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 msgr2=0x7ffa68055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 0x7ffa68055a70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ffa84000f70 tx=0x7ffa84006930).stop 2021-11-15T14:36:18.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 msgr2=0x7ffa88148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ffa88148d30 tx=0x7ffa78013000).stop 2021-11-15T14:36:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 shutdown_connections 2021-11-15T14:36:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa680535b0 0x7ffa68055a70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffa880b54a0 0x7ffa8815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffa880b5020 0x7ffa880b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 --2- 172.21.2.135:0/2429701159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffa70003820 0x7ffa88148e50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 >> 172.21.2.135:0/2429701159 conn(0x7ffa8805f730 msgr2=0x7ffa880ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 shutdown_connections 2021-11-15T14:36:18.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.592+0000 7ffa8f612700 1 -- 172.21.2.135:0/2429701159 wait complete. 2021-11-15T14:36:18.602 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:18.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 Processor -- start 2021-11-15T14:36:18.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 -- start start 2021-11-15T14:36:18.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 0x7f0a8c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 0x7f0a8c143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0aac30 con 0x7f0a8c0b4cc0 2021-11-15T14:36:18.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c060560 con 0x7f0a8c060180 2021-11-15T14:36:18.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a92dac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c066f20 con 0x7f0a8c067380 2021-11-15T14:36:18.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a90b48700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 0x7f0a8c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 0x7f0a8c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a91349700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f0a8c0b4cc0 0x7f0a8c144590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:53936/0 (socket says 172.21.2.135:53936) 2021-11-15T14:36:18.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a91349700 1 -- 172.21.2.135:0/765784180 learned_addr learned my addr 172.21.2.135:0/765784180 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:18.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 -- 172.21.2.135:0/765784180 >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 msgr2=0x7f0a8c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:18.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 --2- 172.21.2.135:0/765784180 >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 0x7f0a8c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 -- 172.21.2.135:0/765784180 >> v1:172.21.2.119:6789/0 conn(0x7f0a8c0b4cc0 legacy=0x7f0a8c144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 -- 172.21.2.135:0/765784180 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0b3430 con 0x7f0a8c067380 2021-11-15T14:36:18.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a90b48700 1 --2- 172.21.2.135:0/765784180 >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 0x7f0a8c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:36:18.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8bfff700 1 --2- 172.21.2.135:0/765784180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 0x7f0a8c143970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0a80002f70 tx=0x7f0a80006e80).ready entity=mon.2 client_cookie=ccbbb82fbd86eeb9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8b7fe700 1 -- 172.21.2.135:0/765784180 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80012070 con 0x7f0a8c067380 2021-11-15T14:36:18.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8b7fe700 1 -- 172.21.2.135:0/765784180 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80000e90 con 0x7f0a8c067380 2021-11-15T14:36:18.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.648+0000 7f0a8b7fe700 1 -- 172.21.2.135:0/765784180 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8000f7f0 con 0x7f0a8c067380 2021-11-15T14:36:18.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/765784180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 msgr2=0x7f0a8c143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- 172.21.2.135:0/765784180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 0x7f0a8c143970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0a80002f70 tx=0x7f0a80006e80).stop 2021-11-15T14:36:18.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/765784180 shutdown_connections 2021-11-15T14:36:18.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- 172.21.2.135:0/765784180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c067380 0x7f0a8c143970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- 172.21.2.135:0/765784180 >> v2:172.21.2.119:3300/0 conn(0x7f0a8c060180 0x7f0a8c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/765784180 >> 172.21.2.135:0/765784180 conn(0x7f0a8c05cfb0 msgr2=0x7f0a8c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/765784180 shutdown_connections 2021-11-15T14:36:18.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/765784180 wait complete. 2021-11-15T14:36:18.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 Processor -- start 2021-11-15T14:36:18.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- start start 2021-11-15T14:36:18.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c060180 0x7f0a8c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 0x7f0a8c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ac540 con 0x7f0a8c0b4cc0 2021-11-15T14:36:18.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ada90 con 0x7f0a8c067380 2021-11-15T14:36:18.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0add30 con 0x7f0a8c060180 2021-11-15T14:36:18.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56938/0 (socket says 172.21.2.135:56938) 2021-11-15T14:36:18.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 -- 172.21.2.135:0/3804314680 learned_addr learned my addr 172.21.2.135:0/3804314680 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:18.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a91349700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 0x7f0a8c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 -- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c060180 msgr2=0x7f0a8c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c060180 0x7f0a8c0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 -- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 msgr2=0x7f0a8c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 0x7f0a8c13d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 -- 172.21.2.135:0/3804314680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c00b180 con 0x7f0a8c067380 2021-11-15T14:36:18.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a91349700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 0x7f0a8c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:18.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a8bfff700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0a8c0ad9b0 tx=0x7f0a80006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80017680 con 0x7f0a8c067380 2021-11-15T14:36:18.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8001c070 con 0x7f0a8c067380 2021-11-15T14:36:18.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8000d590 con 0x7f0a8c067380 2021-11-15T14:36:18.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a800179d0 con 0x7f0a8c067380 2021-11-15T14:36:18.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c0abf50 con 0x7f0a8c067380 2021-11-15T14:36:18.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c0625a0 con 0x7f0a8c067380 2021-11-15T14:36:18.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a80017b30 con 0x7f0a8c067380 2021-11-15T14:36:18.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 0x7f0a6c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.652+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0a80070bb0 con 0x7f0a8c067380 2021-11-15T14:36:18.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.656+0000 7f0a90b48700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 0x7f0a6c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.656+0000 7f0a90b48700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 0x7f0a6c0559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f0a7c00c000 tx=0x7f0a7c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.656+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a80047ab0 con 0x7f0a8c067380 2021-11-15T14:36:18.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a8c0573d0 con 0x7f0a8c067380 2021-11-15T14:36:18.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a89ffb700 1 -- 172.21.2.135:0/3804314680 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f0a8004b0d0 con 0x7f0a8c067380 2021-11-15T14:36:18.770 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:18.770 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:18.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 msgr2=0x7f0a6c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 0x7f0a6c0559b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f0a7c00c000 tx=0x7f0a7c006df0).stop 2021-11-15T14:36:18.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 msgr2=0x7f0a8c0b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0a8c0ad9b0 tx=0x7f0a80006e80).stop 2021-11-15T14:36:18.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 shutdown_connections 2021-11-15T14:36:18.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a6c0534f0 0x7f0a6c0559b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a8c0b4cc0 0x7f0a8c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a8c067380 0x7f0a8c0b6a60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 --2- 172.21.2.135:0/3804314680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a8c060180 0x7f0a8c0ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 >> 172.21.2.135:0/3804314680 conn(0x7f0a8c05cfb0 msgr2=0x7f0a8c143740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 shutdown_connections 2021-11-15T14:36:18.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.764+0000 7f0a92dac700 1 -- 172.21.2.135:0/3804314680 wait complete. 2021-11-15T14:36:18.774 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:18.777 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:18.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 Processor -- start 2021-11-15T14:36:18.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- start start 2021-11-15T14:36:18.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08b80b6600 0x7f08b80b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b80b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f08b8061db0 0x7f08b8062220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b8144130 con 0x7f08b8061db0 2021-11-15T14:36:18.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80b6ed0 con 0x7f08b80b6600 2021-11-15T14:36:18.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8143bf0 con 0x7f08b80b4440 2021-11-15T14:36:18.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08b80b6600 0x7f08b80b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08b80b6600 0x7f08b80b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56944/0 (socket says 172.21.2.135:56944) 2021-11-15T14:36:18.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 -- 172.21.2.135:0/3709374242 learned_addr learned my addr 172.21.2.135:0/3709374242 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:18.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 -- 172.21.2.135:0/3709374242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 msgr2=0x7f08b80b69e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:18.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/3709374242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b80b69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 -- 172.21.2.135:0/3709374242 >> v2:172.21.2.119:3300/0 conn(0x7f08b8061db0 msgr2=0x7f08b8062220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:18.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/3709374242 >> v2:172.21.2.119:3300/0 conn(0x7f08b8061db0 0x7f08b8062220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 -- 172.21.2.135:0/3709374242 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8143e90 con 0x7f08b80b6600 2021-11-15T14:36:18.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/3709374242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b80b6600 0x7f08b80b5c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8006eb0).ready entity=mon.1 client_cookie=af45d9d168a9ec09 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b5ffb700 1 -- 172.21.2.135:0/3709374242 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a800d570 con 0x7f08b80b6600 2021-11-15T14:36:18.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b5ffb700 1 -- 172.21.2.135:0/3709374242 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8000e90 con 0x7f08b80b6600 2021-11-15T14:36:18.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b5ffb700 1 -- 172.21.2.135:0/3709374242 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a800d900 con 0x7f08b80b6600 2021-11-15T14:36:18.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- 172.21.2.135:0/3709374242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b80b6600 msgr2=0x7f08b80b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- 172.21.2.135:0/3709374242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b80b6600 0x7f08b80b5c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8006eb0).stop 2021-11-15T14:36:18.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- 172.21.2.135:0/3709374242 shutdown_connections 2021-11-15T14:36:18.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- 172.21.2.135:0/3709374242 >> v2:172.21.2.119:3300/0 conn(0x7f08b8061db0 0x7f08b8062220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- 172.21.2.135:0/3709374242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b80b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- 172.21.2.135:0/3709374242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b80b6600 0x7f08b80b5c70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- 172.21.2.135:0/3709374242 >> 172.21.2.135:0/3709374242 conn(0x7f08b805c510 msgr2=0x7f08b805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- 172.21.2.135:0/3709374242 shutdown_connections 2021-11-15T14:36:18.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- 172.21.2.135:0/3709374242 wait complete. 2021-11-15T14:36:18.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 Processor -- start 2021-11-15T14:36:18.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- start start 2021-11-15T14:36:18.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b8126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08b80b6600 0x7f08b8147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81267c0 con 0x7f08b80b6600 2021-11-15T14:36:18.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8126a60 con 0x7f08b8061db0 2021-11-15T14:36:18.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08bd659700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8126d00 con 0x7f08b80b4440 2021-11-15T14:36:18.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56948/0 (socket says 172.21.2.135:56948) 2021-11-15T14:36:18.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.824+0000 7f08b6ffd700 1 -- 172.21.2.135:0/4153850397 learned_addr learned my addr 172.21.2.135:0/4153850397 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:18.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 -- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 msgr2=0x7f08b8126120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:18.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b8126120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 -- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08b80b6600 msgr2=0x7f08b8147590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:18.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08b80b6600 0x7f08b8147590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 -- 172.21.2.135:0/4153850397 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a800b1e0 con 0x7f08b8061db0 2021-11-15T14:36:18.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b6ffd700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a800de40 con 0x7f08b8061db0 2021-11-15T14:36:18.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8011ce0 con 0x7f08b8061db0 2021-11-15T14:36:18.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b80b2fd0 con 0x7f08b8061db0 2021-11-15T14:36:18.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a801e650 con 0x7f08b8061db0 2021-11-15T14:36:18.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b8147a80 con 0x7f08b8061db0 2021-11-15T14:36:18.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b8126ec0 con 0x7f08b8061db0 2021-11-15T14:36:18.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08a8025030 con 0x7f08b8061db0 2021-11-15T14:36:18.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 0x7f089c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f08a806cda0 con 0x7f08b8061db0 2021-11-15T14:36:18.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b67fc700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 0x7f089c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.828+0000 7f08b67fc700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 0x7f089c055b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f08a0002ef0 tx=0x7f08a0006890).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.832+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08a8043db0 con 0x7f08b8061db0 2021-11-15T14:36:18.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b8061670 con 0x7f08b8061db0 2021-11-15T14:36:18.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08affff700 1 -- 172.21.2.135:0/4153850397 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f08a8023070 con 0x7f08b8061db0 2021-11-15T14:36:18.921 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:18.921 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":47,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:18.143439+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:36:15.047541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T14:36:16.111420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:18.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 msgr2=0x7f089c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 0x7f089c055b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f08a0002ef0 tx=0x7f08a0006890).stop 2021-11-15T14:36:18.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 msgr2=0x7f08b81415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8015000).stop 2021-11-15T14:36:18.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 shutdown_connections 2021-11-15T14:36:18.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f089c0536d0 0x7f089c055b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08b80b6600 0x7f08b8147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08b80b4440 0x7f08b8126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 --2- 172.21.2.135:0/4153850397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08b8061db0 0x7f08b81415f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 >> 172.21.2.135:0/4153850397 conn(0x7f08b805c510 msgr2=0x7f08b81431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 shutdown_connections 2021-11-15T14:36:18.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.916+0000 7f08bd659700 1 -- 172.21.2.135:0/4153850397 wait complete. 2021-11-15T14:36:18.928 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:36:18.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.976+0000 7f5fcc9ca700 1 Processor -- start 2021-11-15T14:36:18.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.976+0000 7f5fcc9ca700 1 -- start start 2021-11-15T14:36:18.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5fc80b1300 0x7f5fc80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5fc8140d70 0x7f5fc80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80a8cf0 0x7f5fc80ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc8140390 con 0x7f5fc80b1300 2021-11-15T14:36:18.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc8140630 con 0x7f5fc8140d70 2021-11-15T14:36:18.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc81408d0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5fc8140d70 0x7f5fc80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5fc8140d70 0x7f5fc80b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56956/0 (socket says 172.21.2.135:56956) 2021-11-15T14:36:18.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 -- 172.21.2.135:0/2467836789 learned_addr learned my addr 172.21.2.135:0/2467836789 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:18.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 -- 172.21.2.135:0/2467836789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80a8cf0 msgr2=0x7f5fc80ae730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:18.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/2467836789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80a8cf0 0x7f5fc80ae730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 -- 172.21.2.135:0/2467836789 >> v2:172.21.2.119:3300/0 conn(0x7f5fc80b1300 msgr2=0x7f5fc80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:18.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/2467836789 >> v2:172.21.2.119:3300/0 conn(0x7f5fc80b1300 0x7f5fc80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 -- 172.21.2.135:0/2467836789 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8140080 con 0x7f5fc8140d70 2021-11-15T14:36:18.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/2467836789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc8140d70 0x7f5fc80b21e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f5fb8002f70 tx=0x7f5fb8006eb0).ready entity=mon.1 client_cookie=863e389624f3729a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc559a700 1 -- 172.21.2.135:0/2467836789 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb800d570 con 0x7f5fc8140d70 2021-11-15T14:36:18.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc559a700 1 -- 172.21.2.135:0/2467836789 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8000e90 con 0x7f5fc8140d70 2021-11-15T14:36:18.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc559a700 1 -- 172.21.2.135:0/2467836789 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb800d900 con 0x7f5fc8140d70 2021-11-15T14:36:18.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/2467836789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc8140d70 msgr2=0x7f5fc80b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/2467836789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc8140d70 0x7f5fc80b21e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f5fb8002f70 tx=0x7f5fb8006eb0).stop 2021-11-15T14:36:18.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/2467836789 shutdown_connections 2021-11-15T14:36:18.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/2467836789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80a8cf0 0x7f5fc80ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/2467836789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc8140d70 0x7f5fc80b21e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/2467836789 >> v2:172.21.2.119:3300/0 conn(0x7f5fc80b1300 0x7f5fc80b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:18.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/2467836789 >> 172.21.2.135:0/2467836789 conn(0x7f5fc805f730 msgr2=0x7f5fc805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:18.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/2467836789 shutdown_connections 2021-11-15T14:36:18.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/2467836789 wait complete. 2021-11-15T14:36:18.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 Processor -- start 2021-11-15T14:36:18.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- start start 2021-11-15T14:36:18.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80b1300 0x7f5fc80ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 0x7f5fc80ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:18.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80aaa90 con 0x7f5fc8140d70 2021-11-15T14:36:18.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80b16e0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fcc9ca700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80aef10 con 0x7f5fc80b1300 2021-11-15T14:36:18.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56962/0 (socket says 172.21.2.135:56962) 2021-11-15T14:36:18.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 -- 172.21.2.135:0/1740074357 learned_addr learned my addr 172.21.2.135:0/1740074357 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:18.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc6d9d700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 0x7f5fc80ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 -- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80b1300 msgr2=0x7f5fc80ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80b1300 0x7f5fc80ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:18.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80b1300 0x7f5fc80ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 -- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 msgr2=0x7f5fc80ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:18.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 0x7f5fc80ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:18.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 -- 172.21.2.135:0/1740074357 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb800b1e0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc6d9d700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 0x7f5fc80ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:18.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.980+0000 7f5fc659c700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5fc814ca60 tx=0x7f5fb0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:18.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb0013460 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb00135c0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fb0013920 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc80af1e0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc80aec70 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc80aafd0 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5fb000f070 con 0x7f5fc80a8cf0 2021-11-15T14:36:18.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 0x7f5fac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5fb006b360 con 0x7f5fc80a8cf0 2021-11-15T14:36:19.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 0x7f5fac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fc5d9b700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 0x7f5fac055b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5fb8017000 tx=0x7f5fb8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:18.984+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5fb0042370 con 0x7f5fc80a8cf0 2021-11-15T14:36:19.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.096+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5fc80aa410 con 0x7f5fc80a8cf0 2021-11-15T14:36:19.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fbf7fe700 1 -- 172.21.2.135:0/1740074357 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5fb0045990 con 0x7f5fc80a8cf0 2021-11-15T14:36:19.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 msgr2=0x7f5fac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 0x7f5fac055b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5fb8017000 tx=0x7f5fb8015000).stop 2021-11-15T14:36:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 msgr2=0x7f5fc81310f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5fc814ca60 tx=0x7f5fb0006ec0).stop 2021-11-15T14:36:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 shutdown_connections 2021-11-15T14:36:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5fac0536a0 0x7f5fac055b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5fc8140d70 0x7f5fc80ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5fc80b1300 0x7f5fc80ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 --2- 172.21.2.135:0/1740074357 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5fc80a8cf0 0x7f5fc81310f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 >> 172.21.2.135:0/1740074357 conn(0x7f5fc805f730 msgr2=0x7f5fc80afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 shutdown_connections 2021-11-15T14:36:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.112+0000 7f5fcc9ca700 1 -- 172.21.2.135:0/1740074357 wait complete. 2021-11-15T14:36:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:36:19.120 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:36:19.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.168+0000 7f3eda444700 1 Processor -- start 2021-11-15T14:36:19.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.168+0000 7f3eda444700 1 -- start start 2021-11-15T14:36:19.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3ed40b1300 0x7f3ed40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ed40b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed4140390 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed4140630 con 0x7f3ed40b1300 2021-11-15T14:36:19.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41408d0 con 0x7f3ed4140d70 2021-11-15T14:36:19.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3ed40a8cf0 0x7f3ed40ae730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44558/0 (socket says 172.21.2.135:44558) 2021-11-15T14:36:19.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 -- 172.21.2.135:0/1580724046 learned_addr learned my addr 172.21.2.135:0/1580724046 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:19.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920094105 0 0) 0x7f3ed4140390 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec0003260 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed37fe700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ed40b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/1580724046 >> v2:172.21.2.119:3300/0 conn(0x7f3ed40b1300 0x7f3ed40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356315659 0 0) 0x7f3ec0003260 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 msgr2=0x7f3ed40b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ed40b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 >> v2:172.21.2.119:3300/0 conn(0x7f3ed40b1300 msgr2=0x7f3ed40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 --2- 172.21.2.135:0/1580724046 >> v2:172.21.2.119:3300/0 conn(0x7f3ed40b1300 0x7f3ed40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4140080 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f3ecc0019e0 con 0x7f3ed40a8cf0 2021-11-15T14:36:19.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 >> v1:172.21.2.135:6789/0 conn(0x7f3ed40a8cf0 legacy=0x7f3ed40ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ec00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec0003e00 0x7f3ec0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec00049f0 0x7f3ec0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4140630 con 0x7f3ec0003e00 2021-11-15T14:36:19.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41408d0 con 0x7f3ec00049f0 2021-11-15T14:36:19.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec000b8e0 con 0x7f3ed4140d70 2021-11-15T14:36:19.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ec00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec00049f0 0x7f3ec0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed37fe700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec0003e00 0x7f3ec0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 -- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 msgr2=0x7f3ec00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4140d70 0x7f3ec00037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 -- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec0003e00 msgr2=0x7f3ec0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec0003e00 0x7f3ec0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 -- 172.21.2.135:0/1580724046 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0003260 con 0x7f3ec00049f0 2021-11-15T14:36:19.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec00049f0 0x7f3ec0004e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f3ecc0016f0 tx=0x7f3ed40b26d0).ready entity=mon.1 client_cookie=84452ea922e24b12 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ecc00cc50 con 0x7f3ec00049f0 2021-11-15T14:36:19.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc00cdb0 con 0x7f3ec00049f0 2021-11-15T14:36:19.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed2ffd700 1 -- 172.21.2.135:0/1580724046 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ecc005b80 con 0x7f3ec00049f0 2021-11-15T14:36:19.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- 172.21.2.135:0/1580724046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec00049f0 msgr2=0x7f3ec0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 --2- 172.21.2.135:0/1580724046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec00049f0 0x7f3ec0004e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f3ecc0016f0 tx=0x7f3ed40b26d0).stop 2021-11-15T14:36:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3ed89e1700 1 -- 172.21.2.135:0/1580724046 reap_dead start 2021-11-15T14:36:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- 172.21.2.135:0/1580724046 shutdown_connections 2021-11-15T14:36:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- 172.21.2.135:0/1580724046 >> 172.21.2.135:0/1580724046 conn(0x7f3ed405f730 msgr2=0x7f3ed405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- 172.21.2.135:0/1580724046 shutdown_connections 2021-11-15T14:36:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- 172.21.2.135:0/1580724046 wait complete. 2021-11-15T14:36:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 Processor -- start 2021-11-15T14:36:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.172+0000 7f3eda444700 1 -- start start 2021-11-15T14:36:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 0x7f3ed4065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4143f90 0x7f3ed4141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4063f50 con 0x7f3ed40abd00 2021-11-15T14:36:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4066130 con 0x7f3ed4143b10 2021-11-15T14:36:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed413f8f0 con 0x7f3ed4143f90 2021-11-15T14:36:19.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:56982/0 (socket says 172.21.2.135:56982) 2021-11-15T14:36:19.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 -- 172.21.2.135:0/3795909242 learned_addr learned my addr 172.21.2.135:0/3795909242 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:19.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 0x7f3ed4065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 -- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4143f90 msgr2=0x7f3ed4141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4143f90 0x7f3ed4141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 -- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 msgr2=0x7f3ed4065c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 0x7f3ed4065c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 -- 172.21.2.135:0/3795909242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40ac0e0 con 0x7f3ed4143b10 2021-11-15T14:36:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 0x7f3ed4065c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed37fe700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f3ed4064bd0 tx=0x7f3ec4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec4012800 con 0x7f3ed4143b10 2021-11-15T14:36:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4012960 con 0x7f3ed4143b10 2021-11-15T14:36:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4062c00 con 0x7f3ed4143b10 2021-11-15T14:36:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec4012cc0 con 0x7f3ed4143b10 2021-11-15T14:36:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed413fb20 con 0x7f3ed4143b10 2021-11-15T14:36:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed40aa410 con 0x7f3ed4143b10 2021-11-15T14:36:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ec4014470 con 0x7f3ed4143b10 2021-11-15T14:36:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 0x7f3eb4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3ec406bff0 con 0x7f3ed4143b10 2021-11-15T14:36:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.176+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 0x7f3eb4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.180+0000 7f3ed3fff700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 0x7f3eb4055a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f3ec800c000 tx=0x7f3ec800b040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.180+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ec4042fa0 con 0x7f3ed4143b10 2021-11-15T14:36:19.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.288+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3ed40573d0 con 0x7f3ed4143b10 2021-11-15T14:36:19.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.300+0000 7f3ed17fa700 1 -- 172.21.2.135:0/3795909242 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3ec40465c0 con 0x7f3ed4143b10 2021-11-15T14:36:19.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 msgr2=0x7f3eb4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 0x7f3eb4055a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f3ec800c000 tx=0x7f3ec800b040).stop 2021-11-15T14:36:19.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 msgr2=0x7f3ed4141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f3ed4064bd0 tx=0x7f3ec4008040).stop 2021-11-15T14:36:19.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 shutdown_connections 2021-11-15T14:36:19.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3eb4053580 0x7f3eb4055a40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ed4143f90 0x7f3ed4141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:19.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ed4143b10 0x7f3ed4141340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 --2- 172.21.2.135:0/3795909242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ed40abd00 0x7f3ed4065c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 >> 172.21.2.135:0/3795909242 conn(0x7f3ed405f730 msgr2=0x7f3ed40ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 shutdown_connections 2021-11-15T14:36:19.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.304+0000 7f3eda444700 1 -- 172.21.2.135:0/3795909242 wait complete. 2021-11-15T14:36:19.311 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:36:19.314 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 Processor -- start 2021-11-15T14:36:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 -- start start 2021-11-15T14:36:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 0x7f23ac0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23ac0b69e0 0x7f23ac12ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac144130 con 0x7f23ac0b4440 2021-11-15T14:36:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac143bf0 con 0x7f23ac0b69e0 2021-11-15T14:36:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23b1f17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac143e90 con 0x7f23ac0b6600 2021-11-15T14:36:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aaffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f23ac0b4440 0x7f23ac061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44576/0 (socket says 172.21.2.135:44576) 2021-11-15T14:36:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aaffd700 1 -- 172.21.2.135:0/2979410531 learned_addr learned my addr 172.21.2.135:0/2979410531 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115517962 0 0) 0x7f23ac144130 con 0x7f23ac0b4440 2021-11-15T14:36:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238c003260 con 0x7f23ac0b4440 2021-11-15T14:36:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909963230 0 0) 0x7f238c003260 con 0x7f23ac0b4440 2021-11-15T14:36:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 msgr2=0x7f23ac0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 0x7f23ac0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23abfff700 1 --2- 172.21.2.135:0/2979410531 >> v2:172.21.2.119:3300/0 conn(0x7f23ac0b69e0 0x7f23ac12ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 >> v2:172.21.2.119:3300/0 conn(0x7f23ac0b69e0 msgr2=0x7f23ac12ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 --2- 172.21.2.135:0/2979410531 >> v2:172.21.2.119:3300/0 conn(0x7f23ac0b69e0 0x7f23ac12ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac061670 con 0x7f23ac0b4440 2021-11-15T14:36:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.360+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f239c001660 con 0x7f23ac0b4440 2021-11-15T14:36:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 >> v1:172.21.2.135:6789/0 conn(0x7f23ac0b4440 legacy=0x7f23ac061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f238c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f238c004500 0x7f238c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 0x7f238c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac143bf0 con 0x7f238c004500 2021-11-15T14:36:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac143e90 con 0x7f238c003750 2021-11-15T14:36:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c00b990 con 0x7f23ac0b6600 2021-11-15T14:36:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23abfff700 1 --2- 172.21.2.135:0/2979410531 >> v2:172.21.2.119:3300/0 conn(0x7f23ac0b69e0 0x7f23ac12ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f238c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23abfff700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 0x7f238c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aaffd700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f238c004500 0x7f238c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 msgr2=0x7f238c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac0b6600 0x7f238c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f238c004500 msgr2=0x7f238c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:19.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f238c004500 0x7f238c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/2979410531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c003260 con 0x7f238c003750 2021-11-15T14:36:19.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394006ca0).ready entity=mon.1 client_cookie=c8cb02bbed185ccc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394013410 con 0x7f238c003750 2021-11-15T14:36:19.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394013570 con 0x7f238c003750 2021-11-15T14:36:19.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aa7fc700 1 -- 172.21.2.135:0/2979410531 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23940138d0 con 0x7f238c003750 2021-11-15T14:36:19.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/2979410531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 msgr2=0x7f238c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 --2- 172.21.2.135:0/2979410531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394006ca0).stop 2021-11-15T14:36:19.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23abfff700 1 -- 172.21.2.135:0/2979410531 reap_dead start 2021-11-15T14:36:19.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/2979410531 shutdown_connections 2021-11-15T14:36:19.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/2979410531 >> 172.21.2.135:0/2979410531 conn(0x7f23ac05c510 msgr2=0x7f23ac05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/2979410531 shutdown_connections 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/2979410531 wait complete. 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 Processor -- start 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- start start 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac12bf50 0x7f23ac1403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 0x7f23ac12af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0ad820 con 0x7f23ac1408b0 2021-11-15T14:36:19.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0adac0 con 0x7f238c003750 2021-11-15T14:36:19.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0add60 con 0x7f23ac12bf50 2021-11-15T14:36:19.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57002/0 (socket says 172.21.2.135:57002) 2021-11-15T14:36:19.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/4162452051 learned_addr learned my addr 172.21.2.135:0/4162452051 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:19.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23abfff700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 0x7f23ac12af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23aaffd700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac12bf50 0x7f23ac1403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac12bf50 msgr2=0x7f23ac1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac12bf50 0x7f23ac1403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 msgr2=0x7f23ac12af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 0x7f23ac12af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 -- 172.21.2.135:0/4162452051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0ae200 con 0x7f238c003750 2021-11-15T14:36:19.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23abfff700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 0x7f23ac12af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:36:19.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23ab7fe700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394013410 con 0x7f238c003750 2021-11-15T14:36:19.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394021660 con 0x7f238c003750 2021-11-15T14:36:19.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac140d30 con 0x7f238c003750 2021-11-15T14:36:19.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394012ec0 con 0x7f238c003750 2021-11-15T14:36:19.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.364+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac12c490 con 0x7f238c003750 2021-11-15T14:36:19.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac061910 con 0x7f238c003750 2021-11-15T14:36:19.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23940219c0 con 0x7f238c003750 2021-11-15T14:36:19.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23a8ff9700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 0x7f2390055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f239401b040 con 0x7f238c003750 2021-11-15T14:36:19.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23aaffd700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 0x7f2390055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23aaffd700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 0x7f2390055a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f239c00d000 tx=0x7f239c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.368+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23940441e0 con 0x7f238c003750 2021-11-15T14:36:19.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.476+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23ac0573d0 con 0x7f238c003750 2021-11-15T14:36:19.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.476+0000 7f23a8ff9700 1 -- 172.21.2.135:0/4162452051 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f2394047800 con 0x7f238c003750 2021-11-15T14:36:19.483 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:19.483 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:19.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 msgr2=0x7f2390055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 0x7f2390055a70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f239c00d000 tx=0x7f239c009040).stop 2021-11-15T14:36:19.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 msgr2=0x7f23ac141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f2394002f70 tx=0x7f2394014000).stop 2021-11-15T14:36:19.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 shutdown_connections 2021-11-15T14:36:19.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23900535b0 0x7f2390055a70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23ac1408b0 0x7f23ac12af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23ac12bf50 0x7f23ac1403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 --2- 172.21.2.135:0/4162452051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f238c003750 0x7f23ac141c00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 >> 172.21.2.135:0/4162452051 conn(0x7f23ac05c510 msgr2=0x7f23ac1431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 shutdown_connections 2021-11-15T14:36:19.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.480+0000 7f23b1f17700 1 -- 172.21.2.135:0/4162452051 wait complete. 2021-11-15T14:36:19.487 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:19.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:36:17.138655+0000', 'modified': '2021-11-15T14:36:18.583912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5200}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5200': {'gid': 5200, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/614438403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 614438403}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 614438403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:36:19.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:36:19.795 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:36:19.859 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5200,"want_state":"up:active","state":"up:active","rank_uptime":2.7117923400000001,"mdsmap_epoch":20,"osdmap_epoch":47,"osdmap_epoch_barrier":47,"uptime":6.8902820169999996} 2021-11-15T14:36:19.860 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5200, "mdsmap_epoch": 20, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "rank_uptime": 2.71179234, "state": "up:active", "uptime": 6.890282017, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:36:19.861 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:19.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 Processor -- start 2021-11-15T14:36:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 -- start start 2021-11-15T14:36:19.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f412c0acdd0 0x7f412c14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0b6d60 con 0x7f412c060990 2021-11-15T14:36:19.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c061260 con 0x7f412c0b6980 2021-11-15T14:36:19.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4133a30700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c061500 con 0x7f412c0acdd0 2021-11-15T14:36:19.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f4131fcd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f412c0acdd0 0x7f412c14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f41317cc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f412c0b6980 0x7f412c0a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44596/0 (socket says 172.21.2.135:44596) 2021-11-15T14:36:19.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.904+0000 7f41317cc700 1 -- 172.21.2.135:0/646999477 learned_addr learned my addr 172.21.2.135:0/646999477 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:19.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4131fcd700 1 -- 172.21.2.135:0/646999477 >> v1:172.21.2.135:6789/0 conn(0x7f412c0b6980 legacy=0x7f412c0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4131fcd700 1 -- 172.21.2.135:0/646999477 >> v1:172.21.2.119:6789/0 conn(0x7f412c060990 legacy=0x7f412c0aa650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:19.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4131fcd700 1 -- 172.21.2.135:0/646999477 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0617a0 con 0x7f412c0acdd0 2021-11-15T14:36:19.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4131fcd700 1 --2- 172.21.2.135:0/646999477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c14a2c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f412c060380 tx=0x7f412400b470).ready entity=mon.1 client_cookie=d46195ebd3f0848f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411bfff700 1 -- 172.21.2.135:0/646999477 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f412400ddb0 con 0x7f412c0acdd0 2021-11-15T14:36:19.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411bfff700 1 -- 172.21.2.135:0/646999477 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4124010470 con 0x7f412c0acdd0 2021-11-15T14:36:19.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411bfff700 1 -- 172.21.2.135:0/646999477 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41240107d0 con 0x7f412c0acdd0 2021-11-15T14:36:19.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/646999477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 msgr2=0x7f412c14a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 --2- 172.21.2.135:0/646999477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c14a2c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f412c060380 tx=0x7f412400b470).stop 2021-11-15T14:36:19.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/646999477 shutdown_connections 2021-11-15T14:36:19.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 --2- 172.21.2.135:0/646999477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c14a2c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:19.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/646999477 >> 172.21.2.135:0/646999477 conn(0x7f412c0b3500 msgr2=0x7f412c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:19.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/646999477 shutdown_connections 2021-11-15T14:36:19.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/646999477 wait complete. 2021-11-15T14:36:19.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 Processor -- start 2021-11-15T14:36:19.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- start start 2021-11-15T14:36:19.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f412c060990 0x7f412c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f412c0b6980 0x7f412c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c144ac0 con 0x7f412c0b6980 2021-11-15T14:36:19.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c144cf0 con 0x7f412c0acdd0 2021-11-15T14:36:19.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c144f90 con 0x7f412c060990 2021-11-15T14:36:19.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57014/0 (socket says 172.21.2.135:57014) 2021-11-15T14:36:19.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 -- 172.21.2.135:0/3270612594 learned_addr learned my addr 172.21.2.135:0/3270612594 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:19.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 -- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f412c060990 msgr2=0x7f412c13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f412c060990 0x7f412c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:19.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 -- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f412c0b6980 msgr2=0x7f412c151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f412c0b6980 0x7f412c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 -- 172.21.2.135:0/3270612594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412400b710 con 0x7f412c0acdd0 2021-11-15T14:36:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4130fcb700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f412c144540 tx=0x7f411c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f411c013460 con 0x7f412c0acdd0 2021-11-15T14:36:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0135c0 con 0x7f412c0acdd0 2021-11-15T14:36:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c145230 con 0x7f412c0acdd0 2021-11-15T14:36:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f411c013920 con 0x7f412c0acdd0 2021-11-15T14:36:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.908+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c067300 con 0x7f412c0acdd0 2021-11-15T14:36:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c061a40 con 0x7f412c0acdd0 2021-11-15T14:36:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f411c00f070 con 0x7f412c0acdd0 2021-11-15T14:36:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f411a7fc700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 0x7f410c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f411c06b460 con 0x7f412c0acdd0 2021-11-15T14:36:19.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f41317cc700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 0x7f410c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:19.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f41317cc700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 0x7f410c055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f412c05dcb0 tx=0x7f41280078b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.912+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f411c042470 con 0x7f412c0acdd0 2021-11-15T14:36:20.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f412c0573d0 con 0x7f412c0acdd0 2021-11-15T14:36:20.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f411a7fc700 1 -- 172.21.2.135:0/3270612594 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f411c045a90 con 0x7f412c0acdd0 2021-11-15T14:36:20.001 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:20.002 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":47,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:18.143439+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:36:15.047541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T14:36:16.111420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:20.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 msgr2=0x7f410c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 0x7f410c055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f412c05dcb0 tx=0x7f41280078b0).stop 2021-11-15T14:36:20.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 msgr2=0x7f412c13b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f412c144540 tx=0x7f411c006df0).stop 2021-11-15T14:36:20.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 shutdown_connections 2021-11-15T14:36:20.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f410c0536a0 0x7f410c055b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f412c0b6980 0x7f412c151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f412c0acdd0 0x7f412c13b610 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 --2- 172.21.2.135:0/3270612594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f412c060990 0x7f412c13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:19.996+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 >> 172.21.2.135:0/3270612594 conn(0x7f412c0b3500 msgr2=0x7f412c13c460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.000+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 shutdown_connections 2021-11-15T14:36:20.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.000+0000 7f4133a30700 1 -- 172.21.2.135:0/3270612594 wait complete. 2021-11-15T14:36:20.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:36:15.047541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:36:16.111420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:36:20.012 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:36:20.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 Processor -- start 2021-11-15T14:36:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 -- start start 2021-11-15T14:36:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02281444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f02280b3950 0x7f02281449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02280b2430 con 0x7f0228060040 2021-11-15T14:36:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280b26d0 con 0x7f02280b3950 2021-11-15T14:36:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022f64c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02280b2970 con 0x7f02280654a0 2021-11-15T14:36:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022d3e8700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0228060040 0x7f0228064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44608/0 (socket says 172.21.2.135:44608) 2021-11-15T14:36:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022d3e8700 1 -- 172.21.2.135:0/4273147319 learned_addr learned my addr 172.21.2.135:0/4273147319 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:20.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523372480 0 0) 0x7f02280b2430 con 0x7f0228060040 2021-11-15T14:36:20.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003260 con 0x7f0228060040 2021-11-15T14:36:20.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151435814 0 0) 0x7f0210003260 con 0x7f0228060040 2021-11-15T14:36:20.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 msgr2=0x7f02281444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022cbe7700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02281444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> v2:172.21.2.119:3300/0 conn(0x7f02280b3950 0x7f02281449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02281444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 >> v2:172.21.2.119:3300/0 conn(0x7f02280b3950 msgr2=0x7f02281449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 --2- 172.21.2.135:0/4273147319 >> v2:172.21.2.119:3300/0 conn(0x7f02280b3950 0x7f02281449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280648f0 con 0x7f0228060040 2021-11-15T14:36:20.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0224001660 con 0x7f0228060040 2021-11-15T14:36:20.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022cbe7700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02281444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:20.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 >> v1:172.21.2.135:6789/0 conn(0x7f0228060040 legacy=0x7f0228064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02100037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0210003ec0 0x7f0210004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0210004b40 0x7f0210004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280b26d0 con 0x7f0210003ec0 2021-11-15T14:36:20.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280b2970 con 0x7f0210004b40 2021-11-15T14:36:20.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021000ba80 con 0x7f02280654a0 2021-11-15T14:36:20.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> v2:172.21.2.119:3300/0 conn(0x7f02280b3950 0x7f02281449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:20.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0210004b40 0x7f0210004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022cbe7700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0210003ec0 0x7f0210004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022d3e8700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02100037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 -- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 msgr2=0x7f02100037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02280654a0 0x7f02100037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 -- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0210003ec0 msgr2=0x7f0210004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0210003ec0 0x7f0210004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 -- 172.21.2.135:0/4273147319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210003260 con 0x7f0210004b40 2021-11-15T14:36:20.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.060+0000 7f022dbe9700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0210004b40 0x7f0210004fc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f0220007000 tx=0x7f0220008040).ready entity=mon.1 client_cookie=de199214c9286d61 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f022000c640 con 0x7f0210004b40 2021-11-15T14:36:20.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022000c7a0 con 0x7f0210004b40 2021-11-15T14:36:20.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021bfff700 1 -- 172.21.2.135:0/4273147319 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f022000c910 con 0x7f0210004b40 2021-11-15T14:36:20.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/4273147319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0210004b40 msgr2=0x7f0210004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 --2- 172.21.2.135:0/4273147319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0210004b40 0x7f0210004fc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f0220007000 tx=0x7f0220008040).stop 2021-11-15T14:36:20.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022dbe9700 1 -- 172.21.2.135:0/4273147319 reap_dead start 2021-11-15T14:36:20.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/4273147319 shutdown_connections 2021-11-15T14:36:20.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/4273147319 >> 172.21.2.135:0/4273147319 conn(0x7f022805cfe0 msgr2=0x7f022805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/4273147319 shutdown_connections 2021-11-15T14:36:20.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/4273147319 wait complete. 2021-11-15T14:36:20.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 Processor -- start 2021-11-15T14:36:20.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- start start 2021-11-15T14:36:20.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0210004b40 0x7f022813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f022813db30 0x7f02280ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280ae5f0 con 0x7f022813db30 2021-11-15T14:36:20.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022813cc10 con 0x7f02280b1560 2021-11-15T14:36:20.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022813e160 con 0x7f0210004b40 2021-11-15T14:36:20.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57036/0 (socket says 172.21.2.135:57036) 2021-11-15T14:36:20.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 -- 172.21.2.135:0/726725203 learned_addr learned my addr 172.21.2.135:0/726725203 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022d3e8700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0210004b40 0x7f022813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022dbe9700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f022813db30 0x7f02280ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 -- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0210004b40 msgr2=0x7f022813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0210004b40 0x7f022813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 -- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f022813db30 msgr2=0x7f02280ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f022813db30 0x7f02280ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 -- 172.21.2.135:0/726725203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280b68d0 con 0x7f02280b1560 2021-11-15T14:36:20.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022cbe7700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f021c00d000 tx=0x7f021c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c013670 con 0x7f02280b1560 2021-11-15T14:36:20.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c000e90 con 0x7f02280b1560 2021-11-15T14:36:20.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280b6b70 con 0x7f02280b1560 2021-11-15T14:36:20.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021c0139c0 con 0x7f02280b1560 2021-11-15T14:36:20.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02280abd60 con 0x7f02280b1560 2021-11-15T14:36:20.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02280ac010 con 0x7f02280b1560 2021-11-15T14:36:20.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f021c013b20 con 0x7f02280b1560 2021-11-15T14:36:20.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 0x7f0208055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.064+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f021c06c030 con 0x7f02280b1560 2021-11-15T14:36:20.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.068+0000 7f022d3e8700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 0x7f0208055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.068+0000 7f022d3e8700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 0x7f0208055b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f0224005000 tx=0x7f0224009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.068+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f021c043040 con 0x7f02280b1560 2021-11-15T14:36:20.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.152+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f02280ab3b0 con 0x7f02280b1560 2021-11-15T14:36:20.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.152+0000 7f021a7fc700 1 -- 172.21.2.135:0/726725203 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v47) v1 ==== 110+0+10 (secure 0 0 0) 0x7f02280ab3b0 con 0x7f02280b1560 2021-11-15T14:36:20.160 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:36:20.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 msgr2=0x7f0208055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 0x7f0208055b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f0224005000 tx=0x7f0224009040).stop 2021-11-15T14:36:20.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 msgr2=0x7f022813d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f021c00d000 tx=0x7f021c008040).stop 2021-11-15T14:36:20.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 shutdown_connections 2021-11-15T14:36:20.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0208053640 0x7f0208055b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f022813db30 0x7f02280ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02280b1560 0x7f022813d640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 --2- 172.21.2.135:0/726725203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0210004b40 0x7f022813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 >> 172.21.2.135:0/726725203 conn(0x7f022805cfe0 msgr2=0x7f02281416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 shutdown_connections 2021-11-15T14:36:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.156+0000 7f022f64c700 1 -- 172.21.2.135:0/726725203 wait complete. 2021-11-15T14:36:20.168 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:36:20.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 Processor -- start 2021-11-15T14:36:20.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- start start 2021-11-15T14:36:20.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24200b0630 0x7f24200b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f24200b3790 0x7f242013d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24201439a0 con 0x7f242013dac0 2021-11-15T14:36:20.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2420143c40 con 0x7f24200b3790 2021-11-15T14:36:20.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2420143ee0 con 0x7f24200b0630 2021-11-15T14:36:20.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24200b0630 0x7f24200b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24200b0630 0x7f24200b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57040/0 (socket says 172.21.2.135:57040) 2021-11-15T14:36:20.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 -- 172.21.2.135:0/2201258114 learned_addr learned my addr 172.21.2.135:0/2201258114 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 -- 172.21.2.135:0/2201258114 >> v2:172.21.2.119:3300/0 conn(0x7f24200b3790 msgr2=0x7f242013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 --2- 172.21.2.135:0/2201258114 >> v2:172.21.2.119:3300/0 conn(0x7f24200b3790 0x7f242013d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 -- 172.21.2.135:0/2201258114 >> v1:172.21.2.119:6789/0 conn(0x7f242013dac0 legacy=0x7f24200b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 -- 172.21.2.135:0/2201258114 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420144180 con 0x7f24200b0630 2021-11-15T14:36:20.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241f7fe700 1 --2- 172.21.2.135:0/2201258114 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b0630 0x7f24200b0a10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f242006aad0 tx=0x7f2410006eb0).ready entity=mon.1 client_cookie=9a5721df338a238 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241e7fc700 1 -- 172.21.2.135:0/2201258114 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241000d5c0 con 0x7f24200b0630 2021-11-15T14:36:20.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241e7fc700 1 -- 172.21.2.135:0/2201258114 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410000e90 con 0x7f24200b0630 2021-11-15T14:36:20.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f241e7fc700 1 -- 172.21.2.135:0/2201258114 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241000d910 con 0x7f24200b0630 2021-11-15T14:36:20.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- 172.21.2.135:0/2201258114 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b0630 msgr2=0x7f24200b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 --2- 172.21.2.135:0/2201258114 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b0630 0x7f24200b0a10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f242006aad0 tx=0x7f2410006eb0).stop 2021-11-15T14:36:20.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- 172.21.2.135:0/2201258114 shutdown_connections 2021-11-15T14:36:20.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 --2- 172.21.2.135:0/2201258114 >> v2:172.21.2.119:3300/0 conn(0x7f24200b3790 0x7f242013d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 --2- 172.21.2.135:0/2201258114 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b0630 0x7f24200b0a10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- 172.21.2.135:0/2201258114 >> 172.21.2.135:0/2201258114 conn(0x7f2420060840 msgr2=0x7f2420060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- 172.21.2.135:0/2201258114 shutdown_connections 2021-11-15T14:36:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.216+0000 7f2425fff700 1 -- 172.21.2.135:0/2201258114 wait complete. 2021-11-15T14:36:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 Processor -- start 2021-11-15T14:36:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- start start 2021-11-15T14:36:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24200b0630 0x7f24200aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f242013dac0 0x7f2420132520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200663b0 con 0x7f24200b0630 2021-11-15T14:36:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200677a0 con 0x7f24200b3790 2021-11-15T14:36:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2420140ee0 con 0x7f242013dac0 2021-11-15T14:36:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57048/0 (socket says 172.21.2.135:57048) 2021-11-15T14:36:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 -- 172.21.2.135:0/4047849218 learned_addr learned my addr 172.21.2.135:0/4047849218 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 -- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f242013dac0 msgr2=0x7f2420132520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:20.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f242013dac0 0x7f2420132520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 -- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24200b0630 msgr2=0x7f24200aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24200b0630 0x7f24200aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 -- 172.21.2.135:0/4047849218 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241000b1e0 con 0x7f24200b3790 2021-11-15T14:36:20.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241effd700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f2408002f70 tx=0x7f2408006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2408013460 con 0x7f24200b3790 2021-11-15T14:36:20.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24080135c0 con 0x7f24200b3790 2021-11-15T14:36:20.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2420066110 con 0x7f24200b3790 2021-11-15T14:36:20.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420065a90 con 0x7f24200b3790 2021-11-15T14:36:20.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2408013920 con 0x7f24200b3790 2021-11-15T14:36:20.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420063ba0 con 0x7f24200b3790 2021-11-15T14:36:20.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f240801a060 con 0x7f24200b3790 2021-11-15T14:36:20.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 0x7f2404055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f240806b5e0 con 0x7f24200b3790 2021-11-15T14:36:20.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.220+0000 7f241f7fe700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 0x7f2404055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.224+0000 7f241f7fe700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 0x7f2404055be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f242006aad0 tx=0x7f2410015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.224+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24080424e0 con 0x7f24200b3790 2021-11-15T14:36:20.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2420063e00 con 0x7f24200b3790 2021-11-15T14:36:20.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f241cff9700 1 -- 172.21.2.135:0/4047849218 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2408045b00 con 0x7f24200b3790 2021-11-15T14:36:20.315 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:20.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 msgr2=0x7f2404055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 0x7f2404055be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f242006aad0 tx=0x7f2410015000).stop 2021-11-15T14:36:20.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 msgr2=0x7f2420064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f2408002f70 tx=0x7f2408006e90).stop 2021-11-15T14:36:20.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 shutdown_connections 2021-11-15T14:36:20.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2404053720 0x7f2404055be0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f242013dac0 0x7f2420132520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24200b3790 0x7f2420064670 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 --2- 172.21.2.135:0/4047849218 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24200b0630 0x7f24200aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 >> 172.21.2.135:0/4047849218 conn(0x7f2420060840 msgr2=0x7f24200b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 shutdown_connections 2021-11-15T14:36:20.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.308+0000 7f2425fff700 1 -- 172.21.2.135:0/4047849218 wait complete. 2021-11-15T14:36:20.321 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:36:20.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 Processor -- start 2021-11-15T14:36:20.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 -- start start 2021-11-15T14:36:20.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 0x7ff7a80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff7a80b0030 0x7ff7a80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80b2810 con 0x7ff7a80a7140 2021-11-15T14:36:20.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80b0470 con 0x7ff7a80b0030 2021-11-15T14:36:20.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.368+0000 7ff7af5ed700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80b06d0 con 0x7ff7a80b1f40 2021-11-15T14:36:20.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff7a80a7140 0x7ff7a81412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44644/0 (socket says 172.21.2.135:44644) 2021-11-15T14:36:20.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 -- 172.21.2.135:0/3505352154 learned_addr learned my addr 172.21.2.135:0/3505352154 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:20.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931269188 0 0) 0x7ff7a80b2810 con 0x7ff7a80a7140 2021-11-15T14:36:20.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff790003260 con 0x7ff7a80a7140 2021-11-15T14:36:20.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402245517 0 0) 0x7ff790003260 con 0x7ff7a80a7140 2021-11-15T14:36:20.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 msgr2=0x7ff7a80b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 0x7ff7a80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 >> v2:172.21.2.119:3300/0 conn(0x7ff7a80b0030 msgr2=0x7ff7a80b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 --2- 172.21.2.135:0/3505352154 >> v2:172.21.2.119:3300/0 conn(0x7ff7a80b0030 0x7ff7a80b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80b0970 con 0x7ff7a80a7140 2021-11-15T14:36:20.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff7a00019e0 con 0x7ff7a80a7140 2021-11-15T14:36:20.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 >> v1:172.21.2.135:6789/0 conn(0x7ff7a80a7140 legacy=0x7ff7a81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 0x7ff7900037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790003ee0 0x7ff790004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff790004bf0 0x7ff79000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80b0470 con 0x7ff790003ee0 2021-11-15T14:36:20.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80b06d0 con 0x7ff790004bf0 2021-11-15T14:36:20.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900053a0 con 0x7ff7a80b1f40 2021-11-15T14:36:20.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff790004bf0 0x7ff79000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 -- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 msgr2=0x7ff7900037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80b1f40 0x7ff7900037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 -- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790003ee0 msgr2=0x7ff790004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790003ee0 0x7ff790004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 -- 172.21.2.135:0/3505352154 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790003260 con 0x7ff790004bf0 2021-11-15T14:36:20.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff790004bf0 0x7ff79000b750 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ff7a00016f0 tx=0x7ff7a80b2a80).ready entity=mon.1 client_cookie=574d6e98dbfba360 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a000cc70 con 0x7ff790004bf0 2021-11-15T14:36:20.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000cdd0 con 0x7ff790004bf0 2021-11-15T14:36:20.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff79bfff700 1 -- 172.21.2.135:0/3505352154 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a0005b80 con 0x7ff790004bf0 2021-11-15T14:36:20.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- 172.21.2.135:0/3505352154 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff790004bf0 msgr2=0x7ff79000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/3505352154 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff790004bf0 0x7ff79000b750 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ff7a00016f0 tx=0x7ff7a80b2a80).stop 2021-11-15T14:36:20.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 -- 172.21.2.135:0/3505352154 reap_dead start 2021-11-15T14:36:20.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- 172.21.2.135:0/3505352154 shutdown_connections 2021-11-15T14:36:20.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- 172.21.2.135:0/3505352154 >> 172.21.2.135:0/3505352154 conn(0x7ff7a805f730 msgr2=0x7ff7a805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- 172.21.2.135:0/3505352154 shutdown_connections 2021-11-15T14:36:20.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- 172.21.2.135:0/3505352154 wait complete. 2021-11-15T14:36:20.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 Processor -- start 2021-11-15T14:36:20.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- start start 2021-11-15T14:36:20.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790004bf0 0x7ff7a80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80aa3f0 0x7ff7a8138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a813fed0 con 0x7ff790004bf0 2021-11-15T14:36:20.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80b58c0 con 0x7ff7a80b3290 2021-11-15T14:36:20.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7af5ed700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80aabf0 con 0x7ff7a80aa3f0 2021-11-15T14:36:20.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57066/0 (socket says 172.21.2.135:57066) 2021-11-15T14:36:20.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 -- 172.21.2.135:0/1103819702 learned_addr learned my addr 172.21.2.135:0/1103819702 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7adb8a700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80aa3f0 0x7ff7a8138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 -- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80aa3f0 msgr2=0x7ff7a8138860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80aa3f0 0x7ff7a8138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 -- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790004bf0 msgr2=0x7ff7a80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790004bf0 0x7ff7a80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.372+0000 7ff7acb88700 1 -- 172.21.2.135:0/1103819702 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80a94a0 con 0x7ff7a80b3290 2021-11-15T14:36:20.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7acb88700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff7a8067990 tx=0x7ff7a4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a4013460 con 0x7ff7a80b3290 2021-11-15T14:36:20.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a40135c0 con 0x7ff7a80b3290 2021-11-15T14:36:20.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7a4013920 con 0x7ff7a80b3290 2021-11-15T14:36:20.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a80ac110 con 0x7ff7a80b3290 2021-11-15T14:36:20.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a80ab0f0 con 0x7ff7a80b3290 2021-11-15T14:36:20.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a80b0c10 con 0x7ff7a80b3290 2021-11-15T14:36:20.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7a400f070 con 0x7ff7a80b3290 2021-11-15T14:36:20.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 0x7ff788055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff7a406b390 con 0x7ff7a80b3290 2021-11-15T14:36:20.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7ad389700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 0x7ff788055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff7ad389700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 0x7ff788055a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff79c002f70 tx=0x7ff79c006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.376+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7a40423a0 con 0x7ff7a80b3290 2021-11-15T14:36:20.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.460+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7a80573d0 con 0x7ff7a80b3290 2021-11-15T14:36:20.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.460+0000 7ff79a7fc700 1 -- 172.21.2.135:0/1103819702 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff7a40459c0 con 0x7ff7a80b3290 2021-11-15T14:36:20.466 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:20.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.460+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 msgr2=0x7ff788055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 0x7ff788055a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff79c002f70 tx=0x7ff79c006a10).stop 2021-11-15T14:36:20.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 msgr2=0x7ff7a80ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff7a8067990 tx=0x7ff7a4006ec0).stop 2021-11-15T14:36:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 shutdown_connections 2021-11-15T14:36:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7880535b0 0x7ff788055a70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7a80aa3f0 0x7ff7a8138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7a80b3290 0x7ff7a80ab940 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 --2- 172.21.2.135:0/1103819702 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff790004bf0 0x7ff7a80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 >> 172.21.2.135:0/1103819702 conn(0x7ff7a805f730 msgr2=0x7ff7a80af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 shutdown_connections 2021-11-15T14:36:20.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.464+0000 7ff7af5ed700 1 -- 172.21.2.135:0/1103819702 wait complete. 2021-11-15T14:36:20.474 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:36:20.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 Processor -- start 2021-11-15T14:36:20.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 -- start start 2021-11-15T14:36:20.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fccf40b3790 0x7fccf40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 0x7fccf40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf41439a0 con 0x7fccf40b0630 2021-11-15T14:36:20.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf4143c40 con 0x7fccf40b3790 2021-11-15T14:36:20.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf8bb1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4143ee0 con 0x7fccf40a9c90 2021-11-15T14:36:20.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fccf40b0630 0x7fccf413d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44662/0 (socket says 172.21.2.135:44662) 2021-11-15T14:36:20.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf259c700 1 -- 172.21.2.135:0/526844533 learned_addr learned my addr 172.21.2.135:0/526844533 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:20.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881908538 0 0) 0x7fccf41439a0 con 0x7fccf40b0630 2021-11-15T14:36:20.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd4003260 con 0x7fccf40b0630 2021-11-15T14:36:20.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329513130 0 0) 0x7fccd4003260 con 0x7fccf40b0630 2021-11-15T14:36:20.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 msgr2=0x7fccf40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 0x7fccf40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 >> v2:172.21.2.119:3300/0 conn(0x7fccf40b3790 msgr2=0x7fccf40b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 --2- 172.21.2.135:0/526844533 >> v2:172.21.2.119:3300/0 conn(0x7fccf40b3790 0x7fccf40b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4144180 con 0x7fccf40b0630 2021-11-15T14:36:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fccdc001660 con 0x7fccf40b0630 2021-11-15T14:36:20.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 >> v1:172.21.2.135:6789/0 conn(0x7fccf40b0630 legacy=0x7fccf413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 0x7fccd40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccd4003ee0 0x7fccd4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccd4004bf0 0x7fccd400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4143c40 con 0x7fccd4004bf0 2021-11-15T14:36:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4143ee0 con 0x7fccd4003ee0 2021-11-15T14:36:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40053a0 con 0x7fccf40a9c90 2021-11-15T14:36:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.520+0000 7fccf1d9b700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccd4003ee0 0x7fccd4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 -- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 msgr2=0x7fccd40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccf40a9c90 0x7fccd40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 -- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccd4004bf0 msgr2=0x7fccd400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccd4004bf0 0x7fccd400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 -- 172.21.2.135:0/526844533 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4003260 con 0x7fccd4003ee0 2021-11-15T14:36:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf1d9b700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccd4003ee0 0x7fccd4004500 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fcce4002f70 tx=0x7fcce4006ca0).ready entity=mon.1 client_cookie=eee15ab25e915644 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce400f760 con 0x7fccd4003ee0 2021-11-15T14:36:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400f8c0 con 0x7fccd4003ee0 2021-11-15T14:36:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf159a700 1 -- 172.21.2.135:0/526844533 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce400fc20 con 0x7fccd4003ee0 2021-11-15T14:36:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/526844533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccd4003ee0 msgr2=0x7fccd4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/526844533 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccd4003ee0 0x7fccd4004500 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fcce4002f70 tx=0x7fcce4006ca0).stop 2021-11-15T14:36:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 -- 172.21.2.135:0/526844533 reap_dead start 2021-11-15T14:36:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/526844533 shutdown_connections 2021-11-15T14:36:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/526844533 >> 172.21.2.135:0/526844533 conn(0x7fccf4060840 msgr2=0x7fccf4060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/526844533 shutdown_connections 2021-11-15T14:36:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/526844533 wait complete. 2021-11-15T14:36:20.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 Processor -- start 2021-11-15T14:36:20.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- start start 2021-11-15T14:36:20.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccd4003ee0 0x7fccf40ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccf40aa8e0 0x7fccf4063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40acff0 con 0x7fccf40aa8e0 2021-11-15T14:36:20.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40ac6e0 con 0x7fccf4063e40 2021-11-15T14:36:20.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40ac980 con 0x7fccd4003ee0 2021-11-15T14:36:20.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57090/0 (socket says 172.21.2.135:57090) 2021-11-15T14:36:20.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 -- 172.21.2.135:0/3372676509 learned_addr learned my addr 172.21.2.135:0/3372676509 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 -- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccd4003ee0 msgr2=0x7fccf40ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccd4003ee0 0x7fccf40ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 -- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccf40aa8e0 msgr2=0x7fccf4063950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccf40aa8e0 0x7fccf4063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 -- 172.21.2.135:0/3372676509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40acc20 con 0x7fccf4063e40 2021-11-15T14:36:20.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf2d9d700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fccf40ac4a0 tx=0x7fccec00a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccec005a20 con 0x7fccf4063e40 2021-11-15T14:36:20.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec005b80 con 0x7fccf4063e40 2021-11-15T14:36:20.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf40ad1e0 con 0x7fccf4063e40 2021-11-15T14:36:20.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccec007070 con 0x7fccf4063e40 2021-11-15T14:36:20.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf4151750 con 0x7fccf4063e40 2021-11-15T14:36:20.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf40ac130 con 0x7fccf4063e40 2021-11-15T14:36:20.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.524+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccec01b060 con 0x7fccf4063e40 2021-11-15T14:36:20.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.528+0000 7fcceb7fe700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 0x7fccd8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.528+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fccec06b2e0 con 0x7fccf4063e40 2021-11-15T14:36:20.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.528+0000 7fccf259c700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 0x7fccd8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.528+0000 7fccf259c700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 0x7fccd8055b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fccdc001370 tx=0x7fccf40b0550).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.546 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.528+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccec042290 con 0x7fccf4063e40 2021-11-15T14:36:20.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccf40acdb0 con 0x7fccf4063e40 2021-11-15T14:36:20.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fcceb7fe700 1 -- 172.21.2.135:0/3372676509 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+10 (secure 0 0 0) 0x7fccec019020 con 0x7fccf4063e40 2021-11-15T14:36:20.617 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:20.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 msgr2=0x7fccd8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 0x7fccd8055b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fccdc001370 tx=0x7fccf40b0550).stop 2021-11-15T14:36:20.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 msgr2=0x7fccf4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fccf40ac4a0 tx=0x7fccec00a060).stop 2021-11-15T14:36:20.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 shutdown_connections 2021-11-15T14:36:20.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccd80536a0 0x7fccd8055b60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccf4063e40 0x7fccf4151c20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccf40aa8e0 0x7fccf4063950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 --2- 172.21.2.135:0/3372676509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccd4003ee0 0x7fccf40ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 >> 172.21.2.135:0/3372676509 conn(0x7fccf4060840 msgr2=0x7fccf413cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 shutdown_connections 2021-11-15T14:36:20.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.612+0000 7fccf8bb1700 1 -- 172.21.2.135:0/3372676509 wait complete. 2021-11-15T14:36:20.625 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:36:20.625 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 Processor -- start 2021-11-15T14:36:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 -- start start 2021-11-15T14:36:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f60f40b1e30 0x7f60f40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b03d0 con 0x7f60f4148420 2021-11-15T14:36:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b0670 con 0x7f60f40a7140 2021-11-15T14:36:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60fb20a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40a9140 con 0x7f60f40b1e30 2021-11-15T14:36:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.668+0000 7f60f97a7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f60f40a7140 0x7f60f41447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44684/0 (socket says 172.21.2.135:44684) 2021-11-15T14:36:20.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/2636971233 learned_addr learned my addr 172.21.2.135:0/2636971233 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:20.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552509674 0 0) 0x7f60f40b0670 con 0x7f60f40a7140 2021-11-15T14:36:20.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d4003260 con 0x7f60f40a7140 2021-11-15T14:36:20.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493114117 0 0) 0x7f60d4003260 con 0x7f60f40a7140 2021-11-15T14:36:20.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 >> v2:172.21.2.119:3300/0 conn(0x7f60f40b1e30 msgr2=0x7f60f40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 --2- 172.21.2.135:0/2636971233 >> v2:172.21.2.119:3300/0 conn(0x7f60f40b1e30 0x7f60f40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 >> v1:172.21.2.119:6789/0 conn(0x7f60f4148420 legacy=0x7f60f40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40b0910 con 0x7f60f40a7140 2021-11-15T14:36:20.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f60ec001660 con 0x7f60f40a7140 2021-11-15T14:36:20.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 >> v1:172.21.2.135:6789/0 conn(0x7f60f40a7140 legacy=0x7f60f41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60d4003820 0x7f60d4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4004500 0x7f60d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 0x7f60d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400bf10 con 0x7f60d4003820 2021-11-15T14:36:20.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400c080 con 0x7f60d4005050 2021-11-15T14:36:20.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400c240 con 0x7f60d4004500 2021-11-15T14:36:20.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 0x7f60d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4004500 msgr2=0x7f60d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4004500 0x7f60d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60d4003820 msgr2=0x7f60d4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:20.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60d4003820 0x7f60d4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/2636971233 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4003260 con 0x7f60d4005050 2021-11-15T14:36:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/2636971233 reap_dead start 2021-11-15T14:36:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 0x7f60d400b750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f60f40acee0 tx=0x7f60f40b0aa0).ready entity=mon.1 client_cookie=5685be607315c8be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec0070d0 con 0x7f60d4005050 2021-11-15T14:36:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec007230 con 0x7f60d4005050 2021-11-15T14:36:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f37fe700 1 -- 172.21.2.135:0/2636971233 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec00c8f0 con 0x7f60d4005050 2021-11-15T14:36:20.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 msgr2=0x7f60d400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 0x7f60d400b750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f60f40acee0 tx=0x7f60f40b0aa0).stop 2021-11-15T14:36:20.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- 172.21.2.135:0/2636971233 shutdown_connections 2021-11-15T14:36:20.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 --2- 172.21.2.135:0/2636971233 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60d4005050 0x7f60d400b750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- 172.21.2.135:0/2636971233 >> 172.21.2.135:0/2636971233 conn(0x7f60f405f730 msgr2=0x7f60f405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- 172.21.2.135:0/2636971233 shutdown_connections 2021-11-15T14:36:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- 172.21.2.135:0/2636971233 wait complete. 2021-11-15T14:36:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 Processor -- start 2021-11-15T14:36:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- start start 2021-11-15T14:36:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4005050 0x7f60f40b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60f40afac0 0x7f60f40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40ad160 con 0x7f60f40afac0 2021-11-15T14:36:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f413f8d0 con 0x7f60f4140300 2021-11-15T14:36:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60fb20a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41575a0 con 0x7f60d4005050 2021-11-15T14:36:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57106/0 (socket says 172.21.2.135:57106) 2021-11-15T14:36:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/1757372825 learned_addr learned my addr 172.21.2.135:0/1757372825 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:20.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4005050 msgr2=0x7f60f40b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4005050 0x7f60f40b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60f40afac0 msgr2=0x7f60f40aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60f40afac0 0x7f60f40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 -- 172.21.2.135:0/1757372825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f413fb00 con 0x7f60f4140300 2021-11-15T14:36:20.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f97a7700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f60f40acee0 tx=0x7f60ec013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec0070d0 con 0x7f60f4140300 2021-11-15T14:36:20.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.672+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec001ba0 con 0x7f60f4140300 2021-11-15T14:36:20.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f413fda0 con 0x7f60f4140300 2021-11-15T14:36:20.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec0019c0 con 0x7f60f4140300 2021-11-15T14:36:20.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f41571e0 con 0x7f60f4140300 2021-11-15T14:36:20.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f413ff30 con 0x7f60f4140300 2021-11-15T14:36:20.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60ec026070 con 0x7f60f4140300 2021-11-15T14:36:20.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f1ffb700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 0x7f60d8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:20.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f60ec06be60 con 0x7f60f4140300 2021-11-15T14:36:20.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f8fa6700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 0x7f60d8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:20.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f8fa6700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 0x7f60d8055b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f60dc002f70 tx=0x7f60dc006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:20.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.676+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60ec042f20 con 0x7f60f4140300 2021-11-15T14:36:20.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.784+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f40b0bb0 con 0x7f60f4140300 2021-11-15T14:36:20.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.784+0000 7f60f1ffb700 1 -- 172.21.2.135:0/1757372825 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f60ec046540 con 0x7f60f4140300 2021-11-15T14:36:20.791 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:20.791 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 msgr2=0x7f60d8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 0x7f60d8055b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f60dc002f70 tx=0x7f60dc006a00).stop 2021-11-15T14:36:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 msgr2=0x7f60f40af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f60f40acee0 tx=0x7f60ec013000).stop 2021-11-15T14:36:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 shutdown_connections 2021-11-15T14:36:20.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60d8053640 0x7f60d8055b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60f4140300 0x7f60f40af190 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:20.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60f40afac0 0x7f60f40aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 --2- 172.21.2.135:0/1757372825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60d4005050 0x7f60f40b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:20.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 >> 172.21.2.135:0/1757372825 conn(0x7f60f405f730 msgr2=0x7f60f4142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:20.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 shutdown_connections 2021-11-15T14:36:20.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:20.788+0000 7f60fb20a700 1 -- 172.21.2.135:0/1757372825 wait complete. 2021-11-15T14:36:20.795 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:21.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:36:17.138655+0000', 'modified': '2021-11-15T14:36:18.583912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5200}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5200': {'gid': 5200, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/614438403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 614438403}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 614438403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:36:21.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:36:21.102 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:36:21.167 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5200,"want_state":"up:active","state":"up:active","rank_uptime":4.0187923640000003,"mdsmap_epoch":20,"osdmap_epoch":47,"osdmap_epoch_barrier":47,"uptime":8.1972823389999991} 2021-11-15T14:36:21.168 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5200, "mdsmap_epoch": 20, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "rank_uptime": 4.018792364, "state": "up:active", "uptime": 8.197282339, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:36:21.168 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:36:21.169 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:36:21.169 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:36:21.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:21.170 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:21.181 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:21.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:21.235 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:21.241 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:21.241 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:21.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:21.242 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:21.246 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:36:21.247 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:21.290 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:21.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:21.299 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:21.304 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:21.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:21.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:21.306 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:21.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:36:21.325+0000 7f5a5b52d080 -1 init, newargv = 0x5645815480e0 newargc=9ceph-fuse[14141]: starting ceph client 2021-11-15T14:36:21.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr: 2021-11-15T14:36:21.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14141]: starting fuse 2021-11-15T14:36:22.411 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:22.423 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:22.423 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:22.471 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:22.472 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:22.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.474 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:22.479 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:36:22.479 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:36:22.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.480 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:36:22.481 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:36:22.481 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:36:22.481 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:36:22.482 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:36:22.482 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.483 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:36:22.483 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:36:22.483 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:36:22.484 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.484 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:36:22.485 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:36:22.485 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:36:22.485 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:36:22.486 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.486 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:36:22.486 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:36:22.487 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:36:22.487 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:36:22.488 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:36:22.488 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.488 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:36:22.489 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:36:22.524 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14141.asok 2021-11-15T14:36:22.527 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14141.asok 2021-11-15T14:36:22.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.528 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14141.asok status 2021-11-15T14:36:22.575 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:36:22.575 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:36:22.575 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:36:22.576 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:36:22.576 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:36:22.576 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:36:22.576 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:36:22.576 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14141", 2021-11-15T14:36:22.577 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:36:22.577 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:22.577 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:36:22.578 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:36:22.578 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5359, 2021-11-15T14:36:22.578 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:36:22.578 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:36:22.578 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:36:22.579 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5359 2021-11-15T14:36:22.579 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:22.579 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:36:22.579 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:36:22.580 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:36:22.580 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3318022635 2021-11-15T14:36:22.580 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:36:22.580 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:22.580 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:36:22.581 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:36:22.581 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:36:22.581 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3318022635 2021-11-15T14:36:22.581 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:22.582 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5359 172.21.2.138:0/3318022635", 2021-11-15T14:36:22.582 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/3318022635", 2021-11-15T14:36:22.582 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:36:22.582 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 20, 2021-11-15T14:36:22.582 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 47, 2021-11-15T14:36:22.583 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:36:22.583 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:36:22.583 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:36:22.583 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:36:22.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.585 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:22.585 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:22.590 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:36:22.591 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:22.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.592 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:22.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:22.600 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:22.600 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:22.648 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:36:22.649 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:22.649 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:36:22.650 DEBUG:teuthology.orchestra.run.gibba038:> import sys 2021-11-15T14:36:22.650 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:36:22.651 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:36:22.651 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.651 DEBUG:teuthology.orchestra.run.gibba038:> n = 1000 2021-11-15T14:36:22.652 DEBUG:teuthology.orchestra.run.gibba038:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T14:36:22.652 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.652 DEBUG:teuthology.orchestra.run.gibba038:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T14:36:22.653 DEBUG:teuthology.orchestra.run.gibba038:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T14:36:22.653 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:22.654 DEBUG:teuthology.orchestra.run.gibba038:> for i in range(0, n): 2021-11-15T14:36:22.654 DEBUG:teuthology.orchestra.run.gibba038:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T14:36:22.654 DEBUG:teuthology.orchestra.run.gibba038:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T14:36:22.655 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:36:22.655 DEBUG:teuthology.orchestra.run.gibba038:> if True: 2021-11-15T14:36:22.655 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:36:22.656 DEBUG:teuthology.orchestra.run.gibba038:> os.fsync(f.fileno()) 2021-11-15T14:36:22.656 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:36:40.378 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:40.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 Processor -- start 2021-11-15T14:36:40.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- start start 2021-11-15T14:36:40.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46840b1e30 0x7f46840b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f46840b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f46840a7140 0x7f46841447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840a9140 con 0x7f46840a7140 2021-11-15T14:36:40.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840b03d0 con 0x7f46840b1e30 2021-11-15T14:36:40.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46840b0670 con 0x7f4684148420 2021-11-15T14:36:40.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46840b1e30 0x7f46840b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46840b1e30 0x7f46840b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57116/0 (socket says 172.21.2.135:57116) 2021-11-15T14:36:40.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 -- 172.21.2.135:0/295838593 learned_addr learned my addr 172.21.2.135:0/295838593 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:40.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 -- 172.21.2.135:0/295838593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 msgr2=0x7f46840b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 --2- 172.21.2.135:0/295838593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f46840b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 -- 172.21.2.135:0/295838593 >> v2:172.21.2.119:3300/0 conn(0x7f46840a7140 msgr2=0x7f46841447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 --2- 172.21.2.135:0/295838593 >> v2:172.21.2.119:3300/0 conn(0x7f46840a7140 0x7f46841447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 -- 172.21.2.135:0/295838593 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840b0910 con 0x7f46840b1e30 2021-11-15T14:36:40.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4688ab3700 1 --2- 172.21.2.135:0/295838593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f46840b1050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4674002f70 tx=0x7f4674006eb0).ready entity=mon.1 client_cookie=19a5583105eced1f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f46837fe700 1 -- 172.21.2.135:0/295838593 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467400d570 con 0x7f46840b1e30 2021-11-15T14:36:40.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f46837fe700 1 -- 172.21.2.135:0/295838593 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674000e90 con 0x7f46840b1e30 2021-11-15T14:36:40.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f46837fe700 1 -- 172.21.2.135:0/295838593 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467400d900 con 0x7f46840b1e30 2021-11-15T14:36:40.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/295838593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 msgr2=0x7f46840b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- 172.21.2.135:0/295838593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f46840b1050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f4674002f70 tx=0x7f4674006eb0).stop 2021-11-15T14:36:40.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/295838593 shutdown_connections 2021-11-15T14:36:40.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- 172.21.2.135:0/295838593 >> v2:172.21.2.119:3300/0 conn(0x7f46840a7140 0x7f46841447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- 172.21.2.135:0/295838593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f46840b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- 172.21.2.135:0/295838593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f46840b1050 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/295838593 >> 172.21.2.135:0/295838593 conn(0x7f468405f730 msgr2=0x7f468405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:40.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/295838593 shutdown_connections 2021-11-15T14:36:40.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/295838593 wait complete. 2021-11-15T14:36:40.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 Processor -- start 2021-11-15T14:36:40.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- start start 2021-11-15T14:36:40.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46840a7140 0x7f46840ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f468414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684149370 con 0x7f46840a7140 2021-11-15T14:36:40.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468414bbe0 con 0x7f46840b1e30 2021-11-15T14:36:40.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46840aac80 con 0x7f4684148420 2021-11-15T14:36:40.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57124/0 (socket says 172.21.2.135:57124) 2021-11-15T14:36:40.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 -- 172.21.2.135:0/2297446215 learned_addr learned my addr 172.21.2.135:0/2297446215 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:40.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 -- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 msgr2=0x7f468414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f468414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 -- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46840a7140 msgr2=0x7f46840ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46840a7140 0x7f46840ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 -- 172.21.2.135:0/2297446215 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467400b1e0 con 0x7f46840b1e30 2021-11-15T14:36:40.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4683fff700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f466c002f70 tx=0x7f466c006d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466c009e00 con 0x7f46840b1e30 2021-11-15T14:36:40.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00f510 con 0x7f46840b1e30 2021-11-15T14:36:40.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840aaf20 con 0x7f46840b1e30 2021-11-15T14:36:40.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466c00f680 con 0x7f46840b1e30 2021-11-15T14:36:40.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.436+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4684147120 con 0x7f46840b1e30 2021-11-15T14:36:40.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468414b0b0 con 0x7f46840b1e30 2021-11-15T14:36:40.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f466c00f070 con 0x7f46840b1e30 2021-11-15T14:36:40.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4681ffb700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 0x7f4668055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f466c06b2c0 con 0x7f46840b1e30 2021-11-15T14:36:40.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4688ab3700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 0x7f4668055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4688ab3700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 0x7f4668055ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4674002f70 tx=0x7f4674015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.440+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f468414b0b0 con 0x7f46840b1e30 2021-11-15T14:36:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f468414b0b0 con 0x7f46840b1e30 2021-11-15T14:36:40.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f4681ffb700 1 -- 172.21.2.135:0/2297446215 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f468414b0b0 con 0x7f46840b1e30 2021-11-15T14:36:40.558 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:40.558 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 msgr2=0x7f4668055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 0x7f4668055ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4674002f70 tx=0x7f4674015000).stop 2021-11-15T14:36:40.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 msgr2=0x7f468414b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f466c002f70 tx=0x7f466c006d80).stop 2021-11-15T14:36:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 shutdown_connections 2021-11-15T14:36:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4668053610 0x7f4668055ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4684148420 0x7f468414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46840b1e30 0x7f468414b6f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 --2- 172.21.2.135:0/2297446215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46840a7140 0x7f46840ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 >> 172.21.2.135:0/2297446215 conn(0x7f468405f730 msgr2=0x7f46840b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 shutdown_connections 2021-11-15T14:36:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.552+0000 7f468ad17700 1 -- 172.21.2.135:0/2297446215 wait complete. 2021-11-15T14:36:40.561 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:40.564 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2021-11-15T14:36:40.623 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T14:36:40.623 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T14:36:40.624 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:40.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.668+0000 7f90a9c75700 1 Processor -- start 2021-11-15T14:36:40.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.668+0000 7f90a9c75700 1 -- start start 2021-11-15T14:36:40.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f90a40646c0 0x7f90a4064aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 0x7f90a4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40b4e50 con 0x7f90a41435e0 2021-11-15T14:36:40.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a41474b0 con 0x7f90a40646c0 2021-11-15T14:36:40.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b4950 con 0x7f90a40b3790 2021-11-15T14:36:40.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f90a41435e0 0x7f90a41402e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44720/0 (socket says 172.21.2.135:44720) 2021-11-15T14:36:40.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 -- 172.21.2.135:0/935490002 learned_addr learned my addr 172.21.2.135:0/935490002 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:40.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533955586 0 0) 0x7f90a40b4e50 con 0x7f90a41435e0 2021-11-15T14:36:40.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9084003260 con 0x7f90a41435e0 2021-11-15T14:36:40.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a3fff700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 0x7f90a4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a8c73700 1 --2- 172.21.2.135:0/935490002 >> v2:172.21.2.119:3300/0 conn(0x7f90a40646c0 0x7f90a4064aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908667993 0 0) 0x7f9084003260 con 0x7f90a41435e0 2021-11-15T14:36:40.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 msgr2=0x7f90a4146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 0x7f90a4146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 >> v2:172.21.2.119:3300/0 conn(0x7f90a40646c0 msgr2=0x7f90a4064aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 --2- 172.21.2.135:0/935490002 >> v2:172.21.2.119:3300/0 conn(0x7f90a40646c0 0x7f90a4064aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40b4bb0 con 0x7f90a41435e0 2021-11-15T14:36:40.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9094001660 con 0x7f90a41435e0 2021-11-15T14:36:40.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 >> v1:172.21.2.135:6789/0 conn(0x7f90a41435e0 legacy=0x7f90a41402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90840037d0 0x7f9084003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 0x7f9084004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f9084004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a41474b0 con 0x7f90840037d0 2021-11-15T14:36:40.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b4950 con 0x7f90840049f0 2021-11-15T14:36:40.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908400b880 con 0x7f90a40b3790 2021-11-15T14:36:40.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f9084004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 -- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 msgr2=0x7f9084004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b3790 0x7f9084004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 -- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90840037d0 msgr2=0x7f9084003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90840037d0 0x7f9084003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 -- 172.21.2.135:0/935490002 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084003260 con 0x7f90840049f0 2021-11-15T14:36:40.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f9084004e70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f9094001370 tx=0x7f90a40b4d40).ready entity=mon.1 client_cookie=a43c0598b0395d3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90940070d0 con 0x7f90840049f0 2021-11-15T14:36:40.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9094007230 con 0x7f90840049f0 2021-11-15T14:36:40.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a37fe700 1 -- 172.21.2.135:0/935490002 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909400c8f0 con 0x7f90840049f0 2021-11-15T14:36:40.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- 172.21.2.135:0/935490002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 msgr2=0x7f9084004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 --2- 172.21.2.135:0/935490002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f9084004e70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f9094001370 tx=0x7f90a40b4d40).stop 2021-11-15T14:36:40.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9474700 1 -- 172.21.2.135:0/935490002 reap_dead start 2021-11-15T14:36:40.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- 172.21.2.135:0/935490002 shutdown_connections 2021-11-15T14:36:40.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- 172.21.2.135:0/935490002 >> 172.21.2.135:0/935490002 conn(0x7f90a405f730 msgr2=0x7f90a405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:40.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- 172.21.2.135:0/935490002 shutdown_connections 2021-11-15T14:36:40.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- 172.21.2.135:0/935490002 wait complete. 2021-11-15T14:36:40.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 Processor -- start 2021-11-15T14:36:40.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.672+0000 7f90a9c75700 1 -- start start 2021-11-15T14:36:40.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b0d00 0x7f90a40ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a40aba40 0x7f90a413f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40abef0 con 0x7f90a40aba40 2021-11-15T14:36:40.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b1670 con 0x7f90840049f0 2021-11-15T14:36:40.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b0080 con 0x7f90a40b0d00 2021-11-15T14:36:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57140/0 (socket says 172.21.2.135:57140) 2021-11-15T14:36:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 -- 172.21.2.135:0/80235241 learned_addr learned my addr 172.21.2.135:0/80235241 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:40.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 -- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b0d00 msgr2=0x7f90a40ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b0d00 0x7f90a40ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 -- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a40aba40 msgr2=0x7f90a413f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a40aba40 0x7f90a413f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 -- 172.21.2.135:0/80235241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40b0320 con 0x7f90840049f0 2021-11-15T14:36:40.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a8c73700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f909c00a000 tx=0x7f909c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909c012510 con 0x7f90840049f0 2021-11-15T14:36:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c012670 con 0x7f90840049f0 2021-11-15T14:36:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909c0127e0 con 0x7f90840049f0 2021-11-15T14:36:40.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a40afdc0 con 0x7f90840049f0 2021-11-15T14:36:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40b07c0 con 0x7f90840049f0 2021-11-15T14:36:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f909c01a020 con 0x7f90840049f0 2021-11-15T14:36:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a40b04b0 con 0x7f90840049f0 2021-11-15T14:36:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 0x7f9088055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f909c06b7a0 con 0x7f90840049f0 2021-11-15T14:36:40.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a3fff700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 0x7f9088055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.676+0000 7f90a3fff700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 0x7f9088055ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f908c00a000 tx=0x7f908c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.680+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f909c042640 con 0x7f90840049f0 2021-11-15T14:36:40.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90a4143140 con 0x7f90840049f0 2021-11-15T14:36:40.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a1ffb700 1 -- 172.21.2.135:0/80235241 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f909c018090 con 0x7f90840049f0 2021-11-15T14:36:40.797 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:40.797 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:40.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 msgr2=0x7f9088055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 0x7f9088055ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f908c00a000 tx=0x7f908c008040).stop 2021-11-15T14:36:40.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 msgr2=0x7f90a4141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f909c00a000 tx=0x7f909c008040).stop 2021-11-15T14:36:40.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 shutdown_connections 2021-11-15T14:36:40.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9088053610 0x7f9088055ad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a40aba40 0x7f90a413f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a40b0d00 0x7f90a40ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 --2- 172.21.2.135:0/80235241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90840049f0 0x7f90a4141a50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 >> 172.21.2.135:0/80235241 conn(0x7f90a405f730 msgr2=0x7f90a40b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:40.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 shutdown_connections 2021-11-15T14:36:40.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.792+0000 7f90a9c75700 1 -- 172.21.2.135:0/80235241 wait complete. 2021-11-15T14:36:40.801 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:40.803 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T14:36:40.863 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T14:36:40.863 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T14:36:40.864 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:36:40.878 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 Processor -- start 2021-11-15T14:36:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- start start 2021-11-15T14:36:40.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f24cc0b1e30 0x7f24cc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24cc0a7140 0x7f24cc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc0b03d0 con 0x7f24cc148420 2021-11-15T14:36:40.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0a9140 con 0x7f24cc0b1e30 2021-11-15T14:36:40.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0b0670 con 0x7f24cc0a7140 2021-11-15T14:36:40.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d1199700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f24cc148420 0x7f24cc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44738/0 (socket says 172.21.2.135:44738) 2021-11-15T14:36:40.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d1199700 1 -- 172.21.2.135:0/825653973 learned_addr learned my addr 172.21.2.135:0/825653973 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:40.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/825653973 >> v2:172.21.2.135:3300/0 conn(0x7f24cc0a7140 0x7f24cc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/825653973 >> v2:172.21.2.119:3300/0 conn(0x7f24cc0b1e30 msgr2=0x7f24cc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:40.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/825653973 >> v2:172.21.2.119:3300/0 conn(0x7f24cc0b1e30 0x7f24cc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/825653973 >> v1:172.21.2.135:6789/0 conn(0x7f24cc148420 legacy=0x7f24cc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/825653973 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc0b0910 con 0x7f24cc0a7140 2021-11-15T14:36:40.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/825653973 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc0a7140 0x7f24cc1447a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f24cc1477b0 tx=0x7f24c40091d0).ready entity=mon.1 client_cookie=4619fb518f1ea890 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d0998700 1 -- 172.21.2.135:0/825653973 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c4009ea0 con 0x7f24cc0a7140 2021-11-15T14:36:40.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d0998700 1 -- 172.21.2.135:0/825653973 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c400b860 con 0x7f24cc0a7140 2021-11-15T14:36:40.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d0998700 1 -- 172.21.2.135:0/825653973 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c400b9d0 con 0x7f24cc0a7140 2021-11-15T14:36:40.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/825653973 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc0a7140 msgr2=0x7f24cc1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/825653973 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc0a7140 0x7f24cc1447a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f24cc1477b0 tx=0x7f24c40091d0).stop 2021-11-15T14:36:40.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/825653973 shutdown_connections 2021-11-15T14:36:40.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/825653973 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc0a7140 0x7f24cc1447a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:40.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/825653973 >> v2:172.21.2.119:3300/0 conn(0x7f24cc0b1e30 0x7f24cc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/825653973 >> 172.21.2.135:0/825653973 conn(0x7f24cc05f730 msgr2=0x7f24cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:40.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/825653973 shutdown_connections 2021-11-15T14:36:40.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/825653973 wait complete. 2021-11-15T14:36:40.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 Processor -- start 2021-11-15T14:36:40.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- start start 2021-11-15T14:36:40.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24cc0a7140 0x7f24cc0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24cc0b1e30 0x7f24cc143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0afc80 con 0x7f24cc0a7140 2021-11-15T14:36:40.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0af590 con 0x7f24cc148420 2021-11-15T14:36:40.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0ae8d0 con 0x7f24cc0b1e30 2021-11-15T14:36:40.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57158/0 (socket says 172.21.2.135:57158) 2021-11-15T14:36:40.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/2053411913 learned_addr learned my addr 172.21.2.135:0/2053411913 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:40.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24cc0b1e30 msgr2=0x7f24cc143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24cc0b1e30 0x7f24cc143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24cc0a7140 msgr2=0x7f24cc0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:40.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24cc0a7140 0x7f24cc0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:40.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 -- 172.21.2.135:0/2053411913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009470 con 0x7f24cc148420 2021-11-15T14:36:40.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d219b700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f24cc0afdc0 tx=0x7f24c4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c4021440 con 0x7f24cc148420 2021-11-15T14:36:40.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40215a0 con 0x7f24cc148420 2021-11-15T14:36:40.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c4021900 con 0x7f24cc148420 2021-11-15T14:36:40.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0aeb70 con 0x7f24cc148420 2021-11-15T14:36:40.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc0ab980 con 0x7f24cc148420 2021-11-15T14:36:40.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc1444b0 con 0x7f24cc148420 2021-11-15T14:36:40.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f24c4027020 con 0x7f24cc148420 2021-11-15T14:36:40.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 0x7f24ac055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:40.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f24c406d260 con 0x7f24cc148420 2021-11-15T14:36:40.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d199a700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 0x7f24ac055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:40.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.928+0000 7f24d199a700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 0x7f24ac055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f24bc002f70 tx=0x7f24bc006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:40.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:40.932+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24c4044100 con 0x7f24cc148420 2021-11-15T14:36:41.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.040+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24cc0aed00 con 0x7f24cc148420 2021-11-15T14:36:41.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24baffd700 1 -- 172.21.2.135:0/2053411913 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f24c40159d0 con 0x7f24cc148420 2021-11-15T14:36:41.048 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:41.049 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:41.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 msgr2=0x7f24ac055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 0x7f24ac055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f24bc002f70 tx=0x7f24bc006a80).stop 2021-11-15T14:36:41.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 msgr2=0x7f24cc143e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f24cc0afdc0 tx=0x7f24c4016000).stop 2021-11-15T14:36:41.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 shutdown_connections 2021-11-15T14:36:41.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24ac0536d0 0x7f24ac055b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24cc148420 0x7f24cc143e20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24cc0b1e30 0x7f24cc143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 --2- 172.21.2.135:0/2053411913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24cc0a7140 0x7f24cc0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 >> 172.21.2.135:0/2053411913 conn(0x7f24cc05f730 msgr2=0x7f24cc147c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:41.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 shutdown_connections 2021-11-15T14:36:41.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.044+0000 7f24d3bfe700 1 -- 172.21.2.135:0/2053411913 wait complete. 2021-11-15T14:36:41.058 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:41.060 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c cache drop 2021-11-15T14:36:41.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 Processor -- start 2021-11-15T14:36:41.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- start start 2021-11-15T14:36:41.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b1f40 0x7ff6ac0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6ac0b0030 0x7ff6ac0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff6ac0a7140 0x7ff6ac1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b2810 con 0x7ff6ac0a7140 2021-11-15T14:36:41.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b0470 con 0x7ff6ac0b0030 2021-11-15T14:36:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b06d0 con 0x7ff6ac0b1f40 2021-11-15T14:36:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6ac0b0030 0x7ff6ac0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6ac0b0030 0x7ff6ac0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57166/0 (socket says 172.21.2.135:57166) 2021-11-15T14:36:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1335523149 learned_addr learned my addr 172.21.2.135:0/1335523149 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1335523149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b1f40 msgr2=0x7ff6ac0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1335523149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b1f40 0x7ff6ac0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1335523149 >> v2:172.21.2.119:3300/0 conn(0x7ff6ac0a7140 msgr2=0x7ff6ac1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1335523149 >> v2:172.21.2.119:3300/0 conn(0x7ff6ac0a7140 0x7ff6ac1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1335523149 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0b0970 con 0x7ff6ac0b0030 2021-11-15T14:36:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1335523149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0b0030 0x7ff6ac0b2320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7ff69c002f70 tx=0x7ff69c006eb0).ready entity=mon.1 client_cookie=bfc0f182295e691b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a9d9b700 1 -- 172.21.2.135:0/1335523149 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c00d570 con 0x7ff6ac0b0030 2021-11-15T14:36:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a9d9b700 1 -- 172.21.2.135:0/1335523149 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c000e90 con 0x7ff6ac0b0030 2021-11-15T14:36:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a9d9b700 1 -- 172.21.2.135:0/1335523149 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c00d900 con 0x7ff6ac0b0030 2021-11-15T14:36:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1335523149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0b0030 msgr2=0x7ff6ac0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1335523149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0b0030 0x7ff6ac0b2320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7ff69c002f70 tx=0x7ff69c006eb0).stop 2021-11-15T14:36:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1335523149 shutdown_connections 2021-11-15T14:36:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1335523149 >> v2:172.21.2.119:3300/0 conn(0x7ff6ac0a7140 0x7ff6ac1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1335523149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0b0030 0x7ff6ac0b2320 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1335523149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b1f40 0x7ff6ac0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1335523149 >> 172.21.2.135:0/1335523149 conn(0x7ff6ac05f730 msgr2=0x7ff6ac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1335523149 shutdown_connections 2021-11-15T14:36:41.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1335523149 wait complete. 2021-11-15T14:36:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 Processor -- start 2021-11-15T14:36:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- start start 2021-11-15T14:36:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b0030 0x7ff6ac13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6ac0b1f40 0x7ff6ac0a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b4490 con 0x7ff6ac0b1f40 2021-11-15T14:36:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b53d0 con 0x7ff6ac0a7140 2021-11-15T14:36:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0b4c30 con 0x7ff6ac0b0030 2021-11-15T14:36:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57168/0 (socket says 172.21.2.135:57168) 2021-11-15T14:36:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 -- 172.21.2.135:0/1070783599 learned_addr learned my addr 172.21.2.135:0/1070783599 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 -- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b0030 msgr2=0x7ff6ac13ed80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b0030 0x7ff6ac13ed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 -- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6ac0b1f40 msgr2=0x7ff6ac0a97e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:36:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6ac0b1f40 0x7ff6ac0a97e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 -- 172.21.2.135:0/1070783599 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c00b1e0 con 0x7ff6ac0a7140 2021-11-15T14:36:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7ff6ac0ab330 tx=0x7ff694006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 -- 172.21.2.135:0/1070783599 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69400e470 con 0x7ff6ac0a7140 2021-11-15T14:36:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 -- 172.21.2.135:0/1070783599 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400e5d0 con 0x7ff6ac0a7140 2021-11-15T14:36:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 -- 172.21.2.135:0/1070783599 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69400e930 con 0x7ff6ac0a7140 2021-11-15T14:36:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac0b5130 con 0x7ff6ac0a7140 2021-11-15T14:36:41.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac140940 con 0x7ff6ac0a7140 2021-11-15T14:36:41.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 -- 172.21.2.135:0/1070783599 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff694018030 con 0x7ff6ac0a7140 2021-11-15T14:36:41.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 0x7ff690055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6a3fff700 1 -- 172.21.2.135:0/1070783599 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff69406afb0 con 0x7ff6ac0a7140 2021-11-15T14:36:41.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 Processor -- start 2021-11-15T14:36:41.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 0x7ff690055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 -- start start 2021-11-15T14:36:41.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a2ec0 0x16d92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x15ffd50 con 0x16a2ec0 2021-11-15T14:36:41.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x16134b0 con 0x16d97c0 2021-11-15T14:36:41.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x15f3c20 con 0x16d9c40 2021-11-15T14:36:41.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57178/0 (socket says 172.21.2.135:57178) 2021-11-15T14:36:41.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1936167120 learned_addr learned my addr 172.21.2.135:0/1936167120 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 msgr2=0x16d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a2ec0 msgr2=0x16d92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.112+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a2ec0 0x16d92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aa59c700 1 -- 172.21.2.135:0/1936167120 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x164bcb0 con 0x16d97c0 2021-11-15T14:36:41.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 0x7ff690055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff69c000bc0 tx=0x7ff69c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff69c01c000 tx=0x7ff69c024040).ready entity=mon.1 client_cookie=e58cb3ae5aa1b7e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6b10da700 1 -- 172.21.2.135:0/1936167120 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c0228f0 con 0x16d97c0 2021-11-15T14:36:41.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6b10da700 1 -- 172.21.2.135:0/1936167120 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c022a50 con 0x16d97c0 2021-11-15T14:36:41.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6b10da700 1 -- 172.21.2.135:0/1936167120 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69c022db0 con 0x16d97c0 2021-11-15T14:36:41.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1936167120 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 msgr2=0x16d5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff69c01c000 tx=0x7ff69c024040).stop 2021-11-15T14:36:41.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1936167120 shutdown_connections 2021-11-15T14:36:41.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d5ad0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1936167120 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a2ec0 0x16d92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1936167120 >> 172.21.2.135:0/1936167120 conn(0x16a0630 msgr2=0x16a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:41.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1936167120 shutdown_connections 2021-11-15T14:36:41.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1936167120 wait complete. 2021-11-15T14:36:41.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- start start 2021-11-15T14:36:41.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 Processor -- start 2021-11-15T14:36:41.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x16d0930 con 0x16a3600 2021-11-15T14:36:41.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x16da560 con 0x16d97c0 2021-11-15T14:36:41.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x16cdcc0 con 0x16d9c40 2021-11-15T14:36:41.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 10 client.0 ll_register_callbacks cb 0x16072a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:36:41.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57182/0 (socket says 172.21.2.135:57182) 2021-11-15T14:36:41.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 -- 172.21.2.135:0/2093745756 learned_addr learned my addr 172.21.2.135:0/2093745756 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 -- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 msgr2=0x16d85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 -- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 msgr2=0x16cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 -- 172.21.2.135:0/2093745756 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c027040 con 0x16d97c0 2021-11-15T14:36:41.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x16da6a0 tx=0x7ff694011000).ready entity=mon.1 client_cookie=6c0828ea674d8a58 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:36:41.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff69400ea90 con 0x16d97c0 2021-11-15T14:36:41.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff69400ebf0 con 0x16d97c0 2021-11-15T14:36:41.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1609570 con 0x16d97c0 2021-11-15T14:36:41.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69400edb0 con 0x16d97c0 2021-11-15T14:36:41.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 10 client.5392 fetch_fsmap learned FSMap version 20 2021-11-15T14:36:41.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x1602e50 con 0x16d97c0 2021-11-15T14:36:41.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1609570 con 0x16d97c0 2021-11-15T14:36:41.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 20) v1 ==== 1434+0+0 (secure 0 0 0) 0x7ff694043310 con 0x16d97c0 2021-11-15T14:36:41.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 10 client.5392 fetch_fsmap finished waiting for FSMap version 20 2021-11-15T14:36:41.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 10 client.5392 resolve_mds: resolved ID 'c' to GID 5200 2021-11-15T14:36:41.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 20 client.5392 populate_metadata read hostname 'gibba035' 2021-11-15T14:36:41.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x16ec1b0 0x16ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 4 client.5392 mds_command: new command op to 5200 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T14:36:41.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 --> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16018e0 con 0x16ec1b0 2021-11-15T14:36:41.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x16ec1b0 0x16ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff6aa59c700 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x16ec1b0 0x16ce1b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fc4591208564707 server_cookie=fc3a785cd48236be in_seq=0 out_seq=0 2021-11-15T14:36:41.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.116+0000 7ff689ffb700 10 client.5392 ms_handle_connect on v2:172.21.2.135:6834/614438403 2021-11-15T14:36:41.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff689ffb700 1 -- 172.21.2.135:0/2093745756 <== mds.0 v2:172.21.2.135:6834/614438403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x16018e0 con 0x16ec1b0 2021-11-15T14:36:41.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff689ffb700 10 client.5392 handle_command_reply: tid=0 2021-11-15T14:36:41.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 client.5392 shutdown 2021-11-15T14:36:41.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 msgr2=0x16d80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x16da6a0 tx=0x7ff694011000).stop 2021-11-15T14:36:41.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 shutdown_connections 2021-11-15T14:36:41.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x16ec1b0 0x16ce1b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d9c40 0x16d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff689ffb700 0 client.5392 ms_handle_reset on v2:172.21.2.135:6834/614438403 2021-11-15T14:36:41.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2093745756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d97c0 0x16d80d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 >> 172.21.2.135:0/2093745756 conn(0x16a2ec0 msgr2=0x16d62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:41.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 shutdown_connections 2021-11-15T14:36:41.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2093745756 wait complete. 2021-11-15T14:36:41.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.120+0000 7ff6bb31e740 20 client.5392 trim_cache size 0 max 16384 2021-11-15T14:36:41.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 Processor -- start 2021-11-15T14:36:41.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 -- start start 2021-11-15T14:36:41.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x169e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x16e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a1ea0 con 0x16a3600 2021-11-15T14:36:41.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a10b0 con 0x16d9c40 2021-11-15T14:36:41.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x15dc290 con 0x16d97c0 2021-11-15T14:36:41.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6ab59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6ab59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57190/0 (socket says 172.21.2.135:57190) 2021-11-15T14:36:41.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.124+0000 7ff6ab59e700 1 -- 172.21.2.135:0/2149223544 learned_addr learned my addr 172.21.2.135:0/2149223544 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 msgr2=0x16e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x16e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 msgr2=0x169e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x169e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/2149223544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x160b750 con 0x16d9c40 2021-11-15T14:36:41.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x1603360 tx=0x7ff6a4009120).ready entity=mon.1 client_cookie=9a437a2d9f094514 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68bfff700 1 -- 172.21.2.135:0/2149223544 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a400b520 con 0x16d9c40 2021-11-15T14:36:41.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68bfff700 1 -- 172.21.2.135:0/2149223544 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400b680 con 0x16d9c40 2021-11-15T14:36:41.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68bfff700 1 -- 172.21.2.135:0/2149223544 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a400b9e0 con 0x16d9c40 2021-11-15T14:36:41.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2149223544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 msgr2=0x16ea400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:41.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x1603360 tx=0x7ff6a4009120).stop 2021-11-15T14:36:41.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2149223544 shutdown_connections 2021-11-15T14:36:41.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x16ea400 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:41.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x16e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/2149223544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x169e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2149223544 >> 172.21.2.135:0/2149223544 conn(0x16a2ec0 msgr2=0x16cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:41.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2149223544 shutdown_connections 2021-11-15T14:36:41.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/2149223544 wait complete. 2021-11-15T14:36:41.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- start start 2021-11-15T14:36:41.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 Processor -- start 2021-11-15T14:36:41.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x1739840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x16d8310 con 0x16a3600 2021-11-15T14:36:41.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x169f120 con 0x16d9c40 2021-11-15T14:36:41.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a5c70 con 0x16d97c0 2021-11-15T14:36:41.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 10 client.0 ll_register_callbacks cb 0x16cd9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:36:41.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57196/0 (socket says 172.21.2.135:57196) 2021-11-15T14:36:41.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/1980109915 learned_addr learned my addr 172.21.2.135:0/1980109915 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:41.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 msgr2=0x1739840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x1739840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 msgr2=0x16ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:41.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:41.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 -- 172.21.2.135:0/1980109915 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a40093c0 con 0x16d9c40 2021-11-15T14:36:41.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6ab59e700 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x1603360 tx=0x7ff6a4014000).ready entity=mon.1 client_cookie=e3b5a335c50949ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:41.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:36:41.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6a4021070 con 0x16d9c40 2021-11-15T14:36:41.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff6a4011800 con 0x16d9c40 2021-11-15T14:36:41.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff69c022a50 con 0x16d9c40 2021-11-15T14:36:41.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a4006cd0 con 0x16d9c40 2021-11-15T14:36:41.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 10 client.5398 fetch_fsmap learned FSMap version 20 2021-11-15T14:36:41.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x1608140 con 0x16d9c40 2021-11-15T14:36:41.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c022a50 con 0x16d9c40 2021-11-15T14:36:41.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 20) v1 ==== 1434+0+0 (secure 0 0 0) 0x7ff6a4024300 con 0x16d9c40 2021-11-15T14:36:41.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 10 client.5398 fetch_fsmap finished waiting for FSMap version 20 2021-11-15T14:36:41.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 10 client.5398 resolve_mds: resolved ID 'c' to GID 5200 2021-11-15T14:36:41.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 20 client.5398 populate_metadata read hostname 'gibba035' 2021-11-15T14:36:41.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x173fd60 0x1740140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:41.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 4 client.5398 mds_command: new command op to 5200 tid=0[{"prefix": "cache drop"}] 2021-11-15T14:36:41.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 --> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x14f7590 con 0x173fd60 2021-11-15T14:36:41.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x173fd60 0x1740140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:41.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff6aad9d700 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x173fd60 0x1740140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8176111fd6e661f1 server_cookie=937183f7355a2ed4 in_seq=0 out_seq=0 2021-11-15T14:36:41.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:41.128+0000 7ff68affd700 10 client.5398 ms_handle_connect on v2:172.21.2.135:6834/614438403 2021-11-15T14:36:41.474 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:41.478 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:41.482 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:41.485 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:36:52.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff68affd700 1 -- 172.21.2.135:0/1980109915 <== mds.0 v2:172.21.2.135:6834/614438403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x14f7590 con 0x173fd60 2021-11-15T14:36:52.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff68affd700 10 client.5398 handle_command_reply: tid=0 2021-11-15T14:36:52.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 client.5398 shutdown 2021-11-15T14:36:52.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 msgr2=0x1739d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x1603360 tx=0x7ff6a4014000).stop 2021-11-15T14:36:52.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 shutdown_connections 2021-11-15T14:36:52.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:6834/614438403,v1:172.21.2.135:6835/614438403] conn(0x173fd60 0x1740140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x16d9c40 0x1739d30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x16d97c0 0x1739840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff68affd700 0 client.5398 ms_handle_reset on v2:172.21.2.135:6834/614438403 2021-11-15T14:36:52.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 --2- 172.21.2.135:0/1980109915 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x16a3600 0x16ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 >> 172.21.2.135:0/1980109915 conn(0x16a2ec0 msgr2=0x16cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 shutdown_connections 2021-11-15T14:36:52.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 1 -- 172.21.2.135:0/1980109915 wait complete. 2021-11-15T14:36:52.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6bb31e740 20 client.5398 trim_cache size 0 max 16384 2021-11-15T14:36:52.230 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:36:52.231 INFO:teuthology.orchestra.run.gibba035.stdout: "client_recall": { 2021-11-15T14:36:52.231 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:36:52.231 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "(0) Success", 2021-11-15T14:36:52.231 INFO:teuthology.orchestra.run.gibba035.stdout: "recalled": 220 2021-11-15T14:36:52.232 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:52.232 INFO:teuthology.orchestra.run.gibba035.stdout: "flush_journal": { 2021-11-15T14:36:52.232 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:36:52.232 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "" 2021-11-15T14:36:52.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:52.233 INFO:teuthology.orchestra.run.gibba035.stdout: "trim_cache": { 2021-11-15T14:36:52.233 INFO:teuthology.orchestra.run.gibba035.stdout: "trimmed": 0 2021-11-15T14:36:52.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:52.234 INFO:teuthology.orchestra.run.gibba035.stdout: "cache": { 2021-11-15T14:36:52.234 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": { 2021-11-15T14:36:52.234 INFO:teuthology.orchestra.run.gibba035.stdout: "items": 19884, 2021-11-15T14:36:52.234 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes": 3092112 2021-11-15T14:36:52.235 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:36:52.235 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:36:52.235 INFO:teuthology.orchestra.run.gibba035.stdout: "duration": 11.090066520000001 2021-11-15T14:36:52.235 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:36:52.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 msgr2=0x7ff690055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 0x7ff690055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff69c000bc0 tx=0x7ff69c015000).stop 2021-11-15T14:36:52.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 msgr2=0x7ff6ac0abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7ff6ac0ab330 tx=0x7ff694006db0).stop 2021-11-15T14:36:52.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 shutdown_connections 2021-11-15T14:36:52.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff690053610 0x7ff690055ad0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6ac0b1f40 0x7ff6ac0a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6ac0b0030 0x7ff6ac13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 --2- 172.21.2.135:0/1070783599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6ac0a7140 0x7ff6ac0abe60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 >> 172.21.2.135:0/1070783599 conn(0x7ff6ac05f730 msgr2=0x7ff6ac13e470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 shutdown_connections 2021-11-15T14:36:52.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.220+0000 7ff6b10da700 1 -- 172.21.2.135:0/1070783599 wait complete. 2021-11-15T14:36:52.240 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T14:36:52.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:52.241 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:52.242 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:52.252 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T14:36:52.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:36:52.253 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:52.254 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:36:52.254 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:36:52.255 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:52.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:52.271 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:52.272 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:52.315 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:36:52.317 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:36:52.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:36:52.318 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:52.323 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:36:52.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 Processor -- start 2021-11-15T14:36:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- start start 2021-11-15T14:36:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f738c067070 0x7f738c143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ad0b0 0x7f738c143e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f738c0b0760 0x7f738c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c067450 con 0x7f738c067070 2021-11-15T14:36:52.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0b0050 con 0x7f738c0b0760 2021-11-15T14:36:52.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0b02f0 con 0x7f738c0ad0b0 2021-11-15T14:36:52.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f738c0b0760 0x7f738c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f738c0b0760 0x7f738c0b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57208/0 (socket says 172.21.2.135:57208) 2021-11-15T14:36:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 -- 172.21.2.135:0/4028370558 learned_addr learned my addr 172.21.2.135:0/4028370558 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 -- 172.21.2.135:0/4028370558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ad0b0 msgr2=0x7f738c143e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 --2- 172.21.2.135:0/4028370558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ad0b0 0x7f738c143e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 -- 172.21.2.135:0/4028370558 >> v2:172.21.2.119:3300/0 conn(0x7f738c067070 msgr2=0x7f738c143950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 --2- 172.21.2.135:0/4028370558 >> v2:172.21.2.119:3300/0 conn(0x7f738c067070 0x7f738c143950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 -- 172.21.2.135:0/4028370558 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0af420 con 0x7f738c0b0760 2021-11-15T14:36:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f739106d700 1 --2- 172.21.2.135:0/4028370558 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c0b0760 0x7f738c0b0f60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f73840032f0 tx=0x7f7384009290).ready entity=mon.1 client_cookie=82f1b6230a14e0fa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f738b7fe700 1 -- 172.21.2.135:0/4028370558 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738400b870 con 0x7f738c0b0760 2021-11-15T14:36:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f738b7fe700 1 -- 172.21.2.135:0/4028370558 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400b9d0 con 0x7f738c0b0760 2021-11-15T14:36:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f738b7fe700 1 -- 172.21.2.135:0/4028370558 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738400bb80 con 0x7f738c0b0760 2021-11-15T14:36:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- 172.21.2.135:0/4028370558 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c0b0760 msgr2=0x7f738c0b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- 172.21.2.135:0/4028370558 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c0b0760 0x7f738c0b0f60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f73840032f0 tx=0x7f7384009290).stop 2021-11-15T14:36:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- 172.21.2.135:0/4028370558 shutdown_connections 2021-11-15T14:36:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- 172.21.2.135:0/4028370558 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c0b0760 0x7f738c0b0f60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- 172.21.2.135:0/4028370558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ad0b0 0x7f738c143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 --2- 172.21.2.135:0/4028370558 >> v2:172.21.2.119:3300/0 conn(0x7f738c067070 0x7f738c143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.432+0000 7f7392ad0700 1 -- 172.21.2.135:0/4028370558 >> 172.21.2.135:0/4028370558 conn(0x7f738c05f730 msgr2=0x7f738c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- 172.21.2.135:0/4028370558 shutdown_connections 2021-11-15T14:36:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- 172.21.2.135:0/4028370558 wait complete. 2021-11-15T14:36:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 Processor -- start 2021-11-15T14:36:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- start start 2021-11-15T14:36:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f738c0b0760 0x7f738c13e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 0x7f738c13e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0a0710 con 0x7f738c0b0760 2021-11-15T14:36:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0a09b0 con 0x7f738c067070 2021-11-15T14:36:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0a0c50 con 0x7f738c0ac460 2021-11-15T14:36:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57214/0 (socket says 172.21.2.135:57214) 2021-11-15T14:36:52.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 -- 172.21.2.135:0/2430435708 learned_addr learned my addr 172.21.2.135:0/2430435708 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739106d700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 0x7f738c13e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 -- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 msgr2=0x7f738c13e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 0x7f738c13e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f738bfff700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f738c0b0760 0x7f738c13e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 -- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f738c0b0760 msgr2=0x7f738c13e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f738c0b0760 0x7f738c13e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 -- 172.21.2.135:0/2430435708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009530 con 0x7f738c067070 2021-11-15T14:36:52.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739106d700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 0x7f738c13e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:52.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f739086c700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7374002fb0 tx=0x7f7374006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7374013460 con 0x7f738c067070 2021-11-15T14:36:52.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73740135c0 con 0x7f738c067070 2021-11-15T14:36:52.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0a0ef0 con 0x7f738c067070 2021-11-15T14:36:52.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c0a4d90 con 0x7f738c067070 2021-11-15T14:36:52.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7374013920 con 0x7f738c067070 2021-11-15T14:36:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0a1080 con 0x7f738c067070 2021-11-15T14:36:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f737400f070 con 0x7f738c067070 2021-11-15T14:36:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 0x7f7370055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.436+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f737406b4f0 con 0x7f738c067070 2021-11-15T14:36:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.440+0000 7f738bfff700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 0x7f7370055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.440+0000 7f738bfff700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 0x7f7370055be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f737c007000 tx=0x7f737c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.440+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7374042500 con 0x7f738c067070 2021-11-15T14:36:52.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.524+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f738c0573d0 con 0x7f738c067070 2021-11-15T14:36:52.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.524+0000 7f7389ffb700 1 -- 172.21.2.135:0/2430435708 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f7374045b20 con 0x7f738c067070 2021-11-15T14:36:52.531 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:52.531 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":47,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:36:18.143439+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:36:15.047541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-15T14:36:16.111420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:36:52.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 msgr2=0x7f7370055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 0x7f7370055be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f737c007000 tx=0x7f737c008040).stop 2021-11-15T14:36:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 msgr2=0x7f738c146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7374002fb0 tx=0x7f7374006df0).stop 2021-11-15T14:36:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 shutdown_connections 2021-11-15T14:36:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7370053720 0x7f7370055be0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f738c0ac460 0x7f738c13e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f738c0b0760 0x7f738c13e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 --2- 172.21.2.135:0/2430435708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f738c067070 0x7f738c146f70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 >> 172.21.2.135:0/2430435708 conn(0x7f738c05f730 msgr2=0x7f738c141e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 shutdown_connections 2021-11-15T14:36:52.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.528+0000 7f7392ad0700 1 -- 172.21.2.135:0/2430435708 wait complete. 2021-11-15T14:36:52.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:36:15.047541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:36:16.111420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:36:52.539 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:36:52.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 Processor -- start 2021-11-15T14:36:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- start start 2021-11-15T14:36:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f64340b1f40 0x7f64340b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340b0030 0x7f64340b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64340a7140 0x7f64341412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340b04a0 con 0x7f64340b1f40 2021-11-15T14:36:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340b2810 con 0x7f64340a7140 2021-11-15T14:36:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b06d0 con 0x7f64340b0030 2021-11-15T14:36:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64340a7140 0x7f64341412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64340a7140 0x7f64341412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57224/0 (socket says 172.21.2.135:57224) 2021-11-15T14:36:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 -- 172.21.2.135:0/200447961 learned_addr learned my addr 172.21.2.135:0/200447961 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a1c4700 1 --2- 172.21.2.135:0/200447961 >> v2:172.21.2.119:3300/0 conn(0x7f64340b1f40 0x7f64340b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 -- 172.21.2.135:0/200447961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340b0030 msgr2=0x7f64340b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- 172.21.2.135:0/200447961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340b0030 0x7f64340b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 -- 172.21.2.135:0/200447961 >> v2:172.21.2.119:3300/0 conn(0x7f64340b1f40 msgr2=0x7f64340b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- 172.21.2.135:0/200447961 >> v2:172.21.2.119:3300/0 conn(0x7f64340b1f40 0x7f64340b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 -- 172.21.2.135:0/200447961 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340b0970 con 0x7f64340a7140 2021-11-15T14:36:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- 172.21.2.135:0/200447961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340a7140 0x7f64341412d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f642c0032f0 tx=0x7f642c009290).ready entity=mon.1 client_cookie=145069158504b734 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64391c2700 1 -- 172.21.2.135:0/200447961 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c00b870 con 0x7f64340a7140 2021-11-15T14:36:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64391c2700 1 -- 172.21.2.135:0/200447961 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c00b9d0 con 0x7f64340a7140 2021-11-15T14:36:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64391c2700 1 -- 172.21.2.135:0/200447961 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c00bb40 con 0x7f64340a7140 2021-11-15T14:36:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/200447961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340a7140 msgr2=0x7f64341412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- 172.21.2.135:0/200447961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340a7140 0x7f64341412d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f642c0032f0 tx=0x7f642c009290).stop 2021-11-15T14:36:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/200447961 shutdown_connections 2021-11-15T14:36:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- 172.21.2.135:0/200447961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340a7140 0x7f64341412d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- 172.21.2.135:0/200447961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340b0030 0x7f64340b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- 172.21.2.135:0/200447961 >> v2:172.21.2.119:3300/0 conn(0x7f64340b1f40 0x7f64340b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/200447961 >> 172.21.2.135:0/200447961 conn(0x7f643405f730 msgr2=0x7f643405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/200447961 shutdown_connections 2021-11-15T14:36:52.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/200447961 wait complete. 2021-11-15T14:36:52.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 Processor -- start 2021-11-15T14:36:52.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- start start 2021-11-15T14:36:52.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 0x7f643414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64340b1f40 0x7f643415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b6000 con 0x7f64340b1f40 2021-11-15T14:36:52.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643414a010 con 0x7f64340b0030 2021-11-15T14:36:52.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6434148bb0 con 0x7f64340a7140 2021-11-15T14:36:52.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57230/0 (socket says 172.21.2.135:57230) 2021-11-15T14:36:52.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 -- 172.21.2.135:0/1381974048 learned_addr learned my addr 172.21.2.135:0/1381974048 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a1c4700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 0x7f643414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a9c5700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64340b1f40 0x7f643415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 -- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 msgr2=0x7f643414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 0x7f643414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 -- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64340b1f40 msgr2=0x7f643415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64340b1f40 0x7f643415a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 -- 172.21.2.135:0/1381974048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c009530 con 0x7f64340b0030 2021-11-15T14:36:52.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643a1c4700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 0x7f643414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:52.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64399c3700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f6424002f70 tx=0x7f6424006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6424013460 con 0x7f64340b0030 2021-11-15T14:36:52.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64240135c0 con 0x7f64340b0030 2021-11-15T14:36:52.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643414a240 con 0x7f64340b0030 2021-11-15T14:36:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6424013920 con 0x7f64340b0030 2021-11-15T14:36:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.588+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6434145000 con 0x7f64340b0030 2021-11-15T14:36:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64340b0c10 con 0x7f64340b0030 2021-11-15T14:36:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f642401a060 con 0x7f64340b0030 2021-11-15T14:36:52.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f64237fe700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 0x7f6414055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f642406b430 con 0x7f64340b0030 2021-11-15T14:36:52.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f643a1c4700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 0x7f6414055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f643a1c4700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 0x7f6414055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f6430008000 tx=0x7f6430008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.592+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6424042440 con 0x7f64340b0030 2021-11-15T14:36:52.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64340573d0 con 0x7f64340b0030 2021-11-15T14:36:52.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f64237fe700 1 -- 172.21.2.135:0/1381974048 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v47) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6424018030 con 0x7f64340b0030 2021-11-15T14:36:52.682 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:36:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 msgr2=0x7f6414055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 0x7f6414055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f6430008000 tx=0x7f6430008040).stop 2021-11-15T14:36:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 msgr2=0x7f64341492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f6424002f70 tx=0x7f6424006ec0).stop 2021-11-15T14:36:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 shutdown_connections 2021-11-15T14:36:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6414053640 0x7f6414055b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64340b1f40 0x7f643415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64340b0030 0x7f64341492d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 --2- 172.21.2.135:0/1381974048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64340a7140 0x7f643414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.676+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 >> 172.21.2.135:0/1381974048 conn(0x7f643405f730 msgr2=0x7f643405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.680+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 shutdown_connections 2021-11-15T14:36:52.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.680+0000 7f643c428700 1 -- 172.21.2.135:0/1381974048 wait complete. 2021-11-15T14:36:52.689 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:36:52.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 Processor -- start 2021-11-15T14:36:52.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 -- start start 2021-11-15T14:36:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda240b3790 0x7fda240b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fda240a9c90 0x7fda240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda241439a0 con 0x7fda240b0630 2021-11-15T14:36:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda24143c40 con 0x7fda240a9c90 2021-11-15T14:36:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda28879700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24143ee0 con 0x7fda240b3790 2021-11-15T14:36:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda2259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fda240b0630 0x7fda2413d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44822/0 (socket says 172.21.2.135:44822) 2021-11-15T14:36:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.736+0000 7fda2259c700 1 -- 172.21.2.135:0/3858507652 learned_addr learned my addr 172.21.2.135:0/3858507652 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186900787 0 0) 0x7fda241439a0 con 0x7fda240b0630 2021-11-15T14:36:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda04003260 con 0x7fda240b0630 2021-11-15T14:36:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda22d9d700 1 --2- 172.21.2.135:0/3858507652 >> v2:172.21.2.119:3300/0 conn(0x7fda240a9c90 0x7fda240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda240b3790 0x7fda240b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187710334 0 0) 0x7fda04003260 con 0x7fda240b0630 2021-11-15T14:36:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda240b3790 msgr2=0x7fda240b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda240b3790 0x7fda240b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 >> v2:172.21.2.119:3300/0 conn(0x7fda240a9c90 msgr2=0x7fda240b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 --2- 172.21.2.135:0/3858507652 >> v2:172.21.2.119:3300/0 conn(0x7fda240a9c90 0x7fda240b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24144180 con 0x7fda240b0630 2021-11-15T14:36:52.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fda0c001660 con 0x7fda240b0630 2021-11-15T14:36:52.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 >> v1:172.21.2.135:6789/0 conn(0x7fda240b0630 legacy=0x7fda2413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda04003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda04004500 0x7fda04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda04004e70 0x7fda0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24143c40 con 0x7fda04004500 2021-11-15T14:36:52.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24143ee0 con 0x7fda04003750 2021-11-15T14:36:52.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0400bc40 con 0x7fda04004e70 2021-11-15T14:36:52.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda240b3790 0x7fda240b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:36:52.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda04003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda22d9d700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda04004e70 0x7fda0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda04004500 0x7fda04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda04004e70 msgr2=0x7fda0400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda04004e70 0x7fda0400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda04004500 msgr2=0x7fda04004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda04004500 0x7fda04004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/3858507652 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24144180 con 0x7fda04003750 2021-11-15T14:36:52.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda04004500 0x7fda04004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:52.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda04003b70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda040054d0 tx=0x7fda0c0076c0).ready entity=mon.1 client_cookie=c4bdfdd517d2b8de server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c0070d0 con 0x7fda04003750 2021-11-15T14:36:52.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c007230 con 0x7fda04003750 2021-11-15T14:36:52.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2159a700 1 -- 172.21.2.135:0/3858507652 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c00c9e0 con 0x7fda04003750 2021-11-15T14:36:52.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/3858507652 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 msgr2=0x7fda04003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 --2- 172.21.2.135:0/3858507652 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda04003b70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda040054d0 tx=0x7fda0c0076c0).stop 2021-11-15T14:36:52.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda22d9d700 1 -- 172.21.2.135:0/3858507652 reap_dead start 2021-11-15T14:36:52.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/3858507652 shutdown_connections 2021-11-15T14:36:52.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/3858507652 >> 172.21.2.135:0/3858507652 conn(0x7fda24060840 msgr2=0x7fda24060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/3858507652 shutdown_connections 2021-11-15T14:36:52.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/3858507652 wait complete. 2021-11-15T14:36:52.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 Processor -- start 2021-11-15T14:36:52.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- start start 2021-11-15T14:36:52.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 0x7fda2413e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda2413e6c0 0x7fda2413eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24067000 con 0x7fda24140a40 2021-11-15T14:36:52.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24067250 con 0x7fda04003750 2021-11-15T14:36:52.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240674f0 con 0x7fda2413e6c0 2021-11-15T14:36:52.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57246/0 (socket says 172.21.2.135:57246) 2021-11-15T14:36:52.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/531247333 learned_addr learned my addr 172.21.2.135:0/531247333 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 0x7fda2413e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda2413e6c0 msgr2=0x7fda2413eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda2413e6c0 0x7fda2413eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 msgr2=0x7fda2413e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 0x7fda2413e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 -- 172.21.2.135:0/531247333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24067790 con 0x7fda04003750 2021-11-15T14:36:52.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda21d9b700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 0x7fda2413e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:36:52.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda2259c700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fda040054d0 tx=0x7fda0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c0070d0 con 0x7fda04003750 2021-11-15T14:36:52.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c004920 con 0x7fda04003750 2021-11-15T14:36:52.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda24066da0 con 0x7fda04003750 2021-11-15T14:36:52.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24142370 con 0x7fda04003750 2021-11-15T14:36:52.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c00cee0 con 0x7fda04003750 2021-11-15T14:36:52.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.740+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc003410 con 0x7fda04003750 2021-11-15T14:36:52.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda0c01d070 con 0x7fda04003750 2021-11-15T14:36:52.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda1b7fe700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 0x7fda08055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fda0c06ca40 con 0x7fda04003750 2021-11-15T14:36:52.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda21d9b700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 0x7fda08055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda21d9b700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 0x7fda08055b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fda14009000 tx=0x7fda14008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.744+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda0c043a50 con 0x7fda04003750 2021-11-15T14:36:52.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd9fc003c40 con 0x7fda04003750 2021-11-15T14:36:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda1b7fe700 1 -- 172.21.2.135:0/531247333 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda0c01a020 con 0x7fda04003750 2021-11-15T14:36:52.834 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 msgr2=0x7fda08055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 0x7fda08055b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fda14009000 tx=0x7fda14008040).stop 2021-11-15T14:36:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 msgr2=0x7fda24140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fda040054d0 tx=0x7fda0c015000).stop 2021-11-15T14:36:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 shutdown_connections 2021-11-15T14:36:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda08053690 0x7fda08055b50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda2413e6c0 0x7fda2413eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda24140a40 0x7fda2413e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 --2- 172.21.2.135:0/531247333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda04003750 0x7fda24140310 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 >> 172.21.2.135:0/531247333 conn(0x7fda24060840 msgr2=0x7fda240b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 shutdown_connections 2021-11-15T14:36:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.828+0000 7fda28879700 1 -- 172.21.2.135:0/531247333 wait complete. 2021-11-15T14:36:52.841 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:36:52.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 Processor -- start 2021-11-15T14:36:52.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 -- start start 2021-11-15T14:36:52.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 0x7f6e38064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6e380b3950 0x7f6e38065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e380b2430 con 0x7f6e380b2ca0 2021-11-15T14:36:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e38065770 con 0x7f6e380b3950 2021-11-15T14:36:52.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3ce60700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380b26d0 con 0x7f6e38060040 2021-11-15T14:36:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e36d9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f6e380b2ca0 0x7f6e380b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44844/0 (socket says 172.21.2.135:44844) 2021-11-15T14:36:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e36d9d700 1 -- 172.21.2.135:0/1753168110 learned_addr learned my addr 172.21.2.135:0/1753168110 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471888209 0 0) 0x7f6e380b2430 con 0x7f6e380b2ca0 2021-11-15T14:36:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e18003260 con 0x7f6e380b2ca0 2021-11-15T14:36:52.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501604846 0 0) 0x7f6e18003260 con 0x7f6e380b2ca0 2021-11-15T14:36:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 msgr2=0x7f6e38064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 0x7f6e38064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 >> v2:172.21.2.119:3300/0 conn(0x7f6e380b3950 msgr2=0x7f6e38065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 --2- 172.21.2.135:0/1753168110 >> v2:172.21.2.119:3300/0 conn(0x7f6e380b3950 0x7f6e38065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380b2970 con 0x7f6e380b2ca0 2021-11-15T14:36:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6e300019e0 con 0x7f6e380b2ca0 2021-11-15T14:36:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 >> v1:172.21.2.135:6789/0 conn(0x7f6e380b2ca0 legacy=0x7f6e380b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e18003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 0x7f6e18004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e18004b10 0x7f6e18004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38065770 con 0x7f6e18004b10 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380b26d0 con 0x7f6e180037d0 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1800fdf0 con 0x7f6e38060040 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e18003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 -- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 msgr2=0x7f6e18004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e38060040 0x7f6e18004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 -- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e18004b10 msgr2=0x7f6e18004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e18004b10 0x7f6e18004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 -- 172.21.2.135:0/1753168110 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380b2970 con 0x7f6e180037d0 2021-11-15T14:36:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3659c700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e18003bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6e28002f70 tx=0x7f6e28006ca0).ready entity=mon.1 client_cookie=8c46a0dc30bd6f06 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e28012410 con 0x7f6e180037d0 2021-11-15T14:36:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28012570 con 0x7f6e180037d0 2021-11-15T14:36:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.888+0000 7f6e3559a700 1 -- 172.21.2.135:0/1753168110 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e280128d0 con 0x7f6e180037d0 2021-11-15T14:36:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/1753168110 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 msgr2=0x7f6e18003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/1753168110 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e18003bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6e28002f70 tx=0x7f6e28006ca0).stop 2021-11-15T14:36:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e36d9d700 1 -- 172.21.2.135:0/1753168110 reap_dead start 2021-11-15T14:36:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/1753168110 shutdown_connections 2021-11-15T14:36:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/1753168110 >> 172.21.2.135:0/1753168110 conn(0x7f6e3805cfe0 msgr2=0x7f6e3805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/1753168110 shutdown_connections 2021-11-15T14:36:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/1753168110 wait complete. 2021-11-15T14:36:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 Processor -- start 2021-11-15T14:36:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- start start 2021-11-15T14:36:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e380ae7a0 0x7f6e3813d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e3813e760 0x7f6e3813ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3814e760 con 0x7f6e380ae7a0 2021-11-15T14:36:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380b18f0 con 0x7f6e180037d0 2021-11-15T14:36:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3814e950 con 0x7f6e3813e760 2021-11-15T14:36:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57268/0 (socket says 172.21.2.135:57268) 2021-11-15T14:36:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 -- 172.21.2.135:0/182483547 learned_addr learned my addr 172.21.2.135:0/182483547 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 -- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e3813e760 msgr2=0x7f6e3813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e3813e760 0x7f6e3813ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 -- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e380ae7a0 msgr2=0x7f6e3813d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e380ae7a0 0x7f6e3813d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 -- 172.21.2.135:0/182483547 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380aee40 con 0x7f6e180037d0 2021-11-15T14:36:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3659c700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6e380ad6e0 tx=0x7f6e28015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e28012410 con 0x7f6e180037d0 2021-11-15T14:36:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28011e00 con 0x7f6e180037d0 2021-11-15T14:36:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3813e2b0 con 0x7f6e180037d0 2021-11-15T14:36:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e2801d600 con 0x7f6e180037d0 2021-11-15T14:36:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e380af720 con 0x7f6e180037d0 2021-11-15T14:36:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e380648f0 con 0x7f6e180037d0 2021-11-15T14:36:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e2801a030 con 0x7f6e180037d0 2021-11-15T14:36:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 0x7f6e1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.892+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6e2806ca80 con 0x7f6e180037d0 2021-11-15T14:36:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.896+0000 7f6e35d9b700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 0x7f6e1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.896+0000 7f6e35d9b700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 0x7f6e1c055b60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f6e20002f70 tx=0x7f6e20006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.896+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e28043a90 con 0x7f6e180037d0 2021-11-15T14:36:52.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e380573d0 con 0x7f6e180037d0 2021-11-15T14:36:52.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e2f7fe700 1 -- 172.21.2.135:0/182483547 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6e280470b0 con 0x7f6e180037d0 2021-11-15T14:36:52.985 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:52.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 msgr2=0x7f6e1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 0x7f6e1c055b60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f6e20002f70 tx=0x7f6e20006a80).stop 2021-11-15T14:36:52.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 msgr2=0x7f6e380adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:52.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6e380ad6e0 tx=0x7f6e28015000).stop 2021-11-15T14:36:52.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 shutdown_connections 2021-11-15T14:36:52.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e1c0536a0 0x7f6e1c055b60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e3813e760 0x7f6e3813ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e380ae7a0 0x7f6e3813d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:52.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 --2- 172.21.2.135:0/182483547 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e180037d0 0x7f6e380adaa0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:52.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 >> 172.21.2.135:0/182483547 conn(0x7f6e3805cfe0 msgr2=0x7f6e381443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:52.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 shutdown_connections 2021-11-15T14:36:52.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:52.980+0000 7f6e3ce60700 1 -- 172.21.2.135:0/182483547 wait complete. 2021-11-15T14:36:52.991 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:36:53.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 Processor -- start 2021-11-15T14:36:53.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- start start 2021-11-15T14:36:53.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f196c0b1350 0x7f196c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f196c0b2320 0x7f196c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0a7850 con 0x7f196c0b1f40 2021-11-15T14:36:53.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0b17c0 con 0x7f196c0b2320 2021-11-15T14:36:53.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0b06d0 con 0x7f196c0b1350 2021-11-15T14:36:53.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f196c0b1350 0x7f196c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f196c0b1350 0x7f196c0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57278/0 (socket says 172.21.2.135:57278) 2021-11-15T14:36:53.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 -- 172.21.2.135:0/3323354956 learned_addr learned my addr 172.21.2.135:0/3323354956 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:53.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 -- 172.21.2.135:0/3323354956 >> v2:172.21.2.119:3300/0 conn(0x7f196c0b2320 msgr2=0x7f196c1412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:53.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 --2- 172.21.2.135:0/3323354956 >> v2:172.21.2.119:3300/0 conn(0x7f196c0b2320 0x7f196c1412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 -- 172.21.2.135:0/3323354956 >> v1:172.21.2.119:6789/0 conn(0x7f196c0b1f40 legacy=0x7f196c0a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:36:53.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 -- 172.21.2.135:0/3323354956 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0b0970 con 0x7f196c0b1350 2021-11-15T14:36:53.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196b7fe700 1 --2- 172.21.2.135:0/3323354956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1350 0x7f196c0b0030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f196c0ad350 tx=0x7f1954006eb0).ready entity=mon.1 client_cookie=28699c87b9a1426b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196affd700 1 -- 172.21.2.135:0/3323354956 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195400d5c0 con 0x7f196c0b1350 2021-11-15T14:36:53.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196affd700 1 -- 172.21.2.135:0/3323354956 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954000e90 con 0x7f196c0b1350 2021-11-15T14:36:53.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f196affd700 1 -- 172.21.2.135:0/3323354956 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195400d910 con 0x7f196c0b1350 2021-11-15T14:36:53.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- 172.21.2.135:0/3323354956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1350 msgr2=0x7f196c0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 --2- 172.21.2.135:0/3323354956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1350 0x7f196c0b0030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f196c0ad350 tx=0x7f1954006eb0).stop 2021-11-15T14:36:53.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- 172.21.2.135:0/3323354956 shutdown_connections 2021-11-15T14:36:53.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 --2- 172.21.2.135:0/3323354956 >> v2:172.21.2.119:3300/0 conn(0x7f196c0b2320 0x7f196c1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 --2- 172.21.2.135:0/3323354956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1350 0x7f196c0b0030 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- 172.21.2.135:0/3323354956 >> 172.21.2.135:0/3323354956 conn(0x7f196c05f730 msgr2=0x7f196c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- 172.21.2.135:0/3323354956 shutdown_connections 2021-11-15T14:36:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- 172.21.2.135:0/3323354956 wait complete. 2021-11-15T14:36:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 Processor -- start 2021-11-15T14:36:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.044+0000 7f197246f700 1 -- start start 2021-11-15T14:36:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f196c0b1350 0x7f196c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f196c0b2320 0x7f196c0abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0a9630 con 0x7f196c0b1350 2021-11-15T14:36:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c143ee0 con 0x7f196c0b1f40 2021-11-15T14:36:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c143660 con 0x7f196c0b2320 2021-11-15T14:36:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57282/0 (socket says 172.21.2.135:57282) 2021-11-15T14:36:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 -- 172.21.2.135:0/3786461524 learned_addr learned my addr 172.21.2.135:0/3786461524 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 -- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f196c0b2320 msgr2=0x7f196c0abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f196c0b2320 0x7f196c0abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 -- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f196c0b1350 msgr2=0x7f196c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f196c0b1350 0x7f196c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 -- 172.21.2.135:0/3786461524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195400b1e0 con 0x7f196c0b1f40 2021-11-15T14:36:53.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196b7fe700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f196c0ad350 tx=0x7f1954015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195400d940 con 0x7f196c0b1f40 2021-11-15T14:36:53.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954011ca0 con 0x7f196c0b1f40 2021-11-15T14:36:53.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195401e460 con 0x7f196c0b1f40 2021-11-15T14:36:53.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c143900 con 0x7f196c0b1f40 2021-11-15T14:36:53.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c157c80 con 0x7f196c0b1f40 2021-11-15T14:36:53.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c144020 con 0x7f196c0b1f40 2021-11-15T14:36:53.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1954025030 con 0x7f196c0b1f40 2021-11-15T14:36:53.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 0x7f1950055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f195406cfa0 con 0x7f196c0b1f40 2021-11-15T14:36:53.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196bfff700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 0x7f1950055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f196bfff700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 0x7f1950055b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f195c002fb0 tx=0x7f195c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.048+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1954043fb0 con 0x7f196c0b1f40 2021-11-15T14:36:53.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f196c0573d0 con 0x7f196c0b1f40 2021-11-15T14:36:53.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f19697fa700 1 -- 172.21.2.135:0/3786461524 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1954023070 con 0x7f196c0b1f40 2021-11-15T14:36:53.134 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:36:53.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 msgr2=0x7f1950055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 0x7f1950055b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f195c002fb0 tx=0x7f195c0069b0).stop 2021-11-15T14:36:53.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 msgr2=0x7f196c0a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f196c0ad350 tx=0x7f1954015000).stop 2021-11-15T14:36:53.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 shutdown_connections 2021-11-15T14:36:53.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1950053640 0x7f1950055b00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f196c0b2320 0x7f196c0abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f196c0b1f40 0x7f196c0a9b50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 --2- 172.21.2.135:0/3786461524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f196c0b1350 0x7f196c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 >> 172.21.2.135:0/3786461524 conn(0x7f196c05f730 msgr2=0x7f196c0a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:53.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 shutdown_connections 2021-11-15T14:36:53.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.128+0000 7f197246f700 1 -- 172.21.2.135:0/3786461524 wait complete. 2021-11-15T14:36:53.141 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:36:53.142 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:36:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 Processor -- start 2021-11-15T14:36:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- start start 2021-11-15T14:36:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f29000b0520 0x7f29000addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 0x7f2900140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000b2b70 con 0x7f29000aa1a0 2021-11-15T14:36:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29000b27f0 con 0x7f29000b0520 2021-11-15T14:36:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000b2da0 con 0x7f29000b0900 2021-11-15T14:36:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2905d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f29000aa1a0 0x7f29000ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44878/0 (socket says 172.21.2.135:44878) 2021-11-15T14:36:53.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2905d9b700 1 -- 172.21.2.135:0/3439832723 learned_addr learned my addr 172.21.2.135:0/3439832723 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:36:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290659c700 1 --2- 172.21.2.135:0/3439832723 >> v2:172.21.2.119:3300/0 conn(0x7f29000b0520 0x7f29000addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 0x7f2900140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688502847 0 0) 0x7f29000b2b70 con 0x7f29000aa1a0 2021-11-15T14:36:53.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e4003260 con 0x7f29000aa1a0 2021-11-15T14:36:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029906180 0 0) 0x7f28e4003260 con 0x7f29000aa1a0 2021-11-15T14:36:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 msgr2=0x7f2900140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 0x7f2900140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 >> v2:172.21.2.119:3300/0 conn(0x7f29000b0520 msgr2=0x7f29000addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 --2- 172.21.2.135:0/3439832723 >> v2:172.21.2.119:3300/0 conn(0x7f29000b0520 0x7f29000addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000a9bf0 con 0x7f29000aa1a0 2021-11-15T14:36:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f28f4001660 con 0x7f29000aa1a0 2021-11-15T14:36:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 >> v1:172.21.2.135:6789/0 conn(0x7f29000aa1a0 legacy=0x7f29000ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 0x7f28e40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28e4003d50 0x7f28e4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28e40049f0 0x7f28e4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000b27f0 con 0x7f28e4003d50 2021-11-15T14:36:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000b2da0 con 0x7f28e40049f0 2021-11-15T14:36:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e400b830 con 0x7f29000b0900 2021-11-15T14:36:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28e40049f0 0x7f28e4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 msgr2=0x7f28e40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29000b0900 0x7f28e40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28e4003d50 msgr2=0x7f28e4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:36:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28e4003d50 0x7f28e4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:36:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/3439832723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4003260 con 0x7f28e40049f0 2021-11-15T14:36:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28e40049f0 0x7f28e4004e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f28fc00a000 tx=0x7f28fc008040).ready entity=mon.1 client_cookie=87280f9a1192a6b2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc00c070 con 0x7f28e40049f0 2021-11-15T14:36:53.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00e5f0 con 0x7f28e40049f0 2021-11-15T14:36:53.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290559a700 1 -- 172.21.2.135:0/3439832723 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc00e950 con 0x7f28e40049f0 2021-11-15T14:36:53.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/3439832723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28e40049f0 msgr2=0x7f28e4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- 172.21.2.135:0/3439832723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28e40049f0 0x7f28e4004e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f28fc00a000 tx=0x7f28fc008040).stop 2021-11-15T14:36:53.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/3439832723 reap_dead start 2021-11-15T14:36:53.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/3439832723 shutdown_connections 2021-11-15T14:36:53.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/3439832723 >> 172.21.2.135:0/3439832723 conn(0x7f2900060840 msgr2=0x7f2900060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/3439832723 shutdown_connections 2021-11-15T14:36:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/3439832723 wait complete. 2021-11-15T14:36:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 Processor -- start 2021-11-15T14:36:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- start start 2021-11-15T14:36:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28e40049f0 0x7f29000643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2900063af0 0x7f2900066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900066990 con 0x7f2900063af0 2021-11-15T14:36:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000ac340 con 0x7f29000672e0 2021-11-15T14:36:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000ab7d0 con 0x7f28e40049f0 2021-11-15T14:36:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57304/0 (socket says 172.21.2.135:57304) 2021-11-15T14:36:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/1569875771 learned_addr learned my addr 172.21.2.135:0/1569875771 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:36:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290659c700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28e40049f0 0x7f29000643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2905d9b700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2900063af0 0x7f2900066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28e40049f0 msgr2=0x7f29000643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28e40049f0 0x7f29000643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2900063af0 msgr2=0x7f2900066df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2900063af0 0x7f2900066df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 -- 172.21.2.135:0/1569875771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000677b0 con 0x7f29000672e0 2021-11-15T14:36:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2906d9d700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f28f4001110 tx=0x7f28fc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc021070 con 0x7f29000672e0 2021-11-15T14:36:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc01d440 con 0x7f29000672e0 2021-11-15T14:36:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc01d7a0 con 0x7f29000672e0 2021-11-15T14:36:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000ac0a0 con 0x7f29000672e0 2021-11-15T14:36:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29000648d0 con 0x7f29000672e0 2021-11-15T14:36:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900066b00 con 0x7f29000672e0 2021-11-15T14:36:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28fc01d900 con 0x7f29000672e0 2021-11-15T14:36:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 0x7f28e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:36:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f28fc06c360 con 0x7f29000672e0 2021-11-15T14:36:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.192+0000 7f290659c700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 0x7f28e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:36:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.196+0000 7f290659c700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 0x7f28e8055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f28ec00b000 tx=0x7f28ec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:36:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.196+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28fc0431e0 con 0x7f29000672e0 2021-11-15T14:36:53.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29000573d0 con 0x7f29000672e0 2021-11-15T14:36:53.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f28fb7fe700 1 -- 172.21.2.135:0/1569875771 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f28fc046800 con 0x7f29000672e0 2021-11-15T14:36:53.311 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:36:53.311 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:36:53.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 msgr2=0x7f28e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 0x7f28e8055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f28ec00b000 tx=0x7f28ec008040).stop 2021-11-15T14:36:53.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 msgr2=0x7f29000aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:36:53.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f28f4001110 tx=0x7f28fc008040).stop 2021-11-15T14:36:53.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 shutdown_connections 2021-11-15T14:36:53.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28e8053610 0x7f28e8055ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29000672e0 0x7f29000aa5c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2900063af0 0x7f2900066df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 --2- 172.21.2.135:0/1569875771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28e40049f0 0x7f29000643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:36:53.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 >> 172.21.2.135:0/1569875771 conn(0x7f2900060840 msgr2=0x7f29000b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:36:53.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 shutdown_connections 2021-11-15T14:36:53.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:36:53.304+0000 7f2908800700 1 -- 172.21.2.135:0/1569875771 wait complete. 2021-11-15T14:36:53.316 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:36:53.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:36:17.138655+0000', 'modified': '2021-11-15T14:36:18.583912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5200}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5200': {'gid': 5200, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/614438403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 614438403}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 614438403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:36:53.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:36:53.622 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:36:53.686 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5200,"want_state":"up:active","state":"up:active","rank_uptime":36.537907887000003,"mdsmap_epoch":20,"osdmap_epoch":47,"osdmap_epoch_barrier":47,"uptime":40.7163982} 2021-11-15T14:36:53.686 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5200, "mdsmap_epoch": 20, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "rank_uptime": 36.537907887, "state": "up:active", "uptime": 40.7163982, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:36:53.687 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:36:53.687 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:36:53.688 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:36:53.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:53.689 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:53.699 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:53.754 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:53.755 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:53.761 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:53.761 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:53.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:53.763 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:53.767 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:36:53.767 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:53.810 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:53.819 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:53.819 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:53.824 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:53.825 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:53.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:53.826 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:53.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:36:53.850+0000 7f1630937080 -1 init, newargv = 0x5592ac28c000 newargc=9 2021-11-15T14:36:53.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14222]: starting ceph client 2021-11-15T14:36:53.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14222]: starting fuse 2021-11-15T14:36:54.933 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:36:54.945 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:36:54.946 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:36:54.994 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:36:54.995 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:36:54.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:54.996 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:36:55.001 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:36:55.002 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:36:55.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:55.003 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:36:55.003 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:36:55.004 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:36:55.004 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:36:55.004 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:36:55.005 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:55.005 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:36:55.006 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:36:55.006 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:36:55.007 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:55.007 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:36:55.007 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:36:55.008 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:36:55.008 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:36:55.009 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:55.009 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:36:55.009 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:36:55.010 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:36:55.010 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:36:55.011 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:36:55.011 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:36:55.011 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:36:55.012 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:36:55.079 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14222.asok 2021-11-15T14:36:55.081 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14222.asok 2021-11-15T14:36:55.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:55.082 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14222.asok status 2021-11-15T14:36:55.130 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:36:55.130 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:36:55.130 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:36:55.131 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:36:55.131 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:36:55.131 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:36:55.131 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:36:55.131 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14222", 2021-11-15T14:36:55.132 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:36:55.132 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:55.132 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:36:55.132 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:36:55.133 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4539, 2021-11-15T14:36:55.133 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:36:55.133 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:36:55.133 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:36:55.133 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4539 2021-11-15T14:36:55.134 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:55.134 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:36:55.134 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:36:55.134 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:36:55.135 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2337038189 2021-11-15T14:36:55.135 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:36:55.135 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:55.135 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:36:55.136 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:36:55.136 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:36:55.136 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2337038189 2021-11-15T14:36:55.136 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:36:55.136 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4539 172.21.2.138:0/2337038189", 2021-11-15T14:36:55.137 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2337038189", 2021-11-15T14:36:55.137 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:36:55.137 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 20, 2021-11-15T14:36:55.137 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 47, 2021-11-15T14:36:55.138 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:36:55.138 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:36:55.138 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:36:55.138 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:36:55.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:55.140 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:36:55.140 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:36:55.146 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:36:55.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:36:55.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:36:55.148 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:11.534 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:11.953 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:11.956 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:11.959 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:42.012 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:42.016 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:42.020 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:42.023 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:37:42.973 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:37:42.974 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:43.003 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:43.017 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:43.031 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:43.046 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:37:43.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:43.047 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:37:43.047 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:43.052 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:37:43.053 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:37:43.053 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:37:43.054 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:37:43.054 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:43.104 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14222]: fuse finished with error 0 and tester_r 0 2021-11-15T14:37:43.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:43.105 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:37:43.106 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:43.111 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:37:43.112 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:37:43.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:37:43.195 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:43.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:43.199 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:37:43.200 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:37:43.209 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:37:43.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:37:43.211 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:37:43.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:37:43.212 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:37:43.221 INFO:teuthology.orchestra.run.gibba032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:37:43.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:37:43.222 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:37:43.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 Processor -- start 2021-11-15T14:37:43.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 -- start start 2021-11-15T14:37:43.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcc1c0b0520 0x7fcc1c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0b2b70 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b27f0 con 0x7fcc1c0b0520 2021-11-15T14:37:43.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.288+0000 7fcc222e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b2da0 con 0x7fcc1c0b0900 2021-11-15T14:37:43.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcc1c0b0520 0x7fcc1c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc20880700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcc1c0b0520 0x7fcc1c0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51122/0 (socket says 172.21.2.135:51122) 2021-11-15T14:37:43.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc20880700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:38852/0 (socket says 172.21.2.135:38852) 2021-11-15T14:37:43.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 -- 172.21.2.135:0/1481857202 learned_addr learned my addr 172.21.2.135:0/1481857202 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1b7fe700 1 --1- 172.21.2.135:0/1481857202 >> v1:172.21.2.119:6789/0 conn(0x7fcc1c0aa1a0 0x7fcc1c0ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:54312/0 (socket says 172.21.2.135:54312) 2021-11-15T14:37:43.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 -- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 msgr2=0x7fcc1c140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:43.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 --2- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 -- 172.21.2.135:0/1481857202 >> v1:172.21.2.119:6789/0 conn(0x7fcc1c0aa1a0 legacy=0x7fcc1c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 -- 172.21.2.135:0/1481857202 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0a9bf0 con 0x7fcc1c0b0520 2021-11-15T14:37:43.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1bfff700 1 --2- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c0addb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcc04002f70 tx=0x7fcc04006f40).ready entity=mon.0 client_cookie=31391cbdf4383eb6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1affd700 1 -- 172.21.2.135:0/1481857202 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0400da80 con 0x7fcc1c0b0520 2021-11-15T14:37:43.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1affd700 1 -- 172.21.2.135:0/1481857202 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04000e90 con 0x7fcc1c0b0520 2021-11-15T14:37:43.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc1affd700 1 -- 172.21.2.135:0/1481857202 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0400de10 con 0x7fcc1c0b0520 2021-11-15T14:37:43.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 -- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 msgr2=0x7fcc1c0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 --2- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c0addb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcc04002f70 tx=0x7fcc04006f40).stop 2021-11-15T14:37:43.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 -- 172.21.2.135:0/1481857202 shutdown_connections 2021-11-15T14:37:43.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 --2- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 --2- 172.21.2.135:0/1481857202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c0addb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 -- 172.21.2.135:0/1481857202 >> 172.21.2.135:0/1481857202 conn(0x7fcc1c060840 msgr2=0x7fcc1c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:43.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 -- 172.21.2.135:0/1481857202 shutdown_connections 2021-11-15T14:37:43.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.292+0000 7fcc222e3700 1 -- 172.21.2.135:0/1481857202 wait complete. 2021-11-15T14:37:43.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 Processor -- start 2021-11-15T14:37:43.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- start start 2021-11-15T14:37:43.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0668e0 con 0x7fcc1c0b0520 2021-11-15T14:37:43.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c152690 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c144170 con 0x7fcc1c0b0900 2021-11-15T14:37:43.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57314/0 (socket says 172.21.2.135:57314) 2021-11-15T14:37:43.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 -- 172.21.2.135:0/2213214913 learned_addr learned my addr 172.21.2.135:0/2213214913 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 -- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 msgr2=0x7fcc1c152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc20880700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1b7fe700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 -- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 msgr2=0x7fcc1c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 -- 172.21.2.135:0/2213214913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0400b460 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc20880700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:43.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1b7fe700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:43.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1bfff700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fcc1c063e50 tx=0x7fcc04006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0401d070 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04018800 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1443a0 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc04018b60 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c145470 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c0573d0 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc04018cc0 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 0x7fcc00055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcc0406cf40 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.296+0000 7fcc1b7fe700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 0x7fcc00055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.300+0000 7fcc1b7fe700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 0x7fcc00055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcc0c008000 tx=0x7fcc0c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.300+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc04043ef0 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.380+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcc1c0446d0 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc197fa700 1 -- 172.21.2.135:0/2213214913 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v47) v1 ==== 81+0+34037 (secure 0 0 0) 0x7fcc04047510 con 0x7fcc1c0aa1a0 2021-11-15T14:37:43.388 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:43.389 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:37:43.389 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 47, 2021-11-15T14:37:43.389 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:37:43.389 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:37:43.390 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:36:18.143439+0000", 2021-11-15T14:37:43.390 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:37:43.390 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:37:43.390 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:37:43.391 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:37:43.391 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:37:43.391 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:37:43.391 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:37:43.391 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:37:43.392 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:37:43.392 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:43.392 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:37:43.392 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:37:43.392 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:37:43.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:37:43.393 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:37:43.393 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 8, 2021-11-15T14:37:43.393 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:37:43.394 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:37:43.394 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:37:43.394 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:37:43.394 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:37:43.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.395 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:37:43.395 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:37:43.395 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:37:43.395 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:43.396 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:43.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:43.396 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:43.396 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:43.396 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:43.397 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:43.397 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:43.397 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:37:43.397 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:37:43.397 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:37:43.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:37:43.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:37:43.398 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:43.398 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:43.399 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:43.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:43.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:43.399 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:43.399 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:43.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.400 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:37:43.400 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:43.400 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:43.400 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:43.401 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:43.401 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:43.401 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:43.401 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:43.401 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:43.402 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:43.402 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:43.402 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:43.402 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:43.403 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:43.403 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:43.403 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:43.403 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:43.403 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:43.404 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:43.404 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:43.404 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:43.404 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:43.404 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:43.405 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:43.405 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:43.405 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:43.405 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:43.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.406 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:43.406 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:43.406 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:43.406 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:43.407 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:43.407 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:43.407 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:43.407 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:43.407 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:43.408 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:43.408 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:43.408 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:37:43.408 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:37:43.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.409 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:43.409 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:37:43.409 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.410 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:37:43.410 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:37:43.410 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:37:43.410 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:43.411 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:43.411 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:43.411 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:43.411 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:43.411 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:43.412 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:43.412 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:43.412 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:37:43.412 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:37:43.412 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:37:43.413 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:37:43.413 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:37:43.413 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:43.413 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:43.414 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:43.414 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:43.414 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:43.414 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:43.414 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:43.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:37:43.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:43.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:43.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:43.416 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:43.416 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:43.416 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:43.416 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:43.416 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:43.417 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:43.417 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:43.417 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:43.417 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:43.418 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:43.418 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:43.418 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:43.418 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:43.418 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:43.419 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:43.419 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:43.419 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:43.419 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:43.419 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:43.420 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:43.420 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:43.420 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:43.420 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:43.421 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.421 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:43.421 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:43.421 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:43.421 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:43.422 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:43.422 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:43.422 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:43.422 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:43.422 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:43.423 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:43.423 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:43.423 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:37:43.423 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:43.424 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:37:43.424 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.424 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.424 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 7, 2021-11-15T14:37:43.425 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:37:43.425 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:36:15.047541+0000", 2021-11-15T14:37:43.425 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:43.425 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:43.425 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:43.426 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:43.426 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:43.426 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:43.426 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:43.427 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:43.427 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:37:43.427 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:37:43.427 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:37:43.427 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:37:43.428 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:37:43.428 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:43.428 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:43.428 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:43.428 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:43.429 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:43.429 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:43.429 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:43.429 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.429 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "46", 2021-11-15T14:37:43.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:43.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:43.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:43.430 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:43.431 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:43.431 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:43.431 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:43.431 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:43.431 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:43.432 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:43.432 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:43.432 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:43.432 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:43.432 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:43.433 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:43.433 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:43.433 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:43.433 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:43.433 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:43.434 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:43.434 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:43.434 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:43.434 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:43.435 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:43.435 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:43.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:43.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.435 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:43.436 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:43.436 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:43.436 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:43.436 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:43.436 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:43.437 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:43.437 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:43.437 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:43.437 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:43.438 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:43.438 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:37:43.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:37:43.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:37:43.438 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:37:43.439 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.439 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:43.439 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:37:43.439 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:37:43.439 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.440 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.440 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.440 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 8, 2021-11-15T14:37:43.441 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:37:43.441 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:36:16.111420+0000", 2021-11-15T14:37:43.441 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:43.441 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:43.441 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:43.442 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:43.442 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:43.442 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:43.442 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:43.442 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:43.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:37:43.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:37:43.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:37:43.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:37:43.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:37:43.444 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:43.444 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:43.444 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:43.444 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:43.445 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:43.445 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:43.445 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:43.445 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.445 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "47", 2021-11-15T14:37:43.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:43.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:43.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:43.446 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:43.447 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:43.447 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:43.447 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:43.447 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:43.447 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:43.448 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:43.448 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:43.448 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:43.448 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:43.448 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:43.449 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:43.449 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:43.449 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:43.449 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:43.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:43.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:43.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:43.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:43.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:43.451 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:43.451 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:43.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:43.451 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.451 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:43.452 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:43.452 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:43.452 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:43.452 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:43.452 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:43.453 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:43.453 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:43.453 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:43.453 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:43.454 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:43.454 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:37:43.454 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:43.454 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:37:43.454 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:37:43.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.455 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:43.456 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:37:43.456 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.456 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:37:43.456 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:37:43.456 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.457 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.457 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.457 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.457 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.457 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:37:43.458 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.458 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.458 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.459 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:37:43.460 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.460 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.460 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:37:43.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.461 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.461 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.461 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.462 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:37:43.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:37:43.464 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.464 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.465 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:37:43.466 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.467 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:37:43.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.467 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.467 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.467 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.468 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:37:43.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:37:43.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:43.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.470 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.471 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:37:43.471 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:37:43.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:37:43.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:37:43.471 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.472 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.472 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.472 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.473 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.473 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:37:43.473 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:37:43.473 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.473 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.474 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.474 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:43.475 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.475 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.475 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.476 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.476 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:37:43.476 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.477 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:37:43.477 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.478 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.478 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.478 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.478 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.479 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:37:43.479 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.480 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.480 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:37:43.480 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.481 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.481 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.481 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.482 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.482 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:37:43.482 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.483 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:37:43.483 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.484 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.484 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.484 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.484 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.485 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:37:43.485 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:37:43.486 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:43.487 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.487 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.487 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:37:43.487 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:37:43.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:37:43.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:37:43.488 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.488 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.489 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.489 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.489 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:37:43.490 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:37:43.490 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.490 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.490 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.490 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.491 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.491 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.491 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.491 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:43.492 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.492 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.492 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.492 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.492 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.493 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.493 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:37:43.493 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.493 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.494 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:37:43.494 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.494 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.495 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.495 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.495 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.496 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.496 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:37:43.496 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.497 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.497 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:37:43.497 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.497 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.498 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.498 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.499 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.499 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:37:43.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.500 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:37:43.500 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.500 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.501 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.501 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.502 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:37:43.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:37:43.504 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:43.504 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.504 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.505 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:37:43.505 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:37:43.505 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:37:43.506 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:37:43.506 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.506 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.507 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.507 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.507 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.508 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:37:43.508 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:37:43.508 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.508 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.509 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.509 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.509 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.509 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.510 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.510 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 44, 2021-11-15T14:37:43.510 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.511 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.511 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.512 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.512 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.512 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:37:43.512 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.513 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.513 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.513 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:37:43.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.514 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.514 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.514 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.514 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.515 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.515 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.515 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.515 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:37:43.516 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.516 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.516 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.517 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:37:43.517 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.517 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.517 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.518 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.518 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.518 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:37:43.519 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.519 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.519 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.520 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:37:43.520 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.520 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.521 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.521 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.521 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.521 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.522 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.522 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:37:43.522 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.522 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.523 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.523 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.523 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:37:43.523 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:43.524 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.524 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.524 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.524 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:37:43.524 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:37:43.525 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:37:43.525 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:37:43.525 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.525 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.525 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.526 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.526 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.526 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.526 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:37:43.527 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:37:43.527 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.527 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.527 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.527 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.528 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.528 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.528 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.528 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 44, 2021-11-15T14:37:43.528 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.529 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.529 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.529 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.529 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.529 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:37:43.530 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.530 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.530 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.531 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.531 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:37:43.531 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.531 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.531 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.533 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:37:43.533 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.533 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.533 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.533 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.534 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:37:43.534 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.534 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.534 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.535 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.535 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.535 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.535 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.536 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:37:43.536 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.536 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.536 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.537 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:37:43.537 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.537 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.537 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.537 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.538 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.538 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.538 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.539 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:37:43.539 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.539 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.539 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.539 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.540 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:37:43.540 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:43.540 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.540 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.540 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.541 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:37:43.541 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:37:43.541 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:37:43.541 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:37:43.542 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.542 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.542 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.542 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.542 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.543 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.543 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:37:43.543 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:37:43.543 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.544 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.544 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.544 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.544 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.544 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.545 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.545 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:43.545 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.545 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.545 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.546 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.546 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:37:43.547 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.547 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.547 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.547 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:37:43.548 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.548 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.548 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.548 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.548 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.549 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.549 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:37:43.549 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.550 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.550 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.550 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.550 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:37:43.551 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.551 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.551 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.551 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.551 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.552 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.552 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:37:43.552 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.553 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.553 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.553 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:37:43.554 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.554 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.554 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.554 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.554 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.555 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.555 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:37:43.555 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.556 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.556 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.556 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.556 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:37:43.556 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:43.557 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.557 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.557 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.557 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:37:43.558 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:37:43.558 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:37:43.558 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:37:43.558 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.558 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.559 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.559 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.559 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.559 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.559 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:37:43.560 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:37:43.560 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.560 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.560 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.561 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.561 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.561 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.561 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.561 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:43.562 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.562 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.562 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.562 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.562 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.563 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.563 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:37:43.563 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.563 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.563 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.564 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.564 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:37:43.564 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.564 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.565 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.565 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.565 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.565 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.565 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.566 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.566 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:37:43.566 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.566 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.566 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.567 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:37:43.567 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.567 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.567 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.568 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.568 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.568 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.568 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.569 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.569 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:37:43.569 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.569 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.569 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.570 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.570 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:37:43.570 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.570 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.570 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.571 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.571 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.571 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.571 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.572 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.572 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:37:43.572 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.572 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.572 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.573 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.573 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:37:43.573 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:43.573 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.574 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.574 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.574 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:37:43.574 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:37:43.574 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:37:43.575 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:37:43.575 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.575 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.575 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.576 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.576 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.576 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.576 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:37:43.576 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:37:43.577 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:43.577 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:43.577 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:43.577 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:43.577 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:43.578 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:43.578 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:43.578 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:43.578 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:43.579 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:43.579 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:43.579 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.579 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.579 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.580 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:37:43.580 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.580 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.580 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.580 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.581 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:37:43.581 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.581 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.581 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.581 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.582 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:43.582 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.582 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.582 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.583 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:37:43.583 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.583 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.583 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.583 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.584 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:37:43.584 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.584 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.584 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.584 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.585 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:43.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.585 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.585 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:37:43.586 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.586 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.586 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.586 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.587 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:37:43.587 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.587 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.587 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.587 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.588 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:43.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:43.588 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.588 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:43.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:37:43.589 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.589 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.589 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.589 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:43.590 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:37:43.590 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:43.590 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.590 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.590 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.591 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:37:43.591 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:37:43.591 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:37:43.591 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:37:43.592 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:43.592 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:43.592 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:43.592 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:43.593 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.593 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:43.593 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:37:43.593 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.593 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:37:43.594 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.594 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.594 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.594 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.595 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.595 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:37:43.595 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.595 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.595 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.596 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:37:43.596 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.596 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.596 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.597 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.597 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.597 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:37:43.597 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.597 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.598 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.598 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:37:43.598 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.598 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.598 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.599 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.599 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.599 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:37:43.599 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.599 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.600 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.600 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:37:43.600 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.600 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.601 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.601 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.601 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.601 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:37:43.601 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.602 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.602 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.602 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:37:43.602 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.602 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.603 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.603 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.603 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.603 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:37:43.604 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.604 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.604 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.604 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:37:43.604 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.605 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.605 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.605 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.605 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:37:43.606 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.606 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.606 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.606 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:37:43.607 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.607 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.607 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.607 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.607 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.608 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:37:43.608 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.608 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.608 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:43.609 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:37:43.609 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:43.609 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:43.609 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:43.609 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:43.610 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:43.610 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:37:43.610 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:43.610 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.610 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:43.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:37:43.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:37:43.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:37:43.611 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:37:43.611 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:37:43.612 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:37:43.612 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:37:43.612 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:37:43.612 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:37:43.613 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:37:43.613 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:37:43.613 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:37:43.613 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:37:43.613 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:37:43.614 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:37:43.614 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:37:43.614 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:37:43.614 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.614 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:37:43.615 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:37:43.615 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:37:43.615 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:37:43.615 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:37:43.615 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:37:43.616 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:37:43.616 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:43.616 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:43.616 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:37:43.617 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:37:43.617 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:37:43.617 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:37:43.617 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:37:43.617 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:37:43.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 msgr2=0x7fcc00055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 0x7fcc00055a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcc0c008000 tx=0x7fcc0c009040).stop 2021-11-15T14:37:43.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 msgr2=0x7fcc1c0646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fcc1c063e50 tx=0x7fcc04006f40).stop 2021-11-15T14:37:43.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 shutdown_connections 2021-11-15T14:37:43.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc00053580 0x7fcc00055a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc1c0b0900 0x7fcc1c152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc1c0b0520 0x7fcc1c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 --2- 172.21.2.135:0/2213214913 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc1c0aa1a0 0x7fcc1c0646e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 >> 172.21.2.135:0/2213214913 conn(0x7fcc1c060840 msgr2=0x7fcc1c0adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:43.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 shutdown_connections 2021-11-15T14:37:43.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.384+0000 7fcc222e3700 1 -- 172.21.2.135:0/2213214913 wait complete. 2021-11-15T14:37:43.622 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:43.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 Processor -- start 2021-11-15T14:37:43.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 -- start start 2021-11-15T14:37:43.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f01100b1e30 0x7f01100b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0110148420 0x7f01100b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01100b03d0 con 0x7f01100a7140 2021-11-15T14:37:43.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100a9140 con 0x7f01100b1e30 2021-11-15T14:37:43.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0117ace700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01100b0670 con 0x7f0110148420 2021-11-15T14:37:43.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0110148420 0x7f01100b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0110148420 0x7f01100b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57324/0 (socket says 172.21.2.135:57324) 2021-11-15T14:37:43.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 -- 172.21.2.135:0/2497644855 learned_addr learned my addr 172.21.2.135:0/2497644855 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 -- 172.21.2.135:0/2497644855 >> v2:172.21.2.119:3300/0 conn(0x7f01100b1e30 msgr2=0x7f01100b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 --2- 172.21.2.135:0/2497644855 >> v2:172.21.2.119:3300/0 conn(0x7f01100b1e30 0x7f01100b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 -- 172.21.2.135:0/2497644855 >> v1:172.21.2.119:6789/0 conn(0x7f01100a7140 legacy=0x7f01101447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 -- 172.21.2.135:0/2497644855 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100b0910 con 0x7f0110148420 2021-11-15T14:37:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.672+0000 7f0115069700 1 --2- 172.21.2.135:0/2497644855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0110148420 0x7f01100b2210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f01100acee0 tx=0x7f010c006eb0).ready entity=mon.1 client_cookie=3fde1d2b1f2275e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0114868700 1 -- 172.21.2.135:0/2497644855 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c00d5c0 con 0x7f0110148420 2021-11-15T14:37:43.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0114868700 1 -- 172.21.2.135:0/2497644855 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c000e90 con 0x7f0110148420 2021-11-15T14:37:43.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0114868700 1 -- 172.21.2.135:0/2497644855 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c00d950 con 0x7f0110148420 2021-11-15T14:37:43.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/2497644855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0110148420 msgr2=0x7f01100b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- 172.21.2.135:0/2497644855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0110148420 0x7f01100b2210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f01100acee0 tx=0x7f010c006eb0).stop 2021-11-15T14:37:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/2497644855 shutdown_connections 2021-11-15T14:37:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- 172.21.2.135:0/2497644855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0110148420 0x7f01100b2210 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- 172.21.2.135:0/2497644855 >> v2:172.21.2.119:3300/0 conn(0x7f01100b1e30 0x7f01100b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/2497644855 >> 172.21.2.135:0/2497644855 conn(0x7f011005f730 msgr2=0x7f011005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/2497644855 shutdown_connections 2021-11-15T14:37:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/2497644855 wait complete. 2021-11-15T14:37:43.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 Processor -- start 2021-11-15T14:37:43.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- start start 2021-11-15T14:37:43.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01100a7140 0x7f01100ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0110148420 0x7f01100a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100aed10 con 0x7f0110148420 2021-11-15T14:37:43.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100abe10 con 0x7f01100b1e30 2021-11-15T14:37:43.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100ae7d0 con 0x7f01100a7140 2021-11-15T14:37:43.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57332/0 (socket says 172.21.2.135:57332) 2021-11-15T14:37:43.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 -- 172.21.2.135:0/743457711 learned_addr learned my addr 172.21.2.135:0/743457711 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f011586a700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01100a7140 0x7f01100ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 -- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01100a7140 msgr2=0x7f01100ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01100a7140 0x7f01100ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 -- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0110148420 msgr2=0x7f01100a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0110148420 0x7f01100a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:43.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 -- 172.21.2.135:0/743457711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c00b1e0 con 0x7f01100b1e30 2021-11-15T14:37:43.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0115069700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f01100acee0 tx=0x7f010c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c006be0 con 0x7f01100b1e30 2021-11-15T14:37:43.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c002f70 con 0x7f01100b1e30 2021-11-15T14:37:43.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c00de70 con 0x7f01100b1e30 2021-11-15T14:37:43.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01100aea70 con 0x7f01100b1e30 2021-11-15T14:37:43.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01100abbb0 con 0x7f01100b1e30 2021-11-15T14:37:43.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.676+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100adee0 con 0x7f01100b1e30 2021-11-15T14:37:43.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f010c025030 con 0x7f01100b1e30 2021-11-15T14:37:43.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f0102ffd700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 0x7f00f0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f010c06cf60 con 0x7f01100b1e30 2021-11-15T14:37:43.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f011586a700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 0x7f00f0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f011586a700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 0x7f00f0055b20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f0104007000 tx=0x7f0104008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.680+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f010c043e60 con 0x7f01100b1e30 2021-11-15T14:37:43.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01100b0bb0 con 0x7f01100b1e30 2021-11-15T14:37:43.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0102ffd700 1 -- 172.21.2.135:0/743457711 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f010c047480 con 0x7f01100b1e30 2021-11-15T14:37:43.794 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:43.795 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:36:18.583912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5200":{"gid":5200,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/614438403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":614438403},{"type":"v1","addr":"172.21.2.135:6835","nonce":614438403}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:37:43.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 msgr2=0x7f00f0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 0x7f00f0055b20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f0104007000 tx=0x7f0104008040).stop 2021-11-15T14:37:43.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 msgr2=0x7f011014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.788+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f01100acee0 tx=0x7f010c015000).stop 2021-11-15T14:37:43.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 shutdown_connections 2021-11-15T14:37:43.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00f0053660 0x7f00f0055b20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0110148420 0x7f01100a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:43.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01100b1e30 0x7f011014b720 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 --2- 172.21.2.135:0/743457711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01100a7140 0x7f01100ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 >> 172.21.2.135:0/743457711 conn(0x7f011005f730 msgr2=0x7f01101477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:43.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 shutdown_connections 2021-11-15T14:37:43.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.792+0000 7f0117ace700 1 -- 172.21.2.135:0/743457711 wait complete. 2021-11-15T14:37:43.799 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 20 2021-11-15T14:37:43.801 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:37:43.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 Processor -- start 2021-11-15T14:37:43.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 -- start start 2021-11-15T14:37:43.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 0x7f69801447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69800b03d0 con 0x7f6980148420 2021-11-15T14:37:43.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800a9140 con 0x7f69800a7140 2021-11-15T14:37:43.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.848+0000 7f69864c5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800b0670 con 0x7f69800b1e30 2021-11-15T14:37:43.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f6984a62700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 0x7f69801447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f6984a62700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 0x7f69801447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51154/0 (socket says 172.21.2.135:51154) 2021-11-15T14:37:43.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:38880/0 (socket says 172.21.2.135:38880) 2021-11-15T14:37:43.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f6984a62700 1 -- 172.21.2.135:0/2253877518 learned_addr learned my addr 172.21.2.135:0/2253877518 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697f7fe700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f6980148420 0x7f69800b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:54342/0 (socket says 172.21.2.135:54342) 2021-11-15T14:37:43.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 -- 172.21.2.135:0/2253877518 >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 msgr2=0x7f69801447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:43.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 --2- 172.21.2.135:0/2253877518 >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 0x7f69801447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 -- 172.21.2.135:0/2253877518 >> v1:172.21.2.119:6789/0 conn(0x7f6980148420 legacy=0x7f69800b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 -- 172.21.2.135:0/2253877518 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800b0910 con 0x7f69800b1e30 2021-11-15T14:37:43.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697ffff700 1 --2- 172.21.2.135:0/2253877518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6970002f70 tx=0x7f6970006df0).ready entity=mon.2 client_cookie=e9892824b1371d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697effd700 1 -- 172.21.2.135:0/2253877518 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697000d570 con 0x7f69800b1e30 2021-11-15T14:37:43.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697effd700 1 -- 172.21.2.135:0/2253877518 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970000e90 con 0x7f69800b1e30 2021-11-15T14:37:43.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f697effd700 1 -- 172.21.2.135:0/2253877518 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697000d8c0 con 0x7f69800b1e30 2021-11-15T14:37:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- 172.21.2.135:0/2253877518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 msgr2=0x7f69800b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 --2- 172.21.2.135:0/2253877518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6970002f70 tx=0x7f6970006df0).stop 2021-11-15T14:37:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- 172.21.2.135:0/2253877518 shutdown_connections 2021-11-15T14:37:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 --2- 172.21.2.135:0/2253877518 >> v2:172.21.2.119:3300/0 conn(0x7f69800a7140 0x7f69801447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 --2- 172.21.2.135:0/2253877518 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800b1e30 0x7f69800b1050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- 172.21.2.135:0/2253877518 >> 172.21.2.135:0/2253877518 conn(0x7f698005f730 msgr2=0x7f698005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:43.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- 172.21.2.135:0/2253877518 shutdown_connections 2021-11-15T14:37:43.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- 172.21.2.135:0/2253877518 wait complete. 2021-11-15T14:37:43.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 Processor -- start 2021-11-15T14:37:43.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.852+0000 7f69864c5700 1 -- start start 2021-11-15T14:37:43.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800a7140 0x7f69800aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69800b1e30 0x7f698015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698015a150 con 0x7f69800b1e30 2021-11-15T14:37:43.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800aada0 con 0x7f6980148420 2021-11-15T14:37:43.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980062e70 con 0x7f69800a7140 2021-11-15T14:37:43.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57346/0 (socket says 172.21.2.135:57346) 2021-11-15T14:37:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 -- 172.21.2.135:0/4101083535 learned_addr learned my addr 172.21.2.135:0/4101083535 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697f7fe700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69800b1e30 0x7f698015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697ffff700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800a7140 0x7f69800aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 -- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800a7140 msgr2=0x7f69800aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800a7140 0x7f69800aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 -- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69800b1e30 msgr2=0x7f698015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69800b1e30 0x7f698015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 -- 172.21.2.135:0/4101083535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697000b180 con 0x7f6980148420 2021-11-15T14:37:43.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f6984a62700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f697800c000 tx=0x7f6978009290).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697800c850 con 0x7f6980148420 2021-11-15T14:37:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800c9b0 con 0x7f6980148420 2021-11-15T14:37:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698015a3e0 con 0x7f6980148420 2021-11-15T14:37:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6980062af0 con 0x7f6980148420 2021-11-15T14:37:43.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697800cd10 con 0x7f6980148420 2021-11-15T14:37:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698015a580 con 0x7f6980148420 2021-11-15T14:37:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6978022070 con 0x7f6980148420 2021-11-15T14:37:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 0x7f6964055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f697806c200 con 0x7f6980148420 2021-11-15T14:37:43.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697ffff700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 0x7f6964055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.856+0000 7f697ffff700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 0x7f6964055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f6970018000 tx=0x7f6970014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:43.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.860+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f698015a580 con 0x7f6980148420 2021-11-15T14:37:43.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:43.968+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f69800573d0 con 0x7f6980148420 2021-11-15T14:37:44.693 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:37:44.686+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:37:44.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f697d7fa700 1 -- 172.21.2.135:0/4101083535 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6978016020 con 0x7f6980148420 2021-11-15T14:37:44.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 msgr2=0x7f6964055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 0x7f6964055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f6970018000 tx=0x7f6970014000).stop 2021-11-15T14:37:44.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 msgr2=0x7f69800ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f697800c000 tx=0x7f6978009290).stop 2021-11-15T14:37:44.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 shutdown_connections 2021-11-15T14:37:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69640536a0 0x7f6964055b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6980148420 0x7f69800ab640 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69800b1e30 0x7f698015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 --2- 172.21.2.135:0/4101083535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69800a7140 0x7f69800aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 >> 172.21.2.135:0/4101083535 conn(0x7f698005f730 msgr2=0x7f6980143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:44.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 shutdown_connections 2021-11-15T14:37:44.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.704+0000 7f69864c5700 1 -- 172.21.2.135:0/4101083535 wait complete. 2021-11-15T14:37:44.713 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:37:44.716 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:44.727 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:37:44.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 Processor -- start 2021-11-15T14:37:44.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- start start 2021-11-15T14:37:44.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b30060180 0x7f3b300b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b300b4cc0 0x7f3b3014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300aac30 con 0x7f3b30067380 2021-11-15T14:37:44.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b30060560 con 0x7f3b300b4cc0 2021-11-15T14:37:44.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30066f20 con 0x7f3b30060180 2021-11-15T14:37:44.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b300b4cc0 0x7f3b3014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b300b4cc0 0x7f3b3014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57366/0 (socket says 172.21.2.135:57366) 2021-11-15T14:37:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 -- 172.21.2.135:0/4158057691 learned_addr learned my addr 172.21.2.135:0/4158057691 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 -- 172.21.2.135:0/4158057691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b30060180 msgr2=0x7f3b300b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- 172.21.2.135:0/4158057691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b30060180 0x7f3b300b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 -- 172.21.2.135:0/4158057691 >> v1:172.21.2.119:6789/0 conn(0x7f3b30067380 legacy=0x7f3b30143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 -- 172.21.2.135:0/4158057691 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300b3430 con 0x7f3b300b4cc0 2021-11-15T14:37:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- 172.21.2.135:0/4158057691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b300b4cc0 0x7f3b3014b8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3b30067260 tx=0x7f3b28009290).ready entity=mon.1 client_cookie=ef852b50e1acc03d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2d59a700 1 -- 172.21.2.135:0/4158057691 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2800b860 con 0x7f3b300b4cc0 2021-11-15T14:37:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2d59a700 1 -- 172.21.2.135:0/4158057691 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800b9c0 con 0x7f3b300b4cc0 2021-11-15T14:37:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2d59a700 1 -- 172.21.2.135:0/4158057691 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b2800bb70 con 0x7f3b300b4cc0 2021-11-15T14:37:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/4158057691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b300b4cc0 msgr2=0x7f3b3014b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- 172.21.2.135:0/4158057691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b300b4cc0 0x7f3b3014b8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3b30067260 tx=0x7f3b28009290).stop 2021-11-15T14:37:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/4158057691 shutdown_connections 2021-11-15T14:37:44.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- 172.21.2.135:0/4158057691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b300b4cc0 0x7f3b3014b8d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- 172.21.2.135:0/4158057691 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b30060180 0x7f3b300b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/4158057691 >> 172.21.2.135:0/4158057691 conn(0x7f3b3005cfb0 msgr2=0x7f3b3005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/4158057691 shutdown_connections 2021-11-15T14:37:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/4158057691 wait complete. 2021-11-15T14:37:44.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 Processor -- start 2021-11-15T14:37:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- start start 2021-11-15T14:37:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b30060180 0x7f3b300a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 0x7f3b300aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300ac400 con 0x7f3b30060180 2021-11-15T14:37:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301531b0 con 0x7f3b30067380 2021-11-15T14:37:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30153450 con 0x7f3b300b4cc0 2021-11-15T14:37:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57372/0 (socket says 172.21.2.135:57372) 2021-11-15T14:37:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 -- 172.21.2.135:0/3243167100 learned_addr learned my addr 172.21.2.135:0/3243167100 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 0x7f3b300aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 -- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 msgr2=0x7f3b300aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 0x7f3b300aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2e59c700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b30060180 0x7f3b300a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 -- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b30060180 msgr2=0x7f3b300a3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b30060180 0x7f3b300a3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 -- 172.21.2.135:0/3243167100 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009530 con 0x7f3b30067380 2021-11-15T14:37:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2ed9d700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 0x7f3b300aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b2dd9b700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f3b300ac540 tx=0x7f3b20006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b20013460 con 0x7f3b30067380 2021-11-15T14:37:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200135c0 con 0x7f3b30067380 2021-11-15T14:37:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b300abf60 con 0x7f3b30067380 2021-11-15T14:37:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b20013920 con 0x7f3b30067380 2021-11-15T14:37:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.764+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b300aa790 con 0x7f3b30067380 2021-11-15T14:37:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30153610 con 0x7f3b30067380 2021-11-15T14:37:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b2001a060 con 0x7f3b30067380 2021-11-15T14:37:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b277fe700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 0x7f3b14055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f3b2006b470 con 0x7f3b30067380 2021-11-15T14:37:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b2e59c700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 0x7f3b14055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b2e59c700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 0x7f3b14055a40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3b18007000 tx=0x7f3b18008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.768+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b20042420 con 0x7f3b30067380 2021-11-15T14:37:44.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b300ac0f0 con 0x7f3b30067380 2021-11-15T14:37:44.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b277fe700 1 -- 172.21.2.135:0/3243167100 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2127 (secure 0 0 0) 0x7f3b20018090 con 0x7f3b30067380 2021-11-15T14:37:44.885 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:44.885 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:36:17.138655+0000","modified":"2021-11-15T14:37:44.692871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":48,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-15T14:37:44.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 msgr2=0x7f3b14055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 0x7f3b14055a40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3b18007000 tx=0x7f3b18008040).stop 2021-11-15T14:37:44.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 msgr2=0x7f3b300a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f3b300ac540 tx=0x7f3b20006df0).stop 2021-11-15T14:37:44.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 shutdown_connections 2021-11-15T14:37:44.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b14053580 0x7f3b14055a40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b300b4cc0 0x7f3b300aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b30067380 0x7f3b300a9db0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 --2- 172.21.2.135:0/3243167100 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b30060180 0x7f3b300a3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 >> 172.21.2.135:0/3243167100 conn(0x7f3b3005cfb0 msgr2=0x7f3b30143f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:44.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 shutdown_connections 2021-11-15T14:37:44.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.880+0000 7f3b34862700 1 -- 172.21.2.135:0/3243167100 wait complete. 2021-11-15T14:37:44.889 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 21 2021-11-15T14:37:44.891 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:37:44.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.936+0000 7f993f9de700 1 Processor -- start 2021-11-15T14:37:44.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.936+0000 7f993f9de700 1 -- start start 2021-11-15T14:37:44.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99380b2c80 0x7f99380b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9938139c40 con 0x7f99380acad0 2021-11-15T14:37:44.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9938140580 con 0x7f99380b2c80 2021-11-15T14:37:44.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b01b0 con 0x7f99380a9650 2021-11-15T14:37:44.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f99380acad0 0x7f99380a8aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44966/0 (socket says 172.21.2.135:44966) 2021-11-15T14:37:44.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 -- 172.21.2.135:0/2263639146 learned_addr learned my addr 172.21.2.135:0/2263639146 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:44.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 --2- 172.21.2.135:0/2263639146 >> v2:172.21.2.135:3300/0 conn(0x7f99380b2c80 0x7f99380b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 -- 172.21.2.135:0/2263639146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 msgr2=0x7f99380a9a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:44.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 --2- 172.21.2.135:0/2263639146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380a9a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 -- 172.21.2.135:0/2263639146 >> v1:172.21.2.135:6789/0 conn(0x7f99380acad0 legacy=0x7f99380a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 -- 172.21.2.135:0/2263639146 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380b0450 con 0x7f99380b2c80 2021-11-15T14:37:44.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993df7b700 1 --2- 172.21.2.135:0/2263639146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380b2c80 0x7f99380b2080 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f9934002f70 tx=0x7f9934006df0).ready entity=mon.1 client_cookie=56f79ca9d8bfa6f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992ffff700 1 -- 172.21.2.135:0/2263639146 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993400d570 con 0x7f99380b2c80 2021-11-15T14:37:44.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992ffff700 1 -- 172.21.2.135:0/2263639146 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934000e90 con 0x7f99380b2c80 2021-11-15T14:37:44.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992ffff700 1 -- 172.21.2.135:0/2263639146 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993400d900 con 0x7f99380b2c80 2021-11-15T14:37:44.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/2263639146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380b2c80 msgr2=0x7f99380b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:44.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- 172.21.2.135:0/2263639146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380b2c80 0x7f99380b2080 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f9934002f70 tx=0x7f9934006df0).stop 2021-11-15T14:37:44.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/2263639146 shutdown_connections 2021-11-15T14:37:44.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- 172.21.2.135:0/2263639146 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380b2c80 0x7f99380b2080 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:44.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- 172.21.2.135:0/2263639146 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/2263639146 >> 172.21.2.135:0/2263639146 conn(0x7f993805f730 msgr2=0x7f993805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:44.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/2263639146 shutdown_connections 2021-11-15T14:37:44.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/2263639146 wait complete. 2021-11-15T14:37:44.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 Processor -- start 2021-11-15T14:37:44.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- start start 2021-11-15T14:37:44.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99380b2c80 0x7f99380aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b56d0 con 0x7f99380b2c80 2021-11-15T14:37:44.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380abc70 con 0x7f99380acad0 2021-11-15T14:37:44.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b4a80 con 0x7f99380a9650 2021-11-15T14:37:44.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57386/0 (socket says 172.21.2.135:57386) 2021-11-15T14:37:44.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 -- 172.21.2.135:0/3726762922 learned_addr learned my addr 172.21.2.135:0/3726762922 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:44.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 -- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 msgr2=0x7f99380b6190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:44.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380b6190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 -- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99380b2c80 msgr2=0x7f99380aacf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:44.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99380b2c80 0x7f99380aacf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:44.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 -- 172.21.2.135:0/3726762922 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993400b180 con 0x7f99380acad0 2021-11-15T14:37:44.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993cf79700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f993812d410 tx=0x7f9928007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992800ce20 con 0x7f99380acad0 2021-11-15T14:37:44.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99280072e0 con 0x7f99380acad0 2021-11-15T14:37:44.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380ab9d0 con 0x7f99380acad0 2021-11-15T14:37:44.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380ab6e0 con 0x7f99380acad0 2021-11-15T14:37:44.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.940+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9928005800 con 0x7f99380acad0 2021-11-15T14:37:44.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938140210 con 0x7f99380acad0 2021-11-15T14:37:44.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9928010070 con 0x7f99380acad0 2021-11-15T14:37:44.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f992e7fc700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 0x7f9920055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:44.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f992806b260 con 0x7f99380acad0 2021-11-15T14:37:44.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f993d77a700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 0x7f9920055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:44.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f993d77a700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 0x7f9920055bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9930003330 tx=0x7f9930006cb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:44.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:44.944+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9928042100 con 0x7f99380acad0 2021-11-15T14:37:45.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.056+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f99380573d0 con 0x7f99380acad0 2021-11-15T14:37:45.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.708+0000 7f992e7fc700 1 -- 172.21.2.135:0/3726762922 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9928045720 con 0x7f99380acad0 2021-11-15T14:37:45.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 msgr2=0x7f9920055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 0x7f9920055bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9930003330 tx=0x7f9930006cb0).stop 2021-11-15T14:37:45.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 msgr2=0x7f99380ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f993812d410 tx=0x7f9928007c10).stop 2021-11-15T14:37:45.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 shutdown_connections 2021-11-15T14:37:45.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99200536f0 0x7f9920055bb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:45.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99380b2c80 0x7f99380aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99380acad0 0x7f99380ae6e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:45.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 --2- 172.21.2.135:0/3726762922 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99380a9650 0x7f99380b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 >> 172.21.2.135:0/3726762922 conn(0x7f993805f730 msgr2=0x7f993805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:45.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 shutdown_connections 2021-11-15T14:37:45.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.712+0000 7f993f9de700 1 -- 172.21.2.135:0/3726762922 wait complete. 2021-11-15T14:37:45.722 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:37:45.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 Processor -- start 2021-11-15T14:37:45.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- start start 2021-11-15T14:37:45.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa2e80b1e30 0x7fa2e80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e8148420 0x7fa2e80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80b03d0 con 0x7fa2e80a7140 2021-11-15T14:37:45.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e80a9140 con 0x7fa2e80b1e30 2021-11-15T14:37:45.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b0670 con 0x7fa2e8148420 2021-11-15T14:37:45.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa2e80a7140 0x7fa2e81447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44978/0 (socket says 172.21.2.135:44978) 2021-11-15T14:37:45.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 -- 172.21.2.135:0/1930875080 learned_addr learned my addr 172.21.2.135:0/1930875080 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:45.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 --2- 172.21.2.135:0/1930875080 >> v2:172.21.2.135:3300/0 conn(0x7fa2e80b1e30 0x7fa2e80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:45.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2dbfff700 1 -- 172.21.2.135:0/1930875080 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712610832 0 0) 0x7fa2e80b03d0 con 0x7fa2e80a7140 2021-11-15T14:37:45.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2dbfff700 1 -- 172.21.2.135:0/1930875080 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d0003260 con 0x7fa2e80a7140 2021-11-15T14:37:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 -- 172.21.2.135:0/1930875080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e8148420 msgr2=0x7fa2e80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 --2- 172.21.2.135:0/1930875080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e8148420 0x7fa2e80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 -- 172.21.2.135:0/1930875080 >> v1:172.21.2.135:6789/0 conn(0x7fa2e80a7140 legacy=0x7fa2e81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 -- 172.21.2.135:0/1930875080 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80b0910 con 0x7fa2e80b1e30 2021-11-15T14:37:45.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ed35b700 1 --2- 172.21.2.135:0/1930875080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e80b1e30 0x7fa2e80b1050 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc006df0).ready entity=mon.1 client_cookie=4aadf35b99d17e26 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2dbfff700 1 -- 172.21.2.135:0/1930875080 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00d570 con 0x7fa2e80b1e30 2021-11-15T14:37:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2dbfff700 1 -- 172.21.2.135:0/1930875080 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc000e90 con 0x7fa2e80b1e30 2021-11-15T14:37:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2dbfff700 1 -- 172.21.2.135:0/1930875080 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00d8c0 con 0x7fa2e80b1e30 2021-11-15T14:37:45.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1930875080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e80b1e30 msgr2=0x7fa2e80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1930875080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e80b1e30 0x7fa2e80b1050 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc006df0).stop 2021-11-15T14:37:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1930875080 shutdown_connections 2021-11-15T14:37:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1930875080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e8148420 0x7fa2e80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1930875080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e80b1e30 0x7fa2e80b1050 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:45.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1930875080 >> 172.21.2.135:0/1930875080 conn(0x7fa2e805f730 msgr2=0x7fa2e805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1930875080 shutdown_connections 2021-11-15T14:37:45.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1930875080 wait complete. 2021-11-15T14:37:45.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 Processor -- start 2021-11-15T14:37:45.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- start start 2021-11-15T14:37:45.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2e80a7140 0x7fa2e80ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e80b1e30 0x7fa2e815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8063e20 con 0x7fa2e80a7140 2021-11-15T14:37:45.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e815ad00 con 0x7fa2e8148420 2021-11-15T14:37:45.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2ef5bf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80aa0a0 con 0x7fa2e80b1e30 2021-11-15T14:37:45.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:45.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57400/0 (socket says 172.21.2.135:57400) 2021-11-15T14:37:45.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 -- 172.21.2.135:0/1353133772 learned_addr learned my addr 172.21.2.135:0/1353133772 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:45.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 -- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e80b1e30 msgr2=0x7fa2e815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e80b1e30 0x7fa2e815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 -- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2e80a7140 msgr2=0x7fa2e80ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:45.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2e80a7140 0x7fa2e80ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:45.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 -- 172.21.2.135:0/1353133772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc00b180 con 0x7fa2e8148420 2021-11-15T14:37:45.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2edb5c700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa2e0001490 tx=0x7fa2e0007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:45.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e0005ba0 con 0x7fa2e8148420 2021-11-15T14:37:45.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0005d00 con 0x7fa2e8148420 2021-11-15T14:37:45.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.772+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e00072c0 con 0x7fa2e8148420 2021-11-15T14:37:45.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e8159e30 con 0x7fa2e8148420 2021-11-15T14:37:45.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e815a370 con 0x7fa2e8148420 2021-11-15T14:37:45.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e815a530 con 0x7fa2e8148420 2021-11-15T14:37:45.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2e0010070 con 0x7fa2e8148420 2021-11-15T14:37:45.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2da7fc700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 0x7fa2c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:45.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa2e006b720 con 0x7fa2e8148420 2021-11-15T14:37:45.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2ed35b700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 0x7fa2c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:45.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2ed35b700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 0x7fa2c8055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:45.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.776+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2e0042540 con 0x7fa2e8148420 2021-11-15T14:37:45.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:45.864+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2e80b0bb0 con 0x7fa2e8148420 2021-11-15T14:37:46.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2da7fc700 1 -- 172.21.2.135:0/1353133772 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa2e0045b60 con 0x7fa2e8148420 2021-11-15T14:37:46.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 msgr2=0x7fa2c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 0x7fa2c8055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc014000).stop 2021-11-15T14:37:46.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 msgr2=0x7fa2e80aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa2e0001490 tx=0x7fa2e0007e00).stop 2021-11-15T14:37:46.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 shutdown_connections 2021-11-15T14:37:46.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa2c8053610 0x7fa2c8055ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:46.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa2e8148420 0x7fa2e80aa570 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:46.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa2e80b1e30 0x7fa2e815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 --2- 172.21.2.135:0/1353133772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa2e80a7140 0x7fa2e80ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 >> 172.21.2.135:0/1353133772 conn(0x7fa2e805f730 msgr2=0x7fa2e80af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:46.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 shutdown_connections 2021-11-15T14:37:46.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.716+0000 7fa2ef5bf700 1 -- 172.21.2.135:0/1353133772 wait complete. 2021-11-15T14:37:46.724 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:37:46.727 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:37:46.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 Processor -- start 2021-11-15T14:37:46.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- start start 2021-11-15T14:37:46.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35c40b6600 0x7f35c40b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f35c40b4440 0x7f35c40b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c4144130 con 0x7f35c4061db0 2021-11-15T14:37:46.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40b6ed0 con 0x7f35c40b4440 2021-11-15T14:37:46.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c4143bf0 con 0x7f35c40b6600 2021-11-15T14:37:46.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f35c40b6600 0x7f35c40b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:46.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f35c4061db0 0x7f35c4146740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:44992/0 (socket says 172.21.2.135:44992) 2021-11-15T14:37:46.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c37fe700 1 -- 172.21.2.135:0/1884001447 learned_addr learned my addr 172.21.2.135:0/1884001447 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:46.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 -- 172.21.2.135:0/1884001447 >> v2:172.21.2.119:3300/0 conn(0x7f35c40b4440 msgr2=0x7f35c40b69e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:46.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 --2- 172.21.2.135:0/1884001447 >> v2:172.21.2.119:3300/0 conn(0x7f35c40b4440 0x7f35c40b69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 -- 172.21.2.135:0/1884001447 >> v1:172.21.2.135:6789/0 conn(0x7f35c4061db0 legacy=0x7f35c4146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 -- 172.21.2.135:0/1884001447 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4143e90 con 0x7f35c40b6600 2021-11-15T14:37:46.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c2ffd700 1 --2- 172.21.2.135:0/1884001447 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c40b6600 0x7f35c40b5c70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f35bc001490 tx=0x7f35ac006df0).ready entity=mon.1 client_cookie=32f386a7584d5a7b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:46.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c1ffb700 1 -- 172.21.2.135:0/1884001447 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac00d4a0 con 0x7f35c40b6600 2021-11-15T14:37:46.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c1ffb700 1 -- 172.21.2.135:0/1884001447 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac000e90 con 0x7f35c40b6600 2021-11-15T14:37:46.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c1ffb700 1 -- 172.21.2.135:0/1884001447 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac00d7f0 con 0x7f35c40b6600 2021-11-15T14:37:46.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- 172.21.2.135:0/1884001447 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c40b6600 msgr2=0x7f35c40b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 --2- 172.21.2.135:0/1884001447 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c40b6600 0x7f35c40b5c70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f35bc001490 tx=0x7f35ac006df0).stop 2021-11-15T14:37:46.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- 172.21.2.135:0/1884001447 shutdown_connections 2021-11-15T14:37:46.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 --2- 172.21.2.135:0/1884001447 >> v2:172.21.2.119:3300/0 conn(0x7f35c40b4440 0x7f35c40b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 --2- 172.21.2.135:0/1884001447 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c40b6600 0x7f35c40b5c70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:46.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- 172.21.2.135:0/1884001447 >> 172.21.2.135:0/1884001447 conn(0x7f35c405c510 msgr2=0x7f35c405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:46.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- 172.21.2.135:0/1884001447 shutdown_connections 2021-11-15T14:37:46.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- 172.21.2.135:0/1884001447 wait complete. 2021-11-15T14:37:46.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 Processor -- start 2021-11-15T14:37:46.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.776+0000 7f35c935c700 1 -- start start 2021-11-15T14:37:46.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35c40b4440 0x7f35c40b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35c40b6600 0x7f35c40b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40aecb0 con 0x7f35c40b4440 2021-11-15T14:37:46.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40af9f0 con 0x7f35c4061db0 2021-11-15T14:37:46.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40aeee0 con 0x7f35c40b6600 2021-11-15T14:37:46.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:46.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57412/0 (socket says 172.21.2.135:57412) 2021-11-15T14:37:46.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 -- 172.21.2.135:0/3957193638 learned_addr learned my addr 172.21.2.135:0/3957193638 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:46.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 -- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35c40b6600 msgr2=0x7f35c40b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35c40b6600 0x7f35c40b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 -- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35c40b4440 msgr2=0x7f35c40b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:46.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35c40b4440 0x7f35c40b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:46.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 -- 172.21.2.135:0/3957193638 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac00b180 con 0x7f35c4061db0 2021-11-15T14:37:46.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c2ffd700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f35bc001490 tx=0x7f35ac014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac013c30 con 0x7f35c4061db0 2021-11-15T14:37:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac013d90 con 0x7f35c4061db0 2021-11-15T14:37:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c40af180 con 0x7f35c4061db0 2021-11-15T14:37:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac01e5f0 con 0x7f35c4061db0 2021-11-15T14:37:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40af5c0 con 0x7f35c4061db0 2021-11-15T14:37:46.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4061670 con 0x7f35c4061db0 2021-11-15T14:37:46.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35ac025030 con 0x7f35c4061db0 2021-11-15T14:37:46.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:46.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f35ac06c880 con 0x7f35c4061db0 2021-11-15T14:37:46.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c27fc700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:46.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.780+0000 7f35c27fc700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 0x7f35a8055a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f35b4002fb0 tx=0x7f35b40069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:46.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.784+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35ac043a70 con 0x7f35c4061db0 2021-11-15T14:37:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:46.864+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35c40afb30 con 0x7f35c4061db0 2021-11-15T14:37:47.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.724+0000 7f35bbfff700 1 -- 172.21.2.135:0/3957193638 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 173+0+0 (secure 0 0 0) 0x7f35ac023020 con 0x7f35c4061db0 2021-11-15T14:37:47.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 msgr2=0x7f35a8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 0x7f35a8055a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f35b4002fb0 tx=0x7f35b40069b0).stop 2021-11-15T14:37:47.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 msgr2=0x7f35c412bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f35bc001490 tx=0x7f35ac014000).stop 2021-11-15T14:37:47.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 shutdown_connections 2021-11-15T14:37:47.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f35c40b6600 0x7f35c40b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:47.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f35c40b4440 0x7f35c40b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:47.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 --2- 172.21.2.135:0/3957193638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f35c4061db0 0x7f35c412bd20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 >> 172.21.2.135:0/3957193638 conn(0x7f35c405c510 msgr2=0x7f35c4141010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:47.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 shutdown_connections 2021-11-15T14:37:47.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.728+0000 7f35c935c700 1 -- 172.21.2.135:0/3957193638 wait complete. 2021-11-15T14:37:47.736 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:37:47.739 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:37:47.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 Processor -- start 2021-11-15T14:37:47.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 -- start start 2021-11-15T14:37:47.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8d580a9f40 0x7f8d580aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d58060450 0x7f8d5813cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d58061a10 con 0x7f8d5813d240 2021-11-15T14:37:47.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d58061cb0 con 0x7f8d580a9f40 2021-11-15T14:37:47.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5e8b6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58060c10 con 0x7f8d58060450 2021-11-15T14:37:47.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d57fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8d580a9f40 0x7f8d580aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d577fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d58060450 0x7f8d5813cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d57fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8d580a9f40 0x7f8d580aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51232/0 (socket says 172.21.2.135:51232) 2021-11-15T14:37:47.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d5ce53700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f8d5813d240 0x7f8d5813f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:54422/0 (socket says 172.21.2.135:54422) 2021-11-15T14:37:47.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.788+0000 7f8d57fff700 1 -- 172.21.2.135:0/579799215 learned_addr learned my addr 172.21.2.135:0/579799215 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:47.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 -- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d58060450 msgr2=0x7f8d5813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:47.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 --2- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d58060450 0x7f8d5813cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 -- 172.21.2.135:0/579799215 >> v1:172.21.2.119:6789/0 conn(0x7f8d5813d240 legacy=0x7f8d5813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 -- 172.21.2.135:0/579799215 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58060eb0 con 0x7f8d580a9f40 2021-11-15T14:37:47.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 --2- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d580a9f40 0x7f8d580aa320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8d5805f8f0 tx=0x7f8d48006eb0).ready entity=mon.0 client_cookie=a7fb40f620e4767 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d56ffd700 1 -- 172.21.2.135:0/579799215 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4800d5c0 con 0x7f8d580a9f40 2021-11-15T14:37:47.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d56ffd700 1 -- 172.21.2.135:0/579799215 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48000e90 con 0x7f8d580a9f40 2021-11-15T14:37:47.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d56ffd700 1 -- 172.21.2.135:0/579799215 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4800d950 con 0x7f8d580a9f40 2021-11-15T14:37:47.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d580a9f40 msgr2=0x7f8d580aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d580a9f40 0x7f8d580aa320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8d5805f8f0 tx=0x7f8d48006eb0).stop 2021-11-15T14:37:47.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/579799215 shutdown_connections 2021-11-15T14:37:47.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d58060450 0x7f8d5813cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/579799215 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d580a9f40 0x7f8d580aa320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/579799215 >> 172.21.2.135:0/579799215 conn(0x7f8d580b29f0 msgr2=0x7f8d580b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:47.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/579799215 shutdown_connections 2021-11-15T14:37:47.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/579799215 wait complete. 2021-11-15T14:37:47.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 Processor -- start 2021-11-15T14:37:47.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- start start 2021-11-15T14:37:47.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 0x7f8d580af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 0x7f8d58150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5813d9c0 con 0x7f8d58060450 2021-11-15T14:37:47.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5813de20 con 0x7f8d5813d240 2021-11-15T14:37:47.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5813e0c0 con 0x7f8d580a9f40 2021-11-15T14:37:47.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57428/0 (socket says 172.21.2.135:57428) 2021-11-15T14:37:47.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 -- 172.21.2.135:0/268157170 learned_addr learned my addr 172.21.2.135:0/268157170 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:47.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 0x7f8d580af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d577fe700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 0x7f8d58150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 -- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 msgr2=0x7f8d58150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 0x7f8d58150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 -- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 msgr2=0x7f8d580af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 0x7f8d580af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 -- 172.21.2.135:0/268157170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4800b1e0 con 0x7f8d5813d240 2021-11-15T14:37:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d57fff700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 0x7f8d580af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:37:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d577fe700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 0x7f8d58150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:37:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5ce53700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f8d5805fe10 tx=0x7f8d50007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d50005ae0 con 0x7f8d5813d240 2021-11-15T14:37:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50005c40 con 0x7f8d5813d240 2021-11-15T14:37:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5813e360 con 0x7f8d5813d240 2021-11-15T14:37:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d500070d0 con 0x7f8d5813d240 2021-11-15T14:37:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.792+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5813d6b0 con 0x7f8d5813d240 2021-11-15T14:37:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d58061150 con 0x7f8d5813d240 2021-11-15T14:37:47.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d5001a060 con 0x7f8d5813d240 2021-11-15T14:37:47.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d557fa700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 0x7f8d3c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8d5006b320 con 0x7f8d5813d240 2021-11-15T14:37:47.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d57fff700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 0x7f8d3c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d57fff700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 0x7f8d3c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f8d4801a000 tx=0x7f8d48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.796+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d500424f0 con 0x7f8d5813d240 2021-11-15T14:37:47.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.880+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8d580573d0 con 0x7f8d5813d240 2021-11-15T14:37:47.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d557fa700 1 -- 172.21.2.135:0/268157170 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8d500180a0 con 0x7f8d5813d240 2021-11-15T14:37:47.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 msgr2=0x7f8d3c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 0x7f8d3c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f8d4801a000 tx=0x7f8d48015000).stop 2021-11-15T14:37:47.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 msgr2=0x7f8d581513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f8d5805fe10 tx=0x7f8d50007f70).stop 2021-11-15T14:37:47.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 shutdown_connections 2021-11-15T14:37:47.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d3c053580 0x7f8d3c055a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d5813d240 0x7f8d581513c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d580a9f40 0x7f8d58150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 --2- 172.21.2.135:0/268157170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d58060450 0x7f8d580af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 >> 172.21.2.135:0/268157170 conn(0x7f8d580b29f0 msgr2=0x7f8d580b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:47.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 shutdown_connections 2021-11-15T14:37:47.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.896+0000 7f8d5e8b6700 1 -- 172.21.2.135:0/268157170 wait complete. 2021-11-15T14:37:47.907 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-15T14:37:47.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 Processor -- start 2021-11-15T14:37:47.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 -- start start 2021-11-15T14:37:47.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f69dc0ad1d0 0x7f69dc0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0ac3f0 con 0x7f69dc0aa8e0 2021-11-15T14:37:47.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0aacc0 con 0x7f69dc0a9e20 2021-11-15T14:37:47.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e2e43700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc0abbd0 con 0x7f69dc0ad1d0 2021-11-15T14:37:47.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e13e0700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f69dc0a9e20 0x7f69dc1403c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45022/0 (socket says 172.21.2.135:45022) 2021-11-15T14:37:47.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69e13e0700 1 -- 172.21.2.135:0/4051550043 learned_addr learned my addr 172.21.2.135:0/4051550043 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:47.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69dbfff700 1 --2- 172.21.2.135:0/4051550043 >> v2:172.21.2.135:3300/0 conn(0x7f69dc0ad1d0 0x7f69dc0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69db7fe700 1 -- 172.21.2.135:0/4051550043 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740490609 0 0) 0x7f69dc0aacc0 con 0x7f69dc0a9e20 2021-11-15T14:37:47.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.952+0000 7f69db7fe700 1 -- 172.21.2.135:0/4051550043 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69bc003260 con 0x7f69dc0a9e20 2021-11-15T14:37:47.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 -- 172.21.2.135:0/4051550043 >> v1:172.21.2.135:6789/0 conn(0x7f69dc0a9e20 legacy=0x7f69dc1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 -- 172.21.2.135:0/4051550043 >> v1:172.21.2.119:6789/0 conn(0x7f69dc0aa8e0 legacy=0x7f69dc0acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:47.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 -- 172.21.2.135:0/4051550043 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0b1730 con 0x7f69dc0ad1d0 2021-11-15T14:37:47.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 --2- 172.21.2.135:0/4051550043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc0ad1d0 0x7f69dc0b1240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f69dc0b2e90 tx=0x7f69c4006df0).ready entity=mon.1 client_cookie=9ad382527cd64db4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69db7fe700 1 -- 172.21.2.135:0/4051550043 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c400d5c0 con 0x7f69dc0ad1d0 2021-11-15T14:37:47.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69db7fe700 1 -- 172.21.2.135:0/4051550043 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4000e90 con 0x7f69dc0ad1d0 2021-11-15T14:37:47.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69db7fe700 1 -- 172.21.2.135:0/4051550043 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c400d910 con 0x7f69dc0ad1d0 2021-11-15T14:37:47.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/4051550043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc0ad1d0 msgr2=0x7f69dc0b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 --2- 172.21.2.135:0/4051550043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc0ad1d0 0x7f69dc0b1240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f69dc0b2e90 tx=0x7f69c4006df0).stop 2021-11-15T14:37:47.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/4051550043 shutdown_connections 2021-11-15T14:37:47.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 --2- 172.21.2.135:0/4051550043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc0ad1d0 0x7f69dc0b1240 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/4051550043 >> 172.21.2.135:0/4051550043 conn(0x7f69dc0b6550 msgr2=0x7f69dc0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:47.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/4051550043 shutdown_connections 2021-11-15T14:37:47.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/4051550043 wait complete. 2021-11-15T14:37:47.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 Processor -- start 2021-11-15T14:37:47.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- start start 2021-11-15T14:37:47.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 0x7f69dc064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 0x7f69dc065720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc066f50 con 0x7f69dc0aa8e0 2021-11-15T14:37:47.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc09fa70 con 0x7f69dc064810 2021-11-15T14:37:47.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc09fd10 con 0x7f69dc0a9e20 2021-11-15T14:37:47.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57442/0 (socket says 172.21.2.135:57442) 2021-11-15T14:37:47.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 -- 172.21.2.135:0/2831794737 learned_addr learned my addr 172.21.2.135:0/2831794737 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:47.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 0x7f69dc065720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 -- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 msgr2=0x7f69dc064320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e0bdf700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 0x7f69dc064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 0x7f69dc064320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 -- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 msgr2=0x7f69dc065720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:47.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 0x7f69dc065720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:47.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 -- 172.21.2.135:0/2831794737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c400b180 con 0x7f69dc064810 2021-11-15T14:37:47.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e0bdf700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 0x7f69dc064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:47.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69dbfff700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 0x7f69dc065720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:37:47.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e13e0700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f69d4001490 tx=0x7f69d4007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d4005ba0 con 0x7f69dc064810 2021-11-15T14:37:47.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4005d00 con 0x7f69dc064810 2021-11-15T14:37:47.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d40072c0 con 0x7f69dc064810 2021-11-15T14:37:47.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc09ffb0 con 0x7f69dc064810 2021-11-15T14:37:47.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.956+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc063760 con 0x7f69dc064810 2021-11-15T14:37:47.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc0b19c0 con 0x7f69dc064810 2021-11-15T14:37:47.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69d4010070 con 0x7f69dc064810 2021-11-15T14:37:47.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69d9ffb700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 0x7f69c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:47.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f69d406b310 con 0x7f69dc064810 2021-11-15T14:37:47.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69e0bdf700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 0x7f69c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:47.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69e0bdf700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 0x7f69c0055b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f69cc007000 tx=0x7f69cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:47.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:47.960+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69d4042550 con 0x7f69dc064810 2021-11-15T14:37:48.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.072+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f69dc0a0450 con 0x7f69dc064810 2021-11-15T14:37:48.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.736+0000 7f69d9ffb700 1 -- 172.21.2.135:0/2831794737 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v147) v1 ==== 144+0+0 (secure 0 0 0) 0x7f69dc0a0450 con 0x7f69dc064810 2021-11-15T14:37:48.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 msgr2=0x7f69c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 0x7f69c0055b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f69cc007000 tx=0x7f69cc008040).stop 2021-11-15T14:37:48.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 msgr2=0x7f69dc065c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f69d4001490 tx=0x7f69d4007e00).stop 2021-11-15T14:37:48.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 shutdown_connections 2021-11-15T14:37:48.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69c00536a0 0x7f69c0055b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69dc064810 0x7f69dc065c10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69dc0aa8e0 0x7f69dc065720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 --2- 172.21.2.135:0/2831794737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69dc0a9e20 0x7f69dc064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 >> 172.21.2.135:0/2831794737 conn(0x7f69dc0b6550 msgr2=0x7f69dc13c820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:48.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 shutdown_connections 2021-11-15T14:37:48.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.740+0000 7f69e2e43700 1 -- 172.21.2.135:0/2831794737 wait complete. 2021-11-15T14:37:48.751 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T14:37:48.751 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T14:37:48.752 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-15T14:37:48.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 Processor -- start 2021-11-15T14:37:48.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 -- start start 2021-11-15T14:37:48.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0aa81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80b03d0 con 0x7f0aa80b1e30 2021-11-15T14:37:48.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80b0670 con 0x7f0aa8148420 2021-11-15T14:37:48.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aad5db700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80a9140 con 0x7f0aa80b1050 2021-11-15T14:37:48.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aa67fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0aa8148420 0x7f0aa80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45034/0 (socket says 172.21.2.135:45034) 2021-11-15T14:37:48.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.804+0000 7f0aa67fc700 1 -- 172.21.2.135:0/3333927424 learned_addr learned my addr 172.21.2.135:0/3333927424 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355221539 0 0) 0x7f0aa80b0670 con 0x7f0aa8148420 2021-11-15T14:37:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a88003260 con 0x7f0aa8148420 2021-11-15T14:37:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3574918759 0 0) 0x7f0a88003260 con 0x7f0aa8148420 2021-11-15T14:37:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 msgr2=0x7f0aa81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:48.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0aa81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 >> v1:172.21.2.119:6789/0 conn(0x7f0aa80b1e30 legacy=0x7f0aa80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80b0910 con 0x7f0aa8148420 2021-11-15T14:37:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0a98001660 con 0x7f0aa8148420 2021-11-15T14:37:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 >> v1:172.21.2.135:6789/0 conn(0x7f0aa8148420 legacy=0x7f0aa80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0a88003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a88004500 0x7f0a88004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0a8800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a88005260 con 0x7f0a88004500 2021-11-15T14:37:48.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880053d0 con 0x7f0a88003800 2021-11-15T14:37:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8800bcc0 con 0x7f0aa80b1050 2021-11-15T14:37:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0a88003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa67fc700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a88004500 0x7f0a88004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 msgr2=0x7f0a8800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:48.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa77fe700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0a8800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0a8800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a88004500 msgr2=0x7f0a88004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a88004500 0x7f0a88004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3333927424 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88003260 con 0x7f0a88003800 2021-11-15T14:37:48.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa67fc700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a88004500 0x7f0a88004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa77fe700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80b1050 0x7f0a8800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0a88003c00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f0a90000f70 tx=0x7f0a900079e0).ready entity=mon.1 client_cookie=ff482b58390ea913 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90007cf0 con 0x7f0a88003800 2021-11-15T14:37:48.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90014410 con 0x7f0a88003800 2021-11-15T14:37:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa5ffb700 1 -- 172.21.2.135:0/3333927424 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90014770 con 0x7f0a88003800 2021-11-15T14:37:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- 172.21.2.135:0/3333927424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 msgr2=0x7f0a88003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3333927424 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0a88003c00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f0a90000f70 tx=0x7f0a900079e0).stop 2021-11-15T14:37:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa77fe700 1 -- 172.21.2.135:0/3333927424 reap_dead start 2021-11-15T14:37:48.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- 172.21.2.135:0/3333927424 shutdown_connections 2021-11-15T14:37:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- 172.21.2.135:0/3333927424 >> 172.21.2.135:0/3333927424 conn(0x7f0aa805f730 msgr2=0x7f0aa805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- 172.21.2.135:0/3333927424 shutdown_connections 2021-11-15T14:37:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- 172.21.2.135:0/3333927424 wait complete. 2021-11-15T14:37:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 Processor -- start 2021-11-15T14:37:48.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- start start 2021-11-15T14:37:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80ac680 0x7f0aa80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa8159e20 0x7f0aa8143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80ab9d0 con 0x7f0aa8159e20 2021-11-15T14:37:48.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80abf40 con 0x7f0a88003800 2021-11-15T14:37:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aad5db700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80ac1e0 con 0x7f0aa80ac680 2021-11-15T14:37:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57458/0 (socket says 172.21.2.135:57458) 2021-11-15T14:37:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.808+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3978740069 learned_addr learned my addr 172.21.2.135:0/3978740069 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:48.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80ac680 msgr2=0x7f0aa80ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80ac680 0x7f0aa80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:48.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa8159e20 msgr2=0x7f0aa8143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:48.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa8159e20 0x7f0aa8143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:48.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 -- 172.21.2.135:0/3978740069 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80ab620 con 0x7f0a88003800 2021-11-15T14:37:48.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa6ffd700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f0a90000f70 tx=0x7f0a90015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:48.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90013840 con 0x7f0a88003800 2021-11-15T14:37:48.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900139a0 con 0x7f0a88003800 2021-11-15T14:37:48.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa814ba80 con 0x7f0a88003800 2021-11-15T14:37:48.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90013d00 con 0x7f0a88003800 2021-11-15T14:37:48.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa815a440 con 0x7f0a88003800 2021-11-15T14:37:48.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa80ac3a0 con 0x7f0a88003800 2021-11-15T14:37:48.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a90022470 con 0x7f0a88003800 2021-11-15T14:37:48.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 0x7f0a8c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:48.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0a9001c040 con 0x7f0a88003800 2021-11-15T14:37:48.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa67fc700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 0x7f0a8c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:48.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.812+0000 7f0aa67fc700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 0x7f0a8c055b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0a98008000 tx=0x7f0a98009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:48.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.816+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a90043fa0 con 0x7f0a88003800 2021-11-15T14:37:48.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:48.928+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f0aa80573d0 con 0x7f0a88003800 2021-11-15T14:37:49.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.740+0000 7f0a9ffff700 1 -- 172.21.2.135:0/3978740069 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v148) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0a90047580 con 0x7f0a88003800 2021-11-15T14:37:49.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 msgr2=0x7f0a8c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:49.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 0x7f0a8c055b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0a98008000 tx=0x7f0a98009040).stop 2021-11-15T14:37:49.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 msgr2=0x7f0aa80a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:49.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f0a90000f70 tx=0x7f0a90015000).stop 2021-11-15T14:37:49.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 shutdown_connections 2021-11-15T14:37:49.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a8c053690 0x7f0a8c055b50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:49.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa8159e20 0x7f0aa8143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa80ac680 0x7f0aa80ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 --2- 172.21.2.135:0/3978740069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a88003800 0x7f0aa80a9800 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:49.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 >> 172.21.2.135:0/3978740069 conn(0x7f0aa805f730 msgr2=0x7f0aa80b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:49.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 shutdown_connections 2021-11-15T14:37:49.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.744+0000 7f0aad5db700 1 -- 172.21.2.135:0/3978740069 wait complete. 2021-11-15T14:37:49.756 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:37:49.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 Processor -- start 2021-11-15T14:37:49.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 -- start start 2021-11-15T14:37:49.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b1f40 0x7f2bdc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b0030 0x7f2bdc0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0a7140 0x7f2bdc1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0b04a0 con 0x7f2bdc0b1f40 2021-11-15T14:37:49.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0b2810 con 0x7f2bdc0b0030 2021-11-15T14:37:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2be1bec700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0b06d0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b0030 0x7f2bdc0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b0030 0x7f2bdc0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57472/0 (socket says 172.21.2.135:57472) 2021-11-15T14:37:49.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 -- 172.21.2.135:0/3040236377 learned_addr learned my addr 172.21.2.135:0/3040236377 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:49.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 -- 172.21.2.135:0/3040236377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0a7140 msgr2=0x7f2bdc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:49.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 --2- 172.21.2.135:0/3040236377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0a7140 0x7f2bdc1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 -- 172.21.2.135:0/3040236377 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b1f40 msgr2=0x7f2bdc0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:49.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 --2- 172.21.2.135:0/3040236377 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b1f40 0x7f2bdc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 -- 172.21.2.135:0/3040236377 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0b0970 con 0x7f2bdc0b0030 2021-11-15T14:37:49.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bdaffd700 1 --2- 172.21.2.135:0/3040236377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b0030 0x7f2bdc0b2320 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0006eb0).ready entity=mon.1 client_cookie=b8179409c794b2ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:49.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.804+0000 7f2bda7fc700 1 -- 172.21.2.135:0/3040236377 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd000d570 con 0x7f2bdc0b0030 2021-11-15T14:37:49.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bda7fc700 1 -- 172.21.2.135:0/3040236377 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0000e90 con 0x7f2bdc0b0030 2021-11-15T14:37:49.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bda7fc700 1 -- 172.21.2.135:0/3040236377 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd000d900 con 0x7f2bdc0b0030 2021-11-15T14:37:49.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3040236377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b0030 msgr2=0x7f2bdc0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:49.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3040236377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b0030 0x7f2bdc0b2320 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0006eb0).stop 2021-11-15T14:37:49.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3040236377 shutdown_connections 2021-11-15T14:37:49.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3040236377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0a7140 0x7f2bdc1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3040236377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b0030 0x7f2bdc0b2320 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:49.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3040236377 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b1f40 0x7f2bdc0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3040236377 >> 172.21.2.135:0/3040236377 conn(0x7f2bdc05f730 msgr2=0x7f2bdc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:49.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3040236377 shutdown_connections 2021-11-15T14:37:49.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3040236377 wait complete. 2021-11-15T14:37:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 Processor -- start 2021-11-15T14:37:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- start start 2021-11-15T14:37:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b0030 0x7f2bdc1453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b1f40 0x7f2bdc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0aa990 con 0x7f2bdc0b1f40 2021-11-15T14:37:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0aac30 con 0x7f2bdc0a7140 2021-11-15T14:37:49.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0abce0 con 0x7f2bdc0b0030 2021-11-15T14:37:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57474/0 (socket says 172.21.2.135:57474) 2021-11-15T14:37:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 -- 172.21.2.135:0/3411788310 learned_addr learned my addr 172.21.2.135:0/3411788310 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 -- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b0030 msgr2=0x7f2bdc1453e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:49.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b0030 0x7f2bdc1453e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 -- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b1f40 msgr2=0x7f2bdc15a360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b1f40 0x7f2bdc15a360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 -- 172.21.2.135:0/3411788310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd000b1e0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bdb7fe700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f2bcc002f70 tx=0x7f2bcc006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc00e470 con 0x7f2bdc0a7140 2021-11-15T14:37:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00e5d0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc0aba00 con 0x7f2bdc0a7140 2021-11-15T14:37:49.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc0a99f0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bcc00e930 con 0x7f2bdc0a7140 2021-11-15T14:37:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0b0c10 con 0x7f2bdc0a7140 2021-11-15T14:37:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2bcc018030 con 0x7f2bdc0a7140 2021-11-15T14:37:49.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 0x7f2bbc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.808+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f2bcc06abe0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.812+0000 7f2bdaffd700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 0x7f2bbc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.812+0000 7f2bdaffd700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 0x7f2bbc055be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:49.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.812+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2bcc041f70 con 0x7f2bdc0a7140 2021-11-15T14:37:49.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.896+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2bdc0573d0 con 0x7f2bdc0a7140 2021-11-15T14:37:49.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2bd8ff9700 1 -- 172.21.2.135:0/3411788310 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2bcc045590 con 0x7f2bdc0a7140 2021-11-15T14:37:49.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 msgr2=0x7f2bbc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:49.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 0x7f2bbc055be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0015000).stop 2021-11-15T14:37:49.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 msgr2=0x7f2bdc144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:49.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f2bcc002f70 tx=0x7f2bcc006db0).stop 2021-11-15T14:37:49.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 shutdown_connections 2021-11-15T14:37:49.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc053720 0x7f2bbc055be0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:49.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b1f40 0x7f2bdc15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b0030 0x7f2bdc1453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:49.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 --2- 172.21.2.135:0/3411788310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0a7140 0x7f2bdc144ef0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:49.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 >> 172.21.2.135:0/3411788310 conn(0x7f2bdc05f730 msgr2=0x7f2bdc13cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:49.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 shutdown_connections 2021-11-15T14:37:49.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:49.908+0000 7f2be1bec700 1 -- 172.21.2.135:0/3411788310 wait complete. 2021-11-15T14:37:49.919 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:37:49.920 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:49.932 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:49.945 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:49.954 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:37:49.967 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:37:49.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:49.968 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:37:49.968 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:50.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:37:50.014 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:37:50.015 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:37:50.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:50.016 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:37:50.016 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:37:50.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:37:50.020 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:37:50.020 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:37:50.021 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:37:50.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.064+0000 7f23d5d6a700 1 Processor -- start 2021-11-15T14:37:50.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.064+0000 7f23d5d6a700 1 -- start start 2021-11-15T14:37:50.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 0x7f23d0144060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d0067450 con 0x7f23d0067070 2021-11-15T14:37:50.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d00b0050 con 0x7f23d00ad0b0 2021-11-15T14:37:50.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00b02f0 con 0x7f23d00b0760 2021-11-15T14:37:50.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f23d00ad0b0 0x7f23d00b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45070/0 (socket says 172.21.2.135:45070) 2021-11-15T14:37:50.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 -- 172.21.2.135:0/1342766073 learned_addr learned my addr 172.21.2.135:0/1342766073 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:50.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255374308 0 0) 0x7f23d00b0050 con 0x7f23d00ad0b0 2021-11-15T14:37:50.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23bc003260 con 0x7f23d00ad0b0 2021-11-15T14:37:50.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cffff700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 0x7f23d0144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202281841 0 0) 0x7f23bc003260 con 0x7f23d00ad0b0 2021-11-15T14:37:50.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 msgr2=0x7f23d0144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 0x7f23d0144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 >> v1:172.21.2.119:6789/0 conn(0x7f23d0067070 legacy=0x7f23d0143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00af420 con 0x7f23d00ad0b0 2021-11-15T14:37:50.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f23c4001660 con 0x7f23d00ad0b0 2021-11-15T14:37:50.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 >> v1:172.21.2.135:6789/0 conn(0x7f23d00ad0b0 legacy=0x7f23d00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23bc0037d0 0x7f23bc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23bc004500 0x7f23bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 0x7f23bc004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00b02f0 con 0x7f23bc0037d0 2021-11-15T14:37:50.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc00b8e0 con 0x7f23bc004500 2021-11-15T14:37:50.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc00baa0 con 0x7f23d00b0760 2021-11-15T14:37:50.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23bc004500 0x7f23bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cf7fe700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23bc0037d0 0x7f23bc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 -- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 msgr2=0x7f23bc004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d00b0760 0x7f23bc004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 -- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23bc0037d0 msgr2=0x7f23bc003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23bc0037d0 0x7f23bc003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 -- 172.21.2.135:0/1342766073 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc003260 con 0x7f23bc004500 2021-11-15T14:37:50.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cf7fe700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23bc0037d0 0x7f23bc003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:50.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ceffd700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23bc004500 0x7f23bc004980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f23bc0054d0 tx=0x7f23d00afde0).ready entity=mon.1 client_cookie=746711116388a334 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c40070d0 con 0x7f23bc004500 2021-11-15T14:37:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4007230 con 0x7f23bc004500 2021-11-15T14:37:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23ce7fc700 1 -- 172.21.2.135:0/1342766073 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c400c8b0 con 0x7f23bc004500 2021-11-15T14:37:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- 172.21.2.135:0/1342766073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23bc004500 msgr2=0x7f23bc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/1342766073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23bc004500 0x7f23bc004980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f23bc0054d0 tx=0x7f23d00afde0).stop 2021-11-15T14:37:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cffff700 1 -- 172.21.2.135:0/1342766073 reap_dead start 2021-11-15T14:37:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- 172.21.2.135:0/1342766073 shutdown_connections 2021-11-15T14:37:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- 172.21.2.135:0/1342766073 >> 172.21.2.135:0/1342766073 conn(0x7f23d005f730 msgr2=0x7f23d005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- 172.21.2.135:0/1342766073 shutdown_connections 2021-11-15T14:37:50.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- 172.21.2.135:0/1342766073 wait complete. 2021-11-15T14:37:50.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 Processor -- start 2021-11-15T14:37:50.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- start start 2021-11-15T14:37:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d0147410 0x7f23d0156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23d009ea10 0x7f23d009ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00a9220 con 0x7f23d009ea10 2021-11-15T14:37:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0145c80 con 0x7f23d01490f0 2021-11-15T14:37:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23d5d6a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d01494d0 con 0x7f23d0147410 2021-11-15T14:37:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57492/0 (socket says 172.21.2.135:57492) 2021-11-15T14:37:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.068+0000 7f23cf7fe700 1 -- 172.21.2.135:0/2161214064 learned_addr learned my addr 172.21.2.135:0/2161214064 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 -- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d0147410 msgr2=0x7f23d0156770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d0147410 0x7f23d0156770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 -- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23d009ea10 msgr2=0x7f23d009ee90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23d009ea10 0x7f23d009ee90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 -- 172.21.2.135:0/2161214064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00a1410 con 0x7f23d01490f0 2021-11-15T14:37:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23cf7fe700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f23c0008000 tx=0x7f23c0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c00104e0 con 0x7f23d01490f0 2021-11-15T14:37:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0000e90 con 0x7f23d01490f0 2021-11-15T14:37:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d0155e90 con 0x7f23d01490f0 2021-11-15T14:37:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c0010870 con 0x7f23d01490f0 2021-11-15T14:37:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d0146a40 con 0x7f23d01490f0 2021-11-15T14:37:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d01462f0 con 0x7f23d01490f0 2021-11-15T14:37:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23c0019030 con 0x7f23d01490f0 2021-11-15T14:37:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 0x7f23b0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f23c006b020 con 0x7f23d01490f0 2021-11-15T14:37:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ceffd700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 0x7f23b0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ceffd700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 0x7f23b0055b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f23bc0054d0 tx=0x7f23c4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.072+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23c00421f0 con 0x7f23d01490f0 2021-11-15T14:37:50.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f23d00573d0 con 0x7f23d01490f0 2021-11-15T14:37:50.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23ccff9700 1 -- 172.21.2.135:0/2161214064 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+29217 (secure 0 0 0) 0x7f23c0045810 con 0x7f23d01490f0 2021-11-15T14:37:50.162 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:50.163 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:37:50.163 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 50, 2021-11-15T14:37:50.163 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:37:50.163 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:37:50.163 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:37:47.717638+0000", 2021-11-15T14:37:50.164 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:37:50.164 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:37:50.164 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:37:50.164 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:37:50.165 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:37:50.165 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:37:50.165 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:37:50.165 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:37:50.165 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:37:50.166 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:50.166 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:37:50.166 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:37:50.166 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:37:50.167 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:37:50.167 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:37:50.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 8, 2021-11-15T14:37:50.167 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:37:50.168 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:37:50.168 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:37:50.168 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:37:50.168 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:37:50.168 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.169 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:37:50.169 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:37:50.169 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:37:50.169 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:50.170 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:50.170 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:50.170 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:50.170 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:50.170 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:50.171 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:50.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:50.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:37:50.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:37:50.172 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:37:50.172 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:37:50.172 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:37:50.172 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:50.173 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:50.173 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:50.173 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:50.173 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:50.173 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:50.174 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:50.174 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.174 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:37:50.174 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:50.175 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:50.175 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:50.175 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:50.175 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:50.175 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:50.176 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:50.176 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:50.176 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:50.176 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:50.176 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:50.177 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:50.177 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:50.177 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:50.177 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:50.178 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:50.178 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:50.178 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:50.178 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:50.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:50.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:50.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:50.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:50.179 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:50.180 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:50.180 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:50.180 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.180 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:50.180 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:50.181 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:50.181 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:50.181 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:50.181 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:50.182 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:50.182 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:50.182 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:50.182 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:50.182 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:50.183 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:37:50.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:37:50.183 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.183 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:50.183 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:37:50.184 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.184 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.184 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:37:50.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:37:50.185 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:37:50.185 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:37:50.185 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:37:50.185 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:37:50.186 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:37:50.186 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:37:50.186 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:37:50.186 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:37:50.186 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:37:50.187 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:37:50.187 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:37:50.187 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:37:50.187 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:37:50.188 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:37:50.188 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:37:50.188 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:37:50.188 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:37:50.188 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:37:50.189 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:37:50.189 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:37:50.189 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:37:50.189 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.190 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:37:50.190 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:37:50.190 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:37:50.190 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:37:50.191 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:37:50.191 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:37:50.191 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:37:50.191 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:37:50.191 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:37:50.192 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:37:50.192 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:37:50.192 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:37:50.192 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:37:50.193 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:37:50.193 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:37:50.193 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:37:50.193 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:37:50.193 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:37:50.194 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:37:50.194 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:37:50.194 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:37:50.194 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:37:50.195 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:37:50.195 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:37:50.195 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:37:50.195 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:37:50.195 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:37:50.196 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.196 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:37:50.196 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:37:50.196 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:37:50.196 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:37:50.197 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:37:50.197 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:37:50.197 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:37:50.197 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:37:50.198 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:37:50.198 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:37:50.198 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:37:50.198 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:37:50.198 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:37:50.199 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:37:50.199 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.199 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.199 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:50.200 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:37:50.200 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.200 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:37:50.200 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:37:50.200 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.201 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.201 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.201 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.201 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.202 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.202 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.202 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 33, 2021-11-15T14:37:50.202 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.202 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.203 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.203 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.203 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.203 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.204 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:37:50.204 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.204 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.204 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.204 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.205 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:37:50.205 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.205 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.205 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.205 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.206 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.206 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.206 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.206 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.207 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:37:50.207 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.207 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.207 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.208 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.208 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:37:50.208 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.208 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.208 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.209 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.209 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.209 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.209 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.209 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.210 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:37:50.210 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.210 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.210 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.210 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.211 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:37:50.211 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.211 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.211 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.211 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.212 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.212 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.212 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.212 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.212 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:37:50.213 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.213 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.213 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.213 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.213 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:37:50.214 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:37:50.214 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.214 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.214 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.214 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:37:50.215 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:37:50.215 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:37:50.215 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:37:50.215 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.215 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.216 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.216 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.216 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.216 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.216 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:37:50.217 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:37:50.217 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.217 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.217 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.218 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.218 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.218 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.218 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.219 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:50.219 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.219 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.219 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.219 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.220 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.220 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.220 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:37:50.220 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.221 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.221 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.221 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.221 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:37:50.221 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.222 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.222 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.222 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.222 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.222 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.223 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.223 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.223 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:37:50.223 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.224 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.224 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.224 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.224 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:37:50.224 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.225 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.225 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.225 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.225 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.225 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.226 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.226 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.226 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:37:50.226 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.226 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.227 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.227 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.227 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:37:50.227 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.227 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.228 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.228 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.228 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.228 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.228 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.229 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.229 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:37:50.229 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.229 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.229 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.230 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.230 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:37:50.230 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:37:50.230 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.231 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.231 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.231 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:37:50.231 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:37:50.231 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:37:50.232 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:37:50.232 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.232 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.232 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.233 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.233 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.233 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:37:50.233 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:37:50.234 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.234 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.234 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.234 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.234 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.235 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.235 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.235 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:50.235 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.235 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.236 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.236 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.236 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.236 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.237 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:37:50.237 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.237 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.237 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.238 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:37:50.238 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.238 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.238 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.238 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.239 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.239 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.239 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:37:50.240 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.240 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.240 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.240 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.241 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:37:50.241 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.241 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.241 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.241 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.242 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.242 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.242 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.242 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.242 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:37:50.243 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.243 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.243 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.243 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.243 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:37:50.244 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.244 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.244 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.244 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.245 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.245 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.245 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.245 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:37:50.245 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.246 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.246 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.246 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.246 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:37:50.247 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:37:50.247 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.247 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.247 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.247 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:37:50.248 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:37:50.248 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:37:50.248 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:37:50.248 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.248 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.249 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.249 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.249 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.249 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:37:50.250 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:37:50.250 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.250 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.250 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.250 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.251 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.251 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.251 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.251 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 44, 2021-11-15T14:37:50.251 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.252 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.252 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.252 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.252 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.252 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.253 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:37:50.253 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.253 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.253 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.253 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.254 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:37:50.254 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.254 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.254 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.254 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.255 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.255 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.255 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.255 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.255 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:37:50.256 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.256 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.256 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.256 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.256 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:37:50.257 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.257 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.257 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.257 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.257 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.258 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.258 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.258 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.258 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:37:50.258 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.259 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.259 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.259 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.259 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:37:50.259 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.260 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.260 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.260 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.260 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.261 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.261 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.261 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:37:50.261 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.261 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.262 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.262 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.262 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:37:50.262 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:37:50.262 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.263 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.263 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.263 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:37:50.263 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:37:50.263 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:37:50.264 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:37:50.264 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.264 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.264 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.264 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.265 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.265 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.265 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:37:50.265 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:37:50.265 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.266 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.266 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.266 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.267 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.267 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 44, 2021-11-15T14:37:50.267 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.267 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.267 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.268 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:37:50.268 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.269 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.269 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.269 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.269 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:37:50.269 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.270 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.270 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.270 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.270 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.270 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.271 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.271 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.271 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:37:50.271 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.271 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.272 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.272 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.272 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:37:50.272 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.272 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.273 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.273 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.273 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.273 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.274 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.274 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.274 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:37:50.274 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.274 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.275 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.275 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.275 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:37:50.275 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.275 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.276 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.276 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.276 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.276 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.276 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.277 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.277 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:37:50.277 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.277 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.277 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.278 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.278 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:37:50.278 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:37:50.278 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.278 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.279 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.279 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:37:50.279 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:37:50.279 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:37:50.280 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:37:50.280 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.280 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.280 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.280 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.281 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.281 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.281 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:37:50.281 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:37:50.282 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.282 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.282 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.282 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.282 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.283 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.283 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.283 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:50.283 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.284 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.284 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.284 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.284 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.284 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.285 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:37:50.285 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.285 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.285 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.286 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:37:50.286 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.286 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.286 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.287 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.287 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.287 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.287 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.288 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:37:50.288 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.288 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.288 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.289 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.289 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:37:50.289 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.289 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.290 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.290 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.290 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.290 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.290 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.291 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.291 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:37:50.291 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.291 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.292 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.292 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.292 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:37:50.292 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.292 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.293 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.293 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.293 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.293 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.294 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.294 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.294 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:37:50.294 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.294 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.295 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.295 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.295 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:37:50.295 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:37:50.296 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.296 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.296 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.296 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:37:50.296 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:37:50.297 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:37:50.297 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:37:50.297 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.297 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.297 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.298 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.298 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.298 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.298 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:37:50.299 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:37:50.299 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.299 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.299 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.300 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.300 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.300 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.300 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.300 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:50.301 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.301 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.301 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.301 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.302 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.302 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.302 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:37:50.302 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.302 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.303 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.303 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.303 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:37:50.303 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.303 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.304 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.304 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.304 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.304 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.305 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:37:50.305 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.305 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.306 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:37:50.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.307 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.307 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.307 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.308 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:37:50.308 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.308 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.309 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.309 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:37:50.309 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.310 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.310 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.310 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.310 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.311 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.311 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.311 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:37:50.311 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.312 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.312 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.312 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:37:50.313 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:37:50.313 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.313 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.313 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.313 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:37:50.314 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:37:50.314 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:37:50.314 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:37:50.314 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.315 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.315 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.315 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.315 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.316 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:37:50.316 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:37:50.316 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:37:50.316 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:37:50.316 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:37:50.317 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:37:50.317 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:37:50.317 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:37:50.317 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:37:50.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:37:50.318 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:37:50.318 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:37:50.318 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:37:50.318 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.319 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:37:50.319 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.320 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.320 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.320 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:37:50.320 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.321 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.321 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.321 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.321 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:37:50.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.322 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:37:50.322 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:37:50.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.324 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.324 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.324 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:37:50.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.325 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.325 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:37:50.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:37:50.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.327 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:37:50.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:37:50.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:37:50.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:37:50.328 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:37:50.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:37:50.329 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:37:50.330 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.330 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.330 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:37:50.330 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:37:50.331 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:37:50.331 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:37:50.331 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:37:50.331 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:37:50.332 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:37:50.332 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:50.332 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.332 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:50.332 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:37:50.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.333 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:37:50.333 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.333 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.334 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.334 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.334 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.334 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:37:50.334 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.335 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.335 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:37:50.335 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.336 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.336 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.336 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.336 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.336 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:37:50.337 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.337 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:37:50.338 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.338 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.338 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.338 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.338 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.339 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:37:50.339 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.339 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.339 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:37:50.340 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.340 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.340 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.340 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.341 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.341 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:37:50.341 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.341 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.342 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:37:50.342 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.342 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.342 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.342 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.343 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.343 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:37:50.343 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.344 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:37:50.344 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.344 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.344 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.345 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.345 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.345 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:37:50.345 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.346 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.346 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.346 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:37:50.346 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.346 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.347 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.347 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.347 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.347 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:37:50.348 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.348 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:50.348 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:37:50.348 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:37:50.349 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:37:50.349 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:37:50.349 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:37:50.349 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:37:50.349 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:37:50.350 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:37:50.350 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.350 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:37:50.350 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:37:50.350 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:37:50.351 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:37:50.351 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:37:50.351 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:37:50.351 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/614438403": "2021-11-16T14:37:43.973356+0000", 2021-11-15T14:37:50.352 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/614438403": "2021-11-16T14:37:43.973356+0000" 2021-11-15T14:37:50.352 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.352 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:37:50.352 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:37:50.352 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:37:50.353 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:37:50.353 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:37:50.353 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:37:50.353 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:37:50.354 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:37:50.354 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:37:50.354 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:37:50.354 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:37:50.354 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:37:50.355 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.355 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:37:50.355 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:37:50.355 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:37:50.355 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:37:50.356 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:37:50.356 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:37:50.356 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:37:50.356 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:50.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:50.357 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:37:50.357 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:37:50.357 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:37:50.357 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:37:50.358 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:37:50.358 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:37:50.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 msgr2=0x7f23b0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 0x7f23b0055b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f23bc0054d0 tx=0x7f23c4015000).stop 2021-11-15T14:37:50.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 msgr2=0x7f23d0156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.156+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f23c0008000 tx=0x7f23c0009040).stop 2021-11-15T14:37:50.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 shutdown_connections 2021-11-15T14:37:50.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23b0053690 0x7f23b0055b50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23d009ea10 0x7f23d009ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f23d0147410 0x7f23d0156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 --2- 172.21.2.135:0/2161214064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23d01490f0 0x7f23d0156280 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 >> 172.21.2.135:0/2161214064 conn(0x7f23d005f730 msgr2=0x7f23d00b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 shutdown_connections 2021-11-15T14:37:50.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.160+0000 7f23d5d6a700 1 -- 172.21.2.135:0/2161214064 wait complete. 2021-11-15T14:37:50.363 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:50.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 Processor -- start 2021-11-15T14:37:50.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- start start 2021-11-15T14:37:50.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 0x7ffbec14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ffbec0a8b40 0x7ffbec14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbec0a7140 con 0x7ffbec0b0090 2021-11-15T14:37:50.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec0a7370 con 0x7ffbec0a8b40 2021-11-15T14:37:50.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0a7610 con 0x7ffbec0b2600 2021-11-15T14:37:50.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf0a1c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ffbec0b0090 0x7ffbec0a8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45092/0 (socket says 172.21.2.135:45092) 2021-11-15T14:37:50.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf0a1c700 1 -- 172.21.2.135:0/48999918 learned_addr learned my addr 172.21.2.135:0/48999918 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:50.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468445792 0 0) 0x7ffbec0a7140 con 0x7ffbec0b0090 2021-11-15T14:37:50.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd4003260 con 0x7ffbec0b0090 2021-11-15T14:37:50.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 33557166 0 0) 0x7ffbd4003260 con 0x7ffbec0b0090 2021-11-15T14:37:50.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 msgr2=0x7ffbec14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 0x7ffbec14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 >> v2:172.21.2.119:3300/0 conn(0x7ffbec0a8b40 msgr2=0x7ffbec14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 --2- 172.21.2.135:0/48999918 >> v2:172.21.2.119:3300/0 conn(0x7ffbec0a8b40 0x7ffbec14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec0a78b0 con 0x7ffbec0b0090 2021-11-15T14:37:50.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ffbdc001660 con 0x7ffbec0b0090 2021-11-15T14:37:50.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 >> v1:172.21.2.135:6789/0 conn(0x7ffbec0b0090 legacy=0x7ffbec0a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 0x7ffbd40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4003ee0 0x7ffbd4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbd4004bf0 0x7ffbd400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0a7370 con 0x7ffbd4003ee0 2021-11-15T14:37:50.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0a7610 con 0x7ffbd4004bf0 2021-11-15T14:37:50.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40053a0 con 0x7ffbec0b2600 2021-11-15T14:37:50.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbd4004bf0 0x7ffbd400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 -- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 msgr2=0x7ffbd40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0b2600 0x7ffbd40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 -- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4003ee0 msgr2=0x7ffbd4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4003ee0 0x7ffbd4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 -- 172.21.2.135:0/48999918 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4003260 con 0x7ffbd4004bf0 2021-11-15T14:37:50.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbd4004bf0 0x7ffbd400b750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffbe40032f0 tx=0x7ffbe4006f90).ready entity=mon.1 client_cookie=2aa92de2e7631bad server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbe400b460 con 0x7ffbd4004bf0 2021-11-15T14:37:50.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe400b5c0 con 0x7ffbd4004bf0 2021-11-15T14:37:50.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbdbfff700 1 -- 172.21.2.135:0/48999918 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbe400b730 con 0x7ffbd4004bf0 2021-11-15T14:37:50.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- 172.21.2.135:0/48999918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbd4004bf0 msgr2=0x7ffbd400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 --2- 172.21.2.135:0/48999918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbd4004bf0 0x7ffbd400b750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffbe40032f0 tx=0x7ffbe4006f90).stop 2021-11-15T14:37:50.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf1a1e700 1 -- 172.21.2.135:0/48999918 reap_dead start 2021-11-15T14:37:50.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- 172.21.2.135:0/48999918 shutdown_connections 2021-11-15T14:37:50.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- 172.21.2.135:0/48999918 >> 172.21.2.135:0/48999918 conn(0x7ffbec060200 msgr2=0x7ffbec0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- 172.21.2.135:0/48999918 shutdown_connections 2021-11-15T14:37:50.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- 172.21.2.135:0/48999918 wait complete. 2021-11-15T14:37:50.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 Processor -- start 2021-11-15T14:37:50.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.432+0000 7ffbf221f700 1 -- start start 2021-11-15T14:37:50.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4004bf0 0x7ffbec0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0aa150 0x7ffbec0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec1401f0 con 0x7ffbd4004bf0 2021-11-15T14:37:50.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0b4ca0 con 0x7ffbec13f880 2021-11-15T14:37:50.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec15a680 con 0x7ffbec0aa150 2021-11-15T14:37:50.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57516/0 (socket says 172.21.2.135:57516) 2021-11-15T14:37:50.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 -- 172.21.2.135:0/107145685 learned_addr learned my addr 172.21.2.135:0/107145685 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:50.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 -- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0aa150 msgr2=0x7ffbec0aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0aa150 0x7ffbec0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 -- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4004bf0 msgr2=0x7ffbec0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4004bf0 0x7ffbec0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 -- 172.21.2.135:0/107145685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec15a920 con 0x7ffbec13f880 2021-11-15T14:37:50.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf0a1c700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffbdc001370 tx=0x7ffbec06a4e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbdc007170 con 0x7ffbec13f880 2021-11-15T14:37:50.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0072d0 con 0x7ffbec13f880 2021-11-15T14:37:50.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbec05c4c0 con 0x7ffbec13f880 2021-11-15T14:37:50.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec0b4f40 con 0x7ffbec13f880 2021-11-15T14:37:50.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbdc004920 con 0x7ffbec13f880 2021-11-15T14:37:50.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec0573d0 con 0x7ffbec13f880 2021-11-15T14:37:50.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffbdc01b070 con 0x7ffbec13f880 2021-11-15T14:37:50.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 0x7ffbcc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ffbdc06b160 con 0x7ffbec13f880 2021-11-15T14:37:50.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf121d700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 0x7ffbcc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.436+0000 7ffbf121d700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 0x7ffbcc055b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ffbe8002f70 tx=0x7ffbe8006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.440+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffbdc042330 con 0x7ffbec13f880 2021-11-15T14:37:50.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbec069960 con 0x7ffbec13f880 2021-11-15T14:37:50.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbda7fc700 1 -- 172.21.2.135:0/107145685 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1559 (secure 0 0 0) 0x7ffbdc001c60 con 0x7ffbec13f880 2021-11-15T14:37:50.552 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:50.552 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5458,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/4192642827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4192642827},{"type":"v1","addr":"172.21.2.135:6835","nonce":4192642827}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-11-15T14:37:50.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 msgr2=0x7ffbcc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 0x7ffbcc055b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ffbe8002f70 tx=0x7ffbe8006a10).stop 2021-11-15T14:37:50.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 msgr2=0x7ffbec13fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffbdc001370 tx=0x7ffbec06a4e0).stop 2021-11-15T14:37:50.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 shutdown_connections 2021-11-15T14:37:50.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffbcc053660 0x7ffbcc055b20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffbec0aa150 0x7ffbec0aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffbec13f880 0x7ffbec13fd00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 --2- 172.21.2.135:0/107145685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffbd4004bf0 0x7ffbec0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 >> 172.21.2.135:0/107145685 conn(0x7ffbec060200 msgr2=0x7ffbec148740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 shutdown_connections 2021-11-15T14:37:50.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.548+0000 7ffbf221f700 1 -- 172.21.2.135:0/107145685 wait complete. 2021-11-15T14:37:50.556 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 23 2021-11-15T14:37:50.559 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:50.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 Processor -- start 2021-11-15T14:37:50.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 -- start start 2021-11-15T14:37:50.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31140b0520 0x7f31140addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f31140aa1a0 0x7f31140ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0900 0x7f3114143790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140b2b70 con 0x7f31140aa1a0 2021-11-15T14:37:50.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140b27f0 con 0x7f31140b0520 2021-11-15T14:37:50.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311b2c1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b2da0 con 0x7f31140b0900 2021-11-15T14:37:50.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31140b0520 0x7f31140addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31140b0520 0x7f31140addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57520/0 (socket says 172.21.2.135:57520) 2021-11-15T14:37:50.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 -- 172.21.2.135:0/535203893 learned_addr learned my addr 172.21.2.135:0/535203893 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:50.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 -- 172.21.2.135:0/535203893 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0900 msgr2=0x7f3114143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 --2- 172.21.2.135:0/535203893 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0900 0x7f3114143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 -- 172.21.2.135:0/535203893 >> v2:172.21.2.119:3300/0 conn(0x7f31140aa1a0 msgr2=0x7f31140ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 --2- 172.21.2.135:0/535203893 >> v2:172.21.2.119:3300/0 conn(0x7f31140aa1a0 0x7f31140ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 -- 172.21.2.135:0/535203893 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140a9bf0 con 0x7f31140b0520 2021-11-15T14:37:50.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f311905d700 1 --2- 172.21.2.135:0/535203893 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0520 0x7f31140addb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f3110002f70 tx=0x7f3110006eb0).ready entity=mon.1 client_cookie=ba6ad2450c7ce35a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f3107fff700 1 -- 172.21.2.135:0/535203893 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f311000d570 con 0x7f31140b0520 2021-11-15T14:37:50.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f3107fff700 1 -- 172.21.2.135:0/535203893 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110000e90 con 0x7f31140b0520 2021-11-15T14:37:50.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.604+0000 7f3107fff700 1 -- 172.21.2.135:0/535203893 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f311000d900 con 0x7f31140b0520 2021-11-15T14:37:50.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/535203893 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0520 msgr2=0x7f31140addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- 172.21.2.135:0/535203893 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0520 0x7f31140addb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f3110002f70 tx=0x7f3110006eb0).stop 2021-11-15T14:37:50.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/535203893 shutdown_connections 2021-11-15T14:37:50.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- 172.21.2.135:0/535203893 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0900 0x7f3114143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- 172.21.2.135:0/535203893 >> v2:172.21.2.119:3300/0 conn(0x7f31140aa1a0 0x7f31140ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- 172.21.2.135:0/535203893 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0520 0x7f31140addb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/535203893 >> 172.21.2.135:0/535203893 conn(0x7f3114060840 msgr2=0x7f3114060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/535203893 shutdown_connections 2021-11-15T14:37:50.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/535203893 wait complete. 2021-11-15T14:37:50.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 Processor -- start 2021-11-15T14:37:50.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- start start 2021-11-15T14:37:50.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31140aa1a0 0x7f3114136770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0520 0x7f3114132230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3114131b90 con 0x7f31140aa1a0 2021-11-15T14:37:50.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140ac0f0 con 0x7f31140b0900 2021-11-15T14:37:50.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b3790 con 0x7f31140b0520 2021-11-15T14:37:50.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57528/0 (socket says 172.21.2.135:57528) 2021-11-15T14:37:50.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 -- 172.21.2.135:0/3122973527 learned_addr learned my addr 172.21.2.135:0/3122973527 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:50.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 -- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0520 msgr2=0x7f3114132230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0520 0x7f3114132230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 -- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31140aa1a0 msgr2=0x7f3114136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31140aa1a0 0x7f3114136770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 -- 172.21.2.135:0/3122973527 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311000b1e0 con 0x7f31140b0900 2021-11-15T14:37:50.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311985e700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f310c0032f0 tx=0x7f310c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f310c00f510 con 0x7f31140b0900 2021-11-15T14:37:50.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c00f670 con 0x7f31140b0900 2021-11-15T14:37:50.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f310c00f7e0 con 0x7f31140b0900 2021-11-15T14:37:50.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31140abe50 con 0x7f31140b0900 2021-11-15T14:37:50.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31140ad610 con 0x7f31140b0900 2021-11-15T14:37:50.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3114131fd0 con 0x7f31140b0900 2021-11-15T14:37:50.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f310c00f070 con 0x7f31140b0900 2021-11-15T14:37:50.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.608+0000 7f31067fc700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 0x7f30f4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.612+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f310c06b260 con 0x7f31140b0900 2021-11-15T14:37:50.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.612+0000 7f311905d700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 0x7f30f4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.612+0000 7f311905d700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 0x7f30f4055b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f3110002f70 tx=0x7f3110015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.612+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f310c042540 con 0x7f31140b0900 2021-11-15T14:37:50.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31140573d0 con 0x7f31140b0900 2021-11-15T14:37:50.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f31067fc700 1 -- 172.21.2.135:0/3122973527 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f310c045b60 con 0x7f31140b0900 2021-11-15T14:37:50.725 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:50.726 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4400,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1532939995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1532939995},{"type":"v1","addr":"172.21.2.119:6835","nonce":1532939995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/233797278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":233797278},{"type":"v1","addr":"172.21.2.135:6833","nonce":233797278}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5458,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/4192642827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4192642827},{"type":"v1","addr":"172.21.2.135:6835","nonce":4192642827}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2021-11-15T14:37:50.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 msgr2=0x7f30f4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 0x7f30f4055b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f3110002f70 tx=0x7f3110015000).stop 2021-11-15T14:37:50.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 msgr2=0x7f3114132720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f310c0032f0 tx=0x7f310c0090f0).stop 2021-11-15T14:37:50.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 shutdown_connections 2021-11-15T14:37:50.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30f4053640 0x7f30f4055b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31140b0900 0x7f3114132720 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31140b0520 0x7f3114132230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 --2- 172.21.2.135:0/3122973527 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31140aa1a0 0x7f3114136770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 >> 172.21.2.135:0/3122973527 conn(0x7f3114060840 msgr2=0x7f311413b990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 shutdown_connections 2021-11-15T14:37:50.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.720+0000 7f311b2c1700 1 -- 172.21.2.135:0/3122973527 wait complete. 2021-11-15T14:37:50.729 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 23 2021-11-15T14:37:50.732 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:37:50.733 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:37:50.733 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:37:50.733 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:37:50.734 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:37:50.734 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:37:50.734 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:37:50.734 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:37:50.735 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:37:50.735 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:37:50.735 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:37:50.736 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:37:50.739 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:37:50.739 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:37:50.740 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:37:50.741 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:37:50.747 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:37:50.748 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:37:50.749 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:37:50.750 DEBUG:teuthology.parallel:result is None 2021-11-15T14:37:50.787 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:37:50.788 DEBUG:teuthology.parallel:result is None 2021-11-15T14:37:50.789 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:37:50.789 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:37:50.790 DEBUG:teuthology.parallel:result is None 2021-11-15T14:37:50.790 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:37:50.823 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:37:50.823 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:37:50.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 Processor -- start 2021-11-15T14:37:50.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- start start 2021-11-15T14:37:50.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f164c0b1e30 0x7f164c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0b03d0 con 0x7f164c0a7140 2021-11-15T14:37:50.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0b0670 con 0x7f164c148420 2021-11-15T14:37:50.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0a9140 con 0x7f164c0b1e30 2021-11-15T14:37:50.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f164c148420 0x7f164c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45148/0 (socket says 172.21.2.135:45148) 2021-11-15T14:37:50.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164a59c700 1 -- 172.21.2.135:0/2962653880 learned_addr learned my addr 172.21.2.135:0/2962653880 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:50.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164ad9d700 1 --2- 172.21.2.135:0/2962653880 >> v2:172.21.2.135:3300/0 conn(0x7f164c0b1e30 0x7f164c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164ad9d700 1 -- 172.21.2.135:0/2962653880 >> v1:172.21.2.135:6789/0 conn(0x7f164c148420 legacy=0x7f164c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164ad9d700 1 -- 172.21.2.135:0/2962653880 >> v1:172.21.2.119:6789/0 conn(0x7f164c0a7140 legacy=0x7f164c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:50.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164ad9d700 1 -- 172.21.2.135:0/2962653880 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0b0910 con 0x7f164c0b1e30 2021-11-15T14:37:50.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f164ad9d700 1 --2- 172.21.2.135:0/2962653880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0b1050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f164c0acee0 tx=0x7f1634006df0).ready entity=mon.1 client_cookie=4ea4642a5ac80b0d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1649d9b700 1 -- 172.21.2.135:0/2962653880 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163400d5c0 con 0x7f164c0b1e30 2021-11-15T14:37:50.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1649d9b700 1 -- 172.21.2.135:0/2962653880 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1634000e90 con 0x7f164c0b1e30 2021-11-15T14:37:50.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1649d9b700 1 -- 172.21.2.135:0/2962653880 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163400d910 con 0x7f164c0b1e30 2021-11-15T14:37:50.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- 172.21.2.135:0/2962653880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 msgr2=0x7f164c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 --2- 172.21.2.135:0/2962653880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0b1050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f164c0acee0 tx=0x7f1634006df0).stop 2021-11-15T14:37:50.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- 172.21.2.135:0/2962653880 shutdown_connections 2021-11-15T14:37:50.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 --2- 172.21.2.135:0/2962653880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0b1050 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:50.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- 172.21.2.135:0/2962653880 >> 172.21.2.135:0/2962653880 conn(0x7f164c05f730 msgr2=0x7f164c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:50.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- 172.21.2.135:0/2962653880 shutdown_connections 2021-11-15T14:37:50.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.840+0000 7f1651136700 1 -- 172.21.2.135:0/2962653880 wait complete. 2021-11-15T14:37:50.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 Processor -- start 2021-11-15T14:37:50.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- start start 2021-11-15T14:37:50.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f164c0a7140 0x7f164c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f164c148420 0x7f164c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c14ab70 con 0x7f164c0a7140 2021-11-15T14:37:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c14a630 con 0x7f164c0b1e30 2021-11-15T14:37:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c14a8d0 con 0x7f164c148420 2021-11-15T14:37:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57566/0 (socket says 172.21.2.135:57566) 2021-11-15T14:37:50.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 -- 172.21.2.135:0/2133980467 learned_addr learned my addr 172.21.2.135:0/2133980467 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:50.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 -- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f164c148420 msgr2=0x7f164c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f164c148420 0x7f164c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 -- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f164c0a7140 msgr2=0x7f164c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:50.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f164c0a7140 0x7f164c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 -- 172.21.2.135:0/2133980467 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163400b180 con 0x7f164c0b1e30 2021-11-15T14:37:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164a59c700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f164c0b31f0 tx=0x7f163c007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c00ce30 con 0x7f164c0b1e30 2021-11-15T14:37:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c0072e0 con 0x7f164c0b1e30 2021-11-15T14:37:50.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0afcc0 con 0x7f164c0b1e30 2021-11-15T14:37:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c005800 con 0x7f164c0b1e30 2021-11-15T14:37:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c0abef0 con 0x7f164c0b1e30 2021-11-15T14:37:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c0b0bb0 con 0x7f164c0b1e30 2021-11-15T14:37:50.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f163c01a060 con 0x7f164c0b1e30 2021-11-15T14:37:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 0x7f1630055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f163c06aaf0 con 0x7f164c0b1e30 2021-11-15T14:37:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.844+0000 7f164ad9d700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 0x7f1630055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.848+0000 7f164ad9d700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 0x7f1630055ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f164c0acee0 tx=0x7f1634014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:50.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.848+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f163c041dd0 con 0x7f164c0b1e30 2021-11-15T14:37:50.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:50.940+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f164c0573d0 con 0x7f164c0b1e30 2021-11-15T14:37:51.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.880+0000 7f1643fff700 1 -- 172.21.2.135:0/2133980467 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7f163c018070 con 0x7f164c0b1e30 2021-11-15T14:37:51.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 msgr2=0x7f1630055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:51.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 0x7f1630055ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f164c0acee0 tx=0x7f1634014000).stop 2021-11-15T14:37:51.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 msgr2=0x7f164c0af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:51.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f164c0b31f0 tx=0x7f163c007c70).stop 2021-11-15T14:37:51.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 shutdown_connections 2021-11-15T14:37:51.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1630053610 0x7f1630055ad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f164c148420 0x7f164c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f164c0b1e30 0x7f164c0af370 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 --2- 172.21.2.135:0/2133980467 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f164c0a7140 0x7f164c14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 >> 172.21.2.135:0/2133980467 conn(0x7f164c05f730 msgr2=0x7f164c144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 shutdown_connections 2021-11-15T14:37:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.884+0000 7f1651136700 1 -- 172.21.2.135:0/2133980467 wait complete. 2021-11-15T14:37:51.893 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:37:51.918 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:37:51.918 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:37:51.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.984+0000 7fa08149e700 1 Processor -- start 2021-11-15T14:37:51.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.984+0000 7fa08149e700 1 -- start start 2021-11-15T14:37:51.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa08149e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 0x7fa07c142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:51.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa08149e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:51.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa08149e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0ac4f0 con 0x7fa07c143320 2021-11-15T14:37:51.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa08149e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0b3090 con 0x7fa07c0b1cd0 2021-11-15T14:37:51.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa08149e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0af3a0 con 0x7fa07c139b60 2021-11-15T14:37:51.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:51.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07affd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 0x7fa07c142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:51.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07affd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 0x7fa07c142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:39120/0 (socket says 172.21.2.135:39120) 2021-11-15T14:37:51.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07affd700 1 -- 172.21.2.135:0/295393644 learned_addr learned my addr 172.21.2.135:0/295393644 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:51.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51388/0 (socket says 172.21.2.135:51388) 2021-11-15T14:37:51.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07a7fc700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa07c143320 0x7fa07c0ab5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:54580/0 (socket says 172.21.2.135:54580) 2021-11-15T14:37:51.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 -- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 msgr2=0x7fa07c142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:51.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 --2- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 0x7fa07c142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:51.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 -- 172.21.2.135:0/295393644 >> v1:172.21.2.119:6789/0 conn(0x7fa07c143320 legacy=0x7fa07c0ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:51.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 -- 172.21.2.135:0/295393644 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c1437b0 con 0x7fa07c0b1cd0 2021-11-15T14:37:51.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa07b7fe700 1 --2- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa07c0af1a0 tx=0x7fa0740091d0).ready entity=mon.0 client_cookie=73aa78b72b0e48c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:51.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa079ffb700 1 -- 172.21.2.135:0/295393644 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07400b680 con 0x7fa07c0b1cd0 2021-11-15T14:37:51.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa079ffb700 1 -- 172.21.2.135:0/295393644 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400b7e0 con 0x7fa07c0b1cd0 2021-11-15T14:37:51.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.988+0000 7fa079ffb700 1 -- 172.21.2.135:0/295393644 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07400b950 con 0x7fa07c0b1cd0 2021-11-15T14:37:51.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c0b1cd0 msgr2=0x7fa07c0a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:51.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa07c0af1a0 tx=0x7fa0740091d0).stop 2021-11-15T14:37:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/295393644 shutdown_connections 2021-11-15T14:37:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c0b1cd0 0x7fa07c0a89d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- 172.21.2.135:0/295393644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c139b60 0x7fa07c142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/295393644 >> 172.21.2.135:0/295393644 conn(0x7fa07c05f730 msgr2=0x7fa07c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/295393644 shutdown_connections 2021-11-15T14:37:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/295393644 wait complete. 2021-11-15T14:37:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 Processor -- start 2021-11-15T14:37:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- start start 2021-11-15T14:37:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c0b1cd0 0x7fa07c152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c13dea0 0x7fa07c139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0b51d0 con 0x7fa07c13dea0 2021-11-15T14:37:52.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c13f320 con 0x7fa07c152e00 2021-11-15T14:37:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c153430 con 0x7fa07c0b1cd0 2021-11-15T14:37:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57582/0 (socket says 172.21.2.135:57582) 2021-11-15T14:37:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 -- 172.21.2.135:0/2228603352 learned_addr learned my addr 172.21.2.135:0/2228603352 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07b7fe700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c13dea0 0x7fa07c139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 -- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c0b1cd0 msgr2=0x7fa07c152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07affd700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c0b1cd0 0x7fa07c152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c0b1cd0 0x7fa07c152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 -- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c13dea0 msgr2=0x7fa07c139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c13dea0 0x7fa07c139f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 -- 172.21.2.135:0/2228603352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009470 con 0x7fa07c152e00 2021-11-15T14:37:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa07a7fc700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fa07c061420 tx=0x7fa064007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06400ce30 con 0x7fa07c152e00 2021-11-15T14:37:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0640072e0 con 0x7fa07c152e00 2021-11-15T14:37:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c1536d0 con 0x7fa07c152e00 2021-11-15T14:37:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c13e320 con 0x7fa07c152e00 2021-11-15T14:37:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa064007450 con 0x7fa07c152e00 2021-11-15T14:37:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c143cf0 con 0x7fa07c152e00 2021-11-15T14:37:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa064010070 con 0x7fa07c152e00 2021-11-15T14:37:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.992+0000 7fa073fff700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 0x7fa060055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.996+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa06406aea0 con 0x7fa07c152e00 2021-11-15T14:37:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.996+0000 7fa07affd700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 0x7fa060055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.996+0000 7fa07affd700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 0x7fa060055b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa06c008000 tx=0x7fa06c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:51.996+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0640420d0 con 0x7fa07c152e00 2021-11-15T14:37:52.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa07c0573d0 con 0x7fa07c152e00 2021-11-15T14:37:52.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa073fff700 1 -- 172.21.2.135:0/2228603352 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fa0640456f0 con 0x7fa07c152e00 2021-11-15T14:37:52.113 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:52.113 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:37:52.114 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:37:52.114 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.114 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:37:52.114 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:37:52.115 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.115 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:37:52.115 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.115 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.116 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.116 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.116 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.116 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.116 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:37:52.117 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:37:52.117 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.117 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:37:52.117 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.118 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.118 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.118 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.118 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.119 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.119 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:37:52.119 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:37:52.119 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.119 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:37:52.120 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.120 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.120 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.120 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.121 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.121 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.121 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:37:52.121 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:37:52.121 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.122 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.122 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.122 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.122 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.123 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.123 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.123 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:37:52.123 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:37:52.124 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.124 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.124 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.124 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.124 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.125 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.125 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.125 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:37:52.125 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:37:52.125 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.126 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.126 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.126 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.126 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.127 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.127 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.127 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:37:52.127 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:37:52.127 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.128 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.128 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.128 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.128 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.129 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.129 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.129 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:37:52.129 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:37:52.129 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.130 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.130 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.130 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.130 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.131 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.131 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.131 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:37:52.131 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:37:52.131 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.132 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.132 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.132 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.132 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.133 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.133 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.133 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:37:52.133 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:37:52.133 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.134 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.134 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.134 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.134 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.135 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.135 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.135 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:37:52.135 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:37:52.135 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.136 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.136 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.136 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.136 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.137 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.137 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.137 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:37:52.137 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:37:52.137 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.138 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:37:52.138 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:37:52.138 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:37:52.138 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.139 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.139 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.139 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:37:52.139 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:37:52.139 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.140 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:37:52.140 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:37:52.140 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:37:52.140 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.140 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.141 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.141 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:37:52.141 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:37:52.141 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.142 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:37:52.142 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:37:52.142 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:37:52.142 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.143 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.143 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.143 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.143 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:37:52.143 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:37:52.144 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.144 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:37:52.144 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:37:52.144 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.144 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.145 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.145 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.145 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:37:52.145 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:37:52.146 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:37:52.146 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:37:52.146 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:37:52.146 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:37:52.146 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.147 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.147 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:37:52.147 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:37:52.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 msgr2=0x7fa060055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 0x7fa060055b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa06c008000 tx=0x7fa06c008040).stop 2021-11-15T14:37:52.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 msgr2=0x7fa07c13d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fa07c061420 tx=0x7fa064007c40).stop 2021-11-15T14:37:52.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 shutdown_connections 2021-11-15T14:37:52.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0600536d0 0x7fa060055b90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa07c13dea0 0x7fa07c139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa07c152e00 0x7fa07c13d9b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 --2- 172.21.2.135:0/2228603352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa07c0b1cd0 0x7fa07c152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 >> 172.21.2.135:0/2228603352 conn(0x7fa07c05f730 msgr2=0x7fa07c0aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 shutdown_connections 2021-11-15T14:37:52.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.108+0000 7fa08149e700 1 -- 172.21.2.135:0/2228603352 wait complete. 2021-11-15T14:37:52.152 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:37:52.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 Processor -- start 2021-11-15T14:37:52.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- start start 2021-11-15T14:37:52.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9f480b1e30 0x7f9f480b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480b03d0 con 0x7f9f480a7140 2021-11-15T14:37:52.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480b0670 con 0x7f9f48148420 2021-11-15T14:37:52.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480a9140 con 0x7f9f480b1e30 2021-11-15T14:37:52.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f477fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9f48148420 0x7f9f480b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45176/0 (socket says 172.21.2.135:45176) 2021-11-15T14:37:52.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f477fe700 1 -- 172.21.2.135:0/2669221781 learned_addr learned my addr 172.21.2.135:0/2669221781 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:52.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f47fff700 1 --2- 172.21.2.135:0/2669221781 >> v2:172.21.2.135:3300/0 conn(0x7f9f480b1e30 0x7f9f480b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f46ffd700 1 -- 172.21.2.135:0/2669221781 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621872037 0 0) 0x7f9f480b0670 con 0x7f9f48148420 2021-11-15T14:37:52.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f46ffd700 1 -- 172.21.2.135:0/2669221781 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f28003260 con 0x7f9f48148420 2021-11-15T14:37:52.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f47fff700 1 -- 172.21.2.135:0/2669221781 >> v1:172.21.2.135:6789/0 conn(0x7f9f48148420 legacy=0x7f9f480b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f47fff700 1 -- 172.21.2.135:0/2669221781 >> v1:172.21.2.119:6789/0 conn(0x7f9f480a7140 legacy=0x7f9f481447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f47fff700 1 -- 172.21.2.135:0/2669221781 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480b0910 con 0x7f9f480b1e30 2021-11-15T14:37:52.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f47fff700 1 --2- 172.21.2.135:0/2669221781 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f480b1050 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f9f480acee0 tx=0x7f9f38006df0).ready entity=mon.1 client_cookie=921243b011ed0240 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f46ffd700 1 -- 172.21.2.135:0/2669221781 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f3800d5c0 con 0x7f9f480b1e30 2021-11-15T14:37:52.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f46ffd700 1 -- 172.21.2.135:0/2669221781 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38000e90 con 0x7f9f480b1e30 2021-11-15T14:37:52.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f46ffd700 1 -- 172.21.2.135:0/2669221781 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f3800d910 con 0x7f9f480b1e30 2021-11-15T14:37:52.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- 172.21.2.135:0/2669221781 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 msgr2=0x7f9f480b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2669221781 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f480b1050 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f9f480acee0 tx=0x7f9f38006df0).stop 2021-11-15T14:37:52.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- 172.21.2.135:0/2669221781 shutdown_connections 2021-11-15T14:37:52.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2669221781 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f480b1050 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- 172.21.2.135:0/2669221781 >> 172.21.2.135:0/2669221781 conn(0x7f9f4805f730 msgr2=0x7f9f4805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- 172.21.2.135:0/2669221781 shutdown_connections 2021-11-15T14:37:52.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.204+0000 7f9f4e323700 1 -- 172.21.2.135:0/2669221781 wait complete. 2021-11-15T14:37:52.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 Processor -- start 2021-11-15T14:37:52.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- start start 2021-11-15T14:37:52.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f480a7140 0x7f9f480aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f48148420 0x7f9f4815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48149c70 con 0x7f9f480a7140 2021-11-15T14:37:52.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4815a820 con 0x7f9f480b1e30 2021-11-15T14:37:52.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480ac1e0 con 0x7f9f48148420 2021-11-15T14:37:52.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57596/0 (socket says 172.21.2.135:57596) 2021-11-15T14:37:52.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 -- 172.21.2.135:0/2714485715 learned_addr learned my addr 172.21.2.135:0/2714485715 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 -- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f48148420 msgr2=0x7f9f4815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f48148420 0x7f9f4815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 -- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f480a7140 msgr2=0x7f9f480aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f480a7140 0x7f9f480aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 -- 172.21.2.135:0/2714485715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3800b180 con 0x7f9f480b1e30 2021-11-15T14:37:52.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f477fe700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9f30001110 tx=0x7f9f30007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f300070d0 con 0x7f9f480b1e30 2021-11-15T14:37:52.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30007230 con 0x7f9f480b1e30 2021-11-15T14:37:52.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f480ac480 con 0x7f9f480b1e30 2021-11-15T14:37:52.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f480a9620 con 0x7f9f480b1e30 2021-11-15T14:37:52.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f30005610 con 0x7f9f480b1e30 2021-11-15T14:37:52.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f480b0bb0 con 0x7f9f480b1e30 2021-11-15T14:37:52.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f30010070 con 0x7f9f480b1e30 2021-11-15T14:37:52.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 0x7f9f2c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f9f3006aef0 con 0x7f9f480b1e30 2021-11-15T14:37:52.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.208+0000 7f9f47fff700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 0x7f9f2c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.212+0000 7f9f47fff700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 0x7f9f2c055b50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9f480acee0 tx=0x7f9f38014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.212+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f30042120 con 0x7f9f480b1e30 2021-11-15T14:37:52.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f480573d0 con 0x7f9f480b1e30 2021-11-15T14:37:52.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f457fa700 1 -- 172.21.2.135:0/2714485715 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f9f30045740 con 0x7f9f480b1e30 2021-11-15T14:37:52.302 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:52.302 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":53,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:51.866025+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:37:52.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 msgr2=0x7f9f2c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 0x7f9f2c055b50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9f480acee0 tx=0x7f9f38014000).stop 2021-11-15T14:37:52.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 msgr2=0x7f9f48159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9f30001110 tx=0x7f9f30007aa0).stop 2021-11-15T14:37:52.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 shutdown_connections 2021-11-15T14:37:52.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f2c053690 0x7f9f2c055b50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f48148420 0x7f9f4815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f480b1e30 0x7f9f48159e40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 --2- 172.21.2.135:0/2714485715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f480a7140 0x7f9f480aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 >> 172.21.2.135:0/2714485715 conn(0x7f9f4805f730 msgr2=0x7f9f48147a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 shutdown_connections 2021-11-15T14:37:52.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.296+0000 7f9f4e323700 1 -- 172.21.2.135:0/2714485715 wait complete. 2021-11-15T14:37:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:37:52.310 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:37:52.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 Processor -- start 2021-11-15T14:37:52.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 -- start start 2021-11-15T14:37:52.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f44980b3950 0x7f4498144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980b2430 con 0x7f4498060040 2021-11-15T14:37:52.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980b26d0 con 0x7f44980654a0 2021-11-15T14:37:52.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.356+0000 7f449d8cf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980b2970 con 0x7f44980b3950 2021-11-15T14:37:52.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f44980b3950 0x7f4498144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f44980b3950 0x7f4498144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57606/0 (socket says 172.21.2.135:57606) 2021-11-15T14:37:52.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/2616967254 learned_addr learned my addr 172.21.2.135:0/2616967254 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/2616967254 >> v1:172.21.2.135:6789/0 conn(0x7f44980654a0 legacy=0x7f44981444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/2616967254 >> v1:172.21.2.119:6789/0 conn(0x7f4498060040 legacy=0x7f4498064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/2616967254 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980648f0 con 0x7f44980b3950 2021-11-15T14:37:52.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- 172.21.2.135:0/2616967254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f4498144bd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f449813b870 tx=0x7f4490009290).ready entity=mon.1 client_cookie=289b30472690f679 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f4495ffb700 1 -- 172.21.2.135:0/2616967254 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449000b860 con 0x7f44980b3950 2021-11-15T14:37:52.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f4495ffb700 1 -- 172.21.2.135:0/2616967254 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000b9c0 con 0x7f44980b3950 2021-11-15T14:37:52.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f4495ffb700 1 -- 172.21.2.135:0/2616967254 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449000bb30 con 0x7f44980b3950 2021-11-15T14:37:52.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/2616967254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 msgr2=0x7f4498144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 --2- 172.21.2.135:0/2616967254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f4498144bd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f449813b870 tx=0x7f4490009290).stop 2021-11-15T14:37:52.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/2616967254 shutdown_connections 2021-11-15T14:37:52.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 --2- 172.21.2.135:0/2616967254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f4498144bd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/2616967254 >> 172.21.2.135:0/2616967254 conn(0x7f449805cfe0 msgr2=0x7f449805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/2616967254 shutdown_connections 2021-11-15T14:37:52.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/2616967254 wait complete. 2021-11-15T14:37:52.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 Processor -- start 2021-11-15T14:37:52.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- start start 2021-11-15T14:37:52.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4498060040 0x7f44981546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44980654a0 0x7f4498153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449813ee90 con 0x7f4498060040 2021-11-15T14:37:52.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980b1560 con 0x7f44980b3950 2021-11-15T14:37:52.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44980b1800 con 0x7f44980654a0 2021-11-15T14:37:52.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57610/0 (socket says 172.21.2.135:57610) 2021-11-15T14:37:52.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/1286105254 learned_addr learned my addr 172.21.2.135:0/1286105254 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44980654a0 msgr2=0x7f4498153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44980654a0 0x7f4498153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4498060040 msgr2=0x7f44981546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4498060040 0x7f44981546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 -- 172.21.2.135:0/1286105254 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490009530 con 0x7f44980b3950 2021-11-15T14:37:52.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f44977fe700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f449813b870 tx=0x7f4490016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449000b860 con 0x7f44980b3950 2021-11-15T14:37:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449001f5e0 con 0x7f44980b3950 2021-11-15T14:37:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449813e780 con 0x7f44980b3950 2021-11-15T14:37:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449001f940 con 0x7f44980b3950 2021-11-15T14:37:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44980ad7b0 con 0x7f44980b3950 2021-11-15T14:37:52.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498154420 con 0x7f44980b3950 2021-11-15T14:37:52.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4490026030 con 0x7f44980b3950 2021-11-15T14:37:52.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 0x7f447c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.360+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f449006c4a0 con 0x7f44980b3950 2021-11-15T14:37:52.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.364+0000 7f4496ffd700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 0x7f447c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.364+0000 7f4496ffd700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 0x7f447c055a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4488002f90 tx=0x7f44880069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.364+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44900437e0 con 0x7f44980b3950 2021-11-15T14:37:52.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4498060420 con 0x7f44980b3950 2021-11-15T14:37:52.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f448ffff700 1 -- 172.21.2.135:0/1286105254 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v53) v1 ==== 110+0+10 (secure 0 0 0) 0x7f44900150b0 con 0x7f44980b3950 2021-11-15T14:37:52.454 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:37:52.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 msgr2=0x7f447c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 0x7f447c055a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f4488002f90 tx=0x7f44880069b0).stop 2021-11-15T14:37:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 msgr2=0x7f44980abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f449813b870 tx=0x7f4490016000).stop 2021-11-15T14:37:52.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 shutdown_connections 2021-11-15T14:37:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f447c0535d0 0x7f447c055a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44980b3950 0x7f44980abdd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44980654a0 0x7f4498153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 --2- 172.21.2.135:0/1286105254 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4498060040 0x7f44981546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 >> 172.21.2.135:0/1286105254 conn(0x7f449805cfe0 msgr2=0x7f44980b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 shutdown_connections 2021-11-15T14:37:52.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.448+0000 7f449d8cf700 1 -- 172.21.2.135:0/1286105254 wait complete. 2021-11-15T14:37:52.461 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:37:52.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 Processor -- start 2021-11-15T14:37:52.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 -- start start 2021-11-15T14:37:52.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 0x7f59440aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5944060450 0x7f594413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5944061a10 con 0x7f594413d240 2021-11-15T14:37:52.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5944061cb0 con 0x7f5944060450 2021-11-15T14:37:52.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.508+0000 7f59492b3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944060c10 con 0x7f59440a9f40 2021-11-15T14:37:52.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5944060450 0x7f594413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f5942ffd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 0x7f59440aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5944060450 0x7f594413cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51432/0 (socket says 172.21.2.135:51432) 2021-11-15T14:37:52.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 -- 172.21.2.135:0/3417955038 learned_addr learned my addr 172.21.2.135:0/3417955038 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 -- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 msgr2=0x7f59440aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 0x7f59440aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 -- 172.21.2.135:0/3417955038 >> v1:172.21.2.119:6789/0 conn(0x7f594413d240 legacy=0x7f594413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 -- 172.21.2.135:0/3417955038 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944060eb0 con 0x7f5944060450 2021-11-15T14:37:52.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f5942ffd700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 0x7f59440aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:37:52.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59427fc700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f594413cd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f594405f8f0 tx=0x7f5934006f40).ready entity=mon.0 client_cookie=3506073d697349f7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f5941ffb700 1 -- 172.21.2.135:0/3417955038 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593400c880 con 0x7f5944060450 2021-11-15T14:37:52.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f5941ffb700 1 -- 172.21.2.135:0/3417955038 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934000e90 con 0x7f5944060450 2021-11-15T14:37:52.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f5941ffb700 1 -- 172.21.2.135:0/3417955038 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593400cbd0 con 0x7f5944060450 2021-11-15T14:37:52.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 -- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 msgr2=0x7f594413cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f594413cd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f594405f8f0 tx=0x7f5934006f40).stop 2021-11-15T14:37:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 -- 172.21.2.135:0/3417955038 shutdown_connections 2021-11-15T14:37:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f594413cd50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 --2- 172.21.2.135:0/3417955038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59440a9f40 0x7f59440aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 -- 172.21.2.135:0/3417955038 >> 172.21.2.135:0/3417955038 conn(0x7f59440b29f0 msgr2=0x7f59440b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 -- 172.21.2.135:0/3417955038 shutdown_connections 2021-11-15T14:37:52.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.512+0000 7f59492b3700 1 -- 172.21.2.135:0/3417955038 wait complete. 2021-11-15T14:37:52.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 Processor -- start 2021-11-15T14:37:52.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- start start 2021-11-15T14:37:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f5944142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f594413d240 0x7f594413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440a80d0 con 0x7f5944060450 2021-11-15T14:37:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440a8370 con 0x7f59440a9f40 2021-11-15T14:37:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440a8610 con 0x7f594413d240 2021-11-15T14:37:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57626/0 (socket says 172.21.2.135:57626) 2021-11-15T14:37:52.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 -- 172.21.2.135:0/3059022798 learned_addr learned my addr 172.21.2.135:0/3059022798 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 -- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f594413d240 msgr2=0x7f594413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f594413d240 0x7f594413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 -- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 msgr2=0x7f5944142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f5944142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 -- 172.21.2.135:0/3059022798 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c00b180 con 0x7f59440a9f40 2021-11-15T14:37:52.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59427fc700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f594405f8f0 tx=0x7f5944061ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5934002f70 con 0x7f59440a9f40 2021-11-15T14:37:52.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340068b0 con 0x7f59440a9f40 2021-11-15T14:37:52.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593400a360 con 0x7f59440a9f40 2021-11-15T14:37:52.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593401a630 con 0x7f59440a9f40 2021-11-15T14:37:52.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5944143bf0 con 0x7f59440a9f40 2021-11-15T14:37:52.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944061150 con 0x7f59440a9f40 2021-11-15T14:37:52.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f593402a070 con 0x7f59440a9f40 2021-11-15T14:37:52.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 0x7f59280559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f593406ce70 con 0x7f59440a9f40 2021-11-15T14:37:52.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.516+0000 7f5942ffd700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 0x7f59280559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.520+0000 7f5942ffd700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 0x7f59280559b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f592c00c000 tx=0x7f592c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.520+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f59340441b0 con 0x7f59440a9f40 2021-11-15T14:37:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59440573d0 con 0x7f59440a9f40 2021-11-15T14:37:52.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f593bfff700 1 -- 172.21.2.135:0/3059022798 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59340477d0 con 0x7f59440a9f40 2021-11-15T14:37:52.608 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:37:52.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 msgr2=0x7f59280559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 0x7f59280559b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f592c00c000 tx=0x7f592c006df0).stop 2021-11-15T14:37:52.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 msgr2=0x7f594413dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f594405f8f0 tx=0x7f5944061ba0).stop 2021-11-15T14:37:52.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 shutdown_connections 2021-11-15T14:37:52.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f59280534f0 0x7f59280559b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f594413d240 0x7f594413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59440a9f40 0x7f594413dde0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 --2- 172.21.2.135:0/3059022798 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5944060450 0x7f5944142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 >> 172.21.2.135:0/3059022798 conn(0x7f59440b29f0 msgr2=0x7f59440b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 shutdown_connections 2021-11-15T14:37:52.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.604+0000 7f59492b3700 1 -- 172.21.2.135:0/3059022798 wait complete. 2021-11-15T14:37:52.616 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:37:52.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.660+0000 7ff587cee700 1 Processor -- start 2021-11-15T14:37:52.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.660+0000 7ff587cee700 1 -- start start 2021-11-15T14:37:52.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff5800b0050 0x7ff580141720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800ac590 0x7ff580141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff580142100 con 0x7ff5800b2280 2021-11-15T14:37:52.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5801452d0 con 0x7ff5800b0050 2021-11-15T14:37:52.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff580145570 con 0x7ff5800ac590 2021-11-15T14:37:52.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff5800b2280 0x7ff5800abe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45218/0 (socket says 172.21.2.135:45218) 2021-11-15T14:37:52.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 -- 172.21.2.135:0/3321449728 learned_addr learned my addr 172.21.2.135:0/3321449728 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:52.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 --2- 172.21.2.135:0/3321449728 >> v2:172.21.2.135:3300/0 conn(0x7ff5800b0050 0x7ff580141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff584a88700 1 -- 172.21.2.135:0/3321449728 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684870248 0 0) 0x7ff580142100 con 0x7ff5800b2280 2021-11-15T14:37:52.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 -- 172.21.2.135:0/3321449728 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800ac590 msgr2=0x7ff580141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 --2- 172.21.2.135:0/3321449728 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800ac590 0x7ff580141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 -- 172.21.2.135:0/3321449728 >> v1:172.21.2.135:6789/0 conn(0x7ff5800b2280 legacy=0x7ff5800abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 -- 172.21.2.135:0/3321449728 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580141280 con 0x7ff5800b0050 2021-11-15T14:37:52.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 --2- 172.21.2.135:0/3321449728 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800b0050 0x7ff580141720 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ff574002f70 tx=0x7ff574006df0).ready entity=mon.1 client_cookie=58d4ef96a428e85e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff584a88700 1 -- 172.21.2.135:0/3321449728 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff574010b60 con 0x7ff5800b0050 2021-11-15T14:37:52.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff584a88700 1 -- 172.21.2.135:0/3321449728 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574000e90 con 0x7ff5800b0050 2021-11-15T14:37:52.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff584a88700 1 -- 172.21.2.135:0/3321449728 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5740183d0 con 0x7ff5800b0050 2021-11-15T14:37:52.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- 172.21.2.135:0/3321449728 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800b0050 msgr2=0x7ff580141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- 172.21.2.135:0/3321449728 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800b0050 0x7ff580141720 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ff574002f70 tx=0x7ff574006df0).stop 2021-11-15T14:37:52.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- 172.21.2.135:0/3321449728 shutdown_connections 2021-11-15T14:37:52.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- 172.21.2.135:0/3321449728 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800b0050 0x7ff580141720 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- 172.21.2.135:0/3321449728 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800ac590 0x7ff580141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:52.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- 172.21.2.135:0/3321449728 >> 172.21.2.135:0/3321449728 conn(0x7ff58005f730 msgr2=0x7ff58005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- 172.21.2.135:0/3321449728 shutdown_connections 2021-11-15T14:37:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- 172.21.2.135:0/3321449728 wait complete. 2021-11-15T14:37:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 Processor -- start 2021-11-15T14:37:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- start start 2021-11-15T14:37:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800b0050 0x7ff580066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 0x7ff5800671f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58013e500 con 0x7ff5800b2280 2021-11-15T14:37:52.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58013e730 con 0x7ff5800ac590 2021-11-15T14:37:52.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff587cee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014f020 con 0x7ff5800b0050 2021-11-15T14:37:52.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57638/0 (socket says 172.21.2.135:57638) 2021-11-15T14:37:52.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 -- 172.21.2.135:0/3416234645 learned_addr learned my addr 172.21.2.135:0/3416234645 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585289700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800b0050 0x7ff580066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 -- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800b0050 msgr2=0x7ff580066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800b0050 0x7ff580066d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 -- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 msgr2=0x7ff5800671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff58628b700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 0x7ff5800671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 0x7ff5800671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 -- 172.21.2.135:0/3416234645 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57400b180 con 0x7ff5800ac590 2021-11-15T14:37:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff58628b700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 0x7ff5800671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.664+0000 7ff585a8a700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ff57c000ed0 tx=0x7ff57c007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff57c0070d0 con 0x7ff5800ac590 2021-11-15T14:37:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c007230 con 0x7ff5800ac590 2021-11-15T14:37:52.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5800676e0 con 0x7ff5800ac590 2021-11-15T14:37:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff57c005590 con 0x7ff5800ac590 2021-11-15T14:37:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58013d500 con 0x7ff5800ac590 2021-11-15T14:37:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58014f1e0 con 0x7ff5800ac590 2021-11-15T14:37:52.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff57c01a060 con 0x7ff5800ac590 2021-11-15T14:37:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 0x7ff5600559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff57c06af00 con 0x7ff5800ac590 2021-11-15T14:37:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff585289700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 0x7ff5600559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff585289700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 0x7ff5600559e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ff57401d000 tx=0x7ff574017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.668+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff57c042240 con 0x7ff5800ac590 2021-11-15T14:37:52.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.752+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff58013e870 con 0x7ff5800ac590 2021-11-15T14:37:52.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.756+0000 7ff572ffd700 1 -- 172.21.2.135:0/3416234645 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff57c018070 con 0x7ff5800ac590 2021-11-15T14:37:52.763 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:52.763 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:37:52.763 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.763 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:37:52.764 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:37:52.764 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:37:52.764 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:37:52.765 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:37:52.765 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:37:52.765 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:37:52.765 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:37:52.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 msgr2=0x7ff5600559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 0x7ff5600559e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ff57401d000 tx=0x7ff574017000).stop 2021-11-15T14:37:52.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 msgr2=0x7ff5800af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ff57c000ed0 tx=0x7ff57c007cb0).stop 2021-11-15T14:37:52.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 shutdown_connections 2021-11-15T14:37:52.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff560053520 0x7ff5600559e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff5800b2280 0x7ff5800671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff5800b0050 0x7ff580066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 --2- 172.21.2.135:0/3416234645 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5800ac590 0x7ff5800af5f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 >> 172.21.2.135:0/3416234645 conn(0x7ff58005f730 msgr2=0x7ff5801418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 shutdown_connections 2021-11-15T14:37:52.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.760+0000 7ff587cee700 1 -- 172.21.2.135:0/3416234645 wait complete. 2021-11-15T14:37:52.771 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:37:52.771 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:37:52.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 Processor -- start 2021-11-15T14:37:52.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 -- start start 2021-11-15T14:37:52.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc8181419e0 0x7fc8180b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8180a7850 con 0x7fc8180b1350 2021-11-15T14:37:52.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8180b06d0 con 0x7fc8180b1f40 2021-11-15T14:37:52.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc81daa5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8180b17c0 con 0x7fc8181419e0 2021-11-15T14:37:52.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8177fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc8180b1f40 0x7fc8180a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45232/0 (socket says 172.21.2.135:45232) 2021-11-15T14:37:52.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8177fe700 1 -- 172.21.2.135:0/1142916649 learned_addr learned my addr 172.21.2.135:0/1142916649 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:52.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433005551 0 0) 0x7fc8180b06d0 con 0x7fc8180b1f40 2021-11-15T14:37:52.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8003260 con 0x7fc8180b1f40 2021-11-15T14:37:52.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc817fff700 1 --2- 172.21.2.135:0/1142916649 >> v2:172.21.2.119:3300/0 conn(0x7fc8181419e0 0x7fc8180b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587941761 0 0) 0x7fc7f8003260 con 0x7fc8180b1f40 2021-11-15T14:37:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 >> v2:172.21.2.119:3300/0 conn(0x7fc8181419e0 msgr2=0x7fc8180b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 --2- 172.21.2.135:0/1142916649 >> v2:172.21.2.119:3300/0 conn(0x7fc8181419e0 0x7fc8180b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 >> v1:172.21.2.119:6789/0 conn(0x7fc8180b1350 legacy=0x7fc8181412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8180b0970 con 0x7fc8180b1f40 2021-11-15T14:37:52.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc808001660 con 0x7fc8180b1f40 2021-11-15T14:37:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.820+0000 7fc817fff700 1 --2- 172.21.2.135:0/1142916649 >> v2:172.21.2.119:3300/0 conn(0x7fc8181419e0 0x7fc8180b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 >> v1:172.21.2.135:6789/0 conn(0x7fc8180b1f40 legacy=0x7fc8180a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8003820 0x7fc7f8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 0x7fc7f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f8005050 0x7fc7f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180b17c0 con 0x7fc7f8005050 2021-11-15T14:37:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f800bf40 con 0x7fc7f8004500 2021-11-15T14:37:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f800c100 con 0x7fc7f8003820 2021-11-15T14:37:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 0x7fc7f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8177fe700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8003820 0x7fc7f8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f8005050 0x7fc7f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 -- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8003820 msgr2=0x7fc7f8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8003820 0x7fc7f8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 -- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f8005050 msgr2=0x7fc7f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f8005050 0x7fc7f800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 -- 172.21.2.135:0/1142916649 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8003260 con 0x7fc7f8004500 2021-11-15T14:37:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f8005050 0x7fc7f800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 -- 172.21.2.135:0/1142916649 reap_dead start 2021-11-15T14:37:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 0x7fc7f8004980 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fc800001fa0 tx=0x7fc800007a00).ready entity=mon.1 client_cookie=2928ec2e56b07cd0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc800007070 con 0x7fc7f8004500 2021-11-15T14:37:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000071d0 con 0x7fc7f8004500 2021-11-15T14:37:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8167fc700 1 -- 172.21.2.135:0/1142916649 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc800006510 con 0x7fc7f8004500 2021-11-15T14:37:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 msgr2=0x7fc7f8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 0x7fc7f8004980 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fc800001fa0 tx=0x7fc800007a00).stop 2021-11-15T14:37:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/1142916649 shutdown_connections 2021-11-15T14:37:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 --2- 172.21.2.135:0/1142916649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f8004500 0x7fc7f8004980 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/1142916649 >> 172.21.2.135:0/1142916649 conn(0x7fc81805f730 msgr2=0x7fc81805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:52.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/1142916649 shutdown_connections 2021-11-15T14:37:52.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/1142916649 wait complete. 2021-11-15T14:37:52.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 Processor -- start 2021-11-15T14:37:52.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- start start 2021-11-15T14:37:52.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 0x7fc81813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 0x7fc818143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818149470 con 0x7fc8180ab350 2021-11-15T14:37:52.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818149710 con 0x7fc818143610 2021-11-15T14:37:52.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181499b0 con 0x7fc7f8004500 2021-11-15T14:37:52.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57660/0 (socket says 172.21.2.135:57660) 2021-11-15T14:37:52.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 -- 172.21.2.135:0/116194723 learned_addr learned my addr 172.21.2.135:0/116194723 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:52.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 0x7fc818143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 -- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 msgr2=0x7fc81813b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8177fe700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 0x7fc81813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 0x7fc81813b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 -- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 msgr2=0x7fc818143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:52.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 0x7fc818143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:52.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 -- 172.21.2.135:0/116194723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818149c50 con 0x7fc818143610 2021-11-15T14:37:52.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc8177fe700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 0x7fc81813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:52.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc816ffd700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 0x7fc818143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:52.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc817fff700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fc808001110 tx=0x7fc810008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc81000dec0 con 0x7fc818143610 2021-11-15T14:37:52.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81000c040 con 0x7fc818143610 2021-11-15T14:37:52.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8100117e0 con 0x7fc818143610 2021-11-15T14:37:52.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81813c120 con 0x7fc818143610 2021-11-15T14:37:52.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181449e0 con 0x7fc818143610 2021-11-15T14:37:52.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818149de0 con 0x7fc818143610 2021-11-15T14:37:52.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.824+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc810011940 con 0x7fc818143610 2021-11-15T14:37:52.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.828+0000 7fc814ff9700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 0x7fc7fc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:52.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.828+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc81006b9c0 con 0x7fc818143610 2021-11-15T14:37:52.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.828+0000 7fc8177fe700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 0x7fc7fc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:52.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.828+0000 7fc8177fe700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 0x7fc7fc0559b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc808006000 tx=0x7fc8180b0b00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:52.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.828+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc810042bf0 con 0x7fc818143610 2021-11-15T14:37:52.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:52.912+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc8180b0c10 con 0x7fc818143610 2021-11-15T14:37:53.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc814ff9700 1 -- 172.21.2.135:0/116194723 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc810046210 con 0x7fc818143610 2021-11-15T14:37:53.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 msgr2=0x7fc7fc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:53.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 0x7fc7fc0559b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc808006000 tx=0x7fc8180b0b00).stop 2021-11-15T14:37:53.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 msgr2=0x7fc818143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:53.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fc808001110 tx=0x7fc810008040).stop 2021-11-15T14:37:53.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 shutdown_connections 2021-11-15T14:37:53.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7fc0534f0 0x7fc7fc0559b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:53.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc818143610 0x7fc818143a90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:53.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8180ab350 0x7fc818143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:53.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 --2- 172.21.2.135:0/116194723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f8004500 0x7fc81813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:53.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 >> 172.21.2.135:0/116194723 conn(0x7fc81805f730 msgr2=0x7fc8180ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:53.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 shutdown_connections 2021-11-15T14:37:53.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.772+0000 7fc81daa5700 1 -- 172.21.2.135:0/116194723 wait complete. 2021-11-15T14:37:53.781 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:37:53.784 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:37:53.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 Processor -- start 2021-11-15T14:37:53.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- start start 2021-11-15T14:37:53.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6880b0630 0x7ff6880b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff6880a9c90 0x7ff6880b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6881439a0 con 0x7ff6880b3790 2021-11-15T14:37:53.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff688143c40 con 0x7ff6880a9c90 2021-11-15T14:37:53.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff688143ee0 con 0x7ff6880b0630 2021-11-15T14:37:53.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6880b0630 0x7ff6880b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:53.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff6880b0630 0x7ff6880b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57664/0 (socket says 172.21.2.135:57664) 2021-11-15T14:37:53.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 -- 172.21.2.135:0/3588799060 learned_addr learned my addr 172.21.2.135:0/3588799060 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:53.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 -- 172.21.2.135:0/3588799060 >> v2:172.21.2.119:3300/0 conn(0x7ff6880a9c90 msgr2=0x7ff6880b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:53.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 --2- 172.21.2.135:0/3588799060 >> v2:172.21.2.119:3300/0 conn(0x7ff6880a9c90 0x7ff6880b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:53.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 -- 172.21.2.135:0/3588799060 >> v1:172.21.2.119:6789/0 conn(0x7ff6880b3790 legacy=0x7ff68813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:53.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 -- 172.21.2.135:0/3588799060 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688144180 con 0x7ff6880b0630 2021-11-15T14:37:53.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68e536700 1 --2- 172.21.2.135:0/3588799060 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b0630 0x7ff6880b0a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff68806aad0 tx=0x7ff684006eb0).ready entity=mon.1 client_cookie=49f1f877b2184b7d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:53.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68d534700 1 -- 172.21.2.135:0/3588799060 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68400d5c0 con 0x7ff6880b0630 2021-11-15T14:37:53.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68d534700 1 -- 172.21.2.135:0/3588799060 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff684000e90 con 0x7ff6880b0630 2021-11-15T14:37:53.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff68d534700 1 -- 172.21.2.135:0/3588799060 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68400d910 con 0x7ff6880b0630 2021-11-15T14:37:53.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- 172.21.2.135:0/3588799060 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b0630 msgr2=0x7ff6880b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:53.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 --2- 172.21.2.135:0/3588799060 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b0630 0x7ff6880b0a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff68806aad0 tx=0x7ff684006eb0).stop 2021-11-15T14:37:53.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- 172.21.2.135:0/3588799060 shutdown_connections 2021-11-15T14:37:53.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 --2- 172.21.2.135:0/3588799060 >> v2:172.21.2.119:3300/0 conn(0x7ff6880a9c90 0x7ff6880b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 --2- 172.21.2.135:0/3588799060 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b0630 0x7ff6880b0a10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.832+0000 7ff69079a700 1 -- 172.21.2.135:0/3588799060 >> 172.21.2.135:0/3588799060 conn(0x7ff688060840 msgr2=0x7ff688060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- 172.21.2.135:0/3588799060 shutdown_connections 2021-11-15T14:37:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- 172.21.2.135:0/3588799060 wait complete. 2021-11-15T14:37:53.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 Processor -- start 2021-11-15T14:37:53.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- start start 2021-11-15T14:37:53.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6880a9c90 0x7ff68813ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6880b0630 0x7ff688140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880a80d0 con 0x7ff6880b0630 2021-11-15T14:37:53.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881578d0 con 0x7ff6880b3790 2021-11-15T14:37:53.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68813fda0 con 0x7ff6880a9c90 2021-11-15T14:37:53.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:53.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57672/0 (socket says 172.21.2.135:57672) 2021-11-15T14:37:53.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 -- 172.21.2.135:0/1006051350 learned_addr learned my addr 172.21.2.135:0/1006051350 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:53.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 -- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6880a9c90 msgr2=0x7ff68813ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:53.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6880a9c90 0x7ff68813ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:53.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 -- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6880b0630 msgr2=0x7ff688140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:53.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6880b0630 0x7ff688140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:53.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 -- 172.21.2.135:0/1006051350 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68400b1e0 con 0x7ff6880b3790 2021-11-15T14:37:53.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68ed37700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff688064fa0 tx=0x7ff680009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:53.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68000d580 con 0x7ff6880b3790 2021-11-15T14:37:53.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000d6e0 con 0x7ff6880b3790 2021-11-15T14:37:53.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff688157b30 con 0x7ff6880b3790 2021-11-15T14:37:53.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68000da40 con 0x7ff6880b3790 2021-11-15T14:37:53.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68813ef00 con 0x7ff6880b3790 2021-11-15T14:37:53.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68813dce0 con 0x7ff6880b3790 2021-11-15T14:37:53.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff68000dba0 con 0x7ff6880b3790 2021-11-15T14:37:53.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 0x7ff668055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:53.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5950+0+0 (secure 0 0 0) 0x7ff68006bc80 con 0x7ff6880b3790 2021-11-15T14:37:53.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.836+0000 7ff68e536700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 0x7ff668055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:53.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.840+0000 7ff68e536700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 0x7ff668055bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff68806aad0 tx=0x7ff684015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:53.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.840+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff680071020 con 0x7ff6880b3790 2021-11-15T14:37:53.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:53.924+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ff6880573d0 con 0x7ff6880b3790 2021-11-15T14:37:54.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.784+0000 7ff6777fe700 1 -- 172.21.2.135:0/1006051350 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v55) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff680042e60 con 0x7ff6880b3790 2021-11-15T14:37:54.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.784+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 msgr2=0x7ff668055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.784+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 0x7ff668055bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff68806aad0 tx=0x7ff684015000).stop 2021-11-15T14:37:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.784+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 msgr2=0x7ff688140af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.784+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7ff688064fa0 tx=0x7ff680009220).stop 2021-11-15T14:37:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 shutdown_connections 2021-11-15T14:37:54.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff6680536f0 0x7ff668055bb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6880b3790 0x7ff688140af0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6880b0630 0x7ff688140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 --2- 172.21.2.135:0/1006051350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6880a9c90 0x7ff68813ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 >> 172.21.2.135:0/1006051350 conn(0x7ff688060840 msgr2=0x7ff688135880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 shutdown_connections 2021-11-15T14:37:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.788+0000 7ff69079a700 1 -- 172.21.2.135:0/1006051350 wait complete. 2021-11-15T14:37:54.794 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:37:54.797 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:37:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 Processor -- start 2021-11-15T14:37:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 -- start start 2021-11-15T14:37:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0520 0x7f51c00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f51c00b0900 0x7f51c0140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00b2b70 con 0x7f51c00aa1a0 2021-11-15T14:37:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c00b27f0 con 0x7f51c00b0900 2021-11-15T14:37:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51c54e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00b2da0 con 0x7f51c00b0520 2021-11-15T14:37:54.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f51c00b0900 0x7f51c0140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:54.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f51c00b0900 0x7f51c0140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57678/0 (socket says 172.21.2.135:57678) 2021-11-15T14:37:54.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 -- 172.21.2.135:0/1487427842 learned_addr learned my addr 172.21.2.135:0/1487427842 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:54.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51be7fc700 1 --1- 172.21.2.135:0/1487427842 >> v1:172.21.2.135:6789/0 conn(0x7f51c00aa1a0 0x7f51c00ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45266/0 (socket says 172.21.2.135:45266) 2021-11-15T14:37:54.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 -- 172.21.2.135:0/1487427842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0520 msgr2=0x7f51c00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:54.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 --2- 172.21.2.135:0/1487427842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0520 0x7f51c00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 -- 172.21.2.135:0/1487427842 >> v1:172.21.2.135:6789/0 conn(0x7f51c00aa1a0 legacy=0x7f51c00ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 -- 172.21.2.135:0/1487427842 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00a9bf0 con 0x7f51c00b0900 2021-11-15T14:37:54.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bdffb700 1 -- 172.21.2.135:0/1487427842 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672675521 0 0) 0x7f51c00b2b70 con 0x7f51c00aa1a0 2021-11-15T14:37:54.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bf7fe700 1 --2- 172.21.2.135:0/1487427842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0900 0x7f51c0140620 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f51b80032f0 tx=0x7f51b8009290).ready entity=mon.1 client_cookie=f2bb8b52a2854877 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:54.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bdffb700 1 -- 172.21.2.135:0/1487427842 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b800b8a0 con 0x7f51c00b0900 2021-11-15T14:37:54.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bdffb700 1 -- 172.21.2.135:0/1487427842 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800ba00 con 0x7f51c00b0900 2021-11-15T14:37:54.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.848+0000 7f51bdffb700 1 -- 172.21.2.135:0/1487427842 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b800bb70 con 0x7f51c00b0900 2021-11-15T14:37:54.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/1487427842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0900 msgr2=0x7f51c0140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- 172.21.2.135:0/1487427842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0900 0x7f51c0140620 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f51b80032f0 tx=0x7f51b8009290).stop 2021-11-15T14:37:54.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/1487427842 shutdown_connections 2021-11-15T14:37:54.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- 172.21.2.135:0/1487427842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0900 0x7f51c0140620 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:54.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- 172.21.2.135:0/1487427842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0520 0x7f51c00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/1487427842 >> 172.21.2.135:0/1487427842 conn(0x7f51c0060840 msgr2=0x7f51c0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:54.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/1487427842 shutdown_connections 2021-11-15T14:37:54.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/1487427842 wait complete. 2021-11-15T14:37:54.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 Processor -- start 2021-11-15T14:37:54.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- start start 2021-11-15T14:37:54.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51c00aa1a0 0x7f51c015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0900 0x7f51c013c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c013cc10 con 0x7f51c00aa1a0 2021-11-15T14:37:54.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0159e70 con 0x7f51c00b0520 2021-11-15T14:37:54.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00b1640 con 0x7f51c00b0900 2021-11-15T14:37:54.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:54.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57682/0 (socket says 172.21.2.135:57682) 2021-11-15T14:37:54.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 -- 172.21.2.135:0/676471696 learned_addr learned my addr 172.21.2.135:0/676471696 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:54.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 -- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0900 msgr2=0x7f51c013c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0900 0x7f51c013c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 -- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51c00aa1a0 msgr2=0x7f51c015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51c00aa1a0 0x7f51c015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 -- 172.21.2.135:0/676471696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009530 con 0x7f51c00b0520 2021-11-15T14:37:54.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51be7fc700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f51a8000bc0 tx=0x7f51a8007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:54.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a800ce50 con 0x7f51c00b0520 2021-11-15T14:37:54.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a80072e0 con 0x7f51c00b0520 2021-11-15T14:37:54.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a8005740 con 0x7f51c00b0520 2021-11-15T14:37:54.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c013ce40 con 0x7f51c00b0520 2021-11-15T14:37:54.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c015a340 con 0x7f51c00b0520 2021-11-15T14:37:54.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c015a500 con 0x7f51c00b0520 2021-11-15T14:37:54.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f51a8010070 con 0x7f51c00b0520 2021-11-15T14:37:54.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 0x7f51a4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:54.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f51a806b100 con 0x7f51c00b0520 2021-11-15T14:37:54.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.852+0000 7f51beffd700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 0x7f51a4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:54.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.856+0000 7f51beffd700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 0x7f51a4055b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f51b0002f70 tx=0x7f51b0006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:54.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.856+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51a8042180 con 0x7f51c00b0520 2021-11-15T14:37:54.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.972+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f51c00573d0 con 0x7f51c00b0520 2021-11-15T14:37:54.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51b7fff700 1 -- 172.21.2.135:0/676471696 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v25) v1 ==== 188+0+0 (secure 0 0 0) 0x7f51a80457a0 con 0x7f51c00b0520 2021-11-15T14:37:54.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 msgr2=0x7f51a4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 0x7f51a4055b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f51b0002f70 tx=0x7f51b0006a80).stop 2021-11-15T14:37:54.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 msgr2=0x7f51c0139e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:54.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f51a8000bc0 tx=0x7f51a8007a60).stop 2021-11-15T14:37:54.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 shutdown_connections 2021-11-15T14:37:54.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f51a4053640 0x7f51a4055b00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:54.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51c00b0900 0x7f51c013c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f51c00b0520 0x7f51c0139e70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:54.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 --2- 172.21.2.135:0/676471696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51c00aa1a0 0x7f51c015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:54.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 >> 172.21.2.135:0/676471696 conn(0x7f51c0060840 msgr2=0x7f51c013e610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:54.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 shutdown_connections 2021-11-15T14:37:54.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:54.988+0000 7f51c54e3700 1 -- 172.21.2.135:0/676471696 wait complete. 2021-11-15T14:37:54.997 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 9 and data pool 10 2021-11-15T14:37:55.001 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:37:55.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.044+0000 7f0e1a262700 1 Processor -- start 2021-11-15T14:37:55.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.044+0000 7f0e1a262700 1 -- start start 2021-11-15T14:37:55.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0e140b1300 0x7f0e140b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e14140d70 0x7f0e140b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e14140390 con 0x7f0e140a8cf0 2021-11-15T14:37:55.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e14140630 con 0x7f0e140b1300 2021-11-15T14:37:55.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e141408d0 con 0x7f0e14140d70 2021-11-15T14:37:55.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e14140d70 0x7f0e140b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e13fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0e140a8cf0 0x7f0e140ae730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45290/0 (socket says 172.21.2.135:45290) 2021-11-15T14:37:55.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e13fff700 1 -- 172.21.2.135:0/4166649807 learned_addr learned my addr 172.21.2.135:0/4166649807 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:55.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/4166649807 >> v2:172.21.2.119:3300/0 conn(0x7f0e140b1300 msgr2=0x7f0e140b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:55.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- 172.21.2.135:0/4166649807 >> v2:172.21.2.119:3300/0 conn(0x7f0e140b1300 0x7f0e140b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/4166649807 >> v1:172.21.2.135:6789/0 conn(0x7f0e140a8cf0 legacy=0x7f0e140ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/4166649807 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14140080 con 0x7f0e14140d70 2021-11-15T14:37:55.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- 172.21.2.135:0/4166649807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e14140d70 0x7f0e140b21e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006df0).ready entity=mon.1 client_cookie=c84f8ab89afde0ca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e127fc700 1 -- 172.21.2.135:0/4166649807 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d5c0 con 0x7f0e14140d70 2021-11-15T14:37:55.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e127fc700 1 -- 172.21.2.135:0/4166649807 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc000e90 con 0x7f0e14140d70 2021-11-15T14:37:55.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e127fc700 1 -- 172.21.2.135:0/4166649807 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d910 con 0x7f0e14140d70 2021-11-15T14:37:55.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/4166649807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e14140d70 msgr2=0x7f0e140b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- 172.21.2.135:0/4166649807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e14140d70 0x7f0e140b21e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006df0).stop 2021-11-15T14:37:55.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/4166649807 shutdown_connections 2021-11-15T14:37:55.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- 172.21.2.135:0/4166649807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e14140d70 0x7f0e140b21e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- 172.21.2.135:0/4166649807 >> v2:172.21.2.119:3300/0 conn(0x7f0e140b1300 0x7f0e140b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/4166649807 >> 172.21.2.135:0/4166649807 conn(0x7f0e1405f730 msgr2=0x7f0e1405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:55.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/4166649807 shutdown_connections 2021-11-15T14:37:55.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/4166649807 wait complete. 2021-11-15T14:37:55.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 Processor -- start 2021-11-15T14:37:55.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- start start 2021-11-15T14:37:55.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e140a8cf0 0x7f0e140a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e14140d70 0x7f0e14154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1413d9d0 con 0x7f0e140a8cf0 2021-11-15T14:37:55.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141319c0 con 0x7f0e140b1300 2021-11-15T14:37:55.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140af3b0 con 0x7f0e14140d70 2021-11-15T14:37:55.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57708/0 (socket says 172.21.2.135:57708) 2021-11-15T14:37:55.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/769821531 learned_addr learned my addr 172.21.2.135:0/769821531 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:55.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e14140d70 msgr2=0x7f0e14154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e14140d70 0x7f0e14154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e140a8cf0 msgr2=0x7f0e140a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e140a8cf0 0x7f0e140a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 -- 172.21.2.135:0/769821531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc00b180 con 0x7f0e140b1300 2021-11-15T14:37:55.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e12ffd700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0e14131640 tx=0x7f0dfc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc01e400 con 0x7f0e140b1300 2021-11-15T14:37:55.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc01e560 con 0x7f0e140b1300 2021-11-15T14:37:55.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e14131720 con 0x7f0e140b1300 2021-11-15T14:37:55.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc01e8c0 con 0x7f0e140b1300 2021-11-15T14:37:55.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.048+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e140aef00 con 0x7f0e140b1300 2021-11-15T14:37:55.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e140af210 con 0x7f0e140b1300 2021-11-15T14:37:55.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0dfc025030 con 0x7f0e140b1300 2021-11-15T14:37:55.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e10ff9700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 0x7f0df8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0dfc06ca80 con 0x7f0e140b1300 2021-11-15T14:37:55.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e137fe700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 0x7f0df8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e137fe700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 0x7f0df8055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0e04002f70 tx=0x7f0e04006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.052+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e140af210 con 0x7f0e140b1300 2021-11-15T14:37:55.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e14156c10 con 0x7f0e140b1300 2021-11-15T14:37:55.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e10ff9700 1 -- 172.21.2.135:0/769821531 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f0e14156c10 con 0x7f0e140b1300 2021-11-15T14:37:55.144 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:55.145 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":57,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:54.978839+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:37:52.935747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T14:37:53.946772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:37:55.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 msgr2=0x7f0df8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 0x7f0df8055b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0e04002f70 tx=0x7f0e04006a80).stop 2021-11-15T14:37:55.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 msgr2=0x7f0e14153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0e14131640 tx=0x7f0dfc014000).stop 2021-11-15T14:37:55.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 shutdown_connections 2021-11-15T14:37:55.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0df80536a0 0x7f0df8055b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e14140d70 0x7f0e14154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e140b1300 0x7f0e14153d90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 --2- 172.21.2.135:0/769821531 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e140a8cf0 0x7f0e140a7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 >> 172.21.2.135:0/769821531 conn(0x7f0e1405f730 msgr2=0x7f0e140a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:55.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 shutdown_connections 2021-11-15T14:37:55.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.140+0000 7f0e1a262700 1 -- 172.21.2.135:0/769821531 wait complete. 2021-11-15T14:37:55.152 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:37:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 Processor -- start 2021-11-15T14:37:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 -- start start 2021-11-15T14:37:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7b940b6980 0x7f7b940acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b94060990 0x7f7b940a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940b6d60 con 0x7f7b940aa430 2021-11-15T14:37:55.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b94061260 con 0x7f7b940b6980 2021-11-15T14:37:55.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.196+0000 7f7b99a85700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94061500 con 0x7f7b94060990 2021-11-15T14:37:55.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b93fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7b940aa430 0x7f7b940b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45302/0 (socket says 172.21.2.135:45302) 2021-11-15T14:37:55.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b93fff700 1 -- 172.21.2.135:0/3998396265 learned_addr learned my addr 172.21.2.135:0/3998396265 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:55.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/3998396265 >> v2:172.21.2.135:3300/0 conn(0x7f7b940b6980 0x7f7b940acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/3998396265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b94060990 msgr2=0x7f7b940a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:55.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/3998396265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b94060990 0x7f7b940a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/3998396265 >> v1:172.21.2.135:6789/0 conn(0x7f7b940aa430 legacy=0x7f7b940b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/3998396265 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940617a0 con 0x7f7b940b6980 2021-11-15T14:37:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/3998396265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b940b6980 0x7f7b940acdd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7b8c001490 tx=0x7f7b84007f00).ready entity=mon.1 client_cookie=7e42df0a3778a24b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b927fc700 1 -- 172.21.2.135:0/3998396265 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b84007570 con 0x7f7b940b6980 2021-11-15T14:37:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b927fc700 1 -- 172.21.2.135:0/3998396265 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84000e90 con 0x7f7b940b6980 2021-11-15T14:37:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b927fc700 1 -- 172.21.2.135:0/3998396265 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b840058e0 con 0x7f7b940b6980 2021-11-15T14:37:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/3998396265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b940b6980 msgr2=0x7f7b940acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- 172.21.2.135:0/3998396265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b940b6980 0x7f7b940acdd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f7b8c001490 tx=0x7f7b84007f00).stop 2021-11-15T14:37:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/3998396265 shutdown_connections 2021-11-15T14:37:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- 172.21.2.135:0/3998396265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b94060990 0x7f7b940a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- 172.21.2.135:0/3998396265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b940b6980 0x7f7b940acdd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/3998396265 >> 172.21.2.135:0/3998396265 conn(0x7f7b940b3500 msgr2=0x7f7b940b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/3998396265 shutdown_connections 2021-11-15T14:37:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/3998396265 wait complete. 2021-11-15T14:37:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 Processor -- start 2021-11-15T14:37:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- start start 2021-11-15T14:37:55.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b940aa430 0x7f7b94152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b940b6980 0x7f7b94153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94153670 con 0x7f7b940b6980 2021-11-15T14:37:55.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9413da30 con 0x7f7b94060990 2021-11-15T14:37:55.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9413dcd0 con 0x7f7b940aa430 2021-11-15T14:37:55.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57724/0 (socket says 172.21.2.135:57724) 2021-11-15T14:37:55.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/1599150819 learned_addr learned my addr 172.21.2.135:0/1599150819 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:55.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b940aa430 msgr2=0x7f7b94152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b940aa430 0x7f7b94152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b940b6980 msgr2=0x7f7b94153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b940b6980 0x7f7b94153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 -- 172.21.2.135:0/1599150819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8400c200 con 0x7f7b94060990 2021-11-15T14:37:55.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b937fe700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f7b8c001490 tx=0x7f7b84017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b8401b880 con 0x7f7b94060990 2021-11-15T14:37:55.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8401b9e0 con 0x7f7b94060990 2021-11-15T14:37:55.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b8401bd40 con 0x7f7b94060990 2021-11-15T14:37:55.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9413df70 con 0x7f7b94060990 2021-11-15T14:37:55.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.200+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94140b40 con 0x7f7b94060990 2021-11-15T14:37:55.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9413d7a0 con 0x7f7b94060990 2021-11-15T14:37:55.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b8402b070 con 0x7f7b94060990 2021-11-15T14:37:55.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b90ff9700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 0x7f7b780559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7b8406cc00 con 0x7f7b94060990 2021-11-15T14:37:55.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b92ffd700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 0x7f7b780559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b92ffd700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 0x7f7b780559b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7b7c002f70 tx=0x7f7b7c0069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.204+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b84043a80 con 0x7f7b94060990 2021-11-15T14:37:55.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b94061a40 con 0x7f7b94060990 2021-11-15T14:37:55.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b90ff9700 1 -- 172.21.2.135:0/1599150819 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f7b840470a0 con 0x7f7b94060990 2021-11-15T14:37:55.297 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:55.297 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":57,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:54.978839+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:37:52.935747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T14:37:53.946772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:37:55.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 msgr2=0x7f7b780559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 0x7f7b780559b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7b7c002f70 tx=0x7f7b7c0069e0).stop 2021-11-15T14:37:55.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 msgr2=0x7f7b940b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f7b8c001490 tx=0x7f7b84017000).stop 2021-11-15T14:37:55.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 shutdown_connections 2021-11-15T14:37:55.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b780534f0 0x7f7b780559b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b940b6980 0x7f7b94153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b940aa430 0x7f7b94152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 --2- 172.21.2.135:0/1599150819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b94060990 0x7f7b940b1ab0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 >> 172.21.2.135:0/1599150819 conn(0x7f7b940b3500 msgr2=0x7f7b94133a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:55.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 shutdown_connections 2021-11-15T14:37:55.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.292+0000 7f7b99a85700 1 -- 172.21.2.135:0/1599150819 wait complete. 2021-11-15T14:37:55.305 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:37:55.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 Processor -- start 2021-11-15T14:37:55.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 -- start start 2021-11-15T14:37:55.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b0630 0x7f69c40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f69c40b3790 0x7f69c413d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f69c413dac0 0x7f69c40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c41439a0 con 0x7f69c413dac0 2021-11-15T14:37:55.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c4143c40 con 0x7f69c40b3790 2021-11-15T14:37:55.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4143ee0 con 0x7f69c40b0630 2021-11-15T14:37:55.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f69c40b3790 0x7f69c413d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f69c40b3790 0x7f69c413d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57732/0 (socket says 172.21.2.135:57732) 2021-11-15T14:37:55.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 -- 172.21.2.135:0/718934956 learned_addr learned my addr 172.21.2.135:0/718934956 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:55.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 -- 172.21.2.135:0/718934956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b0630 msgr2=0x7f69c40b0a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:55.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 --2- 172.21.2.135:0/718934956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b0630 0x7f69c40b0a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 -- 172.21.2.135:0/718934956 >> v2:172.21.2.119:3300/0 conn(0x7f69c413dac0 msgr2=0x7f69c40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:55.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 --2- 172.21.2.135:0/718934956 >> v2:172.21.2.119:3300/0 conn(0x7f69c413dac0 0x7f69c40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 -- 172.21.2.135:0/718934956 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4144180 con 0x7f69c40b3790 2021-11-15T14:37:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c2ffd700 1 --2- 172.21.2.135:0/718934956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b3790 0x7f69c413d5d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f69ac002f70 tx=0x7f69ac006f40).ready entity=mon.1 client_cookie=722151690a4c00aa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c27fc700 1 -- 172.21.2.135:0/718934956 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac00dc70 con 0x7f69c40b3790 2021-11-15T14:37:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c27fc700 1 -- 172.21.2.135:0/718934956 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac000e90 con 0x7f69c40b3790 2021-11-15T14:37:55.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c27fc700 1 -- 172.21.2.135:0/718934956 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac00be90 con 0x7f69c40b3790 2021-11-15T14:37:55.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 -- 172.21.2.135:0/718934956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b3790 msgr2=0x7f69c413d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:55.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.352+0000 7f69c9f53700 1 --2- 172.21.2.135:0/718934956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b3790 0x7f69c413d5d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f69ac002f70 tx=0x7f69ac006f40).stop 2021-11-15T14:37:55.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/718934956 shutdown_connections 2021-11-15T14:37:55.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- 172.21.2.135:0/718934956 >> v2:172.21.2.119:3300/0 conn(0x7f69c413dac0 0x7f69c40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- 172.21.2.135:0/718934956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b3790 0x7f69c413d5d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:55.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- 172.21.2.135:0/718934956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b0630 0x7f69c40b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/718934956 >> 172.21.2.135:0/718934956 conn(0x7f69c4060840 msgr2=0x7f69c4060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:55.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/718934956 shutdown_connections 2021-11-15T14:37:55.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/718934956 wait complete. 2021-11-15T14:37:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 Processor -- start 2021-11-15T14:37:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- start start 2021-11-15T14:37:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b3790 0x7f69c415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69c413dac0 0x7f69c415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c40658a0 con 0x7f69c413dac0 2021-11-15T14:37:55.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c413f650 con 0x7f69c40b0630 2021-11-15T14:37:55.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415afe0 con 0x7f69c40b3790 2021-11-15T14:37:55.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57736/0 (socket says 172.21.2.135:57736) 2021-11-15T14:37:55.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 -- 172.21.2.135:0/2813303903 learned_addr learned my addr 172.21.2.135:0/2813303903 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:55.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 -- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b3790 msgr2=0x7f69c415a600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:55.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b3790 0x7f69c415a600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 -- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69c413dac0 msgr2=0x7f69c415aaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:55.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69c413dac0 0x7f69c415aaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:55.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 -- 172.21.2.135:0/2813303903 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac00b460 con 0x7f69c40b0630 2021-11-15T14:37:55.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c37fe700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f69b4002fb0 tx=0x7f69b4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b4013460 con 0x7f69c40b0630 2021-11-15T14:37:55.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40135c0 con 0x7f69c40b0630 2021-11-15T14:37:55.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69b4013920 con 0x7f69c40b0630 2021-11-15T14:37:55.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c413ed10 con 0x7f69c40b0630 2021-11-15T14:37:55.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c413e7d0 con 0x7f69c40b0630 2021-11-15T14:37:55.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4143620 con 0x7f69c40b0630 2021-11-15T14:37:55.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f69b400f070 con 0x7f69c40b0630 2021-11-15T14:37:55.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 0x7f69a8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:55.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f69b406b540 con 0x7f69c40b0630 2021-11-15T14:37:55.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.356+0000 7f69c2ffd700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 0x7f69a8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:55.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.360+0000 7f69c2ffd700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 0x7f69a8055a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f69ac002f70 tx=0x7f69c4144310).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:55.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.360+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69b4042550 con 0x7f69c40b0630 2021-11-15T14:37:55.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.468+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f69c40573d0 con 0x7f69c40b0630 2021-11-15T14:37:56.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c0ff9700 1 -- 172.21.2.135:0/2813303903 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7f69b4045b70 con 0x7f69c40b0630 2021-11-15T14:37:56.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 msgr2=0x7f69a8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 0x7f69a8055a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f69ac002f70 tx=0x7f69c4144310).stop 2021-11-15T14:37:56.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 msgr2=0x7f69c40a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f69b4002fb0 tx=0x7f69b4006df0).stop 2021-11-15T14:37:56.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 shutdown_connections 2021-11-15T14:37:56.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f69a80535d0 0x7f69a8055a90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f69c413dac0 0x7f69c415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f69c40b3790 0x7f69c415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 --2- 172.21.2.135:0/2813303903 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69c40b0630 0x7f69c40a8410 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 >> 172.21.2.135:0/2813303903 conn(0x7f69c4060840 msgr2=0x7f69c4141450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 shutdown_connections 2021-11-15T14:37:56.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:55.996+0000 7f69c9f53700 1 -- 172.21.2.135:0/2813303903 wait complete. 2021-11-15T14:37:56.008 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:56.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 Processor -- start 2021-11-15T14:37:56.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- start start 2021-11-15T14:37:56.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa3700b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 0x7fa3701447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3700b03d0 con 0x7fa3700b1e30 2021-11-15T14:37:56.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3700a9140 con 0x7fa3700a7140 2021-11-15T14:37:56.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700b0670 con 0x7fa370148420 2021-11-15T14:37:56.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa3700b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa3755fc700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa3700b1e30 0x7fa3700b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:54746/0 (socket says 172.21.2.135:54746) 2021-11-15T14:37:56.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa3755fc700 1 -- 172.21.2.135:0/271179867 learned_addr learned my addr 172.21.2.135:0/271179867 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:56.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa375dfd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 0x7fa3701447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa363fff700 1 -- 172.21.2.135:0/271179867 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081738548 0 0) 0x7fa3700b03d0 con 0x7fa3700b1e30 2021-11-15T14:37:56.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa363fff700 1 -- 172.21.2.135:0/271179867 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa358003260 con 0x7fa3700b1e30 2021-11-15T14:37:56.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 -- 172.21.2.135:0/271179867 >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 msgr2=0x7fa3701447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 --2- 172.21.2.135:0/271179867 >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 0x7fa3701447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 -- 172.21.2.135:0/271179867 >> v1:172.21.2.119:6789/0 conn(0x7fa3700b1e30 legacy=0x7fa3700b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 -- 172.21.2.135:0/271179867 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700b0910 con 0x7fa370148420 2021-11-15T14:37:56.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa375dfd700 1 --2- 172.21.2.135:0/271179867 >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 0x7fa3701447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:37:56.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa374dfb700 1 --2- 172.21.2.135:0/271179867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa3700b1050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa36c001110 tx=0x7fa364006df0).ready entity=mon.2 client_cookie=baecf325c8ed87ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa363fff700 1 -- 172.21.2.135:0/271179867 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa36400d4a0 con 0x7fa370148420 2021-11-15T14:37:56.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa363fff700 1 -- 172.21.2.135:0/271179867 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364000e90 con 0x7fa370148420 2021-11-15T14:37:56.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa363fff700 1 -- 172.21.2.135:0/271179867 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa36400d7f0 con 0x7fa370148420 2021-11-15T14:37:56.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- 172.21.2.135:0/271179867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 msgr2=0x7fa3700b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 --2- 172.21.2.135:0/271179867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa3700b1050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa36c001110 tx=0x7fa364006df0).stop 2021-11-15T14:37:56.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- 172.21.2.135:0/271179867 shutdown_connections 2021-11-15T14:37:56.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 --2- 172.21.2.135:0/271179867 >> v2:172.21.2.119:3300/0 conn(0x7fa3700a7140 0x7fa3701447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 --2- 172.21.2.135:0/271179867 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa3700b1050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- 172.21.2.135:0/271179867 >> 172.21.2.135:0/271179867 conn(0x7fa37005f730 msgr2=0x7fa37005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- 172.21.2.135:0/271179867 shutdown_connections 2021-11-15T14:37:56.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.056+0000 7fa377860700 1 -- 172.21.2.135:0/271179867 wait complete. 2021-11-15T14:37:56.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 Processor -- start 2021-11-15T14:37:56.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- start start 2021-11-15T14:37:56.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa370143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370144470 con 0x7fa3700b1e30 2021-11-15T14:37:56.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700abfb0 con 0x7fa3700a7140 2021-11-15T14:37:56.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700ac250 con 0x7fa370148420 2021-11-15T14:37:56.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3755fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51566/0 (socket says 172.21.2.135:51566) 2021-11-15T14:37:56.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa375dfd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa370143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 -- 172.21.2.135:0/2049713177 learned_addr learned my addr 172.21.2.135:0/2049713177 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3755fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57748/0 (socket says 172.21.2.135:57748) 2021-11-15T14:37:56.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 -- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 msgr2=0x7fa370143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa370143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 -- 172.21.2.135:0/2049713177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 msgr2=0x7fa37014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 -- 172.21.2.135:0/2049713177 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368009470 con 0x7fa3700b1e30 2021-11-15T14:37:56.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3755fc700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:37:56.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa374dfb700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa36c001110 tx=0x7fa364014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa364012930 con 0x7fa3700b1e30 2021-11-15T14:37:56.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364012a90 con 0x7fa3700b1e30 2021-11-15T14:37:56.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36400b180 con 0x7fa3700b1e30 2021-11-15T14:37:56.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3700ac790 con 0x7fa3700b1e30 2021-11-15T14:37:56.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa364012df0 con 0x7fa3700b1e30 2021-11-15T14:37:56.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3700573d0 con 0x7fa3700b1e30 2021-11-15T14:37:56.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.060+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa36401c070 con 0x7fa3700b1e30 2021-11-15T14:37:56.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.064+0000 7fa3627fc700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 0x7fa350055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.064+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa36406ca90 con 0x7fa3700b1e30 2021-11-15T14:37:56.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.064+0000 7fa3755fc700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 0x7fa350055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.064+0000 7fa3755fc700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 0x7fa350055a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fa36c00d000 tx=0x7fa36c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.068+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa364043a40 con 0x7fa3700b1e30 2021-11-15T14:37:56.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.176+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3700446d0 con 0x7fa3700b1e30 2021-11-15T14:37:56.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa3627fc700 1 -- 172.21.2.135:0/2049713177 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fa364019090 con 0x7fa3700b1e30 2021-11-15T14:37:56.184 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:56.184 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:37:56.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 msgr2=0x7fa350055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 0x7fa350055a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fa36c00d000 tx=0x7fa36c009040).stop 2021-11-15T14:37:56.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 msgr2=0x7fa370143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa36c001110 tx=0x7fa364014000).stop 2021-11-15T14:37:56.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 shutdown_connections 2021-11-15T14:37:56.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa350053580 0x7fa350055a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa370148420 0x7fa370143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa3700b1e30 0x7fa370143a90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 --2- 172.21.2.135:0/2049713177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa3700a7140 0x7fa37014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 >> 172.21.2.135:0/2049713177 conn(0x7fa37005f730 msgr2=0x7fa3700aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 shutdown_connections 2021-11-15T14:37:56.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.180+0000 7fa377860700 1 -- 172.21.2.135:0/2049713177 wait complete. 2021-11-15T14:37:56.188 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:37:56.191 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:37:56.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 Processor -- start 2021-11-15T14:37:56.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 -- start start 2021-11-15T14:37:56.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f97b8060990 0x7f97b80acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b80b6d60 con 0x7f97b80b6980 2021-11-15T14:37:56.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b8061260 con 0x7f97b80aa650 2021-11-15T14:37:56.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bf50d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b805cc20 con 0x7f97b8060990 2021-11-15T14:37:56.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bdaaa700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f97b80aa650 0x7f97b805c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45346/0 (socket says 172.21.2.135:45346) 2021-11-15T14:37:56.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bdaaa700 1 -- 172.21.2.135:0/3820908511 learned_addr learned my addr 172.21.2.135:0/3820908511 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:56.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bcaa8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f97b8060990 0x7f97b80acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bcaa8700 1 -- 172.21.2.135:0/3820908511 >> v1:172.21.2.135:6789/0 conn(0x7f97b80aa650 legacy=0x7f97b805c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bcaa8700 1 -- 172.21.2.135:0/3820908511 >> v1:172.21.2.119:6789/0 conn(0x7f97b80b6980 legacy=0x7f97b80a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bcaa8700 1 -- 172.21.2.135:0/3820908511 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8061500 con 0x7f97b8060990 2021-11-15T14:37:56.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.236+0000 7f97bcaa8700 1 --2- 172.21.2.135:0/3820908511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b8060990 0x7f97b80acdd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f97b8060380 tx=0x7f97b4006df0).ready entity=mon.1 client_cookie=778543c7be36b2a8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a7fff700 1 -- 172.21.2.135:0/3820908511 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b400d5c0 con 0x7f97b8060990 2021-11-15T14:37:56.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a7fff700 1 -- 172.21.2.135:0/3820908511 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4000e90 con 0x7f97b8060990 2021-11-15T14:37:56.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a7fff700 1 -- 172.21.2.135:0/3820908511 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b400d910 con 0x7f97b8060990 2021-11-15T14:37:56.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/3820908511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b8060990 msgr2=0x7f97b80acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 --2- 172.21.2.135:0/3820908511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b8060990 0x7f97b80acdd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f97b8060380 tx=0x7f97b4006df0).stop 2021-11-15T14:37:56.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/3820908511 shutdown_connections 2021-11-15T14:37:56.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 --2- 172.21.2.135:0/3820908511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b8060990 0x7f97b80acdd0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/3820908511 >> 172.21.2.135:0/3820908511 conn(0x7f97b80b3500 msgr2=0x7f97b80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/3820908511 shutdown_connections 2021-11-15T14:37:56.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/3820908511 wait complete. 2021-11-15T14:37:56.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 Processor -- start 2021-11-15T14:37:56.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- start start 2021-11-15T14:37:56.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97b8060990 0x7f97b80633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97b80b6980 0x7f97b8141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8143ba0 con 0x7f97b8060990 2021-11-15T14:37:56.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8142270 con 0x7f97b80aa650 2021-11-15T14:37:56.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b81433c0 con 0x7f97b80b6980 2021-11-15T14:37:56.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57762/0 (socket says 172.21.2.135:57762) 2021-11-15T14:37:56.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 -- 172.21.2.135:0/997797771 learned_addr learned my addr 172.21.2.135:0/997797771 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 -- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97b80b6980 msgr2=0x7f97b8141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97b80b6980 0x7f97b8141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 -- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97b8060990 msgr2=0x7f97b80633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97b8060990 0x7f97b80633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 -- 172.21.2.135:0/997797771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b400b180 con 0x7f97b80aa650 2021-11-15T14:37:56.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bcaa8700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f97b8143ce0 tx=0x7f97b4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b4016070 con 0x7f97b80aa650 2021-11-15T14:37:56.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400de70 con 0x7f97b80aa650 2021-11-15T14:37:56.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8143660 con 0x7f97b80aa650 2021-11-15T14:37:56.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b80ad430 con 0x7f97b80aa650 2021-11-15T14:37:56.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b401e450 con 0x7f97b80aa650 2021-11-15T14:37:56.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b80617a0 con 0x7f97b80aa650 2021-11-15T14:37:56.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97b4025030 con 0x7f97b80aa650 2021-11-15T14:37:56.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 0x7f9798055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.240+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f97b406cda0 con 0x7f97b80aa650 2021-11-15T14:37:56.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.244+0000 7f97bd2a9700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 0x7f9798055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.244+0000 7f97bd2a9700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 0x7f9798055b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f97a8002ef0 tx=0x7f97a8006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.244+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97b4043ca0 con 0x7f97b80aa650 2021-11-15T14:37:56.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97b80573d0 con 0x7f97b80aa650 2021-11-15T14:37:56.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97a67fc700 1 -- 172.21.2.135:0/997797771 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f97b40472c0 con 0x7f97b80aa650 2021-11-15T14:37:56.332 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:56.333 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":58,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:55.984224+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:37:52.935747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T14:37:53.946772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:37:56.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 msgr2=0x7f9798055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 0x7f9798055b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f97a8002ef0 tx=0x7f97a8006910).stop 2021-11-15T14:37:56.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 msgr2=0x7f97b8141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f97b8143ce0 tx=0x7f97b4014000).stop 2021-11-15T14:37:56.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 shutdown_connections 2021-11-15T14:37:56.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9798053690 0x7f9798055b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f97b80b6980 0x7f97b8141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f97b80aa650 0x7f97b8141890 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 --2- 172.21.2.135:0/997797771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f97b8060990 0x7f97b80633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 >> 172.21.2.135:0/997797771 conn(0x7f97b80b3500 msgr2=0x7f97b813f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 shutdown_connections 2021-11-15T14:37:56.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.328+0000 7f97bf50d700 1 -- 172.21.2.135:0/997797771 wait complete. 2021-11-15T14:37:56.339 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:37:56.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 Processor -- start 2021-11-15T14:37:56.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 -- start start 2021-11-15T14:37:56.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe83c0ad150 0x7fe83c13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe83c0afca0 0x7fe83c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0b0bb0 0x7fe83c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0b04b0 con 0x7fe83c0afca0 2021-11-15T14:37:56.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0ad530 con 0x7fe83c0ad150 2021-11-15T14:37:56.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe843a5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0b57d0 con 0x7fe83c0b0bb0 2021-11-15T14:37:56.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe8417fb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe83c0ad150 0x7fe83c13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe8417fb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe83c0ad150 0x7fe83c13f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57770/0 (socket says 172.21.2.135:57770) 2021-11-15T14:37:56.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.388+0000 7fe8417fb700 1 -- 172.21.2.135:0/1797699499 learned_addr learned my addr 172.21.2.135:0/1797699499 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 -- 172.21.2.135:0/1797699499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0b0bb0 msgr2=0x7fe83c13fb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:56.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 --2- 172.21.2.135:0/1797699499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0b0bb0 0x7fe83c13fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 -- 172.21.2.135:0/1797699499 >> v2:172.21.2.119:3300/0 conn(0x7fe83c0afca0 msgr2=0x7fe83c13f640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:56.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 --2- 172.21.2.135:0/1797699499 >> v2:172.21.2.119:3300/0 conn(0x7fe83c0afca0 0x7fe83c13f640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 -- 172.21.2.135:0/1797699499 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c0b06e0 con 0x7fe83c0ad150 2021-11-15T14:37:56.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe8417fb700 1 --2- 172.21.2.135:0/1797699499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0ad150 0x7fe83c13f150 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fe82c002f70 tx=0x7fe82c006e40).ready entity=mon.1 client_cookie=3f4b21753dd790b0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82bfff700 1 -- 172.21.2.135:0/1797699499 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82c00bcf0 con 0x7fe83c0ad150 2021-11-15T14:37:56.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82bfff700 1 -- 172.21.2.135:0/1797699499 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c000e90 con 0x7fe83c0ad150 2021-11-15T14:37:56.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82bfff700 1 -- 172.21.2.135:0/1797699499 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82c0155e0 con 0x7fe83c0ad150 2021-11-15T14:37:56.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/1797699499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0ad150 msgr2=0x7fe83c13f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- 172.21.2.135:0/1797699499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0ad150 0x7fe83c13f150 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fe82c002f70 tx=0x7fe82c006e40).stop 2021-11-15T14:37:56.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/1797699499 shutdown_connections 2021-11-15T14:37:56.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- 172.21.2.135:0/1797699499 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0b0bb0 0x7fe83c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- 172.21.2.135:0/1797699499 >> v2:172.21.2.119:3300/0 conn(0x7fe83c0afca0 0x7fe83c13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- 172.21.2.135:0/1797699499 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0ad150 0x7fe83c13f150 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/1797699499 >> 172.21.2.135:0/1797699499 conn(0x7fe83c062cb0 msgr2=0x7fe83c063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/1797699499 shutdown_connections 2021-11-15T14:37:56.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/1797699499 wait complete. 2021-11-15T14:37:56.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 Processor -- start 2021-11-15T14:37:56.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- start start 2021-11-15T14:37:56.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0ad150 0x7fe83c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe83c0b0bb0 0x7fe83c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c134720 con 0x7fe83c0b0bb0 2021-11-15T14:37:56.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c156a60 con 0x7fe83c0afca0 2021-11-15T14:37:56.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c156d00 con 0x7fe83c0ad150 2021-11-15T14:37:56.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57776/0 (socket says 172.21.2.135:57776) 2021-11-15T14:37:56.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 -- 172.21.2.135:0/850703084 learned_addr learned my addr 172.21.2.135:0/850703084 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 -- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0ad150 msgr2=0x7fe83c157440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:56.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0ad150 0x7fe83c157440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 -- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe83c0b0bb0 msgr2=0x7fe83c159e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:56.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe83c0b0bb0 0x7fe83c159e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 -- 172.21.2.135:0/850703084 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c00d4d0 con 0x7fe83c0afca0 2021-11-15T14:37:56.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe840ffa700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe838002fb0 tx=0x7fe838006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe838013460 con 0x7fe83c0afca0 2021-11-15T14:37:56.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8380135c0 con 0x7fe83c0afca0 2021-11-15T14:37:56.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c156fa0 con 0x7fe83c0afca0 2021-11-15T14:37:56.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c13bef0 con 0x7fe83c0afca0 2021-11-15T14:37:56.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.392+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe838013920 con 0x7fe83c0afca0 2021-11-15T14:37:56.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c157160 con 0x7fe83c0afca0 2021-11-15T14:37:56.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe83800f070 con 0x7fe83c0afca0 2021-11-15T14:37:56.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe82a7fc700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 0x7fe81c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe83806b650 con 0x7fe83c0afca0 2021-11-15T14:37:56.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe8417fb700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 0x7fe81c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe8417fb700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 0x7fe81c055b20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fe82c002f70 tx=0x7fe82c018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.396+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe838042550 con 0x7fe83c0afca0 2021-11-15T14:37:56.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.508+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe83c0b5a30 con 0x7fe83c0afca0 2021-11-15T14:37:56.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.520+0000 7fe82a7fc700 1 -- 172.21.2.135:0/850703084 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe838045b70 con 0x7fe83c0afca0 2021-11-15T14:37:56.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 msgr2=0x7fe81c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 0x7fe81c055b20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fe82c002f70 tx=0x7fe82c018000).stop 2021-11-15T14:37:56.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 msgr2=0x7fe83c134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe838002fb0 tx=0x7fe838006df0).stop 2021-11-15T14:37:56.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 shutdown_connections 2021-11-15T14:37:56.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe81c053660 0x7fe81c055b20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe83c0b0bb0 0x7fe83c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe83c0afca0 0x7fe83c134c40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 --2- 172.21.2.135:0/850703084 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe83c0ad150 0x7fe83c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 >> 172.21.2.135:0/850703084 conn(0x7fe83c062cb0 msgr2=0x7fe83c149190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 shutdown_connections 2021-11-15T14:37:56.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.524+0000 7fe843a5f700 1 -- 172.21.2.135:0/850703084 wait complete. 2021-11-15T14:37:56.531 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:37:56.535 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:37:56.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 Processor -- start 2021-11-15T14:37:56.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 -- start start 2021-11-15T14:37:56.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0fbc0b1e30 0x7f0fbc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0fbc148420 0x7f0fbc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0b03d0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0a9140 con 0x7f0fbc0b1e30 2021-11-15T14:37:56.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc3da7700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b0670 con 0x7f0fbc148420 2021-11-15T14:37:56.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc2344700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0fbc0a7140 0x7f0fbc1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45374/0 (socket says 172.21.2.135:45374) 2021-11-15T14:37:56.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc2344700 1 -- 172.21.2.135:0/3877878142 learned_addr learned my addr 172.21.2.135:0/3877878142 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:56.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc1342700 1 --2- 172.21.2.135:0/3877878142 >> v2:172.21.2.135:3300/0 conn(0x7f0fbc148420 0x7f0fbc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc1342700 1 -- 172.21.2.135:0/3877878142 >> v2:172.21.2.119:3300/0 conn(0x7f0fbc0b1e30 msgr2=0x7f0fbc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc1342700 1 --2- 172.21.2.135:0/3877878142 >> v2:172.21.2.119:3300/0 conn(0x7f0fbc0b1e30 0x7f0fbc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc1342700 1 -- 172.21.2.135:0/3877878142 >> v1:172.21.2.135:6789/0 conn(0x7f0fbc0a7140 legacy=0x7f0fbc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc1342700 1 -- 172.21.2.135:0/3877878142 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0b0910 con 0x7f0fbc148420 2021-11-15T14:37:56.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.584+0000 7f0fc0b41700 1 -- 172.21.2.135:0/3877878142 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733470237 0 0) 0x7f0fbc0b03d0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1342700 1 --2- 172.21.2.135:0/3877878142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc148420 0x7f0fbc0b2210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0fbc1477b0 tx=0x7f0fb8006df0).ready entity=mon.1 client_cookie=1f3fe9523cdf0b0e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc0b41700 1 -- 172.21.2.135:0/3877878142 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb800d5c0 con 0x7f0fbc148420 2021-11-15T14:37:56.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc0b41700 1 -- 172.21.2.135:0/3877878142 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8000e90 con 0x7f0fbc148420 2021-11-15T14:37:56.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc0b41700 1 -- 172.21.2.135:0/3877878142 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb800d910 con 0x7f0fbc148420 2021-11-15T14:37:56.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/3877878142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc148420 msgr2=0x7f0fbc0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/3877878142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc148420 0x7f0fbc0b2210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0fbc1477b0 tx=0x7f0fb8006df0).stop 2021-11-15T14:37:56.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/3877878142 shutdown_connections 2021-11-15T14:37:56.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/3877878142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc148420 0x7f0fbc0b2210 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/3877878142 >> v2:172.21.2.119:3300/0 conn(0x7f0fbc0b1e30 0x7f0fbc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/3877878142 >> 172.21.2.135:0/3877878142 conn(0x7f0fbc05f730 msgr2=0x7f0fbc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/3877878142 shutdown_connections 2021-11-15T14:37:56.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/3877878142 wait complete. 2021-11-15T14:37:56.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 Processor -- start 2021-11-15T14:37:56.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- start start 2021-11-15T14:37:56.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 0x7f0fbc156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 0x7f0fbc156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc157440 con 0x7f0fbc0b1e30 2021-11-15T14:37:56.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0a9840 con 0x7f0fbc0a7140 2021-11-15T14:37:56.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0abb20 con 0x7f0fbc148420 2021-11-15T14:37:56.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57792/0 (socket says 172.21.2.135:57792) 2021-11-15T14:37:56.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 -- 172.21.2.135:0/827543313 learned_addr learned my addr 172.21.2.135:0/827543313 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1342700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 0x7f0fbc156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc2344700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 0x7f0fbc156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 -- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 msgr2=0x7f0fbc156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 0x7f0fbc156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 -- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 msgr2=0x7f0fbc156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 0x7f0fbc156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 -- 172.21.2.135:0/827543313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb800b180 con 0x7f0fbc0a7140 2021-11-15T14:37:56.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1342700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 0x7f0fbc156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:56.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc2344700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 0x7f0fbc156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:37:56.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc1b43700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f0fb0002f70 tx=0x7f0fb0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb0013460 con 0x7f0fbc0a7140 2021-11-15T14:37:56.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb00135c0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc0abdc0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0a94c0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb0013920 con 0x7f0fbc0a7140 2021-11-15T14:37:56.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc0b0bb0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.588+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0fb001a060 con 0x7f0fbc0a7140 2021-11-15T14:37:56.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.592+0000 7f0faeffd700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 0x7f0f9c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.592+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0fb006b4e0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.592+0000 7f0fc1342700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 0x7f0f9c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.592+0000 7f0fc1342700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 0x7f0f9c055b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f0fb8014000 tx=0x7f0fb8012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.592+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0fb00424f0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.704+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0fbc0573d0 con 0x7f0fbc0a7140 2021-11-15T14:37:56.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0faeffd700 1 -- 172.21.2.135:0/827543313 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0fb0045b10 con 0x7f0fbc0a7140 2021-11-15T14:37:56.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 msgr2=0x7f0f9c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 0x7f0f9c055b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f0fb8014000 tx=0x7f0fb8012000).stop 2021-11-15T14:37:56.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 msgr2=0x7f0fbc149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f0fb0002f70 tx=0x7f0fb0006ec0).stop 2021-11-15T14:37:56.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 shutdown_connections 2021-11-15T14:37:56.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f9c0536d0 0x7f0f9c055b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0fbc148420 0x7f0fbc156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0fbc0b1e30 0x7f0fbc156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 --2- 172.21.2.135:0/827543313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0fbc0a7140 0x7f0fbc149e30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 >> 172.21.2.135:0/827543313 conn(0x7f0fbc05f730 msgr2=0x7f0fbc0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 shutdown_connections 2021-11-15T14:37:56.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.720+0000 7f0fc3da7700 1 -- 172.21.2.135:0/827543313 wait complete. 2021-11-15T14:37:56.726 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:37:56.729 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:56.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 Processor -- start 2021-11-15T14:37:56.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 -- start start 2021-11-15T14:37:56.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9eec0b1e30 0x7f9eec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0b03d0 con 0x7f9eec0a7140 2021-11-15T14:37:56.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0b0670 con 0x7f9eec148420 2021-11-15T14:37:56.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0a9140 con 0x7f9eec0b1e30 2021-11-15T14:37:56.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eebfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9eec148420 0x7f9eec0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45388/0 (socket says 172.21.2.135:45388) 2021-11-15T14:37:56.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eebfff700 1 -- 172.21.2.135:0/4194745122 learned_addr learned my addr 172.21.2.135:0/4194745122 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:56.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831476282 0 0) 0x7f9eec0b0670 con 0x7f9eec148420 2021-11-15T14:37:56.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc003260 con 0x7f9eec148420 2021-11-15T14:37:56.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752612829 0 0) 0x7f9ecc003260 con 0x7f9eec148420 2021-11-15T14:37:56.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 >> v2:172.21.2.119:3300/0 conn(0x7f9eec0b1e30 msgr2=0x7f9eec0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 --2- 172.21.2.135:0/4194745122 >> v2:172.21.2.119:3300/0 conn(0x7f9eec0b1e30 0x7f9eec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 >> v1:172.21.2.119:6789/0 conn(0x7f9eec0a7140 legacy=0x7f9eec1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0b0910 con 0x7f9eec148420 2021-11-15T14:37:56.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9edc001660 con 0x7f9eec148420 2021-11-15T14:37:56.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 >> v1:172.21.2.135:6789/0 conn(0x7f9eec148420 legacy=0x7f9eec0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9ecc003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ecc004500 0x7f9ecc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ecc005070 0x7f9ecc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00bec0 con 0x7f9ecc005070 2021-11-15T14:37:56.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c030 con 0x7f9ecc0037d0 2021-11-15T14:37:56.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c1f0 con 0x7f9ecc004500 2021-11-15T14:37:56.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9ecc003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ecc004500 msgr2=0x7f9ecc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ecc004500 0x7f9ecc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ecc005070 msgr2=0x7f9ecc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:56.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ecc005070 0x7f9ecc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/4194745122 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0b0910 con 0x7f9ecc0037d0 2021-11-15T14:37:56.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef144d700 1 -- 172.21.2.135:0/4194745122 reap_dead start 2021-11-15T14:37:56.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9ecc003bd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9ed4002f70 tx=0x7f9ed4006ca0).ready entity=mon.1 client_cookie=9af3e94b9ae5be75 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed4012410 con 0x7f9ecc0037d0 2021-11-15T14:37:56.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4012570 con 0x7f9ecc0037d0 2021-11-15T14:37:56.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9eeb7fe700 1 -- 172.21.2.135:0/4194745122 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed40128d0 con 0x7f9ecc0037d0 2021-11-15T14:37:56.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 msgr2=0x7f9ecc003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.776+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9ecc003bd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9ed4002f70 tx=0x7f9ed4006ca0).stop 2021-11-15T14:37:56.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/4194745122 shutdown_connections 2021-11-15T14:37:56.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/4194745122 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9ecc003bd0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/4194745122 >> 172.21.2.135:0/4194745122 conn(0x7f9eec05f730 msgr2=0x7f9eec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/4194745122 shutdown_connections 2021-11-15T14:37:56.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/4194745122 wait complete. 2021-11-15T14:37:56.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 Processor -- start 2021-11-15T14:37:56.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- start start 2021-11-15T14:37:56.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9eec145cd0 0x7f9eec157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9eec148ec0 0x7f9eec149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec14a2f0 con 0x7f9eec145cd0 2021-11-15T14:37:56.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec156a40 con 0x7f9ecc0037d0 2021-11-15T14:37:56.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec146370 con 0x7f9eec148ec0 2021-11-15T14:37:56.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57814/0 (socket says 172.21.2.135:57814) 2021-11-15T14:37:56.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/216410801 learned_addr learned my addr 172.21.2.135:0/216410801 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:56.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9eec148ec0 msgr2=0x7f9eec149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9eec148ec0 0x7f9eec149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9eec145cd0 msgr2=0x7f9eec157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9eec145cd0 0x7f9eec157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 -- 172.21.2.135:0/216410801 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec14ac80 con 0x7f9ecc0037d0 2021-11-15T14:37:56.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef0c4c700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9eec145700 tx=0x7f9ed4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed4012410 con 0x7f9ecc0037d0 2021-11-15T14:37:56.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4011e40 con 0x7f9ecc0037d0 2021-11-15T14:37:56.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec156c30 con 0x7f9ecc0037d0 2021-11-15T14:37:56.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed401d610 con 0x7f9ecc0037d0 2021-11-15T14:37:56.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec157860 con 0x7f9ecc0037d0 2021-11-15T14:37:56.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec0b0bb0 con 0x7f9ecc0037d0 2021-11-15T14:37:56.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ed400f030 con 0x7f9ecc0037d0 2021-11-15T14:37:56.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 0x7f9ed0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:56.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.780+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9ed406c6e0 con 0x7f9ecc0037d0 2021-11-15T14:37:56.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.784+0000 7f9eebfff700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 0x7f9ed0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:56.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.784+0000 7f9eebfff700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 0x7f9ed0055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f9edc001020 tx=0x7f9edc0015f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:56.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.784+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ed40437a0 con 0x7f9ecc0037d0 2021-11-15T14:37:56.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.892+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eec0573d0 con 0x7f9ecc0037d0 2021-11-15T14:37:56.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.892+0000 7f9ee9ffb700 1 -- 172.21.2.135:0/216410801 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f9ed4022070 con 0x7f9ecc0037d0 2021-11-15T14:37:56.899 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:56.899 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:37:56.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 msgr2=0x7f9ed0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 0x7f9ed0055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f9edc001020 tx=0x7f9edc0015f0).stop 2021-11-15T14:37:56.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 msgr2=0x7f9eec1465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:56.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9eec145700 tx=0x7f9ed4015000).stop 2021-11-15T14:37:56.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 shutdown_connections 2021-11-15T14:37:56.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9ed0053640 0x7f9ed0055b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9eec148ec0 0x7f9eec149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9eec145cd0 0x7f9eec157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:56.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 --2- 172.21.2.135:0/216410801 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ecc0037d0 0x7f9eec1465b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:56.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 >> 172.21.2.135:0/216410801 conn(0x7f9eec05f730 msgr2=0x7f9eec0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:56.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 shutdown_connections 2021-11-15T14:37:56.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:56.896+0000 7f9ef2eb0700 1 -- 172.21.2.135:0/216410801 wait complete. 2021-11-15T14:37:56.903 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:37:57.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:37:54.979308+0000', 'modified': '2021-11-15T14:37:55.985759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5551}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5551': {'gid': 5551, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2231823287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 2231823287}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2231823287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:37:57.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:37:57.210 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:37:57.276 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5551,"want_state":"up:active","state":"up:active","rank_uptime":2.2853740669999998,"mdsmap_epoch":26,"osdmap_epoch":58,"osdmap_epoch_barrier":58,"uptime":6.4477421169999998} 2021-11-15T14:37:57.277 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5551, "mdsmap_epoch": 26, "osdmap_epoch": 58, "osdmap_epoch_barrier": 58, "rank_uptime": 2.285374067, "state": "up:active", "uptime": 6.447742117, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:37:57.278 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:37:57.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 Processor -- start 2021-11-15T14:37:57.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- start start 2021-11-15T14:37:57.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f506c0b1e30 0x7f506c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0b03d0 con 0x7f506c148420 2021-11-15T14:37:57.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0a9140 con 0x7f506c0b1e30 2021-11-15T14:37:57.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b0670 con 0x7f506c0a7140 2021-11-15T14:37:57.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f506c0b1e30 0x7f506c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f506c0b1e30 0x7f506c0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57818/0 (socket says 172.21.2.135:57818) 2021-11-15T14:37:57.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 -- 172.21.2.135:0/786945698 learned_addr learned my addr 172.21.2.135:0/786945698 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 -- 172.21.2.135:0/786945698 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 msgr2=0x7f506c1447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:57.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 --2- 172.21.2.135:0/786945698 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c1447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 -- 172.21.2.135:0/786945698 >> v1:172.21.2.119:6789/0 conn(0x7f506c148420 legacy=0x7f506c0b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:57.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 -- 172.21.2.135:0/786945698 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c0b0910 con 0x7f506c0b1e30 2021-11-15T14:37:57.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f507107b700 1 --2- 172.21.2.135:0/786945698 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c0b1050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f506c1477b0 tx=0x7f5060006eb0).ready entity=mon.1 client_cookie=6b51f91af82c8922 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f505ffff700 1 -- 172.21.2.135:0/786945698 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506000d570 con 0x7f506c0b1e30 2021-11-15T14:37:57.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f505ffff700 1 -- 172.21.2.135:0/786945698 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060000e90 con 0x7f506c0b1e30 2021-11-15T14:37:57.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f505ffff700 1 -- 172.21.2.135:0/786945698 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506000d900 con 0x7f506c0b1e30 2021-11-15T14:37:57.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- 172.21.2.135:0/786945698 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 msgr2=0x7f506c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 --2- 172.21.2.135:0/786945698 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c0b1050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f506c1477b0 tx=0x7f5060006eb0).stop 2021-11-15T14:37:57.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- 172.21.2.135:0/786945698 shutdown_connections 2021-11-15T14:37:57.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 --2- 172.21.2.135:0/786945698 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 --2- 172.21.2.135:0/786945698 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c0b1050 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- 172.21.2.135:0/786945698 >> 172.21.2.135:0/786945698 conn(0x7f506c05f730 msgr2=0x7f506c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- 172.21.2.135:0/786945698 shutdown_connections 2021-11-15T14:37:57.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.324+0000 7f50732df700 1 -- 172.21.2.135:0/786945698 wait complete. 2021-11-15T14:37:57.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 Processor -- start 2021-11-15T14:37:57.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- start start 2021-11-15T14:37:57.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f506c148420 0x7f506c0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0a95a0 con 0x7f506c148420 2021-11-15T14:37:57.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c149d90 con 0x7f506c0b1e30 2021-11-15T14:37:57.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c149af0 con 0x7f506c0a7140 2021-11-15T14:37:57.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57826/0 (socket says 172.21.2.135:57826) 2021-11-15T14:37:57.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 -- 172.21.2.135:0/2785299792 learned_addr learned my addr 172.21.2.135:0/2785299792 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 -- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 msgr2=0x7f506c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 -- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f506c148420 msgr2=0x7f506c0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f506c148420 0x7f506c0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 -- 172.21.2.135:0/2785299792 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506000b1e0 con 0x7f506c0b1e30 2021-11-15T14:37:57.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507087a700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f506c0aa8d0 tx=0x7f5068006e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5068013460 con 0x7f506c0b1e30 2021-11-15T14:37:57.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680135c0 con 0x7f506c0b1e30 2021-11-15T14:37:57.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c15a3c0 con 0x7f506c0b1e30 2021-11-15T14:37:57.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5068013920 con 0x7f506c0b1e30 2021-11-15T14:37:57.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0ad5b0 con 0x7f506c0b1e30 2021-11-15T14:37:57.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0573d0 con 0x7f506c0b1e30 2021-11-15T14:37:57.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f506800f070 con 0x7f506c0b1e30 2021-11-15T14:37:57.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 0x7f504c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f506806b560 con 0x7f506c0b1e30 2021-11-15T14:37:57.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.328+0000 7f507107b700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 0x7f504c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.332+0000 7f507107b700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 0x7f504c0559b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f506c1477b0 tx=0x7f5060015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.332+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5068042460 con 0x7f506c0b1e30 2021-11-15T14:37:57.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f506c0446d0 con 0x7f506c0b1e30 2021-11-15T14:37:57.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f505e7fc700 1 -- 172.21.2.135:0/2785299792 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f5068045a80 con 0x7f506c0b1e30 2021-11-15T14:37:57.420 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:57.420 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":58,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:55.984224+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:37:52.935747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T14:37:53.946772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:37:57.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 msgr2=0x7f504c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 0x7f504c0559b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f506c1477b0 tx=0x7f5060015000).stop 2021-11-15T14:37:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 msgr2=0x7f506c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f506c0aa8d0 tx=0x7f5068006e00).stop 2021-11-15T14:37:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 shutdown_connections 2021-11-15T14:37:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f504c0534f0 0x7f504c0559b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f506c148420 0x7f506c0b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f506c0b1e30 0x7f506c15ab00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 --2- 172.21.2.135:0/2785299792 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f506c0a7140 0x7f506c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 >> 172.21.2.135:0/2785299792 conn(0x7f506c05f730 msgr2=0x7f506c1438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 shutdown_connections 2021-11-15T14:37:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.416+0000 7f50732df700 1 -- 172.21.2.135:0/2785299792 wait complete. 2021-11-15T14:37:57.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:37:52.935747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:37:53.946772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:37:57.428 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:37:57.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 Processor -- start 2021-11-15T14:37:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 -- start start 2021-11-15T14:37:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 0x7f67500b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f67500b2320 0x7f67501412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500a7850 con 0x7f67500b0030 2021-11-15T14:37:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500b0470 con 0x7f67500b2320 2021-11-15T14:37:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f6756c3f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b06d0 con 0x7f67500b1f40 2021-11-15T14:37:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674ffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f67500b0030 0x7f67500a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45424/0 (socket says 172.21.2.135:45424) 2021-11-15T14:37:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674ffff700 1 -- 172.21.2.135:0/2654747443 learned_addr learned my addr 172.21.2.135:0/2654747443 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816131238 0 0) 0x7f67500a7850 con 0x7f67500b0030 2021-11-15T14:37:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6730003260 con 0x7f67500b0030 2021-11-15T14:37:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 0x7f67500b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67551dc700 1 --2- 172.21.2.135:0/2654747443 >> v2:172.21.2.119:3300/0 conn(0x7f67500b2320 0x7f67501412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192107112 0 0) 0x7f6730003260 con 0x7f67500b0030 2021-11-15T14:37:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 msgr2=0x7f67500b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 0x7f67500b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 >> v2:172.21.2.119:3300/0 conn(0x7f67500b2320 msgr2=0x7f67501412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 --2- 172.21.2.135:0/2654747443 >> v2:172.21.2.119:3300/0 conn(0x7f67500b2320 0x7f67501412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500b0970 con 0x7f67500b0030 2021-11-15T14:37:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6740001660 con 0x7f67500b0030 2021-11-15T14:37:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 >> v1:172.21.2.135:6789/0 conn(0x7f67500b0030 legacy=0x7f67500a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67300037d0 0x7f6730003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6730004500 0x7f6730004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 0x7f6730004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b0470 con 0x7f6730004500 2021-11-15T14:37:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b06d0 con 0x7f67300037d0 2021-11-15T14:37:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673000b820 con 0x7f67500b1f40 2021-11-15T14:37:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67300037d0 0x7f6730003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 -- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 msgr2=0x7f6730004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500b1f40 0x7f6730004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 -- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6730004500 msgr2=0x7f6730004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6730004500 0x7f6730004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 -- 172.21.2.135:0/2654747443 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500b0970 con 0x7f67300037d0 2021-11-15T14:37:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f67549db700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67300037d0 0x7f6730003bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f673800a000 tx=0x7f6738008040).ready entity=mon.1 client_cookie=48c004d4c9fb7425 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6738013670 con 0x7f67300037d0 2021-11-15T14:37:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67380137d0 con 0x7f67300037d0 2021-11-15T14:37:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.476+0000 7f674f7fe700 1 -- 172.21.2.135:0/2654747443 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6738013b30 con 0x7f67300037d0 2021-11-15T14:37:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/2654747443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67300037d0 msgr2=0x7f6730003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 --2- 172.21.2.135:0/2654747443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67300037d0 0x7f6730003bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f673800a000 tx=0x7f6738008040).stop 2021-11-15T14:37:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 -- 172.21.2.135:0/2654747443 reap_dead start 2021-11-15T14:37:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/2654747443 shutdown_connections 2021-11-15T14:37:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/2654747443 >> 172.21.2.135:0/2654747443 conn(0x7f675005f730 msgr2=0x7f675005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/2654747443 shutdown_connections 2021-11-15T14:37:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/2654747443 wait complete. 2021-11-15T14:37:57.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 Processor -- start 2021-11-15T14:37:57.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- start start 2021-11-15T14:37:57.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f67300037d0 0x7f67500b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500aa910 0x7f67500aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b5a30 con 0x7f67300037d0 2021-11-15T14:37:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500abc90 con 0x7f67500ab280 2021-11-15T14:37:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500b5630 con 0x7f67500aa910 2021-11-15T14:37:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57846/0 (socket says 172.21.2.135:57846) 2021-11-15T14:37:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 -- 172.21.2.135:0/3753027560 learned_addr learned my addr 172.21.2.135:0/3753027560 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 -- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500aa910 msgr2=0x7f67500aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500aa910 0x7f67500aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 -- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f67300037d0 msgr2=0x7f67500b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f67300037d0 0x7f67500b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 -- 172.21.2.135:0/3753027560 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500ac090 con 0x7f67500ab280 2021-11-15T14:37:57.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f67551dc700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f6748000b60 tx=0x7f6748008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674800c070 con 0x7f67500ab280 2021-11-15T14:37:57.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67480133f0 con 0x7f67500ab280 2021-11-15T14:37:57.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6748013750 con 0x7f67500ab280 2021-11-15T14:37:57.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67500a9640 con 0x7f67500ab280 2021-11-15T14:37:57.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67501455b0 con 0x7f67500ab280 2021-11-15T14:37:57.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67500b0c10 con 0x7f67500ab280 2021-11-15T14:37:57.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67480138b0 con 0x7f67500ab280 2021-11-15T14:37:57.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 0x7f6734055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.480+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f674806b660 con 0x7f67500ab280 2021-11-15T14:37:57.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.484+0000 7f67549db700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 0x7f6734055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.484+0000 7f67549db700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 0x7f6734055b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f673800a000 tx=0x7f6738008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.484+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6748042560 con 0x7f67500ab280 2021-11-15T14:37:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f67500573d0 con 0x7f67500ab280 2021-11-15T14:37:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f674dffb700 1 -- 172.21.2.135:0/3753027560 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6748045b80 con 0x7f67500ab280 2021-11-15T14:37:57.573 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:37:57.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 msgr2=0x7f6734055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 0x7f6734055b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f673800a000 tx=0x7f6738008040).stop 2021-11-15T14:37:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 msgr2=0x7f675015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f6748000b60 tx=0x7f6748008040).stop 2021-11-15T14:37:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 shutdown_connections 2021-11-15T14:37:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6734053640 0x7f6734055b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67500ab280 0x7f675015a220 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67500aa910 0x7f67500aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 --2- 172.21.2.135:0/3753027560 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f67300037d0 0x7f67500b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 >> 172.21.2.135:0/3753027560 conn(0x7f675005f730 msgr2=0x7f67500a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 shutdown_connections 2021-11-15T14:37:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.568+0000 7f6756c3f700 1 -- 172.21.2.135:0/3753027560 wait complete. 2021-11-15T14:37:57.579 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:37:57.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 Processor -- start 2021-11-15T14:37:57.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- start start 2021-11-15T14:37:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f78101469d0 0x7f78101402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4200 0x7f78101407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7810143be0 con 0x7f78100b4710 2021-11-15T14:37:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7810147590 con 0x7f78101469d0 2021-11-15T14:37:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7810143e80 con 0x7f78100b4200 2021-11-15T14:37:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f78100b4710 0x7f78100b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45438/0 (socket says 172.21.2.135:45438) 2021-11-15T14:37:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 -- 172.21.2.135:0/1334941850 learned_addr learned my addr 172.21.2.135:0/1334941850 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:37:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 --2- 172.21.2.135:0/1334941850 >> v2:172.21.2.135:3300/0 conn(0x7f78101469d0 0x7f78101402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780dffb700 1 -- 172.21.2.135:0/1334941850 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549155712 0 0) 0x7f7810143be0 con 0x7f78100b4710 2021-11-15T14:37:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780dffb700 1 -- 172.21.2.135:0/1334941850 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f4003260 con 0x7f78100b4710 2021-11-15T14:37:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 -- 172.21.2.135:0/1334941850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4200 msgr2=0x7f78101407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 --2- 172.21.2.135:0/1334941850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4200 0x7f78101407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 -- 172.21.2.135:0/1334941850 >> v1:172.21.2.135:6789/0 conn(0x7f78100b4710 legacy=0x7f78100b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 -- 172.21.2.135:0/1334941850 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100b0d10 con 0x7f78101469d0 2021-11-15T14:37:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780effd700 1 --2- 172.21.2.135:0/1334941850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f78101402b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f7804002f70 tx=0x7f7804006df0).ready entity=mon.1 client_cookie=434f6075134f0c76 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780dffb700 1 -- 172.21.2.135:0/1334941850 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780400d570 con 0x7f78101469d0 2021-11-15T14:37:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780dffb700 1 -- 172.21.2.135:0/1334941850 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804000e90 con 0x7f78101469d0 2021-11-15T14:37:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780dffb700 1 -- 172.21.2.135:0/1334941850 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780400d8c0 con 0x7f78101469d0 2021-11-15T14:37:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- 172.21.2.135:0/1334941850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 msgr2=0x7f78101402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- 172.21.2.135:0/1334941850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f78101402b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f7804002f70 tx=0x7f7804006df0).stop 2021-11-15T14:37:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- 172.21.2.135:0/1334941850 shutdown_connections 2021-11-15T14:37:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- 172.21.2.135:0/1334941850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4200 0x7f78101407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- 172.21.2.135:0/1334941850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f78101402b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- 172.21.2.135:0/1334941850 >> 172.21.2.135:0/1334941850 conn(0x7f781005c510 msgr2=0x7f781005c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- 172.21.2.135:0/1334941850 shutdown_connections 2021-11-15T14:37:57.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- 172.21.2.135:0/1334941850 wait complete. 2021-11-15T14:37:57.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 Processor -- start 2021-11-15T14:37:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- start start 2021-11-15T14:37:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78100b4200 0x7f781014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4710 0x7f7810152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810153250 con 0x7f78100b4200 2021-11-15T14:37:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810141ce0 con 0x7f78101469d0 2021-11-15T14:37:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f781531f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7810152410 con 0x7f78100b4710 2021-11-15T14:37:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57860/0 (socket says 172.21.2.135:57860) 2021-11-15T14:37:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 -- 172.21.2.135:0/3990055822 learned_addr learned my addr 172.21.2.135:0/3990055822 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 -- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4710 msgr2=0x7f7810152870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4710 0x7f7810152870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 -- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78100b4200 msgr2=0x7f781014a1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78100b4200 0x7f781014a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 -- 172.21.2.135:0/3990055822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780400b180 con 0x7f78101469d0 2021-11-15T14:37:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.628+0000 7f780f7fe700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7810153390 tx=0x7f7808007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7808005ba0 con 0x7f78101469d0 2021-11-15T14:37:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808005d00 con 0x7f78101469d0 2021-11-15T14:37:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7810142750 con 0x7f78101469d0 2021-11-15T14:37:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7810142c90 con 0x7f78101469d0 2021-11-15T14:37:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78080072c0 con 0x7f78101469d0 2021-11-15T14:37:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78101525d0 con 0x7f78101469d0 2021-11-15T14:37:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7808010070 con 0x7f78101469d0 2021-11-15T14:37:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 0x7f77ec055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f780806b6d0 con 0x7f78101469d0 2021-11-15T14:37:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f780effd700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 0x7f77ec055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f780effd700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 0x7f77ec055b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f7804002f70 tx=0x7f7804014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.632+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78101525d0 con 0x7f78101469d0 2021-11-15T14:37:57.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.716+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78101525d0 con 0x7f78101469d0 2021-11-15T14:37:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.716+0000 7f77fffff700 1 -- 172.21.2.135:0/3990055822 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78101525d0 con 0x7f78101469d0 2021-11-15T14:37:57.723 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:37:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 msgr2=0x7f77ec055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 0x7f77ec055b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f7804002f70 tx=0x7f7804014000).stop 2021-11-15T14:37:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 msgr2=0x7f7810152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7810153390 tx=0x7f7808007e00).stop 2021-11-15T14:37:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 shutdown_connections 2021-11-15T14:37:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f77ec053690 0x7f77ec055b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78101469d0 0x7f7810152d60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78100b4710 0x7f7810152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 --2- 172.21.2.135:0/3990055822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78100b4200 0x7f781014a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 >> 172.21.2.135:0/3990055822 conn(0x7f781005c510 msgr2=0x7f78100b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 shutdown_connections 2021-11-15T14:37:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.720+0000 7f781531f700 1 -- 172.21.2.135:0/3990055822 wait complete. 2021-11-15T14:37:57.730 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:37:57.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 Processor -- start 2021-11-15T14:37:57.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 -- start start 2021-11-15T14:37:57.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08100b1350 0x7f08100b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f08100b2320 0x7f08101412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100a7850 con 0x7f08100b1f40 2021-11-15T14:37:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b17c0 con 0x7f08100b2320 2021-11-15T14:37:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f0817e54700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b06d0 con 0x7f08100b1350 2021-11-15T14:37:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f08153ef700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08100b1350 0x7f08100b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f08153ef700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f08100b1350 0x7f08100b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57864/0 (socket says 172.21.2.135:57864) 2021-11-15T14:37:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f08153ef700 1 -- 172.21.2.135:0/1185061542 learned_addr learned my addr 172.21.2.135:0/1185061542 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f08153ef700 1 -- 172.21.2.135:0/1185061542 >> v2:172.21.2.119:3300/0 conn(0x7f08100b2320 msgr2=0x7f08101412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.776+0000 7f08153ef700 1 --2- 172.21.2.135:0/1185061542 >> v2:172.21.2.119:3300/0 conn(0x7f08100b2320 0x7f08101412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f08153ef700 1 -- 172.21.2.135:0/1185061542 >> v1:172.21.2.119:6789/0 conn(0x7f08100b1f40 legacy=0x7f08100a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:37:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f08153ef700 1 -- 172.21.2.135:0/1185061542 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100b0970 con 0x7f08100b1350 2021-11-15T14:37:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f08153ef700 1 --2- 172.21.2.135:0/1185061542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f08100b0030 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f08100ad350 tx=0x7f080c006eb0).ready entity=mon.1 client_cookie=e5510bd1427d1ac5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0814bee700 1 -- 172.21.2.135:0/1185061542 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c00d5c0 con 0x7f08100b1350 2021-11-15T14:37:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0814bee700 1 -- 172.21.2.135:0/1185061542 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c000e90 con 0x7f08100b1350 2021-11-15T14:37:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0814bee700 1 -- 172.21.2.135:0/1185061542 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c00d910 con 0x7f08100b1350 2021-11-15T14:37:57.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/1185061542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 msgr2=0x7f08100b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- 172.21.2.135:0/1185061542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f08100b0030 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f08100ad350 tx=0x7f080c006eb0).stop 2021-11-15T14:37:57.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/1185061542 shutdown_connections 2021-11-15T14:37:57.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- 172.21.2.135:0/1185061542 >> v2:172.21.2.119:3300/0 conn(0x7f08100b2320 0x7f08101412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- 172.21.2.135:0/1185061542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f08100b0030 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/1185061542 >> 172.21.2.135:0/1185061542 conn(0x7f081005f730 msgr2=0x7f081005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/1185061542 shutdown_connections 2021-11-15T14:37:57.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/1185061542 wait complete. 2021-11-15T14:37:57.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 Processor -- start 2021-11-15T14:37:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- start start 2021-11-15T14:37:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08100b1f40 0x7f0810142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08100b2320 0x7f0810156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015a290 con 0x7f08100b2320 2021-11-15T14:37:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015a530 con 0x7f08100b1350 2021-11-15T14:37:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081015a7d0 con 0x7f08100b1f40 2021-11-15T14:37:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57870/0 (socket says 172.21.2.135:57870) 2021-11-15T14:37:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 -- 172.21.2.135:0/636607870 learned_addr learned my addr 172.21.2.135:0/636607870 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 -- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08100b1f40 msgr2=0x7f0810142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08100b1f40 0x7f0810142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 -- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08100b2320 msgr2=0x7f0810156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08100b2320 0x7f0810156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 -- 172.21.2.135:0/636607870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c00b1e0 con 0x7f08100b1350 2021-11-15T14:37:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0815bf0700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f0804002f90 tx=0x7f0804006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804013460 con 0x7f08100b1350 2021-11-15T14:37:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040135c0 con 0x7f08100b1350 2021-11-15T14:37:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081015aa70 con 0x7f08100b1350 2021-11-15T14:37:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804013920 con 0x7f08100b1350 2021-11-15T14:37:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810140720 con 0x7f08100b1350 2021-11-15T14:37:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.780+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081015ac00 con 0x7f08100b1350 2021-11-15T14:37:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f080401a060 con 0x7f08100b1350 2021-11-15T14:37:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f0802ffd700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 0x7f07f0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f080406b3c0 con 0x7f08100b1350 2021-11-15T14:37:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f08153ef700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 0x7f07f0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f08153ef700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 0x7f07f0055a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f08100ad350 tx=0x7f080c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.784+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08040423d0 con 0x7f08100b1350 2021-11-15T14:37:57.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08100573d0 con 0x7f08100b1350 2021-11-15T14:37:57.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0802ffd700 1 -- 172.21.2.135:0/636607870 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+10 (secure 0 0 0) 0x7f08040180a0 con 0x7f08100b1350 2021-11-15T14:37:57.874 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:37:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 msgr2=0x7f07f0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 0x7f07f0055a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f08100ad350 tx=0x7f080c015000).stop 2021-11-15T14:37:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 msgr2=0x7f0810140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f0804002f90 tx=0x7f0804006df0).stop 2021-11-15T14:37:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 shutdown_connections 2021-11-15T14:37:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f07f0053580 0x7f07f0055a40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f08100b2320 0x7f0810156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f08100b1f40 0x7f0810142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 --2- 172.21.2.135:0/636607870 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f08100b1350 0x7f0810140170 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 >> 172.21.2.135:0/636607870 conn(0x7f081005f730 msgr2=0x7f08100a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.868+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 shutdown_connections 2021-11-15T14:37:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.872+0000 7f0817e54700 1 -- 172.21.2.135:0/636607870 wait complete. 2021-11-15T14:37:57.881 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:37:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 Processor -- start 2021-11-15T14:37:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 -- start start 2021-11-15T14:37:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580654a0 0x7f1b581444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1b580b3950 0x7f1b581449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b580b2430 con 0x7f1b58060040 2021-11-15T14:37:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580b26d0 con 0x7f1b580b3950 2021-11-15T14:37:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5d0cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b2970 con 0x7f1b580654a0 2021-11-15T14:37:57.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1b580b3950 0x7f1b581449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1b580b3950 0x7f1b581449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57882/0 (socket says 172.21.2.135:57882) 2021-11-15T14:37:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 -- 172.21.2.135:0/3225798204 learned_addr learned my addr 172.21.2.135:0/3225798204 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 -- 172.21.2.135:0/3225798204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580654a0 msgr2=0x7f1b581444c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 --2- 172.21.2.135:0/3225798204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580654a0 0x7f1b581444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 -- 172.21.2.135:0/3225798204 >> v1:172.21.2.119:6789/0 conn(0x7f1b58060040 legacy=0x7f1b58064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 -- 172.21.2.135:0/3225798204 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580648f0 con 0x7f1b580b3950 2021-11-15T14:37:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b5759e700 1 --2- 172.21.2.135:0/3225798204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b580b3950 0x7f1b581449b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1b58064c70 tx=0x7f1b50009290).ready entity=mon.1 client_cookie=38e1252ea71c8a3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.932+0000 7f1b55d9b700 1 -- 172.21.2.135:0/3225798204 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5000b860 con 0x7f1b580b3950 2021-11-15T14:37:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b55d9b700 1 -- 172.21.2.135:0/3225798204 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000b9c0 con 0x7f1b580b3950 2021-11-15T14:37:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b55d9b700 1 -- 172.21.2.135:0/3225798204 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5000bb70 con 0x7f1b580b3950 2021-11-15T14:37:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/3225798204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b580b3950 msgr2=0x7f1b581449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/3225798204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b580b3950 0x7f1b581449b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1b58064c70 tx=0x7f1b50009290).stop 2021-11-15T14:37:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/3225798204 shutdown_connections 2021-11-15T14:37:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/3225798204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b580b3950 0x7f1b581449b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/3225798204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580654a0 0x7f1b581444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/3225798204 >> 172.21.2.135:0/3225798204 conn(0x7f1b5805cfe0 msgr2=0x7f1b5805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/3225798204 shutdown_connections 2021-11-15T14:37:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/3225798204 wait complete. 2021-11-15T14:37:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 Processor -- start 2021-11-15T14:37:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- start start 2021-11-15T14:37:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1b580654a0 0x7f1b5813b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580b3950 0x7f1b5813a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5813e8a0 con 0x7f1b580654a0 2021-11-15T14:37:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580adee0 con 0x7f1b58060040 2021-11-15T14:37:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ae180 con 0x7f1b580b3950 2021-11-15T14:37:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57884/0 (socket says 172.21.2.135:57884) 2021-11-15T14:37:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 -- 172.21.2.135:0/2282036769 learned_addr learned my addr 172.21.2.135:0/2282036769 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 -- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580b3950 msgr2=0x7f1b5813a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580b3950 0x7f1b5813a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 -- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1b580654a0 msgr2=0x7f1b5813b8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:37:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1b580654a0 0x7f1b5813b8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 -- 172.21.2.135:0/2282036769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50009530 con 0x7f1b58060040 2021-11-15T14:37:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b56d9d700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f1b5813eb80 tx=0x7f1b48006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b48013460 con 0x7f1b58060040 2021-11-15T14:37:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b480135c0 con 0x7f1b58060040 2021-11-15T14:37:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5813e170 con 0x7f1b58060040 2021-11-15T14:37:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580b0bf0 con 0x7f1b58060040 2021-11-15T14:37:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b48013920 con 0x7f1b58060040 2021-11-15T14:37:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5813dfd0 con 0x7f1b58060040 2021-11-15T14:37:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b4800f070 con 0x7f1b58060040 2021-11-15T14:37:57.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 0x7f1b3c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:57.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.936+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1b4806b4f0 con 0x7f1b58060040 2021-11-15T14:37:57.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.940+0000 7f1b5659c700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 0x7f1b3c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:57.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.940+0000 7f1b5659c700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 0x7f1b3c055b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1b40002fb0 tx=0x7f1b40006950).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:57.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:57.940+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b5813dfd0 con 0x7f1b58060040 2021-11-15T14:37:58.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b5813dfd0 con 0x7f1b58060040 2021-11-15T14:37:58.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b4ffff700 1 -- 172.21.2.135:0/2282036769 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1b5813dfd0 con 0x7f1b58060040 2021-11-15T14:37:58.030 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:37:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 msgr2=0x7f1b3c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 0x7f1b3c055b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1b40002fb0 tx=0x7f1b40006950).stop 2021-11-15T14:37:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 msgr2=0x7f1b580b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f1b5813eb80 tx=0x7f1b48006df0).stop 2021-11-15T14:37:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 shutdown_connections 2021-11-15T14:37:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1b3c053660 0x7f1b3c055b20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1b580b3950 0x7f1b5813a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1b580654a0 0x7f1b5813b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 --2- 172.21.2.135:0/2282036769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1b58060040 0x7f1b580b7be0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 >> 172.21.2.135:0/2282036769 conn(0x7f1b5805cfe0 msgr2=0x7f1b58141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 shutdown_connections 2021-11-15T14:37:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.024+0000 7f1b5d0cf700 1 -- 172.21.2.135:0/2282036769 wait complete. 2021-11-15T14:37:58.037 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:37:58.037 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:37:58.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 Processor -- start 2021-11-15T14:37:58.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- start start 2021-11-15T14:37:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff658067380 0x7ff658143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff658143e60 0x7ff65814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580aac30 con 0x7ff658060180 2021-11-15T14:37:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff658060560 con 0x7ff658067380 2021-11-15T14:37:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff658066f20 con 0x7ff658143e60 2021-11-15T14:37:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff658143e60 0x7ff65814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff658143e60 0x7ff65814b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57894/0 (socket says 172.21.2.135:57894) 2021-11-15T14:37:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 -- 172.21.2.135:0/2166358583 learned_addr learned my addr 172.21.2.135:0/2166358583 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 -- 172.21.2.135:0/2166358583 >> v2:172.21.2.119:3300/0 conn(0x7ff658067380 msgr2=0x7ff658143970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 --2- 172.21.2.135:0/2166358583 >> v2:172.21.2.119:3300/0 conn(0x7ff658067380 0x7ff658143970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 -- 172.21.2.135:0/2166358583 >> v1:172.21.2.119:6789/0 conn(0x7ff658060180 legacy=0x7ff6580b47d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:37:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 -- 172.21.2.135:0/2166358583 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580b3430 con 0x7ff658143e60 2021-11-15T14:37:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65d4e2700 1 --2- 172.21.2.135:0/2166358583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658143e60 0x7ff65814b8d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff65805f260 tx=0x7ff650009290).ready entity=mon.1 client_cookie=1e96e0e70cb3da73 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff6577fe700 1 -- 172.21.2.135:0/2166358583 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65000b830 con 0x7ff658143e60 2021-11-15T14:37:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff6577fe700 1 -- 172.21.2.135:0/2166358583 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000b990 con 0x7ff658143e60 2021-11-15T14:37:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff6577fe700 1 -- 172.21.2.135:0/2166358583 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65000bb40 con 0x7ff658143e60 2021-11-15T14:37:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- 172.21.2.135:0/2166358583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658143e60 msgr2=0x7ff65814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 --2- 172.21.2.135:0/2166358583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658143e60 0x7ff65814b8d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7ff65805f260 tx=0x7ff650009290).stop 2021-11-15T14:37:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- 172.21.2.135:0/2166358583 shutdown_connections 2021-11-15T14:37:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 --2- 172.21.2.135:0/2166358583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658143e60 0x7ff65814b8d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 --2- 172.21.2.135:0/2166358583 >> v2:172.21.2.119:3300/0 conn(0x7ff658067380 0x7ff658143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- 172.21.2.135:0/2166358583 >> 172.21.2.135:0/2166358583 conn(0x7ff65805cfb0 msgr2=0x7ff65805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:58.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- 172.21.2.135:0/2166358583 shutdown_connections 2021-11-15T14:37:58.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- 172.21.2.135:0/2166358583 wait complete. 2021-11-15T14:37:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 Processor -- start 2021-11-15T14:37:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.084+0000 7ff65ef45700 1 -- start start 2021-11-15T14:37:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff658067380 0x7ff658136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff658143e60 0x7ff6581374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658060fb0 con 0x7ff658143e60 2021-11-15T14:37:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580afe30 con 0x7ff658060180 2021-11-15T14:37:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580b00d0 con 0x7ff658067380 2021-11-15T14:37:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57900/0 (socket says 172.21.2.135:57900) 2021-11-15T14:37:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 -- 172.21.2.135:0/1784289762 learned_addr learned my addr 172.21.2.135:0/1784289762 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:37:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 -- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff658067380 msgr2=0x7ff658136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff658067380 0x7ff658136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 -- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff658143e60 msgr2=0x7ff6581374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff658143e60 0x7ff6581374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 -- 172.21.2.135:0/1784289762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009530 con 0x7ff658060180 2021-11-15T14:37:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65cce1700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ff658060db0 tx=0x7ff648006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff648013460 con 0x7ff658060180 2021-11-15T14:37:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6480135c0 con 0x7ff658060180 2021-11-15T14:37:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6580b0370 con 0x7ff658060180 2021-11-15T14:37:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff648013920 con 0x7ff658060180 2021-11-15T14:37:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658060950 con 0x7ff658060180 2021-11-15T14:37:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6580573d0 con 0x7ff658060180 2021-11-15T14:37:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff64800f070 con 0x7ff658060180 2021-11-15T14:37:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 0x7ff63c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:37:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff64806b1d0 con 0x7ff658060180 2021-11-15T14:37:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.088+0000 7ff657fff700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 0x7ff63c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:37:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.092+0000 7ff657fff700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 0x7ff63c055b60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff640002fb0 tx=0x7ff6400069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:37:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.092+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff6480421e0 con 0x7ff658060180 2021-11-15T14:37:58.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.200+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff658145410 con 0x7ff658060180 2021-11-15T14:37:58.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.200+0000 7ff655ffb700 1 -- 172.21.2.135:0/1784289762 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7ff648018030 con 0x7ff658060180 2021-11-15T14:37:58.207 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:37:58.207 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:37:58.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 msgr2=0x7ff63c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 0x7ff63c055b60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff640002fb0 tx=0x7ff6400069b0).stop 2021-11-15T14:37:58.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 msgr2=0x7ff658062160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:37:58.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ff658060db0 tx=0x7ff648006df0).stop 2021-11-15T14:37:58.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 shutdown_connections 2021-11-15T14:37:58.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff63c0536a0 0x7ff63c055b60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:58.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff658143e60 0x7ff6581374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff658067380 0x7ff658136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:37:58.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 --2- 172.21.2.135:0/1784289762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff658060180 0x7ff658062160 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:37:58.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 >> 172.21.2.135:0/1784289762 conn(0x7ff65805cfb0 msgr2=0x7ff6580b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:37:58.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 shutdown_connections 2021-11-15T14:37:58.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:37:58.204+0000 7ff65ef45700 1 -- 172.21.2.135:0/1784289762 wait complete. 2021-11-15T14:37:58.211 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:37:58.517 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:37:54.979308+0000', 'modified': '2021-11-15T14:37:55.985759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5551}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5551': {'gid': 5551, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2231823287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 2231823287}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2231823287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:37:58.517 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:37:58.518 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:37:58.599 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5551,"want_state":"up:active","state":"up:active","rank_uptime":3.6088344540000001,"mdsmap_epoch":26,"osdmap_epoch":58,"osdmap_epoch_barrier":58,"uptime":7.7712010349999998} 2021-11-15T14:37:58.600 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5551, "mdsmap_epoch": 26, "osdmap_epoch": 58, "osdmap_epoch_barrier": 58, "rank_uptime": 3.608834454, "state": "up:active", "uptime": 7.771201035, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:37:58.601 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:37:58.601 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:37:58.601 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:37:58.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:58.603 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:58.613 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:37:58.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:37:58.625 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:37:58.674 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:37:58.675 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:37:58.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:58.676 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:37:58.681 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:37:58.682 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:37:58.725 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:37:58.736 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:37:58.737 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:37:58.742 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:37:58.742 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:37:58.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:58.744 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:37:58.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:37:58.766+0000 7f143ab19080 -1 init, newargv = 0x558d7e1aab50 newargc=9 2021-11-15T14:37:58.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14310]: starting ceph client 2021-11-15T14:37:58.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14310]: starting fuse 2021-11-15T14:37:59.871 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:37:59.884 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:37:59.884 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:37:59.935 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:37:59.935 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:37:59.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:59.937 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:37:59.942 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:37:59.942 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:37:59.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:59.943 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:37:59.944 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:37:59.944 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:37:59.945 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:37:59.945 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:37:59.946 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:37:59.946 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:37:59.947 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:37:59.947 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:37:59.947 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:37:59.948 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:37:59.948 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:37:59.949 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:37:59.949 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:37:59.949 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:37:59.950 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:37:59.950 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:37:59.951 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:37:59.951 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:37:59.952 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:37:59.952 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:37:59.952 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:37:59.953 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:37:59.976 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14310.asok 2021-11-15T14:37:59.978 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14310.asok 2021-11-15T14:37:59.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:37:59.979 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14310.asok status 2021-11-15T14:38:00.026 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:38:00.027 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:38:00.027 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:38:00.027 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:38:00.027 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:38:00.028 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:38:00.028 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:38:00.028 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14310", 2021-11-15T14:38:00.028 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:38:00.028 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:00.029 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:38:00.029 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:38:00.029 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5719, 2021-11-15T14:38:00.029 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:38:00.030 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:38:00.030 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:38:00.030 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5719 2021-11-15T14:38:00.030 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:00.030 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:38:00.031 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:38:00.031 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:38:00.031 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2049656695 2021-11-15T14:38:00.031 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:38:00.031 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:00.032 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:38:00.032 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:38:00.032 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:38:00.032 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2049656695 2021-11-15T14:38:00.033 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:00.033 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5719 172.21.2.138:0/2049656695", 2021-11-15T14:38:00.033 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2049656695", 2021-11-15T14:38:00.033 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:38:00.033 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 26, 2021-11-15T14:38:00.034 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 58, 2021-11-15T14:38:00.034 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:38:00.034 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:38:00.034 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:38:00.035 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:38:00.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:00.036 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:38:00.037 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:00.042 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:38:00.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:38:00.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:00.043 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:00.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:00.052 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:38:00.052 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:00.100 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:38:00.101 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:38:00.102 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:38:00.102 DEBUG:teuthology.orchestra.run.gibba038:> import sys 2021-11-15T14:38:00.103 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:38:00.103 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:38:00.103 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:00.104 DEBUG:teuthology.orchestra.run.gibba038:> n = 1000 2021-11-15T14:38:00.104 DEBUG:teuthology.orchestra.run.gibba038:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T14:38:00.105 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:00.105 DEBUG:teuthology.orchestra.run.gibba038:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T14:38:00.105 DEBUG:teuthology.orchestra.run.gibba038:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T14:38:00.106 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:00.106 DEBUG:teuthology.orchestra.run.gibba038:> for i in range(0, n): 2021-11-15T14:38:00.107 DEBUG:teuthology.orchestra.run.gibba038:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T14:38:00.107 DEBUG:teuthology.orchestra.run.gibba038:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T14:38:00.107 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:38:00.108 DEBUG:teuthology.orchestra.run.gibba038:> if True: 2021-11-15T14:38:00.108 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:38:00.109 DEBUG:teuthology.orchestra.run.gibba038:> os.fsync(f.fileno()) 2021-11-15T14:38:00.109 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:38:12.076 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:12.079 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:12.083 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:12.086 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:17.799 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:38:17.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.864+0000 7fd6c54a0700 1 Processor -- start 2021-11-15T14:38:17.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.864+0000 7fd6c54a0700 1 -- start start 2021-11-15T14:38:17.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd6c0148420 0x7fd6c00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00b03d0 con 0x7fd6c00b1e30 2021-11-15T14:38:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00b0670 con 0x7fd6c00a7140 2021-11-15T14:38:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00a9140 con 0x7fd6c0148420 2021-11-15T14:38:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd6c0148420 0x7fd6c00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd6c0148420 0x7fd6c00b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57908/0 (socket says 172.21.2.135:57908) 2021-11-15T14:38:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 -- 172.21.2.135:0/487468730 learned_addr learned my addr 172.21.2.135:0/487468730 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 -- 172.21.2.135:0/487468730 >> v1:172.21.2.135:6789/0 conn(0x7fd6c00a7140 legacy=0x7fd6c01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 -- 172.21.2.135:0/487468730 >> v1:172.21.2.119:6789/0 conn(0x7fd6c00b1e30 legacy=0x7fd6c00b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:38:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 -- 172.21.2.135:0/487468730 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00b0910 con 0x7fd6c0148420 2021-11-15T14:38:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6be7fc700 1 --2- 172.21.2.135:0/487468730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c0148420 0x7fd6c00b1050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fd6c00acee0 tx=0x7fd6b0006eb0).ready entity=mon.1 client_cookie=3ab611ec23cf3bb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6bdffb700 1 -- 172.21.2.135:0/487468730 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b000d5c0 con 0x7fd6c0148420 2021-11-15T14:38:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6bdffb700 1 -- 172.21.2.135:0/487468730 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0000e90 con 0x7fd6c0148420 2021-11-15T14:38:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6bdffb700 1 -- 172.21.2.135:0/487468730 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b000d950 con 0x7fd6c0148420 2021-11-15T14:38:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/487468730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c0148420 msgr2=0x7fd6c00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/487468730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c0148420 0x7fd6c00b1050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fd6c00acee0 tx=0x7fd6b0006eb0).stop 2021-11-15T14:38:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/487468730 shutdown_connections 2021-11-15T14:38:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/487468730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c0148420 0x7fd6c00b1050 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/487468730 >> 172.21.2.135:0/487468730 conn(0x7fd6c005f730 msgr2=0x7fd6c005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/487468730 shutdown_connections 2021-11-15T14:38:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/487468730 wait complete. 2021-11-15T14:38:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 Processor -- start 2021-11-15T14:38:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- start start 2021-11-15T14:38:17.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:17.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6c00b1e30 0x7fd6c00ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:17.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6c0148420 0x7fd6c014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:17.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00aadf0 con 0x7fd6c00b1e30 2021-11-15T14:38:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014a320 con 0x7fd6c00a7140 2021-11-15T14:38:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00ac4f0 con 0x7fd6c0148420 2021-11-15T14:38:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57914/0 (socket says 172.21.2.135:57914) 2021-11-15T14:38:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 -- 172.21.2.135:0/1030781663 learned_addr learned my addr 172.21.2.135:0/1030781663 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 -- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6c0148420 msgr2=0x7fd6c014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6c0148420 0x7fd6c014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 -- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6c00b1e30 msgr2=0x7fd6c00ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:17.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6c00b1e30 0x7fd6c00ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:17.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 -- 172.21.2.135:0/1030781663 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b000b1e0 con 0x7fd6c00a7140 2021-11-15T14:38:17.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6beffd700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fd6c00af3a0 tx=0x7fd6a8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:17.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a8013460 con 0x7fd6c00a7140 2021-11-15T14:38:17.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a80135c0 con 0x7fd6c00a7140 2021-11-15T14:38:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6a8013920 con 0x7fd6c00a7140 2021-11-15T14:38:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c00ac790 con 0x7fd6c00a7140 2021-11-15T14:38:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.868+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c014a5b0 con 0x7fd6c00a7140 2021-11-15T14:38:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c014a740 con 0x7fd6c00a7140 2021-11-15T14:38:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6a800f070 con 0x7fd6c00a7140 2021-11-15T14:38:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6b7fff700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 0x7fd6a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd6a806b280 con 0x7fd6c00a7140 2021-11-15T14:38:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6be7fc700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 0x7fd6a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6be7fc700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 0x7fd6a4055b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd6c00acee0 tx=0x7fd6b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:17.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.872+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6a8042180 con 0x7fd6c00a7140 2021-11-15T14:38:17.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.980+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6c00b0bb0 con 0x7fd6c00a7140 2021-11-15T14:38:17.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.980+0000 7fd6b7fff700 1 -- 172.21.2.135:0/1030781663 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fd6a8018030 con 0x7fd6c00a7140 2021-11-15T14:38:17.987 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:38:17.987 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:38:17.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 msgr2=0x7fd6a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:17.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 0x7fd6a4055b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd6c00acee0 tx=0x7fd6b0015000).stop 2021-11-15T14:38:17.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 msgr2=0x7fd6c00a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:17.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fd6c00af3a0 tx=0x7fd6a8006df0).stop 2021-11-15T14:38:17.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 shutdown_connections 2021-11-15T14:38:17.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6a40536a0 0x7fd6a4055b60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:17.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6c0148420 0x7fd6c014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:17.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6c00b1e30 0x7fd6c00ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:17.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 --2- 172.21.2.135:0/1030781663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6c00a7140 0x7fd6c00a94c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:17.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 >> 172.21.2.135:0/1030781663 conn(0x7fd6c005f730 msgr2=0x7fd6c00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:17.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 shutdown_connections 2021-11-15T14:38:17.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:17.984+0000 7fd6c54a0700 1 -- 172.21.2.135:0/1030781663 wait complete. 2021-11-15T14:38:17.991 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:38:17.994 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2021-11-15T14:38:18.054 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T14:38:18.054 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T14:38:18.055 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:38:18.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 Processor -- start 2021-11-15T14:38:18.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 -- start start 2021-11-15T14:38:18.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 0x7f83180b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f83180a7140 0x7f83181447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180b03d0 con 0x7f83180b1e30 2021-11-15T14:38:18.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180a9140 con 0x7f83180a7140 2021-11-15T14:38:18.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f831e54e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180b0670 con 0x7f8318148420 2021-11-15T14:38:18.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8317fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f83180b1e30 0x7f83180b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45508/0 (socket says 172.21.2.135:45508) 2021-11-15T14:38:18.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8317fff700 1 -- 172.21.2.135:0/835076092 learned_addr learned my addr 172.21.2.135:0/835076092 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:18.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505724908 0 0) 0x7f83180b03d0 con 0x7f83180b1e30 2021-11-15T14:38:18.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f8003260 con 0x7f83180b1e30 2021-11-15T14:38:18.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028967820 0 0) 0x7f82f8003260 con 0x7f83180b1e30 2021-11-15T14:38:18.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 msgr2=0x7f83180b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 0x7f83180b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 >> v2:172.21.2.119:3300/0 conn(0x7f83180a7140 msgr2=0x7f83181447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 --2- 172.21.2.135:0/835076092 >> v2:172.21.2.119:3300/0 conn(0x7f83180a7140 0x7f83181447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180b0910 con 0x7f83180b1e30 2021-11-15T14:38:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8308001660 con 0x7f83180b1e30 2021-11-15T14:38:18.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 >> v1:172.21.2.135:6789/0 conn(0x7f83180b1e30 legacy=0x7f83180b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82f80037d0 0x7f82f8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f82f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 0x7f82f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180b0670 con 0x7f82f80037d0 2021-11-15T14:38:18.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8005280 con 0x7f82f8004500 2021-11-15T14:38:18.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f800bc40 con 0x7f8318148420 2021-11-15T14:38:18.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.100+0000 7f83177fe700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f82f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 -- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 msgr2=0x7f82f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8318148420 0x7f82f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 -- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82f80037d0 msgr2=0x7f82f8003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82f80037d0 0x7f82f8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 -- 172.21.2.135:0/835076092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8003260 con 0x7f82f8004500 2021-11-15T14:38:18.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f82f8004980 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f8300002f70 tx=0x7f8300006ca0).ready entity=mon.1 client_cookie=8ba3b72ca4111324 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8300012410 con 0x7f82f8004500 2021-11-15T14:38:18.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300012570 con 0x7f82f8004500 2021-11-15T14:38:18.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8316ffd700 1 -- 172.21.2.135:0/835076092 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83000128d0 con 0x7f82f8004500 2021-11-15T14:38:18.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/835076092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 msgr2=0x7f82f8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 --2- 172.21.2.135:0/835076092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f82f8004980 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f8300002f70 tx=0x7f8300006ca0).stop 2021-11-15T14:38:18.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831caeb700 1 -- 172.21.2.135:0/835076092 reap_dead start 2021-11-15T14:38:18.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/835076092 shutdown_connections 2021-11-15T14:38:18.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/835076092 >> 172.21.2.135:0/835076092 conn(0x7f831805f730 msgr2=0x7f831805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/835076092 shutdown_connections 2021-11-15T14:38:18.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/835076092 wait complete. 2021-11-15T14:38:18.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 Processor -- start 2021-11-15T14:38:18.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- start start 2021-11-15T14:38:18.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831814b8f0 0x7f83180ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83180a94c0 0x7f8318159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180a9970 con 0x7f83180a94c0 2021-11-15T14:38:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180a9b90 con 0x7f82f8004500 2021-11-15T14:38:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180a9e30 con 0x7f831814b8f0 2021-11-15T14:38:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57932/0 (socket says 172.21.2.135:57932) 2021-11-15T14:38:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 -- 172.21.2.135:0/2189138990 learned_addr learned my addr 172.21.2.135:0/2189138990 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83177fe700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831814b8f0 0x7f83180ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 -- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831814b8f0 msgr2=0x7f83180ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831814b8f0 0x7f83180ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 -- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83180a94c0 msgr2=0x7f8318159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83180a94c0 0x7f8318159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 -- 172.21.2.135:0/2189138990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180ab360 con 0x7f82f8004500 2021-11-15T14:38:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f8317fff700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8308001370 tx=0x7f83180b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8308007170 con 0x7f82f8004500 2021-11-15T14:38:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83080072d0 con 0x7f82f8004500 2021-11-15T14:38:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8308004920 con 0x7f82f8004500 2021-11-15T14:38:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83180ab600 con 0x7f82f8004500 2021-11-15T14:38:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.104+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831815a650 con 0x7f82f8004500 2021-11-15T14:38:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83180ab790 con 0x7f82f8004500 2021-11-15T14:38:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f830801b070 con 0x7f82f8004500 2021-11-15T14:38:18.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83157fa700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 0x7f82fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f830806b3f0 con 0x7f82f8004500 2021-11-15T14:38:18.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83177fe700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 0x7f82fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83177fe700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 0x7f82fc055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f8300016000 tx=0x7f8300015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.108+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83080422f0 con 0x7f82f8004500 2021-11-15T14:38:18.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83180573d0 con 0x7f82f8004500 2021-11-15T14:38:18.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f83157fa700 1 -- 172.21.2.135:0/2189138990 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f8308019020 con 0x7f82f8004500 2021-11-15T14:38:18.225 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:38:18.225 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:38:18.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 msgr2=0x7f82fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 0x7f82fc055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f8300016000 tx=0x7f8300015000).stop 2021-11-15T14:38:18.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 msgr2=0x7f83180abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8308001370 tx=0x7f83180b0aa0).stop 2021-11-15T14:38:18.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 shutdown_connections 2021-11-15T14:38:18.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82fc053610 0x7f82fc055ad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f83180a94c0 0x7f8318159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831814b8f0 0x7f83180ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 --2- 172.21.2.135:0/2189138990 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82f8004500 0x7f83180abaa0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 >> 172.21.2.135:0/2189138990 conn(0x7f831805f730 msgr2=0x7f83180b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 shutdown_connections 2021-11-15T14:38:18.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.220+0000 7f831e54e700 1 -- 172.21.2.135:0/2189138990 wait complete. 2021-11-15T14:38:18.230 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:38:18.233 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T14:38:18.290 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T14:38:18.290 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T14:38:18.291 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:38:18.302 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:38:18.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.348+0000 7fa08c3eb700 1 Processor -- start 2021-11-15T14:38:18.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.348+0000 7fa08c3eb700 1 -- start start 2021-11-15T14:38:18.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0840b1050 0x7fa0841447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840b03d0 con 0x7fa0840b1e30 2021-11-15T14:38:18.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840b0670 con 0x7fa084148420 2021-11-15T14:38:18.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0840a9140 con 0x7fa0840b1050 2021-11-15T14:38:18.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa089986700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa084148420 0x7fa0840a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45530/0 (socket says 172.21.2.135:45530) 2021-11-15T14:38:18.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa089986700 1 -- 172.21.2.135:0/3479223229 learned_addr learned my addr 172.21.2.135:0/3479223229 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:18.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- 172.21.2.135:0/3479223229 >> v2:172.21.2.135:3300/0 conn(0x7fa0840b1050 0x7fa0841447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/3479223229 >> v1:172.21.2.135:6789/0 conn(0x7fa084148420 legacy=0x7fa0840a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/3479223229 >> v1:172.21.2.119:6789/0 conn(0x7fa0840b1e30 legacy=0x7fa0840b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/3479223229 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840b0910 con 0x7fa0840b1050 2021-11-15T14:38:18.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- 172.21.2.135:0/3479223229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0840b1050 0x7fa0841447a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fa0841477b0 tx=0x7fa07c0091d0).ready entity=mon.1 client_cookie=845a83e013a8120e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa089185700 1 -- 172.21.2.135:0/3479223229 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c00b860 con 0x7fa0840b1050 2021-11-15T14:38:18.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa089185700 1 -- 172.21.2.135:0/3479223229 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00b9c0 con 0x7fa0840b1050 2021-11-15T14:38:18.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa089185700 1 -- 172.21.2.135:0/3479223229 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c00bb30 con 0x7fa0840b1050 2021-11-15T14:38:18.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/3479223229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0840b1050 msgr2=0x7fa0841447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/3479223229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0840b1050 0x7fa0841447a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fa0841477b0 tx=0x7fa07c0091d0).stop 2021-11-15T14:38:18.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/3479223229 shutdown_connections 2021-11-15T14:38:18.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/3479223229 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0840b1050 0x7fa0841447a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/3479223229 >> 172.21.2.135:0/3479223229 conn(0x7fa08405f730 msgr2=0x7fa08405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/3479223229 shutdown_connections 2021-11-15T14:38:18.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/3479223229 wait complete. 2021-11-15T14:38:18.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 Processor -- start 2021-11-15T14:38:18.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- start start 2021-11-15T14:38:18.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0840b1050 0x7fa0840ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0840b1e30 0x7fa08414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084149ce0 con 0x7fa0840b1e30 2021-11-15T14:38:18.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084149f80 con 0x7fa084148420 2021-11-15T14:38:18.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08414a220 con 0x7fa0840b1050 2021-11-15T14:38:18.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57948/0 (socket says 172.21.2.135:57948) 2021-11-15T14:38:18.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/914351797 learned_addr learned my addr 172.21.2.135:0/914351797 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0840b1050 msgr2=0x7fa0840ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0840b1050 0x7fa0840ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0840b1e30 msgr2=0x7fa08414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0840b1e30 0x7fa08414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 -- 172.21.2.135:0/914351797 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009470 con 0x7fa084148420 2021-11-15T14:38:18.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08a988700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fa0841477b0 tx=0x7fa07c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c0032f0 con 0x7fa084148420 2021-11-15T14:38:18.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c01f3f0 con 0x7fa084148420 2021-11-15T14:38:18.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08414b7d0 con 0x7fa084148420 2021-11-15T14:38:18.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840abfd0 con 0x7fa084148420 2021-11-15T14:38:18.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa07c01f750 con 0x7fa084148420 2021-11-15T14:38:18.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.352+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0840b0bb0 con 0x7fa084148420 2021-11-15T14:38:18.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa07c026030 con 0x7fa084148420 2021-11-15T14:38:18.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa0777fe700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 0x7fa064055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa07c06c5f0 con 0x7fa084148420 2021-11-15T14:38:18.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa08a187700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 0x7fa064055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa08a187700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 0x7fa064055ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa0840acee0 tx=0x7fa080007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.356+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa07c043600 con 0x7fa084148420 2021-11-15T14:38:18.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0840573d0 con 0x7fa084148420 2021-11-15T14:38:18.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa0777fe700 1 -- 172.21.2.135:0/914351797 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fa07c0249d0 con 0x7fa084148420 2021-11-15T14:38:18.472 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:38:18.472 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:38:18.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 msgr2=0x7fa064055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 0x7fa064055ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa0840acee0 tx=0x7fa080007810).stop 2021-11-15T14:38:18.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 msgr2=0x7fa0840ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fa0841477b0 tx=0x7fa07c016000).stop 2021-11-15T14:38:18.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 shutdown_connections 2021-11-15T14:38:18.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa064053610 0x7fa064055ad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa084148420 0x7fa0840ab2c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0840b1e30 0x7fa08414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 --2- 172.21.2.135:0/914351797 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0840b1050 0x7fa0840ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 >> 172.21.2.135:0/914351797 conn(0x7fa08405f730 msgr2=0x7fa0841448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 shutdown_connections 2021-11-15T14:38:18.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.468+0000 7fa08c3eb700 1 -- 172.21.2.135:0/914351797 wait complete. 2021-11-15T14:38:18.476 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:38:18.479 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c cache drop 5 2021-11-15T14:38:18.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 Processor -- start 2021-11-15T14:38:18.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 -- start start 2021-11-15T14:38:18.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f547c0b1f40 0x7f547c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 0x7f547c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0b04a0 con 0x7f547c0a7140 2021-11-15T14:38:18.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0b2810 con 0x7f547c0b1f40 2021-11-15T14:38:18.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5480c05700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0b06d0 con 0x7f547c0b0030 2021-11-15T14:38:18.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f547c0a7140 0x7f547c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45544/0 (socket says 172.21.2.135:45544) 2021-11-15T14:38:18.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 -- 172.21.2.135:0/3164083601 learned_addr learned my addr 172.21.2.135:0/3164083601 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:18.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855921580 0 0) 0x7f547c0b04a0 con 0x7f547c0a7140 2021-11-15T14:38:18.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f545c003260 con 0x7f547c0a7140 2021-11-15T14:38:18.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547a59c700 1 --2- 172.21.2.135:0/3164083601 >> v2:172.21.2.119:3300/0 conn(0x7f547c0b1f40 0x7f547c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588912582 0 0) 0x7f545c003260 con 0x7f547c0a7140 2021-11-15T14:38:18.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 msgr2=0x7f547c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f5479d9b700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 0x7f547c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 0x7f547c0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 >> v2:172.21.2.119:3300/0 conn(0x7f547c0b1f40 msgr2=0x7f547c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 --2- 172.21.2.135:0/3164083601 >> v2:172.21.2.119:3300/0 conn(0x7f547c0b1f40 0x7f547c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0b0970 con 0x7f547c0a7140 2021-11-15T14:38:18.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f54740019e0 con 0x7f547c0a7140 2021-11-15T14:38:18.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547a59c700 1 --2- 172.21.2.135:0/3164083601 >> v2:172.21.2.119:3300/0 conn(0x7f547c0b1f40 0x7f547c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:38:18.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 >> v1:172.21.2.135:6789/0 conn(0x7f547c0a7140 legacy=0x7f547c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 0x7f545c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c003ee0 0x7f545c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c004bf0 0x7f545c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0b2810 con 0x7f545c003ee0 2021-11-15T14:38:18.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0b06d0 con 0x7f545c004bf0 2021-11-15T14:38:18.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0053a0 con 0x7f547c0b0030 2021-11-15T14:38:18.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c004bf0 0x7f545c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 -- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 msgr2=0x7f545c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f547c0b0030 0x7f545c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 -- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c003ee0 msgr2=0x7f545c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c003ee0 0x7f545c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.576+0000 7f547ad9d700 1 -- 172.21.2.135:0/3164083601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c003260 con 0x7f545c004bf0 2021-11-15T14:38:18.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c004bf0 0x7f545c00b750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f54740016f0 tx=0x7f547c0b2950).ready entity=mon.1 client_cookie=432e70caaf25858b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547400cc70 con 0x7f545c004bf0 2021-11-15T14:38:18.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547400cdd0 con 0x7f545c004bf0 2021-11-15T14:38:18.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547959a700 1 -- 172.21.2.135:0/3164083601 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474005b80 con 0x7f545c004bf0 2021-11-15T14:38:18.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3164083601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c004bf0 msgr2=0x7f545c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 --2- 172.21.2.135:0/3164083601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c004bf0 0x7f545c00b750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f54740016f0 tx=0x7f547c0b2950).stop 2021-11-15T14:38:18.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 -- 172.21.2.135:0/3164083601 reap_dead start 2021-11-15T14:38:18.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3164083601 shutdown_connections 2021-11-15T14:38:18.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3164083601 >> 172.21.2.135:0/3164083601 conn(0x7f547c05f730 msgr2=0x7f547c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3164083601 shutdown_connections 2021-11-15T14:38:18.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3164083601 wait complete. 2021-11-15T14:38:18.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 Processor -- start 2021-11-15T14:38:18.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- start start 2021-11-15T14:38:18.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c004bf0 0x7f547c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f547c1573b0 0x7f547c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0af050 con 0x7f547c1573b0 2021-11-15T14:38:18.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14ba50 con 0x7f547c0ac060 2021-11-15T14:38:18.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0ae870 con 0x7f545c004bf0 2021-11-15T14:38:18.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57968/0 (socket says 172.21.2.135:57968) 2021-11-15T14:38:18.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 -- 172.21.2.135:0/3261619621 learned_addr learned my addr 172.21.2.135:0/3261619621 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547a59c700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c004bf0 0x7f547c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5479d9b700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f547c1573b0 0x7f547c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 -- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c004bf0 msgr2=0x7f547c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c004bf0 0x7f547c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 -- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f547c1573b0 msgr2=0x7f547c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f547c1573b0 0x7f547c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 -- 172.21.2.135:0/3261619621 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0aeb10 con 0x7f547c0ac060 2021-11-15T14:38:18.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f547ad9d700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f547c0aaa00 tx=0x7f5474013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f54737fe700 1 -- 172.21.2.135:0/3261619621 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547400cc70 con 0x7f547c0ac060 2021-11-15T14:38:18.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f54737fe700 1 -- 172.21.2.135:0/3261619621 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474001d80 con 0x7f547c0ac060 2021-11-15T14:38:18.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0aedb0 con 0x7f547c0ac060 2021-11-15T14:38:18.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f54737fe700 1 -- 172.21.2.135:0/3261619621 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54740074d0 con 0x7f547c0ac060 2021-11-15T14:38:18.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.580+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0aaf40 con 0x7f547c0ac060 2021-11-15T14:38:18.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f54737fe700 1 -- 172.21.2.135:0/3261619621 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f547401c070 con 0x7f547c0ac060 2021-11-15T14:38:18.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f54737fe700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 0x7f5460055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f54737fe700 1 -- 172.21.2.135:0/3261619621 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f547406c3b0 con 0x7f547c0ac060 2021-11-15T14:38:18.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 Processor -- start 2021-11-15T14:38:18.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 0x7f5460055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- start start 2021-11-15T14:38:18.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a5090 0x119db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11d5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x11137f0 con 0x11d51d0 2021-11-15T14:38:18.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f3c70 con 0x11dcc90 2021-11-15T14:38:18.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x11dd070 con 0x11a5090 2021-11-15T14:38:18.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57972/0 (socket says 172.21.2.135:57972) 2021-11-15T14:38:18.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 -- 172.21.2.135:0/3869905512 learned_addr learned my addr 172.21.2.135:0/3869905512 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 -- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a5090 msgr2=0x119db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a5090 0x119db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 -- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 msgr2=0x11d5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11d5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 -- 172.21.2.135:0/3869905512 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x114a960 con 0x11dcc90 2021-11-15T14:38:18.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 0x7f5460055ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f546c008000 tx=0x7f546c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f547a59c700 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f546c010000 tx=0x7f546c01b000).ready entity=mon.1 client_cookie=e3576015ed70820b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f5480c05700 1 -- 172.21.2.135:0/3869905512 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c018e00 con 0x11dcc90 2021-11-15T14:38:18.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f5480c05700 1 -- 172.21.2.135:0/3869905512 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c021480 con 0x11dcc90 2021-11-15T14:38:18.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f5480c05700 1 -- 172.21.2.135:0/3869905512 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c0217e0 con 0x11dcc90 2021-11-15T14:38:18.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- 172.21.2.135:0/3869905512 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 msgr2=0x11a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f546c010000 tx=0x7f546c01b000).stop 2021-11-15T14:38:18.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- 172.21.2.135:0/3869905512 shutdown_connections 2021-11-15T14:38:18.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11d5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a5090 0x119db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 --2- 172.21.2.135:0/3869905512 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11a25d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- 172.21.2.135:0/3869905512 >> 172.21.2.135:0/3869905512 conn(0x119ef00 msgr2=0x11dc220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- 172.21.2.135:0/3869905512 shutdown_connections 2021-11-15T14:38:18.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- 172.21.2.135:0/3869905512 wait complete. 2021-11-15T14:38:18.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 -- start start 2021-11-15T14:38:18.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.584+0000 7f548ae49740 1 Processor -- start 2021-11-15T14:38:18.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11dcc90 0x11a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x11e71f0 con 0x11dcc90 2021-11-15T14:38:18.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d4b80 con 0x11d51d0 2021-11-15T14:38:18.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x11a5e70 con 0x11a59d0 2021-11-15T14:38:18.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 10 client.0 ll_register_callbacks cb 0x11072f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:38:18.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57978/0 (socket says 172.21.2.135:57978) 2021-11-15T14:38:18.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 -- 172.21.2.135:0/2082753706 learned_addr learned my addr 172.21.2.135:0/2082753706 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547ad9d700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 -- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 msgr2=0x11e7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 -- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11dcc90 msgr2=0x11a80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11dcc90 0x11a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 -- 172.21.2.135:0/2082753706 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c016cc0 con 0x11d51d0 2021-11-15T14:38:18.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f547a59c700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f546c010000 tx=0x7f546c021000).ready entity=mon.1 client_cookie=478ece6c42ea3f37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:38:18.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c027070 con 0x11d51d0 2021-11-15T14:38:18.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f546c018e00 con 0x11d51d0 2021-11-15T14:38:18.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11098b0 con 0x11d51d0 2021-11-15T14:38:18.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f546c00ca20 con 0x11d51d0 2021-11-15T14:38:18.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 10 client.5752 fetch_fsmap learned FSMap version 26 2021-11-15T14:38:18.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x1102ea0 con 0x11d51d0 2021-11-15T14:38:18.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11098b0 con 0x11d51d0 2021-11-15T14:38:18.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 26) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f546c013a60 con 0x11d51d0 2021-11-15T14:38:18.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 10 client.5752 fetch_fsmap finished waiting for FSMap version 26 2021-11-15T14:38:18.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 10 client.5752 resolve_mds: resolved ID 'c' to GID 5551 2021-11-15T14:38:18.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 20 client.5752 populate_metadata read hostname 'gibba035' 2021-11-15T14:38:18.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11a6d60 0x11ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 4 client.5752 mds_command: new command op to 5551 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T14:38:18.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 --> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1101930 con 0x11a6d60 2021-11-15T14:38:18.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f5479d9b700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11a6d60 0x11ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f5479d9b700 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11a6d60 0x11ea7c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4086c5141dcf7c91 server_cookie=665e78866efd5ba1 in_seq=0 out_seq=0 2021-11-15T14:38:18.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 10 client.5752 ms_handle_connect on v2:172.21.2.135:6833/2231823287 2021-11-15T14:38:18.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 1 -- 172.21.2.135:0/2082753706 <== mds.0 v2:172.21.2.135:6833/2231823287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1101930 con 0x11a6d60 2021-11-15T14:38:18.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 10 client.5752 handle_command_reply: tid=0 2021-11-15T14:38:18.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 client.5752 shutdown 2021-11-15T14:38:18.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 msgr2=0x11a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f546c010000 tx=0x7f546c021000).stop 2021-11-15T14:38:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 shutdown_connections 2021-11-15T14:38:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11a6d60 0x11ea7c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11dcc90 0x11a80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 --2- 172.21.2.135:0/2082753706 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11d51d0 0x11a7bf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 >> 172.21.2.135:0/2082753706 conn(0x11a5090 msgr2=0x11d9400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f54597fa700 0 client.5752 ms_handle_reset on v2:172.21.2.135:6833/2231823287 2021-11-15T14:38:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 shutdown_connections 2021-11-15T14:38:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 1 -- 172.21.2.135:0/2082753706 wait complete. 2021-11-15T14:38:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.588+0000 7f548ae49740 20 client.5752 trim_cache size 0 max 16384 2021-11-15T14:38:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 Processor -- start 2021-11-15T14:38:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- start start 2021-11-15T14:38:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11d75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a86a0 con 0x11d51d0 2021-11-15T14:38:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x119dbf0 con 0x11dcc90 2021-11-15T14:38:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x11a0cb0 con 0x11a59d0 2021-11-15T14:38:18.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57988/0 (socket says 172.21.2.135:57988) 2021-11-15T14:38:18.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 -- 172.21.2.135:0/1162642454 learned_addr learned my addr 172.21.2.135:0/1162642454 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 -- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 msgr2=0x11d75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11d75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 -- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 msgr2=0x11ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 -- 172.21.2.135:0/1162642454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x110ba90 con 0x11dcc90 2021-11-15T14:38:18.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x10f9650 tx=0x7f547406c040).ready entity=mon.1 client_cookie=4e9d67c4c59b252f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f545b7fe700 1 -- 172.21.2.135:0/1162642454 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54740469e0 con 0x11dcc90 2021-11-15T14:38:18.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f545b7fe700 1 -- 172.21.2.135:0/1162642454 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474047020 con 0x11dcc90 2021-11-15T14:38:18.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f545b7fe700 1 -- 172.21.2.135:0/1162642454 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474045420 con 0x11dcc90 2021-11-15T14:38:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- 172.21.2.135:0/1162642454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 msgr2=0x11eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x10f9650 tx=0x7f547406c040).stop 2021-11-15T14:38:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- 172.21.2.135:0/1162642454 shutdown_connections 2021-11-15T14:38:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x11eabc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x11ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 --2- 172.21.2.135:0/1162642454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11d75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- 172.21.2.135:0/1162642454 >> 172.21.2.135:0/1162642454 conn(0x11a5090 msgr2=0x11a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- 172.21.2.135:0/1162642454 shutdown_connections 2021-11-15T14:38:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- 172.21.2.135:0/1162642454 wait complete. 2021-11-15T14:38:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 -- start start 2021-11-15T14:38:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.596+0000 7f548ae49740 1 Processor -- start 2021-11-15T14:38:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x123c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x11e3f50 con 0x11d51d0 2021-11-15T14:38:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x11df710 con 0x11dcc90 2021-11-15T14:38:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x11e4610 con 0x11a59d0 2021-11-15T14:38:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 10 client.0 ll_register_callbacks cb 0x7f546400c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:38:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:57996/0 (socket says 172.21.2.135:57996) 2021-11-15T14:38:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 -- 172.21.2.135:0/1017519829 learned_addr learned my addr 172.21.2.135:0/1017519829 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 -- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 msgr2=0x11e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 -- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 msgr2=0x123c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x123c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 -- 172.21.2.135:0/1017519829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0aaf40 con 0x11dcc90 2021-11-15T14:38:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547ad9d700 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x10f9650 tx=0x7f547402c000).ready entity=mon.1 client_cookie=79392de7cd06c1a7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:38:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474046800 con 0x11dcc90 2021-11-15T14:38:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f547406c1a0 con 0x11dcc90 2021-11-15T14:38:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f546c021480 con 0x11dcc90 2021-11-15T14:38:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5474042e70 con 0x11dcc90 2021-11-15T14:38:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 10 client.5758 fetch_fsmap learned FSMap version 26 2021-11-15T14:38:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x1108480 con 0x11dcc90 2021-11-15T14:38:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c021480 con 0x11dcc90 2021-11-15T14:38:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 26) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f5474042fd0 con 0x11dcc90 2021-11-15T14:38:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 10 client.5758 fetch_fsmap finished waiting for FSMap version 26 2021-11-15T14:38:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 10 client.5758 resolve_mds: resolved ID 'c' to GID 5551 2021-11-15T14:38:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 20 client.5758 populate_metadata read hostname 'gibba035' 2021-11-15T14:38:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11e0d60 0x1234720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 4 client.5758 mds_command: new command op to 5551 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-11-15T14:38:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 --> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0xff75e0 con 0x11e0d60 2021-11-15T14:38:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547a59c700 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11e0d60 0x1234720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f547a59c700 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11e0d60 0x1234720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e172acd6599b313f server_cookie=9658f7d07c89b988 in_seq=0 out_seq=0 2021-11-15T14:38:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:18.600+0000 7f545a7fc700 10 client.5758 ms_handle_connect on v2:172.21.2.135:6833/2231823287 2021-11-15T14:38:23.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f545a7fc700 1 -- 172.21.2.135:0/1017519829 <== mds.0 v2:172.21.2.135:6833/2231823287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0xff75e0 con 0x11e0d60 2021-11-15T14:38:23.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f545a7fc700 10 client.5758 handle_command_reply: tid=0 2021-11-15T14:38:23.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 client.5758 shutdown 2021-11-15T14:38:23.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 msgr2=0x123b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x10f9650 tx=0x7f547402c000).stop 2021-11-15T14:38:23.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 shutdown_connections 2021-11-15T14:38:23.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:6833/2231823287,v1:172.21.2.135:6835/2231823287] conn(0x11e0d60 0x1234720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x11dcc90 0x123b760 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x11d51d0 0x123c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 --2- 172.21.2.135:0/1017519829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x11a59d0 0x11e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f545a7fc700 0 client.5758 ms_handle_reset on v2:172.21.2.135:6833/2231823287 2021-11-15T14:38:23.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 >> 172.21.2.135:0/1017519829 conn(0x11a5090 msgr2=0x11a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:23.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 shutdown_connections 2021-11-15T14:38:23.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 1 -- 172.21.2.135:0/1017519829 wait complete. 2021-11-15T14:38:23.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f548ae49740 20 client.5758 trim_cache size 0 max 16384 2021-11-15T14:38:23.693 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:38:23.693 INFO:teuthology.orchestra.run.gibba035.stdout: "client_recall": { 2021-11-15T14:38:23.693 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": -110, 2021-11-15T14:38:23.694 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "(110) Connection timed out", 2021-11-15T14:38:23.694 INFO:teuthology.orchestra.run.gibba035.stdout: "recalled": 120 2021-11-15T14:38:23.694 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:38:23.694 INFO:teuthology.orchestra.run.gibba035.stdout: "flush_journal": { 2021-11-15T14:38:23.695 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:38:23.695 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "" 2021-11-15T14:38:23.695 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:38:23.695 INFO:teuthology.orchestra.run.gibba035.stdout: "trim_cache": { 2021-11-15T14:38:23.695 INFO:teuthology.orchestra.run.gibba035.stdout: "trimmed": 0 2021-11-15T14:38:23.696 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:38:23.696 INFO:teuthology.orchestra.run.gibba035.stdout: "cache": { 2021-11-15T14:38:23.696 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": { 2021-11-15T14:38:23.696 INFO:teuthology.orchestra.run.gibba035.stdout: "items": 19887, 2021-11-15T14:38:23.697 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes": 3092304 2021-11-15T14:38:23.697 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:38:23.697 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:38:23.697 INFO:teuthology.orchestra.run.gibba035.stdout: "duration": 5.0830050529999999 2021-11-15T14:38:23.697 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:38:23.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 msgr2=0x7f5460055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 0x7f5460055ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f546c008000 tx=0x7f546c008040).stop 2021-11-15T14:38:23.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 msgr2=0x7f547c15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f547c0aaa00 tx=0x7f5474013000).stop 2021-11-15T14:38:23.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 shutdown_connections 2021-11-15T14:38:23.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5460053610 0x7f5460055ad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f547c0ac060 0x7f547c15b3a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f547c1573b0 0x7f547c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 --2- 172.21.2.135:0/3261619621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c004bf0 0x7f547c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 >> 172.21.2.135:0/3261619621 conn(0x7f547c05f730 msgr2=0x7f547c13b670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:23.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 shutdown_connections 2021-11-15T14:38:23.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.684+0000 7f5480c05700 1 -- 172.21.2.135:0/3261619621 wait complete. 2021-11-15T14:38:23.702 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T14:38:23.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:23.703 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:38:23.704 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:23.713 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T14:38:23.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:38:23.715 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T14:38:23.716 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:38:23.716 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:38:23.716 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:23.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:23.732 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:38:23.732 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:23.779 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:38:23.780 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:38:23.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:38:23.781 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:23.787 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:38:23.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 Processor -- start 2021-11-15T14:38:23.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- start start 2021-11-15T14:38:23.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf00b1e30 0x7ffaf00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffaf0148420 0x7ffaf00b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00b03d0 con 0x7ffaf00a7140 2021-11-15T14:38:23.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00a9140 con 0x7ffaf0148420 2021-11-15T14:38:23.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00b0670 con 0x7ffaf00b1e30 2021-11-15T14:38:23.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffaf0148420 0x7ffaf00b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:23.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffaf0148420 0x7ffaf00b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58008/0 (socket says 172.21.2.135:58008) 2021-11-15T14:38:23.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/956155945 learned_addr learned my addr 172.21.2.135:0/956155945 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:23.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/956155945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf00b1e30 msgr2=0x7ffaf00b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:38:23.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 --2- 172.21.2.135:0/956155945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf00b1e30 0x7ffaf00b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/956155945 >> v1:172.21.2.119:6789/0 conn(0x7ffaf00a7140 legacy=0x7ffaf01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:23.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/956155945 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00b0910 con 0x7ffaf0148420 2021-11-15T14:38:23.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf4ed0700 1 --2- 172.21.2.135:0/956155945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf0148420 0x7ffaf00b2210 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ffaf0061420 tx=0x7ffae4006eb0).ready entity=mon.1 client_cookie=c4189a4d46155ae4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:23.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffae3fff700 1 -- 172.21.2.135:0/956155945 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400d570 con 0x7ffaf0148420 2021-11-15T14:38:23.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffae3fff700 1 -- 172.21.2.135:0/956155945 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4000e90 con 0x7ffaf0148420 2021-11-15T14:38:23.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffae3fff700 1 -- 172.21.2.135:0/956155945 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400d8c0 con 0x7ffaf0148420 2021-11-15T14:38:23.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- 172.21.2.135:0/956155945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf0148420 msgr2=0x7ffaf00b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- 172.21.2.135:0/956155945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf0148420 0x7ffaf00b2210 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ffaf0061420 tx=0x7ffae4006eb0).stop 2021-11-15T14:38:23.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- 172.21.2.135:0/956155945 shutdown_connections 2021-11-15T14:38:23.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- 172.21.2.135:0/956155945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf0148420 0x7ffaf00b2210 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- 172.21.2.135:0/956155945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf00b1e30 0x7ffaf00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- 172.21.2.135:0/956155945 >> 172.21.2.135:0/956155945 conn(0x7ffaf005f730 msgr2=0x7ffaf005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:23.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- 172.21.2.135:0/956155945 shutdown_connections 2021-11-15T14:38:23.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- 172.21.2.135:0/956155945 wait complete. 2021-11-15T14:38:23.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 Processor -- start 2021-11-15T14:38:23.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- start start 2021-11-15T14:38:23.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffaf00a7140 0x7ffaf00ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf0148420 0x7ffaf00aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf015b020 con 0x7ffaf00a7140 2021-11-15T14:38:23.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00aac40 con 0x7ffaf00b1e30 2021-11-15T14:38:23.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.896+0000 7ffaf7935700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00aaed0 con 0x7ffaf0148420 2021-11-15T14:38:23.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:23.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58012/0 (socket says 172.21.2.135:58012) 2021-11-15T14:38:23.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/2817384647 learned_addr learned my addr 172.21.2.135:0/2817384647 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:23.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf0148420 msgr2=0x7ffaf00aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf0148420 0x7ffaf00aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffaf00a7140 msgr2=0x7ffaf00ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffaf00a7140 0x7ffaf00ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 -- 172.21.2.135:0/2817384647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae400b1e0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf4ed0700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ffaf0061420 tx=0x7ffae4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:23.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae4011810 con 0x7ffaf00b1e30 2021-11-15T14:38:23.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4011970 con 0x7ffaf00b1e30 2021-11-15T14:38:23.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00ab170 con 0x7ffaf00b1e30 2021-11-15T14:38:23.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae4011cd0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0156b20 con 0x7ffaf00b1e30 2021-11-15T14:38:23.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf00b0bb0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffae4025030 con 0x7ffaf00b1e30 2021-11-15T14:38:23.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:23.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffae406cdc0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf56d1700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:23.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.900+0000 7ffaf56d1700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 0x7ffad0055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ffaec002fb0 tx=0x7ffaec0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:23.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.904+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffae4043dd0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf00573d0 con 0x7ffaf00b1e30 2021-11-15T14:38:23.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffae27fc700 1 -- 172.21.2.135:0/2817384647 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16273 (secure 0 0 0) 0x7ffae4023020 con 0x7ffaf00b1e30 2021-11-15T14:38:23.993 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:38:23.993 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":58,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:37:55.984224+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:37:52.935747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-15T14:37:53.946772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:38:23.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 msgr2=0x7ffad0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 0x7ffad0055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ffaec002fb0 tx=0x7ffaec0069b0).stop 2021-11-15T14:38:23.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 msgr2=0x7ffaf015ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:23.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ffaf0061420 tx=0x7ffae4015000).stop 2021-11-15T14:38:23.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 shutdown_connections 2021-11-15T14:38:23.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffad0053610 0x7ffad0055ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffaf0148420 0x7ffaf00aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffaf00b1e30 0x7ffaf015ab30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:23.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 --2- 172.21.2.135:0/2817384647 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffaf00a7140 0x7ffaf00ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:23.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 >> 172.21.2.135:0/2817384647 conn(0x7ffaf005f730 msgr2=0x7ffaf0140740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:23.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 shutdown_connections 2021-11-15T14:38:23.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:23.988+0000 7ffaf7935700 1 -- 172.21.2.135:0/2817384647 wait complete. 2021-11-15T14:38:24.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:37:52.935747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:37:53.946772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:38:24.001 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:38:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 Processor -- start 2021-11-15T14:38:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 -- start start 2021-11-15T14:38:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b1350 0x7f7e600b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e600b2320 0x7f7e601412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600a7850 con 0x7f7e600b1f40 2021-11-15T14:38:24.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e600b17c0 con 0x7f7e600b2320 2021-11-15T14:38:24.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.048+0000 7f7e68607700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600b06d0 con 0x7f7e600b1350 2021-11-15T14:38:24.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e600b2320 0x7f7e601412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e65ba2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b1350 0x7f7e600b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e600b2320 0x7f7e601412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:51836/0 (socket says 172.21.2.135:51836) 2021-11-15T14:38:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e663a3700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f7e600b1f40 0x7f7e600a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:55022/0 (socket says 172.21.2.135:55022) 2021-11-15T14:38:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 -- 172.21.2.135:0/2220440974 learned_addr learned my addr 172.21.2.135:0/2220440974 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 -- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b1350 msgr2=0x7f7e600b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 --2- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b1350 0x7f7e600b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 -- 172.21.2.135:0/2220440974 >> v1:172.21.2.119:6789/0 conn(0x7f7e600b1f40 legacy=0x7f7e600a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 -- 172.21.2.135:0/2220440974 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600b0970 con 0x7f7e600b2320 2021-11-15T14:38:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e66ba4700 1 --2- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b2320 0x7f7e601412d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7e580032f0 tx=0x7f7e58009290).ready entity=mon.0 client_cookie=2a46f3bf073de0e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e653a1700 1 -- 172.21.2.135:0/2220440974 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5800b8a0 con 0x7f7e600b2320 2021-11-15T14:38:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e653a1700 1 -- 172.21.2.135:0/2220440974 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5800ba00 con 0x7f7e600b2320 2021-11-15T14:38:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e653a1700 1 -- 172.21.2.135:0/2220440974 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5800bb70 con 0x7f7e600b2320 2021-11-15T14:38:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b2320 msgr2=0x7f7e601412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 --2- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b2320 0x7f7e601412d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7e580032f0 tx=0x7f7e58009290).stop 2021-11-15T14:38:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- 172.21.2.135:0/2220440974 shutdown_connections 2021-11-15T14:38:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 --2- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b2320 0x7f7e601412d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 --2- 172.21.2.135:0/2220440974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b1350 0x7f7e600b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- 172.21.2.135:0/2220440974 >> 172.21.2.135:0/2220440974 conn(0x7f7e6005f730 msgr2=0x7f7e6005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- 172.21.2.135:0/2220440974 shutdown_connections 2021-11-15T14:38:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- 172.21.2.135:0/2220440974 wait complete. 2021-11-15T14:38:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 Processor -- start 2021-11-15T14:38:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.052+0000 7f7e68607700 1 -- start start 2021-11-15T14:38:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b1f40 0x7f7e600aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b2320 0x7f7e6014b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600aa4b0 con 0x7f7e600b1f40 2021-11-15T14:38:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601490b0 con 0x7f7e600b1350 2021-11-15T14:38:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ab800 con 0x7f7e600b2320 2021-11-15T14:38:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58024/0 (socket says 172.21.2.135:58024) 2021-11-15T14:38:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 -- 172.21.2.135:0/4286052852 learned_addr learned my addr 172.21.2.135:0/4286052852 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 -- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b2320 msgr2=0x7f7e6014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b2320 0x7f7e6014b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 -- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b1f40 msgr2=0x7f7e600aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b1f40 0x7f7e600aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 -- 172.21.2.135:0/4286052852 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58009530 con 0x7f7e600b1350 2021-11-15T14:38:24.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e663a3700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7e6006a170 tx=0x7f7e54007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5400ce30 con 0x7f7e600b1350 2021-11-15T14:38:24.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540072e0 con 0x7f7e600b1350 2021-11-15T14:38:24.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e54005740 con 0x7f7e600b1350 2021-11-15T14:38:24.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60148bb0 con 0x7f7e600b1350 2021-11-15T14:38:24.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60148e10 con 0x7f7e600b1350 2021-11-15T14:38:24.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600573d0 con 0x7f7e600b1350 2021-11-15T14:38:24.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e54010070 con 0x7f7e600b1350 2021-11-15T14:38:24.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 0x7f7e40055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7e5406b210 con 0x7f7e600b1350 2021-11-15T14:38:24.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.056+0000 7f7e65ba2700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 0x7f7e40055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.060+0000 7f7e65ba2700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 0x7f7e40055a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7e5c00c000 tx=0x7f7e5c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.060+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e54042110 con 0x7f7e600b1350 2021-11-15T14:38:24.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.140+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7e600aba80 con 0x7f7e600b1350 2021-11-15T14:38:24.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.140+0000 7f7e537fe700 1 -- 172.21.2.135:0/4286052852 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7e54045730 con 0x7f7e600b1350 2021-11-15T14:38:24.147 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:38:24.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 msgr2=0x7f7e40055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 0x7f7e40055a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7e5c00c000 tx=0x7f7e5c006df0).stop 2021-11-15T14:38:24.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 msgr2=0x7f7e600abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7e6006a170 tx=0x7f7e54007c00).stop 2021-11-15T14:38:24.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 shutdown_connections 2021-11-15T14:38:24.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e40053540 0x7f7e40055a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e600b2320 0x7f7e6014b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e600b1f40 0x7f7e600aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 --2- 172.21.2.135:0/4286052852 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e600b1350 0x7f7e600abd90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 >> 172.21.2.135:0/4286052852 conn(0x7f7e6005f730 msgr2=0x7f7e600a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 shutdown_connections 2021-11-15T14:38:24.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.144+0000 7f7e68607700 1 -- 172.21.2.135:0/4286052852 wait complete. 2021-11-15T14:38:24.153 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:38:24.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 Processor -- start 2021-11-15T14:38:24.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- start start 2021-11-15T14:38:24.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f649c0ad0c0 0x7f649c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c0afb70 0x7f649c13c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0b5fc0 con 0x7f649c13c820 2021-11-15T14:38:24.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0ad4a0 con 0x7f649c0ad0c0 2021-11-15T14:38:24.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c13cc50 con 0x7f649c0afb70 2021-11-15T14:38:24.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f649c0ad0c0 0x7f649c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f649c0ad0c0 0x7f649c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58032/0 (socket says 172.21.2.135:58032) 2021-11-15T14:38:24.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 -- 172.21.2.135:0/2384151052 learned_addr learned my addr 172.21.2.135:0/2384151052 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 -- 172.21.2.135:0/2384151052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c0afb70 msgr2=0x7f649c13c330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:38:24.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 --2- 172.21.2.135:0/2384151052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c0afb70 0x7f649c13c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 -- 172.21.2.135:0/2384151052 >> v1:172.21.2.119:6789/0 conn(0x7f649c13c820 legacy=0x7f649c13f0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:38:24.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 -- 172.21.2.135:0/2384151052 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0aebe0 con 0x7f649c0ad0c0 2021-11-15T14:38:24.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f649affd700 1 --2- 172.21.2.135:0/2384151052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0ad0c0 0x7f649c0b5ad0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f649c062980 tx=0x7f6490006f40).ready entity=mon.1 client_cookie=8ccb6c21cb24c225 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f6499ffb700 1 -- 172.21.2.135:0/2384151052 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6490007cb0 con 0x7f649c0ad0c0 2021-11-15T14:38:24.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f6499ffb700 1 -- 172.21.2.135:0/2384151052 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490000e90 con 0x7f649c0ad0c0 2021-11-15T14:38:24.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f6499ffb700 1 -- 172.21.2.135:0/2384151052 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64900092c0 con 0x7f649c0ad0c0 2021-11-15T14:38:24.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- 172.21.2.135:0/2384151052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0ad0c0 msgr2=0x7f649c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 --2- 172.21.2.135:0/2384151052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0ad0c0 0x7f649c0b5ad0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f649c062980 tx=0x7f6490006f40).stop 2021-11-15T14:38:24.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- 172.21.2.135:0/2384151052 shutdown_connections 2021-11-15T14:38:24.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 --2- 172.21.2.135:0/2384151052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c0afb70 0x7f649c13c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 --2- 172.21.2.135:0/2384151052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0ad0c0 0x7f649c0b5ad0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- 172.21.2.135:0/2384151052 >> 172.21.2.135:0/2384151052 conn(0x7f649c05c510 msgr2=0x7f649c05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- 172.21.2.135:0/2384151052 shutdown_connections 2021-11-15T14:38:24.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.200+0000 7f64a1792700 1 -- 172.21.2.135:0/2384151052 wait complete. 2021-11-15T14:38:24.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 Processor -- start 2021-11-15T14:38:24.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- start start 2021-11-15T14:38:24.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f649c0ad0c0 0x7f649c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c13c820 0x7f649c141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c13df80 con 0x7f649c0ad0c0 2021-11-15T14:38:24.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c15a700 con 0x7f649c0afb70 2021-11-15T14:38:24.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c15a930 con 0x7f649c13c820 2021-11-15T14:38:24.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58040/0 (socket says 172.21.2.135:58040) 2021-11-15T14:38:24.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 -- 172.21.2.135:0/1017923544 learned_addr learned my addr 172.21.2.135:0/1017923544 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 -- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c13c820 msgr2=0x7f649c141970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:38:24.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c13c820 0x7f649c141970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 -- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f649c0ad0c0 msgr2=0x7f649c15a210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:38:24.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f649c0ad0c0 0x7f649c15a210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 -- 172.21.2.135:0/1017923544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649000d040 con 0x7f649c0afb70 2021-11-15T14:38:24.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649a7fc700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f649c13e0c0 tx=0x7f648c006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648c012410 con 0x7f649c0afb70 2021-11-15T14:38:24.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c012570 con 0x7f649c0afb70 2021-11-15T14:38:24.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c15abd0 con 0x7f649c0afb70 2021-11-15T14:38:24.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648c0128d0 con 0x7f649c0afb70 2021-11-15T14:38:24.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c141e60 con 0x7f649c0afb70 2021-11-15T14:38:24.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c15ad60 con 0x7f649c0afb70 2021-11-15T14:38:24.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f648c00f030 con 0x7f649c0afb70 2021-11-15T14:38:24.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 0x7f6478055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f648c06b7e0 con 0x7f649c0afb70 2021-11-15T14:38:24.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.204+0000 7f649affd700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 0x7f6478055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.208+0000 7f649affd700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 0x7f6478055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f649c062980 tx=0x7f649c0b6800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.208+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f648c0427f0 con 0x7f649c0afb70 2021-11-15T14:38:24.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.288+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f649c0aee80 con 0x7f649c0afb70 2021-11-15T14:38:24.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.288+0000 7f648bfff700 1 -- 172.21.2.135:0/1017923544 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f648c045e10 con 0x7f649c0afb70 2021-11-15T14:38:24.295 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:38:24.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 msgr2=0x7f6478055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 0x7f6478055a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f649c062980 tx=0x7f649c0b6800).stop 2021-11-15T14:38:24.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 msgr2=0x7f649c141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f649c13e0c0 tx=0x7f648c006d50).stop 2021-11-15T14:38:24.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 shutdown_connections 2021-11-15T14:38:24.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6478053580 0x7f6478055a40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f649c13c820 0x7f649c141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f649c0afb70 0x7f649c141480 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 --2- 172.21.2.135:0/1017923544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f649c0ad0c0 0x7f649c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 >> 172.21.2.135:0/1017923544 conn(0x7f649c05c510 msgr2=0x7f649c13a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 shutdown_connections 2021-11-15T14:38:24.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.292+0000 7f64a1792700 1 -- 172.21.2.135:0/1017923544 wait complete. 2021-11-15T14:38:24.302 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:38:24.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 Processor -- start 2021-11-15T14:38:24.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 -- start start 2021-11-15T14:38:24.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcd280654a0 0x7fcd281444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd280b2430 con 0x7fcd28060040 2021-11-15T14:38:24.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd280b26d0 con 0x7fcd280b3950 2021-11-15T14:38:24.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2f873700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd280b2970 con 0x7fcd280654a0 2021-11-15T14:38:24.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2de10700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcd280b3950 0x7fcd281449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45634/0 (socket says 172.21.2.135:45634) 2021-11-15T14:38:24.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.348+0000 7fcd2de10700 1 -- 172.21.2.135:0/3786816772 learned_addr learned my addr 172.21.2.135:0/3786816772 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:24.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013575579 0 0) 0x7fcd280b26d0 con 0x7fcd280b3950 2021-11-15T14:38:24.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd10003260 con 0x7fcd280b3950 2021-11-15T14:38:24.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880542322 0 0) 0x7fcd10003260 con 0x7fcd280b3950 2021-11-15T14:38:24.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 >> v2:172.21.2.119:3300/0 conn(0x7fcd280654a0 msgr2=0x7fcd281444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 --2- 172.21.2.135:0/3786816772 >> v2:172.21.2.119:3300/0 conn(0x7fcd280654a0 0x7fcd281444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 >> v1:172.21.2.119:6789/0 conn(0x7fcd28060040 legacy=0x7fcd28064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280648f0 con 0x7fcd280b3950 2021-11-15T14:38:24.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fcd200019e0 con 0x7fcd280b3950 2021-11-15T14:38:24.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 >> v1:172.21.2.135:6789/0 conn(0x7fcd280b3950 legacy=0x7fcd281449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd100037d0 0x7fcd10003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 0x7fcd10004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10005070 0x7fcd1000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280b2970 con 0x7fcd100037d0 2021-11-15T14:38:24.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1000bef0 con 0x7fcd10004500 2021-11-15T14:38:24.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1000c0b0 con 0x7fcd10005070 2021-11-15T14:38:24.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 0x7fcd10004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2d60f700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd100037d0 0x7fcd10003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10005070 0x7fcd1000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 -- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10005070 msgr2=0x7fcd1000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10005070 0x7fcd1000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 -- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd100037d0 msgr2=0x7fcd10003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd100037d0 0x7fcd10003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 -- 172.21.2.135:0/3786816772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280648f0 con 0x7fcd10004500 2021-11-15T14:38:24.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 -- 172.21.2.135:0/3786816772 reap_dead start 2021-11-15T14:38:24.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2d60f700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd100037d0 0x7fcd10003bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:38:24.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 0x7fcd10004980 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fcd18002f70 tx=0x7fcd18006ca0).ready entity=mon.1 client_cookie=732301dc3214a0f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd18013410 con 0x7fcd10004500 2021-11-15T14:38:24.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18013570 con 0x7fcd10004500 2021-11-15T14:38:24.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd17fff700 1 -- 172.21.2.135:0/3786816772 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd180138d0 con 0x7fcd10004500 2021-11-15T14:38:24.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 msgr2=0x7fcd10004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 0x7fcd10004980 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fcd18002f70 tx=0x7fcd18006ca0).stop 2021-11-15T14:38:24.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- 172.21.2.135:0/3786816772 shutdown_connections 2021-11-15T14:38:24.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 --2- 172.21.2.135:0/3786816772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd10004500 0x7fcd10004980 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- 172.21.2.135:0/3786816772 >> 172.21.2.135:0/3786816772 conn(0x7fcd2805cfe0 msgr2=0x7fcd2805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- 172.21.2.135:0/3786816772 shutdown_connections 2021-11-15T14:38:24.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- 172.21.2.135:0/3786816772 wait complete. 2021-11-15T14:38:24.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 Processor -- start 2021-11-15T14:38:24.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- start start 2021-11-15T14:38:24.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10004500 0x7fcd280ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd280ad980 0x7fcd280adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280af470 con 0x7fcd280ad980 2021-11-15T14:38:24.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280aec50 con 0x7fcd280af940 2021-11-15T14:38:24.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2f873700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280af6e0 con 0x7fcd10004500 2021-11-15T14:38:24.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58062/0 (socket says 172.21.2.135:58062) 2021-11-15T14:38:24.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 -- 172.21.2.135:0/1790571260 learned_addr learned my addr 172.21.2.135:0/1790571260 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 -- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10004500 msgr2=0x7fcd280ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10004500 0x7fcd280ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2ce0e700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd280ad980 0x7fcd280adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 -- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd280ad980 msgr2=0x7fcd280adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd280ad980 0x7fcd280adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 -- 172.21.2.135:0/1790571260 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280b5260 con 0x7fcd280af940 2021-11-15T14:38:24.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.352+0000 7fcd2de10700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fcd280af5b0 tx=0x7fcd20009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20004ab0 con 0x7fcd280af940 2021-11-15T14:38:24.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20004c10 con 0x7fcd280af940 2021-11-15T14:38:24.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd280b0f30 con 0x7fcd280af940 2021-11-15T14:38:24.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20007030 con 0x7fcd280af940 2021-11-15T14:38:24.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd280aee80 con 0x7fcd280af940 2021-11-15T14:38:24.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2813fe30 con 0x7fcd280af940 2021-11-15T14:38:24.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd2001c060 con 0x7fcd280af940 2021-11-15T14:38:24.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 0x7fcd08055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcd2006b600 con 0x7fcd280af940 2021-11-15T14:38:24.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd2d60f700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 0x7fcd08055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd2d60f700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 0x7fcd08055be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcd24008000 tx=0x7fcd24009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.356+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd20042500 con 0x7fcd280af940 2021-11-15T14:38:24.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.440+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd280ae9f0 con 0x7fcd280af940 2021-11-15T14:38:24.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.440+0000 7fcd167fc700 1 -- 172.21.2.135:0/1790571260 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcd2001a070 con 0x7fcd280af940 2021-11-15T14:38:24.447 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:38:24.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 msgr2=0x7fcd08055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 0x7fcd08055be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcd24008000 tx=0x7fcd24009040).stop 2021-11-15T14:38:24.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 msgr2=0x7fcd280afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fcd280af5b0 tx=0x7fcd20009040).stop 2021-11-15T14:38:24.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 shutdown_connections 2021-11-15T14:38:24.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd08053720 0x7fcd08055be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd280af940 0x7fcd280afdc0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd280ad980 0x7fcd280adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 --2- 172.21.2.135:0/1790571260 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd10004500 0x7fcd280ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 >> 172.21.2.135:0/1790571260 conn(0x7fcd2805cfe0 msgr2=0x7fcd28140320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 shutdown_connections 2021-11-15T14:38:24.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.444+0000 7fcd2f873700 1 -- 172.21.2.135:0/1790571260 wait complete. 2021-11-15T14:38:24.454 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:38:24.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 Processor -- start 2021-11-15T14:38:24.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- start start 2021-11-15T14:38:24.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff8f40b3950 0x7ff8f4144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40b2430 con 0x7ff8f40654a0 2021-11-15T14:38:24.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40b26d0 con 0x7ff8f4060040 2021-11-15T14:38:24.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40b2970 con 0x7ff8f40b3950 2021-11-15T14:38:24.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f2ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff8f4060040 0x7ff8f4064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45654/0 (socket says 172.21.2.135:45654) 2021-11-15T14:38:24.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f2ffd700 1 -- 172.21.2.135:0/3344688011 learned_addr learned my addr 172.21.2.135:0/3344688011 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:24.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91083369 0 0) 0x7ff8f40b26d0 con 0x7ff8f4060040 2021-11-15T14:38:24.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d4003260 con 0x7ff8f4060040 2021-11-15T14:38:24.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827495966 0 0) 0x7ff8d4003260 con 0x7ff8f4060040 2021-11-15T14:38:24.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 >> v2:172.21.2.119:3300/0 conn(0x7ff8f40b3950 msgr2=0x7ff8f4144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 --2- 172.21.2.135:0/3344688011 >> v2:172.21.2.119:3300/0 conn(0x7ff8f40b3950 0x7ff8f4144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 >> v1:172.21.2.119:6789/0 conn(0x7ff8f40654a0 legacy=0x7ff8f41444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40648f0 con 0x7ff8f4060040 2021-11-15T14:38:24.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff8dc001660 con 0x7ff8f4060040 2021-11-15T14:38:24.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 >> v1:172.21.2.135:6789/0 conn(0x7ff8f4060040 legacy=0x7ff8f4064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d4003820 0x7ff8d4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4004500 0x7ff8d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 0x7ff8d400fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b2970 con 0x7ff8d4003820 2021-11-15T14:38:24.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4010350 con 0x7ff8d4005050 2021-11-15T14:38:24.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4010510 con 0x7ff8d4004500 2021-11-15T14:38:24.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 0x7ff8d400fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 -- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4004500 msgr2=0x7ff8d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4004500 0x7ff8d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 -- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d4003820 msgr2=0x7ff8d4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8d4003820 0x7ff8d4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:38:24.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 -- 172.21.2.135:0/3344688011 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4003260 con 0x7ff8d4005050 2021-11-15T14:38:24.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 -- 172.21.2.135:0/3344688011 reap_dead start 2021-11-15T14:38:24.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 0x7ff8d400fb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7ff8ec0032f0 tx=0x7ff8ec006f90).ready entity=mon.1 client_cookie=27ae78f5c0554377 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec00b460 con 0x7ff8d4005050 2021-11-15T14:38:24.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec00b5c0 con 0x7ff8d4005050 2021-11-15T14:38:24.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f1ffb700 1 -- 172.21.2.135:0/3344688011 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec00b730 con 0x7ff8d4005050 2021-11-15T14:38:24.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 msgr2=0x7ff8d400fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 0x7ff8d400fb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7ff8ec0032f0 tx=0x7ff8ec006f90).stop 2021-11-15T14:38:24.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- 172.21.2.135:0/3344688011 shutdown_connections 2021-11-15T14:38:24.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/3344688011 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8d4005050 0x7ff8d400fb60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- 172.21.2.135:0/3344688011 >> 172.21.2.135:0/3344688011 conn(0x7ff8f405cfe0 msgr2=0x7ff8f405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- 172.21.2.135:0/3344688011 shutdown_connections 2021-11-15T14:38:24.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- 172.21.2.135:0/3344688011 wait complete. 2021-11-15T14:38:24.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 Processor -- start 2021-11-15T14:38:24.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- start start 2021-11-15T14:38:24.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4005050 0x7ff8f40b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 0x7ff8f40b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.504+0000 7ff8f93fa700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40ae7a0 con 0x7ff8f40abd10 2021-11-15T14:38:24.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f93fa700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40aea40 con 0x7ff8f40ac810 2021-11-15T14:38:24.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f93fa700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40adfe0 con 0x7ff8d4005050 2021-11-15T14:38:24.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58080/0 (socket says 172.21.2.135:58080) 2021-11-15T14:38:24.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 -- 172.21.2.135:0/2466765648 learned_addr learned my addr 172.21.2.135:0/2466765648 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 0x7ff8f40b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 -- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4005050 msgr2=0x7ff8f40b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f2ffd700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4005050 0x7ff8f40b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4005050 0x7ff8f40b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 -- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 msgr2=0x7ff8f40b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 0x7ff8f40b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 -- 172.21.2.135:0/2466765648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40ae280 con 0x7ff8f40ac810 2021-11-15T14:38:24.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f37fe700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 0x7ff8f40b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:38:24.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f27fc700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7ff8e4000f70 tx=0x7ff8e4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e4013460 con 0x7ff8f40ac810 2021-11-15T14:38:24.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40135c0 con 0x7ff8f40ac810 2021-11-15T14:38:24.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40ae520 con 0x7ff8f40ac810 2021-11-15T14:38:24.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f413cd50 con 0x7ff8f40ac810 2021-11-15T14:38:24.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e4013920 con 0x7ff8f40ac810 2021-11-15T14:38:24.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc003410 con 0x7ff8f40ac810 2021-11-15T14:38:24.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8e401a060 con 0x7ff8f40ac810 2021-11-15T14:38:24.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 0x7ff8d8055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff8e406b450 con 0x7ff8f40ac810 2021-11-15T14:38:24.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f2ffd700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 0x7ff8d8055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.508+0000 7ff8f2ffd700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 0x7ff8d8055b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff8dc008000 tx=0x7ff8dc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.512+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8e40422f0 con 0x7ff8f40ac810 2021-11-15T14:38:24.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.592+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8cc003c40 con 0x7ff8f40ac810 2021-11-15T14:38:24.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8ebfff700 1 -- 172.21.2.135:0/2466765648 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff8e4018020 con 0x7ff8f40ac810 2021-11-15T14:38:24.600 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:38:24.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 msgr2=0x7ff8d8055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 0x7ff8d8055b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff8dc008000 tx=0x7ff8dc009040).stop 2021-11-15T14:38:24.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 msgr2=0x7ff8f415a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7ff8e4000f70 tx=0x7ff8e4006df0).stop 2021-11-15T14:38:24.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 shutdown_connections 2021-11-15T14:38:24.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8d8053690 0x7ff8d8055b50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8f40abd10 0x7ff8f40b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8f40ac810 0x7ff8f415a020 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 --2- 172.21.2.135:0/2466765648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8d4005050 0x7ff8f40b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 >> 172.21.2.135:0/2466765648 conn(0x7ff8f405cfe0 msgr2=0x7ff8f4142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 shutdown_connections 2021-11-15T14:38:24.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.596+0000 7ff8f93fa700 1 -- 172.21.2.135:0/2466765648 wait complete. 2021-11-15T14:38:24.606 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:38:24.607 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:38:24.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 Processor -- start 2021-11-15T14:38:24.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 -- start start 2021-11-15T14:38:24.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7fac0b0520 0x7f7fac0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0b2b70 con 0x7f7fac0aa1a0 2021-11-15T14:38:24.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0b27f0 con 0x7f7fac0b0900 2021-11-15T14:38:24.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb2710700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0b2da0 con 0x7f7fac0b0520 2021-11-15T14:38:24.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb0cad700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7fac0b0900 0x7f7fac140620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45676/0 (socket says 172.21.2.135:45676) 2021-11-15T14:38:24.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fb0cad700 1 -- 172.21.2.135:0/3145216957 learned_addr learned my addr 172.21.2.135:0/3145216957 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:38:24.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7fabfff700 1 --2- 172.21.2.135:0/3145216957 >> v2:172.21.2.119:3300/0 conn(0x7f7fac0b0520 0x7f7fac0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.652+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089819429 0 0) 0x7f7fac0b27f0 con 0x7f7fac0b0900 2021-11-15T14:38:24.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c003260 con 0x7f7fac0b0900 2021-11-15T14:38:24.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013537142 0 0) 0x7f7f8c003260 con 0x7f7fac0b0900 2021-11-15T14:38:24.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 >> v2:172.21.2.119:3300/0 conn(0x7f7fac0b0520 msgr2=0x7f7fac0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 --2- 172.21.2.135:0/3145216957 >> v2:172.21.2.119:3300/0 conn(0x7f7fac0b0520 0x7f7fac0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 >> v1:172.21.2.119:6789/0 conn(0x7f7fac0aa1a0 legacy=0x7f7fac0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0a9bf0 con 0x7f7fac0b0900 2021-11-15T14:38:24.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7fa40019e0 con 0x7f7fac0b0900 2021-11-15T14:38:24.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 >> v1:172.21.2.135:6789/0 conn(0x7f7fac0b0900 legacy=0x7f7fac140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f8c003750 0x7f7f8c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f8c004500 0x7f7f8c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7f8c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b2da0 con 0x7f7f8c003750 2021-11-15T14:38:24.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bd20 con 0x7f7f8c004e70 2021-11-15T14:38:24.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bee0 con 0x7f7f8c004500 2021-11-15T14:38:24.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7f8c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fab7fe700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f8c004500 0x7f7f8c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f8c003750 0x7f7f8c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 -- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f8c004500 msgr2=0x7f7f8c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f8c004500 0x7f7f8c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 -- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f8c003750 msgr2=0x7f7f8c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:38:24.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f8c003750 0x7f7f8c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 -- 172.21.2.135:0/3145216957 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c003260 con 0x7f7f8c004e70 2021-11-15T14:38:24.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f8c003750 0x7f7f8c003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:38:24.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 -- 172.21.2.135:0/3145216957 reap_dead start 2021-11-15T14:38:24.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7f8c00b750 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f7fa40016f0 tx=0x7f7fa4002190).ready entity=mon.1 client_cookie=f646ec517b71d2d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa400ccb0 con 0x7f7f8c004e70 2021-11-15T14:38:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400ce10 con 0x7f7f8c004e70 2021-11-15T14:38:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7faaffd700 1 -- 172.21.2.135:0/3145216957 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa4005b80 con 0x7f7f8c004e70 2021-11-15T14:38:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 msgr2=0x7f7f8c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7f8c00b750 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f7fa40016f0 tx=0x7f7fa4002190).stop 2021-11-15T14:38:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/3145216957 shutdown_connections 2021-11-15T14:38:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 --2- 172.21.2.135:0/3145216957 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7f8c00b750 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/3145216957 >> 172.21.2.135:0/3145216957 conn(0x7f7fac060840 msgr2=0x7f7fac060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/3145216957 shutdown_connections 2021-11-15T14:38:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/3145216957 wait complete. 2021-11-15T14:38:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 Processor -- start 2021-11-15T14:38:24.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- start start 2021-11-15T14:38:24.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 0x7f7fac155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fac0662a0 0x7f7fac156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac065780 con 0x7f7fac0662a0 2021-11-15T14:38:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac067560 con 0x7f7f8c004e70 2021-11-15T14:38:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0659b0 con 0x7f7fac067050 2021-11-15T14:38:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58098/0 (socket says 172.21.2.135:58098) 2021-11-15T14:38:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 -- 172.21.2.135:0/4033038098 learned_addr learned my addr 172.21.2.135:0/4033038098 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:38:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb0cad700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fac0662a0 0x7f7fac156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fab7fe700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 0x7f7fac155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 -- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 msgr2=0x7f7fac155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 0x7f7fac155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 -- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fac0662a0 msgr2=0x7f7fac156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fac0662a0 0x7f7fac156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 -- 172.21.2.135:0/4033038098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac065c50 con 0x7f7f8c004e70 2021-11-15T14:38:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fab7fe700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 0x7f7fac155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:38:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fabfff700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f7fac065540 tx=0x7f7f94008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f940136b0 con 0x7f7f8c004e70 2021-11-15T14:38:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f94013810 con 0x7f7f8c004e70 2021-11-15T14:38:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac064ca0 con 0x7f7f8c004e70 2021-11-15T14:38:24.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f94013b70 con 0x7f7f8c004e70 2021-11-15T14:38:24.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.656+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1566c0 con 0x7f7f8c004e70 2021-11-15T14:38:24.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac0573d0 con 0x7f7f8c004e70 2021-11-15T14:38:24.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f94013cd0 con 0x7f7f8c004e70 2021-11-15T14:38:24.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fa97fa700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 0x7f7f90055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:38:24.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7f9406c410 con 0x7f7f8c004e70 2021-11-15T14:38:24.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fab7fe700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 0x7f7f90055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:38:24.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fab7fe700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 0x7f7f90055b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7f9c003000 tx=0x7f7f9c007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:38:24.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.660+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f94043310 con 0x7f7f8c004e70 2021-11-15T14:38:24.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fac0446d0 con 0x7f7f8c004e70 2021-11-15T14:38:24.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fa97fa700 1 -- 172.21.2.135:0/4033038098 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f7f94046930 con 0x7f7f8c004e70 2021-11-15T14:38:24.776 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:38:24.777 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:38:24.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 msgr2=0x7f7f90055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 0x7f7f90055b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7f9c003000 tx=0x7f7f9c007a00).stop 2021-11-15T14:38:24.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 msgr2=0x7f7fac148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:38:24.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f7fac065540 tx=0x7f7f94008040).stop 2021-11-15T14:38:24.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 shutdown_connections 2021-11-15T14:38:24.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f900536d0 0x7f7f90055b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fac0662a0 0x7f7fac156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fac067050 0x7f7fac155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 --2- 172.21.2.135:0/4033038098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f8c004e70 0x7f7fac148180 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:38:24.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 >> 172.21.2.135:0/4033038098 conn(0x7f7fac060840 msgr2=0x7f7fac0b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:38:24.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 shutdown_connections 2021-11-15T14:38:24.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:38:24.772+0000 7f7fb2710700 1 -- 172.21.2.135:0/4033038098 wait complete. 2021-11-15T14:38:24.780 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:38:25.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:37:54.979308+0000', 'modified': '2021-11-15T14:37:55.985759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5551}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5551': {'gid': 5551, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2231823287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 2231823287}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2231823287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:38:25.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:38:25.087 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:38:25.151 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5551,"want_state":"up:active","state":"up:active","rank_uptime":30.160553578999998,"mdsmap_epoch":26,"osdmap_epoch":58,"osdmap_epoch_barrier":58,"uptime":34.322922593000001} 2021-11-15T14:38:25.152 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5551, "mdsmap_epoch": 26, "osdmap_epoch": 58, "osdmap_epoch_barrier": 58, "rank_uptime": 30.160553579, "state": "up:active", "uptime": 34.322922593, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:38:25.152 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:38:25.152 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:38:25.153 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:38:25.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:25.154 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:25.164 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:38:25.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:38:25.218 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:38:25.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:38:25.224 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:38:25.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:25.225 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:38:25.229 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:38:25.230 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:25.273 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:38:25.283 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:38:25.283 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:38:25.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:38:25.290 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:38:25.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:25.291 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:38:25.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14391]: starting ceph client 2021-11-15T14:38:25.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:38:25.314+0000 7fd5a6e71080 -1 init, newargv = 0x557ea5186b50 newargc=9 2021-11-15T14:38:25.329 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14391]: starting fuse 2021-11-15T14:38:26.419 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:38:26.431 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:38:26.432 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:38:26.482 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:38:26.483 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:38:26.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:26.484 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:38:26.489 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:38:26.490 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:38:26.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:26.491 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:38:26.491 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:38:26.491 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:38:26.492 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:38:26.492 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:38:26.493 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:26.493 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:38:26.494 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:38:26.494 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:38:26.495 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:26.495 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:38:26.495 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:38:26.496 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:38:26.496 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:38:26.497 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:26.497 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:38:26.497 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:38:26.498 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:38:26.498 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:38:26.499 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:38:26.499 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:38:26.499 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:38:26.500 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:38:26.566 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14391.asok 2021-11-15T14:38:26.568 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14391.asok 2021-11-15T14:38:26.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:26.569 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14391.asok status 2021-11-15T14:38:26.616 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:38:26.617 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:38:26.617 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:38:26.617 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:38:26.617 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:38:26.617 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:38:26.618 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:38:26.618 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14391", 2021-11-15T14:38:26.618 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:38:26.619 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:26.619 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:38:26.619 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:38:26.619 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5800, 2021-11-15T14:38:26.620 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:38:26.620 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:38:26.620 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:38:26.620 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5800 2021-11-15T14:38:26.621 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:26.621 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:38:26.621 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:38:26.621 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:38:26.622 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1330857003 2021-11-15T14:38:26.622 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:38:26.622 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:26.622 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:38:26.622 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:38:26.623 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:38:26.623 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1330857003 2021-11-15T14:38:26.623 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:38:26.623 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5800 172.21.2.138:0/1330857003", 2021-11-15T14:38:26.623 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1330857003", 2021-11-15T14:38:26.624 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:38:26.624 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 26, 2021-11-15T14:38:26.624 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 58, 2021-11-15T14:38:26.624 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:38:26.625 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:38:26.625 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:38:26.625 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:38:26.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:26.627 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:38:26.627 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:26.633 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:38:26.634 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:38:26.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:38:26.635 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:38:42.135 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:42.139 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:42.142 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:38:42.146 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:12.186 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:12.191 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:12.195 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:12.199 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:20.838 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:39:20.839 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:20.851 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:20.864 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:20.877 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:20.890 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:39:20.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:20.891 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:20.892 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:20.895 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:39:20.896 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:39:20.897 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:39:20.897 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:39:20.898 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:20.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14391]: fuse finished with error 0 and tester_r 0 2021-11-15T14:39:20.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:20.948 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:20.948 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:20.953 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:39:20.954 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:39:21.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:39:21.064 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:21.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:21.068 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:21.069 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:39:21.078 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:39:21.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:39:21.080 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:39:21.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:39:21.081 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:39:21.090 INFO:teuthology.orchestra.run.gibba032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:39:21.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:39:21.091 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:39:21.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.140+0000 7f29b90ad700 1 Processor -- start 2021-11-15T14:39:21.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.140+0000 7f29b90ad700 1 -- start start 2021-11-15T14:39:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f29b40b1e30 0x7f29b40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40b03d0 con 0x7f29b4148420 2021-11-15T14:39:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40b0670 con 0x7f29b40a7140 2021-11-15T14:39:21.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40a9140 con 0x7f29b40b1e30 2021-11-15T14:39:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f29b40a7140 0x7f29b41447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45698/0 (socket says 172.21.2.135:45698) 2021-11-15T14:39:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 -- 172.21.2.135:0/2998461462 learned_addr learned my addr 172.21.2.135:0/2998461462 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415863115 0 0) 0x7f29b40b0670 con 0x7f29b40a7140 2021-11-15T14:39:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2994003260 con 0x7f29b40a7140 2021-11-15T14:39:21.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b2d9d700 1 --2- 172.21.2.135:0/2998461462 >> v2:172.21.2.119:3300/0 conn(0x7f29b40b1e30 0x7f29b40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 52883121 0 0) 0x7f2994003260 con 0x7f29b40a7140 2021-11-15T14:39:21.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 >> v2:172.21.2.119:3300/0 conn(0x7f29b40b1e30 msgr2=0x7f29b40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 --2- 172.21.2.135:0/2998461462 >> v2:172.21.2.119:3300/0 conn(0x7f29b40b1e30 0x7f29b40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 >> v1:172.21.2.119:6789/0 conn(0x7f29b4148420 legacy=0x7f29b40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40b0910 con 0x7f29b40a7140 2021-11-15T14:39:21.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f29ac0019e0 con 0x7f29b40a7140 2021-11-15T14:39:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 >> v1:172.21.2.135:6789/0 conn(0x7f29b40a7140 legacy=0x7f29b41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994003820 0x7f2994003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2994004500 0x7f2994004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 0x7f299400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299400be20 con 0x7f2994003820 2021-11-15T14:39:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299400bf90 con 0x7f2994004f70 2021-11-15T14:39:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299400c150 con 0x7f2994004500 2021-11-15T14:39:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 0x7f299400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 -- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2994004500 msgr2=0x7f2994004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2994004500 0x7f2994004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 -- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994003820 msgr2=0x7f2994003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994003820 0x7f2994003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 -- 172.21.2.135:0/2998461462 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994003260 con 0x7f2994004f70 2021-11-15T14:39:21.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 -- 172.21.2.135:0/2998461462 reap_dead start 2021-11-15T14:39:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b359e700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 0x7f299400b750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f29b40acee0 tx=0x7f29b40b0aa0).ready entity=mon.1 client_cookie=5d64ce1e949ed85c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac00cbe0 con 0x7f2994004f70 2021-11-15T14:39:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00cd40 con 0x7f2994004f70 2021-11-15T14:39:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b1d9b700 1 -- 172.21.2.135:0/2998461462 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac005b80 con 0x7f2994004f70 2021-11-15T14:39:21.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 msgr2=0x7f299400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 0x7f299400b750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f29b40acee0 tx=0x7f29b40b0aa0).stop 2021-11-15T14:39:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- 172.21.2.135:0/2998461462 shutdown_connections 2021-11-15T14:39:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 --2- 172.21.2.135:0/2998461462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2994004f70 0x7f299400b750 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- 172.21.2.135:0/2998461462 >> 172.21.2.135:0/2998461462 conn(0x7f29b405f730 msgr2=0x7f29b405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- 172.21.2.135:0/2998461462 shutdown_connections 2021-11-15T14:39:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.144+0000 7f29b90ad700 1 -- 172.21.2.135:0/2998461462 wait complete. 2021-11-15T14:39:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 Processor -- start 2021-11-15T14:39:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- start start 2021-11-15T14:39:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994004f70 0x7f29b4145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29b40ad0c0 0x7f29b40ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4146b80 con 0x7f2994004f70 2021-11-15T14:39:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b41463d0 con 0x7f29b40afac0 2021-11-15T14:39:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4146db0 con 0x7f29b40ad0c0 2021-11-15T14:39:21.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58122/0 (socket says 172.21.2.135:58122) 2021-11-15T14:39:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 -- 172.21.2.135:0/3232877446 learned_addr learned my addr 172.21.2.135:0/3232877446 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 -- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29b40ad0c0 msgr2=0x7f29b40ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29b40ad0c0 0x7f29b40ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 -- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994004f70 msgr2=0x7f29b4145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994004f70 0x7f29b4145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 -- 172.21.2.135:0/3232877446 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4147200 con 0x7f29b40afac0 2021-11-15T14:39:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b259c700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f299c001fa0 tx=0x7f299c007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f299c00ce80 con 0x7f29b40afac0 2021-11-15T14:39:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c000e90 con 0x7f29b40afac0 2021-11-15T14:39:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b415a1d0 con 0x7f29b40afac0 2021-11-15T14:39:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f299c007430 con 0x7f29b40afac0 2021-11-15T14:39:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40aece0 con 0x7f29b40afac0 2021-11-15T14:39:21.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40b0bb0 con 0x7f29b40afac0 2021-11-15T14:39:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f299c01a060 con 0x7f29b40afac0 2021-11-15T14:39:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 0x7f2998055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f299c06b2c0 con 0x7f29b40afac0 2021-11-15T14:39:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.148+0000 7f29b2d9d700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 0x7f2998055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.152+0000 7f29b2d9d700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 0x7f2998055b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f29a400a000 tx=0x7f29a4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.152+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f299c0422d0 con 0x7f29b40afac0 2021-11-15T14:39:21.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.232+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f29b4146510 con 0x7f29b40afac0 2021-11-15T14:39:21.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29abfff700 1 -- 172.21.2.135:0/3232877446 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v58) v1 ==== 81+0+34039 (secure 0 0 0) 0x7f299c018020 con 0x7f29b40afac0 2021-11-15T14:39:21.239 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:21.240 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:39:21.240 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 58, 2021-11-15T14:39:21.240 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:39:21.240 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:39:21.241 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:37:55.984224+0000", 2021-11-15T14:39:21.241 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:39:21.241 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:39:21.241 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:39:21.242 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:39:21.242 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:39:21.242 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:39:21.242 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:39:21.243 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:39:21.243 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:39:21.243 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:21.243 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:39:21.243 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:39:21.244 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:39:21.244 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:39:21.244 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:39:21.244 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 10, 2021-11-15T14:39:21.245 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:39:21.245 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:39:21.245 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:39:21.245 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:39:21.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:39:21.246 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.246 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:39:21.246 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:39:21.246 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:39:21.247 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:21.247 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:21.247 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:21.247 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:21.248 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:21.248 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:21.248 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:21.248 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:21.248 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:39:21.249 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:39:21.249 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:39:21.249 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:39:21.249 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:39:21.250 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:21.250 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:21.250 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:21.250 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:21.250 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:21.251 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:21.251 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:21.251 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.251 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:39:21.251 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:21.252 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:21.252 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:21.252 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:21.252 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:21.252 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:21.253 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:21.253 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:21.253 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:21.253 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:21.254 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:21.254 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:21.254 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:21.254 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:21.254 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:21.255 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:21.255 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:21.255 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:21.255 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:21.255 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:21.256 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:21.256 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:21.256 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:21.256 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:21.256 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:21.257 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:21.257 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.257 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:21.257 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:21.258 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:21.258 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:21.258 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:21.258 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:21.258 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:21.259 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:21.259 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:21.259 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:21.259 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:21.259 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:39:21.260 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:39:21.260 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.260 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:21.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:39:21.261 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.261 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.261 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.261 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:39:21.261 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:39:21.262 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:39:21.262 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:21.262 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:21.262 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:21.262 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:21.263 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:21.263 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:21.263 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:21.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:21.263 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:39:21.264 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:39:21.264 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:39:21.264 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:39:21.264 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:39:21.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:21.265 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:21.265 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:21.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:21.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:21.266 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:21.266 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:21.266 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.266 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:39:21.267 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:21.267 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:21.267 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:21.268 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:21.268 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:21.268 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:21.268 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:21.269 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:21.269 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:21.269 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:21.269 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:21.269 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:21.270 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:21.270 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:21.270 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:21.270 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:21.271 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:21.271 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:21.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:21.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:21.272 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:21.272 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:21.272 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:21.272 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:21.273 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:21.273 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:21.273 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.274 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:21.274 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:21.274 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:21.274 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:21.275 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:21.275 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:21.275 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:21.275 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:21.276 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:21.276 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:21.276 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:21.276 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:39:21.277 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:21.277 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:39:21.277 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.277 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.278 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.278 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 9, 2021-11-15T14:39:21.278 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:39:21.278 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:37:52.935747+0000", 2021-11-15T14:39:21.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:21.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:21.279 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:21.279 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:21.279 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:21.280 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:21.280 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:21.280 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:21.280 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:39:21.281 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:39:21.281 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:39:21.281 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:39:21.281 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:39:21.282 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:21.282 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:21.282 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:21.282 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:21.283 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:21.283 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:21.283 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:21.283 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.283 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "57", 2021-11-15T14:39:21.284 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:21.284 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:21.284 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:21.284 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:21.285 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:21.285 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:21.285 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:21.285 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:21.286 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:21.286 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:21.286 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:21.286 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:21.287 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:21.287 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:21.287 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:21.287 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:21.288 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:21.288 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:21.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:21.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:21.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:21.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:21.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:21.290 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:21.290 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:21.290 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:21.290 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.291 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:21.291 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:21.291 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:21.291 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:21.292 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:21.292 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:21.292 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:21.292 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:21.292 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:21.293 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:21.293 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:21.293 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:39:21.293 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:39:21.294 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:39:21.294 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:39:21.294 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.294 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:21.295 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:39:21.295 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:39:21.295 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.295 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.296 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.296 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.296 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 10, 2021-11-15T14:39:21.297 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:39:21.297 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:37:53.946772+0000", 2021-11-15T14:39:21.298 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:21.298 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:21.299 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:21.299 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:21.300 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:21.300 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:21.300 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:21.301 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:21.301 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:39:21.302 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:39:21.302 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:39:21.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:39:21.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:39:21.303 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:21.304 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:21.304 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:21.305 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:21.305 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:21.306 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:21.306 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:21.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.307 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "58", 2021-11-15T14:39:21.307 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:21.308 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:21.308 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:21.309 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:21.309 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:21.310 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:21.310 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:21.310 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:21.311 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:21.311 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:21.312 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:21.312 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:21.312 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:21.312 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:21.313 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:21.313 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:21.313 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:21.313 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:21.314 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:21.314 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:21.314 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:21.314 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:21.315 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:21.315 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:21.316 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:21.316 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:21.316 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.316 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:21.317 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:21.317 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:21.317 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:21.317 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:21.318 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:21.318 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:21.318 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:21.318 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:21.319 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:21.319 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:21.319 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:39:21.319 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:21.320 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:39:21.320 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:39:21.320 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.320 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.320 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.321 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:21.321 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:39:21.321 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.321 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:39:21.322 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:39:21.322 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.322 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.322 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.322 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.323 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.323 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.323 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.323 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:21.324 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.324 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.324 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.325 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:39:21.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:39:21.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.327 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:39:21.328 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.329 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:39:21.330 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.330 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.330 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.331 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.332 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.332 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.333 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.333 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:39:21.333 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.335 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.335 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:39:21.336 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.336 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.336 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.338 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:39:21.340 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.340 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.340 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:39:21.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:21.341 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.341 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.341 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.342 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:39:21.342 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:39:21.342 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:39:21.342 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:39:21.343 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.343 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.343 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.343 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.344 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.344 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:39:21.344 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:39:21.345 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.345 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.345 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.345 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.345 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.346 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.346 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.346 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:39:21.347 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.347 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.347 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.348 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.348 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.349 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:39:21.349 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.349 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.350 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.350 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.351 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:39:21.351 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.352 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.352 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.352 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.353 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.353 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.354 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.354 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:39:21.355 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:39:21.357 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.357 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.357 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.358 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.358 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.358 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:39:21.359 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.359 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.360 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:39:21.360 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.360 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.360 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.361 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.361 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.361 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.362 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:39:21.362 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.362 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.363 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:39:21.363 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:21.363 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.364 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.364 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.364 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:39:21.364 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:39:21.364 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:39:21.365 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:39:21.365 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.365 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.365 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.366 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.366 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.366 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.366 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:39:21.367 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:39:21.367 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.367 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.367 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.367 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.368 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.368 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:21.369 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.369 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.369 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.369 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.369 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.370 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.370 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:39:21.370 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.371 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.371 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.372 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.372 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:39:21.372 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.373 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.373 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.373 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.373 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.374 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.374 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.374 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.374 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:39:21.375 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.376 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.376 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:39:21.376 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.376 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.376 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.377 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.377 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.377 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.378 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.378 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:39:21.379 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.379 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.379 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.379 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.380 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:39:21.380 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.380 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.380 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.381 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.381 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.382 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:39:21.382 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.382 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.382 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.382 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.383 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:39:21.383 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:21.383 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.383 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.384 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:39:21.384 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:39:21.384 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:39:21.384 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:39:21.385 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.385 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.385 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.385 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.386 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.386 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.386 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:39:21.386 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:39:21.387 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.387 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.387 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.387 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.388 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.388 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.388 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.388 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 56, 2021-11-15T14:39:21.389 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.389 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.389 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.390 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.390 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:39:21.390 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.390 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:39:21.391 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.391 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.392 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.392 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.392 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.393 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.393 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:39:21.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.394 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:39:21.394 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.395 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.395 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.395 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.395 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.396 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:39:21.396 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.396 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.397 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:39:21.397 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.398 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.398 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.398 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.399 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.399 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:39:21.399 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.399 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.400 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:39:21.400 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:21.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.401 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.401 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.401 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:39:21.402 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:39:21.402 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:39:21.402 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:39:21.402 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.402 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.403 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.403 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.403 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.404 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:39:21.404 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:39:21.404 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.404 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.404 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.405 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.405 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.405 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.405 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.406 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 56, 2021-11-15T14:39:21.406 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.406 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.406 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.406 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.407 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.407 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:39:21.407 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.407 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.408 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.408 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:39:21.408 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.409 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.409 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.409 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.409 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.410 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.410 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:39:21.410 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.411 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.411 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.411 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:39:21.411 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.412 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.412 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.412 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.413 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.413 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.413 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.413 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:39:21.414 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.414 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:39:21.415 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.415 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.415 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.416 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.416 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.416 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:39:21.417 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.417 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.417 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.418 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.418 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:39:21.418 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:21.418 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.419 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.419 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.419 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:39:21.419 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:39:21.419 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:39:21.420 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:39:21.420 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.420 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.420 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.420 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.421 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.421 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.421 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:39:21.422 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:39:21.422 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.423 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.423 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.424 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.424 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.425 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:21.425 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.425 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.425 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.426 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.426 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:39:21.426 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.427 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.427 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.427 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.427 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:39:21.428 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.428 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.428 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.429 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.429 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.429 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.430 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:39:21.430 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.430 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.430 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.430 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.431 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:39:21.431 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.431 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.431 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.432 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.432 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.432 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:39:21.433 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.433 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.433 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:39:21.434 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.434 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.434 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.435 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:39:21.436 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.436 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.436 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.436 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:39:21.437 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:21.437 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.437 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.437 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:39:21.438 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:39:21.438 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:39:21.438 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:39:21.438 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.439 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.439 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.439 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.439 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.439 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.440 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:39:21.440 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:39:21.440 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.440 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.440 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.441 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.441 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.441 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.441 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.441 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 54, 2021-11-15T14:39:21.442 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.442 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.442 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.443 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.443 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.443 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:39:21.443 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.444 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:39:21.445 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.445 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.445 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.445 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.446 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.446 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.446 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.446 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.447 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:39:21.447 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.447 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.447 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.448 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.448 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:39:21.448 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.448 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.448 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.449 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.449 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.449 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.449 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.450 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.450 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:39:21.450 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.450 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:39:21.451 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.452 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.452 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.452 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.452 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.453 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.453 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.453 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:39:21.453 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.454 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.454 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:39:21.455 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:21.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.455 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.456 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:39:21.456 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:39:21.456 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:39:21.457 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:39:21.457 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.457 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.457 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.457 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.458 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:39:21.458 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:39:21.459 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:21.459 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:21.459 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:21.459 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:21.460 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:21.460 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:21.460 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:21.460 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 54, 2021-11-15T14:39:21.461 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:21.461 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:21.461 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:21.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.461 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:39:21.462 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.462 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.463 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:39:21.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.464 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.464 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:21.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:39:21.465 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.466 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:39:21.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.467 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.467 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.467 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.467 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:21.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:39:21.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:39:21.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.470 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.471 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:21.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:21.471 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.472 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:21.472 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:39:21.472 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.473 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:21.473 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:39:21.473 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:21.473 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.474 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.474 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:39:21.474 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:39:21.475 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:39:21.475 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:39:21.475 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:21.475 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:21.476 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:21.476 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:21.476 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.476 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:21.476 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:39:21.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.477 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:39:21.477 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.477 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.478 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.478 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.478 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:39:21.479 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.479 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:39:21.479 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.480 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.480 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.480 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.480 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.481 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:39:21.481 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.482 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:39:21.482 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.482 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.482 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.483 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.483 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.483 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:39:21.483 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.483 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.484 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.484 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:39:21.484 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.484 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.485 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.485 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.485 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.485 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:39:21.486 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.486 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:39:21.487 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.487 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.487 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.487 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.488 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.488 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:39:21.488 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.488 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.488 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.489 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:39:21.489 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.489 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.489 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.490 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.490 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.490 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:39:21.490 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.491 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:39:21.491 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.491 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.492 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.492 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.492 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.492 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:39:21.493 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.493 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:21.493 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:39:21.494 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:21.494 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:21.494 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:21.494 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:21.494 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:21.495 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:39:21.495 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:21.495 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.495 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:21.496 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:39:21.496 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:39:21.496 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:39:21.496 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:39:21.496 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:39:21.497 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:39:21.497 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:39:21.497 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:39:21.497 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:39:21.498 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:39:21.498 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:39:21.498 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:39:21.498 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:39:21.499 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:39:21.499 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:39:21.499 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:39:21.499 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:39:21.500 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.500 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:39:21.500 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:39:21.500 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:39:21.500 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:39:21.501 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:39:21.501 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:39:21.501 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:39:21.501 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:21.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:21.502 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:39:21.502 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:39:21.502 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:39:21.502 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:39:21.503 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:39:21.503 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:39:21.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 msgr2=0x7f2998055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 0x7f2998055b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f29a400a000 tx=0x7f29a4008040).stop 2021-11-15T14:39:21.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 msgr2=0x7f29b4159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f299c001fa0 tx=0x7f299c007c00).stop 2021-11-15T14:39:21.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 shutdown_connections 2021-11-15T14:39:21.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f29980536d0 0x7f2998055b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f29b40ad0c0 0x7f29b40ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f29b40afac0 0x7f29b4159ce0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 --2- 172.21.2.135:0/3232877446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2994004f70 0x7f29b4145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 >> 172.21.2.135:0/3232877446 conn(0x7f29b405f730 msgr2=0x7f29b40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 shutdown_connections 2021-11-15T14:39:21.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.236+0000 7f29b90ad700 1 -- 172.21.2.135:0/3232877446 wait complete. 2021-11-15T14:39:21.508 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:21.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 Processor -- start 2021-11-15T14:39:21.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 -- start start 2021-11-15T14:39:21.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7faf90148420 0x7faf900b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900b03d0 con 0x7faf900b1e30 2021-11-15T14:39:21.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900b0670 con 0x7faf900a7140 2021-11-15T14:39:21.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf9617b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900a9140 con 0x7faf90148420 2021-11-15T14:39:21.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7faf900a7140 0x7faf901447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45716/0 (socket says 172.21.2.135:45716) 2021-11-15T14:39:21.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 -- 172.21.2.135:0/3587629740 learned_addr learned my addr 172.21.2.135:0/3587629740 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:21.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195013239 0 0) 0x7faf900b0670 con 0x7faf900a7140 2021-11-15T14:39:21.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c003260 con 0x7faf900a7140 2021-11-15T14:39:21.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8effd700 1 --2- 172.21.2.135:0/3587629740 >> v2:172.21.2.119:3300/0 conn(0x7faf90148420 0x7faf900b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979339114 0 0) 0x7faf7c003260 con 0x7faf900a7140 2021-11-15T14:39:21.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 >> v2:172.21.2.119:3300/0 conn(0x7faf90148420 msgr2=0x7faf900b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 --2- 172.21.2.135:0/3587629740 >> v2:172.21.2.119:3300/0 conn(0x7faf90148420 0x7faf900b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 >> v1:172.21.2.119:6789/0 conn(0x7faf900b1e30 legacy=0x7faf900b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900b0910 con 0x7faf900a7140 2021-11-15T14:39:21.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7faf880019e0 con 0x7faf900a7140 2021-11-15T14:39:21.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 >> v1:172.21.2.135:6789/0 conn(0x7faf900a7140 legacy=0x7faf901447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf7c003820 0x7faf7c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004500 0x7faf7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 0x7faf7c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c00be20 con 0x7faf7c004500 2021-11-15T14:39:21.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c00bf90 con 0x7faf7c004f70 2021-11-15T14:39:21.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c00c150 con 0x7faf7c003820 2021-11-15T14:39:21.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 0x7faf7c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8f7fe700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf7c003820 0x7faf7c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 -- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf7c003820 msgr2=0x7faf7c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf7c003820 0x7faf7c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8effd700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004500 0x7faf7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 -- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004500 msgr2=0x7faf7c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004500 0x7faf7c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 -- 172.21.2.135:0/3587629740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c003260 con 0x7faf7c004f70 2021-11-15T14:39:21.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 -- 172.21.2.135:0/3587629740 reap_dead start 2021-11-15T14:39:21.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8f7fe700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf7c003820 0x7faf7c003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:39:21.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8ffff700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 0x7faf7c00b750 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7faf901477b0 tx=0x7faf900b0aa0).ready entity=mon.1 client_cookie=aef17b00a3c19048 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8800cbe0 con 0x7faf7c004f70 2021-11-15T14:39:21.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800cd40 con 0x7faf7c004f70 2021-11-15T14:39:21.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.560+0000 7faf8e7fc700 1 -- 172.21.2.135:0/3587629740 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88005b80 con 0x7faf7c004f70 2021-11-15T14:39:21.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 msgr2=0x7faf7c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 0x7faf7c00b750 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7faf901477b0 tx=0x7faf900b0aa0).stop 2021-11-15T14:39:21.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/3587629740 shutdown_connections 2021-11-15T14:39:21.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 --2- 172.21.2.135:0/3587629740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf7c004f70 0x7faf7c00b750 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/3587629740 >> 172.21.2.135:0/3587629740 conn(0x7faf9005f730 msgr2=0x7faf9005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/3587629740 shutdown_connections 2021-11-15T14:39:21.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/3587629740 wait complete. 2021-11-15T14:39:21.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 Processor -- start 2021-11-15T14:39:21.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- start start 2021-11-15T14:39:21.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004f70 0x7faf900a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf9013d960 0x7faf9013ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf901459a0 con 0x7faf7c004f70 2021-11-15T14:39:21.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf901407e0 con 0x7faf9015a2b0 2021-11-15T14:39:21.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9014d120 con 0x7faf9013d960 2021-11-15T14:39:21.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58140/0 (socket says 172.21.2.135:58140) 2021-11-15T14:39:21.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 -- 172.21.2.135:0/2357878308 learned_addr learned my addr 172.21.2.135:0/2357878308 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:21.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 -- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf9013d960 msgr2=0x7faf9013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf9013d960 0x7faf9013ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 -- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004f70 msgr2=0x7faf900a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004f70 0x7faf900a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 -- 172.21.2.135:0/2357878308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9014d3c0 con 0x7faf9015a2b0 2021-11-15T14:39:21.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8ffff700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7faf901477b0 tx=0x7faf88013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88001f00 con 0x7faf9015a2b0 2021-11-15T14:39:21.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf880074d0 con 0x7faf9015a2b0 2021-11-15T14:39:21.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88007830 con 0x7faf9015a2b0 2021-11-15T14:39:21.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9014d660 con 0x7faf9015a2b0 2021-11-15T14:39:21.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9013fc20 con 0x7faf9015a2b0 2021-11-15T14:39:21.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9013e450 con 0x7faf9015a2b0 2021-11-15T14:39:21.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf88027070 con 0x7faf9015a2b0 2021-11-15T14:39:21.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 0x7faf70055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.564+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faf8806c770 con 0x7faf9015a2b0 2021-11-15T14:39:21.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.568+0000 7faf8f7fe700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 0x7faf70055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.568+0000 7faf8f7fe700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 0x7faf70055b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7faf80008000 tx=0x7faf80009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.568+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf88043780 con 0x7faf9015a2b0 2021-11-15T14:39:21.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.672+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf9013e450 con 0x7faf9015a2b0 2021-11-15T14:39:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf8cff9700 1 -- 172.21.2.135:0/2357878308 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2492 (secure 0 0 0) 0x7faf88046da0 con 0x7faf9015a2b0 2021-11-15T14:39:21.680 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:21.680 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:37:55.985759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5551},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5551":{"gid":5551,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2231823287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2231823287},{"type":"v1","addr":"172.21.2.135:6835","nonce":2231823287}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:39:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 msgr2=0x7faf70055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 0x7faf70055b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7faf80008000 tx=0x7faf80009040).stop 2021-11-15T14:39:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 msgr2=0x7faf9015a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7faf901477b0 tx=0x7faf88013000).stop 2021-11-15T14:39:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 shutdown_connections 2021-11-15T14:39:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faf700536d0 0x7faf70055b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faf9015a2b0 0x7faf9015a760 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faf9013d960 0x7faf9013ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 --2- 172.21.2.135:0/2357878308 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faf7c004f70 0x7faf900a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 >> 172.21.2.135:0/2357878308 conn(0x7faf9005f730 msgr2=0x7faf900b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 shutdown_connections 2021-11-15T14:39:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.676+0000 7faf9617b700 1 -- 172.21.2.135:0/2357878308 wait complete. 2021-11-15T14:39:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 26 2021-11-15T14:39:21.686 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:39:21.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 Processor -- start 2021-11-15T14:39:21.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 -- start start 2021-11-15T14:39:21.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc1ec0b1e30 0x7fc1ec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0b03d0 con 0x7fc1ec0a7140 2021-11-15T14:39:21.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0b0670 con 0x7fc1ec148420 2021-11-15T14:39:21.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1f243b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0a9140 con 0x7fc1ec0b1e30 2021-11-15T14:39:21.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eb7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc1ec148420 0x7fc1ec0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45734/0 (socket says 172.21.2.135:45734) 2021-11-15T14:39:21.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/3320367121 learned_addr learned my addr 172.21.2.135:0/3320367121 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:21.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172278303 0 0) 0x7fc1ec0b0670 con 0x7fc1ec148420 2021-11-15T14:39:21.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d8003260 con 0x7fc1ec148420 2021-11-15T14:39:21.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3876417171 0 0) 0x7fc1d8003260 con 0x7fc1ec148420 2021-11-15T14:39:21.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 >> v2:172.21.2.119:3300/0 conn(0x7fc1ec0b1e30 msgr2=0x7fc1ec0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 --2- 172.21.2.135:0/3320367121 >> v2:172.21.2.119:3300/0 conn(0x7fc1ec0b1e30 0x7fc1ec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 >> v1:172.21.2.119:6789/0 conn(0x7fc1ec0a7140 legacy=0x7fc1ec1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0b0910 con 0x7fc1ec148420 2021-11-15T14:39:21.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.732+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc1e0001660 con 0x7fc1ec148420 2021-11-15T14:39:21.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 >> v1:172.21.2.135:6789/0 conn(0x7fc1ec148420 legacy=0x7fc1ec0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1d8003750 0x7fc1d8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 0x7fc1d8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004f90 0x7fc1d800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d800be50 con 0x7fc1d8003750 2021-11-15T14:39:21.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d800bfc0 con 0x7fc1d8004500 2021-11-15T14:39:21.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d800c180 con 0x7fc1d8004f90 2021-11-15T14:39:21.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 0x7fc1d8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1ebfff700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1d8003750 0x7fc1d8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004f90 msgr2=0x7fc1d800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004f90 0x7fc1d800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:21.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1d8003750 msgr2=0x7fc1d8003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:21.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1d8003750 0x7fc1d8003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f09d8700 1 -- 172.21.2.135:0/3320367121 reap_dead start 2021-11-15T14:39:21.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/3320367121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8003260 con 0x7fc1d8004500 2021-11-15T14:39:21.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 0x7fc1d8004980 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc1ec1477b0 tx=0x7fc1ec0b0aa0).ready entity=mon.1 client_cookie=2a06d33b2410ee76 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e00070d0 con 0x7fc1d8004500 2021-11-15T14:39:21.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0007230 con 0x7fc1d8004500 2021-11-15T14:39:21.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eaffd700 1 -- 172.21.2.135:0/3320367121 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e000c990 con 0x7fc1d8004500 2021-11-15T14:39:21.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 msgr2=0x7fc1d8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 0x7fc1d8004980 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc1ec1477b0 tx=0x7fc1ec0b0aa0).stop 2021-11-15T14:39:21.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/3320367121 shutdown_connections 2021-11-15T14:39:21.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 --2- 172.21.2.135:0/3320367121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1d8004500 0x7fc1d8004980 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/3320367121 >> 172.21.2.135:0/3320367121 conn(0x7fc1ec05f730 msgr2=0x7fc1ec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/3320367121 shutdown_connections 2021-11-15T14:39:21.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/3320367121 wait complete. 2021-11-15T14:39:21.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 Processor -- start 2021-11-15T14:39:21.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- start start 2021-11-15T14:39:21.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004500 0x7fc1ec14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1ec156dc0 0x7fc1ec157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1569d0 con 0x7fc1ec156dc0 2021-11-15T14:39:21.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0a94c0 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0ac1c0 con 0x7fc1d8004500 2021-11-15T14:39:21.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58158/0 (socket says 172.21.2.135:58158) 2021-11-15T14:39:21.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/433224793 learned_addr learned my addr 172.21.2.135:0/433224793 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:21.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1ebfff700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004500 0x7fc1ec14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f09d8700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1ec156dc0 0x7fc1ec157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004500 msgr2=0x7fc1ec14afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004500 0x7fc1ec14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1ec156dc0 msgr2=0x7fc1ec157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1ec156dc0 0x7fc1ec157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 -- 172.21.2.135:0/433224793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0ac460 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1eb7fe700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc1ec063fa0 tx=0x7fc1e0013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e001a070 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0004920 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec0ac700 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1e00070d0 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.736+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec159fa0 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec0ac890 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1e0010070 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1e97fa700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 0x7fc1cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:21.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc1e006bd10 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1ebfff700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 0x7fc1cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:21.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1ebfff700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 0x7fc1cc055a40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc1dc008000 tx=0x7fc1dc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:21.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.740+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1e0042d20 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.852+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1ec0b0bb0 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.933 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:39:21.927+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:39:21.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1e97fa700 1 -- 172.21.2.135:0/433224793 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc1e0046340 con 0x7fc1ec0aadf0 2021-11-15T14:39:21.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 msgr2=0x7fc1cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 0x7fc1cc055a40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc1dc008000 tx=0x7fc1dc008040).stop 2021-11-15T14:39:21.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 msgr2=0x7fc1ec0ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:21.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc1ec063fa0 tx=0x7fc1e0013000).stop 2021-11-15T14:39:21.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 shutdown_connections 2021-11-15T14:39:21.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1cc053580 0x7fc1cc055a40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1ec156dc0 0x7fc1ec157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1ec0aadf0 0x7fc1ec0ab510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 --2- 172.21.2.135:0/433224793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1d8004500 0x7fc1ec14afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:21.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 >> 172.21.2.135:0/433224793 conn(0x7fc1ec05f730 msgr2=0x7fc1ec0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:21.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 shutdown_connections 2021-11-15T14:39:21.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:21.948+0000 7fc1f243b700 1 -- 172.21.2.135:0/433224793 wait complete. 2021-11-15T14:39:21.956 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:39:21.960 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:21.971 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:39:22.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 Processor -- start 2021-11-15T14:39:22.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- start start 2021-11-15T14:39:22.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7d68060180 0x7f7d680b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d68067380 0x7f7d68143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d680b4cc0 0x7f7d68143e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680aac30 con 0x7f7d68060180 2021-11-15T14:39:22.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d68060560 con 0x7f7d68067380 2021-11-15T14:39:22.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68066f20 con 0x7f7d680b4cc0 2021-11-15T14:39:22.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d68067380 0x7f7d68143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d68067380 0x7f7d68143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58182/0 (socket says 172.21.2.135:58182) 2021-11-15T14:39:22.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 -- 172.21.2.135:0/2493352805 learned_addr learned my addr 172.21.2.135:0/2493352805 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:22.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 -- 172.21.2.135:0/2493352805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d680b4cc0 msgr2=0x7f7d68143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 --2- 172.21.2.135:0/2493352805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d680b4cc0 0x7f7d68143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 -- 172.21.2.135:0/2493352805 >> v2:172.21.2.119:3300/0 conn(0x7f7d68060180 msgr2=0x7f7d680b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 --2- 172.21.2.135:0/2493352805 >> v2:172.21.2.119:3300/0 conn(0x7f7d68060180 0x7f7d680b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 -- 172.21.2.135:0/2493352805 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68144350 con 0x7f7d68067380 2021-11-15T14:39:22.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d667fc700 1 --2- 172.21.2.135:0/2493352805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d68067380 0x7f7d68143970 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7d50002f70 tx=0x7f7d50006eb0).ready entity=mon.1 client_cookie=cd0959708d7bced3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d65ffb700 1 -- 172.21.2.135:0/2493352805 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d50010b60 con 0x7f7d68067380 2021-11-15T14:39:22.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d65ffb700 1 -- 172.21.2.135:0/2493352805 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d50000e90 con 0x7f7d68067380 2021-11-15T14:39:22.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d65ffb700 1 -- 172.21.2.135:0/2493352805 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d500183d0 con 0x7f7d68067380 2021-11-15T14:39:22.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- 172.21.2.135:0/2493352805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d68067380 msgr2=0x7f7d68143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2493352805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d68067380 0x7f7d68143970 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7d50002f70 tx=0x7f7d50006eb0).stop 2021-11-15T14:39:22.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- 172.21.2.135:0/2493352805 shutdown_connections 2021-11-15T14:39:22.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2493352805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d680b4cc0 0x7f7d68143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2493352805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d68067380 0x7f7d68143970 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:22.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2493352805 >> v2:172.21.2.119:3300/0 conn(0x7f7d68060180 0x7f7d680b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- 172.21.2.135:0/2493352805 >> 172.21.2.135:0/2493352805 conn(0x7f7d6805cfb0 msgr2=0x7f7d6805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:22.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- 172.21.2.135:0/2493352805 shutdown_connections 2021-11-15T14:39:22.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- 172.21.2.135:0/2493352805 wait complete. 2021-11-15T14:39:22.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 Processor -- start 2021-11-15T14:39:22.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.008+0000 7f7d6da01700 1 -- start start 2021-11-15T14:39:22.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d68060180 0x7f7d68142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d68067380 0x7f7d6813d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6814e1e0 con 0x7f7d68060180 2021-11-15T14:39:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680ac040 con 0x7f7d680b4cc0 2021-11-15T14:39:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6814e3d0 con 0x7f7d68067380 2021-11-15T14:39:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58186/0 (socket says 172.21.2.135:58186) 2021-11-15T14:39:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 -- 172.21.2.135:0/2172956319 learned_addr learned my addr 172.21.2.135:0/2172956319 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 -- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d68067380 msgr2=0x7f7d6813d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d68067380 0x7f7d6813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 -- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d68060180 msgr2=0x7f7d68142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d68060180 0x7f7d68142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 -- 172.21.2.135:0/2172956319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5000b1e0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d677fe700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f7d6814e6a0 tx=0x7f7d600091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d60005c30 con 0x7f7d680b4cc0 2021-11-15T14:39:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60005d90 con 0x7f7d680b4cc0 2021-11-15T14:39:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d60006220 con 0x7f7d680b4cc0 2021-11-15T14:39:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d680af8d0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d680af3a0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d680afa60 con 0x7f7d680b4cc0 2021-11-15T14:39:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d6000f030 con 0x7f7d680b4cc0 2021-11-15T14:39:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 0x7f7d4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f7d6006bce0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d66ffd700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 0x7f7d4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.012+0000 7f7d66ffd700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 0x7f7d4c055a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f7d58002f70 tx=0x7f7d580069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.016+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d60042c90 con 0x7f7d680b4cc0 2021-11-15T14:39:22.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d680573d0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d5ffff700 1 -- 172.21.2.135:0/2172956319 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f7d600462b0 con 0x7f7d680b4cc0 2021-11-15T14:39:22.133 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:22.133 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:37:54.979308+0000","modified":"2021-11-15T14:39:21.932941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-15T14:39:22.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 msgr2=0x7f7d4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 0x7f7d4c055a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f7d58002f70 tx=0x7f7d580069e0).stop 2021-11-15T14:39:22.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 msgr2=0x7f7d6813de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f7d6814e6a0 tx=0x7f7d600091a0).stop 2021-11-15T14:39:22.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 shutdown_connections 2021-11-15T14:39:22.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d4c053580 0x7f7d4c055a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:22.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d680b4cc0 0x7f7d6813de00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:22.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d68067380 0x7f7d6813d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 --2- 172.21.2.135:0/2172956319 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d68060180 0x7f7d68142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 >> 172.21.2.135:0/2172956319 conn(0x7f7d6805cfb0 msgr2=0x7f7d6813fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:22.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 shutdown_connections 2021-11-15T14:39:22.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.128+0000 7f7d6da01700 1 -- 172.21.2.135:0/2172956319 wait complete. 2021-11-15T14:39:22.137 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 27 2021-11-15T14:39:22.141 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:39:22.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 Processor -- start 2021-11-15T14:39:22.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 -- start start 2021-11-15T14:39:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8fe00b1350 0x7f8fe00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 0x7f8fe01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00a7850 con 0x7f8fe00b1f40 2021-11-15T14:39:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe00b17c0 con 0x7f8fe00b1350 2021-11-15T14:39:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fe4a46700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00b06d0 con 0x7f8fe00b2320 2021-11-15T14:39:22.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fde59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8fe00b1f40 0x7f8fe00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45780/0 (socket says 172.21.2.135:45780) 2021-11-15T14:39:22.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fde59c700 1 -- 172.21.2.135:0/2257133463 learned_addr learned my addr 172.21.2.135:0/2257133463 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:22.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375166621 0 0) 0x7f8fe00a7850 con 0x7f8fe00b1f40 2021-11-15T14:39:22.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc4003260 con 0x7f8fe00b1f40 2021-11-15T14:39:22.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808060673 0 0) 0x7f8fc4003260 con 0x7f8fe00b1f40 2021-11-15T14:39:22.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 msgr2=0x7f8fe01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 0x7f8fe01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 >> v2:172.21.2.119:3300/0 conn(0x7f8fe00b1350 msgr2=0x7f8fe00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 --2- 172.21.2.135:0/2257133463 >> v2:172.21.2.119:3300/0 conn(0x7f8fe00b1350 0x7f8fe00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00b0970 con 0x7f8fe00b1f40 2021-11-15T14:39:22.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8fd4001660 con 0x7f8fe00b1f40 2021-11-15T14:39:22.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 >> v1:172.21.2.135:6789/0 conn(0x7f8fe00b1f40 legacy=0x7f8fe00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 0x7f8fc40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fc4003ee0 0x7f8fc4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fc4004bf0 0x7f8fc400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00b17c0 con 0x7f8fc4004bf0 2021-11-15T14:39:22.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00b06d0 con 0x7f8fc4003ee0 2021-11-15T14:39:22.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.188+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40053a0 con 0x7f8fe00b2320 2021-11-15T14:39:22.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fc4003ee0 0x7f8fc4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 msgr2=0x7f8fc40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fe00b2320 0x7f8fc40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fc4004bf0 msgr2=0x7f8fc400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:22.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fc4004bf0 0x7f8fc400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/2257133463 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc4003260 con 0x7f8fc4003ee0 2021-11-15T14:39:22.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fc4003ee0 0x7f8fc4004500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8fd0002f70 tx=0x7f8fd0006ca0).ready entity=mon.1 client_cookie=c464d7badf8e2559 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd0012410 con 0x7f8fc4003ee0 2021-11-15T14:39:22.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0012570 con 0x7f8fc4003ee0 2021-11-15T14:39:22.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fdd59a700 1 -- 172.21.2.135:0/2257133463 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd00128d0 con 0x7f8fc4003ee0 2021-11-15T14:39:22.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/2257133463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fc4003ee0 msgr2=0x7f8fc4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/2257133463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fc4003ee0 0x7f8fc4004500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8fd0002f70 tx=0x7f8fd0006ca0).stop 2021-11-15T14:39:22.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fded9d700 1 -- 172.21.2.135:0/2257133463 reap_dead start 2021-11-15T14:39:22.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/2257133463 shutdown_connections 2021-11-15T14:39:22.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/2257133463 >> 172.21.2.135:0/2257133463 conn(0x7f8fe005f730 msgr2=0x7f8fe005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:22.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/2257133463 shutdown_connections 2021-11-15T14:39:22.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/2257133463 wait complete. 2021-11-15T14:39:22.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 Processor -- start 2021-11-15T14:39:22.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- start start 2021-11-15T14:39:22.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fc4003ee0 0x7f8fe0140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fe015ad30 0x7f8fe0137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0145a50 con 0x7f8fe015ad30 2021-11-15T14:39:22.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0156f70 con 0x7f8fe01455d0 2021-11-15T14:39:22.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01470d0 con 0x7f8fc4003ee0 2021-11-15T14:39:22.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58208/0 (socket says 172.21.2.135:58208) 2021-11-15T14:39:22.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/602348006 learned_addr learned my addr 172.21.2.135:0/602348006 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:22.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fc4003ee0 msgr2=0x7f8fe0140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fc4003ee0 0x7f8fe0140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fe015ad30 msgr2=0x7f8fe0137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fe015ad30 0x7f8fe0137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 -- 172.21.2.135:0/602348006 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0147370 con 0x7f8fe01455d0 2021-11-15T14:39:22.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fddd9b700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f8fd0002f70 tx=0x7f8fd0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd0011930 con 0x7f8fe01455d0 2021-11-15T14:39:22.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0011a90 con 0x7f8fe01455d0 2021-11-15T14:39:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fd0011df0 con 0x7f8fe01455d0 2021-11-15T14:39:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe0147610 con 0x7f8fe01455d0 2021-11-15T14:39:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00ae340 con 0x7f8fe01455d0 2021-11-15T14:39:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.192+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00573d0 con 0x7f8fe01455d0 2021-11-15T14:39:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fd000f030 con 0x7f8fe01455d0 2021-11-15T14:39:22.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fcf7fe700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 0x7f8fbc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:22.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f8fd006c9a0 con 0x7f8fe01455d0 2021-11-15T14:39:22.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fde59c700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 0x7f8fbc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fde59c700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 0x7f8fbc055a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f8fd4001370 tx=0x7f8fe00b0b00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.196+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8fd00438f0 con 0x7f8fe01455d0 2021-11-15T14:39:22.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.304+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8fe00ac7e0 con 0x7f8fe01455d0 2021-11-15T14:39:22.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fcf7fe700 1 -- 172.21.2.135:0/602348006 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fd0022020 con 0x7f8fe01455d0 2021-11-15T14:39:22.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 msgr2=0x7f8fbc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 0x7f8fbc055a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f8fd4001370 tx=0x7f8fe00b0b00).stop 2021-11-15T14:39:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 msgr2=0x7f8fe015a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f8fd0002f70 tx=0x7f8fd0015000).stop 2021-11-15T14:39:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 shutdown_connections 2021-11-15T14:39:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fbc053580 0x7f8fbc055a40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fe015ad30 0x7f8fe0137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fe01455d0 0x7f8fe015a840 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 --2- 172.21.2.135:0/602348006 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fc4003ee0 0x7f8fe0140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 >> 172.21.2.135:0/602348006 conn(0x7f8fe005f730 msgr2=0x7f8fe013d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:22.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 shutdown_connections 2021-11-15T14:39:22.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:22.956+0000 7f8fe4a46700 1 -- 172.21.2.135:0/602348006 wait complete. 2021-11-15T14:39:22.969 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:39:23.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 Processor -- start 2021-11-15T14:39:23.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- start start 2021-11-15T14:39:23.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f02980b1e30 0x7f02980b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980a7140 0x7f02981447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980b03d0 con 0x7f0298148420 2021-11-15T14:39:23.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02980a9140 con 0x7f02980b1e30 2021-11-15T14:39:23.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02980b0670 con 0x7f02980a7140 2021-11-15T14:39:23.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f0296ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0298148420 0x7f02980b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45804/0 (socket says 172.21.2.135:45804) 2021-11-15T14:39:23.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f0296ffd700 1 -- 172.21.2.135:0/2139478038 learned_addr learned my addr 172.21.2.135:0/2139478038 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:23.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 --2- 172.21.2.135:0/2139478038 >> v2:172.21.2.135:3300/0 conn(0x7f02980b1e30 0x7f02980b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:23.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 -- 172.21.2.135:0/2139478038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980a7140 msgr2=0x7f02981447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:23.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 --2- 172.21.2.135:0/2139478038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980a7140 0x7f02981447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 -- 172.21.2.135:0/2139478038 >> v1:172.21.2.135:6789/0 conn(0x7f0298148420 legacy=0x7f02980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 -- 172.21.2.135:0/2139478038 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980b0910 con 0x7f02980b1e30 2021-11-15T14:39:23.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02977fe700 1 --2- 172.21.2.135:0/2139478038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980b1e30 0x7f02980b1050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f02981477b0 tx=0x7f0288006df0).ready entity=mon.1 client_cookie=2a8202ded10d5eb7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:23.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02967fc700 1 -- 172.21.2.135:0/2139478038 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f028800d570 con 0x7f02980b1e30 2021-11-15T14:39:23.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02967fc700 1 -- 172.21.2.135:0/2139478038 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288000e90 con 0x7f02980b1e30 2021-11-15T14:39:23.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f02967fc700 1 -- 172.21.2.135:0/2139478038 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f028800d8c0 con 0x7f02980b1e30 2021-11-15T14:39:23.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- 172.21.2.135:0/2139478038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980b1e30 msgr2=0x7f02980b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 --2- 172.21.2.135:0/2139478038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980b1e30 0x7f02980b1050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f02981477b0 tx=0x7f0288006df0).stop 2021-11-15T14:39:23.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- 172.21.2.135:0/2139478038 shutdown_connections 2021-11-15T14:39:23.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 --2- 172.21.2.135:0/2139478038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980a7140 0x7f02981447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 --2- 172.21.2.135:0/2139478038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980b1e30 0x7f02980b1050 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:23.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- 172.21.2.135:0/2139478038 >> 172.21.2.135:0/2139478038 conn(0x7f029805f730 msgr2=0x7f029805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:23.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- 172.21.2.135:0/2139478038 shutdown_connections 2021-11-15T14:39:23.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.020+0000 7f029dd55700 1 -- 172.21.2.135:0/2139478038 wait complete. 2021-11-15T14:39:23.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 Processor -- start 2021-11-15T14:39:23.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- start start 2021-11-15T14:39:23.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980b1e30 0x7f029814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0298148420 0x7f0298148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0298157a80 con 0x7f0298148420 2021-11-15T14:39:23.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029814b0c0 con 0x7f02980a7140 2021-11-15T14:39:23.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02981577e0 con 0x7f02980b1e30 2021-11-15T14:39:23.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:23.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58222/0 (socket says 172.21.2.135:58222) 2021-11-15T14:39:23.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 -- 172.21.2.135:0/2319061887 learned_addr learned my addr 172.21.2.135:0/2319061887 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:23.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 -- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980b1e30 msgr2=0x7f029814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980b1e30 0x7f029814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 -- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0298148420 msgr2=0x7f0298148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0298148420 0x7f0298148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 -- 172.21.2.135:0/2319061887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028800b180 con 0x7f02980a7140 2021-11-15T14:39:23.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f02977fe700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f02981477b0 tx=0x7f0288015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:23.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0288006b20 con 0x7f02980a7140 2021-11-15T14:39:23.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288002f50 con 0x7f02980a7140 2021-11-15T14:39:23.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0298157500 con 0x7f02980a7140 2021-11-15T14:39:23.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0288006780 con 0x7f02980a7140 2021-11-15T14:39:23.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029814a1f0 con 0x7f02980a7140 2021-11-15T14:39:23.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029814bb90 con 0x7f02980a7140 2021-11-15T14:39:23.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0288025030 con 0x7f02980a7140 2021-11-15T14:39:23.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 0x7f0278055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:23.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f028806ccf0 con 0x7f02980a7140 2021-11-15T14:39:23.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.024+0000 7f0296ffd700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 0x7f0278055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:23.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.028+0000 7f0296ffd700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 0x7f0278055b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f02980b31f0 tx=0x7f028c007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:23.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.028+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0288043ca0 con 0x7f02980a7140 2021-11-15T14:39:23.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.112+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02980573d0 con 0x7f02980a7140 2021-11-15T14:39:23.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.972+0000 7f0294ff9700 1 -- 172.21.2.135:0/2319061887 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0288023020 con 0x7f02980a7140 2021-11-15T14:39:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 msgr2=0x7f0278055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 0x7f0278055b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f02980b31f0 tx=0x7f028c007800).stop 2021-11-15T14:39:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 msgr2=0x7f02980ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f02981477b0 tx=0x7f0288015000).stop 2021-11-15T14:39:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 shutdown_connections 2021-11-15T14:39:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02780536d0 0x7f0278055b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0298148420 0x7f0298148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02980b1e30 0x7f029814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:23.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 --2- 172.21.2.135:0/2319061887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02980a7140 0x7f02980ae1f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:23.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 >> 172.21.2.135:0/2319061887 conn(0x7f029805f730 msgr2=0x7f02980b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:23.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 shutdown_connections 2021-11-15T14:39:23.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:23.976+0000 7f029dd55700 1 -- 172.21.2.135:0/2319061887 wait complete. 2021-11-15T14:39:23.983 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:39:23.991 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:39:24.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 Processor -- start 2021-11-15T14:39:24.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- start start 2021-11-15T14:39:24.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280613a0 0x7f7028061780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70280aed70 con 0x7f70280ad640 2021-11-15T14:39:24.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70280b6fa0 con 0x7f70281404c0 2021-11-15T14:39:24.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280aefa0 con 0x7f70280613a0 2021-11-15T14:39:24.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702e55c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f70281404c0 0x7f70281465a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45818/0 (socket says 172.21.2.135:45818) 2021-11-15T14:39:24.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702e55c700 1 -- 172.21.2.135:0/4125689285 learned_addr learned my addr 172.21.2.135:0/4125689285 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:24.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714514892 0 0) 0x7f70280b6fa0 con 0x7f70281404c0 2021-11-15T14:39:24.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7010003260 con 0x7f70281404c0 2021-11-15T14:39:24.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806920777 0 0) 0x7f7010003260 con 0x7f70281404c0 2021-11-15T14:39:24.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280613a0 msgr2=0x7f7028061780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:24.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280613a0 0x7f7028061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 >> v1:172.21.2.119:6789/0 conn(0x7f70280ad640 legacy=0x7f70280b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:24.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280af240 con 0x7f70281404c0 2021-11-15T14:39:24.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f70200019e0 con 0x7f70281404c0 2021-11-15T14:39:24.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 >> v1:172.21.2.135:6789/0 conn(0x7f70281404c0 legacy=0x7f70281465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70100037d0 0x7f7010003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7010004500 0x7f7010004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010005070 0x7f701000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280aefa0 con 0x7f7010005070 2021-11-15T14:39:24.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701000bea0 con 0x7f7010004500 2021-11-15T14:39:24.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701000c060 con 0x7f70100037d0 2021-11-15T14:39:24.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7010004500 0x7f7010004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:24.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 -- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70100037d0 msgr2=0x7f7010003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:24.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70100037d0 0x7f7010003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 -- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010005070 msgr2=0x7f701000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:24.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010005070 0x7f701000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 -- 172.21.2.135:0/4125689285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7010003260 con 0x7f7010004500 2021-11-15T14:39:24.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702d55a700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7010004500 0x7f7010004980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7024000f70 tx=0x7f70240079e0).ready entity=mon.1 client_cookie=8127c4a42f21136e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:24.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7024007cf0 con 0x7f7010004500 2021-11-15T14:39:24.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024014410 con 0x7f7010004500 2021-11-15T14:39:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702cd59700 1 -- 172.21.2.135:0/4125689285 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7024014770 con 0x7f7010004500 2021-11-15T14:39:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- 172.21.2.135:0/4125689285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7010004500 msgr2=0x7f7010004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 --2- 172.21.2.135:0/4125689285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7010004500 0x7f7010004980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7024000f70 tx=0x7f70240079e0).stop 2021-11-15T14:39:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702e55c700 1 -- 172.21.2.135:0/4125689285 reap_dead start 2021-11-15T14:39:24.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- 172.21.2.135:0/4125689285 shutdown_connections 2021-11-15T14:39:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- 172.21.2.135:0/4125689285 >> 172.21.2.135:0/4125689285 conn(0x7f7028066e60 msgr2=0x7f7028067240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- 172.21.2.135:0/4125689285 shutdown_connections 2021-11-15T14:39:24.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- 172.21.2.135:0/4125689285 wait complete. 2021-11-15T14:39:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 Processor -- start 2021-11-15T14:39:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.040+0000 7f702ed5d700 1 -- start start 2021-11-15T14:39:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010004500 0x7f70280ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280ac1b0 0x7f7028152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280aba80 con 0x7f7010004500 2021-11-15T14:39:24.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280aa9e0 con 0x7f70280ac610 2021-11-15T14:39:24.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280aac80 con 0x7f70280ac1b0 2021-11-15T14:39:24.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:24.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58244/0 (socket says 172.21.2.135:58244) 2021-11-15T14:39:24.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 -- 172.21.2.135:0/2278624080 learned_addr learned my addr 172.21.2.135:0/2278624080 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:24.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 -- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280ac1b0 msgr2=0x7f7028152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280ac1b0 0x7f7028152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 -- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010004500 msgr2=0x7f70280ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010004500 0x7f70280ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 -- 172.21.2.135:0/2278624080 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280aa460 con 0x7f70280ac610 2021-11-15T14:39:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702e55c700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f70200016f0 tx=0x7f70280af3d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7020004ab0 con 0x7f70280ac610 2021-11-15T14:39:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020004c10 con 0x7f70280ac610 2021-11-15T14:39:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70200070d0 con 0x7f70280ac610 2021-11-15T14:39:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280acad0 con 0x7f70280ac610 2021-11-15T14:39:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028152ad0 con 0x7f70280ac610 2021-11-15T14:39:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70280af4e0 con 0x7f70280ac610 2021-11-15T14:39:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f702001b070 con 0x7f70280ac610 2021-11-15T14:39:24.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 0x7f7008055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f702006afe0 con 0x7f70280ac610 2021-11-15T14:39:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702dd5b700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 0x7f7008055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.044+0000 7f702dd5b700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 0x7f7008055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7018002f70 tx=0x7f7018006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.048+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7020042150 con 0x7f70280ac610 2021-11-15T14:39:24.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.128+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70280573d0 con 0x7f70280ac610 2021-11-15T14:39:24.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f7016ffd700 1 -- 172.21.2.135:0/2278624080 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7020045770 con 0x7f70280ac610 2021-11-15T14:39:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 msgr2=0x7f7008055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 0x7f7008055b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f7018002f70 tx=0x7f7018006a00).stop 2021-11-15T14:39:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 msgr2=0x7f70280b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f70200016f0 tx=0x7f70280af3d0).stop 2021-11-15T14:39:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 shutdown_connections 2021-11-15T14:39:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f70080536a0 0x7f7008055b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:24.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f70280ac610 0x7f70280b08c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f70280ac1b0 0x7f7028152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 --2- 172.21.2.135:0/2278624080 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7010004500 0x7f70280ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 >> 172.21.2.135:0/2278624080 conn(0x7f7028066e60 msgr2=0x7f7028141e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:24.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 shutdown_connections 2021-11-15T14:39:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:24.980+0000 7f702ed5d700 1 -- 172.21.2.135:0/2278624080 wait complete. 2021-11-15T14:39:24.988 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:39:24.992 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:39:25.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 Processor -- start 2021-11-15T14:39:25.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- start start 2021-11-15T14:39:25.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f13201419e0 0x7f13200b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200a7850 con 0x7f13200b1f40 2021-11-15T14:39:25.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200b06d0 con 0x7f13200b1350 2021-11-15T14:39:25.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200b17c0 con 0x7f13201419e0 2021-11-15T14:39:25.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f13200b1350 0x7f13201412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45838/0 (socket says 172.21.2.135:45838) 2021-11-15T14:39:25.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131f7fe700 1 -- 172.21.2.135:0/684570965 learned_addr learned my addr 172.21.2.135:0/684570965 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:25.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894335526 0 0) 0x7f13200b06d0 con 0x7f13200b1350 2021-11-15T14:39:25.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f130c003260 con 0x7f13200b1350 2021-11-15T14:39:25.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 --2- 172.21.2.135:0/684570965 >> v2:172.21.2.119:3300/0 conn(0x7f13201419e0 0x7f13200b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786399500 0 0) 0x7f130c003260 con 0x7f13200b1350 2021-11-15T14:39:25.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 >> v2:172.21.2.119:3300/0 conn(0x7f13201419e0 msgr2=0x7f13200b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 --2- 172.21.2.135:0/684570965 >> v2:172.21.2.119:3300/0 conn(0x7f13201419e0 0x7f13200b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 >> v1:172.21.2.119:6789/0 conn(0x7f13200b1f40 legacy=0x7f13200a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200b0970 con 0x7f13200b1350 2021-11-15T14:39:25.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f1314001660 con 0x7f13200b1350 2021-11-15T14:39:25.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 >> v1:172.21.2.135:6789/0 conn(0x7f13200b1350 legacy=0x7f13201412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f130c003820 0x7f130c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f130c004500 0x7f130c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f130c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13200b17c0 con 0x7f130c004500 2021-11-15T14:39:25.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c00be50 con 0x7f130c004f70 2021-11-15T14:39:25.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c00c010 con 0x7f130c003820 2021-11-15T14:39:25.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f130c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 -- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f130c003820 msgr2=0x7f130c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f130c003820 0x7f130c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 -- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f130c004500 msgr2=0x7f130c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131f7fe700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f130c004500 0x7f130c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f130c004500 0x7f130c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 -- 172.21.2.135:0/684570965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c003260 con 0x7f130c004f70 2021-11-15T14:39:25.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 -- 172.21.2.135:0/684570965 reap_dead start 2021-11-15T14:39:25.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f1324c1c700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f130c00b750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f131800a000 tx=0x7f1318008040).ready entity=mon.1 client_cookie=cf15609a4ca06111 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f131800c070 con 0x7f130c004f70 2021-11-15T14:39:25.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131800e810 con 0x7f130c004f70 2021-11-15T14:39:25.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f131effd700 1 -- 172.21.2.135:0/684570965 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f131800eb70 con 0x7f130c004f70 2021-11-15T14:39:25.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 msgr2=0x7f130c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f130c00b750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f131800a000 tx=0x7f1318008040).stop 2021-11-15T14:39:25.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- 172.21.2.135:0/684570965 shutdown_connections 2021-11-15T14:39:25.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 --2- 172.21.2.135:0/684570965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f130c00b750 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- 172.21.2.135:0/684570965 >> 172.21.2.135:0/684570965 conn(0x7f132005f730 msgr2=0x7f132005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:25.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- 172.21.2.135:0/684570965 shutdown_connections 2021-11-15T14:39:25.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.040+0000 7f132667f700 1 -- 172.21.2.135:0/684570965 wait complete. 2021-11-15T14:39:25.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 Processor -- start 2021-11-15T14:39:25.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- start start 2021-11-15T14:39:25.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1320157870 0x7f13200a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f132015a150 0x7f13200aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201426f0 con 0x7f1320157870 2021-11-15T14:39:25.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1320156e90 con 0x7f130c004f70 2021-11-15T14:39:25.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1320157130 con 0x7f132015a150 2021-11-15T14:39:25.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58260/0 (socket says 172.21.2.135:58260) 2021-11-15T14:39:25.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 -- 172.21.2.135:0/3238320329 learned_addr learned my addr 172.21.2.135:0/3238320329 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:25.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 -- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f132015a150 msgr2=0x7f13200aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f132015a150 0x7f13200aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 -- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1320157870 msgr2=0x7f13200a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1320157870 0x7f13200a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 -- 172.21.2.135:0/3238320329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13201573d0 con 0x7f130c004f70 2021-11-15T14:39:25.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131ffff700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f1310001fa0 tx=0x7f1310007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f131000ce80 con 0x7f130c004f70 2021-11-15T14:39:25.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310000e90 con 0x7f130c004f70 2021-11-15T14:39:25.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1310007430 con 0x7f130c004f70 2021-11-15T14:39:25.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1320156b80 con 0x7f130c004f70 2021-11-15T14:39:25.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13200ac110 con 0x7f130c004f70 2021-11-15T14:39:25.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320157560 con 0x7f130c004f70 2021-11-15T14:39:25.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f131001a060 con 0x7f130c004f70 2021-11-15T14:39:25.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 0x7f1300055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f131006b1b0 con 0x7f130c004f70 2021-11-15T14:39:25.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131f7fe700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 0x7f1300055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.044+0000 7f131f7fe700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 0x7f1300055bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1314008000 tx=0x7f1314009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.048+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1310042320 con 0x7f130c004f70 2021-11-15T14:39:25.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.132+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f13200b0c10 con 0x7f130c004f70 2021-11-15T14:39:25.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f131d7fa700 1 -- 172.21.2.135:0/3238320329 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1310045940 con 0x7f130c004f70 2021-11-15T14:39:25.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 msgr2=0x7f1300055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 0x7f1300055bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1314008000 tx=0x7f1314009040).stop 2021-11-15T14:39:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 msgr2=0x7f13200ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f1310001fa0 tx=0x7f1310007c30).stop 2021-11-15T14:39:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 shutdown_connections 2021-11-15T14:39:25.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f13000536f0 0x7f1300055bb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f132015a150 0x7f13200aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1320157870 0x7f13200a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 --2- 172.21.2.135:0/3238320329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f130c004f70 0x7f13200ae850 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 >> 172.21.2.135:0/3238320329 conn(0x7f132005f730 msgr2=0x7f13200af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:25.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 shutdown_connections 2021-11-15T14:39:25.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.140+0000 7f132667f700 1 -- 172.21.2.135:0/3238320329 wait complete. 2021-11-15T14:39:25.152 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-15T14:39:25.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.196+0000 7fdf8b1b0700 1 Processor -- start 2021-11-15T14:39:25.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.196+0000 7fdf8b1b0700 1 -- start start 2021-11-15T14:39:25.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdf84060180 0x7fdf840616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 0x7fdf84066d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf84060560 con 0x7fdf840659f0 2021-11-15T14:39:25.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf840662e0 con 0x7fdf84060180 2021-11-15T14:39:25.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84060cf0 con 0x7fdf84065ea0 2021-11-15T14:39:25.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fdf840659f0 0x7fdf84066650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45858/0 (socket says 172.21.2.135:45858) 2021-11-15T14:39:25.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 -- 172.21.2.135:0/2967945119 learned_addr learned my addr 172.21.2.135:0/2967945119 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:25.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305909704 0 0) 0x7fdf84060560 con 0x7fdf840659f0 2021-11-15T14:39:25.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf64003260 con 0x7fdf840659f0 2021-11-15T14:39:25.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073160445 0 0) 0x7fdf64003260 con 0x7fdf840659f0 2021-11-15T14:39:25.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 msgr2=0x7fdf84066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 0x7fdf84066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 >> v2:172.21.2.119:3300/0 conn(0x7fdf84060180 msgr2=0x7fdf840616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 --2- 172.21.2.135:0/2967945119 >> v2:172.21.2.119:3300/0 conn(0x7fdf84060180 0x7fdf840616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84060f90 con 0x7fdf840659f0 2021-11-15T14:39:25.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fdf6c001660 con 0x7fdf840659f0 2021-11-15T14:39:25.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 >> v1:172.21.2.135:6789/0 conn(0x7fdf840659f0 legacy=0x7fdf84066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf64003750 0x7fdf64003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf64004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 0x7fdf64004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840662e0 con 0x7fdf64003750 2021-11-15T14:39:25.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84060cf0 con 0x7fdf64004500 2021-11-15T14:39:25.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640141a0 con 0x7fdf84065ea0 2021-11-15T14:39:25.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf64004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 -- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 msgr2=0x7fdf64004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf84065ea0 0x7fdf64004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 -- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf64003750 msgr2=0x7fdf64003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:25.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf64003750 0x7fdf64003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 -- 172.21.2.135:0/2967945119 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64003260 con 0x7fdf64004500 2021-11-15T14:39:25.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf83fff700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf64004980 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdf6c001370 tx=0x7fdf840621c0).ready entity=mon.1 client_cookie=345c480cdb8c33c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf6c0071a0 con 0x7fdf64004500 2021-11-15T14:39:25.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c007300 con 0x7fdf64004500 2021-11-15T14:39:25.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf837fe700 1 -- 172.21.2.135:0/2967945119 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf6c00cbb0 con 0x7fdf64004500 2021-11-15T14:39:25.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/2967945119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 msgr2=0x7fdf64004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/2967945119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf64004980 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdf6c001370 tx=0x7fdf840621c0).stop 2021-11-15T14:39:25.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8974d700 1 -- 172.21.2.135:0/2967945119 reap_dead start 2021-11-15T14:39:25.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/2967945119 shutdown_connections 2021-11-15T14:39:25.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/2967945119 >> 172.21.2.135:0/2967945119 conn(0x7fdf8405cfb0 msgr2=0x7fdf8405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:25.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/2967945119 shutdown_connections 2021-11-15T14:39:25.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/2967945119 wait complete. 2021-11-15T14:39:25.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 Processor -- start 2021-11-15T14:39:25.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- start start 2021-11-15T14:39:25.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf8409f8c0 0x7fdf840a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf840a5350 0x7fdf8413f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840a3db0 con 0x7fdf840a5350 2021-11-15T14:39:25.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840a2720 con 0x7fdf64004500 2021-11-15T14:39:25.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf8b1b0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8413fda0 con 0x7fdf8409f8c0 2021-11-15T14:39:25.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.200+0000 7fdf88f4c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58282/0 (socket says 172.21.2.135:58282) 2021-11-15T14:39:25.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 -- 172.21.2.135:0/1213524542 learned_addr learned my addr 172.21.2.135:0/1213524542 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:25.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 -- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf8409f8c0 msgr2=0x7fdf840a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf8409f8c0 0x7fdf840a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 -- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf840a5350 msgr2=0x7fdf8413f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf840a5350 0x7fdf8413f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 -- 172.21.2.135:0/1213524542 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8413ffd0 con 0x7fdf64004500 2021-11-15T14:39:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf88f4c700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fdf74002f70 tx=0x7fdf74006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf74013460 con 0x7fdf64004500 2021-11-15T14:39:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf740135c0 con 0x7fdf64004500 2021-11-15T14:39:25.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8409fd40 con 0x7fdf64004500 2021-11-15T14:39:25.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf840b2020 con 0x7fdf64004500 2021-11-15T14:39:25.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf74013920 con 0x7fdf64004500 2021-11-15T14:39:25.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf84061230 con 0x7fdf64004500 2021-11-15T14:39:25.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf7401a060 con 0x7fdf64004500 2021-11-15T14:39:25.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 0x7fdf68055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:25.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fdf7406b110 con 0x7fdf64004500 2021-11-15T14:39:25.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf83fff700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 0x7fdf68055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:25.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.204+0000 7fdf83fff700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 0x7fdf68055be0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fdf6c001370 tx=0x7fdf6c013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:25.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.208+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf740423f0 con 0x7fdf64004500 2021-11-15T14:39:25.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.320+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7fdf8409fd00 con 0x7fdf64004500 2021-11-15T14:39:25.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.988+0000 7fdf81ffb700 1 -- 172.21.2.135:0/1213524542 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v206) v1 ==== 152+0+0 (secure 0 0 0) 0x7fdf74018070 con 0x7fdf64004500 2021-11-15T14:39:25.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 msgr2=0x7fdf68055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 0x7fdf68055be0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fdf6c001370 tx=0x7fdf6c013000).stop 2021-11-15T14:39:25.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 msgr2=0x7fdf840a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:25.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fdf74002f70 tx=0x7fdf74006ec0).stop 2021-11-15T14:39:25.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 shutdown_connections 2021-11-15T14:39:25.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf68053720 0x7fdf68055be0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf840a5350 0x7fdf8413f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf8409f8c0 0x7fdf840a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:25.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 --2- 172.21.2.135:0/1213524542 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf64004500 0x7fdf840a1ab0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:25.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 >> 172.21.2.135:0/1213524542 conn(0x7fdf8405cfb0 msgr2=0x7fdf840b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:25.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 shutdown_connections 2021-11-15T14:39:25.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:25.992+0000 7fdf8b1b0700 1 -- 172.21.2.135:0/1213524542 wait complete. 2021-11-15T14:39:26.001 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T14:39:26.002 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-15T14:39:26.002 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-15T14:39:26.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 Processor -- start 2021-11-15T14:39:26.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 -- start start 2021-11-15T14:39:26.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380b1e30 0x7f90380b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f90380a7140 0x7f90381447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380b03d0 con 0x7f9038148420 2021-11-15T14:39:26.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380a9140 con 0x7f90380a7140 2021-11-15T14:39:26.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.048+0000 7f903cc08700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380b0670 con 0x7f90380b1e30 2021-11-15T14:39:26.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f90380a7140 0x7f90381447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:26.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f90380a7140 0x7f90381447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:52102/0 (socket says 172.21.2.135:52102) 2021-11-15T14:39:26.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 -- 172.21.2.135:0/3580933946 learned_addr learned my addr 172.21.2.135:0/3580933946 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:26.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903659c700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380b1e30 0x7f90380b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:26.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 -- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380b1e30 msgr2=0x7f90380b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:26.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380b1e30 0x7f90380b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:26.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 -- 172.21.2.135:0/3580933946 >> v1:172.21.2.119:6789/0 conn(0x7f9038148420 legacy=0x7f90380b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:26.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 -- 172.21.2.135:0/3580933946 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380b0910 con 0x7f90380a7140 2021-11-15T14:39:26.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f9036d9d700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90380a7140 0x7f90381447a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f90300032f0 tx=0x7f9030009290).ready entity=mon.0 client_cookie=ae0664c7937046c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:26.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903559a700 1 -- 172.21.2.135:0/3580933946 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000b8a0 con 0x7f90380a7140 2021-11-15T14:39:26.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903559a700 1 -- 172.21.2.135:0/3580933946 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903000ba00 con 0x7f90380a7140 2021-11-15T14:39:26.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903559a700 1 -- 172.21.2.135:0/3580933946 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000bb70 con 0x7f90380a7140 2021-11-15T14:39:26.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90380a7140 msgr2=0x7f90381447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:26.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90380a7140 0x7f90381447a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f90300032f0 tx=0x7f9030009290).stop 2021-11-15T14:39:26.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- 172.21.2.135:0/3580933946 shutdown_connections 2021-11-15T14:39:26.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90380a7140 0x7f90381447a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:26.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 --2- 172.21.2.135:0/3580933946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380b1e30 0x7f90380b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:26.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- 172.21.2.135:0/3580933946 >> 172.21.2.135:0/3580933946 conn(0x7f903805f730 msgr2=0x7f903805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:26.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- 172.21.2.135:0/3580933946 shutdown_connections 2021-11-15T14:39:26.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- 172.21.2.135:0/3580933946 wait complete. 2021-11-15T14:39:26.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 Processor -- start 2021-11-15T14:39:26.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.052+0000 7f903cc08700 1 -- start start 2021-11-15T14:39:26.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380a7140 0x7f90380ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9038148420 0x7f903813ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380ac750 con 0x7f9038148420 2021-11-15T14:39:26.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380ac9f0 con 0x7f90380b1e30 2021-11-15T14:39:26.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903814d890 con 0x7f90380a7140 2021-11-15T14:39:26.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:26.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58296/0 (socket says 172.21.2.135:58296) 2021-11-15T14:39:26.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 -- 172.21.2.135:0/4159196003 learned_addr learned my addr 172.21.2.135:0/4159196003 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:26.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 -- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380a7140 msgr2=0x7f90380ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:26.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380a7140 0x7f90380ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:26.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 -- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9038148420 msgr2=0x7f903813ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:26.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9038148420 0x7f903813ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:26.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 -- 172.21.2.135:0/4159196003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009530 con 0x7f90380b1e30 2021-11-15T14:39:26.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f9035d9b700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9038061420 tx=0x7f902c007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:26.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c00ce30 con 0x7f90380b1e30 2021-11-15T14:39:26.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c012400 con 0x7f90380b1e30 2021-11-15T14:39:26.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903814db30 con 0x7f90380b1e30 2021-11-15T14:39:26.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c012760 con 0x7f90380b1e30 2021-11-15T14:39:26.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9038140710 con 0x7f90380b1e30 2021-11-15T14:39:26.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903814dcc0 con 0x7f90380b1e30 2021-11-15T14:39:26.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f902c019030 con 0x7f90380b1e30 2021-11-15T14:39:26.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 0x7f9014055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:26.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f902c06acf0 con 0x7f90380b1e30 2021-11-15T14:39:26.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903659c700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 0x7f9014055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:26.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.056+0000 7f903659c700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 0x7f9014055ad0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f902800c000 tx=0x7f9028006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:26.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.060+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f902c041e60 con 0x7f90380b1e30 2021-11-15T14:39:26.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.172+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f90380573d0 con 0x7f90380b1e30 2021-11-15T14:39:26.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.992+0000 7f90277fe700 1 -- 172.21.2.135:0/4159196003 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v207) v1 ==== 150+0+0 (secure 0 0 0) 0x7f902c045480 con 0x7f90380b1e30 2021-11-15T14:39:27.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 msgr2=0x7f9014055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 0x7f9014055ad0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f902800c000 tx=0x7f9028006df0).stop 2021-11-15T14:39:27.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 msgr2=0x7f903813a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9038061420 tx=0x7f902c007c20).stop 2021-11-15T14:39:27.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 shutdown_connections 2021-11-15T14:39:27.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9014053610 0x7f9014055ad0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9038148420 0x7f903813ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90380b1e30 0x7f903813a8a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 --2- 172.21.2.135:0/4159196003 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90380a7140 0x7f90380ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 >> 172.21.2.135:0/4159196003 conn(0x7f903805f730 msgr2=0x7f90381442c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 shutdown_connections 2021-11-15T14:39:27.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:26.996+0000 7f903cc08700 1 -- 172.21.2.135:0/4159196003 wait complete. 2021-11-15T14:39:27.006 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:39:27.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 Processor -- start 2021-11-15T14:39:27.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- start start 2021-11-15T14:39:27.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0b1f40 0x7fd37c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd37c0b0030 0x7fd37c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0b2810 con 0x7fd37c0a7140 2021-11-15T14:39:27.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0b0470 con 0x7fd37c0b0030 2021-11-15T14:39:27.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b06d0 con 0x7fd37c0b1f40 2021-11-15T14:39:27.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd37c0b0030 0x7fd37c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd37c0b0030 0x7fd37c0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58302/0 (socket says 172.21.2.135:58302) 2021-11-15T14:39:27.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 -- 172.21.2.135:0/2774589554 learned_addr learned my addr 172.21.2.135:0/2774589554 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 -- 172.21.2.135:0/2774589554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0b1f40 msgr2=0x7fd37c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 --2- 172.21.2.135:0/2774589554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0b1f40 0x7fd37c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 -- 172.21.2.135:0/2774589554 >> v1:172.21.2.119:6789/0 conn(0x7fd37c0a7140 legacy=0x7fd37c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 -- 172.21.2.135:0/2774589554 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0b0970 con 0x7fd37c0b0030 2021-11-15T14:39:27.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37b7fe700 1 --2- 172.21.2.135:0/2774589554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0b2320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fd37c06a170 tx=0x7fd36c006eb0).ready entity=mon.1 client_cookie=d4b85959d3064cb4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37affd700 1 -- 172.21.2.135:0/2774589554 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c00d570 con 0x7fd37c0b0030 2021-11-15T14:39:27.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37affd700 1 -- 172.21.2.135:0/2774589554 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c000e90 con 0x7fd37c0b0030 2021-11-15T14:39:27.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd37affd700 1 -- 172.21.2.135:0/2774589554 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c00d8c0 con 0x7fd37c0b0030 2021-11-15T14:39:27.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- 172.21.2.135:0/2774589554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 msgr2=0x7fd37c0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- 172.21.2.135:0/2774589554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0b2320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fd37c06a170 tx=0x7fd36c006eb0).stop 2021-11-15T14:39:27.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- 172.21.2.135:0/2774589554 shutdown_connections 2021-11-15T14:39:27.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- 172.21.2.135:0/2774589554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0b2320 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- 172.21.2.135:0/2774589554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0b1f40 0x7fd37c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- 172.21.2.135:0/2774589554 >> 172.21.2.135:0/2774589554 conn(0x7fd37c05f730 msgr2=0x7fd37c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- 172.21.2.135:0/2774589554 shutdown_connections 2021-11-15T14:39:27.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- 172.21.2.135:0/2774589554 wait complete. 2021-11-15T14:39:27.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 Processor -- start 2021-11-15T14:39:27.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 -- start start 2021-11-15T14:39:27.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 0x7fd37c0a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.056+0000 7fd3829a8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd37c0b1f40 0x7fd37c0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0a9780 con 0x7fd37c0b1f40 2021-11-15T14:39:27.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0aa8d0 con 0x7fd37c0b0030 2021-11-15T14:39:27.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c14ad20 con 0x7fd37c0a7140 2021-11-15T14:39:27.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58308/0 (socket says 172.21.2.135:58308) 2021-11-15T14:39:27.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 -- 172.21.2.135:0/3002038043 learned_addr learned my addr 172.21.2.135:0/3002038043 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd380f45700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd37c0b1f40 0x7fd37c0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37bfff700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 0x7fd37c0a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 -- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 msgr2=0x7fd37c0a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 0x7fd37c0a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 -- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd37c0b1f40 msgr2=0x7fd37c0aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd37c0b1f40 0x7fd37c0aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 -- 172.21.2.135:0/3002038043 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c00b1e0 con 0x7fd37c0b0030 2021-11-15T14:39:27.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37bfff700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 0x7fd37c0a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:39:27.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37b7fe700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fd37c06a170 tx=0x7fd36c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c0118a0 con 0x7fd37c0b0030 2021-11-15T14:39:27.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c011a00 con 0x7fd37c0b0030 2021-11-15T14:39:27.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c011d60 con 0x7fd37c0b0030 2021-11-15T14:39:27.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0aab00 con 0x7fd37c0b0030 2021-11-15T14:39:27.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c14b240 con 0x7fd37c0b0030 2021-11-15T14:39:27.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c14b400 con 0x7fd37c0b0030 2021-11-15T14:39:27.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd36c025030 con 0x7fd37c0b0030 2021-11-15T14:39:27.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 0x7fd360055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd36c06cc40 con 0x7fd37c0b0030 2021-11-15T14:39:27.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37bfff700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 0x7fd360055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.060+0000 7fd37bfff700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 0x7fd360055b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd364007000 tx=0x7fd364008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.064+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd36c043e10 con 0x7fd37c0b0030 2021-11-15T14:39:27.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.148+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd37c0b0c10 con 0x7fd37c0b0030 2021-11-15T14:39:27.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3797fa700 1 -- 172.21.2.135:0/3002038043 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd36c023020 con 0x7fd37c0b0030 2021-11-15T14:39:27.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 msgr2=0x7fd360055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 0x7fd360055b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd364007000 tx=0x7fd364008040).stop 2021-11-15T14:39:27.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 msgr2=0x7fd37c0ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fd37c06a170 tx=0x7fd36c015000).stop 2021-11-15T14:39:27.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 shutdown_connections 2021-11-15T14:39:27.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3600536d0 0x7fd360055b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd37c0b1f40 0x7fd37c0aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd37c0b0030 0x7fd37c0ab570 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 --2- 172.21.2.135:0/3002038043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd37c0a7140 0x7fd37c0a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.160+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 >> 172.21.2.135:0/3002038043 conn(0x7fd37c05f730 msgr2=0x7fd37c146440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.164+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 shutdown_connections 2021-11-15T14:39:27.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.164+0000 7fd3829a8700 1 -- 172.21.2.135:0/3002038043 wait complete. 2021-11-15T14:39:27.173 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:39:27.173 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:27.181 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:27.195 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:27.203 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:39:27.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:39:27.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:27.217 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:27.217 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:27.262 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:39:27.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:39:27.264 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:39:27.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:27.265 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:27.265 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:39:27.272 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:39:27.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:39:27.273 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:39:27.273 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:39:27.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 Processor -- start 2021-11-15T14:39:27.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 -- start start 2021-11-15T14:39:27.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f05300b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05300a7140 0x7f05301447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300b03d0 con 0x7f0530148420 2021-11-15T14:39:27.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05300a9140 con 0x7f05300a7140 2021-11-15T14:39:27.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f05349e6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05300b0670 con 0x7f05300b1e30 2021-11-15T14:39:27.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05300a7140 0x7f05301447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05300a7140 0x7f05301447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58316/0 (socket says 172.21.2.135:58316) 2021-11-15T14:39:27.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 -- 172.21.2.135:0/955194139 learned_addr learned my addr 172.21.2.135:0/955194139 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 -- 172.21.2.135:0/955194139 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 msgr2=0x7f05300b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:27.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 --2- 172.21.2.135:0/955194139 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f05300b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 -- 172.21.2.135:0/955194139 >> v1:172.21.2.119:6789/0 conn(0x7f0530148420 legacy=0x7f05300b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:27.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.340+0000 7f052ed9d700 1 -- 172.21.2.135:0/955194139 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300b0910 con 0x7f05300a7140 2021-11-15T14:39:27.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- 172.21.2.135:0/955194139 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05300a7140 0x7f05301447a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f0530061420 tx=0x7f0528009290).ready entity=mon.1 client_cookie=f8765adce2b92be1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052d59a700 1 -- 172.21.2.135:0/955194139 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052800b860 con 0x7f05300a7140 2021-11-15T14:39:27.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052d59a700 1 -- 172.21.2.135:0/955194139 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800b9c0 con 0x7f05300a7140 2021-11-15T14:39:27.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052d59a700 1 -- 172.21.2.135:0/955194139 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052800bb70 con 0x7f05300a7140 2021-11-15T14:39:27.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/955194139 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05300a7140 msgr2=0x7f05301447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- 172.21.2.135:0/955194139 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05300a7140 0x7f05301447a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f0530061420 tx=0x7f0528009290).stop 2021-11-15T14:39:27.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/955194139 shutdown_connections 2021-11-15T14:39:27.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- 172.21.2.135:0/955194139 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05300a7140 0x7f05301447a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- 172.21.2.135:0/955194139 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f05300b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/955194139 >> 172.21.2.135:0/955194139 conn(0x7f053005f730 msgr2=0x7f053005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/955194139 shutdown_connections 2021-11-15T14:39:27.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/955194139 wait complete. 2021-11-15T14:39:27.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 Processor -- start 2021-11-15T14:39:27.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- start start 2021-11-15T14:39:27.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05300a7140 0x7f053015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f0530140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053014c9f0 con 0x7f05300a7140 2021-11-15T14:39:27.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053014c210 con 0x7f0530148420 2021-11-15T14:39:27.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053014c4b0 con 0x7f05300b1e30 2021-11-15T14:39:27.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58324/0 (socket says 172.21.2.135:58324) 2021-11-15T14:39:27.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 -- 172.21.2.135:0/815776958 learned_addr learned my addr 172.21.2.135:0/815776958 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 -- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 msgr2=0x7f0530140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f0530140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 -- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05300a7140 msgr2=0x7f053015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05300a7140 0x7f053015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 -- 172.21.2.135:0/815776958 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009530 con 0x7f0530148420 2021-11-15T14:39:27.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f052ed9d700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0530061420 tx=0x7f0528016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0528021630 con 0x7f0530148420 2021-11-15T14:39:27.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528021790 con 0x7f0530148420 2021-11-15T14:39:27.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053014c750 con 0x7f0530148420 2021-11-15T14:39:27.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0528021af0 con 0x7f0530148420 2021-11-15T14:39:27.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530140a20 con 0x7f0530148420 2021-11-15T14:39:27.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.344+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05300b3960 con 0x7f0530148420 2021-11-15T14:39:27.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0528027020 con 0x7f0530148420 2021-11-15T14:39:27.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f05277fe700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 0x7f0514055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f052806d300 con 0x7f0530148420 2021-11-15T14:39:27.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f052e59c700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 0x7f0514055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f052e59c700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 0x7f0514055a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0518002fb0 tx=0x7f05180069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.348+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05280444d0 con 0x7f0530148420 2021-11-15T14:39:27.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f05300573d0 con 0x7f0530148420 2021-11-15T14:39:27.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05277fe700 1 -- 172.21.2.135:0/815776958 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v61) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f0528015020 con 0x7f0530148420 2021-11-15T14:39:27.436 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:27.436 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:39:27.437 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 61, 2021-11-15T14:39:27.437 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:39:27.437 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:39:27.437 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:39:24.968977+0000", 2021-11-15T14:39:27.438 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:39:27.438 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:39:27.438 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:39:27.438 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:39:27.438 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:39:27.439 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:39:27.439 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:39:27.439 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:39:27.439 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:39:27.439 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:27.440 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:39:27.440 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:39:27.440 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:39:27.440 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:39:27.441 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:39:27.441 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 10, 2021-11-15T14:39:27.441 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:39:27.441 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:39:27.441 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:39:27.442 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:39:27.442 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:39:27.442 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.442 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:39:27.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:39:27.443 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:39:27.443 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:27.443 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:27.443 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:27.444 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:27.444 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:27.444 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:27.444 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:27.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:27.445 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:39:27.445 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:39:27.445 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:39:27.445 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:39:27.445 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:39:27.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:27.446 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:27.446 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:27.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:27.447 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:27.447 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:27.447 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:27.447 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.447 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:39:27.448 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:27.448 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:27.448 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:27.448 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:27.448 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:27.449 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:27.449 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:27.449 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:27.449 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:27.450 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:27.450 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:27.450 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:27.450 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:27.450 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:27.451 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:27.451 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:27.451 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:27.451 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:27.452 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:27.452 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:27.452 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:27.452 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:27.452 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:27.453 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:27.453 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:27.453 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:27.453 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.453 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:27.454 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:27.454 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:27.454 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:27.454 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:27.455 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:27.455 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:27.455 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:27.455 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:27.455 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:27.456 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:27.456 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:39:27.456 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:39:27.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.456 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:27.457 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:39:27.457 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.457 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.457 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.457 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:39:27.458 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:39:27.458 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:39:27.458 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:39:27.458 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:39:27.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:39:27.459 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:39:27.459 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:39:27.459 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:39:27.459 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:39:27.460 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:39:27.460 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:39:27.460 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:39:27.460 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:39:27.460 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:39:27.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:39:27.461 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:39:27.461 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:39:27.461 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:39:27.461 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:39:27.462 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:39:27.462 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:39:27.462 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:39:27.462 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.462 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:39:27.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:39:27.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:39:27.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:39:27.463 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:39:27.464 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:39:27.464 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:39:27.464 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:39:27.464 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:39:27.464 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:39:27.465 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:39:27.465 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:39:27.465 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:39:27.465 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:39:27.465 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:39:27.466 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:39:27.466 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:39:27.466 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:39:27.467 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:39:27.467 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:39:27.467 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:39:27.467 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:39:27.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:39:27.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:39:27.468 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:39:27.468 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:39:27.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:39:27.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.469 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:39:27.469 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:39:27.469 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:39:27.470 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:39:27.470 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:39:27.470 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:39:27.470 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:39:27.470 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:39:27.471 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:39:27.471 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:39:27.471 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:39:27.471 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:39:27.472 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:39:27.472 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:39:27.472 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.473 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.473 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:27.473 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:39:27.473 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.473 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:39:27.474 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:39:27.474 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.474 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.474 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.475 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.475 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.475 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:27.476 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.476 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.476 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.477 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:39:27.477 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.478 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.478 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.478 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:39:27.479 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.479 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.479 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.479 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.480 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:39:27.481 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.481 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.481 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:39:27.482 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.482 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.482 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.482 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.483 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:39:27.484 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.484 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.484 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:39:27.485 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.485 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.485 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.486 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.487 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.487 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:39:27.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.488 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.488 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:39:27.488 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:39:27.488 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.489 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.489 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:39:27.489 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:39:27.490 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:39:27.490 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:39:27.490 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.490 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.490 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.491 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.492 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:39:27.492 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:39:27.492 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.492 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.493 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.493 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.493 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.493 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.493 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.494 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 45, 2021-11-15T14:39:27.494 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.494 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.494 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.495 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:39:27.495 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.496 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.496 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:39:27.497 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.497 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.497 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.497 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.497 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.498 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.499 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:39:27.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.499 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:39:27.500 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.500 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.500 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.501 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.501 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:39:27.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:39:27.503 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.503 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.503 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.504 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.504 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.504 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.505 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.505 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:39:27.505 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.505 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.506 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.506 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:39:27.506 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:39:27.506 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.507 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.507 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:39:27.507 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:39:27.508 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:39:27.508 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:39:27.508 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.508 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.508 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.509 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.509 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.509 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:39:27.509 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:39:27.510 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.510 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.510 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.510 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.511 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.511 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.511 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.511 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:27.511 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.512 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.512 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.512 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.512 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.513 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:39:27.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.513 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.513 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.514 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.514 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:39:27.514 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.514 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.515 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.515 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.515 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.515 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.515 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.516 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:39:27.516 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.516 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.516 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.517 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:39:27.517 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.517 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.518 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.518 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.519 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:39:27.519 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.519 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.520 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.520 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:39:27.520 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.521 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.521 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.521 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.521 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.521 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.522 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.522 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:39:27.522 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.523 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.523 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.523 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.523 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:39:27.523 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:39:27.524 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.524 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.524 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.525 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:39:27.525 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:39:27.525 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:39:27.525 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:39:27.526 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.526 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.526 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.526 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.526 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.527 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.527 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:39:27.527 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:39:27.527 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.528 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.528 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.528 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.528 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.529 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.529 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.529 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 56, 2021-11-15T14:39:27.529 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.529 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.530 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.530 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.530 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:39:27.531 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.531 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.531 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.532 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:39:27.532 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.532 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.533 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.533 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.533 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.533 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.533 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.534 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.534 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:39:27.534 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.534 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.535 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.535 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:39:27.535 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.535 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.536 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.536 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.536 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.537 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.537 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.537 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:39:27.537 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.538 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.538 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.538 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:39:27.538 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.539 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.539 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.539 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.539 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.540 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.540 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.540 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.540 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:39:27.540 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.541 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.541 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.541 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.541 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:39:27.542 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:39:27.542 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.542 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.542 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.542 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:39:27.543 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:39:27.543 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:39:27.543 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:39:27.543 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.544 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.544 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.544 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.544 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.544 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.545 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:39:27.545 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:39:27.545 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.545 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.546 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.546 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.546 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.546 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.546 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.547 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 56, 2021-11-15T14:39:27.547 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.547 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.547 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.548 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.548 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.548 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.548 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:39:27.548 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.549 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.549 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.549 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:39:27.550 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.550 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.550 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.550 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.550 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.551 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.551 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.551 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.551 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:39:27.552 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.552 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.552 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.552 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.553 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:39:27.553 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.553 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.553 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.554 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.554 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.554 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.554 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:39:27.555 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.555 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.555 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.555 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.556 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:39:27.556 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.556 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.556 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.557 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.557 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.557 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.557 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.557 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.558 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:39:27.558 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.558 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.558 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.559 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.559 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:39:27.559 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:39:27.559 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.560 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.560 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.560 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:39:27.560 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:39:27.560 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:39:27.561 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:39:27.561 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.561 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.561 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.561 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.562 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.562 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.562 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:39:27.562 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:39:27.563 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.563 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.563 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.563 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.563 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.564 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.564 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.564 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 55, 2021-11-15T14:39:27.564 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.565 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.565 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.565 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.565 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.565 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.566 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:39:27.566 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.566 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.566 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.567 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:39:27.567 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.567 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.567 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.568 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.568 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.568 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.568 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.569 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.569 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:39:27.569 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.569 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.569 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.570 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.570 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:39:27.570 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.570 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.571 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.571 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.571 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.571 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.572 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.572 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.572 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:39:27.572 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.572 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.573 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.573 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.573 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:39:27.573 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.573 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.574 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.574 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.574 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.574 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.575 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.575 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.575 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:39:27.575 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.575 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.576 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.576 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.576 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:39:27.576 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:39:27.577 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.577 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.577 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.577 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:39:27.577 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:39:27.578 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:39:27.578 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:39:27.578 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.578 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.579 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.579 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.579 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.579 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.579 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:39:27.580 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:39:27.580 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.580 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.580 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.581 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.581 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.581 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.581 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.581 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 54, 2021-11-15T14:39:27.582 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.582 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.582 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.582 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.583 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.583 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.583 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:39:27.583 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.584 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.584 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.584 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:39:27.585 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.585 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.585 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.585 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.586 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.586 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.586 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.586 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.587 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:39:27.587 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.587 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.587 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.587 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:39:27.588 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.588 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.588 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.589 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.589 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.589 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.589 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.589 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.590 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:39:27.590 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.590 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.590 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.591 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.591 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:39:27.591 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.592 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.592 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.592 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.592 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.592 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.593 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.593 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.593 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:39:27.593 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.594 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.594 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.594 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.594 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:39:27.595 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:39:27.595 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.595 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.595 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.596 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:39:27.596 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:39:27.596 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:39:27.596 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:39:27.596 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.597 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.597 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.597 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.597 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.598 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.598 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:39:27.598 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:39:27.598 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:39:27.599 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:39:27.599 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:39:27.599 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:39:27.599 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:39:27.599 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:39:27.600 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:39:27.600 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 54, 2021-11-15T14:39:27.600 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:39:27.600 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:39:27.601 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:39:27.601 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.601 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.601 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.601 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:39:27.602 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.602 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.602 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.602 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.603 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:39:27.603 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.603 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.603 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.603 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.604 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:39:27.604 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.604 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.604 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.605 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:39:27.605 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.605 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.605 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.605 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.606 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:39:27.606 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.606 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.606 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.607 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.607 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:39:27.607 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.607 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.607 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.608 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:39:27.608 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.608 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.608 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.609 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.609 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:39:27.609 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.609 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.609 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.610 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.610 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:39:27.610 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:39:27.610 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.611 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:39:27.611 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:39:27.611 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.611 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.611 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.612 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:39:27.612 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:39:27.612 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:39:27.612 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.613 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.613 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.613 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:39:27.613 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:39:27.613 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:39:27.614 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:39:27.614 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:39:27.614 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:39:27.614 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:39:27.615 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:27.615 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.615 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:27.615 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:39:27.615 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.616 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:39:27.616 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.616 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.616 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.616 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.617 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.617 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:39:27.617 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.617 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.618 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.618 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:39:27.618 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.618 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.619 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.619 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.619 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.619 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:39:27.619 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.620 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.620 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.620 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:39:27.620 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.620 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.621 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.621 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.621 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.621 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:39:27.622 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.622 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.622 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.622 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:39:27.622 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.623 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.623 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.623 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.623 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.624 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:39:27.624 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.624 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.625 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.625 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:39:27.625 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.625 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.625 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.626 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.626 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.626 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:39:27.626 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.627 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.627 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.627 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:39:27.627 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.627 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.628 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.628 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.628 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.628 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:39:27.629 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.629 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.629 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.629 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:39:27.629 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.630 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.630 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.630 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.631 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.631 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:39:27.631 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.631 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.632 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:27.632 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:39:27.632 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:39:27.632 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:39:27.632 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:39:27.633 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:39:27.633 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:39:27.633 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:39:27.633 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:39:27.634 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.634 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:39:27.634 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:39:27.634 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:39:27.634 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:39:27.635 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:39:27.635 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:39:27.635 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/2231823287": "2021-11-16T14:39:21.857131+0000", 2021-11-15T14:39:27.635 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6833/2231823287": "2021-11-16T14:39:21.857131+0000" 2021-11-15T14:39:27.636 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.636 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:39:27.636 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:39:27.636 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:39:27.636 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:39:27.637 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:39:27.637 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:39:27.637 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:39:27.638 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:39:27.638 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:39:27.638 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:39:27.638 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:39:27.638 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:39:27.639 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.639 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:39:27.639 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:39:27.639 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:39:27.640 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:39:27.640 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:39:27.640 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:39:27.640 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:39:27.640 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:27.641 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:27.641 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:39:27.641 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:39:27.641 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:39:27.642 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:39:27.642 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:39:27.642 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:39:27.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 msgr2=0x7f0514055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 0x7f0514055a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0518002fb0 tx=0x7f05180069b0).stop 2021-11-15T14:39:27.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 msgr2=0x7f05300b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0530061420 tx=0x7f0528016000).stop 2021-11-15T14:39:27.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 shutdown_connections 2021-11-15T14:39:27.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05140535b0 0x7f0514055a70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0530148420 0x7f05300b5c50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05300b1e30 0x7f0530140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 --2- 172.21.2.135:0/815776958 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05300a7140 0x7f053015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 >> 172.21.2.135:0/815776958 conn(0x7f053005f730 msgr2=0x7f05300aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 shutdown_connections 2021-11-15T14:39:27.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.432+0000 7f05349e6700 1 -- 172.21.2.135:0/815776958 wait complete. 2021-11-15T14:39:27.648 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:27.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 Processor -- start 2021-11-15T14:39:27.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- start start 2021-11-15T14:39:27.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41e4066c90 0x7f41e40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e4064de0 con 0x7f41e4064a00 2021-11-15T14:39:27.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e41482c0 con 0x7f41e4066c90 2021-11-15T14:39:27.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e41473a0 con 0x7f41e40b47d0 2021-11-15T14:39:27.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41e4066c90 0x7f41e40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f41e4066c90 0x7f41e40b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58330/0 (socket says 172.21.2.135:58330) 2021-11-15T14:39:27.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 -- 172.21.2.135:0/1140389778 learned_addr learned my addr 172.21.2.135:0/1140389778 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 -- 172.21.2.135:0/1140389778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 msgr2=0x7f41e414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 --2- 172.21.2.135:0/1140389778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 -- 172.21.2.135:0/1140389778 >> v1:172.21.2.119:6789/0 conn(0x7f41e4064a00 legacy=0x7f41e4066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 -- 172.21.2.135:0/1140389778 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4147640 con 0x7f41e4066c90 2021-11-15T14:39:27.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41e9891700 1 --2- 172.21.2.135:0/1140389778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4066c90 0x7f41e40b3130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f41e40662a0 tx=0x7f41dc009290).ready entity=mon.1 client_cookie=da04af4d6b12c506 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41d3fff700 1 -- 172.21.2.135:0/1140389778 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41dc00b860 con 0x7f41e4066c90 2021-11-15T14:39:27.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41d3fff700 1 -- 172.21.2.135:0/1140389778 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00b9c0 con 0x7f41e4066c90 2021-11-15T14:39:27.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41d3fff700 1 -- 172.21.2.135:0/1140389778 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41dc00bb70 con 0x7f41e4066c90 2021-11-15T14:39:27.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- 172.21.2.135:0/1140389778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4066c90 msgr2=0x7f41e40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 --2- 172.21.2.135:0/1140389778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4066c90 0x7f41e40b3130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f41e40662a0 tx=0x7f41dc009290).stop 2021-11-15T14:39:27.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- 172.21.2.135:0/1140389778 shutdown_connections 2021-11-15T14:39:27.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 --2- 172.21.2.135:0/1140389778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4066c90 0x7f41e40b3130 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 --2- 172.21.2.135:0/1140389778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- 172.21.2.135:0/1140389778 >> 172.21.2.135:0/1140389778 conn(0x7f41e405f730 msgr2=0x7f41e405fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- 172.21.2.135:0/1140389778 shutdown_connections 2021-11-15T14:39:27.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- 172.21.2.135:0/1140389778 wait complete. 2021-11-15T14:39:27.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 Processor -- start 2021-11-15T14:39:27.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.700+0000 7f41ea092700 1 -- start start 2021-11-15T14:39:27.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41e4066c90 0x7f41e4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e4157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e41545c0 con 0x7f41e4066c90 2021-11-15T14:39:27.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e4157870 con 0x7f41e4064a00 2021-11-15T14:39:27.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40ac8a0 con 0x7f41e40b47d0 2021-11-15T14:39:27.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58334/0 (socket says 172.21.2.135:58334) 2021-11-15T14:39:27.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 -- 172.21.2.135:0/3936690825 learned_addr learned my addr 172.21.2.135:0/3936690825 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9891700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e4157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e888f700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41e4066c90 0x7f41e4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 -- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 msgr2=0x7f41e4157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e4157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 -- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41e4066c90 msgr2=0x7f41e4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41e4066c90 0x7f41e4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 -- 172.21.2.135:0/3936690825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009530 con 0x7f41e4064a00 2021-11-15T14:39:27.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e9090700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f41e0002ef0 tx=0x7f41e0006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e0009e80 con 0x7f41e4064a00 2021-11-15T14:39:27.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0012410 con 0x7f41e4064a00 2021-11-15T14:39:27.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e40b1390 con 0x7f41e4064a00 2021-11-15T14:39:27.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e0012770 con 0x7f41e4064a00 2021-11-15T14:39:27.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e40b18d0 con 0x7f41e4064a00 2021-11-15T14:39:27.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e41478e0 con 0x7f41e4064a00 2021-11-15T14:39:27.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f41e000f030 con 0x7f41e4064a00 2021-11-15T14:39:27.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 0x7f41c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f41e006b3f0 con 0x7f41e4064a00 2021-11-15T14:39:27.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e888f700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 0x7f41c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.704+0000 7f41e888f700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 0x7f41c4055b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f41d400c000 tx=0x7f41d4006e10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.708+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41e00426d0 con 0x7f41e4064a00 2021-11-15T14:39:27.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41e4069c80 con 0x7f41e4064a00 2021-11-15T14:39:27.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41d27fc700 1 -- 172.21.2.135:0/3936690825 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f41e0045cf0 con 0x7f41e4064a00 2021-11-15T14:39:27.822 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:27.822 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5827,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3571248650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3571248650},{"type":"v1","addr":"172.21.2.135:6835","nonce":3571248650}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-11-15T14:39:27.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 msgr2=0x7f41c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 0x7f41c4055b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f41d400c000 tx=0x7f41d4006e10).stop 2021-11-15T14:39:27.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 msgr2=0x7f41e414aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f41e0002ef0 tx=0x7f41e0006d50).stop 2021-11-15T14:39:27.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 shutdown_connections 2021-11-15T14:39:27.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f41c40536a0 0x7f41c4055b60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41e40b47d0 0x7f41e4157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41e4066c90 0x7f41e4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 --2- 172.21.2.135:0/3936690825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f41e4064a00 0x7f41e414aaf0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 >> 172.21.2.135:0/3936690825 conn(0x7f41e405f730 msgr2=0x7f41e40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 shutdown_connections 2021-11-15T14:39:27.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.816+0000 7f41ea092700 1 -- 172.21.2.135:0/3936690825 wait complete. 2021-11-15T14:39:27.826 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 28 2021-11-15T14:39:27.829 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:27.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 Processor -- start 2021-11-15T14:39:27.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- start start 2021-11-15T14:39:27.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0568148420 0x7f05680b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f05680a7140 0x7f05681447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05680b03d0 con 0x7f05680b1e30 2021-11-15T14:39:27.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05680a9140 con 0x7f05680a7140 2021-11-15T14:39:27.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05680b0670 con 0x7f0568148420 2021-11-15T14:39:27.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0568148420 0x7f05680b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0568148420 0x7f05680b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58346/0 (socket says 172.21.2.135:58346) 2021-11-15T14:39:27.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 -- 172.21.2.135:0/3798086304 learned_addr learned my addr 172.21.2.135:0/3798086304 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 -- 172.21.2.135:0/3798086304 >> v2:172.21.2.119:3300/0 conn(0x7f05680a7140 msgr2=0x7f05681447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 --2- 172.21.2.135:0/3798086304 >> v2:172.21.2.119:3300/0 conn(0x7f05680a7140 0x7f05681447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 -- 172.21.2.135:0/3798086304 >> v1:172.21.2.119:6789/0 conn(0x7f05680b1e30 legacy=0x7f05680b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:27.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 -- 172.21.2.135:0/3798086304 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680b0910 con 0x7f0568148420 2021-11-15T14:39:27.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056da66700 1 --2- 172.21.2.135:0/3798086304 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680b1050 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f05680acee0 tx=0x7f0564006eb0).ready entity=mon.1 client_cookie=4c7a30ee225d43d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056d265700 1 -- 172.21.2.135:0/3798086304 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056400d5c0 con 0x7f0568148420 2021-11-15T14:39:27.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056d265700 1 -- 172.21.2.135:0/3798086304 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564000e90 con 0x7f0568148420 2021-11-15T14:39:27.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f056d265700 1 -- 172.21.2.135:0/3798086304 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056400d950 con 0x7f0568148420 2021-11-15T14:39:27.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- 172.21.2.135:0/3798086304 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 msgr2=0x7f05680b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 --2- 172.21.2.135:0/3798086304 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680b1050 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f05680acee0 tx=0x7f0564006eb0).stop 2021-11-15T14:39:27.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- 172.21.2.135:0/3798086304 shutdown_connections 2021-11-15T14:39:27.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 --2- 172.21.2.135:0/3798086304 >> v2:172.21.2.119:3300/0 conn(0x7f05680a7140 0x7f05681447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 --2- 172.21.2.135:0/3798086304 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680b1050 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:27.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- 172.21.2.135:0/3798086304 >> 172.21.2.135:0/3798086304 conn(0x7f056805f730 msgr2=0x7f056805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:27.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- 172.21.2.135:0/3798086304 shutdown_connections 2021-11-15T14:39:27.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.880+0000 7f05704cb700 1 -- 172.21.2.135:0/3798086304 wait complete. 2021-11-15T14:39:27.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 Processor -- start 2021-11-15T14:39:27.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- start start 2021-11-15T14:39:27.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05680a7140 0x7f0568149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05680b1e30 0x7f05680adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568159f40 con 0x7f05680b1e30 2021-11-15T14:39:27.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056815a170 con 0x7f0568148420 2021-11-15T14:39:27.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056815a410 con 0x7f05680a7140 2021-11-15T14:39:27.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58352/0 (socket says 172.21.2.135:58352) 2021-11-15T14:39:27.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 -- 172.21.2.135:0/2559042354 learned_addr learned my addr 172.21.2.135:0/2559042354 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:27.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 -- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05680a7140 msgr2=0x7f0568149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05680a7140 0x7f0568149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 -- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05680b1e30 msgr2=0x7f05680adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:27.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05680b1e30 0x7f05680adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:27.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 -- 172.21.2.135:0/2559042354 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056400b1e0 con 0x7f0568148420 2021-11-15T14:39:27.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f056ea68700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f05680a9a00 tx=0x7f0560009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056000d580 con 0x7f0568148420 2021-11-15T14:39:27.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000d6e0 con 0x7f0568148420 2021-11-15T14:39:27.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056815a6b0 con 0x7f0568148420 2021-11-15T14:39:27.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056000da40 con 0x7f0568148420 2021-11-15T14:39:27.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05680a94c0 con 0x7f0568148420 2021-11-15T14:39:27.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056815a840 con 0x7f0568148420 2021-11-15T14:39:27.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f056000dba0 con 0x7f0568148420 2021-11-15T14:39:27.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 0x7f0548055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:27.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.884+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f056006bb30 con 0x7f0568148420 2021-11-15T14:39:27.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.888+0000 7f056e267700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 0x7f0548055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:27.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.888+0000 7f056e267700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 0x7f0548055ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f055c002f90 tx=0x7f055c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:27.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.888+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0560042e10 con 0x7f0568148420 2021-11-15T14:39:28.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.996+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05680b0bb0 con 0x7f0568148420 2021-11-15T14:39:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:27.996+0000 7f055b7fe700 1 -- 172.21.2.135:0/2559042354 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f0560046430 con 0x7f0568148420 2021-11-15T14:39:28.002 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:28.002 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4484,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/4049129863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4049129863},{"type":"v1","addr":"172.21.2.119:6835","nonce":4049129863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/3425830052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3425830052},{"type":"v1","addr":"172.21.2.135:6834","nonce":3425830052}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5827,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3571248650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3571248650},{"type":"v1","addr":"172.21.2.135:6835","nonce":3571248650}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-11-15T14:39:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 msgr2=0x7f0548055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 0x7f0548055ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f055c002f90 tx=0x7f055c0069b0).stop 2021-11-15T14:39:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 msgr2=0x7f05680ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f05680a9a00 tx=0x7f0560009220).stop 2021-11-15T14:39:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 shutdown_connections 2021-11-15T14:39:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0548053610 0x7f0548055ad0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0568148420 0x7f05680ae3a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05680b1e30 0x7f05680adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 --2- 172.21.2.135:0/2559042354 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05680a7140 0x7f0568149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 >> 172.21.2.135:0/2559042354 conn(0x7f056805f730 msgr2=0x7f05681477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:28.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 shutdown_connections 2021-11-15T14:39:28.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.000+0000 7f05704cb700 1 -- 172.21.2.135:0/2559042354 wait complete. 2021-11-15T14:39:28.006 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 28 2021-11-15T14:39:28.009 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:39:28.010 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:39:28.010 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:39:28.010 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:39:28.011 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:39:28.011 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:39:28.011 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:39:28.011 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:39:28.012 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:39:28.012 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:39:28.012 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:39:28.013 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:39:28.018 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:39:28.019 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:39:28.021 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:39:28.021 DEBUG:teuthology.parallel:result is None 2021-11-15T14:39:28.023 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:39:28.023 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:39:28.024 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:39:28.024 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:39:28.026 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:39:28.026 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:39:28.027 DEBUG:teuthology.parallel:result is None 2021-11-15T14:39:28.027 DEBUG:teuthology.parallel:result is None 2021-11-15T14:39:28.028 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:39:28.055 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:39:28.059 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:39:28.060 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:39:28.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 Processor -- start 2021-11-15T14:39:28.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 -- start start 2021-11-15T14:39:28.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc2000acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc2000aa650 0x7fc20013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2000b6d60 con 0x7fc200060990 2021-11-15T14:39:28.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc200061260 con 0x7fc2000aa650 2021-11-15T14:39:28.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc206bc3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200061500 con 0x7fc2000b6980 2021-11-15T14:39:28.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1fffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc200060990 0x7fc2000a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:45984/0 (socket says 172.21.2.135:45984) 2021-11-15T14:39:28.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1fffff700 1 -- 172.21.2.135:0/3716131263 learned_addr learned my addr 172.21.2.135:0/3716131263 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:28.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115956535 0 0) 0x7fc2000b6d60 con 0x7fc200060990 2021-11-15T14:39:28.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e0003260 con 0x7fc200060990 2021-11-15T14:39:28.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc205160700 1 --2- 172.21.2.135:0/3716131263 >> v2:172.21.2.119:3300/0 conn(0x7fc2000aa650 0x7fc20013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc20495f700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc2000acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4045776333 0 0) 0x7fc1e0003260 con 0x7fc200060990 2021-11-15T14:39:28.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 msgr2=0x7fc2000acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:28.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc2000acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 >> v2:172.21.2.119:3300/0 conn(0x7fc2000aa650 msgr2=0x7fc20013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:28.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 --2- 172.21.2.135:0/3716131263 >> v2:172.21.2.119:3300/0 conn(0x7fc2000aa650 0x7fc20013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000617a0 con 0x7fc200060990 2021-11-15T14:39:28.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc1f0001680 con 0x7fc200060990 2021-11-15T14:39:28.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc205160700 1 --2- 172.21.2.135:0/3716131263 >> v2:172.21.2.119:3300/0 conn(0x7fc2000aa650 0x7fc20013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:39:28.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 >> v1:172.21.2.135:6789/0 conn(0x7fc200060990 legacy=0x7fc2000a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1e00037d0 0x7fc1e0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1e0004500 0x7fc1e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc1e0004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200061260 con 0x7fc1e00037d0 2021-11-15T14:39:28.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200061500 con 0x7fc1e0004500 2021-11-15T14:39:28.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c9e0 con 0x7fc2000b6980 2021-11-15T14:39:28.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1fffff700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1e0004500 0x7fc1e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc205160700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc1e0004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc20495f700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1e00037d0 0x7fc1e0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.076+0000 7fc1fffff700 1 -- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 msgr2=0x7fc1e0004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:28.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2000b6980 0x7fc1e0004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 -- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1e00037d0 msgr2=0x7fc1e0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:28.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1e00037d0 0x7fc1e0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 -- 172.21.2.135:0/3716131263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0003260 con 0x7fc1e0004500 2021-11-15T14:39:28.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1e0004500 0x7fc1e0004980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc1f0001390 tx=0x7fc2000ac010).ready entity=mon.1 client_cookie=934efd60007fc065 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:28.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f0007170 con 0x7fc1e0004500 2021-11-15T14:39:28.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f00072d0 con 0x7fc1e0004500 2021-11-15T14:39:28.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1ff7fe700 1 -- 172.21.2.135:0/3716131263 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f000c9c0 con 0x7fc1e0004500 2021-11-15T14:39:28.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/3716131263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1e0004500 msgr2=0x7fc1e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 --2- 172.21.2.135:0/3716131263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1e0004500 0x7fc1e0004980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc1f0001390 tx=0x7fc2000ac010).stop 2021-11-15T14:39:28.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 -- 172.21.2.135:0/3716131263 reap_dead start 2021-11-15T14:39:28.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/3716131263 shutdown_connections 2021-11-15T14:39:28.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/3716131263 >> 172.21.2.135:0/3716131263 conn(0x7fc2000b3500 msgr2=0x7fc2000b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:28.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/3716131263 shutdown_connections 2021-11-15T14:39:28.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/3716131263 wait complete. 2021-11-15T14:39:28.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 Processor -- start 2021-11-15T14:39:28.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- start start 2021-11-15T14:39:28.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1e0004500 0x7fc2001393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc200155f10 0x7fc200156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000aeb40 con 0x7fc200155f10 2021-11-15T14:39:28.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000adfd0 con 0x7fc20014f4b0 2021-11-15T14:39:28.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000ad400 con 0x7fc1e0004500 2021-11-15T14:39:28.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58408/0 (socket says 172.21.2.135:58408) 2021-11-15T14:39:28.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fffff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc200155f10 0x7fc200156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 -- 172.21.2.135:0/2118475902 learned_addr learned my addr 172.21.2.135:0/2118475902 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:28.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc20495f700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1e0004500 0x7fc2001393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 -- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1e0004500 msgr2=0x7fc2001393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1e0004500 0x7fc2001393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 -- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc200155f10 msgr2=0x7fc200156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:28.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc200155f10 0x7fc200156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:28.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 -- 172.21.2.135:0/2118475902 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000ad6a0 con 0x7fc20014f4b0 2021-11-15T14:39:28.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc205160700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc20013d020 tx=0x7fc1f8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:28.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f8018070 con 0x7fc20014f4b0 2021-11-15T14:39:28.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800c030 con 0x7fc20014f4b0 2021-11-15T14:39:28.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2001398d0 con 0x7fc20014f4b0 2021-11-15T14:39:28.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc200141ec0 con 0x7fc20014f4b0 2021-11-15T14:39:28.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1f8010ee0 con 0x7fc20014f4b0 2021-11-15T14:39:28.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8003410 con 0x7fc20014f4b0 2021-11-15T14:39:28.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1f8012040 con 0x7fc20014f4b0 2021-11-15T14:39:28.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 0x7fc1e4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:28.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc1f806b5c0 con 0x7fc20014f4b0 2021-11-15T14:39:28.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.080+0000 7fc20495f700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 0x7fc1e4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:28.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.084+0000 7fc20495f700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 0x7fc1e4055bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fc1e800c000 tx=0x7fc1e8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:28.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.084+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1f8042840 con 0x7fc20014f4b0 2021-11-15T14:39:28.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:28.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc1d8003c40 con 0x7fc20014f4b0 2021-11-15T14:39:29.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.172+0000 7fc1fdffb700 1 -- 172.21.2.135:0/2118475902 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc1f8045e60 con 0x7fc20014f4b0 2021-11-15T14:39:29.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 msgr2=0x7fc1e4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 0x7fc1e4055bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fc1e800c000 tx=0x7fc1e8008040).stop 2021-11-15T14:39:29.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 msgr2=0x7fc20014f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc20013d020 tx=0x7fc1f8008040).stop 2021-11-15T14:39:29.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 shutdown_connections 2021-11-15T14:39:29.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1e40536f0 0x7fc1e4055bb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc20014f4b0 0x7fc20014f930 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc200155f10 0x7fc200156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 --2- 172.21.2.135:0/2118475902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1e0004500 0x7fc2001393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 >> 172.21.2.135:0/2118475902 conn(0x7fc2000b3500 msgr2=0x7fc2000b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 shutdown_connections 2021-11-15T14:39:29.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.176+0000 7fc206bc3700 1 -- 172.21.2.135:0/2118475902 wait complete. 2021-11-15T14:39:29.183 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:39:29.192 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:39:29.193 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:39:29.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 Processor -- start 2021-11-15T14:39:29.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 -- start start 2021-11-15T14:39:29.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcaa0148420 0x7fcaa00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 0x7fcaa01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00b03d0 con 0x7fcaa00b1e30 2021-11-15T14:39:29.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00a9140 con 0x7fcaa0148420 2021-11-15T14:39:29.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fcaa6143700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b0670 con 0x7fcaa00a7140 2021-11-15T14:39:29.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcaa00b1e30 0x7fcaa00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46004/0 (socket says 172.21.2.135:46004) 2021-11-15T14:39:29.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9f7fe700 1 -- 172.21.2.135:0/3069263331 learned_addr learned my addr 172.21.2.135:0/3069263331 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:29.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415207802 0 0) 0x7fcaa00b03d0 con 0x7fcaa00b1e30 2021-11-15T14:39:29.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca80003260 con 0x7fcaa00b1e30 2021-11-15T14:39:29.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692896449 0 0) 0x7fca80003260 con 0x7fcaa00b1e30 2021-11-15T14:39:29.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 msgr2=0x7fcaa01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 0x7fcaa01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 >> v2:172.21.2.119:3300/0 conn(0x7fcaa0148420 msgr2=0x7fcaa00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 --2- 172.21.2.135:0/3069263331 >> v2:172.21.2.119:3300/0 conn(0x7fcaa0148420 0x7fcaa00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00b0910 con 0x7fcaa00b1e30 2021-11-15T14:39:29.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fca88001660 con 0x7fcaa00b1e30 2021-11-15T14:39:29.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 >> v1:172.21.2.135:6789/0 conn(0x7fcaa00b1e30 legacy=0x7fcaa00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca800037d0 0x7fca80003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca80004500 0x7fca80004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 0x7fca8000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b0670 con 0x7fca800037d0 2021-11-15T14:39:29.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80005280 con 0x7fca80004500 2021-11-15T14:39:29.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000bc40 con 0x7fcaa00a7140 2021-11-15T14:39:29.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca80004500 0x7fca80004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 -- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 msgr2=0x7fca8000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa00a7140 0x7fca8000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 -- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca800037d0 msgr2=0x7fca80003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca800037d0 0x7fca80003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.284+0000 7fca9effd700 1 -- 172.21.2.135:0/3069263331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80003260 con 0x7fca80004500 2021-11-15T14:39:29.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca80004500 0x7fca80004980 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fca90002f70 tx=0x7fca90006ca0).ready entity=mon.1 client_cookie=be2ef81502894557 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca90012410 con 0x7fca80004500 2021-11-15T14:39:29.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90012570 con 0x7fca80004500 2021-11-15T14:39:29.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9e7fc700 1 -- 172.21.2.135:0/3069263331 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca900128d0 con 0x7fca80004500 2021-11-15T14:39:29.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/3069263331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca80004500 msgr2=0x7fca80004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 --2- 172.21.2.135:0/3069263331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca80004500 0x7fca80004980 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fca90002f70 tx=0x7fca90006ca0).stop 2021-11-15T14:39:29.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9ffff700 1 -- 172.21.2.135:0/3069263331 reap_dead start 2021-11-15T14:39:29.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/3069263331 shutdown_connections 2021-11-15T14:39:29.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/3069263331 >> 172.21.2.135:0/3069263331 conn(0x7fcaa005f730 msgr2=0x7fcaa005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/3069263331 shutdown_connections 2021-11-15T14:39:29.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/3069263331 wait complete. 2021-11-15T14:39:29.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 Processor -- start 2021-11-15T14:39:29.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- start start 2021-11-15T14:39:29.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca80004500 0x7fcaa00ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa014a6a0 0x7fcaa014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0148d00 con 0x7fcaa014a6a0 2021-11-15T14:39:29.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0148fa0 con 0x7fcaa015a660 2021-11-15T14:39:29.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0149240 con 0x7fca80004500 2021-11-15T14:39:29.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58426/0 (socket says 172.21.2.135:58426) 2021-11-15T14:39:29.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 -- 172.21.2.135:0/1075746938 learned_addr learned my addr 172.21.2.135:0/1075746938 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 -- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca80004500 msgr2=0x7fcaa00ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca80004500 0x7fcaa00ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 -- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa014a6a0 msgr2=0x7fcaa014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa014a6a0 0x7fcaa014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 -- 172.21.2.135:0/1075746938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00b4680 con 0x7fcaa015a660 2021-11-15T14:39:29.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9effd700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fca90002f70 tx=0x7fca90015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca90012410 con 0x7fcaa015a660 2021-11-15T14:39:29.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90011e40 con 0x7fcaa015a660 2021-11-15T14:39:29.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa015afd0 con 0x7fcaa015a660 2021-11-15T14:39:29.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9001d610 con 0x7fcaa015a660 2021-11-15T14:39:29.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa014b010 con 0x7fcaa015a660 2021-11-15T14:39:29.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa00573d0 con 0x7fcaa015a660 2021-11-15T14:39:29.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.288+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca9000f030 con 0x7fcaa015a660 2021-11-15T14:39:29.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.292+0000 7fca9cff9700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 0x7fca84055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.292+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fca9006c410 con 0x7fcaa015a660 2021-11-15T14:39:29.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.292+0000 7fca9f7fe700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 0x7fca84055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.292+0000 7fca9f7fe700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 0x7fca84055b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fcaa01477b0 tx=0x7fcaa00b0aa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.292+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca90043880 con 0x7fcaa015a660 2021-11-15T14:39:29.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcaa00b53a0 con 0x7fcaa015a660 2021-11-15T14:39:29.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fca9cff9700 1 -- 172.21.2.135:0/1075746938 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fca90046e20 con 0x7fcaa015a660 2021-11-15T14:39:29.409 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:29.409 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:39:29.410 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:39:29.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.410 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:39:29.410 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:39:29.410 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.411 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:39:29.411 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.411 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.411 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.412 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.412 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.412 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:39:29.412 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:39:29.413 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.413 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:39:29.413 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.413 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.413 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.414 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.414 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:39:29.414 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:39:29.415 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.415 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:39:29.415 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.415 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.416 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.416 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.416 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.416 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:39:29.417 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:39:29.417 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.417 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.417 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.418 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.418 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.418 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.418 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:39:29.419 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:39:29.419 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.419 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.419 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.420 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.420 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.420 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.420 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:39:29.421 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:39:29.421 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.421 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.421 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.422 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.422 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.422 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.422 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:39:29.423 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:39:29.423 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.423 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.423 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.424 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.424 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.424 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.425 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:39:29.425 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:39:29.425 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.425 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.425 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.426 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.426 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.426 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.426 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:39:29.427 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:39:29.427 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.427 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.427 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.428 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.428 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.428 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.428 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:39:29.429 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:39:29.429 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.429 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.429 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.429 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.430 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.430 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.430 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.430 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:39:29.431 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:39:29.431 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.431 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.431 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.431 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.432 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.432 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.432 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.432 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:39:29.433 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:39:29.433 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.433 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:39:29.433 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:39:29.433 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:39:29.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.434 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.434 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.434 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:39:29.435 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:39:29.435 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.435 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:39:29.435 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:39:29.436 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:39:29.436 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.436 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.436 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:39:29.437 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:39:29.437 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.437 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:39:29.437 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:39:29.438 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:39:29.438 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.438 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.438 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.439 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.439 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:39:29.439 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:39:29.439 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.440 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:39:29.440 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:39:29.440 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.440 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:29.441 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:29.441 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:39:29.441 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:39:29.441 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:39:29.442 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:39:29.442 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:39:29.442 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:39:29.442 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.442 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:29.443 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:39:29.443 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:39:29.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 msgr2=0x7fca84055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 0x7fca84055b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fcaa01477b0 tx=0x7fcaa00b0aa0).stop 2021-11-15T14:39:29.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 msgr2=0x7fcaa015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fca90002f70 tx=0x7fca90015000).stop 2021-11-15T14:39:29.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 shutdown_connections 2021-11-15T14:39:29.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca840536a0 0x7fca84055b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa014a6a0 0x7fcaa014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa015a660 0x7fcaa015aae0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 --2- 172.21.2.135:0/1075746938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca80004500 0x7fcaa00ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 >> 172.21.2.135:0/1075746938 conn(0x7fcaa005f730 msgr2=0x7fcaa01477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 shutdown_connections 2021-11-15T14:39:29.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.404+0000 7fcaa6143700 1 -- 172.21.2.135:0/1075746938 wait complete. 2021-11-15T14:39:29.447 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:39:29.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 Processor -- start 2021-11-15T14:39:29.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- start start 2021-11-15T14:39:29.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1e14148420 0x7f1e140b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1e140a7140 0x7f1e141447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140b03d0 con 0x7f1e140b1e30 2021-11-15T14:39:29.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140a9140 con 0x7f1e14148420 2021-11-15T14:39:29.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140b0670 con 0x7f1e140a7140 2021-11-15T14:39:29.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e18a6b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f1e140b1e30 0x7f1e140b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46022/0 (socket says 172.21.2.135:46022) 2021-11-15T14:39:29.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e18a6b700 1 -- 172.21.2.135:0/2170712788 learned_addr learned my addr 172.21.2.135:0/2170712788 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:29.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 --2- 172.21.2.135:0/2170712788 >> v2:172.21.2.135:3300/0 conn(0x7f1e140a7140 0x7f1e141447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 -- 172.21.2.135:0/2170712788 >> v2:172.21.2.119:3300/0 conn(0x7f1e14148420 msgr2=0x7f1e140b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 --2- 172.21.2.135:0/2170712788 >> v2:172.21.2.119:3300/0 conn(0x7f1e14148420 0x7f1e140b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 -- 172.21.2.135:0/2170712788 >> v1:172.21.2.135:6789/0 conn(0x7f1e140b1e30 legacy=0x7f1e140b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 -- 172.21.2.135:0/2170712788 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140b0910 con 0x7f1e140a7140 2021-11-15T14:39:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1926c700 1 --2- 172.21.2.135:0/2170712788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e141447a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1e141477b0 tx=0x7f1e0c0091d0).ready entity=mon.1 client_cookie=c81fc06998a6f8c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e137fe700 1 -- 172.21.2.135:0/2170712788 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0c009ea0 con 0x7f1e140a7140 2021-11-15T14:39:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e137fe700 1 -- 172.21.2.135:0/2170712788 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00b860 con 0x7f1e140a7140 2021-11-15T14:39:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e137fe700 1 -- 172.21.2.135:0/2170712788 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0c00b9d0 con 0x7f1e140a7140 2021-11-15T14:39:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- 172.21.2.135:0/2170712788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 msgr2=0x7f1e141447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 --2- 172.21.2.135:0/2170712788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e141447a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1e141477b0 tx=0x7f1e0c0091d0).stop 2021-11-15T14:39:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- 172.21.2.135:0/2170712788 shutdown_connections 2021-11-15T14:39:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 --2- 172.21.2.135:0/2170712788 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e141447a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 --2- 172.21.2.135:0/2170712788 >> v2:172.21.2.119:3300/0 conn(0x7f1e14148420 0x7f1e140b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- 172.21.2.135:0/2170712788 >> 172.21.2.135:0/2170712788 conn(0x7f1e1405f730 msgr2=0x7f1e1405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- 172.21.2.135:0/2170712788 shutdown_connections 2021-11-15T14:39:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.496+0000 7f1e1accf700 1 -- 172.21.2.135:0/2170712788 wait complete. 2021-11-15T14:39:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 Processor -- start 2021-11-15T14:39:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- start start 2021-11-15T14:39:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1e140b1e30 0x7f1e14148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1e14148420 0x7f1e140ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140abd10 con 0x7f1e140b1e30 2021-11-15T14:39:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140ab7e0 con 0x7f1e140a7140 2021-11-15T14:39:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140aba70 con 0x7f1e14148420 2021-11-15T14:39:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58440/0 (socket says 172.21.2.135:58440) 2021-11-15T14:39:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 -- 172.21.2.135:0/77281342 learned_addr learned my addr 172.21.2.135:0/77281342 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 -- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1e14148420 msgr2=0x7f1e140ab2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1e14148420 0x7f1e140ab2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 -- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1e140b1e30 msgr2=0x7f1e14148f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1e140b1e30 0x7f1e14148f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 -- 172.21.2.135:0/77281342 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009470 con 0x7f1e140a7140 2021-11-15T14:39:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e18a6b700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f1e140acee0 tx=0x7f1dfc007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dfc00ce30 con 0x7f1e140a7140 2021-11-15T14:39:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc0072e0 con 0x7f1e140a7140 2021-11-15T14:39:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140ac020 con 0x7f1e140a7140 2021-11-15T14:39:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dfc005800 con 0x7f1e140a7140 2021-11-15T14:39:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1414a790 con 0x7f1e140a7140 2021-11-15T14:39:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140b0bb0 con 0x7f1e140a7140 2021-11-15T14:39:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dfc010070 con 0x7f1e140a7140 2021-11-15T14:39:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 0x7f1df8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f1dfc06ad70 con 0x7f1e140a7140 2021-11-15T14:39:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e13fff700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 0x7f1df8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.500+0000 7f1e13fff700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 0x7f1df8055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1e04002f70 tx=0x7f1e04006960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.504+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1dfc0420b0 con 0x7f1e140a7140 2021-11-15T14:39:29.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.584+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e140573d0 con 0x7f1e140a7140 2021-11-15T14:39:29.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e11ffb700 1 -- 172.21.2.135:0/77281342 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f1dfc0456d0 con 0x7f1e140a7140 2021-11-15T14:39:29.591 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:29.591 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":64,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:39:29.162927+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:39:29.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 msgr2=0x7f1df8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 0x7f1df8055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1e04002f70 tx=0x7f1e04006960).stop 2021-11-15T14:39:29.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 msgr2=0x7f1e140ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f1e140acee0 tx=0x7f1dfc007c00).stop 2021-11-15T14:39:29.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 shutdown_connections 2021-11-15T14:39:29.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1df8053640 0x7f1df8055b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1e14148420 0x7f1e140ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1e140b1e30 0x7f1e14148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 --2- 172.21.2.135:0/77281342 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1e140a7140 0x7f1e140ac760 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 >> 172.21.2.135:0/77281342 conn(0x7f1e1405f730 msgr2=0x7f1e140b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 shutdown_connections 2021-11-15T14:39:29.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.588+0000 7f1e1accf700 1 -- 172.21.2.135:0/77281342 wait complete. 2021-11-15T14:39:29.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:39:29.599 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:39:29.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 Processor -- start 2021-11-15T14:39:29.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- start start 2021-11-15T14:39:29.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31ac0b1350 0x7f31ac0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f31ac0b2320 0x7f31ac1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac0a7850 con 0x7f31ac0b1f40 2021-11-15T14:39:29.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac0b17c0 con 0x7f31ac0b2320 2021-11-15T14:39:29.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac0b06d0 con 0x7f31ac0b1350 2021-11-15T14:39:29.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31ac0b1350 0x7f31ac0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31ac0b1350 0x7f31ac0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58450/0 (socket says 172.21.2.135:58450) 2021-11-15T14:39:29.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 -- 172.21.2.135:0/3744130360 learned_addr learned my addr 172.21.2.135:0/3744130360 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 -- 172.21.2.135:0/3744130360 >> v2:172.21.2.119:3300/0 conn(0x7f31ac0b2320 msgr2=0x7f31ac1412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:29.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 --2- 172.21.2.135:0/3744130360 >> v2:172.21.2.119:3300/0 conn(0x7f31ac0b2320 0x7f31ac1412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 -- 172.21.2.135:0/3744130360 >> v1:172.21.2.119:6789/0 conn(0x7f31ac0b1f40 legacy=0x7f31ac0a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:29.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 -- 172.21.2.135:0/3744130360 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0b0970 con 0x7f31ac0b1350 2021-11-15T14:39:29.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b0ef6700 1 --2- 172.21.2.135:0/3744130360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b1350 0x7f31ac0b0030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f31ac0ad350 tx=0x7f319c006eb0).ready entity=mon.1 client_cookie=cf7bbdb3cbdb5759 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f319bfff700 1 -- 172.21.2.135:0/3744130360 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c00d5c0 con 0x7f31ac0b1350 2021-11-15T14:39:29.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f319bfff700 1 -- 172.21.2.135:0/3744130360 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c000e90 con 0x7f31ac0b1350 2021-11-15T14:39:29.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f319bfff700 1 -- 172.21.2.135:0/3744130360 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c00d910 con 0x7f31ac0b1350 2021-11-15T14:39:29.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- 172.21.2.135:0/3744130360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b1350 msgr2=0x7f31ac0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 --2- 172.21.2.135:0/3744130360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b1350 0x7f31ac0b0030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f31ac0ad350 tx=0x7f319c006eb0).stop 2021-11-15T14:39:29.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- 172.21.2.135:0/3744130360 shutdown_connections 2021-11-15T14:39:29.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 --2- 172.21.2.135:0/3744130360 >> v2:172.21.2.119:3300/0 conn(0x7f31ac0b2320 0x7f31ac1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 --2- 172.21.2.135:0/3744130360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b1350 0x7f31ac0b0030 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- 172.21.2.135:0/3744130360 >> 172.21.2.135:0/3744130360 conn(0x7f31ac05f730 msgr2=0x7f31ac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- 172.21.2.135:0/3744130360 shutdown_connections 2021-11-15T14:39:29.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 -- 172.21.2.135:0/3744130360 wait complete. 2021-11-15T14:39:29.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.648+0000 7f31b395b700 1 Processor -- start 2021-11-15T14:39:29.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- start start 2021-11-15T14:39:29.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31ac0b1350 0x7f31ac157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31ac0b1f40 0x7f31ac0a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0a9630 con 0x7f31ac0b1f40 2021-11-15T14:39:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac143ee0 con 0x7f31ac0b2320 2021-11-15T14:39:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac143660 con 0x7f31ac0b1350 2021-11-15T14:39:29.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58458/0 (socket says 172.21.2.135:58458) 2021-11-15T14:39:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 -- 172.21.2.135:0/1507687998 learned_addr learned my addr 172.21.2.135:0/1507687998 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 -- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31ac0b1350 msgr2=0x7f31ac157790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:29.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31ac0b1350 0x7f31ac157790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 -- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31ac0b1f40 msgr2=0x7f31ac0a9b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:29.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31ac0b1f40 0x7f31ac0a9b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 -- 172.21.2.135:0/1507687998 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c00b1e0 con 0x7f31ac0b2320 2021-11-15T14:39:29.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b1ef8700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f31a4001250 tx=0x7f31a40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a40014e0 con 0x7f31ac0b2320 2021-11-15T14:39:29.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4001640 con 0x7f31ac0b2320 2021-11-15T14:39:29.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac143900 con 0x7f31ac0b2320 2021-11-15T14:39:29.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac157c80 con 0x7f31ac0b2320 2021-11-15T14:39:29.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a40019a0 con 0x7f31ac0b2320 2021-11-15T14:39:29.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3188003410 con 0x7f31ac0b2320 2021-11-15T14:39:29.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31a4018030 con 0x7f31ac0b2320 2021-11-15T14:39:29.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 0x7f318c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f31a406b110 con 0x7f31ac0b2320 2021-11-15T14:39:29.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.652+0000 7f31b16f7700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 0x7f318c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.656+0000 7f31b16f7700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 0x7f318c055b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f31a8002fb0 tx=0x7f31a8006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.656+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31a4042390 con 0x7f31ac0b2320 2021-11-15T14:39:29.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3188003c40 con 0x7f31ac0b2320 2021-11-15T14:39:29.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f319a7fc700 1 -- 172.21.2.135:0/1507687998 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f31a40459b0 con 0x7f31ac0b2320 2021-11-15T14:39:29.743 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:39:29.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 msgr2=0x7f318c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 0x7f318c055b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f31a8002fb0 tx=0x7f31a8006930).stop 2021-11-15T14:39:29.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 msgr2=0x7f31ac0abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f31a4001250 tx=0x7f31a40090f0).stop 2021-11-15T14:39:29.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 shutdown_connections 2021-11-15T14:39:29.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f318c053690 0x7f318c055b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31ac0b2320 0x7f31ac0abb00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31ac0b1f40 0x7f31ac0a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 --2- 172.21.2.135:0/1507687998 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31ac0b1350 0x7f31ac157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 >> 172.21.2.135:0/1507687998 conn(0x7f31ac05f730 msgr2=0x7f31ac0a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 shutdown_connections 2021-11-15T14:39:29.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.740+0000 7f31b395b700 1 -- 172.21.2.135:0/1507687998 wait complete. 2021-11-15T14:39:29.750 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:39:29.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 Processor -- start 2021-11-15T14:39:29.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 -- start start 2021-11-15T14:39:29.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7f700b2320 0x7f7f701412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700a7850 con 0x7f7f700b0030 2021-11-15T14:39:29.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700b0470 con 0x7f7f700b2320 2021-11-15T14:39:29.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f7536e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700b06d0 con 0x7f7f700b1f40 2021-11-15T14:39:29.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:40006/0 (socket says 172.21.2.135:40006) 2021-11-15T14:39:29.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 -- 172.21.2.135:0/794707214 learned_addr learned my addr 172.21.2.135:0/794707214 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6f7fe700 1 --2- 172.21.2.135:0/794707214 >> v2:172.21.2.119:3300/0 conn(0x7f7f700b2320 0x7f7f701412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 -- 172.21.2.135:0/794707214 >> v2:172.21.2.119:3300/0 conn(0x7f7f700b2320 msgr2=0x7f7f701412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 --2- 172.21.2.135:0/794707214 >> v2:172.21.2.119:3300/0 conn(0x7f7f700b2320 0x7f7f701412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 -- 172.21.2.135:0/794707214 >> v1:172.21.2.119:6789/0 conn(0x7f7f700b0030 legacy=0x7f7f700a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.800+0000 7f7f6effd700 1 -- 172.21.2.135:0/794707214 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700b0970 con 0x7f7f700b1f40 2021-11-15T14:39:29.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6effd700 1 --2- 172.21.2.135:0/794707214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f60002f70 tx=0x7f7f60006eb0).ready entity=mon.2 client_cookie=1fd8c76e22b793c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6dffb700 1 -- 172.21.2.135:0/794707214 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f6000d570 con 0x7f7f700b1f40 2021-11-15T14:39:29.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6dffb700 1 -- 172.21.2.135:0/794707214 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60000e90 con 0x7f7f700b1f40 2021-11-15T14:39:29.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6dffb700 1 -- 172.21.2.135:0/794707214 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f6000d900 con 0x7f7f700b1f40 2021-11-15T14:39:29.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/794707214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 msgr2=0x7f7f700b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- 172.21.2.135:0/794707214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7f60002f70 tx=0x7f7f60006eb0).stop 2021-11-15T14:39:29.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/794707214 shutdown_connections 2021-11-15T14:39:29.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- 172.21.2.135:0/794707214 >> v2:172.21.2.119:3300/0 conn(0x7f7f700b2320 0x7f7f701412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- 172.21.2.135:0/794707214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f700b1350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/794707214 >> 172.21.2.135:0/794707214 conn(0x7f7f7005f730 msgr2=0x7f7f7005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/794707214 shutdown_connections 2021-11-15T14:39:29.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/794707214 wait complete. 2021-11-15T14:39:29.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 Processor -- start 2021-11-15T14:39:29.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- start start 2021-11-15T14:39:29.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f700b0030 0x7f7f700b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f7015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700abd90 con 0x7f7f700b0030 2021-11-15T14:39:29.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700b4430 con 0x7f7f700b2320 2021-11-15T14:39:29.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70149460 con 0x7f7f700b1f40 2021-11-15T14:39:29.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58470/0 (socket says 172.21.2.135:58470) 2021-11-15T14:39:29.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 -- 172.21.2.135:0/1947150727 learned_addr learned my addr 172.21.2.135:0/1947150727 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 -- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 msgr2=0x7f7f7015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f7015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 -- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f700b0030 msgr2=0x7f7f700b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f700b0030 0x7f7f700b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 -- 172.21.2.135:0/1947150727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6000b1e0 con 0x7f7f700b2320 2021-11-15T14:39:29.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f6f7fe700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f7f68006e00 tx=0x7f7f680091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f6800c7f0 con 0x7f7f700b2320 2021-11-15T14:39:29.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800c950 con 0x7f7f700b2320 2021-11-15T14:39:29.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f6800ccb0 con 0x7f7f700b2320 2021-11-15T14:39:29.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700ab650 con 0x7f7f700b2320 2021-11-15T14:39:29.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.804+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f70146da0 con 0x7f7f700b2320 2021-11-15T14:39:29.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700573d0 con 0x7f7f700b2320 2021-11-15T14:39:29.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f68022070 con 0x7f7f700b2320 2021-11-15T14:39:29.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f67fff700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 0x7f7f540559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f7f6806bf50 con 0x7f7f700b2320 2021-11-15T14:39:29.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f6effd700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 0x7f7f540559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f6effd700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 0x7f7f540559e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7f60002f70 tx=0x7f7f60015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.808+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f68043180 con 0x7f7f700b2320 2021-11-15T14:39:29.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f700ac7e0 con 0x7f7f700b2320 2021-11-15T14:39:29.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f67fff700 1 -- 172.21.2.135:0/1947150727 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7f680467a0 con 0x7f7f700b2320 2021-11-15T14:39:29.897 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:39:29.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 msgr2=0x7f7f540559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 0x7f7f540559e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7f60002f70 tx=0x7f7f60015000).stop 2021-11-15T14:39:29.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 msgr2=0x7f7f7015a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f7f68006e00 tx=0x7f7f680091d0).stop 2021-11-15T14:39:29.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 shutdown_connections 2021-11-15T14:39:29.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f54053520 0x7f7f540559e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f700b2320 0x7f7f7015a850 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f700b1f40 0x7f7f7015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 --2- 172.21.2.135:0/1947150727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f700b0030 0x7f7f700b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 >> 172.21.2.135:0/1947150727 conn(0x7f7f7005f730 msgr2=0x7f7f700af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 shutdown_connections 2021-11-15T14:39:29.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.892+0000 7f7f7536e700 1 -- 172.21.2.135:0/1947150727 wait complete. 2021-11-15T14:39:29.905 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:39:29.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 Processor -- start 2021-11-15T14:39:29.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 -- start start 2021-11-15T14:39:29.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f25a4148420 0x7f25a40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a40b03d0 con 0x7f25a40b1e30 2021-11-15T14:39:29.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a40a9140 con 0x7f25a4148420 2021-11-15T14:39:29.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25aa7b0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40b0670 con 0x7f25a40a7140 2021-11-15T14:39:29.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a8d4d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f25a4148420 0x7f25a40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f25a4148420 0x7f25a40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:52292/0 (socket says 172.21.2.135:52292) 2021-11-15T14:39:29.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 -- 172.21.2.135:0/3049567444 learned_addr learned my addr 172.21.2.135:0/3049567444 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 -- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 msgr2=0x7f25a41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:29.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 --2- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a41447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 -- 172.21.2.135:0/3049567444 >> v1:172.21.2.119:6789/0 conn(0x7f25a40b1e30 legacy=0x7f25a40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 -- 172.21.2.135:0/3049567444 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40b0910 con 0x7f25a4148420 2021-11-15T14:39:29.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.952+0000 7f25a37fe700 1 --2- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a4148420 0x7f25a40b1050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f25a41477b0 tx=0x7f2594006eb0).ready entity=mon.0 client_cookie=abb3cbdea351595 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a2ffd700 1 -- 172.21.2.135:0/3049567444 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259400d5c0 con 0x7f25a4148420 2021-11-15T14:39:29.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a2ffd700 1 -- 172.21.2.135:0/3049567444 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594000e90 con 0x7f25a4148420 2021-11-15T14:39:29.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a2ffd700 1 -- 172.21.2.135:0/3049567444 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259400d950 con 0x7f25a4148420 2021-11-15T14:39:29.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a4148420 msgr2=0x7f25a40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a4148420 0x7f25a40b1050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f25a41477b0 tx=0x7f2594006eb0).stop 2021-11-15T14:39:29.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3049567444 shutdown_connections 2021-11-15T14:39:29.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3049567444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a4148420 0x7f25a40b1050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:29.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3049567444 >> 172.21.2.135:0/3049567444 conn(0x7f25a405f730 msgr2=0x7f25a405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:29.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3049567444 shutdown_connections 2021-11-15T14:39:29.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3049567444 wait complete. 2021-11-15T14:39:29.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 Processor -- start 2021-11-15T14:39:29.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- start start 2021-11-15T14:39:29.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a40a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a40b1e30 0x7f25a4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4157020 con 0x7f25a40b1e30 2021-11-15T14:39:29.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41572c0 con 0x7f25a4148420 2021-11-15T14:39:29.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4157560 con 0x7f25a40a7140 2021-11-15T14:39:29.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58486/0 (socket says 172.21.2.135:58486) 2021-11-15T14:39:29.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 -- 172.21.2.135:0/3747410757 learned_addr learned my addr 172.21.2.135:0/3747410757 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:29.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 -- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 msgr2=0x7f25a40a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a40a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 -- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a40b1e30 msgr2=0x7f25a4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:29.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a40b1e30 0x7f25a4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:29.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 -- 172.21.2.135:0/3747410757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259400b1e0 con 0x7f25a4148420 2021-11-15T14:39:29.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a8d4d700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f259c006e00 tx=0x7f259c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259c00c7f0 con 0x7f25a4148420 2021-11-15T14:39:29.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00c950 con 0x7f25a4148420 2021-11-15T14:39:29.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a41547b0 con 0x7f25a4148420 2021-11-15T14:39:29.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259c00ccb0 con 0x7f25a4148420 2021-11-15T14:39:29.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.956+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a40641d0 con 0x7f25a4148420 2021-11-15T14:39:29.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a40573d0 con 0x7f25a4148420 2021-11-15T14:39:29.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f259c022070 con 0x7f25a4148420 2021-11-15T14:39:29.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a17fa700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 0x7f2588055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:29.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f259c06bf40 con 0x7f25a4148420 2021-11-15T14:39:29.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a3fff700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 0x7f2588055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:29.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a3fff700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 0x7f2588055a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f25a40b31f0 tx=0x7f258c007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:29.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:29.960+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f259c043170 con 0x7f25a4148420 2021-11-15T14:39:30.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.044+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25a40446d0 con 0x7f25a4148420 2021-11-15T14:39:30.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.044+0000 7f25a17fa700 1 -- 172.21.2.135:0/3747410757 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+143 (secure 0 0 0) 0x7f259c016020 con 0x7f25a4148420 2021-11-15T14:39:30.050 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:30.051 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:39:30.051 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:30.051 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:39:30.051 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:39:30.052 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:39:30.052 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:39:30.052 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:39:30.052 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:39:30.052 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:39:30.053 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:39:30.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 msgr2=0x7f2588055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 0x7f2588055a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f25a40b31f0 tx=0x7f258c007810).stop 2021-11-15T14:39:30.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 msgr2=0x7f25a41542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f259c006e00 tx=0x7f259c0091d0).stop 2021-11-15T14:39:30.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 shutdown_connections 2021-11-15T14:39:30.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2588053580 0x7f2588055a40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:30.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25a4148420 0x7f25a41542c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:30.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25a40b1e30 0x7f25a4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 --2- 172.21.2.135:0/3747410757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25a40a7140 0x7f25a40a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 >> 172.21.2.135:0/3747410757 conn(0x7f25a405f730 msgr2=0x7f25a40af540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:30.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 shutdown_connections 2021-11-15T14:39:30.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.048+0000 7f25aa7b0700 1 -- 172.21.2.135:0/3747410757 wait complete. 2021-11-15T14:39:30.057 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:39:30.058 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:39:30.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 Processor -- start 2021-11-15T14:39:30.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 -- start start 2021-11-15T14:39:30.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 0x7ff8ac144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0b2430 con 0x7ff8ac0654a0 2021-11-15T14:39:30.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0b26d0 con 0x7ff8ac060040 2021-11-15T14:39:30.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b4687700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b2970 con 0x7ff8ac0b3950 2021-11-15T14:39:30.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b2423700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff8ac060040 0x7ff8ac064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46078/0 (socket says 172.21.2.135:46078) 2021-11-15T14:39:30.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b2423700 1 -- 172.21.2.135:0/2364728537 learned_addr learned my addr 172.21.2.135:0/2364728537 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:30.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121805619 0 0) 0x7ff8ac0b26d0 con 0x7ff8ac060040 2021-11-15T14:39:30.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff894003260 con 0x7ff8ac060040 2021-11-15T14:39:30.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b2c24700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 0x7ff8ac144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:30.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601660671 0 0) 0x7ff894003260 con 0x7ff8ac060040 2021-11-15T14:39:30.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 msgr2=0x7ff8ac144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:30.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 0x7ff8ac144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:30.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 >> v1:172.21.2.119:6789/0 conn(0x7ff8ac0654a0 legacy=0x7ff8ac1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0648f0 con 0x7ff8ac060040 2021-11-15T14:39:30.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff89c001660 con 0x7ff8ac060040 2021-11-15T14:39:30.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 >> v1:172.21.2.135:6789/0 conn(0x7ff8ac060040 legacy=0x7ff8ac064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 0x7ff894003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff894003d30 0x7ff894004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8940049f0 0x7ff894004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b2970 con 0x7ff8940049f0 2021-11-15T14:39:30.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89400b860 con 0x7ff894003d30 2021-11-15T14:39:30.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89400ba20 con 0x7ff8ac0b3950 2021-11-15T14:39:30.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff894003d30 0x7ff894004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:30.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 -- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 msgr2=0x7ff894003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:30.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0b3950 0x7ff894003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 -- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8940049f0 msgr2=0x7ff894004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:30.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8940049f0 0x7ff894004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.108+0000 7ff8b1c22700 1 -- 172.21.2.135:0/2364728537 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894003260 con 0x7ff894003d30 2021-11-15T14:39:30.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff894003d30 0x7ff894004500 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ff8ac05d4e0 tx=0x7ff8a8007a00).ready entity=mon.1 client_cookie=fb88eb5446041813 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:30.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a8007d10 con 0x7ff894003d30 2021-11-15T14:39:30.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8007030 con 0x7ff894003d30 2021-11-15T14:39:30.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1421700 1 -- 172.21.2.135:0/2364728537 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a8007390 con 0x7ff894003d30 2021-11-15T14:39:30.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/2364728537 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff894003d30 msgr2=0x7ff894004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 --2- 172.21.2.135:0/2364728537 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff894003d30 0x7ff894004500 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ff8ac05d4e0 tx=0x7ff8a8007a00).stop 2021-11-15T14:39:30.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b2c24700 1 -- 172.21.2.135:0/2364728537 reap_dead start 2021-11-15T14:39:30.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/2364728537 shutdown_connections 2021-11-15T14:39:30.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/2364728537 >> 172.21.2.135:0/2364728537 conn(0x7ff8ac05cfe0 msgr2=0x7ff8ac05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:30.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/2364728537 shutdown_connections 2021-11-15T14:39:30.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/2364728537 wait complete. 2021-11-15T14:39:30.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 Processor -- start 2021-11-15T14:39:30.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- start start 2021-11-15T14:39:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff894003d30 0x7ff8ac13cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0af610 0x7ff8ac15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac13b140 con 0x7ff894003d30 2021-11-15T14:39:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0afd30 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac13b330 con 0x7ff8ac0af610 2021-11-15T14:39:30.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:30.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58504/0 (socket says 172.21.2.135:58504) 2021-11-15T14:39:30.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 -- 172.21.2.135:0/920130737 learned_addr learned my addr 172.21.2.135:0/920130737 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 -- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0af610 msgr2=0x7ff8ac15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0af610 0x7ff8ac15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 -- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff894003d30 msgr2=0x7ff8ac13cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff894003d30 0x7ff8ac13cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 -- 172.21.2.135:0/920130737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac13b9d0 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b1c22700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7ff8ac05d4e0 tx=0x7ff8a8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a8020640 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80207a0 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a8020b00 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac0aec10 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac13d730 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac0674f0 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8a801d070 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 0x7ff88c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:30.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.112+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff8a806c4d0 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.116+0000 7ff8b2423700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 0x7ff88c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:30.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.116+0000 7ff8b2423700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 0x7ff88c055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff89c001370 tx=0x7ff8ac0b2860).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:30.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.116+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8a8043810 con 0x7ff8ac0b0b00 2021-11-15T14:39:30.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:30.200+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff8ac0573d0 con 0x7ff8ac0b0b00 2021-11-15T14:39:31.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.176+0000 7ff89b7fe700 1 -- 172.21.2.135:0/920130737 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v65) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff8a8025030 con 0x7ff8ac0b0b00 2021-11-15T14:39:31.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 msgr2=0x7ff88c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 0x7ff88c055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff89c001370 tx=0x7ff8ac0b2860).stop 2021-11-15T14:39:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 msgr2=0x7ff8ac15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7ff8ac05d4e0 tx=0x7ff8a8015000).stop 2021-11-15T14:39:31.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 shutdown_connections 2021-11-15T14:39:31.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff88c053640 0x7ff88c055b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:31.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ac0af610 0x7ff8ac15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:31.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ac0b0b00 0x7ff8ac15a540 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:31.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 --2- 172.21.2.135:0/920130737 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff894003d30 0x7ff8ac13cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:31.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 >> 172.21.2.135:0/920130737 conn(0x7ff8ac05cfe0 msgr2=0x7ff8ac142d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:31.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 shutdown_connections 2021-11-15T14:39:31.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.180+0000 7ff8b4687700 1 -- 172.21.2.135:0/920130737 wait complete. 2021-11-15T14:39:31.187 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:39:31.191 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:39:31.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 Processor -- start 2021-11-15T14:39:31.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 -- start start 2021-11-15T14:39:31.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 0x7fea5c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0b5fc0 con 0x7fea5c0ad0c0 2021-11-15T14:39:31.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0ad4a0 con 0x7fea5c0afb70 2021-11-15T14:39:31.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0aebe0 con 0x7fea5c13ca40 2021-11-15T14:39:31.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fea5c0afb70 0x7fea5c13f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46098/0 (socket says 172.21.2.135:46098) 2021-11-15T14:39:31.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 -- 172.21.2.135:0/3918859671 learned_addr learned my addr 172.21.2.135:0/3918859671 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:31.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea60838700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 0x7fea5c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:31.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051134320 0 0) 0x7fea5c0ad4a0 con 0x7fea5c0afb70 2021-11-15T14:39:31.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea44003260 con 0x7fea5c0afb70 2021-11-15T14:39:31.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155641436 0 0) 0x7fea44003260 con 0x7fea5c0afb70 2021-11-15T14:39:31.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 msgr2=0x7fea5c0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:31.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 0x7fea5c0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:31.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 >> v1:172.21.2.119:6789/0 conn(0x7fea5c0ad0c0 legacy=0x7fea5c13c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0aee80 con 0x7fea5c0afb70 2021-11-15T14:39:31.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fea540019e0 con 0x7fea5c0afb70 2021-11-15T14:39:31.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 >> v1:172.21.2.135:6789/0 conn(0x7fea5c0afb70 legacy=0x7fea5c13f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 0x7fea44003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea44003c80 0x7fea44004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea440049f0 0x7fea44004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0aebe0 con 0x7fea44003c80 2021-11-15T14:39:31.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4400c8c0 con 0x7fea440049f0 2021-11-15T14:39:31.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea440057a0 con 0x7fea5c13ca40 2021-11-15T14:39:31.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea440049f0 0x7fea44004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:31.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 -- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 msgr2=0x7fea44003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:31.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c13ca40 0x7fea44003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:31.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 -- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea44003c80 msgr2=0x7fea44004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:31.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea44003c80 0x7fea44004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:31.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 -- 172.21.2.135:0/3918859671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44003260 con 0x7fea440049f0 2021-11-15T14:39:31.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6183a700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea440049f0 0x7fea44004e70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fea540016f0 tx=0x7fea5c0b12f0).ready entity=mon.1 client_cookie=53ce5837d0cb84c0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:31.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5400cc70 con 0x7fea440049f0 2021-11-15T14:39:31.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400cdd0 con 0x7fea440049f0 2021-11-15T14:39:31.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea4ffff700 1 -- 172.21.2.135:0/3918859671 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea54005b80 con 0x7fea440049f0 2021-11-15T14:39:31.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 -- 172.21.2.135:0/3918859671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea440049f0 msgr2=0x7fea44004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.248+0000 7fea6329d700 1 --2- 172.21.2.135:0/3918859671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea440049f0 0x7fea44004e70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fea540016f0 tx=0x7fea5c0b12f0).stop 2021-11-15T14:39:31.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6183a700 1 -- 172.21.2.135:0/3918859671 reap_dead start 2021-11-15T14:39:31.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/3918859671 shutdown_connections 2021-11-15T14:39:31.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/3918859671 >> 172.21.2.135:0/3918859671 conn(0x7fea5c05c510 msgr2=0x7fea5c05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:31.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/3918859671 shutdown_connections 2021-11-15T14:39:31.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/3918859671 wait complete. 2021-11-15T14:39:31.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 Processor -- start 2021-11-15T14:39:31.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- start start 2021-11-15T14:39:31.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea440049f0 0x7fea5c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c142de0 0x7fea5c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c151c20 con 0x7fea440049f0 2021-11-15T14:39:31.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c141310 con 0x7fea5c141530 2021-11-15T14:39:31.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0b56c0 con 0x7fea5c142de0 2021-11-15T14:39:31.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:31.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58524/0 (socket says 172.21.2.135:58524) 2021-11-15T14:39:31.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 -- 172.21.2.135:0/2691638310 learned_addr learned my addr 172.21.2.135:0/2691638310 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:31.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea61039700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea440049f0 0x7fea5c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:31.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 -- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c142de0 msgr2=0x7fea5c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c142de0 0x7fea5c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:31.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 -- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea440049f0 msgr2=0x7fea5c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:31.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea440049f0 0x7fea5c0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:31.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 -- 172.21.2.135:0/2691638310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0b5960 con 0x7fea5c141530 2021-11-15T14:39:31.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea60838700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fea5000c000 tx=0x7fea50006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:31.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea50016070 con 0x7fea5c141530 2021-11-15T14:39:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50000e90 con 0x7fea5c141530 2021-11-15T14:39:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5000ca20 con 0x7fea5c141530 2021-11-15T14:39:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0b4c40 con 0x7fea5c141530 2021-11-15T14:39:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c0b5180 con 0x7fea5c141530 2021-11-15T14:39:31.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c0af120 con 0x7fea5c141530 2021-11-15T14:39:31.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea5000cb80 con 0x7fea5c141530 2021-11-15T14:39:31.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 0x7fea3c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:31.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fea5006ba30 con 0x7fea5c141530 2021-11-15T14:39:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.252+0000 7fea61039700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 0x7fea3c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.256+0000 7fea61039700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 0x7fea3c055b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fea58008000 tx=0x7fea58009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:31.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.256+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea50042b00 con 0x7fea5c141530 2021-11-15T14:39:31.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:31.340+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fea5c0573d0 con 0x7fea5c141530 2021-11-15T14:39:32.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea4e7fc700 1 -- 172.21.2.135:0/2691638310 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v66) v1 ==== 125+0+0 (secure 0 0 0) 0x7fea50046120 con 0x7fea5c141530 2021-11-15T14:39:32.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 msgr2=0x7fea3c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 0x7fea3c055b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fea58008000 tx=0x7fea58009040).stop 2021-11-15T14:39:32.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 msgr2=0x7fea5c151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fea5000c000 tx=0x7fea50006df0).stop 2021-11-15T14:39:32.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 shutdown_connections 2021-11-15T14:39:32.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fea3c0536a0 0x7fea3c055b60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea5c142de0 0x7fea5c0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fea5c141530 0x7fea5c151730 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 --2- 172.21.2.135:0/2691638310 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea440049f0 0x7fea5c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 >> 172.21.2.135:0/2691638310 conn(0x7fea5c05c510 msgr2=0x7fea5c13b010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 shutdown_connections 2021-11-15T14:39:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.116+0000 7fea6329d700 1 -- 172.21.2.135:0/2691638310 wait complete. 2021-11-15T14:39:32.124 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:39:32.127 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:39:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 Processor -- start 2021-11-15T14:39:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 -- start start 2021-11-15T14:39:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb9900b6980 0x7fb9900acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900b6d60 con 0x7fb9900aa650 2021-11-15T14:39:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb990061260 con 0x7fb990060990 2021-11-15T14:39:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb99627d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb990061500 con 0x7fb9900b6980 2021-11-15T14:39:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb990060990 0x7fb9900a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46116/0 (socket says 172.21.2.135:46116) 2021-11-15T14:39:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98f7fe700 1 -- 172.21.2.135:0/1825308273 learned_addr learned my addr 172.21.2.135:0/1825308273 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:32.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98ffff700 1 --2- 172.21.2.135:0/1825308273 >> v2:172.21.2.119:3300/0 conn(0x7fb9900b6980 0x7fb9900acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98ffff700 1 -- 172.21.2.135:0/1825308273 >> v1:172.21.2.135:6789/0 conn(0x7fb990060990 legacy=0x7fb9900a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98ffff700 1 -- 172.21.2.135:0/1825308273 >> v1:172.21.2.119:6789/0 conn(0x7fb9900aa650 legacy=0x7fb99013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98ffff700 1 -- 172.21.2.135:0/1825308273 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900617a0 con 0x7fb9900b6980 2021-11-15T14:39:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.176+0000 7fb98ffff700 1 --2- 172.21.2.135:0/1825308273 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9900b6980 0x7fb9900acdd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb988002f70 tx=0x7fb988006df0).ready entity=mon.0 client_cookie=844b3e063e7f52fa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98effd700 1 -- 172.21.2.135:0/1825308273 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9880109d0 con 0x7fb9900b6980 2021-11-15T14:39:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98effd700 1 -- 172.21.2.135:0/1825308273 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988000e90 con 0x7fb9900b6980 2021-11-15T14:39:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98effd700 1 -- 172.21.2.135:0/1825308273 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb988010d20 con 0x7fb9900b6980 2021-11-15T14:39:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/1825308273 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9900b6980 msgr2=0x7fb9900acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 --2- 172.21.2.135:0/1825308273 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9900b6980 0x7fb9900acdd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb988002f70 tx=0x7fb988006df0).stop 2021-11-15T14:39:32.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/1825308273 shutdown_connections 2021-11-15T14:39:32.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 --2- 172.21.2.135:0/1825308273 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9900b6980 0x7fb9900acdd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/1825308273 >> 172.21.2.135:0/1825308273 conn(0x7fb9900b3500 msgr2=0x7fb9900b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/1825308273 shutdown_connections 2021-11-15T14:39:32.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/1825308273 wait complete. 2021-11-15T14:39:32.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 Processor -- start 2021-11-15T14:39:32.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- start start 2021-11-15T14:39:32.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb990060990 0x7fb99013a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9900b6980 0x7fb990155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990152780 con 0x7fb990060990 2021-11-15T14:39:32.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901529e0 con 0x7fb9900aa650 2021-11-15T14:39:32.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990152c80 con 0x7fb9900b6980 2021-11-15T14:39:32.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58536/0 (socket says 172.21.2.135:58536) 2021-11-15T14:39:32.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 -- 172.21.2.135:0/363722418 learned_addr learned my addr 172.21.2.135:0/363722418 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98ffff700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb990060990 0x7fb99013a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99481a700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9900b6980 0x7fb990155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 -- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9900b6980 msgr2=0x7fb990155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9900b6980 0x7fb990155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 -- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb990060990 msgr2=0x7fb99013a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb990060990 0x7fb99013a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 -- 172.21.2.135:0/363722418 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98800c290 con 0x7fb9900aa650 2021-11-15T14:39:32.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98f7fe700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fb99005dcb0 tx=0x7fb980007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9800070d0 con 0x7fb9900aa650 2021-11-15T14:39:32.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990152f20 con 0x7fb9900aa650 2021-11-15T14:39:32.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980007230 con 0x7fb9900aa650 2021-11-15T14:39:32.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb980005610 con 0x7fb9900aa650 2021-11-15T14:39:32.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.180+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9901533c0 con 0x7fb9900aa650 2021-11-15T14:39:32.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9901530b0 con 0x7fb9900aa650 2021-11-15T14:39:32.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb980010070 con 0x7fb9900aa650 2021-11-15T14:39:32.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98d7fa700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 0x7fb968055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fb98006b0c0 con 0x7fb9900aa650 2021-11-15T14:39:32.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98ffff700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 0x7fb968055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98ffff700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 0x7fb968055b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb988019000 tx=0x7fb988017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.184+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb980041fb0 con 0x7fb9900aa650 2021-11-15T14:39:32.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.292+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb990061a40 con 0x7fb9900aa650 2021-11-15T14:39:32.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb98d7fa700 1 -- 172.21.2.135:0/363722418 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v31) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb980018030 con 0x7fb9900aa650 2021-11-15T14:39:32.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 msgr2=0x7fb968055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 0x7fb968055b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb988019000 tx=0x7fb988017000).stop 2021-11-15T14:39:32.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 msgr2=0x7fb9900b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fb99005dcb0 tx=0x7fb980007c40).stop 2021-11-15T14:39:32.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 shutdown_connections 2021-11-15T14:39:32.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb9680536d0 0x7fb968055b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9900b6980 0x7fb990155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9900aa650 0x7fb9900b4020 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 --2- 172.21.2.135:0/363722418 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb990060990 0x7fb99013a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 >> 172.21.2.135:0/363722418 conn(0x7fb9900b3500 msgr2=0x7fb99013f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 shutdown_connections 2021-11-15T14:39:32.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.308+0000 7fb99627d700 1 -- 172.21.2.135:0/363722418 wait complete. 2021-11-15T14:39:32.317 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 11 and data pool 12 2021-11-15T14:39:32.320 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:39:32.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.364+0000 7f3d8da0d700 1 Processor -- start 2021-11-15T14:39:32.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.364+0000 7f3d8da0d700 1 -- start start 2021-11-15T14:39:32.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3d88060180 0x7f3d880616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3d88065ea0 0x7f3d88066d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d88060560 con 0x7f3d880659f0 2021-11-15T14:39:32.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d88060cf0 con 0x7f3d88060180 2021-11-15T14:39:32.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d88060f90 con 0x7f3d88065ea0 2021-11-15T14:39:32.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3d88065ea0 0x7f3d88066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3d88065ea0 0x7f3d88066d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58558/0 (socket says 172.21.2.135:58558) 2021-11-15T14:39:32.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/2968966881 learned_addr learned my addr 172.21.2.135:0/2968966881 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/2968966881 >> v2:172.21.2.119:3300/0 conn(0x7f3d88060180 msgr2=0x7f3d880616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- 172.21.2.135:0/2968966881 >> v2:172.21.2.119:3300/0 conn(0x7f3d88060180 0x7f3d880616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:32.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/2968966881 >> v1:172.21.2.119:6789/0 conn(0x7f3d880659f0 legacy=0x7f3d88066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/2968966881 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88061230 con 0x7f3d88065ea0 2021-11-15T14:39:32.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- 172.21.2.135:0/2968966881 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88066d60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f3d880ae9b0 tx=0x7f3d80009290).ready entity=mon.1 client_cookie=dd0e515639c639be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d85ffb700 1 -- 172.21.2.135:0/2968966881 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8000b830 con 0x7f3d88065ea0 2021-11-15T14:39:32.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d85ffb700 1 -- 172.21.2.135:0/2968966881 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000b990 con 0x7f3d88065ea0 2021-11-15T14:39:32.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d85ffb700 1 -- 172.21.2.135:0/2968966881 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8000bb40 con 0x7f3d88065ea0 2021-11-15T14:39:32.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/2968966881 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 msgr2=0x7f3d88066d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/2968966881 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88066d60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f3d880ae9b0 tx=0x7f3d80009290).stop 2021-11-15T14:39:32.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/2968966881 shutdown_connections 2021-11-15T14:39:32.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/2968966881 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88066d60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/2968966881 >> v2:172.21.2.119:3300/0 conn(0x7f3d88060180 0x7f3d880616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:32.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/2968966881 >> 172.21.2.135:0/2968966881 conn(0x7f3d8805cfb0 msgr2=0x7f3d8805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/2968966881 shutdown_connections 2021-11-15T14:39:32.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/2968966881 wait complete. 2021-11-15T14:39:32.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 Processor -- start 2021-11-15T14:39:32.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- start start 2021-11-15T14:39:32.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3d88060180 0x7f3d880b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3d880659f0 0x7f3d881533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880a4910 con 0x7f3d880659f0 2021-11-15T14:39:32.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88146760 con 0x7f3d88065ea0 2021-11-15T14:39:32.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881538e0 con 0x7f3d88060180 2021-11-15T14:39:32.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58562/0 (socket says 172.21.2.135:58562) 2021-11-15T14:39:32.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/318546242 learned_addr learned my addr 172.21.2.135:0/318546242 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d86ffd700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3d88060180 0x7f3d880b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d867fc700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3d880659f0 0x7f3d881533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3d88060180 msgr2=0x7f3d880b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3d88060180 0x7f3d880b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3d880659f0 msgr2=0x7f3d881533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3d880659f0 0x7f3d881533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 -- 172.21.2.135:0/318546242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009530 con 0x7f3d88065ea0 2021-11-15T14:39:32.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d877fe700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f3d88153a70 tx=0x7f3d80016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d800032f0 con 0x7f3d88065ea0 2021-11-15T14:39:32.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000bdb0 con 0x7f3d88065ea0 2021-11-15T14:39:32.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d80020620 con 0x7f3d88065ea0 2021-11-15T14:39:32.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d88152a10 con 0x7f3d88065ea0 2021-11-15T14:39:32.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.368+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88152f50 con 0x7f3d88065ea0 2021-11-15T14:39:32.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d880573d0 con 0x7f3d88065ea0 2021-11-15T14:39:32.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3d8000f070 con 0x7f3d88065ea0 2021-11-15T14:39:32.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d7ffff700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 0x7f3d6c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3d8006c900 con 0x7f3d88065ea0 2021-11-15T14:39:32.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d86ffd700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 0x7f3d6c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d86ffd700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 0x7f3d6c055b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f3d7800c000 tx=0x7f3d78008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.372+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d80043800 con 0x7f3d88065ea0 2021-11-15T14:39:32.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d880b2440 con 0x7f3d88065ea0 2021-11-15T14:39:32.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d7ffff700 1 -- 172.21.2.135:0/318546242 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f3d80015090 con 0x7f3d88065ea0 2021-11-15T14:39:32.462 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:32.462 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":67,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:39:32.299812+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:39:30.222386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T14:39:31.382790+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:39:32.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 msgr2=0x7f3d6c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 0x7f3d6c055b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f3d7800c000 tx=0x7f3d78008040).stop 2021-11-15T14:39:32.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 msgr2=0x7f3d88144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.456+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f3d88153a70 tx=0x7f3d80016000).stop 2021-11-15T14:39:32.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 shutdown_connections 2021-11-15T14:39:32.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3d6c053660 0x7f3d6c055b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3d88065ea0 0x7f3d88144660 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3d880659f0 0x7f3d881533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 --2- 172.21.2.135:0/318546242 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3d88060180 0x7f3d880b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 >> 172.21.2.135:0/318546242 conn(0x7f3d8805cfb0 msgr2=0x7f3d88066420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 shutdown_connections 2021-11-15T14:39:32.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.460+0000 7f3d8da0d700 1 -- 172.21.2.135:0/318546242 wait complete. 2021-11-15T14:39:32.469 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:39:32.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 Processor -- start 2021-11-15T14:39:32.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 -- start start 2021-11-15T14:39:32.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b2600 0x7f54e014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00a7140 con 0x7f54e00a8b40 2021-11-15T14:39:32.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00a7370 con 0x7f54e00b0090 2021-11-15T14:39:32.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5d9a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00a7610 con 0x7f54e00b2600 2021-11-15T14:39:32.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54dffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f54e00b0090 0x7f54e00a8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46156/0 (socket says 172.21.2.135:46156) 2021-11-15T14:39:32.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54dffff700 1 -- 172.21.2.135:0/2293047919 learned_addr learned my addr 172.21.2.135:0/2293047919 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:32.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967008935 0 0) 0x7f54e00a7370 con 0x7f54e00b0090 2021-11-15T14:39:32.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c0003260 con 0x7f54e00b0090 2021-11-15T14:39:32.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e4d98700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b2600 0x7f54e014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180003988 0 0) 0x7f54c0003260 con 0x7f54e00b0090 2021-11-15T14:39:32.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b2600 msgr2=0x7f54e014aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b2600 0x7f54e014aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 >> v1:172.21.2.119:6789/0 conn(0x7f54e00a8b40 legacy=0x7f54e0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00a78b0 con 0x7f54e00b0090 2021-11-15T14:39:32.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f54d0001660 con 0x7f54e00b0090 2021-11-15T14:39:32.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 >> v1:172.21.2.135:6789/0 conn(0x7f54e00b0090 legacy=0x7f54e00a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54c00037d0 0x7f54c0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0004500 0x7f54c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54c0005070 0x7f54c000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00a7610 con 0x7f54c0004500 2021-11-15T14:39:32.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c000be80 con 0x7f54c0005070 2021-11-15T14:39:32.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c000c040 con 0x7f54c00037d0 2021-11-15T14:39:32.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e4d98700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b2600 0x7f54e014aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:39:32.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54c0005070 0x7f54c000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54dffff700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0004500 0x7f54c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e4d98700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54c00037d0 0x7f54c0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 -- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54c00037d0 msgr2=0x7f54c0003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54c00037d0 0x7f54c0003bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 -- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0004500 msgr2=0x7f54c0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0004500 0x7f54c0004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 -- 172.21.2.135:0/2293047919 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0003260 con 0x7f54c0005070 2021-11-15T14:39:32.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54e5599700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54c0005070 0x7f54c000b750 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f54d8002320 tx=0x7f54d8007d80).ready entity=mon.1 client_cookie=7b2d58f6cfa3e2fe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d8002510 con 0x7f54c0005070 2021-11-15T14:39:32.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8006890 con 0x7f54c0005070 2021-11-15T14:39:32.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.516+0000 7f54df7fe700 1 -- 172.21.2.135:0/2293047919 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d8006bf0 con 0x7f54c0005070 2021-11-15T14:39:32.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/2293047919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54c0005070 msgr2=0x7f54c000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/2293047919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54c0005070 0x7f54c000b750 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f54d8002320 tx=0x7f54d8007d80).stop 2021-11-15T14:39:32.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5599700 1 -- 172.21.2.135:0/2293047919 reap_dead start 2021-11-15T14:39:32.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/2293047919 shutdown_connections 2021-11-15T14:39:32.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/2293047919 >> 172.21.2.135:0/2293047919 conn(0x7f54e0060200 msgr2=0x7f54e00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/2293047919 shutdown_connections 2021-11-15T14:39:32.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/2293047919 wait complete. 2021-11-15T14:39:32.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 Processor -- start 2021-11-15T14:39:32.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- start start 2021-11-15T14:39:32.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0005070 0x7f54e00b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 0x7f54e0145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e014af80 con 0x7f54c0005070 2021-11-15T14:39:32.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e014a7a0 con 0x7f54e0066860 2021-11-15T14:39:32.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e014aa40 con 0x7f54e00b5b90 2021-11-15T14:39:32.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58582/0 (socket says 172.21.2.135:58582) 2021-11-15T14:39:32.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 -- 172.21.2.135:0/142101023 learned_addr learned my addr 172.21.2.135:0/142101023 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e4d98700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0005070 0x7f54e00b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5599700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 0x7f54e0145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 -- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 msgr2=0x7f54e0145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 0x7f54e0145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 -- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0005070 msgr2=0x7f54e00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0005070 0x7f54e00b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 -- 172.21.2.135:0/142101023 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e014ace0 con 0x7f54e0066860 2021-11-15T14:39:32.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5599700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 0x7f54e0145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:39:32.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54dffff700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f54e00b4d90 tx=0x7f54d0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d0007170 con 0x7f54e0066860 2021-11-15T14:39:32.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00072d0 con 0x7f54e0066860 2021-11-15T14:39:32.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d0004920 con 0x7f54e0066860 2021-11-15T14:39:32.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e0145ef0 con 0x7f54e0066860 2021-11-15T14:39:32.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0159e00 con 0x7f54e0066860 2021-11-15T14:39:32.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0159af0 con 0x7f54e0066860 2021-11-15T14:39:32.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.520+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f54d0004a80 con 0x7f54e0066860 2021-11-15T14:39:32.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.524+0000 7f54ddffb700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 0x7f54c4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.524+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f54d006beb0 con 0x7f54e0066860 2021-11-15T14:39:32.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.524+0000 7f54e4d98700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 0x7f54c4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.524+0000 7f54e4d98700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 0x7f54c4055be0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f54c800c000 tx=0x7f54c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.524+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54d0042ec0 con 0x7f54e0066860 2021-11-15T14:39:32.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.608+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54e00573d0 con 0x7f54e0066860 2021-11-15T14:39:32.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54ddffb700 1 -- 172.21.2.135:0/142101023 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f54d00464e0 con 0x7f54e0066860 2021-11-15T14:39:32.615 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:32.615 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":67,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:39:32.299812+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:39:30.222386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T14:39:31.382790+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:39:32.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 msgr2=0x7f54c4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 0x7f54c4055be0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f54c800c000 tx=0x7f54c8008040).stop 2021-11-15T14:39:32.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 msgr2=0x7f54e0145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f54e00b4d90 tx=0x7f54d0009040).stop 2021-11-15T14:39:32.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 shutdown_connections 2021-11-15T14:39:32.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54c4053720 0x7f54c4055be0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f54e00b5b90 0x7f54e0145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f54e0066860 0x7f54e0145510 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 --2- 172.21.2.135:0/142101023 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f54c0005070 0x7f54e00b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 >> 172.21.2.135:0/142101023 conn(0x7f54e0060200 msgr2=0x7f54e00ac320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 shutdown_connections 2021-11-15T14:39:32.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.612+0000 7f54e5d9a700 1 -- 172.21.2.135:0/142101023 wait complete. 2021-11-15T14:39:32.622 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:39:32.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 Processor -- start 2021-11-15T14:39:32.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- start start 2021-11-15T14:39:32.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff2f80acbf0 0x7ff2f8140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff2f813d4e0 0x7ff2f813d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f813de40 con 0x7ff2f813d4e0 2021-11-15T14:39:32.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f8141110 con 0x7ff2f80acbf0 2021-11-15T14:39:32.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80ac840 con 0x7ff2f80b1140 2021-11-15T14:39:32.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff2f80acbf0 0x7ff2f8140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff2f80acbf0 0x7ff2f8140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58588/0 (socket says 172.21.2.135:58588) 2021-11-15T14:39:32.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 -- 172.21.2.135:0/766384497 learned_addr learned my addr 172.21.2.135:0/766384497 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fd3d2700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 -- 172.21.2.135:0/766384497 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 msgr2=0x7ff2f80b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 -- 172.21.2.135:0/766384497 >> v2:172.21.2.119:3300/0 conn(0x7ff2f813d4e0 msgr2=0x7ff2f813d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:32.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/766384497 >> v2:172.21.2.119:3300/0 conn(0x7ff2f813d4e0 0x7ff2f813d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:32.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 -- 172.21.2.135:0/766384497 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80ac0a0 con 0x7ff2f80acbf0 2021-11-15T14:39:32.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f8140c20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ff2e8002f70 tx=0x7ff2e8006eb0).ready entity=mon.1 client_cookie=48dda3c87ae242cc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2e7fff700 1 -- 172.21.2.135:0/766384497 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e800d570 con 0x7ff2f80acbf0 2021-11-15T14:39:32.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2e7fff700 1 -- 172.21.2.135:0/766384497 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e8000e90 con 0x7ff2f80acbf0 2021-11-15T14:39:32.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2e7fff700 1 -- 172.21.2.135:0/766384497 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e800d900 con 0x7ff2f80acbf0 2021-11-15T14:39:32.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- 172.21.2.135:0/766384497 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 msgr2=0x7ff2f8140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f8140c20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ff2e8002f70 tx=0x7ff2e8006eb0).stop 2021-11-15T14:39:32.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- 172.21.2.135:0/766384497 shutdown_connections 2021-11-15T14:39:32.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- 172.21.2.135:0/766384497 >> v2:172.21.2.119:3300/0 conn(0x7ff2f813d4e0 0x7ff2f813d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:32.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f8140c20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 --2- 172.21.2.135:0/766384497 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- 172.21.2.135:0/766384497 >> 172.21.2.135:0/766384497 conn(0x7ff2f805f730 msgr2=0x7ff2f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:32.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- 172.21.2.135:0/766384497 shutdown_connections 2021-11-15T14:39:32.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- 172.21.2.135:0/766384497 wait complete. 2021-11-15T14:39:32.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 Processor -- start 2021-11-15T14:39:32.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.672+0000 7ff2ff636700 1 -- start start 2021-11-15T14:39:32.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff2f813d4e0 0x7ff2f81540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8063ce0 con 0x7ff2f813d4e0 2021-11-15T14:39:32.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8063f80 con 0x7ff2f80acbf0 2021-11-15T14:39:32.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8064220 con 0x7ff2f80b1140 2021-11-15T14:39:32.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58594/0 (socket says 172.21.2.135:58594) 2021-11-15T14:39:32.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 -- 172.21.2.135:0/1007824672 learned_addr learned my addr 172.21.2.135:0/1007824672 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:32.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fdbd3700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff2f813d4e0 0x7ff2f81540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 -- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 msgr2=0x7ff2f80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 -- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff2f813d4e0 msgr2=0x7ff2f81540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:32.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff2f813d4e0 0x7ff2f81540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:32.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 -- 172.21.2.135:0/1007824672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e800b1e0 con 0x7ff2f80acbf0 2021-11-15T14:39:32.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:39:32.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fd3d2700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7ff2f4007000 tx=0x7ff2f4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f4010580 con 0x7ff2f80acbf0 2021-11-15T14:39:32.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f40106e0 con 0x7ff2f80acbf0 2021-11-15T14:39:32.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f4010a40 con 0x7ff2f80acbf0 2021-11-15T14:39:32.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8153c40 con 0x7ff2f80acbf0 2021-11-15T14:39:32.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f8067740 con 0x7ff2f80acbf0 2021-11-15T14:39:32.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f8153dd0 con 0x7ff2f80acbf0 2021-11-15T14:39:32.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2f4010ba0 con 0x7ff2f80acbf0 2021-11-15T14:39:32.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 0x7ff2d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:32.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff2f406bb50 con 0x7ff2f80acbf0 2021-11-15T14:39:32.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 0x7ff2d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:32.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.676+0000 7ff2fcbd1700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 0x7ff2d8055ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff2e801a000 tx=0x7ff2e8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:32.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.680+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2f4042b60 con 0x7ff2f80acbf0 2021-11-15T14:39:32.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:32.788+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2f80ac300 con 0x7ff2f80acbf0 2021-11-15T14:39:33.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2e67fc700 1 -- 172.21.2.135:0/1007824672 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff2f4046180 con 0x7ff2f80acbf0 2021-11-15T14:39:33.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 msgr2=0x7ff2d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:33.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 0x7ff2d8055ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff2e801a000 tx=0x7ff2e8015000).stop 2021-11-15T14:39:33.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 msgr2=0x7ff2f80aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:33.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7ff2f4007000 tx=0x7ff2f4008040).stop 2021-11-15T14:39:33.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 shutdown_connections 2021-11-15T14:39:33.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff2d8053610 0x7ff2d8055ad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:33.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff2f813d4e0 0x7ff2f81540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:33.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff2f80b1140 0x7ff2f80630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:33.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 --2- 172.21.2.135:0/1007824672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff2f80acbf0 0x7ff2f80aad60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:33.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 >> 172.21.2.135:0/1007824672 conn(0x7ff2f805f730 msgr2=0x7ff2f81461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:33.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 shutdown_connections 2021-11-15T14:39:33.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.688+0000 7ff2ff636700 1 -- 172.21.2.135:0/1007824672 wait complete. 2021-11-15T14:39:33.699 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:33.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 Processor -- start 2021-11-15T14:39:34.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 -- start start 2021-11-15T14:39:34.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 0x7fa5f0143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa5f0143e60 0x7fa5f014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00aac30 con 0x7fa5f0060180 2021-11-15T14:39:34.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f0060560 con 0x7fa5f0143e60 2021-11-15T14:39:34.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5f5c17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0066f20 con 0x7fa5f0067380 2021-11-15T14:39:34.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ef7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa5f0060180 0x7fa5f00b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46188/0 (socket says 172.21.2.135:46188) 2021-11-15T14:39:34.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ef7fe700 1 -- 172.21.2.135:0/1520853594 learned_addr learned my addr 172.21.2.135:0/1520853594 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:34.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872006002 0 0) 0x7fa5f00aac30 con 0x7fa5f0060180 2021-11-15T14:39:34.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003260 con 0x7fa5f0060180 2021-11-15T14:39:34.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2079564198 0 0) 0x7fa5dc003260 con 0x7fa5f0060180 2021-11-15T14:39:34.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 msgr2=0x7fa5f0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 0x7fa5f0143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 >> v2:172.21.2.119:3300/0 conn(0x7fa5f0143e60 msgr2=0x7fa5f014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.752+0000 7fa5ee7fc700 1 --2- 172.21.2.135:0/1520853594 >> v2:172.21.2.119:3300/0 conn(0x7fa5f0143e60 0x7fa5f014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00b3430 con 0x7fa5f0060180 2021-11-15T14:39:34.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa5e4001660 con 0x7fa5f0060180 2021-11-15T14:39:34.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 >> v1:172.21.2.135:6789/0 conn(0x7fa5f0060180 legacy=0x7fa5f00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 0x7fa5dc003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc003e10 0x7fa5dc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5dc004b10 0x7fa5dc004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0060560 con 0x7fa5dc003e10 2021-11-15T14:39:34.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0066f20 con 0x7fa5dc004b10 2021-11-15T14:39:34.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00b9e0 con 0x7fa5f0067380 2021-11-15T14:39:34.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5dc004b10 0x7fa5dc004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 msgr2=0x7fa5dc003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f0067380 0x7fa5dc003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc003e10 msgr2=0x7fa5dc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc003e10 0x7fa5dc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/1520853594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc003260 con 0x7fa5dc004b10 2021-11-15T14:39:34.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5dc004b10 0x7fa5dc004f90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fa5e80032f0 tx=0x7fa5e8006f90).ready entity=mon.1 client_cookie=70b994fd8ce485a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e800b460 con 0x7fa5dc004b10 2021-11-15T14:39:34.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800b5c0 con 0x7fa5dc004b10 2021-11-15T14:39:34.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ee7fc700 1 -- 172.21.2.135:0/1520853594 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e800b750 con 0x7fa5dc004b10 2021-11-15T14:39:34.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/1520853594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5dc004b10 msgr2=0x7fa5dc004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/1520853594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5dc004b10 0x7fa5dc004f90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fa5e80032f0 tx=0x7fa5e8006f90).stop 2021-11-15T14:39:34.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/1520853594 reap_dead start 2021-11-15T14:39:34.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/1520853594 shutdown_connections 2021-11-15T14:39:34.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/1520853594 >> 172.21.2.135:0/1520853594 conn(0x7fa5f005cfb0 msgr2=0x7fa5f005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/1520853594 shutdown_connections 2021-11-15T14:39:34.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/1520853594 wait complete. 2021-11-15T14:39:34.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 Processor -- start 2021-11-15T14:39:34.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- start start 2021-11-15T14:39:34.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc004b10 0x7fa5f00b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f009e930 0x7fa5f0153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0154280 con 0x7fa5dc004b10 2021-11-15T14:39:34.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009f040 con 0x7fa5f0153e00 2021-11-15T14:39:34.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00adef0 con 0x7fa5f009e930 2021-11-15T14:39:34.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58616/0 (socket says 172.21.2.135:58616) 2021-11-15T14:39:34.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/2470119307 learned_addr learned my addr 172.21.2.135:0/2470119307 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:34.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f009e930 msgr2=0x7fa5f0153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f009e930 0x7fa5f0153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc004b10 msgr2=0x7fa5f00b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc004b10 0x7fa5f00b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 -- 172.21.2.135:0/2470119307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00ae190 con 0x7fa5f0153e00 2021-11-15T14:39:34.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5effff700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fa5f00a0450 tx=0x7fa5e8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e801f070 con 0x7fa5f0153e00 2021-11-15T14:39:34.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e801b720 con 0x7fa5f0153e00 2021-11-15T14:39:34.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00ae430 con 0x7fa5f0153e00 2021-11-15T14:39:34.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e801ba80 con 0x7fa5f0153e00 2021-11-15T14:39:34.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.756+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00a0ed0 con 0x7fa5f0153e00 2021-11-15T14:39:34.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00ae5c0 con 0x7fa5f0153e00 2021-11-15T14:39:34.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa5e800f070 con 0x7fa5f0153e00 2021-11-15T14:39:34.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ecff9700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 0x7fa5d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa5e806c5a0 con 0x7fa5f0153e00 2021-11-15T14:39:34.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ef7fe700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 0x7fa5d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ef7fe700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 0x7fa5d0055a40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fa5e4001370 tx=0x7fa5e4001560).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.760+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5e80434a0 con 0x7fa5f0153e00 2021-11-15T14:39:34.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5f00573d0 con 0x7fa5f0153e00 2021-11-15T14:39:34.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5ecff9700 1 -- 172.21.2.135:0/2470119307 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fa5e8046ac0 con 0x7fa5f0153e00 2021-11-15T14:39:34.600 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:34.600 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 msgr2=0x7fa5d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 0x7fa5d0055a40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fa5e4001370 tx=0x7fa5e4001560).stop 2021-11-15T14:39:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 msgr2=0x7fa5f013e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fa5f00a0450 tx=0x7fa5e8017000).stop 2021-11-15T14:39:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 shutdown_connections 2021-11-15T14:39:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5d0053580 0x7fa5d0055a40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5f0153e00 0x7fa5f013e4c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5f009e930 0x7fa5f0153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 --2- 172.21.2.135:0/2470119307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5dc004b10 0x7fa5f00b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 >> 172.21.2.135:0/2470119307 conn(0x7fa5f005cfb0 msgr2=0x7fa5f00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 shutdown_connections 2021-11-15T14:39:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:33.872+0000 7fa5f5c17700 1 -- 172.21.2.135:0/2470119307 wait complete. 2021-11-15T14:39:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:34.605 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:39:34.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 Processor -- start 2021-11-15T14:39:34.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- start start 2021-11-15T14:39:34.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9424148420 0x7f94240b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94240b03d0 con 0x7f94240a7140 2021-11-15T14:39:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94240a9140 con 0x7f9424148420 2021-11-15T14:39:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240b0670 con 0x7f94240b1e30 2021-11-15T14:39:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9424148420 0x7f94240b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9424148420 0x7f94240b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58620/0 (socket says 172.21.2.135:58620) 2021-11-15T14:39:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 -- 172.21.2.135:0/3714593001 learned_addr learned my addr 172.21.2.135:0/3714593001 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 -- 172.21.2.135:0/3714593001 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 msgr2=0x7f94240b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 --2- 172.21.2.135:0/3714593001 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 -- 172.21.2.135:0/3714593001 >> v1:172.21.2.119:6789/0 conn(0x7f94240a7140 legacy=0x7f94241447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 -- 172.21.2.135:0/3714593001 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240b0910 con 0x7f9424148420 2021-11-15T14:39:34.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f9423fff700 1 --2- 172.21.2.135:0/3714593001 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9424148420 0x7f94240b2210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9424061420 tx=0x7f940c006eb0).ready entity=mon.1 client_cookie=589e65cd2be2f767 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f94237fe700 1 -- 172.21.2.135:0/3714593001 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c00d570 con 0x7f9424148420 2021-11-15T14:39:34.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f94237fe700 1 -- 172.21.2.135:0/3714593001 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c000e90 con 0x7f9424148420 2021-11-15T14:39:34.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f94237fe700 1 -- 172.21.2.135:0/3714593001 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c00d8c0 con 0x7f9424148420 2021-11-15T14:39:34.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- 172.21.2.135:0/3714593001 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9424148420 msgr2=0x7f94240b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 --2- 172.21.2.135:0/3714593001 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9424148420 0x7f94240b2210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9424061420 tx=0x7f940c006eb0).stop 2021-11-15T14:39:34.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- 172.21.2.135:0/3714593001 shutdown_connections 2021-11-15T14:39:34.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 --2- 172.21.2.135:0/3714593001 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9424148420 0x7f94240b2210 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 --2- 172.21.2.135:0/3714593001 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- 172.21.2.135:0/3714593001 >> 172.21.2.135:0/3714593001 conn(0x7f942405f730 msgr2=0x7f942405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- 172.21.2.135:0/3714593001 shutdown_connections 2021-11-15T14:39:34.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.656+0000 7f942b204700 1 -- 172.21.2.135:0/3714593001 wait complete. 2021-11-15T14:39:34.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 Processor -- start 2021-11-15T14:39:34.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- start start 2021-11-15T14:39:34.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9424148420 0x7f94241573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424156ca0 con 0x7f9424148420 2021-11-15T14:39:34.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942415a430 con 0x7f94240a7140 2021-11-15T14:39:34.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942415a190 con 0x7f94240b1e30 2021-11-15T14:39:34.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58624/0 (socket says 172.21.2.135:58624) 2021-11-15T14:39:34.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 -- 172.21.2.135:0/21347182 learned_addr learned my addr 172.21.2.135:0/21347182 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:34.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 -- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 msgr2=0x7f94240a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 -- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9424148420 msgr2=0x7f94241573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9424148420 0x7f94241573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 -- 172.21.2.135:0/21347182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c00b1e0 con 0x7f94240a7140 2021-11-15T14:39:34.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9428fa0700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f9414002f70 tx=0x7f9414006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9414013460 con 0x7f94240a7140 2021-11-15T14:39:34.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140135c0 con 0x7f94240a7140 2021-11-15T14:39:34.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9414013920 con 0x7f94240a7140 2021-11-15T14:39:34.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9424156f00 con 0x7f94240a7140 2021-11-15T14:39:34.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424157890 con 0x7f94240a7140 2021-11-15T14:39:34.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9424157090 con 0x7f94240a7140 2021-11-15T14:39:34.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f941400f070 con 0x7f94240a7140 2021-11-15T14:39:34.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 0x7f9408055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f941406b400 con 0x7f94240a7140 2021-11-15T14:39:34.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.660+0000 7f9423fff700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 0x7f9408055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.664+0000 7f9423fff700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 0x7f9408055b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9424061420 tx=0x7f940c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.664+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9414042410 con 0x7f94240a7140 2021-11-15T14:39:34.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.744+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94240b0bb0 con 0x7f94240a7140 2021-11-15T14:39:34.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.744+0000 7f9421ffb700 1 -- 172.21.2.135:0/21347182 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f9414045a30 con 0x7f94240a7140 2021-11-15T14:39:34.750 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:34.751 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":68,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:39:33.304802+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:39:30.222386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T14:39:31.382790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:39:34.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 msgr2=0x7f9408055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 0x7f9408055b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9424061420 tx=0x7f940c015000).stop 2021-11-15T14:39:34.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 msgr2=0x7f9424147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f9414002f70 tx=0x7f9414006ec0).stop 2021-11-15T14:39:34.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 shutdown_connections 2021-11-15T14:39:34.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f94080536a0 0x7f9408055b60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9424148420 0x7f94241573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f94240b1e30 0x7f94240a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 --2- 172.21.2.135:0/21347182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f94240a7140 0x7f9424147ae0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 >> 172.21.2.135:0/21347182 conn(0x7f942405f730 msgr2=0x7f942414cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 shutdown_connections 2021-11-15T14:39:34.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.748+0000 7f942b204700 1 -- 172.21.2.135:0/21347182 wait complete. 2021-11-15T14:39:34.758 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:39:34.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 Processor -- start 2021-11-15T14:39:34.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 -- start start 2021-11-15T14:39:34.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7a9c0b1e30 0x7f7a9c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7a9c0a7140 0x7f7a9c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9c0b03d0 con 0x7f7a9c148420 2021-11-15T14:39:34.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9c0a9140 con 0x7f7a9c0a7140 2021-11-15T14:39:34.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7aa0a45700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9c0b0670 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a99d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7a9c148420 0x7f7a9c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46220/0 (socket says 172.21.2.135:46220) 2021-11-15T14:39:34.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a99d9b700 1 -- 172.21.2.135:0/3594638172 learned_addr learned my addr 172.21.2.135:0/3594638172 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:34.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3594638172 >> v2:172.21.2.135:3300/0 conn(0x7f7a9c0b1e30 0x7f7a9c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9959a700 1 -- 172.21.2.135:0/3594638172 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736213749 0 0) 0x7f7a9c0b03d0 con 0x7f7a9c148420 2021-11-15T14:39:34.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9959a700 1 -- 172.21.2.135:0/3594638172 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a7c003260 con 0x7f7a9c148420 2021-11-15T14:39:34.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9ad9d700 1 --2- 172.21.2.135:0/3594638172 >> v2:172.21.2.119:3300/0 conn(0x7f7a9c0a7140 0x7f7a9c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 -- 172.21.2.135:0/3594638172 >> v2:172.21.2.119:3300/0 conn(0x7f7a9c0a7140 msgr2=0x7f7a9c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:34.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3594638172 >> v2:172.21.2.119:3300/0 conn(0x7f7a9c0a7140 0x7f7a9c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 -- 172.21.2.135:0/3594638172 >> v1:172.21.2.135:6789/0 conn(0x7f7a9c148420 legacy=0x7f7a9c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 -- 172.21.2.135:0/3594638172 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c0b0910 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3594638172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c0b1050 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f7a9c1477b0 tx=0x7f7a8c006df0).ready entity=mon.1 client_cookie=8b55395c62ff44b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9959a700 1 -- 172.21.2.135:0/3594638172 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a8c00d5c0 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9959a700 1 -- 172.21.2.135:0/3594638172 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c000e90 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.808+0000 7f7a9959a700 1 -- 172.21.2.135:0/3594638172 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a8c00d910 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3594638172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c0b1e30 msgr2=0x7f7a9c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3594638172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c0b1050 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f7a9c1477b0 tx=0x7f7a8c006df0).stop 2021-11-15T14:39:34.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3594638172 shutdown_connections 2021-11-15T14:39:34.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3594638172 >> v2:172.21.2.119:3300/0 conn(0x7f7a9c0a7140 0x7f7a9c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3594638172 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c0b1050 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3594638172 >> 172.21.2.135:0/3594638172 conn(0x7f7a9c05f730 msgr2=0x7f7a9c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3594638172 shutdown_connections 2021-11-15T14:39:34.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3594638172 wait complete. 2021-11-15T14:39:34.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 Processor -- start 2021-11-15T14:39:34.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- start start 2021-11-15T14:39:34.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a9c0a7140 0x7f7a9c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c14b740 con 0x7f7a9c0b1e30 2021-11-15T14:39:34.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c14a740 con 0x7f7a9c148420 2021-11-15T14:39:34.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c14a9e0 con 0x7f7a9c0a7140 2021-11-15T14:39:34.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58642/0 (socket says 172.21.2.135:58642) 2021-11-15T14:39:34.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 -- 172.21.2.135:0/3998205037 learned_addr learned my addr 172.21.2.135:0/3998205037 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:34.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a9c0a7140 0x7f7a9c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 -- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a9c0a7140 msgr2=0x7f7a9c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a9c0a7140 0x7f7a9c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 -- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a9c0b1e30 msgr2=0x7f7a9c149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 -- 172.21.2.135:0/3998205037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c00b180 con 0x7f7a9c148420 2021-11-15T14:39:34.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a9ad9d700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f7a94007000 tx=0x7f7a94008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a94010580 con 0x7f7a9c148420 2021-11-15T14:39:34.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a940106e0 con 0x7f7a9c148420 2021-11-15T14:39:34.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c14ef40 con 0x7f7a9c148420 2021-11-15T14:39:34.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a94010850 con 0x7f7a9c148420 2021-11-15T14:39:34.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c14a1a0 con 0x7f7a9c148420 2021-11-15T14:39:34.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9c14aba0 con 0x7f7a9c148420 2021-11-15T14:39:34.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.812+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a940109b0 con 0x7f7a9c148420 2021-11-15T14:39:34.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.816+0000 7f7a937fe700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 0x7f7a80055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:34.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.816+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7a9406bc80 con 0x7f7a9c148420 2021-11-15T14:39:34.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.816+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 0x7f7a80055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:34.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.816+0000 7f7a9a59c700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 0x7f7a80055a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f7a8c015000 tx=0x7f7a8c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:34.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.816+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a94042b80 con 0x7f7a9c148420 2021-11-15T14:39:34.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.928+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7a9c0b0bb0 con 0x7f7a9c148420 2021-11-15T14:39:34.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.940+0000 7f7a937fe700 1 -- 172.21.2.135:0/3998205037 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7a940461a0 con 0x7f7a9c148420 2021-11-15T14:39:34.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 msgr2=0x7f7a80055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 0x7f7a80055a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f7a8c015000 tx=0x7f7a8c014000).stop 2021-11-15T14:39:34.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 msgr2=0x7f7a9c1439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:34.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f7a94007000 tx=0x7f7a94008040).stop 2021-11-15T14:39:34.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 shutdown_connections 2021-11-15T14:39:34.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a80053540 0x7f7a80055a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a9c148420 0x7f7a9c1439c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a9c0b1e30 0x7f7a9c149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:34.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 --2- 172.21.2.135:0/3998205037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a9c0a7140 0x7f7a9c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:34.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 >> 172.21.2.135:0/3998205037 conn(0x7f7a9c05f730 msgr2=0x7f7a9c0b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:34.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 shutdown_connections 2021-11-15T14:39:34.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:34.944+0000 7f7aa0a45700 1 -- 172.21.2.135:0/3998205037 wait complete. 2021-11-15T14:39:34.950 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:39:34.954 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:39:35.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 Processor -- start 2021-11-15T14:39:35.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 -- start start 2021-11-15T14:39:35.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb0180ad150 0x7fb01813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb01813f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180b04b0 con 0x7fb0180b0bb0 2021-11-15T14:39:35.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180ad530 con 0x7fb0180ad150 2021-11-15T14:39:35.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01f7c1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180b57d0 con 0x7fb0180afca0 2021-11-15T14:39:35.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01dd5e700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb0180b0bb0 0x7fb0181426a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46234/0 (socket says 172.21.2.135:46234) 2021-11-15T14:39:35.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01dd5e700 1 -- 172.21.2.135:0/3308740314 learned_addr learned my addr 172.21.2.135:0/3308740314 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:35.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153605508 0 0) 0x7fb0180b04b0 con 0x7fb0180b0bb0 2021-11-15T14:39:35.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000003260 con 0x7fb0180b0bb0 2021-11-15T14:39:35.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb01813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01d55d700 1 --2- 172.21.2.135:0/3308740314 >> v2:172.21.2.119:3300/0 conn(0x7fb0180ad150 0x7fb01813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642998218 0 0) 0x7fb000003260 con 0x7fb0180b0bb0 2021-11-15T14:39:35.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 msgr2=0x7fb01813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb01813f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 >> v2:172.21.2.119:3300/0 conn(0x7fb0180ad150 msgr2=0x7fb01813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 --2- 172.21.2.135:0/3308740314 >> v2:172.21.2.119:3300/0 conn(0x7fb0180ad150 0x7fb01813f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180b06e0 con 0x7fb0180b0bb0 2021-11-15T14:39:35.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb0100019e0 con 0x7fb0180b0bb0 2021-11-15T14:39:35.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 >> v1:172.21.2.135:6789/0 conn(0x7fb0180b0bb0 legacy=0x7fb0181426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0000037d0 0x7fb000003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb000004500 0x7fb000004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb000004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ad530 con 0x7fb0000037d0 2021-11-15T14:39:35.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180b57d0 con 0x7fb000004500 2021-11-15T14:39:35.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00000d9e0 con 0x7fb0180afca0 2021-11-15T14:39:35.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01d55d700 1 --2- 172.21.2.135:0/3308740314 >> v2:172.21.2.119:3300/0 conn(0x7fb0180ad150 0x7fb01813f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:39:35.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb000004500 0x7fb000004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01d55d700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0000037d0 0x7fb000003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01dd5e700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb000004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 -- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 msgr2=0x7fb000004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0180afca0 0x7fb000004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 -- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0000037d0 msgr2=0x7fb000003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0000037d0 0x7fb000003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 -- 172.21.2.135:0/3308740314 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000003260 con 0x7fb000004500 2021-11-15T14:39:35.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.004+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb000004500 0x7fb000004980 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fb000004470 tx=0x7fb014006df0).ready entity=mon.1 client_cookie=7cb60c0a34caa2b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01400e830 con 0x7fb000004500 2021-11-15T14:39:35.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400e990 con 0x7fb000004500 2021-11-15T14:39:35.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00bfff700 1 -- 172.21.2.135:0/3308740314 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01400ecf0 con 0x7fb000004500 2021-11-15T14:39:35.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/3308740314 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb000004500 msgr2=0x7fb000004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/3308740314 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb000004500 0x7fb000004980 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fb000004470 tx=0x7fb014006df0).stop 2021-11-15T14:39:35.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01dd5e700 1 -- 172.21.2.135:0/3308740314 reap_dead start 2021-11-15T14:39:35.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/3308740314 shutdown_connections 2021-11-15T14:39:35.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/3308740314 >> 172.21.2.135:0/3308740314 conn(0x7fb018062cb0 msgr2=0x7fb018063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/3308740314 shutdown_connections 2021-11-15T14:39:35.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/3308740314 wait complete. 2021-11-15T14:39:35.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 Processor -- start 2021-11-15T14:39:35.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- start start 2021-11-15T14:39:35.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 0x7fb0180b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 0x7fb01813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb01813ea10 0x7fb0180b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ac4d0 con 0x7fb000004500 2021-11-15T14:39:35.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01806a060 con 0x7fb01813e0c0 2021-11-15T14:39:35.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01813dd90 con 0x7fb01813ea10 2021-11-15T14:39:35.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01d55d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 0x7fb0180b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 0x7fb01813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01d55d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 0x7fb0180b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:52472/0 (socket says 172.21.2.135:52472) 2021-11-15T14:39:35.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01d55d700 1 -- 172.21.2.135:0/2170776299 learned_addr learned my addr 172.21.2.135:0/2170776299 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:35.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01dd5e700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb01813ea10 0x7fb0180b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 -- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb01813ea10 msgr2=0x7fb0180b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb01813ea10 0x7fb0180b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 -- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 msgr2=0x7fb0180b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 0x7fb0180b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 -- 172.21.2.135:0/2170776299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180ac700 con 0x7fb01813e0c0 2021-11-15T14:39:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01cd5c700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 0x7fb01813e520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb000004470 tx=0x7fb014019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01401b820 con 0x7fb01813e0c0 2021-11-15T14:39:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014000e90 con 0x7fb01813e0c0 2021-11-15T14:39:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01401bb70 con 0x7fb01813e0c0 2021-11-15T14:39:35.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01813d090 con 0x7fb01813e0c0 2021-11-15T14:39:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018064bd0 con 0x7fb01813e0c0 2021-11-15T14:39:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01813d8e0 con 0x7fb01813e0c0 2021-11-15T14:39:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb01401bcd0 con 0x7fb01813e0c0 2021-11-15T14:39:35.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 0x7faff8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.008+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb01406d040 con 0x7fb01813e0c0 2021-11-15T14:39:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.012+0000 7fb01d55d700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 0x7faff8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.012+0000 7fb01d55d700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 0x7faff8055ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fb00c00c000 tx=0x7fb00c00c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.012+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb014044050 con 0x7fb01813e0c0 2021-11-15T14:39:35.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.124+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb0180b5a30 con 0x7fb01813e0c0 2021-11-15T14:39:35.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb00a7fc700 1 -- 172.21.2.135:0/2170776299 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb01402a030 con 0x7fb01813e0c0 2021-11-15T14:39:35.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 msgr2=0x7faff8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 0x7faff8055ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fb00c00c000 tx=0x7fb00c00c040).stop 2021-11-15T14:39:35.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 msgr2=0x7fb01813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 0x7fb01813e520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb000004470 tx=0x7fb014019000).stop 2021-11-15T14:39:35.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 shutdown_connections 2021-11-15T14:39:35.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faff8053610 0x7faff8055ad0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb01813ea10 0x7fb0180b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb01813e0c0 0x7fb01813e520 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 --2- 172.21.2.135:0/2170776299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb000004500 0x7fb0180b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 >> 172.21.2.135:0/2170776299 conn(0x7fb018062cb0 msgr2=0x7fb0181386f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 shutdown_connections 2021-11-15T14:39:35.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.136+0000 7fb01f7c1700 1 -- 172.21.2.135:0/2170776299 wait complete. 2021-11-15T14:39:35.145 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:39:35.148 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:35.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 Processor -- start 2021-11-15T14:39:35.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 -- start start 2021-11-15T14:39:35.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1dac148420 0x7f1dac0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1dac0a7140 0x7f1dac1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac0b03d0 con 0x7f1dac0b1e30 2021-11-15T14:39:35.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0a9140 con 0x7f1dac0a7140 2021-11-15T14:39:35.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1db22d3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0b0670 con 0x7f1dac148420 2021-11-15T14:39:35.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1dabfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f1dac0b1e30 0x7f1dac0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46256/0 (socket says 172.21.2.135:46256) 2021-11-15T14:39:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1dab7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1dac148420 0x7f1dac0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.192+0000 7f1dabfff700 1 -- 172.21.2.135:0/3873471028 learned_addr learned my addr 172.21.2.135:0/3873471028 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/3873471028 >> v2:172.21.2.119:3300/0 conn(0x7f1dac0a7140 msgr2=0x7f1dac1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- 172.21.2.135:0/3873471028 >> v2:172.21.2.119:3300/0 conn(0x7f1dac0a7140 0x7f1dac1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/3873471028 >> v1:172.21.2.135:6789/0 conn(0x7f1dac0b1e30 legacy=0x7f1dac0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/3873471028 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0b0910 con 0x7f1dac148420 2021-11-15T14:39:35.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- 172.21.2.135:0/3873471028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac148420 0x7f1dac0b1050 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f1dac1477b0 tx=0x7f1d94006df0).ready entity=mon.1 client_cookie=b20cb1fe76c372e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1daaffd700 1 -- 172.21.2.135:0/3873471028 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9400d5c0 con 0x7f1dac148420 2021-11-15T14:39:35.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1daaffd700 1 -- 172.21.2.135:0/3873471028 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d94000e90 con 0x7f1dac148420 2021-11-15T14:39:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1daaffd700 1 -- 172.21.2.135:0/3873471028 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9400d910 con 0x7f1dac148420 2021-11-15T14:39:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/3873471028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac148420 msgr2=0x7f1dac0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- 172.21.2.135:0/3873471028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac148420 0x7f1dac0b1050 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f1dac1477b0 tx=0x7f1d94006df0).stop 2021-11-15T14:39:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/3873471028 shutdown_connections 2021-11-15T14:39:35.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- 172.21.2.135:0/3873471028 >> v2:172.21.2.119:3300/0 conn(0x7f1dac0a7140 0x7f1dac1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- 172.21.2.135:0/3873471028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac148420 0x7f1dac0b1050 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/3873471028 >> 172.21.2.135:0/3873471028 conn(0x7f1dac05f730 msgr2=0x7f1dac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/3873471028 shutdown_connections 2021-11-15T14:39:35.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/3873471028 wait complete. 2021-11-15T14:39:35.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 Processor -- start 2021-11-15T14:39:35.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- start start 2021-11-15T14:39:35.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1dac0a7140 0x7f1dac0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1dac148420 0x7f1dac14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0a9560 con 0x7f1dac0a7140 2021-11-15T14:39:35.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0ad440 con 0x7f1dac0b1e30 2021-11-15T14:39:35.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac15aae0 con 0x7f1dac148420 2021-11-15T14:39:35.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58674/0 (socket says 172.21.2.135:58674) 2021-11-15T14:39:35.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/172279723 learned_addr learned my addr 172.21.2.135:0/172279723 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:35.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1dac148420 msgr2=0x7f1dac14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1dac148420 0x7f1dac14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1dac0a7140 msgr2=0x7f1dac0ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1dac0a7140 0x7f1dac0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 -- 172.21.2.135:0/172279723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9400b180 con 0x7f1dac0b1e30 2021-11-15T14:39:35.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dab7fe700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f1dac0aad70 tx=0x7f1d94012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d94016070 con 0x7f1dac0b1e30 2021-11-15T14:39:35.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d94002f70 con 0x7f1dac0b1e30 2021-11-15T14:39:35.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d94006b20 con 0x7f1dac0b1e30 2021-11-15T14:39:35.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac15ad80 con 0x7f1dac0b1e30 2021-11-15T14:39:35.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac0afa70 con 0x7f1dac0b1e30 2021-11-15T14:39:35.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac15a920 con 0x7f1dac0b1e30 2021-11-15T14:39:35.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d9400f030 con 0x7f1dac0b1e30 2021-11-15T14:39:35.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 0x7f1d90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1d9406c810 con 0x7f1dac0b1e30 2021-11-15T14:39:35.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.196+0000 7f1dabfff700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 0x7f1d90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.200+0000 7f1dabfff700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 0x7f1d90055ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1dac0acee0 tx=0x7f1d9c0077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.200+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d94043820 con 0x7f1dac0b1e30 2021-11-15T14:39:35.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dac0a96a0 con 0x7f1dac0b1e30 2021-11-15T14:39:35.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1da97fa700 1 -- 172.21.2.135:0/172279723 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1d94023090 con 0x7f1dac0b1e30 2021-11-15T14:39:35.313 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:35.313 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:35.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 msgr2=0x7f1d90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 0x7f1d90055ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1dac0acee0 tx=0x7f1d9c0077d0).stop 2021-11-15T14:39:35.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 msgr2=0x7f1dac0a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f1dac0aad70 tx=0x7f1d94012000).stop 2021-11-15T14:39:35.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 shutdown_connections 2021-11-15T14:39:35.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d90053610 0x7f1d90055ad0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1dac148420 0x7f1dac14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1dac0b1e30 0x7f1dac0a9990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 --2- 172.21.2.135:0/172279723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1dac0a7140 0x7f1dac0ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 >> 172.21.2.135:0/172279723 conn(0x7f1dac05f730 msgr2=0x7f1dac144a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 shutdown_connections 2021-11-15T14:39:35.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.308+0000 7f1db22d3700 1 -- 172.21.2.135:0/172279723 wait complete. 2021-11-15T14:39:35.317 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:35.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:39:32.300335+0000', 'modified': '2021-11-15T14:39:33.678173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5908': {'gid': 5908, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2659643829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 2659643829}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2659643829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:39:35.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:39:35.623 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:39:35.688 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5908,"want_state":"up:active","state":"up:active","rank_uptime":3.3776760349999999,"mdsmap_epoch":33,"osdmap_epoch":68,"osdmap_epoch_barrier":68,"uptime":7.622765298} 2021-11-15T14:39:35.688 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5908, "mdsmap_epoch": 33, "osdmap_epoch": 68, "osdmap_epoch_barrier": 68, "rank_uptime": 3.377676035, "state": "up:active", "uptime": 7.622765298, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:39:35.689 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:39:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 Processor -- start 2021-11-15T14:39:35.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- start start 2021-11-15T14:39:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 0x7f8a180b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a180b03d0 con 0x7f8a18148420 2021-11-15T14:39:35.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a180b0670 con 0x7f8a180a7140 2021-11-15T14:39:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180a9140 con 0x7f8a180b1e30 2021-11-15T14:39:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1c8b7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8a180a7140 0x7f8a181447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46270/0 (socket says 172.21.2.135:46270) 2021-11-15T14:39:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/3134872571 learned_addr learned my addr 172.21.2.135:0/3134872571 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:35.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156332461 0 0) 0x7f8a180b0670 con 0x7f8a180a7140 2021-11-15T14:39:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f8003260 con 0x7f8a180a7140 2021-11-15T14:39:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969553376 0 0) 0x7f89f8003260 con 0x7f8a180a7140 2021-11-15T14:39:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a17fff700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 0x7f8a180b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 msgr2=0x7f8a180b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 0x7f8a180b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 >> v1:172.21.2.119:6789/0 conn(0x7f8a18148420 legacy=0x7f8a180b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180b0910 con 0x7f8a180a7140 2021-11-15T14:39:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8a100019e0 con 0x7f8a180a7140 2021-11-15T14:39:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 >> v1:172.21.2.135:6789/0 conn(0x7f8a180a7140 legacy=0x7f8a181447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89f80037d0 0x7f89f8003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89f8004500 0x7f89f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 0x7f89f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8005280 con 0x7f89f80037d0 2021-11-15T14:39:35.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f800bc40 con 0x7f89f8004500 2021-11-15T14:39:35.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f800bd80 con 0x7f8a180b1e30 2021-11-15T14:39:35.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89f8004500 0x7f89f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 -- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 msgr2=0x7f89f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a180b1e30 0x7f89f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 -- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89f80037d0 msgr2=0x7f89f8003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89f80037d0 0x7f89f8003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 -- 172.21.2.135:0/3134872571 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8003260 con 0x7f89f8004500 2021-11-15T14:39:35.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a177fe700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89f8004500 0x7f89f8004980 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8a00001fa0 tx=0x7f8a00007a00).ready entity=mon.1 client_cookie=2cb57dc94bd4e842 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a00007030 con 0x7f89f8004500 2021-11-15T14:39:35.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00002e90 con 0x7f89f8004500 2021-11-15T14:39:35.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a16ffd700 1 -- 172.21.2.135:0/3134872571 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a00007380 con 0x7f89f8004500 2021-11-15T14:39:35.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- 172.21.2.135:0/3134872571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89f8004500 msgr2=0x7f89f8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/3134872571 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89f8004500 0x7f89f8004980 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f8a00001fa0 tx=0x7f8a00007a00).stop 2021-11-15T14:39:35.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/3134872571 reap_dead start 2021-11-15T14:39:35.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- 172.21.2.135:0/3134872571 shutdown_connections 2021-11-15T14:39:35.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- 172.21.2.135:0/3134872571 >> 172.21.2.135:0/3134872571 conn(0x7f8a1805f730 msgr2=0x7f8a1805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- 172.21.2.135:0/3134872571 shutdown_connections 2021-11-15T14:39:35.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.736+0000 7f8a1e31a700 1 -- 172.21.2.135:0/3134872571 wait complete. 2021-11-15T14:39:35.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 Processor -- start 2021-11-15T14:39:35.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- start start 2021-11-15T14:39:35.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f89f8004500 0x7f8a18146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a18145620 0x7f8a18142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18146dc0 con 0x7f8a18145620 2021-11-15T14:39:35.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18147060 con 0x7f8a18146000 2021-11-15T14:39:35.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180af290 con 0x7f89f8004500 2021-11-15T14:39:35.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58696/0 (socket says 172.21.2.135:58696) 2021-11-15T14:39:35.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/483870678 learned_addr learned my addr 172.21.2.135:0/483870678 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:35.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a17fff700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f89f8004500 0x7f8a18146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f89f8004500 msgr2=0x7f8a18146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f89f8004500 0x7f8a18146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a177fe700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a18145620 0x7f8a18142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a18145620 msgr2=0x7f8a18142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a18145620 0x7f8a18142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 -- 172.21.2.135:0/483870678 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180afa50 con 0x7f8a18146000 2021-11-15T14:39:35.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1c8b7700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f8a100016f0 tx=0x7f8a180b0800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a10004ab0 con 0x7f8a18146000 2021-11-15T14:39:35.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10004c10 con 0x7f8a18146000 2021-11-15T14:39:35.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a100070d0 con 0x7f8a18146000 2021-11-15T14:39:35.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a180afc40 con 0x7f8a18146000 2021-11-15T14:39:35.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1813ead0 con 0x7f8a18146000 2021-11-15T14:39:35.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a18147220 con 0x7f8a18146000 2021-11-15T14:39:35.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a1001a070 con 0x7f8a18146000 2021-11-15T14:39:35.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 0x7f89fc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8a1006ae00 con 0x7f8a18146000 2021-11-15T14:39:35.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.740+0000 7f8a17fff700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 0x7f89fc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.744+0000 7f8a17fff700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 0x7f89fc055b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8a08008000 tx=0x7f8a08008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.744+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a10041e10 con 0x7f8a18146000 2021-11-15T14:39:35.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.824+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a180573d0 con 0x7f8a18146000 2021-11-15T14:39:35.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a157fa700 1 -- 172.21.2.135:0/483870678 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f8a10045430 con 0x7f8a18146000 2021-11-15T14:39:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:35.832 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":68,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:39:33.304802+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:39:30.222386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-15T14:39:31.382790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:39:35.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 msgr2=0x7f89fc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 0x7f89fc055b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8a08008000 tx=0x7f8a08008040).stop 2021-11-15T14:39:35.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 msgr2=0x7f8a180af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f8a100016f0 tx=0x7f8a180b0800).stop 2021-11-15T14:39:35.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 shutdown_connections 2021-11-15T14:39:35.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89fc0536d0 0x7f89fc055b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a18146000 0x7f8a180af560 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a18145620 0x7f8a18142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 --2- 172.21.2.135:0/483870678 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f89f8004500 0x7f8a18146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 >> 172.21.2.135:0/483870678 conn(0x7f8a1805f730 msgr2=0x7f8a181436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 shutdown_connections 2021-11-15T14:39:35.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.828+0000 7f8a1e31a700 1 -- 172.21.2.135:0/483870678 wait complete. 2021-11-15T14:39:35.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:39:30.222386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:39:31.382790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:39:35.840 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:39:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 Processor -- start 2021-11-15T14:39:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- start start 2021-11-15T14:39:35.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe63c0b0630 0x7fe63c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b3790 0x7fe63c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c1439a0 con 0x7fe63c13dac0 2021-11-15T14:39:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c143c40 con 0x7fe63c0b0630 2021-11-15T14:39:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c143ee0 con 0x7fe63c0b3790 2021-11-15T14:39:35.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe63c0b0630 0x7fe63c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe63c0b0630 0x7fe63c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58700/0 (socket says 172.21.2.135:58700) 2021-11-15T14:39:35.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 -- 172.21.2.135:0/614829491 learned_addr learned my addr 172.21.2.135:0/614829491 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:35.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 -- 172.21.2.135:0/614829491 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b3790 msgr2=0x7fe63c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 --2- 172.21.2.135:0/614829491 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b3790 0x7fe63c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 -- 172.21.2.135:0/614829491 >> v1:172.21.2.119:6789/0 conn(0x7fe63c13dac0 legacy=0x7fe63c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 -- 172.21.2.135:0/614829491 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c144180 con 0x7fe63c0b0630 2021-11-15T14:39:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63bfff700 1 --2- 172.21.2.135:0/614829491 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c0b0630 0x7fe63c0b0a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe63c0b3df0 tx=0x7fe630006f40).ready entity=mon.1 client_cookie=d7cf8dea97a17324 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63affd700 1 -- 172.21.2.135:0/614829491 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000dc30 con 0x7fe63c0b0630 2021-11-15T14:39:35.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63affd700 1 -- 172.21.2.135:0/614829491 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630000e90 con 0x7fe63c0b0630 2021-11-15T14:39:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe63affd700 1 -- 172.21.2.135:0/614829491 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000be90 con 0x7fe63c0b0630 2021-11-15T14:39:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- 172.21.2.135:0/614829491 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c0b0630 msgr2=0x7fe63c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 --2- 172.21.2.135:0/614829491 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c0b0630 0x7fe63c0b0a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe63c0b3df0 tx=0x7fe630006f40).stop 2021-11-15T14:39:35.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- 172.21.2.135:0/614829491 shutdown_connections 2021-11-15T14:39:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 --2- 172.21.2.135:0/614829491 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b3790 0x7fe63c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 --2- 172.21.2.135:0/614829491 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c0b0630 0x7fe63c0b0a10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- 172.21.2.135:0/614829491 >> 172.21.2.135:0/614829491 conn(0x7fe63c060840 msgr2=0x7fe63c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- 172.21.2.135:0/614829491 shutdown_connections 2021-11-15T14:39:35.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- 172.21.2.135:0/614829491 wait complete. 2021-11-15T14:39:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 Processor -- start 2021-11-15T14:39:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.888+0000 7fe6427f4700 1 -- start start 2021-11-15T14:39:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b0630 0x7fe63c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe63c0b3790 0x7fe63c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c13fd00 con 0x7fe63c0b3790 2021-11-15T14:39:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c148970 con 0x7fe63c13dac0 2021-11-15T14:39:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c13ff30 con 0x7fe63c0b0630 2021-11-15T14:39:35.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58710/0 (socket says 172.21.2.135:58710) 2021-11-15T14:39:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 -- 172.21.2.135:0/281003905 learned_addr learned my addr 172.21.2.135:0/281003905 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 -- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b0630 msgr2=0x7fe63c140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b0630 0x7fe63c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 -- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe63c0b3790 msgr2=0x7fe63c13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe63c0b3790 0x7fe63c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 -- 172.21.2.135:0/281003905 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63000b460 con 0x7fe63c13dac0 2021-11-15T14:39:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe640d91700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe634003290 tx=0x7fe6340090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63400f510 con 0x7fe63c13dac0 2021-11-15T14:39:35.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400f670 con 0x7fe63c13dac0 2021-11-15T14:39:35.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63400f7e0 con 0x7fe63c13dac0 2021-11-15T14:39:35.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c0aba60 con 0x7fe63c13dac0 2021-11-15T14:39:35.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c0abfa0 con 0x7fe63c13dac0 2021-11-15T14:39:35.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c13e9f0 con 0x7fe63c13dac0 2021-11-15T14:39:35.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe63400f070 con 0x7fe63c13dac0 2021-11-15T14:39:35.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 0x7fe61c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:35.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe63406b5d0 con 0x7fe63c13dac0 2021-11-15T14:39:35.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe63bfff700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 0x7fe61c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:35.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.892+0000 7fe63bfff700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 0x7fe61c055a70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe63c0b3df0 tx=0x7fe63c1410a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:35.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.896+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6340425e0 con 0x7fe63c13dac0 2021-11-15T14:39:35.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.976+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe63c143620 con 0x7fe63c13dac0 2021-11-15T14:39:35.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.976+0000 7fe6397fa700 1 -- 172.21.2.135:0/281003905 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe634045c00 con 0x7fe63c13dac0 2021-11-15T14:39:35.982 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:39:35.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 msgr2=0x7fe61c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 0x7fe61c055a70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe63c0b3df0 tx=0x7fe63c1410a0).stop 2021-11-15T14:39:35.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 msgr2=0x7fe63c0ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:35.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fe634003290 tx=0x7fe6340090f0).stop 2021-11-15T14:39:35.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 shutdown_connections 2021-11-15T14:39:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe61c0535b0 0x7fe61c055a70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe63c13dac0 0x7fe63c0ae780 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe63c0b3790 0x7fe63c13ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 --2- 172.21.2.135:0/281003905 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe63c0b0630 0x7fe63c140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 >> 172.21.2.135:0/281003905 conn(0x7fe63c060840 msgr2=0x7fe63c141450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 shutdown_connections 2021-11-15T14:39:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:35.980+0000 7fe6427f4700 1 -- 172.21.2.135:0/281003905 wait complete. 2021-11-15T14:39:35.989 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:39:36.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 Processor -- start 2021-11-15T14:39:36.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 -- start start 2021-11-15T14:39:36.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7feeec060040 0x7feeec064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec0b2ca0 0x7feeec065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0b2430 con 0x7feeec0b3950 2021-11-15T14:39:36.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec065770 con 0x7feeec060040 2021-11-15T14:39:36.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feef1d5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0b26d0 con 0x7feeec0b2ca0 2021-11-15T14:39:36.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeaffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feeec0b3950 0x7feeec0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46302/0 (socket says 172.21.2.135:46302) 2021-11-15T14:39:36.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeaffd700 1 -- 172.21.2.135:0/1542956653 learned_addr learned my addr 172.21.2.135:0/1542956653 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:36.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeb7fe700 1 --2- 172.21.2.135:0/1542956653 >> v2:172.21.2.135:3300/0 conn(0x7feeec060040 0x7feeec064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeb7fe700 1 -- 172.21.2.135:0/1542956653 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec0b2ca0 msgr2=0x7feeec065280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:36.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeb7fe700 1 --2- 172.21.2.135:0/1542956653 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec0b2ca0 0x7feeec065280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeb7fe700 1 -- 172.21.2.135:0/1542956653 >> v1:172.21.2.135:6789/0 conn(0x7feeec0b3950 legacy=0x7feeec0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeeb7fe700 1 -- 172.21.2.135:0/1542956653 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0b2970 con 0x7feeec060040 2021-11-15T14:39:36.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.036+0000 7feeea7fc700 1 -- 172.21.2.135:0/1542956653 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527695743 0 0) 0x7feeec0b2430 con 0x7feeec0b3950 2021-11-15T14:39:36.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeeb7fe700 1 --2- 172.21.2.135:0/1542956653 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec060040 0x7feeec064d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7feedc002f70 tx=0x7feedc006df0).ready entity=mon.1 client_cookie=13be730f29ee453d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeea7fc700 1 -- 172.21.2.135:0/1542956653 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feedc00d570 con 0x7feeec060040 2021-11-15T14:39:36.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeea7fc700 1 -- 172.21.2.135:0/1542956653 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc000e90 con 0x7feeec060040 2021-11-15T14:39:36.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeea7fc700 1 -- 172.21.2.135:0/1542956653 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feedc00d900 con 0x7feeec060040 2021-11-15T14:39:36.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/1542956653 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec060040 msgr2=0x7feeec064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- 172.21.2.135:0/1542956653 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec060040 0x7feeec064d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7feedc002f70 tx=0x7feedc006df0).stop 2021-11-15T14:39:36.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/1542956653 shutdown_connections 2021-11-15T14:39:36.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- 172.21.2.135:0/1542956653 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec0b2ca0 0x7feeec065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- 172.21.2.135:0/1542956653 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec060040 0x7feeec064d90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/1542956653 >> 172.21.2.135:0/1542956653 conn(0x7feeec05cfe0 msgr2=0x7feeec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/1542956653 shutdown_connections 2021-11-15T14:39:36.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/1542956653 wait complete. 2021-11-15T14:39:36.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 Processor -- start 2021-11-15T14:39:36.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- start start 2021-11-15T14:39:36.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec060040 0x7feeec0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeec0b2ca0 0x7feeec0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0ae3e0 con 0x7feeec0b2ca0 2021-11-15T14:39:36.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0af9c0 con 0x7feeec0b3950 2021-11-15T14:39:36.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0afe50 con 0x7feeec060040 2021-11-15T14:39:36.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58724/0 (socket says 172.21.2.135:58724) 2021-11-15T14:39:36.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 -- 172.21.2.135:0/739938193 learned_addr learned my addr 172.21.2.135:0/739938193 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 -- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec060040 msgr2=0x7feeec0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec060040 0x7feeec0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 -- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeec0b2ca0 msgr2=0x7feeec0b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeec0b2ca0 0x7feeec0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 -- 172.21.2.135:0/739938193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc00b180 con 0x7feeec0b3950 2021-11-15T14:39:36.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feeebfff700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7feeec0aca10 tx=0x7feee40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee4001520 con 0x7feeec0b3950 2021-11-15T14:39:36.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4001680 con 0x7feeec0b3950 2021-11-15T14:39:36.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec0ad170 con 0x7feeec0b3950 2021-11-15T14:39:36.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee40019e0 con 0x7feeec0b3950 2021-11-15T14:39:36.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0adea0 con 0x7feeec0b3950 2021-11-15T14:39:36.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec13ea50 con 0x7feeec0b3950 2021-11-15T14:39:36.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feee4018030 con 0x7feeec0b3950 2021-11-15T14:39:36.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 0x7feed0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.040+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7feee406b4c0 con 0x7feeec0b3950 2021-11-15T14:39:36.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.044+0000 7feeeb7fe700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 0x7feed0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.044+0000 7feeeb7fe700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 0x7feed0055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7feedc002f70 tx=0x7feedc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.044+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feee4042580 con 0x7feeec0b3950 2021-11-15T14:39:36.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feeec0648f0 con 0x7feeec0b3950 2021-11-15T14:39:36.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feee8ff9700 1 -- 172.21.2.135:0/739938193 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7feee4045ba0 con 0x7feeec0b3950 2021-11-15T14:39:36.133 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:39:36.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 msgr2=0x7feed0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 0x7feed0055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7feedc002f70 tx=0x7feedc015000).stop 2021-11-15T14:39:36.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 msgr2=0x7feeec13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7feeec0aca10 tx=0x7feee40091a0).stop 2021-11-15T14:39:36.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 shutdown_connections 2021-11-15T14:39:36.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feed0053580 0x7feed0055a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feeec0b3950 0x7feeec13bc20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feeec0b2ca0 0x7feeec0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 --2- 172.21.2.135:0/739938193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feeec060040 0x7feeec0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 >> 172.21.2.135:0/739938193 conn(0x7feeec05cfe0 msgr2=0x7feeec142a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 shutdown_connections 2021-11-15T14:39:36.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.128+0000 7feef1d5f700 1 -- 172.21.2.135:0/739938193 wait complete. 2021-11-15T14:39:36.140 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:39:36.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 Processor -- start 2021-11-15T14:39:36.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- start start 2021-11-15T14:39:36.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b740a9f40 0x7f3b740aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3b74060450 0x7f3b7413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74061a10 con 0x7f3b7413d240 2021-11-15T14:39:36.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74061cb0 con 0x7f3b74060450 2021-11-15T14:39:36.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74060c10 con 0x7f3b740a9f40 2021-11-15T14:39:36.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b740a9f40 0x7f3b740aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3b740a9f40 0x7f3b740aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58728/0 (socket says 172.21.2.135:58728) 2021-11-15T14:39:36.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 -- 172.21.2.135:0/1771233668 learned_addr learned my addr 172.21.2.135:0/1771233668 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 -- 172.21.2.135:0/1771233668 >> v2:172.21.2.119:3300/0 conn(0x7f3b74060450 msgr2=0x7f3b7413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:36.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 --2- 172.21.2.135:0/1771233668 >> v2:172.21.2.119:3300/0 conn(0x7f3b74060450 0x7f3b7413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 -- 172.21.2.135:0/1771233668 >> v1:172.21.2.119:6789/0 conn(0x7f3b7413d240 legacy=0x7f3b7413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:36.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 -- 172.21.2.135:0/1771233668 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74060eb0 con 0x7f3b740a9f40 2021-11-15T14:39:36.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7988a700 1 --2- 172.21.2.135:0/1771233668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b740a9f40 0x7f3b740aa320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f3b740aab70 tx=0x7f3b64006e40).ready entity=mon.1 client_cookie=cd838d16b93caf4c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b78888700 1 -- 172.21.2.135:0/1771233668 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6400bca0 con 0x7f3b740a9f40 2021-11-15T14:39:36.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b78888700 1 -- 172.21.2.135:0/1771233668 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64000e90 con 0x7f3b740a9f40 2021-11-15T14:39:36.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b78888700 1 -- 172.21.2.135:0/1771233668 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b640153f0 con 0x7f3b740a9f40 2021-11-15T14:39:36.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- 172.21.2.135:0/1771233668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b740a9f40 msgr2=0x7f3b740aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 --2- 172.21.2.135:0/1771233668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b740a9f40 0x7f3b740aa320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f3b740aab70 tx=0x7f3b64006e40).stop 2021-11-15T14:39:36.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- 172.21.2.135:0/1771233668 shutdown_connections 2021-11-15T14:39:36.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 --2- 172.21.2.135:0/1771233668 >> v2:172.21.2.119:3300/0 conn(0x7f3b74060450 0x7f3b7413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 --2- 172.21.2.135:0/1771233668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b740a9f40 0x7f3b740aa320 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- 172.21.2.135:0/1771233668 >> 172.21.2.135:0/1771233668 conn(0x7f3b740b29f0 msgr2=0x7f3b740b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- 172.21.2.135:0/1771233668 shutdown_connections 2021-11-15T14:39:36.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.188+0000 7f3b7baee700 1 -- 172.21.2.135:0/1771233668 wait complete. 2021-11-15T14:39:36.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 Processor -- start 2021-11-15T14:39:36.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- start start 2021-11-15T14:39:36.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b740a9f40 0x7f3b74156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b7413d240 0x7f3b740af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7413a270 con 0x7f3b740a9f40 2021-11-15T14:39:36.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7413ff90 con 0x7f3b74060450 2021-11-15T14:39:36.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74140230 con 0x7f3b7413d240 2021-11-15T14:39:36.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58736/0 (socket says 172.21.2.135:58736) 2021-11-15T14:39:36.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 -- 172.21.2.135:0/4038600428 learned_addr learned my addr 172.21.2.135:0/4038600428 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7a08b700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b7413d240 0x7f3b740af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b79089700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b740a9f40 0x7f3b74156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 -- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b7413d240 msgr2=0x7f3b740af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b7413d240 0x7f3b740af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 -- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b740a9f40 msgr2=0x7f3b74156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b740a9f40 0x7f3b74156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 -- 172.21.2.135:0/4038600428 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6400d4d0 con 0x7f3b74060450 2021-11-15T14:39:36.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7988a700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f3b740aab70 tx=0x7f3b64018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6400b040 con 0x7f3b74060450 2021-11-15T14:39:36.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64015b10 con 0x7f3b74060450 2021-11-15T14:39:36.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64015e70 con 0x7f3b74060450 2021-11-15T14:39:36.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b741404d0 con 0x7f3b74060450 2021-11-15T14:39:36.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740a8ff0 con 0x7f3b74060450 2021-11-15T14:39:36.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b740573d0 con 0x7f3b74060450 2021-11-15T14:39:36.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b64027450 con 0x7f3b74060450 2021-11-15T14:39:36.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 0x7f3b540559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3b6406c970 con 0x7f3b74060450 2021-11-15T14:39:36.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b79089700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 0x7f3b540559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.192+0000 7f3b79089700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 0x7f3b540559b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f3b7000c000 tx=0x7f3b70008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.196+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b64043810 con 0x7f3b74060450 2021-11-15T14:39:36.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b740446d0 con 0x7f3b74060450 2021-11-15T14:39:36.284 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:39:36.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b62ffd700 1 -- 172.21.2.135:0/4038600428 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3b64046e30 con 0x7f3b74060450 2021-11-15T14:39:36.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 msgr2=0x7f3b540559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 0x7f3b540559b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f3b7000c000 tx=0x7f3b70008040).stop 2021-11-15T14:39:36.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 msgr2=0x7f3b740a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f3b740aab70 tx=0x7f3b64018000).stop 2021-11-15T14:39:36.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 shutdown_connections 2021-11-15T14:39:36.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3b540534f0 0x7f3b540559b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3b7413d240 0x7f3b740af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3b740a9f40 0x7f3b74156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 --2- 172.21.2.135:0/4038600428 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3b74060450 0x7f3b740a8410 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 >> 172.21.2.135:0/4038600428 conn(0x7f3b740b29f0 msgr2=0x7f3b740b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 shutdown_connections 2021-11-15T14:39:36.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.280+0000 7f3b7baee700 1 -- 172.21.2.135:0/4038600428 wait complete. 2021-11-15T14:39:36.291 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:39:36.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 Processor -- start 2021-11-15T14:39:36.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- start start 2021-11-15T14:39:36.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa7940654a0 0x7fa7941444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7940b3950 0x7fa7941449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940b2430 con 0x7fa794060040 2021-11-15T14:39:36.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940b26d0 con 0x7fa7940654a0 2021-11-15T14:39:36.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940b2970 con 0x7fa7940b3950 2021-11-15T14:39:36.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa7940654a0 0x7fa7941444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa7940654a0 0x7fa7941444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58746/0 (socket says 172.21.2.135:58746) 2021-11-15T14:39:36.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 -- 172.21.2.135:0/3677480444 learned_addr learned my addr 172.21.2.135:0/3677480444 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 -- 172.21.2.135:0/3677480444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7940b3950 msgr2=0x7fa7941449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:36.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 --2- 172.21.2.135:0/3677480444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7940b3950 0x7fa7941449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 -- 172.21.2.135:0/3677480444 >> v1:172.21.2.135:6789/0 conn(0x7fa794060040 legacy=0x7fa794064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 -- 172.21.2.135:0/3677480444 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940648f0 con 0x7fa7940654a0 2021-11-15T14:39:36.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa798fed700 1 --2- 172.21.2.135:0/3677480444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7941444c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fa790002f70 tx=0x7fa790006eb0).ready entity=mon.1 client_cookie=4b6f03a21cf446cd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa787fff700 1 -- 172.21.2.135:0/3677480444 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79000d5c0 con 0x7fa7940654a0 2021-11-15T14:39:36.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa787fff700 1 -- 172.21.2.135:0/3677480444 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790000e90 con 0x7fa7940654a0 2021-11-15T14:39:36.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa787fff700 1 -- 172.21.2.135:0/3677480444 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79000d950 con 0x7fa7940654a0 2021-11-15T14:39:36.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- 172.21.2.135:0/3677480444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 msgr2=0x7fa7941444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 --2- 172.21.2.135:0/3677480444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7941444c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fa790002f70 tx=0x7fa790006eb0).stop 2021-11-15T14:39:36.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- 172.21.2.135:0/3677480444 shutdown_connections 2021-11-15T14:39:36.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 --2- 172.21.2.135:0/3677480444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7941444c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 --2- 172.21.2.135:0/3677480444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7940b3950 0x7fa7941449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- 172.21.2.135:0/3677480444 >> 172.21.2.135:0/3677480444 conn(0x7fa79405cfe0 msgr2=0x7fa79405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- 172.21.2.135:0/3677480444 shutdown_connections 2021-11-15T14:39:36.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- 172.21.2.135:0/3677480444 wait complete. 2021-11-15T14:39:36.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 Processor -- start 2021-11-15T14:39:36.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.340+0000 7fa79ba52700 1 -- start start 2021-11-15T14:39:36.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa794060040 0x7fa7940afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7940b3950 0x7fa79413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940b1630 con 0x7fa7940b3950 2021-11-15T14:39:36.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940af2a0 con 0x7fa7940654a0 2021-11-15T14:39:36.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940b0ac0 con 0x7fa794060040 2021-11-15T14:39:36.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58750/0 (socket says 172.21.2.135:58750) 2021-11-15T14:39:36.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 -- 172.21.2.135:0/951110434 learned_addr learned my addr 172.21.2.135:0/951110434 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 -- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa794060040 msgr2=0x7fa7940afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa794060040 0x7fa7940afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 -- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7940b3950 msgr2=0x7fa79413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7940b3950 0x7fa79413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 -- 172.21.2.135:0/951110434 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79000b1e0 con 0x7fa7940654a0 2021-11-15T14:39:36.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa798fed700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fa7940b6ae0 tx=0x7fa790015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa790006be0 con 0x7fa7940654a0 2021-11-15T14:39:36.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790011ca0 con 0x7fa7940654a0 2021-11-15T14:39:36.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940ae8b0 con 0x7fa7940654a0 2021-11-15T14:39:36.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7940aef00 con 0x7fa7940654a0 2021-11-15T14:39:36.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79001e460 con 0x7fa7940654a0 2021-11-15T14:39:36.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940afb20 con 0x7fa7940654a0 2021-11-15T14:39:36.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa790025030 con 0x7fa7940654a0 2021-11-15T14:39:36.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 0x7fa774055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa79006d000 con 0x7fa7940654a0 2021-11-15T14:39:36.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7997ee700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 0x7fa774055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.344+0000 7fa7997ee700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 0x7fa774055a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa79405d4e0 tx=0x7fa7880077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.348+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa790043f00 con 0x7fa7940654a0 2021-11-15T14:39:36.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.428+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7940674f0 con 0x7fa7940654a0 2021-11-15T14:39:36.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.428+0000 7fa7867fc700 1 -- 172.21.2.135:0/951110434 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa7900230a0 con 0x7fa7940654a0 2021-11-15T14:39:36.434 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:39:36.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 msgr2=0x7fa774055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 0x7fa774055a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa79405d4e0 tx=0x7fa7880077d0).stop 2021-11-15T14:39:36.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 msgr2=0x7fa7940622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fa7940b6ae0 tx=0x7fa790015000).stop 2021-11-15T14:39:36.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 shutdown_connections 2021-11-15T14:39:36.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7740535d0 0x7fa774055a90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7940b3950 0x7fa79413cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7940654a0 0x7fa7940622d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 --2- 172.21.2.135:0/951110434 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa794060040 0x7fa7940afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 >> 172.21.2.135:0/951110434 conn(0x7fa79405cfe0 msgr2=0x7fa79405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 shutdown_connections 2021-11-15T14:39:36.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.432+0000 7fa79ba52700 1 -- 172.21.2.135:0/951110434 wait complete. 2021-11-15T14:39:36.441 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:39:36.442 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:36.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 Processor -- start 2021-11-15T14:39:36.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- start start 2021-11-15T14:39:36.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb6ec0b69e0 0x7fb6ec12ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec144130 con 0x7fb6ec0b6600 2021-11-15T14:39:36.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec143bf0 con 0x7fb6ec0b69e0 2021-11-15T14:39:36.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec143e90 con 0x7fb6ec0b4440 2021-11-15T14:39:36.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58760/0 (socket says 172.21.2.135:58760) 2021-11-15T14:39:36.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/4172132654 learned_addr learned my addr 172.21.2.135:0/4172132654 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/4172132654 >> v2:172.21.2.119:3300/0 conn(0x7fb6ec0b69e0 msgr2=0x7fb6ec12ba80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:36.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 --2- 172.21.2.135:0/4172132654 >> v2:172.21.2.119:3300/0 conn(0x7fb6ec0b69e0 0x7fb6ec12ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/4172132654 >> v1:172.21.2.119:6789/0 conn(0x7fb6ec0b6600 legacy=0x7fb6ec061db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:36.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/4172132654 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec061670 con 0x7fb6ec0b4440 2021-11-15T14:39:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eb7fe700 1 --2- 172.21.2.135:0/4172132654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb6ec0b1d00 tx=0x7fb6d4006eb0).ready entity=mon.1 client_cookie=1a2814981220186b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eaffd700 1 -- 172.21.2.135:0/4172132654 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d400d5c0 con 0x7fb6ec0b4440 2021-11-15T14:39:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eaffd700 1 -- 172.21.2.135:0/4172132654 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4000e90 con 0x7fb6ec0b4440 2021-11-15T14:39:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6eaffd700 1 -- 172.21.2.135:0/4172132654 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d400d950 con 0x7fb6ec0b4440 2021-11-15T14:39:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- 172.21.2.135:0/4172132654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b4440 msgr2=0x7fb6ec0b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 --2- 172.21.2.135:0/4172132654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb6ec0b1d00 tx=0x7fb6d4006eb0).stop 2021-11-15T14:39:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- 172.21.2.135:0/4172132654 shutdown_connections 2021-11-15T14:39:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 --2- 172.21.2.135:0/4172132654 >> v2:172.21.2.119:3300/0 conn(0x7fb6ec0b69e0 0x7fb6ec12ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 --2- 172.21.2.135:0/4172132654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b4440 0x7fb6ec0b5c70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.488+0000 7fb6f292c700 1 -- 172.21.2.135:0/4172132654 >> 172.21.2.135:0/4172132654 conn(0x7fb6ec05c510 msgr2=0x7fb6ec05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- 172.21.2.135:0/4172132654 shutdown_connections 2021-11-15T14:39:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- 172.21.2.135:0/4172132654 wait complete. 2021-11-15T14:39:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 Processor -- start 2021-11-15T14:39:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- start start 2021-11-15T14:39:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb6ec0b4440 0x7fb6ec147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb6ec0b69e0 0x7fb6ec125690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec125b80 con 0x7fb6ec0b69e0 2021-11-15T14:39:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec129b10 con 0x7fb6ec0b6600 2021-11-15T14:39:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0afc20 con 0x7fb6ec0b4440 2021-11-15T14:39:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58762/0 (socket says 172.21.2.135:58762) 2021-11-15T14:39:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/2670756256 learned_addr learned my addr 172.21.2.135:0/2670756256 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb6ec0b4440 msgr2=0x7fb6ec147ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb6ec0b4440 0x7fb6ec147ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb6ec0b69e0 msgr2=0x7fb6ec125690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:39:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb6ec0b69e0 0x7fb6ec125690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 -- 172.21.2.135:0/2670756256 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d400b1e0 con 0x7fb6ec0b6600 2021-11-15T14:39:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6eb7fe700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fb6ec0b1d00 tx=0x7fb6d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d4002f70 con 0x7fb6ec0b6600 2021-11-15T14:39:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d400de70 con 0x7fb6ec0b6600 2021-11-15T14:39:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec0afec0 con 0x7fb6ec0b6600 2021-11-15T14:39:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec126de0 con 0x7fb6ec0b6600 2021-11-15T14:39:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6d40068b0 con 0x7fb6ec0b6600 2021-11-15T14:39:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec061910 con 0x7fb6ec0b6600 2021-11-15T14:39:36.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6d4025030 con 0x7fb6ec0b6600 2021-11-15T14:39:36.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 0x7fb6d0055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:36.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb6d406ce80 con 0x7fb6ec0b6600 2021-11-15T14:39:36.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.492+0000 7fb6ebfff700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 0x7fb6d0055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:36.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.496+0000 7fb6ebfff700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 0x7fb6d0055ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb6dc002fb0 tx=0x7fb6dc006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:36.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.496+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6d4043e10 con 0x7fb6ec0b6600 2021-11-15T14:39:36.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6ec0573d0 con 0x7fb6ec0b6600 2021-11-15T14:39:36.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6e97fa700 1 -- 172.21.2.135:0/2670756256 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fb6d4047430 con 0x7fb6ec0b6600 2021-11-15T14:39:36.609 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:36.609 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 msgr2=0x7fb6d0055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 0x7fb6d0055ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb6dc002fb0 tx=0x7fb6dc006930).stop 2021-11-15T14:39:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 msgr2=0x7fb6ec1251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fb6ec0b1d00 tx=0x7fb6d4015000).stop 2021-11-15T14:39:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 shutdown_connections 2021-11-15T14:39:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb6d0053600 0x7fb6d0055ac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb6ec0b69e0 0x7fb6ec125690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb6ec0b6600 0x7fb6ec1251a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 --2- 172.21.2.135:0/2670756256 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb6ec0b4440 0x7fb6ec147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 >> 172.21.2.135:0/2670756256 conn(0x7fb6ec05c510 msgr2=0x7fb6ec1283e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 shutdown_connections 2021-11-15T14:39:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:36.604+0000 7fb6f292c700 1 -- 172.21.2.135:0/2670756256 wait complete. 2021-11-15T14:39:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:36.919 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:39:32.300335+0000', 'modified': '2021-11-15T14:39:33.678173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5908': {'gid': 5908, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2659643829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 2659643829}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2659643829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:39:36.919 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:39:36.920 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:39:36.984 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":5908,"want_state":"up:active","state":"up:active","rank_uptime":4.6742042770000003,"mdsmap_epoch":33,"osdmap_epoch":68,"osdmap_epoch_barrier":68,"uptime":8.9192938230000003} 2021-11-15T14:39:36.985 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 5908, "mdsmap_epoch": 33, "osdmap_epoch": 68, "osdmap_epoch_barrier": 68, "rank_uptime": 4.674204277, "state": "up:active", "uptime": 8.919293823, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:39:36.985 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:39:36.986 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:39:36.986 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:39:36.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:36.987 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:36.997 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:39:37.049 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:39:37.049 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:39:37.054 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:39:37.055 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:39:37.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:37.057 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:39:37.060 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:39:37.060 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:37.104 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:39:37.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:39:37.114 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:39:37.118 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:39:37.119 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:39:37.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:37.120 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:39:37.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14489]: starting ceph client 2021-11-15T14:39:37.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:39:37.146+0000 7f3b2fc1a080 -1 init, newargv = 0x5640dd646fc0 newargc=9 2021-11-15T14:39:37.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14489]: starting fuse 2021-11-15T14:39:38.229 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:39:38.241 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:39:38.241 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:39:38.289 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:39:38.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:39:38.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.291 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:39:38.296 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:39:38.297 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:39:38.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.298 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:39:38.298 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:39:38.299 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:39:38.299 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:39:38.299 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:39:38.300 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.300 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:39:38.301 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:39:38.301 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:39:38.302 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.302 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:39:38.302 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:39:38.303 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:39:38.303 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:39:38.304 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.304 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:39:38.305 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:39:38.305 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:39:38.305 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:39:38.306 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:39:38.306 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.307 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:39:38.307 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:39:38.372 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14489.asok 2021-11-15T14:39:38.375 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14489.asok 2021-11-15T14:39:38.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.376 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14489.asok status 2021-11-15T14:39:38.423 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:39:38.424 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:39:38.424 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:39:38.424 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:39:38.424 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:39:38.425 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:39:38.425 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:39:38.425 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14489", 2021-11-15T14:39:38.425 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:39:38.425 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:39:38.426 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:39:38.426 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:39:38.426 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4731, 2021-11-15T14:39:38.426 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:39:38.427 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:39:38.427 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:39:38.427 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4731 2021-11-15T14:39:38.427 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:39:38.427 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:39:38.428 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:39:38.428 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:39:38.428 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1715908457 2021-11-15T14:39:38.428 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:39:38.429 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:39:38.429 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:39:38.429 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:39:38.429 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:39:38.429 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1715908457 2021-11-15T14:39:38.430 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:39:38.430 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4731 172.21.2.138:0/1715908457", 2021-11-15T14:39:38.430 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1715908457", 2021-11-15T14:39:38.430 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:39:38.431 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 33, 2021-11-15T14:39:38.431 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 68, 2021-11-15T14:39:38.431 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:39:38.431 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:39:38.431 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:39:38.432 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:39:38.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.433 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:38.434 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:38.440 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:39:38.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:39:38.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.441 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:38.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:39:38.450 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:39:38.451 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:39:38.456 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:39:38.457 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:39:38.457 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:39:38.458 DEBUG:teuthology.orchestra.run.gibba038:> import sys 2021-11-15T14:39:38.458 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:39:38.459 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:39:38.459 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.459 DEBUG:teuthology.orchestra.run.gibba038:> n = 1000 2021-11-15T14:39:38.460 DEBUG:teuthology.orchestra.run.gibba038:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-15T14:39:38.460 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.461 DEBUG:teuthology.orchestra.run.gibba038:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-15T14:39:38.461 DEBUG:teuthology.orchestra.run.gibba038:> os.makedirs(os.path.dirname(abs_path)) 2021-11-15T14:39:38.461 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:39:38.462 DEBUG:teuthology.orchestra.run.gibba038:> for i in range(0, n): 2021-11-15T14:39:38.462 DEBUG:teuthology.orchestra.run.gibba038:> fname = "{0}_{1}".format(abs_path, i) 2021-11-15T14:39:38.463 DEBUG:teuthology.orchestra.run.gibba038:> with open(fname, '"'"'w'"'"') as f: 2021-11-15T14:39:38.463 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:39:38.464 DEBUG:teuthology.orchestra.run.gibba038:> if True: 2021-11-15T14:39:38.464 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:39:38.464 DEBUG:teuthology.orchestra.run.gibba038:> os.fsync(f.fileno()) 2021-11-15T14:39:38.465 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:39:42.241 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:42.245 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:42.248 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:42.250 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:39:55.169 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:55.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 Processor -- start 2021-11-15T14:39:55.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- start start 2021-11-15T14:39:55.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 0x7f88dc0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f88dc0aa650 0x7f88dc13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0b6d60 con 0x7f88dc060990 2021-11-15T14:39:55.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc061260 con 0x7f88dc0aa650 2021-11-15T14:39:55.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc061500 con 0x7f88dc0b6980 2021-11-15T14:39:55.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e0d84700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f88dc060990 0x7f88dc0a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46362/0 (socket says 172.21.2.135:46362) 2021-11-15T14:39:55.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e0d84700 1 -- 172.21.2.135:0/3714395302 learned_addr learned my addr 172.21.2.135:0/3714395302 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:55.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533250677 0 0) 0x7f88dc0b6d60 con 0x7f88dc060990 2021-11-15T14:39:55.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c4003260 con 0x7f88dc060990 2021-11-15T14:39:55.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1585700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 0x7f88dc0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3714395302 >> v2:172.21.2.119:3300/0 conn(0x7f88dc0aa650 0x7f88dc13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1995606735 0 0) 0x7f88c4003260 con 0x7f88dc060990 2021-11-15T14:39:55.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 msgr2=0x7f88dc0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 0x7f88dc0acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 >> v2:172.21.2.119:3300/0 conn(0x7f88dc0aa650 msgr2=0x7f88dc13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 --2- 172.21.2.135:0/3714395302 >> v2:172.21.2.119:3300/0 conn(0x7f88dc0aa650 0x7f88dc13c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0617a0 con 0x7f88dc060990 2021-11-15T14:39:55.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f88cc001680 con 0x7f88dc060990 2021-11-15T14:39:55.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 >> v1:172.21.2.135:6789/0 conn(0x7f88dc060990 legacy=0x7f88dc0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 0x7f88c40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88c4003e00 0x7f88c4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88c40049f0 0x7f88c4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc061260 con 0x7f88c4003e00 2021-11-15T14:39:55.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc061500 con 0x7f88c40049f0 2021-11-15T14:39:55.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c400fcf0 con 0x7f88dc0b6980 2021-11-15T14:39:55.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88c40049f0 0x7f88c4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 -- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 msgr2=0x7f88c40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88dc0b6980 0x7f88c40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 -- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88c4003e00 msgr2=0x7f88c4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88c4003e00 0x7f88c4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 -- 172.21.2.135:0/3714395302 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4003260 con 0x7f88c40049f0 2021-11-15T14:39:55.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88c40049f0 0x7f88c4004e70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f88d400b000 tx=0x7f88d4008040).ready entity=mon.1 client_cookie=345ff7883f691ffb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d400d7e0 con 0x7f88c40049f0 2021-11-15T14:39:55.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d400d940 con 0x7f88c40049f0 2021-11-15T14:39:55.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88cbfff700 1 -- 172.21.2.135:0/3714395302 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d400dca0 con 0x7f88c40049f0 2021-11-15T14:39:55.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- 172.21.2.135:0/3714395302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88c40049f0 msgr2=0x7f88c4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3714395302 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88c40049f0 0x7f88c4004e70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f88d400b000 tx=0x7f88d4008040).stop 2021-11-15T14:39:55.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e1d86700 1 -- 172.21.2.135:0/3714395302 reap_dead start 2021-11-15T14:39:55.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- 172.21.2.135:0/3714395302 shutdown_connections 2021-11-15T14:39:55.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- 172.21.2.135:0/3714395302 >> 172.21.2.135:0/3714395302 conn(0x7f88dc0b3500 msgr2=0x7f88dc0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- 172.21.2.135:0/3714395302 shutdown_connections 2021-11-15T14:39:55.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.244+0000 7f88e37e9700 1 -- 172.21.2.135:0/3714395302 wait complete. 2021-11-15T14:39:55.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 Processor -- start 2021-11-15T14:39:55.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- start start 2021-11-15T14:39:55.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88c40049f0 0x7f88dc131760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88dc13e1f0 0x7f88dc12f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0adfe0 con 0x7f88dc13e1f0 2021-11-15T14:39:55.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0ad600 con 0x7f88dc12fa80 2021-11-15T14:39:55.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0ad8a0 con 0x7f88c40049f0 2021-11-15T14:39:55.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58784/0 (socket says 172.21.2.135:58784) 2021-11-15T14:39:55.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 -- 172.21.2.135:0/3469837942 learned_addr learned my addr 172.21.2.135:0/3469837942 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 -- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88c40049f0 msgr2=0x7f88dc131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88c40049f0 0x7f88dc131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 -- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88dc13e1f0 msgr2=0x7f88dc12f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88dc13e1f0 0x7f88dc12f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 -- 172.21.2.135:0/3469837942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0adb40 con 0x7f88dc12fa80 2021-11-15T14:39:55.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1d86700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f88dc0b29b0 tx=0x7f88d4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d40118b0 con 0x7f88dc12fa80 2021-11-15T14:39:55.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4011a10 con 0x7f88dc12fa80 2021-11-15T14:39:55.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc12ff00 con 0x7f88dc12fa80 2021-11-15T14:39:55.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d4011d70 con 0x7f88dc12fa80 2021-11-15T14:39:55.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0b1270 con 0x7f88dc12fa80 2021-11-15T14:39:55.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0adcd0 con 0x7f88dc12fa80 2021-11-15T14:39:55.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88d402b070 con 0x7f88dc12fa80 2021-11-15T14:39:55.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 0x7f88bc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f88d406cd60 con 0x7f88dc12fa80 2021-11-15T14:39:55.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1585700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 0x7f88bc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.248+0000 7f88e1585700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 0x7f88bc055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f88d800c000 tx=0x7f88d8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.252+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88d4043d10 con 0x7f88dc12fa80 2021-11-15T14:39:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88dc061a40 con 0x7f88dc12fa80 2021-11-15T14:39:55.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88ca7fc700 1 -- 172.21.2.135:0/3469837942 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f88d4029020 con 0x7f88dc12fa80 2021-11-15T14:39:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:55.364 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:55.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 msgr2=0x7f88bc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 0x7f88bc055a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f88d800c000 tx=0x7f88d8008040).stop 2021-11-15T14:39:55.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 msgr2=0x7f88dc0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f88dc0b29b0 tx=0x7f88d4008040).stop 2021-11-15T14:39:55.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 shutdown_connections 2021-11-15T14:39:55.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88bc0535b0 0x7f88bc055a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88dc12fa80 0x7f88dc0b1b70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88dc13e1f0 0x7f88dc12f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 --2- 172.21.2.135:0/3469837942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88c40049f0 0x7f88dc131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 >> 172.21.2.135:0/3469837942 conn(0x7f88dc0b3500 msgr2=0x7f88dc0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 shutdown_connections 2021-11-15T14:39:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.360+0000 7f88e37e9700 1 -- 172.21.2.135:0/3469837942 wait complete. 2021-11-15T14:39:55.368 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:55.371 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-15T14:39:55.430 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-15T14:39:55.430 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-15T14:39:55.431 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:55.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 Processor -- start 2021-11-15T14:39:55.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 -- start start 2021-11-15T14:39:55.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 0x7fafd00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fafd00a7140 0x7fafd01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00b03d0 con 0x7fafd0148420 2021-11-15T14:39:55.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd00a9140 con 0x7fafd00a7140 2021-11-15T14:39:55.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.476+0000 7fafd814b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00b0670 con 0x7fafd00b1e30 2021-11-15T14:39:55.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 0x7fafd00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd56e6700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fafd0148420 0x7fafd00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:55798/0 (socket says 172.21.2.135:55798) 2021-11-15T14:39:55.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd56e6700 1 -- 172.21.2.135:0/3947989425 learned_addr learned my addr 172.21.2.135:0/3947989425 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:55.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd66e8700 1 --2- 172.21.2.135:0/3947989425 >> v2:172.21.2.119:3300/0 conn(0x7fafd00a7140 0x7fafd01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3947989425 >> v2:172.21.2.119:3300/0 conn(0x7fafd00a7140 msgr2=0x7fafd01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 --2- 172.21.2.135:0/3947989425 >> v2:172.21.2.119:3300/0 conn(0x7fafd00a7140 0x7fafd01447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3947989425 >> v1:172.21.2.119:6789/0 conn(0x7fafd0148420 legacy=0x7fafd00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3947989425 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00b0910 con 0x7fafd00b1e30 2021-11-15T14:39:55.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd5ee7700 1 --2- 172.21.2.135:0/3947989425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 0x7fafd00b1050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fafc4002f70 tx=0x7fafc4006df0).ready entity=mon.2 client_cookie=dc9c784156c7ba37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd4ee5700 1 -- 172.21.2.135:0/3947989425 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc400d570 con 0x7fafd00b1e30 2021-11-15T14:39:55.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd4ee5700 1 -- 172.21.2.135:0/3947989425 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4000e90 con 0x7fafd00b1e30 2021-11-15T14:39:55.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd4ee5700 1 -- 172.21.2.135:0/3947989425 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc400d8c0 con 0x7fafd00b1e30 2021-11-15T14:39:55.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 -- 172.21.2.135:0/3947989425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 msgr2=0x7fafd00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 --2- 172.21.2.135:0/3947989425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 0x7fafd00b1050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fafc4002f70 tx=0x7fafc4006df0).stop 2021-11-15T14:39:55.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 -- 172.21.2.135:0/3947989425 shutdown_connections 2021-11-15T14:39:55.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 --2- 172.21.2.135:0/3947989425 >> v2:172.21.2.119:3300/0 conn(0x7fafd00a7140 0x7fafd01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 --2- 172.21.2.135:0/3947989425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd00b1e30 0x7fafd00b1050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 -- 172.21.2.135:0/3947989425 >> 172.21.2.135:0/3947989425 conn(0x7fafd005f730 msgr2=0x7fafd005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 -- 172.21.2.135:0/3947989425 shutdown_connections 2021-11-15T14:39:55.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.480+0000 7fafd814b700 1 -- 172.21.2.135:0/3947989425 wait complete. 2021-11-15T14:39:55.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 Processor -- start 2021-11-15T14:39:55.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- start start 2021-11-15T14:39:55.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fafd00b1e30 0x7fafd0064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd0148420 0x7fafd0064770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00637e0 con 0x7fafd00b1e30 2021-11-15T14:39:55.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0063110 con 0x7fafd00a7140 2021-11-15T14:39:55.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00673f0 con 0x7fafd0148420 2021-11-15T14:39:55.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58798/0 (socket says 172.21.2.135:58798) 2021-11-15T14:39:55.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3172451144 learned_addr learned my addr 172.21.2.135:0/3172451144 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd0148420 msgr2=0x7fafd0064770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd0148420 0x7fafd0064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fafd00b1e30 msgr2=0x7fafd0064280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fafd00b1e30 0x7fafd0064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 -- 172.21.2.135:0/3172451144 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc400b180 con 0x7fafd00a7140 2021-11-15T14:39:55.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd5ee7700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fafd00664c0 tx=0x7fafc4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc400de40 con 0x7fafd00a7140 2021-11-15T14:39:55.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc401e400 con 0x7fafd00a7140 2021-11-15T14:39:55.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc401e760 con 0x7fafd00a7140 2021-11-15T14:39:55.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd0063340 con 0x7fafd00a7140 2021-11-15T14:39:55.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd00afa40 con 0x7fafd00a7140 2021-11-15T14:39:55.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0067250 con 0x7fafd00a7140 2021-11-15T14:39:55.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fafc4025030 con 0x7fafd00a7140 2021-11-15T14:39:55.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 0x7fafb0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fafc406c960 con 0x7fafd00a7140 2021-11-15T14:39:55.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.484+0000 7fafd56e6700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 0x7fafb0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.488+0000 7fafd56e6700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 0x7fafb0055b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fafd0061420 tx=0x7fafcc007860).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.488+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fafd0067250 con 0x7fafd00a7140 2021-11-15T14:39:55.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafd0067250 con 0x7fafd00a7140 2021-11-15T14:39:55.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafc2ffd700 1 -- 172.21.2.135:0/3172451144 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fafd0067250 con 0x7fafd00a7140 2021-11-15T14:39:55.600 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:55.600 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:55.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 msgr2=0x7fafb0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 0x7fafb0055b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fafd0061420 tx=0x7fafcc007860).stop 2021-11-15T14:39:55.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 msgr2=0x7fafd00af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fafd00664c0 tx=0x7fafc4014000).stop 2021-11-15T14:39:55.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 shutdown_connections 2021-11-15T14:39:55.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fafb00536a0 0x7fafb0055b60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fafd0148420 0x7fafd0064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fafd00b1e30 0x7fafd0064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 --2- 172.21.2.135:0/3172451144 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fafd00a7140 0x7fafd00af270 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 >> 172.21.2.135:0/3172451144 conn(0x7fafd005f730 msgr2=0x7fafd0143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 shutdown_connections 2021-11-15T14:39:55.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.596+0000 7fafd814b700 1 -- 172.21.2.135:0/3172451144 wait complete. 2021-11-15T14:39:55.604 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:55.607 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-15T14:39:55.663 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-15T14:39:55.664 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-15T14:39:55.664 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:39:55.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 Processor -- start 2021-11-15T14:39:55.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 -- start start 2021-11-15T14:39:55.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f79e013d8a0 0x7f79e00608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 0x7f79e0060da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00669e0 con 0x7f79e00b6400 2021-11-15T14:39:55.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0066c80 con 0x7f79e013d8a0 2021-11-15T14:39:55.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79df59e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0066f20 con 0x7f79e00b0d50 2021-11-15T14:39:55.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79ddd9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f79e013d8a0 0x7f79e00608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79ded9d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 0x7f79e0060da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79de59c700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f79e00b6400 0x7f79e013d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:55808/0 (socket says 172.21.2.135:55808) 2021-11-15T14:39:55.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.712+0000 7f79de59c700 1 -- 172.21.2.135:0/2921744156 learned_addr learned my addr 172.21.2.135:0/2921744156 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:39:55.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ded9d700 1 -- 172.21.2.135:0/2921744156 >> v2:172.21.2.119:3300/0 conn(0x7f79e013d8a0 msgr2=0x7f79e00608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ded9d700 1 --2- 172.21.2.135:0/2921744156 >> v2:172.21.2.119:3300/0 conn(0x7f79e013d8a0 0x7f79e00608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ded9d700 1 -- 172.21.2.135:0/2921744156 >> v1:172.21.2.119:6789/0 conn(0x7f79e00b6400 legacy=0x7f79e013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ded9d700 1 -- 172.21.2.135:0/2921744156 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00671c0 con 0x7f79e00b0d50 2021-11-15T14:39:55.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ded9d700 1 --2- 172.21.2.135:0/2921744156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 0x7f79e0060da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f79d80032f0 tx=0x7f79d80091d0).ready entity=mon.2 client_cookie=16859d5c62262afe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79dd59a700 1 -- 172.21.2.135:0/2921744156 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d800b6c0 con 0x7f79e00b0d50 2021-11-15T14:39:55.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79dd59a700 1 -- 172.21.2.135:0/2921744156 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800b820 con 0x7f79e00b0d50 2021-11-15T14:39:55.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79dd59a700 1 -- 172.21.2.135:0/2921744156 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d800b990 con 0x7f79e00b0d50 2021-11-15T14:39:55.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/2921744156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 msgr2=0x7f79e0060da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- 172.21.2.135:0/2921744156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 0x7f79e0060da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f79d80032f0 tx=0x7f79d80091d0).stop 2021-11-15T14:39:55.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/2921744156 shutdown_connections 2021-11-15T14:39:55.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- 172.21.2.135:0/2921744156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e00b0d50 0x7f79e0060da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- 172.21.2.135:0/2921744156 >> v2:172.21.2.119:3300/0 conn(0x7f79e013d8a0 0x7f79e00608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/2921744156 >> 172.21.2.135:0/2921744156 conn(0x7f79e00636f0 msgr2=0x7f79e0063ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/2921744156 shutdown_connections 2021-11-15T14:39:55.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/2921744156 wait complete. 2021-11-15T14:39:55.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 Processor -- start 2021-11-15T14:39:55.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- start start 2021-11-15T14:39:55.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79e00b0d50 0x7f79e0148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e013d8a0 0x7f79e0146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00aa2c0 con 0x7f79e00b0d50 2021-11-15T14:39:55.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e014a030 con 0x7f79e00b6400 2021-11-15T14:39:55.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01484e0 con 0x7f79e013d8a0 2021-11-15T14:39:55.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58812/0 (socket says 172.21.2.135:58812) 2021-11-15T14:39:55.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 -- 172.21.2.135:0/755346263 learned_addr learned my addr 172.21.2.135:0/755346263 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 -- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e013d8a0 msgr2=0x7f79e0146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e013d8a0 0x7f79e0146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 -- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79e00b0d50 msgr2=0x7f79e0148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79e00b0d50 0x7f79e0148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 -- 172.21.2.135:0/755346263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009470 con 0x7f79e00b6400 2021-11-15T14:39:55.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79ddd9b700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f79d400c000 tx=0x7f79d4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d4010780 con 0x7f79e00b6400 2021-11-15T14:39:55.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d40108e0 con 0x7f79e00b6400 2021-11-15T14:39:55.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e014a260 con 0x7f79e00b6400 2021-11-15T14:39:55.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d4010c40 con 0x7f79e00b6400 2021-11-15T14:39:55.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00aa750 con 0x7f79e00b6400 2021-11-15T14:39:55.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e0147c10 con 0x7f79e00b6400 2021-11-15T14:39:55.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79d401c460 con 0x7f79e00b6400 2021-11-15T14:39:55.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 0x7f79bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.716+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f79d406bf50 con 0x7f79e00b6400 2021-11-15T14:39:55.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.720+0000 7f79de59c700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 0x7f79bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.720+0000 7f79de59c700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 0x7f79bc055ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f79e00633c0 tx=0x7f79d0007820).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.720+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79d4042e60 con 0x7f79e00b6400 2021-11-15T14:39:55.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79e014a3f0 con 0x7f79e00b6400 2021-11-15T14:39:55.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79cf7fe700 1 -- 172.21.2.135:0/755346263 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f79d4046480 con 0x7f79e00b6400 2021-11-15T14:39:55.836 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:39:55.836 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:39:55.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 msgr2=0x7f79bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 0x7f79bc055ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f79e00633c0 tx=0x7f79d0007820).stop 2021-11-15T14:39:55.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 msgr2=0x7f79e0147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f79d400c000 tx=0x7f79d4006df0).stop 2021-11-15T14:39:55.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 shutdown_connections 2021-11-15T14:39:55.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79bc053610 0x7f79bc055ad0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79e013d8a0 0x7f79e0146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79e00b6400 0x7f79e0147e10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 --2- 172.21.2.135:0/755346263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79e00b0d50 0x7f79e0148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 >> 172.21.2.135:0/755346263 conn(0x7f79e00636f0 msgr2=0x7f79e01437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 shutdown_connections 2021-11-15T14:39:55.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.832+0000 7f79df59e700 1 -- 172.21.2.135:0/755346263 wait complete. 2021-11-15T14:39:55.840 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:39:55.843 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-11-15T14:39:55.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 Processor -- start 2021-11-15T14:39:55.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- start start 2021-11-15T14:39:55.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f90300b1470 0x7f90300b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f903014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90300b1850 con 0x7f903005f730 2021-11-15T14:39:55.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300b3370 con 0x7f90300b1470 2021-11-15T14:39:55.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300b3610 con 0x7f90300adfa0 2021-11-15T14:39:55.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f90300b1470 0x7f90300b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f90300b1470 0x7f90300b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58818/0 (socket says 172.21.2.135:58818) 2021-11-15T14:39:55.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 -- 172.21.2.135:0/3934806814 learned_addr learned my addr 172.21.2.135:0/3934806814 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 -- 172.21.2.135:0/3934806814 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 msgr2=0x7f903014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 --2- 172.21.2.135:0/3934806814 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f903014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 -- 172.21.2.135:0/3934806814 >> v1:172.21.2.119:6789/0 conn(0x7f903005f730 legacy=0x7f903005fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 -- 172.21.2.135:0/3934806814 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300b38b0 con 0x7f90300b1470 2021-11-15T14:39:55.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902e59c700 1 --2- 172.21.2.135:0/3934806814 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90300b1470 0x7f90300b28a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f90300b0bd0 tx=0x7f9020006eb0).ready entity=mon.1 client_cookie=d719797e368c4732 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902d59a700 1 -- 172.21.2.135:0/3934806814 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902000d570 con 0x7f90300b1470 2021-11-15T14:39:55.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902d59a700 1 -- 172.21.2.135:0/3934806814 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020000e90 con 0x7f90300b1470 2021-11-15T14:39:55.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f902d59a700 1 -- 172.21.2.135:0/3934806814 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902000d900 con 0x7f90300b1470 2021-11-15T14:39:55.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- 172.21.2.135:0/3934806814 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90300b1470 msgr2=0x7f90300b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 --2- 172.21.2.135:0/3934806814 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90300b1470 0x7f90300b28a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f90300b0bd0 tx=0x7f9020006eb0).stop 2021-11-15T14:39:55.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- 172.21.2.135:0/3934806814 shutdown_connections 2021-11-15T14:39:55.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 --2- 172.21.2.135:0/3934806814 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f903014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 --2- 172.21.2.135:0/3934806814 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90300b1470 0x7f90300b28a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- 172.21.2.135:0/3934806814 >> 172.21.2.135:0/3934806814 conn(0x7f9030060840 msgr2=0x7f9030060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- 172.21.2.135:0/3934806814 shutdown_connections 2021-11-15T14:39:55.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- 172.21.2.135:0/3934806814 wait complete. 2021-11-15T14:39:55.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 Processor -- start 2021-11-15T14:39:55.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.896+0000 7f9034eeb700 1 -- start start 2021-11-15T14:39:55.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f90301570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90300b1470 0x7f90301575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300664f0 con 0x7f90300b1470 2021-11-15T14:39:55.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030157ac0 con 0x7f903005f730 2021-11-15T14:39:55.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903014d1c0 con 0x7f90300adfa0 2021-11-15T14:39:55.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58824/0 (socket says 172.21.2.135:58824) 2021-11-15T14:39:55.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/956190496 learned_addr learned my addr 172.21.2.135:0/956190496 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 msgr2=0x7f90301570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f90301570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90300b1470 msgr2=0x7f90301575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90300b1470 0x7f90301575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/956190496 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902000b1e0 con 0x7f903005f730 2021-11-15T14:39:55.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f90300b0bd0 tx=0x7f9020015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 -- 172.21.2.135:0/956190496 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9020006be0 con 0x7f903005f730 2021-11-15T14:39:55.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 -- 172.21.2.135:0/956190496 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020002f50 con 0x7f903005f730 2021-11-15T14:39:55.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903014d460 con 0x7f903005f730 2021-11-15T14:39:55.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 -- 172.21.2.135:0/956190496 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902000de40 con 0x7f903005f730 2021-11-15T14:39:55.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9030065d60 con 0x7f903005f730 2021-11-15T14:39:55.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 -- 172.21.2.135:0/956190496 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9020025030 con 0x7f903005f730 2021-11-15T14:39:55.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 0x7f9014055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f90277fe700 1 -- 172.21.2.135:0/956190496 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f902006ce30 con 0x7f903005f730 2021-11-15T14:39:55.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902dd9b700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 0x7f9014055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 Processor -- start 2021-11-15T14:39:55.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 -- start start 2021-11-15T14:39:55.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x1935090 0x192db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x1965680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x18a37f0 con 0x1935090 2021-11-15T14:39:55.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x1883c70 con 0x196cc90 2021-11-15T14:39:55.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x196d070 con 0x19651d0 2021-11-15T14:39:55.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58832/0 (socket says 172.21.2.135:58832) 2021-11-15T14:39:55.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/3838415535 learned_addr learned my addr 172.21.2.135:0/3838415535 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 msgr2=0x1965680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x1965680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x1935090 msgr2=0x192db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x1935090 0x192db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 -- 172.21.2.135:0/3838415535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18da960 con 0x196cc90 2021-11-15T14:39:55.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f902e59c700 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x19324b0 tx=0x7f9020011000).ready entity=mon.1 client_cookie=fea3957f50ced6a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- 172.21.2.135:0/3838415535 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9020047a00 con 0x196cc90 2021-11-15T14:39:55.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- 172.21.2.135:0/3838415535 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020043850 con 0x196cc90 2021-11-15T14:39:55.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.900+0000 7f9034eeb700 1 -- 172.21.2.135:0/3838415535 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9020043bb0 con 0x196cc90 2021-11-15T14:39:55.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/3838415535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 msgr2=0x19325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x19324b0 tx=0x7f9020011000).stop 2021-11-15T14:39:55.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902dd9b700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 0x7f9014055a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f9018002f70 tx=0x7f9018006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/3838415535 shutdown_connections 2021-11-15T14:39:55.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x1965680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x1935090 0x192db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/3838415535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x19325d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/3838415535 >> 172.21.2.135:0/3838415535 conn(0x192ef00 msgr2=0x196c220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/3838415535 shutdown_connections 2021-11-15T14:39:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/3838415535 wait complete. 2021-11-15T14:39:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- start start 2021-11-15T14:39:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 Processor -- start 2021-11-15T14:39:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x19380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x196cc90 0x197b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x193a3b0 con 0x196cc90 2021-11-15T14:39:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x1939bd0 con 0x197b510 2021-11-15T14:39:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1939e70 con 0x19651d0 2021-11-15T14:39:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 10 client.0 ll_register_callbacks cb 0x18972f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:39:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58842/0 (socket says 172.21.2.135:58842) 2021-11-15T14:39:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 -- 172.21.2.135:0/2638606051 learned_addr learned my addr 172.21.2.135:0/2638606051 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 -- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 msgr2=0x19380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x19380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 -- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x196cc90 msgr2=0x197b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x196cc90 0x197b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 -- 172.21.2.135:0/2638606051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9030065d60 con 0x197b510 2021-11-15T14:39:55.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902ed9d700 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f9028003310 tx=0x7f90280090f0).ready entity=mon.1 client_cookie=c3f5112a8ca30f47 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:39:55.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902800be30 con 0x197b510 2021-11-15T14:39:55.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9028012d80 con 0x197b510 2021-11-15T14:39:55.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18998b0 con 0x197b510 2021-11-15T14:39:55.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f902801a3a0 con 0x197b510 2021-11-15T14:39:55.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 10 client.6082 fetch_fsmap learned FSMap version 33 2021-11-15T14:39:55.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1892ea0 con 0x197b510 2021-11-15T14:39:55.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18998b0 con 0x197b510 2021-11-15T14:39:55.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 33) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f902801ab10 con 0x197b510 2021-11-15T14:39:55.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 10 client.6082 fetch_fsmap finished waiting for FSMap version 33 2021-11-15T14:39:55.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 10 client.6082 resolve_mds: resolved ID 'a' to GID 5908 2021-11-15T14:39:55.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 20 client.6082 populate_metadata read hostname 'gibba035' 2021-11-15T14:39:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x196adb0 0x196b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 4 client.6082 mds_command: new command op to 5908 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-15T14:39:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 --> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1891930 con 0x196adb0 2021-11-15T14:39:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902e59c700 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x196adb0 0x196b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f902e59c700 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x196adb0 0x196b1b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=165c1362148918ea server_cookie=dbdeaf9c823f4ac2 in_seq=0 out_seq=0 2021-11-15T14:39:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 10 client.6082 ms_handle_connect on v2:172.21.2.135:6833/2659643829 2021-11-15T14:39:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 1 -- 172.21.2.135:0/2638606051 <== mds.0 v2:172.21.2.135:6833/2659643829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1891930 con 0x196adb0 2021-11-15T14:39:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 10 client.6082 handle_command_reply: tid=0 2021-11-15T14:39:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 client.6082 shutdown 2021-11-15T14:39:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 msgr2=0x1935e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f9028003310 tx=0x7f90280090f0).stop 2021-11-15T14:39:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 shutdown_connections 2021-11-15T14:39:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x196adb0 0x196b1b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x1935e00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x196cc90 0x197b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 --2- 172.21.2.135:0/2638606051 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x19651d0 0x19380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 >> 172.21.2.135:0/2638606051 conn(0x1935090 msgr2=0x1969400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f900d7fa700 0 client.6082 ms_handle_reset on v2:172.21.2.135:6833/2659643829 2021-11-15T14:39:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 shutdown_connections 2021-11-15T14:39:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 1 -- 172.21.2.135:0/2638606051 wait complete. 2021-11-15T14:39:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.904+0000 7f903f12f740 20 client.6082 trim_cache size 0 max 16384 2021-11-15T14:39:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 Processor -- start 2021-11-15T14:39:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- start start 2021-11-15T14:39:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19655b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x197b510 0x1974480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1877d60 con 0x19651d0 2021-11-15T14:39:55.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x19648c0 con 0x196cc90 2021-11-15T14:39:55.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1883c70 con 0x197b510 2021-11-15T14:39:55.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58850/0 (socket says 172.21.2.135:58850) 2021-11-15T14:39:55.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 -- 172.21.2.135:0/957735650 learned_addr learned my addr 172.21.2.135:0/957735650 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 -- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x197b510 msgr2=0x1974480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:55.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x197b510 0x1974480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 -- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 msgr2=0x19655b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:39:55.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19655b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 -- 172.21.2.135:0/957735650 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x189ba90 con 0x196cc90 2021-11-15T14:39:55.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f902dd9b700 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f9018006af0 tx=0x7f9018011000).ready entity=mon.1 client_cookie=ce457c5c2ebc6aaa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f900f7fe700 1 -- 172.21.2.135:0/957735650 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9018016710 con 0x196cc90 2021-11-15T14:39:55.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f900f7fe700 1 -- 172.21.2.135:0/957735650 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018016870 con 0x196cc90 2021-11-15T14:39:55.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f900f7fe700 1 -- 172.21.2.135:0/957735650 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9018016bd0 con 0x196cc90 2021-11-15T14:39:55.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- 172.21.2.135:0/957735650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 msgr2=0x1965aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:39:55.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f9018006af0 tx=0x7f9018011000).stop 2021-11-15T14:39:55.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- 172.21.2.135:0/957735650 shutdown_connections 2021-11-15T14:39:55.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x197b510 0x1974480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x196cc90 0x1965aa0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:39:55.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 --2- 172.21.2.135:0/957735650 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- 172.21.2.135:0/957735650 >> 172.21.2.135:0/957735650 conn(0x1935090 msgr2=0x19315d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:39:55.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- 172.21.2.135:0/957735650 shutdown_connections 2021-11-15T14:39:55.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.912+0000 7f903f12f740 1 -- 172.21.2.135:0/957735650 wait complete. 2021-11-15T14:39:55.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- start start 2021-11-15T14:39:55.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 Processor -- start 2021-11-15T14:39:55.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x196cc90 0x19cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x19681a0 con 0x19651d0 2021-11-15T14:39:55.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x19697e0 con 0x197b510 2021-11-15T14:39:55.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1968a60 con 0x196cc90 2021-11-15T14:39:55.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 10 client.0 ll_register_callbacks cb 0x1939b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-15T14:39:55.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58854/0 (socket says 172.21.2.135:58854) 2021-11-15T14:39:55.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 -- 172.21.2.135:0/3951082907 learned_addr learned my addr 172.21.2.135:0/3951082907 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:39:55.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 -- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x196cc90 msgr2=0x19cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x196cc90 0x19cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 -- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 msgr2=0x19cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:39:55.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:39:55.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 -- 172.21.2.135:0/3951082907 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9018015400 con 0x197b510 2021-11-15T14:39:55.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902ed9d700 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f9028003310 tx=0x7f9028014000).ready entity=mon.1 client_cookie=c1cfa4a5474c71d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:39:55.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 10 client.0 ms_handle_connect on v2:172.21.2.135:3300/0 2021-11-15T14:39:55.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9028010940 con 0x197b510 2021-11-15T14:39:55.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mon.1 v2:172.21.2.135:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9028025d80 con 0x197b510 2021-11-15T14:39:55.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9020043850 con 0x197b510 2021-11-15T14:39:55.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9028006dc0 con 0x197b510 2021-11-15T14:39:55.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 10 client.6088 fetch_fsmap learned FSMap version 33 2021-11-15T14:39:55.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1898480 con 0x197b510 2021-11-15T14:39:55.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mon.1 v2:172.21.2.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020043850 con 0x197b510 2021-11-15T14:39:55.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mon.1 v2:172.21.2.135:3300/0 5 ==== fsmap(e 33) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f902801a9b0 con 0x197b510 2021-11-15T14:39:55.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 10 client.6088 fetch_fsmap finished waiting for FSMap version 33 2021-11-15T14:39:55.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 10 client.6088 resolve_mds: resolved ID 'a' to GID 5908 2021-11-15T14:39:55.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 20 client.6088 populate_metadata read hostname 'gibba035' 2021-11-15T14:39:55.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x19693d0 0x19ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:39:55.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 4 client.6088 mds_command: new command op to 5908 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-11-15T14:39:55.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 --> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x17875e0 con 0x19693d0 2021-11-15T14:39:55.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902e59c700 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x19693d0 0x19ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:39:55.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f902e59c700 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x19693d0 0x19ce690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2d6140dc624e4716 server_cookie=cfaed64200311a99 in_seq=0 out_seq=0 2021-11-15T14:39:55.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:39:55.916+0000 7f900e7fc700 10 client.6088 ms_handle_connect on v2:172.21.2.135:6833/2659643829 2021-11-15T14:40:06.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f900e7fc700 1 -- 172.21.2.135:0/3951082907 <== mds.0 v2:172.21.2.135:6833/2659643829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x17875e0 con 0x19693d0 2021-11-15T14:40:06.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f900e7fc700 10 client.6088 handle_command_reply: tid=0 2021-11-15T14:40:06.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 client.6088 shutdown 2021-11-15T14:40:06.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 msgr2=0x19ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f9028003310 tx=0x7f9028014000).stop 2021-11-15T14:40:06.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 shutdown_connections 2021-11-15T14:40:06.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:6833/2659643829,v1:172.21.2.135:6835/2659643829] conn(0x19693d0 0x19ce690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x197b510 0x19ce1a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x196cc90 0x19cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 --2- 172.21.2.135:0/3951082907 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x19651d0 0x19cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 >> 172.21.2.135:0/3951082907 conn(0x1935090 msgr2=0x19655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:06.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f900e7fc700 0 client.6088 ms_handle_reset on v2:172.21.2.135:6833/2659643829 2021-11-15T14:40:06.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 shutdown_connections 2021-11-15T14:40:06.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 1 -- 172.21.2.135:0/3951082907 wait complete. 2021-11-15T14:40:06.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f903f12f740 20 client.6088 trim_cache size 0 max 16384 2021-11-15T14:40:06.075 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:40:06.076 INFO:teuthology.orchestra.run.gibba035.stdout: "client_recall": { 2021-11-15T14:40:06.077 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": -110, 2021-11-15T14:40:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "(110) Connection timed out", 2021-11-15T14:40:06.078 INFO:teuthology.orchestra.run.gibba035.stdout: "recalled": 240 2021-11-15T14:40:06.081 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: "flush_journal": { 2021-11-15T14:40:06.082 INFO:teuthology.orchestra.run.gibba035.stdout: "return_code": 0, 2021-11-15T14:40:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: "message": "" 2021-11-15T14:40:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.083 INFO:teuthology.orchestra.run.gibba035.stdout: "trim_cache": { 2021-11-15T14:40:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: "trimmed": 220 2021-11-15T14:40:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: "cache": { 2021-11-15T14:40:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": { 2021-11-15T14:40:06.084 INFO:teuthology.orchestra.run.gibba035.stdout: "items": 15446, 2021-11-15T14:40:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes": 2428448 2021-11-15T14:40:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.085 INFO:teuthology.orchestra.run.gibba035.stdout: "duration": 10.138614832 2021-11-15T14:40:06.086 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:40:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 msgr2=0x7f9014055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 0x7f9014055a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f9018002f70 tx=0x7f9018006a80).stop 2021-11-15T14:40:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 msgr2=0x7f90300657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f90300b0bd0 tx=0x7f9020015000).stop 2021-11-15T14:40:06.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 shutdown_connections 2021-11-15T14:40:06.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f90140535b0 0x7f9014055a70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90300b1470 0x7f90301575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90300adfa0 0x7f90301570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 --2- 172.21.2.135:0/956190496 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f903005f730 0x7f90300657f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 >> 172.21.2.135:0/956190496 conn(0x7f9030060840 msgr2=0x7f903014bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:06.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 shutdown_connections 2021-11-15T14:40:06.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.056+0000 7f9034eeb700 1 -- 172.21.2.135:0/956190496 wait complete. 2021-11-15T14:40:06.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:40:06.092 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:06.124 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:06.142 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:06.181 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:06.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:40:06.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:06.199 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:06.200 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:06.255 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:40:06.257 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:40:06.258 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:40:06.258 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:40:06.259 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:06.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14489]: fuse finished with error 0 and tester_r 0 2021-11-15T14:40:06.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:06.322 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:06.323 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:06.379 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:40:06.381 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:40:06.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:40:06.415 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:06.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:06.471 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:06.472 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:06.483 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:40:06.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:40:06.485 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:40:06.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:40:06.487 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:06.540 INFO:teuthology.orchestra.run.gibba032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:40:06.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:40:06.543 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:40:06.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.596+0000 7f676b717700 1 Processor -- start 2021-11-15T14:40:06.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.596+0000 7f676b717700 1 -- start start 2021-11-15T14:40:06.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6764148420 0x7f67640b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f67641447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640b03d0 con 0x7f67640b1e30 2021-11-15T14:40:06.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640a9140 con 0x7f6764148420 2021-11-15T14:40:06.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640b0670 con 0x7f67640a7140 2021-11-15T14:40:06.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f67694b3700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f67640b1e30 0x7f67640b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46454/0 (socket says 172.21.2.135:46454) 2021-11-15T14:40:06.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f67694b3700 1 -- 172.21.2.135:0/2311165356 learned_addr learned my addr 172.21.2.135:0/2311165356 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:06.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2311165356 >> v2:172.21.2.135:3300/0 conn(0x7f6764148420 0x7f67640b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:06.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6763fff700 1 -- 172.21.2.135:0/2311165356 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386721967 0 0) 0x7f67640b03d0 con 0x7f67640b1e30 2021-11-15T14:40:06.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6763fff700 1 -- 172.21.2.135:0/2311165356 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6750003260 con 0x7f67640b1e30 2021-11-15T14:40:06.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2311165356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 msgr2=0x7f67641447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:06.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2311165356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f67641447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2311165356 >> v1:172.21.2.135:6789/0 conn(0x7f67640b1e30 legacy=0x7f67640b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2311165356 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640b0910 con 0x7f6764148420 2021-11-15T14:40:06.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2311165356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6764148420 0x7f67640b1050 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f67641477b0 tx=0x7f675c0091d0).ready entity=mon.1 client_cookie=c53733304129b6a8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:06.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6763fff700 1 -- 172.21.2.135:0/2311165356 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c00b680 con 0x7f6764148420 2021-11-15T14:40:06.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6763fff700 1 -- 172.21.2.135:0/2311165356 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00b7e0 con 0x7f6764148420 2021-11-15T14:40:06.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6763fff700 1 -- 172.21.2.135:0/2311165356 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c00b950 con 0x7f6764148420 2021-11-15T14:40:06.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- 172.21.2.135:0/2311165356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6764148420 msgr2=0x7f67640b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- 172.21.2.135:0/2311165356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6764148420 0x7f67640b1050 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f67641477b0 tx=0x7f675c0091d0).stop 2021-11-15T14:40:06.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- 172.21.2.135:0/2311165356 shutdown_connections 2021-11-15T14:40:06.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- 172.21.2.135:0/2311165356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6764148420 0x7f67640b1050 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- 172.21.2.135:0/2311165356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f67641447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- 172.21.2.135:0/2311165356 >> 172.21.2.135:0/2311165356 conn(0x7f676405f730 msgr2=0x7f676405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:06.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- 172.21.2.135:0/2311165356 shutdown_connections 2021-11-15T14:40:06.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- 172.21.2.135:0/2311165356 wait complete. 2021-11-15T14:40:06.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 Processor -- start 2021-11-15T14:40:06.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- start start 2021-11-15T14:40:06.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f676414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6764148420 0x7f67640ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640aab30 con 0x7f6764148420 2021-11-15T14:40:06.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640aa020 con 0x7f67640b1e30 2021-11-15T14:40:06.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f676b717700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a9840 con 0x7f67640a7140 2021-11-15T14:40:06.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:06.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58872/0 (socket says 172.21.2.135:58872) 2021-11-15T14:40:06.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2479742598 learned_addr learned my addr 172.21.2.135:0/2479742598 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:06.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 msgr2=0x7f676414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f676414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6764148420 msgr2=0x7f67640ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6764148420 0x7f67640ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 -- 172.21.2.135:0/2479742598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c009470 con 0x7f67640b1e30 2021-11-15T14:40:06.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.600+0000 7f6768cb2700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f67640aec60 tx=0x7f675c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:06.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c006ea0 con 0x7f67640b1e30 2021-11-15T14:40:06.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c011e90 con 0x7f67640b1e30 2021-11-15T14:40:06.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640a9ae0 con 0x7f67640b1e30 2021-11-15T14:40:06.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640a94c0 con 0x7f67640b1e30 2021-11-15T14:40:06.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c021630 con 0x7f67640b1e30 2021-11-15T14:40:06.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640573d0 con 0x7f67640b1e30 2021-11-15T14:40:06.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f675c027020 con 0x7f67640b1e30 2021-11-15T14:40:06.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 0x7f6744055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:06.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f675c06d070 con 0x7f67640b1e30 2021-11-15T14:40:06.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67694b3700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 0x7f6744055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:06.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67694b3700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 0x7f6744055b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6758001110 tx=0x7f67580076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:06.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.604+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f675c047e60 con 0x7f67640b1e30 2021-11-15T14:40:06.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.688+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f67640acaa0 con 0x7f67640b1e30 2021-11-15T14:40:06.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f67627fc700 1 -- 172.21.2.135:0/2479742598 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v68) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f675c015020 con 0x7f67640b1e30 2021-11-15T14:40:06.695 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:06.696 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:40:06.696 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 68, 2021-11-15T14:40:06.696 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:40:06.696 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:40:06.697 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:39:33.304802+0000", 2021-11-15T14:40:06.697 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:40:06.697 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:40:06.697 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:40:06.698 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:40:06.698 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:40:06.698 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:40:06.698 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:40:06.699 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:40:06.699 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:40:06.699 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:06.700 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:40:06.700 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:40:06.700 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:40:06.700 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:40:06.701 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:40:06.701 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 12, 2021-11-15T14:40:06.701 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:40:06.701 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:40:06.702 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:40:06.702 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:40:06.702 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:40:06.702 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.703 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:40:06.703 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:40:06.703 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:40:06.703 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:06.703 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:06.704 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:06.704 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:06.704 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:06.704 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:06.705 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:06.705 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:06.705 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:40:06.705 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:40:06.705 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:40:06.706 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:40:06.706 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:40:06.706 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:06.706 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:06.707 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:06.707 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:06.707 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:06.707 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:06.707 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:06.708 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.708 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:40:06.708 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:06.708 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:06.709 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:06.709 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:06.709 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:06.709 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:06.709 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:06.710 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:06.710 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:06.710 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:06.710 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:06.711 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:06.711 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:06.711 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:06.711 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:06.712 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:06.712 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:06.712 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:06.712 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:06.712 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:06.713 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:06.713 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:06.713 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:06.713 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:06.714 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:06.714 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:06.714 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.714 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:06.714 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:06.715 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:06.715 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:06.715 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:06.715 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:06.716 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:06.716 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:06.716 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:06.716 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:06.716 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:06.717 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:40:06.717 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:40:06.717 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.717 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:06.718 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:40:06.718 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.718 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.718 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.719 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:40:06.719 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:40:06.719 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:40:06.719 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:06.720 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:06.720 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:06.720 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:06.720 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:06.720 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:06.721 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:06.721 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:06.721 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:40:06.721 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:40:06.722 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:40:06.722 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:40:06.722 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:40:06.722 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:06.722 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:06.723 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:06.723 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:06.723 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:06.723 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:06.724 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:06.724 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.724 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:40:06.724 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:06.724 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:06.725 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:06.725 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:06.725 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:06.725 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:06.726 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:06.726 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:06.726 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:06.726 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:06.726 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:06.727 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:06.727 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:06.727 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:06.727 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:06.728 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:06.728 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:06.728 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:06.728 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:06.728 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:06.729 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:06.729 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:06.729 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:06.729 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:06.730 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:06.730 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:06.730 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.730 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:06.731 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:06.731 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:06.731 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:06.731 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:06.731 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:06.732 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:06.732 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:06.732 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:06.732 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:06.733 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:06.733 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:40:06.733 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:06.733 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:40:06.733 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.734 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.734 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.734 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 11, 2021-11-15T14:40:06.734 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:40:06.735 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:39:30.222386+0000", 2021-11-15T14:40:06.735 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:06.735 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:06.735 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:06.735 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:06.736 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:06.736 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:06.736 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:06.736 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:06.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:40:06.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:40:06.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:40:06.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:40:06.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:40:06.738 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:06.738 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:06.738 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:06.738 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:06.739 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:06.739 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:06.739 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:06.739 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.740 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "67", 2021-11-15T14:40:06.740 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:06.740 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:06.740 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:06.740 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:06.741 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:06.741 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:06.741 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:06.741 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:06.741 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:06.742 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:06.742 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:06.742 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:06.742 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:06.743 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:06.743 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:06.743 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:06.743 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:06.743 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:06.744 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:06.744 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:06.744 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:06.744 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:06.745 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:06.745 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:06.745 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:06.745 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:06.745 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.746 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:06.746 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:06.746 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:06.746 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:06.747 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:06.747 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:06.747 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:06.747 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:06.747 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:06.748 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:06.748 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:06.748 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:40:06.748 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:40:06.749 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:40:06.749 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:40:06.749 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.749 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:06.749 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:40:06.750 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:40:06.750 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.750 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.750 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.751 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.751 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 12, 2021-11-15T14:40:06.751 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:40:06.751 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:39:31.382790+0000", 2021-11-15T14:40:06.752 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:06.752 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:06.752 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:06.752 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:06.752 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:06.753 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:06.753 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:06.753 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:06.753 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:40:06.754 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:40:06.754 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:40:06.754 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:40:06.754 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:40:06.755 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:06.755 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:06.756 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:06.756 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:06.756 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:06.757 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:06.757 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:06.757 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.757 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "68", 2021-11-15T14:40:06.758 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:06.758 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:06.758 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:06.759 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:06.759 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:06.759 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:06.760 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:06.760 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:06.760 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:06.761 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:06.761 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:06.761 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:06.761 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:06.762 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:06.762 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:06.762 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:06.763 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:06.763 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:06.764 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:06.764 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:06.765 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:06.765 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:06.765 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:06.766 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:06.766 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:06.766 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:06.766 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.767 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:06.767 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:06.767 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:06.768 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:06.768 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:06.768 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:06.769 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:06.769 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:06.769 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:06.769 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:06.770 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:06.770 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:40:06.770 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:06.770 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:40:06.771 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:40:06.771 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.771 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.772 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.772 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:06.772 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:40:06.773 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.773 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:40:06.773 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:40:06.774 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.774 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.774 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.775 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.775 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.775 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.776 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.776 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.776 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.776 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.777 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.777 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.777 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.778 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.778 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:40:06.778 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.778 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.779 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.779 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.779 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:40:06.779 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.780 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.780 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.780 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.781 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.781 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.781 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.781 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.782 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:40:06.782 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.782 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.783 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.783 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.783 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:40:06.783 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.784 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.784 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.784 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.784 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.785 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.785 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.785 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.785 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:40:06.786 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.786 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.786 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.786 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.787 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:40:06.787 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.787 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.787 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.788 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.788 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.788 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.788 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.789 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.789 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:40:06.789 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.790 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.790 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.791 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.791 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:40:06.791 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:06.792 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.792 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.792 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.792 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:40:06.793 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:40:06.793 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:40:06.793 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:40:06.793 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.794 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.794 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.794 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.794 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.795 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.795 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:40:06.795 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:40:06.795 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.796 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.796 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.796 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.796 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.797 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.797 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.797 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.797 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.798 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.798 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.798 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.798 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.798 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.799 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:40:06.799 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.799 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.799 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.800 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.800 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:40:06.800 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.801 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.801 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.801 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.801 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.801 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.802 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.802 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.802 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:40:06.802 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.803 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.803 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.803 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.803 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:40:06.804 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.804 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.804 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.804 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.805 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.805 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.805 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.805 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.805 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:40:06.806 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.806 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.806 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.806 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.807 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:40:06.807 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.807 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.807 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.807 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.808 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.808 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.808 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.808 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.809 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:40:06.809 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.809 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.809 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.809 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.810 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:40:06.810 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:06.810 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.810 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.811 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.811 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:40:06.811 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:40:06.811 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:40:06.811 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:40:06.812 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.812 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.812 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.812 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.813 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.813 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.813 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:40:06.813 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:40:06.813 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.814 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.814 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.814 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.814 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.815 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.815 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.815 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.815 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.815 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.816 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.816 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.816 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.816 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.817 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:40:06.817 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.817 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.817 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.817 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.818 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:40:06.818 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.818 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.818 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.819 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.819 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.819 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.820 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.820 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:40:06.820 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.820 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.820 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.821 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.821 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:40:06.821 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.821 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.821 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.822 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.822 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.822 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.822 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.823 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.823 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:40:06.823 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.823 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.824 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.824 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.824 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:40:06.824 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.824 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.825 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.825 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.825 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.825 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.826 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.826 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.826 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:40:06.826 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.826 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.827 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.827 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.827 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:40:06.827 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:06.828 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.828 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.828 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.828 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:40:06.828 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:40:06.829 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:40:06.829 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:40:06.829 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.829 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.830 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.830 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.830 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.830 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.830 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:40:06.831 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:40:06.831 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.831 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.831 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.832 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.832 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.832 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.832 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.832 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 65, 2021-11-15T14:40:06.833 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.833 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.833 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.833 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.834 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.834 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.834 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:40:06.834 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.834 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.835 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.835 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.835 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:40:06.835 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.836 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.836 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.836 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.836 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.836 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.837 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.837 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.837 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:40:06.837 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.838 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.838 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.838 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.838 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:40:06.838 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.839 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.839 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.839 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.839 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.840 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.840 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.840 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.840 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:40:06.841 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.841 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.841 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.841 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.841 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:40:06.842 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.842 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.842 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.842 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.843 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.843 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.843 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.843 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.844 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:40:06.844 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.844 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.844 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.844 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.845 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:40:06.845 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:06.845 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.845 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.846 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.846 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:40:06.846 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:40:06.846 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:40:06.847 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:40:06.847 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.847 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.847 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.847 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.848 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.848 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.848 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:40:06.848 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:40:06.849 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.849 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.849 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.849 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.850 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.850 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.850 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.850 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.850 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.851 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.851 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.851 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.851 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.852 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.852 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:40:06.852 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.852 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.852 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.853 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.853 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:40:06.853 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.853 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.854 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.854 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.854 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.854 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.855 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.855 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.855 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:40:06.855 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.855 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.856 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.856 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.856 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:40:06.856 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.857 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.857 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.857 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.857 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.858 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.858 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.858 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.858 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:40:06.859 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.859 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.859 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.859 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.860 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:40:06.860 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.860 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.860 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.860 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.861 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.861 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.861 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.861 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.862 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:40:06.862 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.862 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.862 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.863 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.863 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:40:06.863 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:06.863 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.864 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.864 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.864 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:40:06.864 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:40:06.864 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:40:06.865 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:40:06.865 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.865 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.865 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.866 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.866 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.866 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.866 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:40:06.866 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:40:06.867 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.867 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.867 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.867 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.868 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.868 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.868 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.868 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 65, 2021-11-15T14:40:06.868 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.869 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.869 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.869 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.869 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.870 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.870 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:40:06.870 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.870 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.870 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.871 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.871 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:40:06.871 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.871 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.872 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.872 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.872 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.872 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.872 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.873 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.873 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:40:06.873 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.873 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.874 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.874 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.874 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:40:06.874 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.875 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.875 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.875 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.875 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.875 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.876 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.876 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.876 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:40:06.876 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.877 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.877 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.877 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.877 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:40:06.878 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.878 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.878 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.878 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.878 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.879 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.879 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.879 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.879 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:40:06.880 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.880 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.880 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.880 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.881 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:40:06.881 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:06.881 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.881 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.881 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.882 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:40:06.882 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:40:06.882 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:40:06.882 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:40:06.883 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.883 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.883 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.883 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.883 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.884 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.884 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:40:06.884 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:40:06.884 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.885 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.885 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.885 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.885 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.885 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.886 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.886 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.886 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.886 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.887 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.887 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.887 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.887 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.888 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:40:06.888 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.888 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.888 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.888 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.889 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:40:06.889 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.889 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.889 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.890 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.890 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.890 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.890 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.890 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.891 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:40:06.891 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.891 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.891 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.892 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.892 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:40:06.892 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.892 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.892 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.893 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.893 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.893 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.893 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.894 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.894 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:40:06.894 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.894 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.895 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.895 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.895 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:40:06.895 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.895 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.896 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.896 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.896 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.896 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.897 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.897 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.897 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:40:06.897 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.898 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.898 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.898 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.898 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:40:06.899 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:06.899 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.899 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.899 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.899 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:40:06.900 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:40:06.900 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:40:06.900 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:40:06.900 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.901 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.901 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.901 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.902 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.902 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.902 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:40:06.902 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:40:06.902 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:06.903 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:06.903 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:06.903 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:06.903 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:06.904 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:06.904 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:06.904 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:06.904 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:06.905 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:06.905 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:06.905 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.905 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.906 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.906 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:40:06.906 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.906 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.906 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.907 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.907 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:40:06.907 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.907 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.908 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.908 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.908 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:06.908 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.908 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.909 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.909 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:40:06.909 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.910 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.910 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.910 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.910 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:40:06.911 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.911 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.911 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.911 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.912 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:06.912 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.912 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.912 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.912 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:40:06.913 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.913 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.913 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.913 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.914 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:40:06.914 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.914 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.914 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.915 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.915 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:06.915 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:06.915 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.916 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:06.916 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:40:06.916 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.916 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.916 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.917 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:06.917 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:40:06.917 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:06.917 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.918 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.918 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.918 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:40:06.918 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:40:06.919 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:40:06.919 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:40:06.919 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:06.919 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:06.920 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:06.920 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:06.920 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.920 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:06.920 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:40:06.921 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.921 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:40:06.921 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.921 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.922 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.922 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.922 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.922 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:40:06.923 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.923 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.923 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.923 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:40:06.924 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.924 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.924 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.924 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.924 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.925 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:40:06.925 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.925 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.926 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.926 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:40:06.926 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.926 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.926 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.927 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.927 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.927 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:40:06.927 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.928 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.928 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.928 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:40:06.928 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.928 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.929 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.929 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.929 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.929 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:40:06.930 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.930 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.930 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.931 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:40:06.931 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.931 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.931 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.931 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.932 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.932 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:40:06.932 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.932 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.933 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.933 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:40:06.933 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.933 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.933 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.934 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.934 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.934 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:40:06.934 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.935 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.935 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.935 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:40:06.935 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.935 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.936 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.936 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.936 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.936 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:40:06.937 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.937 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.937 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:06.937 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:40:06.937 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:06.938 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:06.938 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:06.938 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:06.938 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:06.939 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:40:06.939 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:06.939 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.939 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:06.940 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:40:06.940 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:40:06.940 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:40:06.940 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:40:06.940 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:40:06.941 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:40:06.941 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:40:06.941 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:40:06.941 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:40:06.941 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:40:06.942 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:40:06.942 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:40:06.942 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:40:06.942 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:40:06.943 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:40:06.943 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:40:06.943 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:40:06.943 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.944 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:40:06.944 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:40:06.944 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:40:06.944 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:40:06.944 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:40:06.945 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:40:06.945 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:40:06.945 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:06.945 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:06.946 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:40:06.946 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:40:06.946 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:40:06.946 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:40:06.946 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:40:06.947 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:40:06.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 msgr2=0x7f6744055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 0x7f6744055b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6758001110 tx=0x7f67580076c0).stop 2021-11-15T14:40:06.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 msgr2=0x7f67640ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:06.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f67640aec60 tx=0x7f675c016000).stop 2021-11-15T14:40:06.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 shutdown_connections 2021-11-15T14:40:06.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6744053660 0x7f6744055b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6764148420 0x7f67640ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67640b1e30 0x7f67640ac3a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:06.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 --2- 172.21.2.135:0/2479742598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67640a7140 0x7f676414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:06.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 >> 172.21.2.135:0/2479742598 conn(0x7f676405f730 msgr2=0x7f6764144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:06.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 shutdown_connections 2021-11-15T14:40:06.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:06.692+0000 7f676b717700 1 -- 172.21.2.135:0/2479742598 wait complete. 2021-11-15T14:40:06.952 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:07.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 Processor -- start 2021-11-15T14:40:07.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 -- start start 2021-11-15T14:40:07.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb0800acdd0 0x7fb08014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800b6d60 con 0x7fb0800b6980 2021-11-15T14:40:07.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb080061260 con 0x7fb080060990 2021-11-15T14:40:07.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb084a3b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb080061500 con 0x7fb0800acdd0 2021-11-15T14:40:07.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb07dd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb080060990 0x7fb0800aa650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46470/0 (socket says 172.21.2.135:46470) 2021-11-15T14:40:07.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.012+0000 7fb07dd9b700 1 -- 172.21.2.135:0/2573755480 learned_addr learned my addr 172.21.2.135:0/2573755480 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:07.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465945395 0 0) 0x7fb080061260 con 0x7fb080060990 2021-11-15T14:40:07.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb064004370 con 0x7fb080060990 2021-11-15T14:40:07.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07ed9d700 1 --2- 172.21.2.135:0/2573755480 >> v2:172.21.2.119:3300/0 conn(0x7fb0800acdd0 0x7fb08014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2337340083 0 0) 0x7fb064004370 con 0x7fb080060990 2021-11-15T14:40:07.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 >> v2:172.21.2.119:3300/0 conn(0x7fb0800acdd0 msgr2=0x7fb08014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 --2- 172.21.2.135:0/2573755480 >> v2:172.21.2.119:3300/0 conn(0x7fb0800acdd0 0x7fb08014a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 >> v1:172.21.2.119:6789/0 conn(0x7fb0800b6980 legacy=0x7fb0800a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800617a0 con 0x7fb080060990 2021-11-15T14:40:07.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb074001660 con 0x7fb080060990 2021-11-15T14:40:07.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 >> v1:172.21.2.135:6789/0 conn(0x7fb080060990 legacy=0x7fb0800aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb064004860 0x7fb064004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb064005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb064006180 0x7fb064003180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080061500 con 0x7fb064006180 2021-11-15T14:40:07.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640038d0 con 0x7fb064005610 2021-11-15T14:40:07.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb064003a90 con 0x7fb064004860 2021-11-15T14:40:07.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb064005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 -- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb064004860 msgr2=0x7fb064004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb064004860 0x7fb064004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 -- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb064006180 msgr2=0x7fb064003180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb064006180 0x7fb064003180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 -- 172.21.2.135:0/2573755480 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064004370 con 0x7fb064005610 2021-11-15T14:40:07.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07ed9d700 1 -- 172.21.2.135:0/2573755480 reap_dead start 2021-11-15T14:40:07.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb064005a90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb080060380 tx=0x7fb080060e00).ready entity=mon.1 client_cookie=9b3c4ea2bbae8ee5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0740070d0 con 0x7fb064005610 2021-11-15T14:40:07.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074007230 con 0x7fb064005610 2021-11-15T14:40:07.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07d59a700 1 -- 172.21.2.135:0/2573755480 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07400c8f0 con 0x7fb064005610 2021-11-15T14:40:07.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 msgr2=0x7fb064005a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb064005a90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb080060380 tx=0x7fb080060e00).stop 2021-11-15T14:40:07.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2573755480 shutdown_connections 2021-11-15T14:40:07.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2573755480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb064005a90 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2573755480 >> 172.21.2.135:0/2573755480 conn(0x7fb0800b3500 msgr2=0x7fb0800b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:07.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2573755480 shutdown_connections 2021-11-15T14:40:07.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2573755480 wait complete. 2021-11-15T14:40:07.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 Processor -- start 2021-11-15T14:40:07.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- start start 2021-11-15T14:40:07.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0800ad510 0x7fb0801517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0800afef0 0x7fb080151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08014ed80 con 0x7fb0800afef0 2021-11-15T14:40:07.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08014f020 con 0x7fb064005610 2021-11-15T14:40:07.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800b1b00 con 0x7fb0800ad510 2021-11-15T14:40:07.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58890/0 (socket says 172.21.2.135:58890) 2021-11-15T14:40:07.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 -- 172.21.2.135:0/2133722450 learned_addr learned my addr 172.21.2.135:0/2133722450 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:07.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 -- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0800ad510 msgr2=0x7fb0801517f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:07.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0800ad510 0x7fb0801517f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 -- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0800afef0 msgr2=0x7fb080151ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:07.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0800afef0 0x7fb080151ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 -- 172.21.2.135:0/2133722450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800b2700 con 0x7fb064005610 2021-11-15T14:40:07.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb07e59c700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fb070001fa0 tx=0x7fb070007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07000ce80 con 0x7fb064005610 2021-11-15T14:40:07.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070000e90 con 0x7fb064005610 2021-11-15T14:40:07.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0801521d0 con 0x7fb064005610 2021-11-15T14:40:07.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800adbd0 con 0x7fb064005610 2021-11-15T14:40:07.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.016+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb070007430 con 0x7fb064005610 2021-11-15T14:40:07.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08014f1e0 con 0x7fb064005610 2021-11-15T14:40:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb07001a060 con 0x7fb064005610 2021-11-15T14:40:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb06f7fe700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 0x7fb05c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb07006b420 con 0x7fb064005610 2021-11-15T14:40:07.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 0x7fb05c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb07dd9b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 0x7fb05c055a90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fb080060380 tx=0x7fb074013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.020+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb070042320 con 0x7fb064005610 2021-11-15T14:40:07.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb080061a40 con 0x7fb064005610 2021-11-15T14:40:07.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb06f7fe700 1 -- 172.21.2.135:0/2133722450 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fb070018020 con 0x7fb064005610 2021-11-15T14:40:07.133 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:07.133 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:39:33.678173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5908":{"gid":5908,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2659643829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2659643829},{"type":"v1","addr":"172.21.2.135:6835","nonce":2659643829}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:40:07.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 msgr2=0x7fb05c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 0x7fb05c055a90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fb080060380 tx=0x7fb074013000).stop 2021-11-15T14:40:07.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 msgr2=0x7fb08013b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fb070001fa0 tx=0x7fb070007c30).stop 2021-11-15T14:40:07.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 shutdown_connections 2021-11-15T14:40:07.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb05c0535d0 0x7fb05c055a90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb0800afef0 0x7fb080151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb0800ad510 0x7fb0801517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 --2- 172.21.2.135:0/2133722450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb064005610 0x7fb08013b610 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 >> 172.21.2.135:0/2133722450 conn(0x7fb0800b3500 msgr2=0x7fb0800aa530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:07.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 shutdown_connections 2021-11-15T14:40:07.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.128+0000 7fb084a3b700 1 -- 172.21.2.135:0/2133722450 wait complete. 2021-11-15T14:40:07.137 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 33 2021-11-15T14:40:07.140 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:40:07.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 Processor -- start 2021-11-15T14:40:07.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- start start 2021-11-15T14:40:07.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40af6f0 0x7ff7e40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff7e40b0770 0x7ff7e41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40afad0 con 0x7ff7e40ad220 2021-11-15T14:40:07.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40ae6b0 con 0x7ff7e40b0770 2021-11-15T14:40:07.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40ae950 con 0x7ff7e40af6f0 2021-11-15T14:40:07.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e8db0700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff7e40ad220 0x7ff7e40b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46490/0 (socket says 172.21.2.135:46490) 2021-11-15T14:40:07.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e8db0700 1 -- 172.21.2.135:0/1115553435 learned_addr learned my addr 172.21.2.135:0/1115553435 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:07.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 --2- 172.21.2.135:0/1115553435 >> v2:172.21.2.135:3300/0 conn(0x7ff7e40b0770 0x7ff7e41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 -- 172.21.2.135:0/1115553435 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40af6f0 msgr2=0x7ff7e40b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 --2- 172.21.2.135:0/1115553435 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40af6f0 0x7ff7e40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 -- 172.21.2.135:0/1115553435 >> v1:172.21.2.135:6789/0 conn(0x7ff7e40ad220 legacy=0x7ff7e40b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 -- 172.21.2.135:0/1115553435 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40aebf0 con 0x7ff7e40b0770 2021-11-15T14:40:07.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7e9db2700 1 --2- 172.21.2.135:0/1115553435 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40b0770 0x7ff7e41477b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7ff7dc0032f0 tx=0x7ff7dc0091d0).ready entity=mon.1 client_cookie=99707130e495ee server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7d7fff700 1 -- 172.21.2.135:0/1115553435 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7dc009ea0 con 0x7ff7e40b0770 2021-11-15T14:40:07.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7d7fff700 1 -- 172.21.2.135:0/1115553435 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc00b8a0 con 0x7ff7e40b0770 2021-11-15T14:40:07.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7d7fff700 1 -- 172.21.2.135:0/1115553435 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7dc00ba10 con 0x7ff7e40b0770 2021-11-15T14:40:07.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- 172.21.2.135:0/1115553435 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40b0770 msgr2=0x7ff7e41477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 --2- 172.21.2.135:0/1115553435 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40b0770 0x7ff7e41477b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7ff7dc0032f0 tx=0x7ff7dc0091d0).stop 2021-11-15T14:40:07.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- 172.21.2.135:0/1115553435 shutdown_connections 2021-11-15T14:40:07.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 --2- 172.21.2.135:0/1115553435 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40b0770 0x7ff7e41477b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 --2- 172.21.2.135:0/1115553435 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40af6f0 0x7ff7e40b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- 172.21.2.135:0/1115553435 >> 172.21.2.135:0/1115553435 conn(0x7ff7e4062cb0 msgr2=0x7ff7e4063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:07.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- 172.21.2.135:0/1115553435 shutdown_connections 2021-11-15T14:40:07.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- 172.21.2.135:0/1115553435 wait complete. 2021-11-15T14:40:07.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 Processor -- start 2021-11-15T14:40:07.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.196+0000 7ff7eb815700 1 -- start start 2021-11-15T14:40:07.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7e40ad220 0x7ff7e4066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40b0770 0x7ff7e40a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40663a0 con 0x7ff7e40ad220 2021-11-15T14:40:07.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40665d0 con 0x7ff7e40af6f0 2021-11-15T14:40:07.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4149740 con 0x7ff7e40b0770 2021-11-15T14:40:07.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58906/0 (socket says 172.21.2.135:58906) 2021-11-15T14:40:07.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 -- 172.21.2.135:0/2507703451 learned_addr learned my addr 172.21.2.135:0/2507703451 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:07.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 -- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40b0770 msgr2=0x7ff7e40a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40b0770 0x7ff7e40a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 -- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7e40ad220 msgr2=0x7ff7e4066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7e40ad220 0x7ff7e4066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 -- 172.21.2.135:0/2507703451 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009470 con 0x7ff7e40af6f0 2021-11-15T14:40:07.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e8db0700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7ff7e40a98f0 tx=0x7ff7e0007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e000ce20 con 0x7ff7e40af6f0 2021-11-15T14:40:07.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00072e0 con 0x7ff7e40af6f0 2021-11-15T14:40:07.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e41499e0 con 0x7ff7e40af6f0 2021-11-15T14:40:07.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e0005800 con 0x7ff7e40af6f0 2021-11-15T14:40:07.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e40a7140 con 0x7ff7e40af6f0 2021-11-15T14:40:07.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e40aee90 con 0x7ff7e40af6f0 2021-11-15T14:40:07.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7e0010070 con 0x7ff7e40af6f0 2021-11-15T14:40:07.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 0x7ff7c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff7e006b140 con 0x7ff7e40af6f0 2021-11-15T14:40:07.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.200+0000 7ff7e95b1700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 0x7ff7c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.204+0000 7ff7e95b1700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 0x7ff7c4055a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff7d8002f70 tx=0x7ff7d80069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.204+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7e0042150 con 0x7ff7e40af6f0 2021-11-15T14:40:07.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.312+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff7e40573d0 con 0x7ff7e40af6f0 2021-11-15T14:40:07.814 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:40:07.811+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:40:07.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7d67fc700 1 -- 172.21.2.135:0/2507703451 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff7e0045770 con 0x7ff7e40af6f0 2021-11-15T14:40:07.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 msgr2=0x7ff7c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 0x7ff7c4055a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff7d8002f70 tx=0x7ff7d80069e0).stop 2021-11-15T14:40:07.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 msgr2=0x7ff7e40a7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7ff7e40a98f0 tx=0x7ff7e0007c10).stop 2021-11-15T14:40:07.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 shutdown_connections 2021-11-15T14:40:07.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7c4053580 0x7ff7c4055a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff7e40b0770 0x7ff7e40a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff7e40af6f0 0x7ff7e40a7800 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 --2- 172.21.2.135:0/2507703451 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff7e40ad220 0x7ff7e4066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 >> 172.21.2.135:0/2507703451 conn(0x7ff7e4062cb0 msgr2=0x7ff7e40b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:07.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 shutdown_connections 2021-11-15T14:40:07.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.824+0000 7ff7eb815700 1 -- 172.21.2.135:0/2507703451 wait complete. 2021-11-15T14:40:07.831 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:40:07.835 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:07.847 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:40:07.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.880+0000 7fc684e3d700 1 Processor -- start 2021-11-15T14:40:07.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- start start 2021-11-15T14:40:07.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 0x7fc6800b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc6800a7140 0x7fc6801447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800b03d0 con 0x7fc680148420 2021-11-15T14:40:07.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800a9140 con 0x7fc6800a7140 2021-11-15T14:40:07.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800b0670 con 0x7fc6800b1e30 2021-11-15T14:40:07.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67dd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc680148420 0x7fc6800b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46516/0 (socket says 172.21.2.135:46516) 2021-11-15T14:40:07.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67dd9b700 1 -- 172.21.2.135:0/2340891823 learned_addr learned my addr 172.21.2.135:0/2340891823 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:07.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318806771 0 0) 0x7fc6800b03d0 con 0x7fc680148420 2021-11-15T14:40:07.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc664003260 con 0x7fc680148420 2021-11-15T14:40:07.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67ed9d700 1 --2- 172.21.2.135:0/2340891823 >> v2:172.21.2.119:3300/0 conn(0x7fc6800a7140 0x7fc6801447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 0x7fc6800b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174452642 0 0) 0x7fc664003260 con 0x7fc680148420 2021-11-15T14:40:07.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 msgr2=0x7fc6800b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 0x7fc6800b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 >> v2:172.21.2.119:3300/0 conn(0x7fc6800a7140 msgr2=0x7fc6801447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 --2- 172.21.2.135:0/2340891823 >> v2:172.21.2.119:3300/0 conn(0x7fc6800a7140 0x7fc6801447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:07.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800b0910 con 0x7fc680148420 2021-11-15T14:40:07.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc674001660 con 0x7fc680148420 2021-11-15T14:40:07.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 >> v1:172.21.2.135:6789/0 conn(0x7fc680148420 legacy=0x7fc6800b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc6640037d0 0x7fc664003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc664004500 0x7fc664004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 0x7fc664004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800b0670 con 0x7fc664004500 2021-11-15T14:40:07.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66400b850 con 0x7fc6640037d0 2021-11-15T14:40:07.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66400ba10 con 0x7fc6800b1e30 2021-11-15T14:40:07.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc6640037d0 0x7fc664003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 -- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 msgr2=0x7fc664004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6800b1e30 0x7fc664004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 -- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc664004500 msgr2=0x7fc664004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:07.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc664004500 0x7fc664004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 -- 172.21.2.135:0/2340891823 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664003260 con 0x7fc6640037d0 2021-11-15T14:40:07.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67e59c700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc6640037d0 0x7fc664003bf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fc67000a000 tx=0x7fc670008040).ready entity=mon.1 client_cookie=9daf384d3e785c31 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc670013670 con 0x7fc6640037d0 2021-11-15T14:40:07.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6700137d0 con 0x7fc6640037d0 2021-11-15T14:40:07.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67d59a700 1 -- 172.21.2.135:0/2340891823 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc670013b30 con 0x7fc6640037d0 2021-11-15T14:40:07.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- 172.21.2.135:0/2340891823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc6640037d0 msgr2=0x7fc664003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- 172.21.2.135:0/2340891823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc6640037d0 0x7fc664003bf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fc67000a000 tx=0x7fc670008040).stop 2021-11-15T14:40:07.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc67ed9d700 1 -- 172.21.2.135:0/2340891823 reap_dead start 2021-11-15T14:40:07.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- 172.21.2.135:0/2340891823 shutdown_connections 2021-11-15T14:40:07.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- 172.21.2.135:0/2340891823 >> 172.21.2.135:0/2340891823 conn(0x7fc68005f730 msgr2=0x7fc68005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:07.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- 172.21.2.135:0/2340891823 shutdown_connections 2021-11-15T14:40:07.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- 172.21.2.135:0/2340891823 wait complete. 2021-11-15T14:40:07.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 Processor -- start 2021-11-15T14:40:07.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- start start 2021-11-15T14:40:07.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6640037d0 0x7fc68014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc6800ab860 0x7fc680066690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800aaf40 con 0x7fc6800ab860 2021-11-15T14:40:07.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800ac3b0 con 0x7fc68015a040 2021-11-15T14:40:07.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.884+0000 7fc684e3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800ac650 con 0x7fc6640037d0 2021-11-15T14:40:07.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58940/0 (socket says 172.21.2.135:58940) 2021-11-15T14:40:07.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 -- 172.21.2.135:0/3405008147 learned_addr learned my addr 172.21.2.135:0/3405008147 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:07.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 -- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6640037d0 msgr2=0x7fc68014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6640037d0 0x7fc68014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 -- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc6800ab860 msgr2=0x7fc680066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:07.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc6800ab860 0x7fc680066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:07.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 -- 172.21.2.135:0/3405008147 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800ac8f0 con 0x7fc68015a040 2021-11-15T14:40:07.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67dd9b700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fc674001370 tx=0x7fc6800b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674007170 con 0x7fc68015a040 2021-11-15T14:40:07.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740072d0 con 0x7fc68015a040 2021-11-15T14:40:07.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6800ac030 con 0x7fc68015a040 2021-11-15T14:40:07.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6800aad00 con 0x7fc68015a040 2021-11-15T14:40:07.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674004920 con 0x7fc68015a040 2021-11-15T14:40:07.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680067890 con 0x7fc68015a040 2021-11-15T14:40:07.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc67401b070 con 0x7fc68015a040 2021-11-15T14:40:07.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 0x7fc65c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:07.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fc67406b420 con 0x7fc68015a040 2021-11-15T14:40:07.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67e59c700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 0x7fc65c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:07.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.888+0000 7fc67e59c700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 0x7fc65c055b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fc67000a000 tx=0x7fc670008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:07.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:07.892+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc680067890 con 0x7fc68015a040 2021-11-15T14:40:08.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6800ab0b0 con 0x7fc68015a040 2021-11-15T14:40:08.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc66f7fe700 1 -- 172.21.2.135:0/3405008147 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fc6800ab0b0 con 0x7fc68015a040 2021-11-15T14:40:08.004 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:08.004 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:39:32.300335+0000","modified":"2021-11-15T14:40:07.813986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-15T14:40:08.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 msgr2=0x7fc65c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 0x7fc65c055b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fc67000a000 tx=0x7fc670008040).stop 2021-11-15T14:40:08.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 msgr2=0x7fc6800ab370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fc674001370 tx=0x7fc6800b0aa0).stop 2021-11-15T14:40:08.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 shutdown_connections 2021-11-15T14:40:08.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc65c053660 0x7fc65c055b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc6800ab860 0x7fc680066690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68015a040 0x7fc6800ab370 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 --2- 172.21.2.135:0/3405008147 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc6640037d0 0x7fc68014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 >> 172.21.2.135:0/3405008147 conn(0x7fc68005f730 msgr2=0x7fc6800af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:08.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 shutdown_connections 2021-11-15T14:40:08.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.000+0000 7fc684e3d700 1 -- 172.21.2.135:0/3405008147 wait complete. 2021-11-15T14:40:08.008 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 34 2021-11-15T14:40:08.012 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:40:08.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 Processor -- start 2021-11-15T14:40:08.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 -- start start 2021-11-15T14:40:08.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b1f40 0x7f77540b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f77540b2320 0x7f77541412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77540a7850 con 0x7f77540b0030 2021-11-15T14:40:08.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77540b0470 con 0x7f77540b2320 2021-11-15T14:40:08.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775bbc3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77540b06d0 con 0x7f77540b1f40 2021-11-15T14:40:08.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775a160700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f77540b2320 0x7f77541412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775915e700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f77540b0030 0x7f77540a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:55948/0 (socket says 172.21.2.135:55948) 2021-11-15T14:40:08.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775915e700 1 -- 172.21.2.135:0/1252292902 learned_addr learned my addr 172.21.2.135:0/1252292902 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:08.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.064+0000 7f775995f700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b1f40 0x7f77540b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775a160700 1 -- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b1f40 msgr2=0x7f77540b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:08.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775a160700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b1f40 0x7f77540b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775a160700 1 -- 172.21.2.135:0/1252292902 >> v1:172.21.2.119:6789/0 conn(0x7f77540b0030 legacy=0x7f77540a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775a160700 1 -- 172.21.2.135:0/1252292902 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77540b0970 con 0x7f77540b2320 2021-11-15T14:40:08.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775a160700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77541412d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f774c0032f0 tx=0x7f774c0091d0).ready entity=mon.0 client_cookie=ffd8fbb47d89f83f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775895d700 1 -- 172.21.2.135:0/1252292902 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774c00b6c0 con 0x7f77540b2320 2021-11-15T14:40:08.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775895d700 1 -- 172.21.2.135:0/1252292902 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c00b820 con 0x7f77540b2320 2021-11-15T14:40:08.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775895d700 1 -- 172.21.2.135:0/1252292902 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774c00b990 con 0x7f77540b2320 2021-11-15T14:40:08.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 msgr2=0x7f77541412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77541412d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f774c0032f0 tx=0x7f774c0091d0).stop 2021-11-15T14:40:08.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- 172.21.2.135:0/1252292902 shutdown_connections 2021-11-15T14:40:08.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77541412d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- 172.21.2.135:0/1252292902 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b1f40 0x7f77540b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- 172.21.2.135:0/1252292902 >> 172.21.2.135:0/1252292902 conn(0x7f775405f730 msgr2=0x7f775405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:08.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- 172.21.2.135:0/1252292902 shutdown_connections 2021-11-15T14:40:08.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- 172.21.2.135:0/1252292902 wait complete. 2021-11-15T14:40:08.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 Processor -- start 2021-11-15T14:40:08.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- start start 2021-11-15T14:40:08.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b0030 0x7f77541452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77540b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540b3dd0 con 0x7f77540b2320 2021-11-15T14:40:08.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540b4660 con 0x7f77540b1f40 2021-11-15T14:40:08.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775bbc3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77540b3b70 con 0x7f77540b0030 2021-11-15T14:40:08.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775915e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775915e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58952/0 (socket says 172.21.2.135:58952) 2021-11-15T14:40:08.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.068+0000 7f775915e700 1 -- 172.21.2.135:0/830227118 learned_addr learned my addr 172.21.2.135:0/830227118 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:08.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 -- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b0030 msgr2=0x7f77541452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b0030 0x7f77541452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 -- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 msgr2=0x7f77540b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77540b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 -- 172.21.2.135:0/830227118 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009470 con 0x7f77540b1f40 2021-11-15T14:40:08.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775915e700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f77541493c0 tx=0x7f7750007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f775000ce20 con 0x7f77540b1f40 2021-11-15T14:40:08.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77500072e0 con 0x7f77540b1f40 2021-11-15T14:40:08.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77540b5a00 con 0x7f77540b1f40 2021-11-15T14:40:08.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7750005800 con 0x7f77540b1f40 2021-11-15T14:40:08.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7754149e40 con 0x7f77540b1f40 2021-11-15T14:40:08.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77540b4150 con 0x7f77540b1f40 2021-11-15T14:40:08.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7750010070 con 0x7f77540b1f40 2021-11-15T14:40:08.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 0x7f7734055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f775006b110 con 0x7f77540b1f40 2021-11-15T14:40:08.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775995f700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 0x7f7734055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.072+0000 7f775995f700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 0x7f7734055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f774800c000 tx=0x7f7748006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.076+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77540b4150 con 0x7f77540b1f40 2021-11-15T14:40:08.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.180+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77540b4150 con 0x7f77540b1f40 2021-11-15T14:40:08.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f7746ffd700 1 -- 172.21.2.135:0/830227118 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77540b4150 con 0x7f77540b1f40 2021-11-15T14:40:08.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 msgr2=0x7f7734055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 0x7f7734055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f774800c000 tx=0x7f7748006df0).stop 2021-11-15T14:40:08.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 msgr2=0x7f77540aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f77541493c0 tx=0x7f7750007c00).stop 2021-11-15T14:40:08.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 shutdown_connections 2021-11-15T14:40:08.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7734053610 0x7f7734055ad0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77540b2320 0x7f77540b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77540b1f40 0x7f77540aa430 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 --2- 172.21.2.135:0/830227118 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77540b0030 0x7f77541452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 >> 172.21.2.135:0/830227118 conn(0x7f775405f730 msgr2=0x7f775413cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:08.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 shutdown_connections 2021-11-15T14:40:08.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.836+0000 7f775bbc3700 1 -- 172.21.2.135:0/830227118 wait complete. 2021-11-15T14:40:08.848 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:40:08.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 Processor -- start 2021-11-15T14:40:08.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- start start 2021-11-15T14:40:08.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efe780ad150 0x7efe7813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7efe780afca0 0x7efe7813f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780b04b0 con 0x7efe780b0bb0 2021-11-15T14:40:08.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780ad530 con 0x7efe780afca0 2021-11-15T14:40:08.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780b57d0 con 0x7efe780ad150 2021-11-15T14:40:08.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efe780ad150 0x7efe7813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efe780ad150 0x7efe7813f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58962/0 (socket says 172.21.2.135:58962) 2021-11-15T14:40:08.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 -- 172.21.2.135:0/439755126 learned_addr learned my addr 172.21.2.135:0/439755126 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:08.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 -- 172.21.2.135:0/439755126 >> v2:172.21.2.119:3300/0 conn(0x7efe780afca0 msgr2=0x7efe7813f640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:08.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 --2- 172.21.2.135:0/439755126 >> v2:172.21.2.119:3300/0 conn(0x7efe780afca0 0x7efe7813f640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 -- 172.21.2.135:0/439755126 >> v1:172.21.2.119:6789/0 conn(0x7efe780b0bb0 legacy=0x7efe781426a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:08.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 -- 172.21.2.135:0/439755126 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780b06e0 con 0x7efe780ad150 2021-11-15T14:40:08.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7659c700 1 --2- 172.21.2.135:0/439755126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780ad150 0x7efe7813f150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7efe780b00d0 tx=0x7efe68006f40).ready entity=mon.1 client_cookie=2836e1d5356df31e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7559a700 1 -- 172.21.2.135:0/439755126 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe68010070 con 0x7efe780ad150 2021-11-15T14:40:08.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7559a700 1 -- 172.21.2.135:0/439755126 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68000e90 con 0x7efe780ad150 2021-11-15T14:40:08.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7559a700 1 -- 172.21.2.135:0/439755126 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe68008860 con 0x7efe780ad150 2021-11-15T14:40:08.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- 172.21.2.135:0/439755126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780ad150 msgr2=0x7efe7813f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/439755126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780ad150 0x7efe7813f150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7efe780b00d0 tx=0x7efe68006f40).stop 2021-11-15T14:40:08.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- 172.21.2.135:0/439755126 shutdown_connections 2021-11-15T14:40:08.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/439755126 >> v2:172.21.2.119:3300/0 conn(0x7efe780afca0 0x7efe7813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:08.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/439755126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780ad150 0x7efe7813f150 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- 172.21.2.135:0/439755126 >> 172.21.2.135:0/439755126 conn(0x7efe78062cb0 msgr2=0x7efe78063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:08.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- 172.21.2.135:0/439755126 shutdown_connections 2021-11-15T14:40:08.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- 172.21.2.135:0/439755126 wait complete. 2021-11-15T14:40:08.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 Processor -- start 2021-11-15T14:40:08.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.900+0000 7efe7cfbd700 1 -- start start 2021-11-15T14:40:08.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe780ad150 0x7efe780b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 0x7efe7813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780b52c0 con 0x7efe780ad150 2021-11-15T14:40:08.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780b5560 con 0x7efe780afca0 2021-11-15T14:40:08.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780b2390 con 0x7efe780b0bb0 2021-11-15T14:40:08.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58966/0 (socket says 172.21.2.135:58966) 2021-11-15T14:40:08.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 -- 172.21.2.135:0/288869847 learned_addr learned my addr 172.21.2.135:0/288869847 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:08.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe76d9d700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 0x7efe7813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 -- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 msgr2=0x7efe7813f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7659c700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe780ad150 0x7efe780b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 0x7efe7813f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 -- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe780ad150 msgr2=0x7efe780b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:08.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe780ad150 0x7efe780b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:08.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 -- 172.21.2.135:0/288869847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68008240 con 0x7efe780afca0 2021-11-15T14:40:08.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe76d9d700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 0x7efe7813f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:08.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe75d9b700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efe60002fb0 tx=0x7efe60006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe60013460 con 0x7efe780afca0 2021-11-15T14:40:08.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe600135c0 con 0x7efe780afca0 2021-11-15T14:40:08.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe780b4fd0 con 0x7efe780afca0 2021-11-15T14:40:08.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe60013920 con 0x7efe780afca0 2021-11-15T14:40:08.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe780b2830 con 0x7efe780afca0 2021-11-15T14:40:08.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe780b2550 con 0x7efe780afca0 2021-11-15T14:40:08.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe6000f070 con 0x7efe780afca0 2021-11-15T14:40:08.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 0x7efe5c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:08.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6502+0+0 (secure 0 0 0) 0x7efe6006b3d0 con 0x7efe780afca0 2021-11-15T14:40:08.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.904+0000 7efe7659c700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 0x7efe5c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:08.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.908+0000 7efe7659c700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 0x7efe5c055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7efe68009000 tx=0x7efe780ae5c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:08.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.908+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe60042210 con 0x7efe780afca0 2021-11-15T14:40:08.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:08.992+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe780b5a30 con 0x7efe780afca0 2021-11-15T14:40:09.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe6f7fe700 1 -- 172.21.2.135:0/288869847 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 185+0+0 (secure 0 0 0) 0x7efe60018030 con 0x7efe780afca0 2021-11-15T14:40:09.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 msgr2=0x7efe5c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:09.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 0x7efe5c055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7efe68009000 tx=0x7efe780ae5c0).stop 2021-11-15T14:40:09.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 msgr2=0x7efe7813edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:09.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efe60002fb0 tx=0x7efe60006df0).stop 2021-11-15T14:40:09.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 shutdown_connections 2021-11-15T14:40:09.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efe5c0536a0 0x7efe5c055b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:09.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efe780b0bb0 0x7efe7813f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:09.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efe780afca0 0x7efe7813edf0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:09.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 --2- 172.21.2.135:0/288869847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efe780ad150 0x7efe780b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:09.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 >> 172.21.2.135:0/288869847 conn(0x7efe78062cb0 msgr2=0x7efe78063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:09.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 shutdown_connections 2021-11-15T14:40:09.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.844+0000 7efe7cfbd700 1 -- 172.21.2.135:0/288869847 wait complete. 2021-11-15T14:40:09.853 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:40:09.856 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:40:09.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.912+0000 7eff70be5700 1 Processor -- start 2021-11-15T14:40:09.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.912+0000 7eff70be5700 1 -- start start 2021-11-15T14:40:09.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7eff6c0b1e30 0x7eff6c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7eff6c148420 0x7eff6c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0b03d0 con 0x7eff6c0a7140 2021-11-15T14:40:09.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0a9140 con 0x7eff6c148420 2021-11-15T14:40:09.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0b0670 con 0x7eff6c0b1e30 2021-11-15T14:40:09.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6ad9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7eff6c0a7140 0x7eff6c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46562/0 (socket says 172.21.2.135:46562) 2021-11-15T14:40:09.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6ad9d700 1 -- 172.21.2.135:0/576368185 learned_addr learned my addr 172.21.2.135:0/576368185 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:09.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 --2- 172.21.2.135:0/576368185 >> v2:172.21.2.135:3300/0 conn(0x7eff6c0b1e30 0x7eff6c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:09.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6959a700 1 -- 172.21.2.135:0/576368185 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769521241 0 0) 0x7eff6c0b03d0 con 0x7eff6c0a7140 2021-11-15T14:40:09.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6959a700 1 -- 172.21.2.135:0/576368185 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c003260 con 0x7eff6c0a7140 2021-11-15T14:40:09.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 -- 172.21.2.135:0/576368185 >> v2:172.21.2.119:3300/0 conn(0x7eff6c148420 msgr2=0x7eff6c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:09.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 --2- 172.21.2.135:0/576368185 >> v2:172.21.2.119:3300/0 conn(0x7eff6c148420 0x7eff6c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:09.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 -- 172.21.2.135:0/576368185 >> v1:172.21.2.135:6789/0 conn(0x7eff6c0a7140 legacy=0x7eff6c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:09.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 -- 172.21.2.135:0/576368185 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0b0910 con 0x7eff6c0b1e30 2021-11-15T14:40:09.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6a59c700 1 --2- 172.21.2.135:0/576368185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c0b1050 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7eff6c1477b0 tx=0x7eff54006df0).ready entity=mon.1 client_cookie=9f1de91cccf1a824 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:09.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6959a700 1 -- 172.21.2.135:0/576368185 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5400d5c0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6959a700 1 -- 172.21.2.135:0/576368185 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff54000e90 con 0x7eff6c0b1e30 2021-11-15T14:40:09.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff6959a700 1 -- 172.21.2.135:0/576368185 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5400d910 con 0x7eff6c0b1e30 2021-11-15T14:40:09.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- 172.21.2.135:0/576368185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 msgr2=0x7eff6c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:09.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- 172.21.2.135:0/576368185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c0b1050 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7eff6c1477b0 tx=0x7eff54006df0).stop 2021-11-15T14:40:09.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- 172.21.2.135:0/576368185 shutdown_connections 2021-11-15T14:40:09.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- 172.21.2.135:0/576368185 >> v2:172.21.2.119:3300/0 conn(0x7eff6c148420 0x7eff6c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:09.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- 172.21.2.135:0/576368185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c0b1050 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:09.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- 172.21.2.135:0/576368185 >> 172.21.2.135:0/576368185 conn(0x7eff6c05f730 msgr2=0x7eff6c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:09.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- 172.21.2.135:0/576368185 shutdown_connections 2021-11-15T14:40:09.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- 172.21.2.135:0/576368185 wait complete. 2021-11-15T14:40:09.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 Processor -- start 2021-11-15T14:40:09.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- start start 2021-11-15T14:40:09.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7eff6c0a7140 0x7eff6c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7eff6c148420 0x7eff6c149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c14b630 con 0x7eff6c0a7140 2021-11-15T14:40:09.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c14aae0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff70be5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c14a2a0 con 0x7eff6c148420 2021-11-15T14:40:09.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff69d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:09.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff69d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58982/0 (socket says 172.21.2.135:58982) 2021-11-15T14:40:09.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.916+0000 7eff69d9b700 1 -- 172.21.2.135:0/755624142 learned_addr learned my addr 172.21.2.135:0/755624142 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:09.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 -- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7eff6c148420 msgr2=0x7eff6c149200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:09.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7eff6c148420 0x7eff6c149200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:09.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 -- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7eff6c0a7140 msgr2=0x7eff6c0ae4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:09.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7eff6c0a7140 0x7eff6c0ae4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:09.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 -- 172.21.2.135:0/755624142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5400b180 con 0x7eff6c0b1e30 2021-11-15T14:40:09.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff69d9b700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7eff6c0aee20 tx=0x7eff5c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:09.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c013460 con 0x7eff6c0b1e30 2021-11-15T14:40:09.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0135c0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c0aefb0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c013920 con 0x7eff6c0b1e30 2021-11-15T14:40:09.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c14b3d0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c149ec0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff5c01a060 con 0x7eff6c0b1e30 2021-11-15T14:40:09.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 0x7eff50055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:09.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6064+0+0 (secure 0 0 0) 0x7eff5c06b2f0 con 0x7eff6c0b1e30 2021-11-15T14:40:09.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff6a59c700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 0x7eff50055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:09.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.920+0000 7eff6a59c700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 0x7eff50055b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7eff6c1477b0 tx=0x7eff54014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:09.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:09.924+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff5c0423e0 con 0x7eff6c0b1e30 2021-11-15T14:40:10.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.004+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7eff6c0b0bb0 con 0x7eff6c0b1e30 2021-11-15T14:40:10.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff637fe700 1 -- 172.21.2.135:0/755624142 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 173+0+0 (secure 0 0 0) 0x7eff5c045a00 con 0x7eff6c0b1e30 2021-11-15T14:40:10.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 msgr2=0x7eff50055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:10.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 0x7eff50055b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7eff6c1477b0 tx=0x7eff54014000).stop 2021-11-15T14:40:10.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 msgr2=0x7eff6c148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:10.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7eff6c0aee20 tx=0x7eff5c006df0).stop 2021-11-15T14:40:10.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 shutdown_connections 2021-11-15T14:40:10.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff500536a0 0x7eff50055b60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:10.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7eff6c148420 0x7eff6c149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7eff6c0b1e30 0x7eff6c148d10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:10.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 --2- 172.21.2.135:0/755624142 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7eff6c0a7140 0x7eff6c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 >> 172.21.2.135:0/755624142 conn(0x7eff6c05f730 msgr2=0x7eff6c0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:10.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 shutdown_connections 2021-11-15T14:40:10.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.856+0000 7eff70be5700 1 -- 172.21.2.135:0/755624142 wait complete. 2021-11-15T14:40:10.864 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:40:10.868 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:40:10.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 Processor -- start 2021-11-15T14:40:10.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- start start 2021-11-15T14:40:10.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f19100b3790 0x7f19100b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19100a9c90 0x7f19100b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19101439a0 con 0x7f19100b0630 2021-11-15T14:40:10.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1910143c40 con 0x7f19100b3790 2021-11-15T14:40:10.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1910143ee0 con 0x7f19100a9c90 2021-11-15T14:40:10.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19100a9c90 0x7f19100b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:10.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f19100a9c90 0x7f19100b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58992/0 (socket says 172.21.2.135:58992) 2021-11-15T14:40:10.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 -- 172.21.2.135:0/827290166 learned_addr learned my addr 172.21.2.135:0/827290166 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:10.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 -- 172.21.2.135:0/827290166 >> v2:172.21.2.119:3300/0 conn(0x7f19100b3790 msgr2=0x7f19100b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:10.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 --2- 172.21.2.135:0/827290166 >> v2:172.21.2.119:3300/0 conn(0x7f19100b3790 0x7f19100b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 -- 172.21.2.135:0/827290166 >> v1:172.21.2.119:6789/0 conn(0x7f19100b0630 legacy=0x7f191013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:10.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 -- 172.21.2.135:0/827290166 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910144180 con 0x7f19100a9c90 2021-11-15T14:40:10.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f191639f700 1 --2- 172.21.2.135:0/827290166 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100a9c90 0x7f19100b1130 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f191006aad0 tx=0x7f1908009290).ready entity=mon.1 client_cookie=c3a0783a29ebc7eb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:10.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1914b9c700 1 -- 172.21.2.135:0/827290166 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190800b830 con 0x7f19100a9c90 2021-11-15T14:40:10.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1914b9c700 1 -- 172.21.2.135:0/827290166 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800b990 con 0x7f19100a9c90 2021-11-15T14:40:10.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1914b9c700 1 -- 172.21.2.135:0/827290166 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190800bb40 con 0x7f19100a9c90 2021-11-15T14:40:10.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- 172.21.2.135:0/827290166 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100a9c90 msgr2=0x7f19100b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:10.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 --2- 172.21.2.135:0/827290166 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100a9c90 0x7f19100b1130 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f191006aad0 tx=0x7f1908009290).stop 2021-11-15T14:40:10.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- 172.21.2.135:0/827290166 shutdown_connections 2021-11-15T14:40:10.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 --2- 172.21.2.135:0/827290166 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100a9c90 0x7f19100b1130 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:10.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 --2- 172.21.2.135:0/827290166 >> v2:172.21.2.119:3300/0 conn(0x7f19100b3790 0x7f19100b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- 172.21.2.135:0/827290166 >> 172.21.2.135:0/827290166 conn(0x7f1910060840 msgr2=0x7f1910060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:10.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- 172.21.2.135:0/827290166 shutdown_connections 2021-11-15T14:40:10.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- 172.21.2.135:0/827290166 wait complete. 2021-11-15T14:40:10.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 Processor -- start 2021-11-15T14:40:10.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.916+0000 7f1917e02700 1 -- start start 2021-11-15T14:40:10.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19100a9c90 0x7f1910140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19100b3790 0x7f19100660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100aa610 con 0x7f19100a9c90 2021-11-15T14:40:10.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100ab1e0 con 0x7f19100b0630 2021-11-15T14:40:10.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100aa800 con 0x7f19100b3790 2021-11-15T14:40:10.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:10.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:58998/0 (socket says 172.21.2.135:58998) 2021-11-15T14:40:10.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 -- 172.21.2.135:0/1971394037 learned_addr learned my addr 172.21.2.135:0/1971394037 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:10.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 -- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19100b3790 msgr2=0x7f19100660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:10.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19100b3790 0x7f19100660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 -- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19100a9c90 msgr2=0x7f1910140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:10.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19100a9c90 0x7f1910140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:10.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 -- 172.21.2.135:0/1971394037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908009530 con 0x7f19100b0630 2021-11-15T14:40:10.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f191539d700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1900002f70 tx=0x7f1900006e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:10.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190000e470 con 0x7f19100b0630 2021-11-15T14:40:10.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190000e5d0 con 0x7f19100b0630 2021-11-15T14:40:10.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f190000e930 con 0x7f19100b0630 2021-11-15T14:40:10.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19100aaaa0 con 0x7f19100b0630 2021-11-15T14:40:10.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1910060540 con 0x7f19100b0630 2021-11-15T14:40:10.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191013dce0 con 0x7f19100b0630 2021-11-15T14:40:10.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1900018030 con 0x7f19100b0630 2021-11-15T14:40:10.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 0x7f18f0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:10.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f190006acf0 con 0x7f19100b0630 2021-11-15T14:40:10.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1915b9e700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 0x7f18f0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:10.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.920+0000 7f1915b9e700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 0x7f18f0055bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f190c002f90 tx=0x7f190c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:10.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:10.924+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1900041f10 con 0x7f19100b0630 2021-11-15T14:40:11.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.008+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f19100573d0 con 0x7f19100b0630 2021-11-15T14:40:11.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.020+0000 7f18feffd700 1 -- 172.21.2.135:0/1971394037 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1900045530 con 0x7f19100b0630 2021-11-15T14:40:11.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 msgr2=0x7f18f0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 0x7f18f0055bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f190c002f90 tx=0x7f190c0069b0).stop 2021-11-15T14:40:11.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 msgr2=0x7f1910065bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1900002f70 tx=0x7f1900006e00).stop 2021-11-15T14:40:11.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 shutdown_connections 2021-11-15T14:40:11.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18f00536f0 0x7f18f0055bb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19100b3790 0x7f19100660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19100b0630 0x7f1910065bd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 --2- 172.21.2.135:0/1971394037 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f19100a9c90 0x7f1910140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 >> 172.21.2.135:0/1971394037 conn(0x7f1910060840 msgr2=0x7f191005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:11.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 shutdown_connections 2021-11-15T14:40:11.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.024+0000 7f1917e02700 1 -- 172.21.2.135:0/1971394037 wait complete. 2021-11-15T14:40:11.034 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-15T14:40:11.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 Processor -- start 2021-11-15T14:40:11.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 -- start start 2021-11-15T14:40:11.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 0x7f7e940acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e940aa650 0x7f7e9413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940b6d60 con 0x7f7e940b6980 2021-11-15T14:40:11.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e94061260 con 0x7f7e940aa650 2021-11-15T14:40:11.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e9a58d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94061500 con 0x7f7e94060990 2021-11-15T14:40:11.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e93fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7e940b6980 0x7f7e940a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46592/0 (socket says 172.21.2.135:46592) 2021-11-15T14:40:11.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e93fff700 1 -- 172.21.2.135:0/1648756747 learned_addr learned my addr 172.21.2.135:0/1648756747 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:11.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842614873 0 0) 0x7f7e940b6d60 con 0x7f7e940b6980 2021-11-15T14:40:11.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e74003260 con 0x7f7e940b6980 2021-11-15T14:40:11.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916113406 0 0) 0x7f7e74003260 con 0x7f7e940b6980 2021-11-15T14:40:11.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 msgr2=0x7f7e940acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 0x7f7e940acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 >> v2:172.21.2.119:3300/0 conn(0x7f7e940aa650 msgr2=0x7f7e9413c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 --2- 172.21.2.135:0/1648756747 >> v2:172.21.2.119:3300/0 conn(0x7f7e940aa650 0x7f7e9413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940617a0 con 0x7f7e940b6980 2021-11-15T14:40:11.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7e84001680 con 0x7f7e940b6980 2021-11-15T14:40:11.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 >> v1:172.21.2.135:6789/0 conn(0x7f7e940b6980 legacy=0x7f7e940a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e74003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 0x7f7e74004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e74004bf0 0x7f7e74005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94061260 con 0x7f7e74004bf0 2021-11-15T14:40:11.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94061500 con 0x7f7e740037d0 2021-11-15T14:40:11.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.080+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74005330 con 0x7f7e94060990 2021-11-15T14:40:11.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e74003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 msgr2=0x7f7e74004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e94060990 0x7f7e74004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e74004bf0 msgr2=0x7f7e74005720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e74004bf0 0x7f7e74005720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1648756747 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74003260 con 0x7f7e740037d0 2021-11-15T14:40:11.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e74003bf0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f7e84001390 tx=0x7f7e940ac010).ready entity=mon.1 client_cookie=71afa30d3d36c743 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e84007170 con 0x7f7e740037d0 2021-11-15T14:40:11.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840072d0 con 0x7f7e740037d0 2021-11-15T14:40:11.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e92ffd700 1 -- 172.21.2.135:0/1648756747 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8400c9c0 con 0x7f7e740037d0 2021-11-15T14:40:11.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1648756747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 msgr2=0x7f7e74003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1648756747 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e74003bf0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f7e84001390 tx=0x7f7e940ac010).stop 2021-11-15T14:40:11.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e98b2a700 1 -- 172.21.2.135:0/1648756747 reap_dead start 2021-11-15T14:40:11.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1648756747 shutdown_connections 2021-11-15T14:40:11.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1648756747 >> 172.21.2.135:0/1648756747 conn(0x7f7e940b3500 msgr2=0x7f7e940b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:11.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1648756747 shutdown_connections 2021-11-15T14:40:11.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1648756747 wait complete. 2021-11-15T14:40:11.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 Processor -- start 2021-11-15T14:40:11.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- start start 2021-11-15T14:40:11.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e940ad800 0x7f7e94153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 0x7f7e94155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9413f5d0 con 0x7f7e940ae310 2021-11-15T14:40:11.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940ad590 con 0x7f7e740037d0 2021-11-15T14:40:11.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940ad2f0 con 0x7f7e940ad800 2021-11-15T14:40:11.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59016/0 (socket says 172.21.2.135:59016) 2021-11-15T14:40:11.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1560171222 learned_addr learned my addr 172.21.2.135:0/1560171222 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:11.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e937fe700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e940ad800 0x7f7e94153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e98b2a700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 0x7f7e94155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e940ad800 msgr2=0x7f7e94153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e940ad800 0x7f7e94153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 msgr2=0x7f7e94155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 0x7f7e94155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 -- 172.21.2.135:0/1560171222 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940af320 con 0x7f7e740037d0 2021-11-15T14:40:11.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e98b2a700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 0x7f7e94155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:11.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e93fff700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f7e84001390 tx=0x7f7e84013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e84007170 con 0x7f7e740037d0 2021-11-15T14:40:11.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84004730 con 0x7f7e740037d0 2021-11-15T14:40:11.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940ae790 con 0x7f7e740037d0 2021-11-15T14:40:11.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940ae0d0 con 0x7f7e740037d0 2021-11-15T14:40:11.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e84004a90 con 0x7f7e740037d0 2021-11-15T14:40:11.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.084+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e940aeb90 con 0x7f7e740037d0 2021-11-15T14:40:11.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e8401d020 con 0x7f7e740037d0 2021-11-15T14:40:11.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e917fa700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 0x7f7e78055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7e8406c2b0 con 0x7f7e740037d0 2021-11-15T14:40:11.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e937fe700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 0x7f7e78055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e937fe700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 0x7f7e78055a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7e7c00a000 tx=0x7f7e7c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.088+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e84043420 con 0x7f7e740037d0 2021-11-15T14:40:11.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.200+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f7e94061a40 con 0x7f7e740037d0 2021-11-15T14:40:11.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e917fa700 1 -- 172.21.2.135:0/1560171222 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v238) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7e84046a40 con 0x7f7e740037d0 2021-11-15T14:40:11.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 msgr2=0x7f7e78055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 0x7f7e78055a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7e7c00a000 tx=0x7f7e7c008040).stop 2021-11-15T14:40:11.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 msgr2=0x7f7e9413b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f7e84001390 tx=0x7f7e84013000).stop 2021-11-15T14:40:11.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 shutdown_connections 2021-11-15T14:40:11.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e78053540 0x7f7e78055a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e940ae310 0x7f7e94155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e940ad800 0x7f7e94153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 --2- 172.21.2.135:0/1560171222 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e740037d0 0x7f7e9413b800 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 >> 172.21.2.135:0/1560171222 conn(0x7f7e940b3500 msgr2=0x7f7e9413f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:11.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 shutdown_connections 2021-11-15T14:40:11.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.868+0000 7f7e9a58d700 1 -- 172.21.2.135:0/1560171222 wait complete. 2021-11-15T14:40:11.879 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-15T14:40:11.880 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:40:11.880 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-15T14:40:11.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 Processor -- start 2021-11-15T14:40:11.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 -- start start 2021-11-15T14:40:11.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b11f0 0x7fefac1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fefac1419a0 0x7fefac141e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0b3250 con 0x7fefac0b7890 2021-11-15T14:40:11.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0b7c70 con 0x7fefac1419a0 2021-11-15T14:40:11.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefb0db3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac067640 con 0x7fefac0b11f0 2021-11-15T14:40:11.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fefac1419a0 0x7fefac141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fefac1419a0 0x7fefac141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59022/0 (socket says 172.21.2.135:59022) 2021-11-15T14:40:11.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 -- 172.21.2.135:0/2280647444 learned_addr learned my addr 172.21.2.135:0/2280647444 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:11.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefa9d9b700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b11f0 0x7fefac1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 -- 172.21.2.135:0/2280647444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b11f0 msgr2=0x7fefac1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b11f0 0x7fefac1414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 -- 172.21.2.135:0/2280647444 >> v1:172.21.2.119:6789/0 conn(0x7fefac0b7890 legacy=0x7fefac144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:11.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 -- 172.21.2.135:0/2280647444 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac1422f0 con 0x7fefac1419a0 2021-11-15T14:40:11.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefaad9d700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac1419a0 0x7fefac141e00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fefac0607c0 tx=0x7fefa4009290).ready entity=mon.1 client_cookie=db54898228d0f8b1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefa959a700 1 -- 172.21.2.135:0/2280647444 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa400b860 con 0x7fefac1419a0 2021-11-15T14:40:11.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefa959a700 1 -- 172.21.2.135:0/2280647444 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa400b9c0 con 0x7fefac1419a0 2021-11-15T14:40:11.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.928+0000 7fefa959a700 1 -- 172.21.2.135:0/2280647444 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa400bb70 con 0x7fefac1419a0 2021-11-15T14:40:11.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2280647444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac1419a0 msgr2=0x7fefac141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac1419a0 0x7fefac141e00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fefac0607c0 tx=0x7fefa4009290).stop 2021-11-15T14:40:11.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2280647444 shutdown_connections 2021-11-15T14:40:11.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac1419a0 0x7fefac141e00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2280647444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b11f0 0x7fefac1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:11.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2280647444 >> 172.21.2.135:0/2280647444 conn(0x7fefac05f730 msgr2=0x7fefac05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:11.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2280647444 shutdown_connections 2021-11-15T14:40:11.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2280647444 wait complete. 2021-11-15T14:40:11.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 Processor -- start 2021-11-15T14:40:11.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- start start 2021-11-15T14:40:11.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b7890 0x7fefac0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefac1419a0 0x7fefac0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0ab590 con 0x7fefac1419a0 2021-11-15T14:40:11.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0ab830 con 0x7fefac0b11f0 2021-11-15T14:40:11.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0abad0 con 0x7fefac0b7890 2021-11-15T14:40:11.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59032/0 (socket says 172.21.2.135:59032) 2021-11-15T14:40:11.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 -- 172.21.2.135:0/2704747822 learned_addr learned my addr 172.21.2.135:0/2704747822 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:11.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 -- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b7890 msgr2=0x7fefac0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b7890 0x7fefac0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 -- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefac1419a0 msgr2=0x7fefac0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:11.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefac1419a0 0x7fefac0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:11.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 -- 172.21.2.135:0/2704747822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4009530 con 0x7fefac0b11f0 2021-11-15T14:40:11.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefaa59c700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fef94001fa0 tx=0x7fef94007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef9400ce80 con 0x7fefac0b11f0 2021-11-15T14:40:11.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94007240 con 0x7fefac0b11f0 2021-11-15T14:40:11.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac0af480 con 0x7fefac0b11f0 2021-11-15T14:40:11.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac0b6770 con 0x7fefac0b11f0 2021-11-15T14:40:11.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef94006510 con 0x7fefac0b11f0 2021-11-15T14:40:11.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac0ac5a0 con 0x7fefac0b11f0 2021-11-15T14:40:11.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef94010030 con 0x7fefac0b11f0 2021-11-15T14:40:11.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 0x7fef90055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:11.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.932+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fef9406b5a0 con 0x7fefac0b11f0 2021-11-15T14:40:11.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.936+0000 7fefa9d9b700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 0x7fef90055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:11.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.936+0000 7fefa9d9b700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 0x7fef90055bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fef9c007000 tx=0x7fef9c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:11.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:11.936+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefac0ac5a0 con 0x7fefac0b11f0 2021-11-15T14:40:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.052+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fefac0ac5a0 con 0x7fefac0b11f0 2021-11-15T14:40:12.310 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:12.313 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:12.317 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:12.320 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:12.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefa37fe700 1 -- 172.21.2.135:0/2704747822 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v239) v1 ==== 142+0+0 (secure 0 0 0) 0x7fefac0ac5a0 con 0x7fefac0b11f0 2021-11-15T14:40:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 msgr2=0x7fef90055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 0x7fef90055bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fef9c007000 tx=0x7fef9c008040).stop 2021-11-15T14:40:12.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 msgr2=0x7fefac13f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fef94001fa0 tx=0x7fef94007c30).stop 2021-11-15T14:40:12.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 shutdown_connections 2021-11-15T14:40:12.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef900536f0 0x7fef90055bb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:12.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefac1419a0 0x7fefac0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:12.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefac0b7890 0x7fefac0accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:12.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 --2- 172.21.2.135:0/2704747822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefac0b11f0 0x7fefac13f840 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:12.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 >> 172.21.2.135:0/2704747822 conn(0x7fefac05f730 msgr2=0x7fefac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:12.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 shutdown_connections 2021-11-15T14:40:12.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.872+0000 7fefb0db3700 1 -- 172.21.2.135:0/2704747822 wait complete. 2021-11-15T14:40:12.884 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:40:12.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 Processor -- start 2021-11-15T14:40:12.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- start start 2021-11-15T14:40:12.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f71f80b1f40 0x7f71f80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:12.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80b04a0 con 0x7f71f80b2320 2021-11-15T14:40:12.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80a7850 con 0x7f71f80b0030 2021-11-15T14:40:12.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80b06d0 con 0x7f71f80b1f40 2021-11-15T14:40:12.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f71f80b0030 0x7f71f80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46626/0 (socket says 172.21.2.135:46626) 2021-11-15T14:40:12.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f77fe700 1 -- 172.21.2.135:0/3445532544 learned_addr learned my addr 172.21.2.135:0/3445532544 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:12.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f7fff700 1 --2- 172.21.2.135:0/3445532544 >> v2:172.21.2.135:3300/0 conn(0x7f71f80b1f40 0x7f71f80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:12.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f7fff700 1 -- 172.21.2.135:0/3445532544 >> v1:172.21.2.135:6789/0 conn(0x7f71f80b0030 legacy=0x7f71f80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f7fff700 1 -- 172.21.2.135:0/3445532544 >> v1:172.21.2.119:6789/0 conn(0x7f71f80b2320 legacy=0x7f71f81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:12.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f7fff700 1 -- 172.21.2.135:0/3445532544 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80b0970 con 0x7f71f80b1f40 2021-11-15T14:40:12.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f7fff700 1 --2- 172.21.2.135:0/3445532544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b1f40 0x7f71f80b1350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f71f80ad350 tx=0x7f71e8006df0).ready entity=mon.1 client_cookie=35ea4a1579a32551 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:12.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f6ffd700 1 -- 172.21.2.135:0/3445532544 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e800d5c0 con 0x7f71f80b1f40 2021-11-15T14:40:12.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f6ffd700 1 -- 172.21.2.135:0/3445532544 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8000e90 con 0x7f71f80b1f40 2021-11-15T14:40:12.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71f6ffd700 1 -- 172.21.2.135:0/3445532544 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e800d910 con 0x7f71f80b1f40 2021-11-15T14:40:12.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- 172.21.2.135:0/3445532544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b1f40 msgr2=0x7f71f80b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 --2- 172.21.2.135:0/3445532544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b1f40 0x7f71f80b1350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f71f80ad350 tx=0x7f71e8006df0).stop 2021-11-15T14:40:12.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- 172.21.2.135:0/3445532544 shutdown_connections 2021-11-15T14:40:12.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 --2- 172.21.2.135:0/3445532544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b1f40 0x7f71f80b1350 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:12.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- 172.21.2.135:0/3445532544 >> 172.21.2.135:0/3445532544 conn(0x7f71f805f730 msgr2=0x7f71f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:12.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- 172.21.2.135:0/3445532544 shutdown_connections 2021-11-15T14:40:12.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.940+0000 7f71fea48700 1 -- 172.21.2.135:0/3445532544 wait complete. 2021-11-15T14:40:12.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 Processor -- start 2021-11-15T14:40:12.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- start start 2021-11-15T14:40:12.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71f80b0030 0x7f71f8142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:12.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71f80b1f40 0x7f71f8145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:12.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:12.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8142e80 con 0x7f71f80b0030 2021-11-15T14:40:12.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80ab540 con 0x7f71f80b2320 2021-11-15T14:40:12.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80a9f90 con 0x7f71f80b1f40 2021-11-15T14:40:12.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:12.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59044/0 (socket says 172.21.2.135:59044) 2021-11-15T14:40:12.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 -- 172.21.2.135:0/2912691333 learned_addr learned my addr 172.21.2.135:0/2912691333 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:12.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 -- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71f80b1f40 msgr2=0x7f71f8145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71f80b1f40 0x7f71f8145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:12.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 -- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71f80b0030 msgr2=0x7f71f8142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:12.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71f80b0030 0x7f71f8142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:12.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 -- 172.21.2.135:0/2912691333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e800b180 con 0x7f71f80b2320 2021-11-15T14:40:12.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fcfe5700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f71f8144240 tx=0x7f71f00090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:12.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f000d4a0 con 0x7f71f80b2320 2021-11-15T14:40:12.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000d600 con 0x7f71f80b2320 2021-11-15T14:40:12.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f000d960 con 0x7f71f80b2320 2021-11-15T14:40:12.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f8146880 con 0x7f71f80b2320 2021-11-15T14:40:12.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80aa1c0 con 0x7f71f80b2320 2021-11-15T14:40:12.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f80aa380 con 0x7f71f80b2320 2021-11-15T14:40:12.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71f0018030 con 0x7f71f80b2320 2021-11-15T14:40:12.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 0x7f71dc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:12.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f71f006b0e0 con 0x7f71f80b2320 2021-11-15T14:40:12.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.944+0000 7f71f7fff700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 0x7f71dc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:12.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.948+0000 7f71f7fff700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 0x7f71dc055b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f71f80ad350 tx=0x7f71e8012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:12.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:12.948+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71f0042360 con 0x7f71f80b2320 2021-11-15T14:40:13.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.032+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f71f80b0c10 con 0x7f71f80b2320 2021-11-15T14:40:13.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71f57fa700 1 -- 172.21.2.135:0/2912691333 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71f0045980 con 0x7f71f80b2320 2021-11-15T14:40:13.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 msgr2=0x7f71dc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 0x7f71dc055b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f71f80ad350 tx=0x7f71e8012000).stop 2021-11-15T14:40:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 msgr2=0x7f71f8146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f71f8144240 tx=0x7f71f00090f0).stop 2021-11-15T14:40:13.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 shutdown_connections 2021-11-15T14:40:13.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71dc053660 0x7f71dc055b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71f80b2320 0x7f71f8146390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71f80b1f40 0x7f71f8145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 --2- 172.21.2.135:0/2912691333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71f80b0030 0x7f71f8142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 >> 172.21.2.135:0/2912691333 conn(0x7f71f805f730 msgr2=0x7f71f813f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 shutdown_connections 2021-11-15T14:40:13.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.040+0000 7f71fea48700 1 -- 172.21.2.135:0/2912691333 wait complete. 2021-11-15T14:40:13.051 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:40:13.051 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:13.061 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:13.075 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:13.083 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:40:13.095 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:40:13.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:13.096 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:13.097 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:13.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:40:13.101 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:40:13.101 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:40:13.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:13.102 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:13.102 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:13.123 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:40:13.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:40:13.124 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:40:13.125 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:40:13.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 Processor -- start 2021-11-15T14:40:13.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 -- start start 2021-11-15T14:40:13.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2d680b4cc0 0x7f2d6814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680aac30 con 0x7f2d68067380 2021-11-15T14:40:13.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d68060560 con 0x7f2d680b4cc0 2021-11-15T14:40:13.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6c95f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68066f20 con 0x7f2d68060180 2021-11-15T14:40:13.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d65d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2d68067380 0x7f2d68143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46638/0 (socket says 172.21.2.135:46638) 2021-11-15T14:40:13.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d65d9b700 1 -- 172.21.2.135:0/2772811769 learned_addr learned my addr 172.21.2.135:0/2772811769 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:13.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d66d9d700 1 --2- 172.21.2.135:0/2772811769 >> v2:172.21.2.135:3300/0 conn(0x7f2d680b4cc0 0x7f2d6814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d66d9d700 1 -- 172.21.2.135:0/2772811769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 msgr2=0x7f2d680b47d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:13.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d66d9d700 1 --2- 172.21.2.135:0/2772811769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b47d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d66d9d700 1 -- 172.21.2.135:0/2772811769 >> v1:172.21.2.135:6789/0 conn(0x7f2d68067380 legacy=0x7f2d68143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d6559a700 1 -- 172.21.2.135:0/2772811769 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850361931 0 0) 0x7f2d680aac30 con 0x7f2d68067380 2021-11-15T14:40:13.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.180+0000 7f2d66d9d700 1 -- 172.21.2.135:0/2772811769 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680b3430 con 0x7f2d680b4cc0 2021-11-15T14:40:13.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d66d9d700 1 --2- 172.21.2.135:0/2772811769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d680b4cc0 0x7f2d6814b8d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f2d600032f0 tx=0x7f2d600091d0).ready entity=mon.1 client_cookie=125f0138ed16d9f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6559a700 1 -- 172.21.2.135:0/2772811769 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d60009ea0 con 0x7f2d680b4cc0 2021-11-15T14:40:13.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6559a700 1 -- 172.21.2.135:0/2772811769 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000b8a0 con 0x7f2d680b4cc0 2021-11-15T14:40:13.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6559a700 1 -- 172.21.2.135:0/2772811769 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6000ba10 con 0x7f2d680b4cc0 2021-11-15T14:40:13.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/2772811769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d680b4cc0 msgr2=0x7f2d6814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/2772811769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d680b4cc0 0x7f2d6814b8d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f2d600032f0 tx=0x7f2d600091d0).stop 2021-11-15T14:40:13.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/2772811769 shutdown_connections 2021-11-15T14:40:13.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/2772811769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d680b4cc0 0x7f2d6814b8d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/2772811769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/2772811769 >> 172.21.2.135:0/2772811769 conn(0x7f2d6805cfb0 msgr2=0x7f2d6805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/2772811769 shutdown_connections 2021-11-15T14:40:13.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/2772811769 wait complete. 2021-11-15T14:40:13.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 Processor -- start 2021-11-15T14:40:13.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- start start 2021-11-15T14:40:13.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d680b4cc0 0x7f2d680ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68142e50 con 0x7f2d680b4cc0 2021-11-15T14:40:13.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6809f7d0 con 0x7f2d68067380 2021-11-15T14:40:13.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6809fa70 con 0x7f2d68060180 2021-11-15T14:40:13.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59056/0 (socket says 172.21.2.135:59056) 2021-11-15T14:40:13.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 -- 172.21.2.135:0/3795344953 learned_addr learned my addr 172.21.2.135:0/3795344953 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:13.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 -- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 msgr2=0x7f2d680b5be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:13.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b5be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 -- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d680b4cc0 msgr2=0x7f2d680ad4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:13.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d680b4cc0 0x7f2d680ad4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 -- 172.21.2.135:0/3795344953 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60009470 con 0x7f2d68067380 2021-11-15T14:40:13.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d65d9b700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f2d6809f680 tx=0x7f2d50007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5000ce40 con 0x7f2d68067380 2021-11-15T14:40:13.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d500072e0 con 0x7f2d68067380 2021-11-15T14:40:13.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6809fd10 con 0x7f2d68067380 2021-11-15T14:40:13.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d681577e0 con 0x7f2d68067380 2021-11-15T14:40:13.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d50005610 con 0x7f2d68067380 2021-11-15T14:40:13.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d680573d0 con 0x7f2d68067380 2021-11-15T14:40:13.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d5001a060 con 0x7f2d68067380 2021-11-15T14:40:13.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 0x7f2d4c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.184+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f2d5006b210 con 0x7f2d68067380 2021-11-15T14:40:13.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.188+0000 7f2d6659c700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 0x7f2d4c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.188+0000 7f2d6659c700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 0x7f2d4c055bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f2d58002fb0 tx=0x7f2d58006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.188+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d500423e0 con 0x7f2d68067380 2021-11-15T14:40:13.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2d68069960 con 0x7f2d68067380 2021-11-15T14:40:13.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d5f7fe700 1 -- 172.21.2.135:0/3795344953 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v71) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f2d50018020 con 0x7f2d68067380 2021-11-15T14:40:13.276 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:13.277 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:40:13.277 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 71, 2021-11-15T14:40:13.277 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:40:13.278 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:40:13.278 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:40:10.846876+0000", 2021-11-15T14:40:13.278 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:40:13.278 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:40:13.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:40:13.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:40:13.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:40:13.279 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:40:13.279 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:40:13.280 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:40:13.280 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:40:13.280 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:13.280 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:40:13.281 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:40:13.281 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:40:13.281 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:40:13.281 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:40:13.282 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 12, 2021-11-15T14:40:13.282 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:40:13.282 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:40:13.282 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:40:13.283 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:40:13.283 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:40:13.283 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.283 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:40:13.283 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:40:13.284 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:40:13.284 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:13.284 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:13.284 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:13.285 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:13.285 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:13.285 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:13.285 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:13.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:13.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:40:13.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:40:13.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:40:13.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:40:13.287 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:40:13.287 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:13.287 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:13.287 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:13.288 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:13.288 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:13.288 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:13.288 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:13.289 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.289 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:40:13.289 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:13.289 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:13.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:13.290 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:13.290 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:13.290 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:13.290 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:13.291 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:13.291 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:13.291 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:13.291 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:13.292 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:13.292 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:13.292 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:13.292 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:13.293 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:13.293 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:13.293 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:13.293 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:13.293 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:13.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:13.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:13.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:13.294 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:13.295 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:13.295 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:13.295 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.295 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:13.296 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:13.296 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:13.296 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:13.296 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:13.297 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:13.297 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:13.297 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:13.297 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:13.297 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:13.298 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:13.298 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:40:13.298 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:40:13.298 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.299 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:13.299 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:40:13.299 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.299 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.300 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.300 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:40:13.300 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:40:13.300 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:40:13.301 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:40:13.301 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:40:13.301 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:40:13.301 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:40:13.301 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:40:13.302 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:40:13.302 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:40:13.302 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:40:13.302 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:40:13.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:40:13.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:40:13.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:40:13.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:40:13.304 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:40:13.304 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:40:13.304 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:40:13.304 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:40:13.305 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:40:13.305 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:40:13.305 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:40:13.305 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:40:13.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:40:13.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:40:13.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:40:13.306 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:40:13.307 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:40:13.307 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:40:13.307 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:40:13.307 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:40:13.308 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:40:13.308 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:40:13.308 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:40:13.308 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:40:13.309 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:40:13.309 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:40:13.309 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:40:13.309 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:40:13.309 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:40:13.310 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:40:13.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:40:13.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:40:13.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:40:13.311 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:40:13.311 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:40:13.311 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:40:13.311 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:40:13.312 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:40:13.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.312 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:40:13.312 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:40:13.312 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:40:13.313 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:40:13.313 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:40:13.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:40:13.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:40:13.314 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:40:13.314 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:40:13.314 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:40:13.314 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:40:13.314 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:40:13.315 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:40:13.315 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:40:13.315 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.315 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.316 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:13.316 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:40:13.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.316 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:40:13.316 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:40:13.317 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.317 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.317 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.317 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.318 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.318 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.319 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.319 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.319 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.320 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.320 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:40:13.320 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.321 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.321 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:40:13.321 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.321 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.322 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.322 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:40:13.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.323 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.324 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:40:13.324 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.325 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.325 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.325 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:40:13.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.327 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.327 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:40:13.328 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.328 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.328 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.328 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:40:13.330 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.330 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.330 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.331 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:40:13.331 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:40:13.331 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.331 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.332 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:40:13.332 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:40:13.332 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:40:13.332 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:40:13.333 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.333 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.333 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.333 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.333 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.334 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:40:13.334 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:40:13.334 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.335 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.335 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.335 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.335 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.336 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.336 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.336 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.336 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.336 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.337 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.337 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.338 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:40:13.338 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.338 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:40:13.339 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.339 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.340 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.340 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:40:13.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.342 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:40:13.342 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.343 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.343 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.343 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:40:13.345 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.345 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.345 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.345 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:40:13.346 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.346 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.347 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.347 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.348 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:40:13.348 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.348 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.348 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.349 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:40:13.349 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:40:13.349 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.349 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.350 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.350 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:40:13.350 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:40:13.350 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:40:13.351 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:40:13.351 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.351 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.351 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.351 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.352 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.352 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.352 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:40:13.352 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:40:13.353 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.353 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.353 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.353 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.354 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.354 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.354 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.354 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.355 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.355 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.355 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:40:13.356 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.357 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.357 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:40:13.358 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.358 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.359 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.359 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.360 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.361 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.361 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:40:13.362 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.364 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:40:13.364 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.365 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.365 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.365 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.366 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.366 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.367 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.367 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.368 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:40:13.368 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.368 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.369 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.369 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.370 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:40:13.370 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.371 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.371 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.372 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.372 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.373 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.373 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.374 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:40:13.374 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.375 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.376 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:40:13.376 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:40:13.377 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.377 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.378 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.378 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:40:13.379 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:40:13.379 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:40:13.379 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:40:13.380 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.380 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.381 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.381 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.382 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.382 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.382 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:40:13.383 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:40:13.383 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.384 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.384 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.385 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.385 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.386 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.386 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.386 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 65, 2021-11-15T14:40:13.387 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.387 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.388 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.388 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.389 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:40:13.390 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.390 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.392 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:40:13.392 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.392 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.393 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.394 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.395 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.395 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:40:13.396 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.396 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:40:13.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.399 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.399 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.399 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.400 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.401 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.401 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.402 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:40:13.402 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.403 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.403 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.404 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:40:13.404 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.405 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.405 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.406 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.407 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.408 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:40:13.408 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.409 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.410 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.410 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:40:13.411 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:40:13.411 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.412 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.412 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:40:13.413 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:40:13.413 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:40:13.414 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:40:13.414 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.415 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.415 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.415 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.416 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:40:13.416 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:40:13.416 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.416 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.417 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.417 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.418 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.418 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.418 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.418 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.419 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.419 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.419 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.419 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.420 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:40:13.420 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.420 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.421 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.421 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:40:13.421 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.421 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.422 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.422 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.422 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.423 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.423 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.423 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:40:13.424 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.424 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.424 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.425 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:40:13.425 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.425 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.425 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.426 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.426 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.427 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.427 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:40:13.428 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.429 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.429 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.430 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:40:13.430 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.431 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.431 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.432 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.432 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.432 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.433 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:40:13.433 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.433 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.434 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:40:13.434 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:40:13.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.435 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.435 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:40:13.435 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:40:13.435 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:40:13.436 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:40:13.436 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.436 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.436 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.437 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.437 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.437 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:40:13.438 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:40:13.438 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.438 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.438 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.439 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.439 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.439 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.439 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.440 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 65, 2021-11-15T14:40:13.440 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.440 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.440 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.441 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.441 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.441 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.441 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:40:13.441 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.442 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.442 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.442 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:40:13.443 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.443 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.443 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.443 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.444 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.444 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.445 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:40:13.445 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.445 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.445 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.446 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.446 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:40:13.446 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.446 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.447 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.447 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.447 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.447 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.448 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.448 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.448 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:40:13.448 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.448 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.449 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.449 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.449 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:40:13.449 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.450 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.450 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.450 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.450 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:40:13.452 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.452 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.452 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.453 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:40:13.453 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:40:13.453 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.453 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.454 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.454 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:40:13.454 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:40:13.454 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:40:13.454 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:40:13.455 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.455 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.455 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.455 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.456 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.456 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:40:13.456 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:40:13.457 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.457 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.457 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.457 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.457 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.458 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.458 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.459 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.459 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.459 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.460 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:40:13.460 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.460 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.461 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.461 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:40:13.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.461 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.462 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.462 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.462 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.463 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:40:13.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.464 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.464 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:40:13.465 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.465 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.465 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.465 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.466 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.466 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.467 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:40:13.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.467 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.467 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:40:13.468 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.468 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.468 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.469 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.470 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:40:13.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.471 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.471 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:40:13.471 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:40:13.472 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.472 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.472 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:40:13.473 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:40:13.473 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:40:13.473 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:40:13.473 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.474 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.474 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.474 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.475 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.475 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:40:13.475 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:40:13.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:40:13.476 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:40:13.476 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:40:13.476 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:40:13.476 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:40:13.476 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:40:13.477 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:40:13.477 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:40:13.477 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:40:13.477 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:40:13.478 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:40:13.478 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.478 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.478 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:40:13.479 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:40:13.480 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.480 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.481 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.481 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:40:13.481 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.482 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:40:13.482 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.482 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:40:13.483 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.484 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.484 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.484 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:40:13.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.485 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:40:13.485 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.487 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:40:13.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.487 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.487 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:40:13.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:40:13.488 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.488 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:40:13.489 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:40:13.489 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.490 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:40:13.490 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:40:13.490 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:40:13.490 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.491 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.491 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:40:13.491 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:40:13.492 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:40:13.492 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:40:13.492 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:40:13.492 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:40:13.492 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:40:13.493 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:13.493 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.493 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:13.493 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:40:13.494 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.494 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:40:13.494 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.494 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.495 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.495 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.495 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.495 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:40:13.496 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.496 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:40:13.496 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.497 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.497 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.497 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.497 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.498 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:40:13.498 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.499 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:40:13.499 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.499 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.499 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.500 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.500 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.500 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:40:13.500 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.501 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:40:13.501 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.502 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.502 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.502 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.502 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.503 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:40:13.503 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.503 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.503 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.504 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:40:13.504 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.504 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.504 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.505 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.505 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.505 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:40:13.505 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.506 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.506 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:40:13.506 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.506 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.507 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.507 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.507 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.507 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:40:13.508 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.508 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.508 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:40:13.509 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.509 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.509 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.509 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.509 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.510 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:40:13.510 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.510 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.510 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:13.511 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:40:13.511 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:40:13.511 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:40:13.511 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:40:13.512 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:40:13.512 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:40:13.512 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:40:13.512 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:40:13.513 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.513 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:40:13.513 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:40:13.513 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:40:13.514 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:40:13.514 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:40:13.514 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:40:13.514 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/2659643829": "2021-11-16T14:40:07.317756+0000", 2021-11-15T14:40:13.514 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6833/2659643829": "2021-11-16T14:40:07.317756+0000" 2021-11-15T14:40:13.515 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.515 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:40:13.515 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:40:13.515 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:40:13.516 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:40:13.516 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:40:13.516 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:40:13.516 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:40:13.517 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:40:13.517 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:40:13.517 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:40:13.518 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:40:13.518 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:40:13.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.518 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:40:13.519 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:40:13.519 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:40:13.519 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:40:13.519 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:40:13.519 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:40:13.520 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:40:13.520 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:13.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:13.520 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:40:13.521 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:40:13.521 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:40:13.521 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:40:13.521 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:40:13.522 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:40:13.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 msgr2=0x7f2d4c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 0x7f2d4c055bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f2d58002fb0 tx=0x7f2d58006930).stop 2021-11-15T14:40:13.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 msgr2=0x7f2d681572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f2d6809f680 tx=0x7f2d50007ac0).stop 2021-11-15T14:40:13.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 shutdown_connections 2021-11-15T14:40:13.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d4c0536f0 0x7f2d4c055bb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d680b4cc0 0x7f2d680ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d68067380 0x7f2d681572f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 --2- 172.21.2.135:0/3795344953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2d68060180 0x7f2d680b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 >> 172.21.2.135:0/3795344953 conn(0x7f2d6805cfb0 msgr2=0x7f2d680ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 shutdown_connections 2021-11-15T14:40:13.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.272+0000 7f2d6c95f700 1 -- 172.21.2.135:0/3795344953 wait complete. 2021-11-15T14:40:13.528 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:13.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 Processor -- start 2021-11-15T14:40:13.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 -- start start 2021-11-15T14:40:13.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 0x7f8004143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80040aac30 con 0x7f8004060180 2021-11-15T14:40:13.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8004060560 con 0x7f8004143e60 2021-11-15T14:40:13.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f800b462700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004066f20 con 0x7f8004067380 2021-11-15T14:40:13.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f80099ff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8004143e60 0x7f800414b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46654/0 (socket says 172.21.2.135:46654) 2021-11-15T14:40:13.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f80099ff700 1 -- 172.21.2.135:0/1250128090 learned_addr learned my addr 172.21.2.135:0/1250128090 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:13.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268102644 0 0) 0x7f8004060560 con 0x7f8004143e60 2021-11-15T14:40:13.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec003260 con 0x7f8004143e60 2021-11-15T14:40:13.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981644520 0 0) 0x7f7fec003260 con 0x7f8004143e60 2021-11-15T14:40:13.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 msgr2=0x7f8004143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 0x7f8004143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 >> v1:172.21.2.119:6789/0 conn(0x7f8004060180 legacy=0x7f80040b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040b3430 con 0x7f8004143e60 2021-11-15T14:40:13.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7ffc0019e0 con 0x7f8004143e60 2021-11-15T14:40:13.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 >> v1:172.21.2.135:6789/0 conn(0x7f8004143e60 legacy=0x7f800414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fec0037d0 0x7f7fec003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 0x7f7fec004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fec004b40 0x7f7fec004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004066f20 con 0x7f7fec004b40 2021-11-15T14:40:13.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec00ba00 con 0x7f7fec0037d0 2021-11-15T14:40:13.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec00bbc0 con 0x7f8004067380 2021-11-15T14:40:13.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.580+0000 7f80091fe700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fec0037d0 0x7f7fec003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 -- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 msgr2=0x7f7fec004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8004067380 0x7f7fec004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 -- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fec004b40 msgr2=0x7f7fec004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fec004b40 0x7f7fec004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 -- 172.21.2.135:0/1250128090 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec003260 con 0x7f7fec0037d0 2021-11-15T14:40:13.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fec0037d0 0x7f7fec003bd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f7ff8000f70 tx=0x7f7ff80079e0).ready entity=mon.1 client_cookie=5bb35161447bcf58 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8007cf0 con 0x7f7fec0037d0 2021-11-15T14:40:13.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8014410 con 0x7f7fec0037d0 2021-11-15T14:40:13.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff7fff700 1 -- 172.21.2.135:0/1250128090 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8014770 con 0x7f7fec0037d0 2021-11-15T14:40:13.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/1250128090 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fec0037d0 msgr2=0x7f7fec003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 --2- 172.21.2.135:0/1250128090 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fec0037d0 0x7f7fec003bd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f7ff8000f70 tx=0x7f7ff80079e0).stop 2021-11-15T14:40:13.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 -- 172.21.2.135:0/1250128090 reap_dead start 2021-11-15T14:40:13.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/1250128090 shutdown_connections 2021-11-15T14:40:13.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/1250128090 >> 172.21.2.135:0/1250128090 conn(0x7f800405cfb0 msgr2=0x7f800405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/1250128090 shutdown_connections 2021-11-15T14:40:13.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/1250128090 wait complete. 2021-11-15T14:40:13.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 Processor -- start 2021-11-15T14:40:13.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- start start 2021-11-15T14:40:13.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fec0037d0 0x7f8004061b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80041569b0 0x7f800415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b1180 con 0x7f80041569b0 2021-11-15T14:40:13.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800415a0e0 con 0x7f800415aa70 2021-11-15T14:40:13.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004062350 con 0x7f7fec0037d0 2021-11-15T14:40:13.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59078/0 (socket says 172.21.2.135:59078) 2021-11-15T14:40:13.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 -- 172.21.2.135:0/3020741362 learned_addr learned my addr 172.21.2.135:0/3020741362 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:13.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80091fe700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fec0037d0 0x7f8004061b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 -- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fec0037d0 msgr2=0x7f8004061b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fec0037d0 0x7f8004061b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 -- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80041569b0 msgr2=0x7f800415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80041569b0 0x7f800415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 -- 172.21.2.135:0/3020741362 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040b04e0 con 0x7f800415aa70 2021-11-15T14:40:13.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f80099ff700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7ffc0016f0 tx=0x7f7ffc001ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc004ab0 con 0x7f800415aa70 2021-11-15T14:40:13.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc004c10 con 0x7f800415aa70 2021-11-15T14:40:13.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040b08e0 con 0x7f800415aa70 2021-11-15T14:40:13.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ffc0070d0 con 0x7f800415aa70 2021-11-15T14:40:13.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.584+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80040ab610 con 0x7f800415aa70 2021-11-15T14:40:13.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80040b12f0 con 0x7f800415aa70 2021-11-15T14:40:13.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ffc01c070 con 0x7f800415aa70 2021-11-15T14:40:13.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f7ff67fc700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 0x7f7fe4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7ffc06ae30 con 0x7f800415aa70 2021-11-15T14:40:13.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f80091fe700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 0x7f7fe4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f80091fe700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 0x7f7fe4055b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7ff801a000 tx=0x7f7ff8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.588+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f80040b12f0 con 0x7f800415aa70 2021-11-15T14:40:13.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80040b12f0 con 0x7f800415aa70 2021-11-15T14:40:13.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f7ff67fc700 1 -- 172.21.2.135:0/3020741362 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f80040b12f0 con 0x7f800415aa70 2021-11-15T14:40:13.704 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:13.705 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3533811075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3533811075},{"type":"v1","addr":"172.21.2.135:6835","nonce":3533811075}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[]} 2021-11-15T14:40:13.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 msgr2=0x7f7fe4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 0x7f7fe4055b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7ff801a000 tx=0x7f7ff8015000).stop 2021-11-15T14:40:13.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 msgr2=0x7f80040a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7ffc0016f0 tx=0x7f7ffc001ca0).stop 2021-11-15T14:40:13.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 shutdown_connections 2021-11-15T14:40:13.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fe4053640 0x7f7fe4055b00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f800415aa70 0x7f80040a9b80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80041569b0 0x7f800415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 --2- 172.21.2.135:0/3020741362 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fec0037d0 0x7f8004061b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 >> 172.21.2.135:0/3020741362 conn(0x7f800405cfb0 msgr2=0x7f80040b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 shutdown_connections 2021-11-15T14:40:13.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.700+0000 7f800b462700 1 -- 172.21.2.135:0/3020741362 wait complete. 2021-11-15T14:40:13.709 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 35 2021-11-15T14:40:13.711 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:13.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.756+0000 7f75dc829700 1 Processor -- start 2021-11-15T14:40:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.756+0000 7f75dc829700 1 -- start start 2021-11-15T14:40:13.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f75d80a9f30 0x7f75d80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f75d80af0f0 0x7f75d8144500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80aa310 con 0x7f75d80b31b0 2021-11-15T14:40:13.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80ae380 con 0x7f75d80af0f0 2021-11-15T14:40:13.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d81481f0 con 0x7f75d80a9f30 2021-11-15T14:40:13.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f75d80a9f30 0x7f75d80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f75d80a9f30 0x7f75d80b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59082/0 (socket says 172.21.2.135:59082) 2021-11-15T14:40:13.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 -- 172.21.2.135:0/3425123008 learned_addr learned my addr 172.21.2.135:0/3425123008 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:13.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 -- 172.21.2.135:0/3425123008 >> v2:172.21.2.119:3300/0 conn(0x7f75d80af0f0 msgr2=0x7f75d8144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 --2- 172.21.2.135:0/3425123008 >> v2:172.21.2.119:3300/0 conn(0x7f75d80af0f0 0x7f75d8144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 -- 172.21.2.135:0/3425123008 >> v1:172.21.2.119:6789/0 conn(0x7f75d80b31b0 legacy=0x7f75d814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:13.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 -- 172.21.2.135:0/3425123008 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8148490 con 0x7f75d80a9f30 2021-11-15T14:40:13.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d659c700 1 --2- 172.21.2.135:0/3425123008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80a9f30 0x7f75d80b3760 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f75d80b77f0 tx=0x7f75c0006eb0).ready entity=mon.1 client_cookie=e2f6a8f553c5f0c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d559a700 1 -- 172.21.2.135:0/3425123008 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c000d5c0 con 0x7f75d80a9f30 2021-11-15T14:40:13.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d559a700 1 -- 172.21.2.135:0/3425123008 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0000e90 con 0x7f75d80a9f30 2021-11-15T14:40:13.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d559a700 1 -- 172.21.2.135:0/3425123008 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c000d910 con 0x7f75d80a9f30 2021-11-15T14:40:13.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- 172.21.2.135:0/3425123008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80a9f30 msgr2=0x7f75d80b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- 172.21.2.135:0/3425123008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80a9f30 0x7f75d80b3760 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f75d80b77f0 tx=0x7f75c0006eb0).stop 2021-11-15T14:40:13.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- 172.21.2.135:0/3425123008 shutdown_connections 2021-11-15T14:40:13.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- 172.21.2.135:0/3425123008 >> v2:172.21.2.119:3300/0 conn(0x7f75d80af0f0 0x7f75d8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- 172.21.2.135:0/3425123008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80a9f30 0x7f75d80b3760 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- 172.21.2.135:0/3425123008 >> 172.21.2.135:0/3425123008 conn(0x7f75d8060840 msgr2=0x7f75d8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- 172.21.2.135:0/3425123008 shutdown_connections 2021-11-15T14:40:13.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- 172.21.2.135:0/3425123008 wait complete. 2021-11-15T14:40:13.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 Processor -- start 2021-11-15T14:40:13.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- start start 2021-11-15T14:40:13.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75d80a9f30 0x7f75d80b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75d80af0f0 0x7f75d814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8145e70 con 0x7f75d80af0f0 2021-11-15T14:40:13.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80b11e0 con 0x7f75d80b31b0 2021-11-15T14:40:13.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75dc829700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80b1480 con 0x7f75d80a9f30 2021-11-15T14:40:13.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59088/0 (socket says 172.21.2.135:59088) 2021-11-15T14:40:13.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.760+0000 7f75d6d9d700 1 -- 172.21.2.135:0/4284315961 learned_addr learned my addr 172.21.2.135:0/4284315961 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:13.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 -- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75d80a9f30 msgr2=0x7f75d80b1920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:13.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75d80a9f30 0x7f75d80b1920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 -- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75d80af0f0 msgr2=0x7f75d814d5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:13.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75d80af0f0 0x7f75d814d5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 -- 172.21.2.135:0/4284315961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c000b1e0 con 0x7f75d80b31b0 2021-11-15T14:40:13.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d6d9d700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f75d00032f0 tx=0x7f75d0009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000d580 con 0x7f75d80b31b0 2021-11-15T14:40:13.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000d6e0 con 0x7f75d80b31b0 2021-11-15T14:40:13.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000da40 con 0x7f75d80b31b0 2021-11-15T14:40:13.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8145b90 con 0x7f75d80b31b0 2021-11-15T14:40:13.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8147160 con 0x7f75d80b31b0 2021-11-15T14:40:13.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d814aea0 con 0x7f75d80b31b0 2021-11-15T14:40:13.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75d000dba0 con 0x7f75d80b31b0 2021-11-15T14:40:13.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 0x7f75bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:13.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f75d006bc10 con 0x7f75d80b31b0 2021-11-15T14:40:13.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d659c700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 0x7f75bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:13.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75d659c700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 0x7f75bc055a40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f75d80b77f0 tx=0x7f75c0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:13.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.764+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75d0042de0 con 0x7f75d80b31b0 2021-11-15T14:40:13.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.872+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d8146040 con 0x7f75d80b31b0 2021-11-15T14:40:13.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75cf7fe700 1 -- 172.21.2.135:0/4284315961 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f75d0046400 con 0x7f75d80b31b0 2021-11-15T14:40:13.879 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:13.879 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4532,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3665849787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3665849787},{"type":"v1","addr":"172.21.2.119:6835","nonce":3665849787}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5905,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/1813541474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1813541474},{"type":"v1","addr":"172.21.2.135:6834","nonce":1813541474}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6115,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3533811075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3533811075},{"type":"v1","addr":"172.21.2.135:6835","nonce":3533811075}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[]} 2021-11-15T14:40:13.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 msgr2=0x7f75bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 0x7f75bc055a40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f75d80b77f0 tx=0x7f75c0015000).stop 2021-11-15T14:40:13.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 msgr2=0x7f75d81456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:13.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f75d00032f0 tx=0x7f75d0009220).stop 2021-11-15T14:40:13.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 shutdown_connections 2021-11-15T14:40:13.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75bc053580 0x7f75bc055a40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75d80b31b0 0x7f75d81456a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:13.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75d80af0f0 0x7f75d814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 --2- 172.21.2.135:0/4284315961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75d80a9f30 0x7f75d80b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:13.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 >> 172.21.2.135:0/4284315961 conn(0x7f75d8060840 msgr2=0x7f75d80af870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:13.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 shutdown_connections 2021-11-15T14:40:13.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.876+0000 7f75dc829700 1 -- 172.21.2.135:0/4284315961 wait complete. 2021-11-15T14:40:13.884 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 35 2021-11-15T14:40:13.887 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:40:13.887 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:40:13.888 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:40:13.888 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:40:13.888 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:40:13.889 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:40:13.889 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:40:13.889 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:40:13.890 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:40:13.890 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:40:13.890 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:40:13.891 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:40:13.893 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:40:13.894 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:40:13.895 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:40:13.896 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:40:13.897 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:40:13.897 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:40:13.940 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:40:13.941 DEBUG:teuthology.parallel:result is None 2021-11-15T14:40:13.943 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:40:13.943 DEBUG:teuthology.parallel:result is None 2021-11-15T14:40:13.944 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:40:13.945 DEBUG:teuthology.parallel:result is None 2021-11-15T14:40:13.945 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:40:13.976 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:40:13.979 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:40:13.980 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:40:14.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.996+0000 7f661260f700 1 Processor -- start 2021-11-15T14:40:14.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:13.996+0000 7f661260f700 1 -- start start 2021-11-15T14:40:14.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c060180 0x7f660c0616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f660c0659f0 0x7f660c065e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c060560 con 0x7f660c066650 2021-11-15T14:40:14.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0671a0 con 0x7f660c0659f0 2021-11-15T14:40:14.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c060cf0 con 0x7f660c060180 2021-11-15T14:40:14.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f660c0659f0 0x7f660c065e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c060180 0x7f660c0616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f6610bac700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f660c066650 0x7f660c066a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:56128/0 (socket says 172.21.2.135:56128) 2021-11-15T14:40:14.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f6610bac700 1 -- 172.21.2.135:0/367093598 learned_addr learned my addr 172.21.2.135:0/367093598 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:14.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c060180 msgr2=0x7f660c0616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:14.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c060180 0x7f660c0616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:14.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/367093598 >> v1:172.21.2.119:6789/0 conn(0x7f660c066650 legacy=0x7f660c066a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:14.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/367093598 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c060f90 con 0x7f660c0659f0 2021-11-15T14:40:14.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c0659f0 0x7f660c065e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f65fc002f70 tx=0x7f65fc006df0).ready entity=mon.0 client_cookie=a818c4204387cadd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:14.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660affd700 1 -- 172.21.2.135:0/367093598 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc00d570 con 0x7f660c0659f0 2021-11-15T14:40:14.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660affd700 1 -- 172.21.2.135:0/367093598 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc000e90 con 0x7f660c0659f0 2021-11-15T14:40:14.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660affd700 1 -- 172.21.2.135:0/367093598 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc00d8c0 con 0x7f660c0659f0 2021-11-15T14:40:14.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c0659f0 msgr2=0x7f660c065e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:14.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c0659f0 0x7f660c065e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f65fc002f70 tx=0x7f65fc006df0).stop 2021-11-15T14:40:14.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- 172.21.2.135:0/367093598 shutdown_connections 2021-11-15T14:40:14.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c0659f0 0x7f660c065e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:14.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- 172.21.2.135:0/367093598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c060180 0x7f660c0616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:14.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- 172.21.2.135:0/367093598 >> 172.21.2.135:0/367093598 conn(0x7f660c05cfb0 msgr2=0x7f660c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:14.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- 172.21.2.135:0/367093598 shutdown_connections 2021-11-15T14:40:14.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- 172.21.2.135:0/367093598 wait complete. 2021-11-15T14:40:14.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 Processor -- start 2021-11-15T14:40:14.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- start start 2021-11-15T14:40:14.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c060180 0x7f660c147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f660c066650 0x7f660c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c156e40 con 0x7f660c060180 2021-11-15T14:40:14.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0a8b00 con 0x7f660c066650 2021-11-15T14:40:14.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f661260f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0a8d30 con 0x7f660c0659f0 2021-11-15T14:40:14.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f6610bac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f660c066650 0x7f660c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:40672/0 (socket says 172.21.2.135:40672) 2021-11-15T14:40:14.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/2474286262 learned_addr learned my addr 172.21.2.135:0/2474286262 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:14.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660bfff700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c060180 0x7f660c147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/2474286262 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f660c066650 msgr2=0x7f660c0a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:14.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f660c066650 0x7f660c0a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:14.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c060180 msgr2=0x7f660c147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:14.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c060180 0x7f660c147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:14.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 -- 172.21.2.135:0/2474286262 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc00b180 con 0x7f660c0659f0 2021-11-15T14:40:14.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.000+0000 7f660b7fe700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f660c156f80 tx=0x7f65fc014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:14.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc00dea0 con 0x7f660c0659f0 2021-11-15T14:40:14.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc013e50 con 0x7f660c0659f0 2021-11-15T14:40:14.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65fc01e5f0 con 0x7f660c0659f0 2021-11-15T14:40:14.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c0a8fd0 con 0x7f660c0659f0 2021-11-15T14:40:14.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c0a9510 con 0x7f660c0659f0 2021-11-15T14:40:14.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c0a4dd0 con 0x7f660c0659f0 2021-11-15T14:40:14.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65fc025030 con 0x7f660c0659f0 2021-11-15T14:40:14.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 0x7f65f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:14.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f65fc06c580 con 0x7f660c0659f0 2021-11-15T14:40:14.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f660bfff700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 0x7f65f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:14.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.004+0000 7f660bfff700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 0x7f65f0055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f65f400b000 tx=0x7f65f4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:14.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.008+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65fc043860 con 0x7f660c0659f0 2021-11-15T14:40:14.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:14.100+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f660c061230 con 0x7f660c0659f0 2021-11-15T14:40:15.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.044+0000 7f66097fa700 1 -- 172.21.2.135:0/2474286262 <== mon.2 v2:172.21.2.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65fc023020 con 0x7f660c0659f0 2021-11-15T14:40:15.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 msgr2=0x7f65f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 0x7f65f0055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f65f400b000 tx=0x7f65f4006df0).stop 2021-11-15T14:40:15.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 msgr2=0x7f660c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f660c156f80 tx=0x7f65fc014000).stop 2021-11-15T14:40:15.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 shutdown_connections 2021-11-15T14:40:15.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f65f0053610 0x7f65f0055ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f660c066650 0x7f660c0a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f660c0659f0 0x7f660c156950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 --2- 172.21.2.135:0/2474286262 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f660c060180 0x7f660c147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 >> 172.21.2.135:0/2474286262 conn(0x7f660c05cfb0 msgr2=0x7f660c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 shutdown_connections 2021-11-15T14:40:15.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.048+0000 7f661260f700 1 -- 172.21.2.135:0/2474286262 wait complete. 2021-11-15T14:40:15.054 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:40:15.059 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:40:15.060 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:40:15.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 Processor -- start 2021-11-15T14:40:15.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- start start 2021-11-15T14:40:15.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa17c064a00 0x7fa17c144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c066580 con 0x7fa17c067190 2021-11-15T14:40:15.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0b4740 con 0x7fa17c0b35d0 2021-11-15T14:40:15.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c0b3f20 con 0x7fa17c064a00 2021-11-15T14:40:15.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa17c0b35d0 0x7fa17c066a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46726/0 (socket says 172.21.2.135:46726) 2021-11-15T14:40:15.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 -- 172.21.2.135:0/739334130 learned_addr learned my addr 172.21.2.135:0/739334130 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:15.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331845308 0 0) 0x7fa17c0b4740 con 0x7fa17c0b35d0 2021-11-15T14:40:15.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa164003260 con 0x7fa17c0b35d0 2021-11-15T14:40:15.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182453700 1 --2- 172.21.2.135:0/739334130 >> v2:172.21.2.119:3300/0 conn(0x7fa17c064a00 0x7fa17c144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4235564537 0 0) 0x7fa164003260 con 0x7fa17c0b35d0 2021-11-15T14:40:15.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 >> v2:172.21.2.119:3300/0 conn(0x7fa17c064a00 msgr2=0x7fa17c144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 --2- 172.21.2.135:0/739334130 >> v2:172.21.2.119:3300/0 conn(0x7fa17c064a00 0x7fa17c144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 >> v1:172.21.2.119:6789/0 conn(0x7fa17c067190 legacy=0x7fa17c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c064de0 con 0x7fa17c0b35d0 2021-11-15T14:40:15.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa178001660 con 0x7fa17c0b35d0 2021-11-15T14:40:15.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 >> v1:172.21.2.135:6789/0 conn(0x7fa17c0b35d0 legacy=0x7fa17c066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa164003820 0x7fa164003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 0x7fa164004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004f90 0x7fa16400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16400be50 con 0x7fa164003820 2021-11-15T14:40:15.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16400bfc0 con 0x7fa164004500 2021-11-15T14:40:15.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16400c180 con 0x7fa164004f90 2021-11-15T14:40:15.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 0x7fa164004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182453700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa164003820 0x7fa164003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 -- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004f90 msgr2=0x7fa16400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182c54700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004f90 0x7fa16400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004f90 0x7fa16400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 -- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa164003820 msgr2=0x7fa164003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa164003820 0x7fa164003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 -- 172.21.2.135:0/739334130 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa164003260 con 0x7fa164004500 2021-11-15T14:40:15.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182453700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa164003820 0x7fa164003c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:15.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182c54700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004f90 0x7fa16400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:15.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa182c54700 1 -- 172.21.2.135:0/739334130 reap_dead start 2021-11-15T14:40:15.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181c52700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 0x7fa164004980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fa17c0b7390 tx=0x7fa17c0651a0).ready entity=mon.1 client_cookie=a228c4e9bc8f1b85 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1780070d0 con 0x7fa164004500 2021-11-15T14:40:15.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178007230 con 0x7fa164004500 2021-11-15T14:40:15.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa181451700 1 -- 172.21.2.135:0/739334130 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17800c8f0 con 0x7fa164004500 2021-11-15T14:40:15.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 msgr2=0x7fa164004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 0x7fa164004980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fa17c0b7390 tx=0x7fa17c0651a0).stop 2021-11-15T14:40:15.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- 172.21.2.135:0/739334130 shutdown_connections 2021-11-15T14:40:15.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 --2- 172.21.2.135:0/739334130 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa164004500 0x7fa164004980 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- 172.21.2.135:0/739334130 >> 172.21.2.135:0/739334130 conn(0x7fa17c05f730 msgr2=0x7fa17c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- 172.21.2.135:0/739334130 shutdown_connections 2021-11-15T14:40:15.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.108+0000 7fa183455700 1 -- 172.21.2.135:0/739334130 wait complete. 2021-11-15T14:40:15.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 Processor -- start 2021-11-15T14:40:15.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- start start 2021-11-15T14:40:15.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 0x7fa17c1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa17c143e00 0x7fa17c141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c13b6e0 con 0x7fa17c143e00 2021-11-15T14:40:15.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1439d0 con 0x7fa17c13e160 2021-11-15T14:40:15.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c150c70 con 0x7fa164004500 2021-11-15T14:40:15.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59154/0 (socket says 172.21.2.135:59154) 2021-11-15T14:40:15.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 -- 172.21.2.135:0/422573328 learned_addr learned my addr 172.21.2.135:0/422573328 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa181c52700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa17c143e00 0x7fa17c141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182453700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 0x7fa17c1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 -- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 msgr2=0x7fa17c1442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 0x7fa17c1442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 -- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa17c143e00 msgr2=0x7fa17c141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa17c143e00 0x7fa17c141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 -- 172.21.2.135:0/422573328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c150f10 con 0x7fa17c13e160 2021-11-15T14:40:15.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182453700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 0x7fa17c1442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:40:15.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182c54700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fa17c143790 tx=0x7fa174009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa174013470 con 0x7fa17c13e160 2021-11-15T14:40:15.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1740135d0 con 0x7fa17c13e160 2021-11-15T14:40:15.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa174013930 con 0x7fa17c13e160 2021-11-15T14:40:15.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c0aec40 con 0x7fa17c13e160 2021-11-15T14:40:15.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c0aeef0 con 0x7fa17c13e160 2021-11-15T14:40:15.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c150ab0 con 0x7fa17c13e160 2021-11-15T14:40:15.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa17401a030 con 0x7fa17c13e160 2021-11-15T14:40:15.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 0x7fa15c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa17406afe0 con 0x7fa17c13e160 2021-11-15T14:40:15.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.112+0000 7fa182453700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 0x7fa15c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.116+0000 7fa182453700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 0x7fa15c055b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fa170009000 tx=0x7fa170008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.116+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa174042320 con 0x7fa17c13e160 2021-11-15T14:40:15.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa17c143b10 con 0x7fa17c13e160 2021-11-15T14:40:15.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa16f7fe700 1 -- 172.21.2.135:0/422573328 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fa174045940 con 0x7fa17c13e160 2021-11-15T14:40:15.234 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:15.234 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:40:15.234 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:40:15.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.235 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:40:15.235 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:40:15.235 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.236 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:40:15.236 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.236 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.236 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.237 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.237 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.237 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:40:15.237 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:40:15.238 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.238 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:40:15.238 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.238 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.239 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.239 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.239 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.240 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.240 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:40:15.240 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:40:15.241 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.241 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:40:15.241 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.241 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.241 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.242 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.242 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.242 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.243 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:40:15.243 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:40:15.243 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.243 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.243 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.244 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.244 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.244 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.245 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:40:15.245 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:40:15.245 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.245 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.246 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.246 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.246 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.246 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.247 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.247 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:40:15.247 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:40:15.247 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.248 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.248 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.248 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.249 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.249 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.249 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:40:15.250 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:40:15.250 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.250 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.250 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.251 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.251 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.251 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.251 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.252 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:40:15.252 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:40:15.252 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.252 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.253 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.253 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.253 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.253 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.254 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.254 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:40:15.254 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:40:15.254 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.255 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.255 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.255 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.255 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.256 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.256 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.256 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:40:15.256 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:40:15.257 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.257 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.257 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.258 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.258 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.258 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.259 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.259 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:40:15.259 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:40:15.259 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.259 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.260 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.260 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.261 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.261 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:40:15.261 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:40:15.262 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.262 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:40:15.262 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:40:15.262 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:40:15.262 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.263 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.263 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.263 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:40:15.263 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:40:15.264 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.264 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:40:15.264 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:40:15.264 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:40:15.265 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.265 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.265 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.265 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:40:15.266 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:40:15.266 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.266 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:40:15.267 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:40:15.267 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:40:15.267 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.267 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.268 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.268 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:40:15.268 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:40:15.269 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.269 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:40:15.269 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:40:15.269 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.270 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.270 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.270 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.270 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:40:15.271 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:40:15.271 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:40:15.271 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:40:15.271 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:40:15.271 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:40:15.272 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.272 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.272 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:40:15.272 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:40:15.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 msgr2=0x7fa15c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 0x7fa15c055b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fa170009000 tx=0x7fa170008040).stop 2021-11-15T14:40:15.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 msgr2=0x7fa17c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fa17c143790 tx=0x7fa174009040).stop 2021-11-15T14:40:15.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 shutdown_connections 2021-11-15T14:40:15.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa15c0536d0 0x7fa15c055b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa17c13e160 0x7fa17c0ae750 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa17c143e00 0x7fa17c141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 --2- 172.21.2.135:0/422573328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa164004500 0x7fa17c1442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 >> 172.21.2.135:0/422573328 conn(0x7fa17c05f730 msgr2=0x7fa17c0b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 shutdown_connections 2021-11-15T14:40:15.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.228+0000 7fa183455700 1 -- 172.21.2.135:0/422573328 wait complete. 2021-11-15T14:40:15.278 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:15.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 Processor -- start 2021-11-15T14:40:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- start start 2021-11-15T14:40:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc4040b1050 0x7fc4041447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040b03d0 con 0x7fc404148420 2021-11-15T14:40:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040b0670 con 0x7fc4040b1e30 2021-11-15T14:40:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4040a9140 con 0x7fc4040b1050 2021-11-15T14:40:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc4040b1e30 0x7fc4040b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46750/0 (socket says 172.21.2.135:46750) 2021-11-15T14:40:15.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 -- 172.21.2.135:0/2953607235 learned_addr learned my addr 172.21.2.135:0/2953607235 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876218221 0 0) 0x7fc4040b0670 con 0x7fc4040b1e30 2021-11-15T14:40:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003260 con 0x7fc4040b1e30 2021-11-15T14:40:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409b5a700 1 --2- 172.21.2.135:0/2953607235 >> v2:172.21.2.119:3300/0 conn(0x7fc4040b1050 0x7fc4041447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699100291 0 0) 0x7fc3ec003260 con 0x7fc4040b1e30 2021-11-15T14:40:15.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 >> v2:172.21.2.119:3300/0 conn(0x7fc4040b1050 msgr2=0x7fc4041447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 --2- 172.21.2.135:0/2953607235 >> v2:172.21.2.119:3300/0 conn(0x7fc4040b1050 0x7fc4041447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 >> v1:172.21.2.119:6789/0 conn(0x7fc404148420 legacy=0x7fc4040a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040b0910 con 0x7fc4040b1e30 2021-11-15T14:40:15.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc3f8001660 con 0x7fc4040b1e30 2021-11-15T14:40:15.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 >> v1:172.21.2.135:6789/0 conn(0x7fc4040b1e30 legacy=0x7fc4040b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc3ec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3ec004500 0x7fc3ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3ec004f70 0x7fc3ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00be20 con 0x7fc3ec004f70 2021-11-15T14:40:15.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00bf90 con 0x7fc3ec003820 2021-11-15T14:40:15.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c150 con 0x7fc3ec004500 2021-11-15T14:40:15.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc3ec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 -- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3ec004500 msgr2=0x7fc3ec004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3ec004500 0x7fc3ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 -- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3ec004f70 msgr2=0x7fc3ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3ec004f70 0x7fc3ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 -- 172.21.2.135:0/2953607235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec003260 con 0x7fc3ec003820 2021-11-15T14:40:15.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409b5a700 1 -- 172.21.2.135:0/2953607235 reap_dead start 2021-11-15T14:40:15.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc409359700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc3ec003c20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc4040acee0 tx=0x7fc4040b0800).ready entity=mon.1 client_cookie=d92e9d612205d1f3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f80070d0 con 0x7fc3ec003820 2021-11-15T14:40:15.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f8007230 con 0x7fc3ec003820 2021-11-15T14:40:15.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc3f7fff700 1 -- 172.21.2.135:0/2953607235 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f800c8f0 con 0x7fc3ec003820 2021-11-15T14:40:15.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 msgr2=0x7fc3ec003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc3ec003c20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc4040acee0 tx=0x7fc4040b0800).stop 2021-11-15T14:40:15.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- 172.21.2.135:0/2953607235 shutdown_connections 2021-11-15T14:40:15.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/2953607235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc3ec003c20 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- 172.21.2.135:0/2953607235 >> 172.21.2.135:0/2953607235 conn(0x7fc40405f730 msgr2=0x7fc40405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- 172.21.2.135:0/2953607235 shutdown_connections 2021-11-15T14:40:15.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 -- 172.21.2.135:0/2953607235 wait complete. 2021-11-15T14:40:15.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.328+0000 7fc40b5bd700 1 Processor -- start 2021-11-15T14:40:15.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- start start 2021-11-15T14:40:15.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4040ac4a0 0x7fc4040af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc40414d160 0x7fc4040af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040acf20 con 0x7fc40414d160 2021-11-15T14:40:15.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040ad180 con 0x7fc3ec003820 2021-11-15T14:40:15.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040ad420 con 0x7fc4040ac4a0 2021-11-15T14:40:15.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59170/0 (socket says 172.21.2.135:59170) 2021-11-15T14:40:15.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 -- 172.21.2.135:0/4093370740 learned_addr learned my addr 172.21.2.135:0/4093370740 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 -- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4040ac4a0 msgr2=0x7fc4040af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4040ac4a0 0x7fc4040af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 -- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc40414d160 msgr2=0x7fc4040af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc40414d160 0x7fc4040af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 -- 172.21.2.135:0/4093370740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040ad6c0 con 0x7fc3ec003820 2021-11-15T14:40:15.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc409359700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fc4040acee0 tx=0x7fc3f8013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f801a070 con 0x7fc3ec003820 2021-11-15T14:40:15.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f8004730 con 0x7fc3ec003820 2021-11-15T14:40:15.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f80070d0 con 0x7fc3ec003820 2021-11-15T14:40:15.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40414cdf0 con 0x7fc3ec003820 2021-11-15T14:40:15.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4040afcd0 con 0x7fc3ec003820 2021-11-15T14:40:15.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4040b0bb0 con 0x7fc3ec003820 2021-11-15T14:40:15.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3f8010070 con 0x7fc3ec003820 2021-11-15T14:40:15.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 0x7fc3e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc3f806bb30 con 0x7fc3ec003820 2021-11-15T14:40:15.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.332+0000 7fc408b58700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 0x7fc3e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.336+0000 7fc408b58700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 0x7fc3e4055ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc400001fa0 tx=0x7fc4000077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.336+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3f8042d60 con 0x7fc3ec003820 2021-11-15T14:40:15.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4040573d0 con 0x7fc3ec003820 2021-11-15T14:40:15.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc3f67fc700 1 -- 172.21.2.135:0/4093370740 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fc3f8046380 con 0x7fc3ec003820 2021-11-15T14:40:15.425 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:15.426 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":74,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:15.043663+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:15.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 msgr2=0x7fc3e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 0x7fc3e4055ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc400001fa0 tx=0x7fc4000077f0).stop 2021-11-15T14:40:15.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 msgr2=0x7fc40413fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fc4040acee0 tx=0x7fc3f8013000).stop 2021-11-15T14:40:15.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 shutdown_connections 2021-11-15T14:40:15.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3e4053610 0x7fc3e4055ad0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc40414d160 0x7fc4040af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc4040ac4a0 0x7fc4040af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 --2- 172.21.2.135:0/4093370740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3ec003820 0x7fc40413fcd0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 >> 172.21.2.135:0/4093370740 conn(0x7fc40405f730 msgr2=0x7fc4040b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 shutdown_connections 2021-11-15T14:40:15.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.420+0000 7fc40b5bd700 1 -- 172.21.2.135:0/4093370740 wait complete. 2021-11-15T14:40:15.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:40:15.433 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:40:15.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 Processor -- start 2021-11-15T14:40:15.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 -- start start 2021-11-15T14:40:15.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b80b1ce0 con 0x7f71b80a99e0 2021-11-15T14:40:15.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80a9dc0 con 0x7f71b80b0740 2021-11-15T14:40:15.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.480+0000 7f71beebe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80b29c0 con 0x7f71b80ac2e0 2021-11-15T14:40:15.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71bd45b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:40722/0 (socket says 172.21.2.135:40722) 2021-11-15T14:40:15.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71bcc5a700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f71b80a99e0 0x7f71b80aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:56184/0 (socket says 172.21.2.135:56184) 2021-11-15T14:40:15.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71bd45b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:52996/0 (socket says 172.21.2.135:52996) 2021-11-15T14:40:15.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 -- 172.21.2.135:0/160878731 learned_addr learned my addr 172.21.2.135:0/160878731 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 -- 172.21.2.135:0/160878731 >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 msgr2=0x7f71b80ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 --2- 172.21.2.135:0/160878731 >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 -- 172.21.2.135:0/160878731 >> v1:172.21.2.119:6789/0 conn(0x7f71b80a99e0 legacy=0x7f71b80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 -- 172.21.2.135:0/160878731 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80b0140 con 0x7f71b80ac2e0 2021-11-15T14:40:15.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71bd45b700 1 --2- 172.21.2.135:0/160878731 >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:40:15.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b7fff700 1 --2- 172.21.2.135:0/160878731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f71a8002f70 tx=0x7f71a8006eb0).ready entity=mon.2 client_cookie=ca69af9097671162 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b77fe700 1 -- 172.21.2.135:0/160878731 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a800d570 con 0x7f71b80ac2e0 2021-11-15T14:40:15.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b77fe700 1 -- 172.21.2.135:0/160878731 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8000e90 con 0x7f71b80ac2e0 2021-11-15T14:40:15.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71b77fe700 1 -- 172.21.2.135:0/160878731 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a800d900 con 0x7f71b80ac2e0 2021-11-15T14:40:15.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 -- 172.21.2.135:0/160878731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 msgr2=0x7f71b80b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 --2- 172.21.2.135:0/160878731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f71a8002f70 tx=0x7f71a8006eb0).stop 2021-11-15T14:40:15.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 -- 172.21.2.135:0/160878731 shutdown_connections 2021-11-15T14:40:15.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 --2- 172.21.2.135:0/160878731 >> v2:172.21.2.119:3300/0 conn(0x7f71b80b0740 0x7f71b80ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 --2- 172.21.2.135:0/160878731 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b80b17f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 -- 172.21.2.135:0/160878731 >> 172.21.2.135:0/160878731 conn(0x7f71b805f730 msgr2=0x7f71b805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 -- 172.21.2.135:0/160878731 shutdown_connections 2021-11-15T14:40:15.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.484+0000 7f71beebe700 1 -- 172.21.2.135:0/160878731 wait complete. 2021-11-15T14:40:15.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 Processor -- start 2021-11-15T14:40:15.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- start start 2021-11-15T14:40:15.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b8151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71b80b0740 0x7f71b81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81412c0 con 0x7f71b80b0740 2021-11-15T14:40:15.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8143a90 con 0x7f71b80a99e0 2021-11-15T14:40:15.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8143d30 con 0x7f71b80ac2e0 2021-11-15T14:40:15.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59184/0 (socket says 172.21.2.135:59184) 2021-11-15T14:40:15.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 -- 172.21.2.135:0/4030058197 learned_addr learned my addr 172.21.2.135:0/4030058197 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 -- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 msgr2=0x7f71b8151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b8151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 -- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71b80b0740 msgr2=0x7f71b81524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71b80b0740 0x7f71b81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 -- 172.21.2.135:0/4030058197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b000d910 con 0x7f71b80a99e0 2021-11-15T14:40:15.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71bcc5a700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f71b8144c20 tx=0x7f71a0007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a000ce20 con 0x7f71b80a99e0 2021-11-15T14:40:15.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a00072e0 con 0x7f71b80a99e0 2021-11-15T14:40:15.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a800b1e0 con 0x7f71b80a99e0 2021-11-15T14:40:15.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a0007450 con 0x7f71b80a99e0 2021-11-15T14:40:15.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8063250 con 0x7f71b80a99e0 2021-11-15T14:40:15.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71a001a070 con 0x7f71b80a99e0 2021-11-15T14:40:15.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80573d0 con 0x7f71b80a99e0 2021-11-15T14:40:15.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 0x7f719c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f71a006a6f0 con 0x7f71b80a99e0 2021-11-15T14:40:15.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.488+0000 7f71b7fff700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 0x7f719c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.492+0000 7f71b7fff700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 0x7f719c055ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f71a8002f70 tx=0x7f71a8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.492+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71a00419d0 con 0x7f71b80a99e0 2021-11-15T14:40:15.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.572+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f71b80b1ce0 con 0x7f71b80a99e0 2021-11-15T14:40:15.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.572+0000 7f71b5ffb700 1 -- 172.21.2.135:0/4030058197 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7f71b80b1ce0 con 0x7f71b80a99e0 2021-11-15T14:40:15.579 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:40:15.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 msgr2=0x7f719c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 0x7f719c055ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f71a8002f70 tx=0x7f71a8015000).stop 2021-11-15T14:40:15.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 msgr2=0x7f71b80ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f71b8144c20 tx=0x7f71a0007c40).stop 2021-11-15T14:40:15.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 shutdown_connections 2021-11-15T14:40:15.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f719c053610 0x7f719c055ad0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71b80b0740 0x7f71b81524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71b80ac2e0 0x7f71b8151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 --2- 172.21.2.135:0/4030058197 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71b80a99e0 0x7f71b80ad070 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 >> 172.21.2.135:0/4030058197 conn(0x7f71b805f730 msgr2=0x7f71b8145040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 shutdown_connections 2021-11-15T14:40:15.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.576+0000 7f71beebe700 1 -- 172.21.2.135:0/4030058197 wait complete. 2021-11-15T14:40:15.586 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:40:15.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 Processor -- start 2021-11-15T14:40:15.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- start start 2021-11-15T14:40:15.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa0f80b1f40 0x7fa0f80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0f80b0030 0x7fa0f80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80b04a0 con 0x7fa0f80a7140 2021-11-15T14:40:15.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80b2810 con 0x7fa0f80b1f40 2021-11-15T14:40:15.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80b06d0 con 0x7fa0f80b0030 2021-11-15T14:40:15.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0f80b0030 0x7fa0f80b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0f80b0030 0x7fa0f80b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59196/0 (socket says 172.21.2.135:59196) 2021-11-15T14:40:15.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 -- 172.21.2.135:0/3124374468 learned_addr learned my addr 172.21.2.135:0/3124374468 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 -- 172.21.2.135:0/3124374468 >> v2:172.21.2.119:3300/0 conn(0x7fa0f80b1f40 msgr2=0x7fa0f80b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 --2- 172.21.2.135:0/3124374468 >> v2:172.21.2.119:3300/0 conn(0x7fa0f80b1f40 0x7fa0f80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 -- 172.21.2.135:0/3124374468 >> v1:172.21.2.119:6789/0 conn(0x7fa0f80a7140 legacy=0x7fa0f81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 -- 172.21.2.135:0/3124374468 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80b0970 con 0x7fa0f80b0030 2021-11-15T14:40:15.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f6ffd700 1 --2- 172.21.2.135:0/3124374468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b0030 0x7fa0f80b2320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fa0f80ad350 tx=0x7fa0e0006eb0).ready entity=mon.1 client_cookie=ba531d58640d9165 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f67fc700 1 -- 172.21.2.135:0/3124374468 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e000d5c0 con 0x7fa0f80b0030 2021-11-15T14:40:15.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f67fc700 1 -- 172.21.2.135:0/3124374468 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0000e90 con 0x7fa0f80b0030 2021-11-15T14:40:15.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0f67fc700 1 -- 172.21.2.135:0/3124374468 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0e000d910 con 0x7fa0f80b0030 2021-11-15T14:40:15.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/3124374468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b0030 msgr2=0x7fa0f80b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/3124374468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b0030 0x7fa0f80b2320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fa0f80ad350 tx=0x7fa0e0006eb0).stop 2021-11-15T14:40:15.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/3124374468 shutdown_connections 2021-11-15T14:40:15.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/3124374468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b0030 0x7fa0f80b2320 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/3124374468 >> v2:172.21.2.119:3300/0 conn(0x7fa0f80b1f40 0x7fa0f80b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/3124374468 >> 172.21.2.135:0/3124374468 conn(0x7fa0f805f730 msgr2=0x7fa0f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/3124374468 shutdown_connections 2021-11-15T14:40:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/3124374468 wait complete. 2021-11-15T14:40:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 Processor -- start 2021-11-15T14:40:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.636+0000 7fa0fe1e5700 1 -- start start 2021-11-15T14:40:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0f80a7140 0x7fa0f80ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0f80b0030 0x7fa0f80aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80ac3f0 con 0x7fa0f80b0030 2021-11-15T14:40:15.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8149ea0 con 0x7fa0f80b1f40 2021-11-15T14:40:15.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80aa9e0 con 0x7fa0f80a7140 2021-11-15T14:40:15.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59202/0 (socket says 172.21.2.135:59202) 2021-11-15T14:40:15.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 -- 172.21.2.135:0/562293417 learned_addr learned my addr 172.21.2.135:0/562293417 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 -- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0f80a7140 msgr2=0x7fa0f80ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0f80a7140 0x7fa0f80ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 -- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0f80b0030 msgr2=0x7fa0f80aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0f80b0030 0x7fa0f80aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 -- 172.21.2.135:0/562293417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e000b1e0 con 0x7fa0f80b1f40 2021-11-15T14:40:15.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f7fff700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa0f0003310 tx=0x7fa0f00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f0001500 con 0x7fa0f80b1f40 2021-11-15T14:40:15.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0001660 con 0x7fa0f80b1f40 2021-11-15T14:40:15.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f00019c0 con 0x7fa0f80b1f40 2021-11-15T14:40:15.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f8148d30 con 0x7fa0f80b1f40 2021-11-15T14:40:15.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f814a760 con 0x7fa0f80b1f40 2021-11-15T14:40:15.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f814a920 con 0x7fa0f80b1f40 2021-11-15T14:40:15.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0f0018030 con 0x7fa0f80b1f40 2021-11-15T14:40:15.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 0x7fa0dc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa0f006b200 con 0x7fa0f80b1f40 2021-11-15T14:40:15.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f77fe700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 0x7fa0dc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.640+0000 7fa0f77fe700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 0x7fa0dc055b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fa0e8002f70 tx=0x7fa0e80069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.644+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0f00424e0 con 0x7fa0f80b1f40 2021-11-15T14:40:15.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.724+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0f80b0c10 con 0x7fa0f80b1f40 2021-11-15T14:40:15.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0f4ff9700 1 -- 172.21.2.135:0/562293417 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0f0045b00 con 0x7fa0f80b1f40 2021-11-15T14:40:15.731 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:15.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 msgr2=0x7fa0dc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 0x7fa0dc055b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fa0e8002f70 tx=0x7fa0e80069f0).stop 2021-11-15T14:40:15.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 msgr2=0x7fa0f814ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fa0f0003310 tx=0x7fa0f00091a0).stop 2021-11-15T14:40:15.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 shutdown_connections 2021-11-15T14:40:15.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0dc053660 0x7fa0dc055b20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0f80b1f40 0x7fa0f814ac00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0f80b0030 0x7fa0f80aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 --2- 172.21.2.135:0/562293417 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0f80a7140 0x7fa0f80ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 >> 172.21.2.135:0/562293417 conn(0x7fa0f805f730 msgr2=0x7fa0f80a7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 shutdown_connections 2021-11-15T14:40:15.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.728+0000 7fa0fe1e5700 1 -- 172.21.2.135:0/562293417 wait complete. 2021-11-15T14:40:15.738 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:40:15.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 Processor -- start 2021-11-15T14:40:15.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 -- start start 2021-11-15T14:40:15.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5ac00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5ac00b4cc0 0x7f5ac014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac00aac30 con 0x7f5ac0067380 2021-11-15T14:40:15.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac0060560 con 0x7f5ac00b4cc0 2021-11-15T14:40:15.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac72f5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0066f20 con 0x7f5ac0060180 2021-11-15T14:40:15.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac4890700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5ac0067380 0x7f5ac0143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46798/0 (socket says 172.21.2.135:46798) 2021-11-15T14:40:15.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac4890700 1 -- 172.21.2.135:0/801401464 learned_addr learned my addr 172.21.2.135:0/801401464 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:15.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58486342 0 0) 0x7f5ac00aac30 con 0x7f5ac0067380 2021-11-15T14:40:15.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa8003260 con 0x7f5ac0067380 2021-11-15T14:40:15.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac5091700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5ac00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035803739 0 0) 0x7f5aa8003260 con 0x7f5ac0067380 2021-11-15T14:40:15.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> v2:172.21.2.119:3300/0 conn(0x7f5ac00b4cc0 0x7f5ac014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 msgr2=0x7f5ac00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5ac00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 >> v2:172.21.2.119:3300/0 conn(0x7f5ac00b4cc0 msgr2=0x7f5ac014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 --2- 172.21.2.135:0/801401464 >> v2:172.21.2.119:3300/0 conn(0x7f5ac00b4cc0 0x7f5ac014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00b3430 con 0x7f5ac0067380 2021-11-15T14:40:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5ab0001660 con 0x7f5ac0067380 2021-11-15T14:40:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 >> v1:172.21.2.135:6789/0 conn(0x7f5ac0067380 legacy=0x7f5ac0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5aa80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8003e00 0x7f5aa8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5aa8004b10 0x7f5aa8004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0060560 con 0x7f5aa8003e00 2021-11-15T14:40:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0066f20 con 0x7f5aa8004b10 2021-11-15T14:40:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa800b9e0 con 0x7f5ac0060180 2021-11-15T14:40:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> v2:172.21.2.119:3300/0 conn(0x7f5ac00b4cc0 0x7f5ac014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.784+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5aa8004b10 0x7f5aa8004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac4890700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8003e00 0x7f5aa8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5091700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5aa80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 msgr2=0x7f5aa80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac0060180 0x7f5aa80037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8003e00 msgr2=0x7f5aa8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8003e00 0x7f5aa8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/801401464 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8003260 con 0x7f5aa8004b10 2021-11-15T14:40:15.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac4890700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8003e00 0x7f5aa8004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:15.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5aa8004b10 0x7f5aa8004f90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f5ab8007000 tx=0x7f5ab8008040).ready entity=mon.1 client_cookie=9c721d0a9ddb7233 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab800c610 con 0x7f5aa8004b10 2021-11-15T14:40:15.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800c770 con 0x7f5aa8004b10 2021-11-15T14:40:15.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aaffff700 1 -- 172.21.2.135:0/801401464 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab800cad0 con 0x7f5aa8004b10 2021-11-15T14:40:15.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/801401464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5aa8004b10 msgr2=0x7f5aa8004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/801401464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5aa8004b10 0x7f5aa8004f90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f5ab8007000 tx=0x7f5ab8008040).stop 2021-11-15T14:40:15.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/801401464 reap_dead start 2021-11-15T14:40:15.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/801401464 shutdown_connections 2021-11-15T14:40:15.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/801401464 >> 172.21.2.135:0/801401464 conn(0x7f5ac005cfb0 msgr2=0x7f5ac005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/801401464 shutdown_connections 2021-11-15T14:40:15.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/801401464 wait complete. 2021-11-15T14:40:15.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 Processor -- start 2021-11-15T14:40:15.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- start start 2021-11-15T14:40:15.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8004b10 0x7f5ac009f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac00a0530 0x7f5ac00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac01416b0 con 0x7f5aa8004b10 2021-11-15T14:40:15.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00a3560 con 0x7f5ac00a09b0 2021-11-15T14:40:15.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00a0020 con 0x7f5ac00a0530 2021-11-15T14:40:15.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59222/0 (socket says 172.21.2.135:59222) 2021-11-15T14:40:15.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/2413887741 learned_addr learned my addr 172.21.2.135:0/2413887741 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5091700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8004b10 0x7f5ac009f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac4890700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac00a0530 0x7f5ac00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac00a0530 msgr2=0x7f5ac00a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac00a0530 0x7f5ac00a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8004b10 msgr2=0x7f5ac009f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8004b10 0x7f5ac009f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 -- 172.21.2.135:0/2413887741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0151430 con 0x7f5ac00a09b0 2021-11-15T14:40:15.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac5892700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f5ac01417f0 tx=0x7f5ab8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab800a560 con 0x7f5ac00a09b0 2021-11-15T14:40:15.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8011620 con 0x7f5ac00a09b0 2021-11-15T14:40:15.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab8011790 con 0x7f5ac00a09b0 2021-11-15T14:40:15.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac00b5360 con 0x7f5ac00a09b0 2021-11-15T14:40:15.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.788+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0151190 con 0x7f5ac00a09b0 2021-11-15T14:40:15.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac00b1300 con 0x7f5ac00a09b0 2021-11-15T14:40:15.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ab80118f0 con 0x7f5ac00a09b0 2021-11-15T14:40:15.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5aae7fc700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 0x7f5aa0055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f5ab806ca00 con 0x7f5ac00a09b0 2021-11-15T14:40:15.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5ac5091700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 0x7f5aa0055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5ac5091700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 0x7f5aa0055ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5abc009000 tx=0x7f5abc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.792+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ac00b1300 con 0x7f5ac00a09b0 2021-11-15T14:40:15.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5ac00b1300 con 0x7f5ac00a09b0 2021-11-15T14:40:15.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5aae7fc700 1 -- 172.21.2.135:0/2413887741 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5ac00b1300 con 0x7f5ac00a09b0 2021-11-15T14:40:15.884 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:15.884 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:40:15.884 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.884 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:40:15.885 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:40:15.885 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:40:15.885 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:40:15.885 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:40:15.886 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:40:15.886 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:40:15.886 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:40:15.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 msgr2=0x7f5aa0055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 0x7f5aa0055ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5abc009000 tx=0x7f5abc008040).stop 2021-11-15T14:40:15.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 msgr2=0x7f5ac00a3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f5ac01417f0 tx=0x7f5ab8008040).stop 2021-11-15T14:40:15.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 shutdown_connections 2021-11-15T14:40:15.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5aa0053600 0x7f5aa0055ac0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ac00a09b0 0x7f5ac00a3070 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ac00a0530 0x7f5ac00a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 --2- 172.21.2.135:0/2413887741 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5aa8004b10 0x7f5ac009f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 >> 172.21.2.135:0/2413887741 conn(0x7f5ac005cfb0 msgr2=0x7f5ac00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 shutdown_connections 2021-11-15T14:40:15.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.880+0000 7f5ac72f5700 1 -- 172.21.2.135:0/2413887741 wait complete. 2021-11-15T14:40:15.891 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:40:15.892 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:40:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 Processor -- start 2021-11-15T14:40:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 -- start start 2021-11-15T14:40:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcb980b3790 0x7fcb980b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb981439a0 con 0x7fcb980b0630 2021-11-15T14:40:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98143c40 con 0x7fcb980a9c90 2021-11-15T14:40:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98143ee0 con 0x7fcb980b3790 2021-11-15T14:40:15.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9759e700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcb980a9c90 0x7fcb980b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46818/0 (socket says 172.21.2.135:46818) 2021-11-15T14:40:15.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9759e700 1 -- 172.21.2.135:0/1629258181 learned_addr learned my addr 172.21.2.135:0/1629258181 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:15.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9659c700 1 --2- 172.21.2.135:0/1629258181 >> v2:172.21.2.135:3300/0 conn(0x7fcb980b3790 0x7fcb980b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9659c700 1 -- 172.21.2.135:0/1629258181 >> v1:172.21.2.135:6789/0 conn(0x7fcb980a9c90 legacy=0x7fcb980b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9659c700 1 -- 172.21.2.135:0/1629258181 >> v1:172.21.2.119:6789/0 conn(0x7fcb980b0630 legacy=0x7fcb9813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9659c700 1 -- 172.21.2.135:0/1629258181 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98144180 con 0x7fcb980b3790 2021-11-15T14:40:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9659c700 1 --2- 172.21.2.135:0/1629258181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980b3790 0x7fcb980b0a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fcb9806aad0 tx=0x7fcb80006df0).ready entity=mon.1 client_cookie=619b2a4e1d81d0e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb95d9b700 1 -- 172.21.2.135:0/1629258181 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb8000d5c0 con 0x7fcb980b3790 2021-11-15T14:40:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb95d9b700 1 -- 172.21.2.135:0/1629258181 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80000e90 con 0x7fcb980b3790 2021-11-15T14:40:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb95d9b700 1 -- 172.21.2.135:0/1629258181 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb8000d910 con 0x7fcb980b3790 2021-11-15T14:40:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 -- 172.21.2.135:0/1629258181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980b3790 msgr2=0x7fcb980b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.940+0000 7fcb9d115700 1 --2- 172.21.2.135:0/1629258181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980b3790 0x7fcb980b0a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fcb9806aad0 tx=0x7fcb80006df0).stop 2021-11-15T14:40:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/1629258181 shutdown_connections 2021-11-15T14:40:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 --2- 172.21.2.135:0/1629258181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980b3790 0x7fcb980b0a10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/1629258181 >> 172.21.2.135:0/1629258181 conn(0x7fcb98060840 msgr2=0x7fcb98060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/1629258181 shutdown_connections 2021-11-15T14:40:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/1629258181 wait complete. 2021-11-15T14:40:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 Processor -- start 2021-11-15T14:40:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- start start 2021-11-15T14:40:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb980b0630 0x7fcb98063b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb980b3790 0x7fcb98064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98065a50 con 0x7fcb980b3790 2021-11-15T14:40:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98140d90 con 0x7fcb980a9c90 2021-11-15T14:40:15.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98140af0 con 0x7fcb980b0630 2021-11-15T14:40:15.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59232/0 (socket says 172.21.2.135:59232) 2021-11-15T14:40:15.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 -- 172.21.2.135:0/3133863544 learned_addr learned my addr 172.21.2.135:0/3133863544 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:15.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 -- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb980b0630 msgr2=0x7fcb98063b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb980b0630 0x7fcb98063b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 -- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb980b3790 msgr2=0x7fcb98064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:15.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb980b3790 0x7fcb98064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:15.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 -- 172.21.2.135:0/3133863544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8000b180 con 0x7fcb980a9c90 2021-11-15T14:40:15.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb96d9d700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fcb9813f7e0 tx=0x7fcb88006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb88013460 con 0x7fcb980a9c90 2021-11-15T14:40:15.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880135c0 con 0x7fcb980a9c90 2021-11-15T14:40:15.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9813ffe0 con 0x7fcb980a9c90 2021-11-15T14:40:15.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb88013920 con 0x7fcb980a9c90 2021-11-15T14:40:15.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb98140520 con 0x7fcb980a9c90 2021-11-15T14:40:15.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9813dce0 con 0x7fcb980a9c90 2021-11-15T14:40:15.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb8800f070 con 0x7fcb980a9c90 2021-11-15T14:40:15.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 0x7fcb7c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:15.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.944+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fcb8806af00 con 0x7fcb980a9c90 2021-11-15T14:40:15.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.948+0000 7fcb9659c700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 0x7fcb7c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:15.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.948+0000 7fcb9659c700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 0x7fcb7c055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fcb9806aad0 tx=0x7fcb80012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:15.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:15.948+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb88042240 con 0x7fcb980a9c90 2021-11-15T14:40:16.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.036+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fcb980573d0 con 0x7fcb980a9c90 2021-11-15T14:40:16.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb8ffff700 1 -- 172.21.2.135:0/3133863544 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v75) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcb88045860 con 0x7fcb980a9c90 2021-11-15T14:40:16.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 msgr2=0x7fcb7c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:16.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 0x7fcb7c055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fcb9806aad0 tx=0x7fcb80012000).stop 2021-11-15T14:40:16.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 msgr2=0x7fcb980b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:16.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fcb9813f7e0 tx=0x7fcb88006df0).stop 2021-11-15T14:40:16.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 shutdown_connections 2021-11-15T14:40:16.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb7c053610 0x7fcb7c055ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:16.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb980b3790 0x7fcb98064040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb980b0630 0x7fcb98063b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 --2- 172.21.2.135:0/3133863544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb980a9c90 0x7fcb980b5fa0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:16.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 >> 172.21.2.135:0/3133863544 conn(0x7fcb98060840 msgr2=0x7fcb9813d590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:16.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 shutdown_connections 2021-11-15T14:40:16.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.900+0000 7fcb9d115700 1 -- 172.21.2.135:0/3133863544 wait complete. 2021-11-15T14:40:16.910 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:40:16.912 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:40:16.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 Processor -- start 2021-11-15T14:40:16.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- start start 2021-11-15T14:40:16.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b1f40 0x7fb2dc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb2dc0b0030 0x7fb2dc0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0b2810 con 0x7fb2dc0a7140 2021-11-15T14:40:16.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc0b0470 con 0x7fb2dc0b0030 2021-11-15T14:40:16.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0b06d0 con 0x7fb2dc0b1f40 2021-11-15T14:40:16.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb2dc0b0030 0x7fb2dc0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:16.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb2dc0b0030 0x7fb2dc0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59244/0 (socket says 172.21.2.135:59244) 2021-11-15T14:40:16.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 -- 172.21.2.135:0/3281737864 learned_addr learned my addr 172.21.2.135:0/3281737864 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:16.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 -- 172.21.2.135:0/3281737864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b1f40 msgr2=0x7fb2dc0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:16.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 --2- 172.21.2.135:0/3281737864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b1f40 0x7fb2dc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 -- 172.21.2.135:0/3281737864 >> v1:172.21.2.135:6789/0 conn(0x7fb2dc0a7140 legacy=0x7fb2dc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:16.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 -- 172.21.2.135:0/3281737864 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0b0970 con 0x7fb2dc0b0030 2021-11-15T14:40:16.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2da7fc700 1 --2- 172.21.2.135:0/3281737864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0b0030 0x7fb2dc0b2320 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb2d4001490 tx=0x7fb2c4006eb0).ready entity=mon.1 client_cookie=da93166d7301f4d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:16.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2d9ffb700 1 -- 172.21.2.135:0/3281737864 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c400d570 con 0x7fb2dc0b0030 2021-11-15T14:40:16.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2d9ffb700 1 -- 172.21.2.135:0/3281737864 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4000e90 con 0x7fb2dc0b0030 2021-11-15T14:40:16.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2d9ffb700 1 -- 172.21.2.135:0/3281737864 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c400d900 con 0x7fb2dc0b0030 2021-11-15T14:40:16.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3281737864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0b0030 msgr2=0x7fb2dc0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:16.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3281737864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0b0030 0x7fb2dc0b2320 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fb2d4001490 tx=0x7fb2c4006eb0).stop 2021-11-15T14:40:16.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3281737864 shutdown_connections 2021-11-15T14:40:16.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3281737864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0b0030 0x7fb2dc0b2320 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:16.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3281737864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b1f40 0x7fb2dc0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3281737864 >> 172.21.2.135:0/3281737864 conn(0x7fb2dc05f730 msgr2=0x7fb2dc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:16.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3281737864 shutdown_connections 2021-11-15T14:40:16.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3281737864 wait complete. 2021-11-15T14:40:16.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 Processor -- start 2021-11-15T14:40:16.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- start start 2021-11-15T14:40:16.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b0030 0x7fb2dc1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2dc0b1f40 0x7fb2dc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0a9da0 con 0x7fb2dc0b1f40 2021-11-15T14:40:16.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc157750 con 0x7fb2dc0a7140 2021-11-15T14:40:16.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2e19a6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0aa610 con 0x7fb2dc0b0030 2021-11-15T14:40:16.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:16.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59248/0 (socket says 172.21.2.135:59248) 2021-11-15T14:40:16.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 -- 172.21.2.135:0/3384755271 learned_addr learned my addr 172.21.2.135:0/3384755271 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:16.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 -- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b0030 msgr2=0x7fb2dc1543b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:16.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b0030 0x7fb2dc1543b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 -- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2dc0b1f40 msgr2=0x7fb2dc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:16.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2dc0b1f40 0x7fb2dc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:16.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 -- 172.21.2.135:0/3384755271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c400b1e0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.964+0000 7fb2daffd700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb2cc002f70 tx=0x7fb2cc006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:16.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc013460 con 0x7fb2dc0a7140 2021-11-15T14:40:16.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0135c0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc0a9fd0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc157bb0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc013920 con 0x7fb2dc0a7140 2021-11-15T14:40:16.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc1578c0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2cc01a060 con 0x7fb2dc0a7140 2021-11-15T14:40:16.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 0x7fb2c0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:16.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fb2cc06b3a0 con 0x7fb2dc0a7140 2021-11-15T14:40:16.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2da7fc700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 0x7fb2c0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:16.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2da7fc700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 0x7fb2c0055b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fb2d4001490 tx=0x7fb2c4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:16.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:16.968+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2cc042410 con 0x7fb2dc0a7140 2021-11-15T14:40:17.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.056+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb2dc0b0c10 con 0x7fb2dc0a7140 2021-11-15T14:40:17.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2d3fff700 1 -- 172.21.2.135:0/3384755271 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v76) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb2cc0180a0 con 0x7fb2dc0a7140 2021-11-15T14:40:17.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 msgr2=0x7fb2c0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:17.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 0x7fb2c0055b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fb2d4001490 tx=0x7fb2c4015000).stop 2021-11-15T14:40:17.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 msgr2=0x7fb2dc153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:17.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb2cc002f70 tx=0x7fb2cc006e20).stop 2021-11-15T14:40:17.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 shutdown_connections 2021-11-15T14:40:17.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2c0053690 0x7fb2c0055b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:17.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb2dc0b1f40 0x7fb2dc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:17.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb2dc0b0030 0x7fb2dc1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:17.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 --2- 172.21.2.135:0/3384755271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb2dc0a7140 0x7fb2dc153ec0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:17.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 >> 172.21.2.135:0/3384755271 conn(0x7fb2dc05f730 msgr2=0x7fb2dc13cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:17.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 shutdown_connections 2021-11-15T14:40:17.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.916+0000 7fb2e19a6700 1 -- 172.21.2.135:0/3384755271 wait complete. 2021-11-15T14:40:17.925 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:40:17.929 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:40:17.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 Processor -- start 2021-11-15T14:40:17.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- start start 2021-11-15T14:40:17.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 0x7f21fc14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:17.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc0b2b70 con 0x7f21fc0aa1a0 2021-11-15T14:40:17.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc0b27f0 con 0x7f21fc0b0520 2021-11-15T14:40:17.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0b2da0 con 0x7f21fc0b0900 2021-11-15T14:40:17.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2201920700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f21fc0b0520 0x7f21fc0addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46842/0 (socket says 172.21.2.135:46842) 2021-11-15T14:40:17.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2201920700 1 -- 172.21.2.135:0/472645869 learned_addr learned my addr 172.21.2.135:0/472645869 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:17.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796067656 0 0) 0x7f21fc0b27f0 con 0x7f21fc0b0520 2021-11-15T14:40:17.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e4003260 con 0x7f21fc0b0520 2021-11-15T14:40:17.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2202121700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 0x7f21fc14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:17.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3347371387 0 0) 0x7f21e4003260 con 0x7f21fc0b0520 2021-11-15T14:40:17.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 msgr2=0x7f21fc14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:17.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 0x7f21fc14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:17.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 >> v1:172.21.2.119:6789/0 conn(0x7f21fc0aa1a0 legacy=0x7f21fc0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:17.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0a9bf0 con 0x7f21fc0b0520 2021-11-15T14:40:17.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f21f8001660 con 0x7f21fc0b0520 2021-11-15T14:40:17.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 >> v1:172.21.2.135:6789/0 conn(0x7f21fc0b0520 legacy=0x7f21fc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:17.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21e4003800 0x7f21e4003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:17.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21e4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:17.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 0x7f21e4004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:17.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0b2da0 con 0x7f21e4003800 2021-11-15T14:40:17.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e400db20 con 0x7f21e4004500 2021-11-15T14:40:17.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e400dce0 con 0x7f21fc0b0900 2021-11-15T14:40:17.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21e4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:17.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 -- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 msgr2=0x7f21e4004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:17.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc0b0900 0x7f21e4004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:17.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 -- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21e4003800 msgr2=0x7f21e4003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:17.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21e4003800 0x7f21e4003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:17.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 -- 172.21.2.135:0/472645869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4003260 con 0x7f21e4004500 2021-11-15T14:40:17.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220111f700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21e4004980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f21ec000f70 tx=0x7f21ec0079e0).ready entity=mon.1 client_cookie=470fe444ac6858ca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:17.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ec007cf0 con 0x7f21e4004500 2021-11-15T14:40:17.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec014410 con 0x7f21e4004500 2021-11-15T14:40:17.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f220091e700 1 -- 172.21.2.135:0/472645869 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ec014770 con 0x7f21e4004500 2021-11-15T14:40:17.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- 172.21.2.135:0/472645869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 msgr2=0x7f21e4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:17.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 --2- 172.21.2.135:0/472645869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21e4004980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f21ec000f70 tx=0x7f21ec0079e0).stop 2021-11-15T14:40:17.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2202121700 1 -- 172.21.2.135:0/472645869 reap_dead start 2021-11-15T14:40:17.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- 172.21.2.135:0/472645869 shutdown_connections 2021-11-15T14:40:17.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- 172.21.2.135:0/472645869 >> 172.21.2.135:0/472645869 conn(0x7f21fc060840 msgr2=0x7f21fc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:17.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- 172.21.2.135:0/472645869 shutdown_connections 2021-11-15T14:40:17.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.980+0000 7f2203b84700 1 -- 172.21.2.135:0/472645869 wait complete. 2021-11-15T14:40:17.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 Processor -- start 2021-11-15T14:40:18.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- start start 2021-11-15T14:40:18.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21fc0ac6d0 0x7f21fc064070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc063950 0x7f21fc0aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc1418e0 con 0x7f21fc0ac6d0 2021-11-15T14:40:18.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc141640 con 0x7f21e4004500 2021-11-15T14:40:18.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0673d0 con 0x7f21fc063950 2021-11-15T14:40:18.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59268/0 (socket says 172.21.2.135:59268) 2021-11-15T14:40:18.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 -- 172.21.2.135:0/3981096805 learned_addr learned my addr 172.21.2.135:0/3981096805 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:18.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 -- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc063950 msgr2=0x7f21fc0aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc063950 0x7f21fc0aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 -- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21fc0ac6d0 msgr2=0x7f21fc064070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21fc0ac6d0 0x7f21fc064070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 -- 172.21.2.135:0/3981096805 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0abb80 con 0x7f21e4004500 2021-11-15T14:40:18.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2201920700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f21fc0b77f0 tx=0x7f21fc0b2980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21f8007170 con 0x7f21e4004500 2021-11-15T14:40:18.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f80072d0 con 0x7f21e4004500 2021-11-15T14:40:18.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc152600 con 0x7f21e4004500 2021-11-15T14:40:18.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21f8004920 con 0x7f21e4004500 2021-11-15T14:40:18.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc064700 con 0x7f21e4004500 2021-11-15T14:40:18.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc0573d0 con 0x7f21e4004500 2021-11-15T14:40:18.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f21f8004a80 con 0x7f21e4004500 2021-11-15T14:40:18.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 0x7f21dc055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f21f806b640 con 0x7f21e4004500 2021-11-15T14:40:18.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.984+0000 7f220111f700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 0x7f21dc055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.988+0000 7f220111f700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 0x7f21dc055b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f21ec000f70 tx=0x7f21ec015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:17.988+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21f8042660 con 0x7f21e4004500 2021-11-15T14:40:18.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.104+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f21fc0446d0 con 0x7f21e4004500 2021-11-15T14:40:18.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f21eaffd700 1 -- 172.21.2.135:0/3981096805 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v37) v1 ==== 189+0+0 (secure 0 0 0) 0x7f21f8045c80 con 0x7f21e4004500 2021-11-15T14:40:18.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 msgr2=0x7f21dc055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 0x7f21dc055b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f21ec000f70 tx=0x7f21ec015000).stop 2021-11-15T14:40:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 msgr2=0x7f21fc0b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f21fc0b77f0 tx=0x7f21fc0b2980).stop 2021-11-15T14:40:18.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 shutdown_connections 2021-11-15T14:40:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f21dc053690 0x7f21dc055b50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21fc063950 0x7f21fc0aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21fc0ac6d0 0x7f21fc064070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 --2- 172.21.2.135:0/3981096805 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21e4004500 0x7f21fc0b16f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 >> 172.21.2.135:0/3981096805 conn(0x7f21fc060840 msgr2=0x7f21fc060020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 shutdown_connections 2021-11-15T14:40:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.116+0000 7f2203b84700 1 -- 172.21.2.135:0/3981096805 wait complete. 2021-11-15T14:40:18.125 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 13 and data pool 14 2021-11-15T14:40:18.128 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:18.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 Processor -- start 2021-11-15T14:40:18.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- start start 2021-11-15T14:40:18.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7dec0b1e30 0x7f7dec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec148420 0x7f7dec0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dec0a7140 0x7f7dec1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0a9140 con 0x7f7dec0b1e30 2021-11-15T14:40:18.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0b03d0 con 0x7f7dec0a7140 2021-11-15T14:40:18.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0b0670 con 0x7f7dec148420 2021-11-15T14:40:18.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dec0a7140 0x7f7dec1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dec0a7140 0x7f7dec1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59286/0 (socket says 172.21.2.135:59286) 2021-11-15T14:40:18.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 -- 172.21.2.135:0/3635017459 learned_addr learned my addr 172.21.2.135:0/3635017459 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:18.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 -- 172.21.2.135:0/3635017459 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec148420 msgr2=0x7f7dec0b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:18.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- 172.21.2.135:0/3635017459 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec148420 0x7f7dec0b2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 -- 172.21.2.135:0/3635017459 >> v2:172.21.2.119:3300/0 conn(0x7f7dec0b1e30 msgr2=0x7f7dec0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- 172.21.2.135:0/3635017459 >> v2:172.21.2.119:3300/0 conn(0x7f7dec0b1e30 0x7f7dec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 -- 172.21.2.135:0/3635017459 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0b0910 con 0x7f7dec0a7140 2021-11-15T14:40:18.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- 172.21.2.135:0/3635017459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec0a7140 0x7f7dec1447a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f7de40032f0 tx=0x7f7de4009290).ready entity=mon.1 client_cookie=5599d91f78954002 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7ddbfff700 1 -- 172.21.2.135:0/3635017459 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de400b870 con 0x7f7dec0a7140 2021-11-15T14:40:18.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7ddbfff700 1 -- 172.21.2.135:0/3635017459 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de400b9d0 con 0x7f7dec0a7140 2021-11-15T14:40:18.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7ddbfff700 1 -- 172.21.2.135:0/3635017459 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de400bb80 con 0x7f7dec0a7140 2021-11-15T14:40:18.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- 172.21.2.135:0/3635017459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec0a7140 msgr2=0x7f7dec1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- 172.21.2.135:0/3635017459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec0a7140 0x7f7dec1447a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f7de40032f0 tx=0x7f7de4009290).stop 2021-11-15T14:40:18.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- 172.21.2.135:0/3635017459 shutdown_connections 2021-11-15T14:40:18.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- 172.21.2.135:0/3635017459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec0a7140 0x7f7dec1447a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- 172.21.2.135:0/3635017459 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec148420 0x7f7dec0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- 172.21.2.135:0/3635017459 >> v2:172.21.2.119:3300/0 conn(0x7f7dec0b1e30 0x7f7dec0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- 172.21.2.135:0/3635017459 >> 172.21.2.135:0/3635017459 conn(0x7f7dec05f730 msgr2=0x7f7dec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- 172.21.2.135:0/3635017459 shutdown_connections 2021-11-15T14:40:18.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- 172.21.2.135:0/3635017459 wait complete. 2021-11-15T14:40:18.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 Processor -- start 2021-11-15T14:40:18.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- start start 2021-11-15T14:40:18.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dec0a7140 0x7f7dec0a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec0b1e30 0x7f7dec149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15ae70 con 0x7f7dec0a7140 2021-11-15T14:40:18.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0adf50 con 0x7f7dec148420 2021-11-15T14:40:18.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df39b9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0ae1f0 con 0x7f7dec0b1e30 2021-11-15T14:40:18.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.176+0000 7f7df1f56700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59292/0 (socket says 172.21.2.135:59292) 2021-11-15T14:40:18.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 -- 172.21.2.135:0/483188381 learned_addr learned my addr 172.21.2.135:0/483188381 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:18.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 -- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec0b1e30 msgr2=0x7f7dec149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec0b1e30 0x7f7dec149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 -- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dec0a7140 msgr2=0x7f7dec0a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dec0a7140 0x7f7dec0a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 -- 172.21.2.135:0/483188381 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009530 con 0x7f7dec148420 2021-11-15T14:40:18.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1f56700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f7de40032f0 tx=0x7f7de4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de400b870 con 0x7f7dec148420 2021-11-15T14:40:18.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4020620 con 0x7f7dec148420 2021-11-15T14:40:18.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec0ae490 con 0x7f7dec148420 2021-11-15T14:40:18.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec14a7a0 con 0x7f7dec148420 2021-11-15T14:40:18.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de4020980 con 0x7f7dec148420 2021-11-15T14:40:18.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec0ae620 con 0x7f7dec148420 2021-11-15T14:40:18.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7de4026020 con 0x7f7dec148420 2021-11-15T14:40:18.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 0x7f7dcc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7de406ca30 con 0x7f7dec148420 2021-11-15T14:40:18.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1755700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 0x7f7dcc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7df1755700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 0x7f7dcc055be0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.180+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7de4043930 con 0x7f7dec148420 2021-11-15T14:40:18.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dec0b0bb0 con 0x7f7dec148420 2021-11-15T14:40:18.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7dda7fc700 1 -- 172.21.2.135:0/483188381 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f7de4015020 con 0x7f7dec148420 2021-11-15T14:40:18.272 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:18.272 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":78,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:18.107859+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:18.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 msgr2=0x7f7dcc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 0x7f7dcc055be0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7de8002f70 tx=0x7f7de8006a80).stop 2021-11-15T14:40:18.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 msgr2=0x7f7dec14a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f7de40032f0 tx=0x7f7de4016000).stop 2021-11-15T14:40:18.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 shutdown_connections 2021-11-15T14:40:18.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7dcc053720 0x7f7dcc055be0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dec148420 0x7f7dec14a2b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dec0b1e30 0x7f7dec149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 --2- 172.21.2.135:0/483188381 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dec0a7140 0x7f7dec0a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 >> 172.21.2.135:0/483188381 conn(0x7f7dec05f730 msgr2=0x7f7dec0a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 shutdown_connections 2021-11-15T14:40:18.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.268+0000 7f7df39b9700 1 -- 172.21.2.135:0/483188381 wait complete. 2021-11-15T14:40:18.279 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:18.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 Processor -- start 2021-11-15T14:40:18.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 -- start start 2021-11-15T14:40:18.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc5ac060990 0x7fc5ac0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc5ac0aa650 0x7fc5ac13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0b6d60 con 0x7fc5ac0b6980 2021-11-15T14:40:18.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac061260 con 0x7fc5ac060990 2021-11-15T14:40:18.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5b1605700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac061500 con 0x7fc5ac0aa650 2021-11-15T14:40:18.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5aaffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc5ac0b6980 0x7fc5ac0a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46884/0 (socket says 172.21.2.135:46884) 2021-11-15T14:40:18.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5aaffd700 1 -- 172.21.2.135:0/2120359659 learned_addr learned my addr 172.21.2.135:0/2120359659 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:18.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.324+0000 7fc5ab7fe700 1 --2- 172.21.2.135:0/2120359659 >> v2:172.21.2.135:3300/0 conn(0x7fc5ac0aa650 0x7fc5ac13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a9ffb700 1 -- 172.21.2.135:0/2120359659 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807526515 0 0) 0x7fc5ac0b6d60 con 0x7fc5ac0b6980 2021-11-15T14:40:18.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a9ffb700 1 -- 172.21.2.135:0/2120359659 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58c003260 con 0x7fc5ac0b6980 2021-11-15T14:40:18.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5ab7fe700 1 -- 172.21.2.135:0/2120359659 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac060990 msgr2=0x7fc5ac0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5ab7fe700 1 --2- 172.21.2.135:0/2120359659 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac060990 0x7fc5ac0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5ab7fe700 1 -- 172.21.2.135:0/2120359659 >> v1:172.21.2.135:6789/0 conn(0x7fc5ac0b6980 legacy=0x7fc5ac0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5ab7fe700 1 -- 172.21.2.135:0/2120359659 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0617a0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5ab7fe700 1 --2- 172.21.2.135:0/2120359659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13c4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fc5a40032f0 tx=0x7fc5a40091d0).ready entity=mon.1 client_cookie=8ec76c515216ec0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a9ffb700 1 -- 172.21.2.135:0/2120359659 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a400c980 con 0x7fc5ac0aa650 2021-11-15T14:40:18.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a9ffb700 1 -- 172.21.2.135:0/2120359659 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400cae0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a9ffb700 1 -- 172.21.2.135:0/2120359659 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a400ce40 con 0x7fc5ac0aa650 2021-11-15T14:40:18.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/2120359659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 msgr2=0x7fc5ac13c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- 172.21.2.135:0/2120359659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13c4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fc5a40032f0 tx=0x7fc5a40091d0).stop 2021-11-15T14:40:18.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/2120359659 shutdown_connections 2021-11-15T14:40:18.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- 172.21.2.135:0/2120359659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13c4f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- 172.21.2.135:0/2120359659 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac060990 0x7fc5ac0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/2120359659 >> 172.21.2.135:0/2120359659 conn(0x7fc5ac0b3500 msgr2=0x7fc5ac0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/2120359659 shutdown_connections 2021-11-15T14:40:18.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/2120359659 wait complete. 2021-11-15T14:40:18.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 Processor -- start 2021-11-15T14:40:18.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- start start 2021-11-15T14:40:18.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac060990 0x7fc5ac13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0b6980 0x7fc5ac13b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac13d6e0 con 0x7fc5ac060990 2021-11-15T14:40:18.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac139270 con 0x7fc5ac0aa650 2021-11-15T14:40:18.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac139510 con 0x7fc5ac0b6980 2021-11-15T14:40:18.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59306/0 (socket says 172.21.2.135:59306) 2021-11-15T14:40:18.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1711190436 learned_addr learned my addr 172.21.2.135:0/1711190436 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:18.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0b6980 msgr2=0x7fc5ac13b610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:18.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0b6980 0x7fc5ac13b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac060990 msgr2=0x7fc5ac13df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac060990 0x7fc5ac13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1711190436 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009470 con 0x7fc5ac0aa650 2021-11-15T14:40:18.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5aa7fc700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fc59c002f70 tx=0x7fc59c006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc59c013460 con 0x7fc5ac0aa650 2021-11-15T14:40:18.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c0135c0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac15a990 con 0x7fc5ac0aa650 2021-11-15T14:40:18.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac0affc0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc59c013920 con 0x7fc5ac0aa650 2021-11-15T14:40:18.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.328+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac061a40 con 0x7fc5ac0aa650 2021-11-15T14:40:18.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc59c01a060 con 0x7fc5ac0aa650 2021-11-15T14:40:18.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5a3fff700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 0x7fc590055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc59c06b5b0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 0x7fc590055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 0x7fc590055bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fc594001110 tx=0x7fc5940076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.332+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc59c0424b0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.416+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5ac0573d0 con 0x7fc5ac0aa650 2021-11-15T14:40:18.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.416+0000 7fc5a3fff700 1 -- 172.21.2.135:0/1711190436 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fc59c018020 con 0x7fc5ac0aa650 2021-11-15T14:40:18.422 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:18.422 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":78,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:18.107859+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:18.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 msgr2=0x7fc590055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 0x7fc590055bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fc594001110 tx=0x7fc5940076c0).stop 2021-11-15T14:40:18.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 msgr2=0x7fc5ac13ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fc59c002f70 tx=0x7fc59c006e20).stop 2021-11-15T14:40:18.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 shutdown_connections 2021-11-15T14:40:18.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900536f0 0x7fc590055bb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0b6980 0x7fc5ac13b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0aa650 0x7fc5ac13ea70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:18.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 --2- 172.21.2.135:0/1711190436 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac060990 0x7fc5ac13df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 >> 172.21.2.135:0/1711190436 conn(0x7fc5ac0b3500 msgr2=0x7fc5ac13c460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 shutdown_connections 2021-11-15T14:40:18.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.420+0000 7fc5b1605700 1 -- 172.21.2.135:0/1711190436 wait complete. 2021-11-15T14:40:18.429 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:40:18.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 Processor -- start 2021-11-15T14:40:18.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 -- start start 2021-11-15T14:40:18.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 0x7f62680b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f62680b0030 0x7f62680b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680b2810 con 0x7f62680a7140 2021-11-15T14:40:18.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680b0470 con 0x7f62680b0030 2021-11-15T14:40:18.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f6270115700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680b06d0 con 0x7f62680b1f40 2021-11-15T14:40:18.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f626e6b2700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f62680a7140 0x7f62681412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:46902/0 (socket says 172.21.2.135:46902) 2021-11-15T14:40:18.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f626e6b2700 1 -- 172.21.2.135:0/503845949 learned_addr learned my addr 172.21.2.135:0/503845949 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:18.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105272361 0 0) 0x7f62680b2810 con 0x7f62680a7140 2021-11-15T14:40:18.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.476+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003260 con 0x7f62680a7140 2021-11-15T14:40:18.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071553477 0 0) 0x7f6250003260 con 0x7f62680a7140 2021-11-15T14:40:18.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 msgr2=0x7f62680b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 0x7f62680b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 >> v2:172.21.2.119:3300/0 conn(0x7f62680b0030 msgr2=0x7f62680b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 --2- 172.21.2.135:0/503845949 >> v2:172.21.2.119:3300/0 conn(0x7f62680b0030 0x7f62680b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680b0970 con 0x7f62680a7140 2021-11-15T14:40:18.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f62600019e0 con 0x7f62680a7140 2021-11-15T14:40:18.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 >> v1:172.21.2.135:6789/0 conn(0x7f62680a7140 legacy=0x7f62681412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250003750 0x7f6250003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6250004500 0x7f6250004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 0x7f6250004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680b0470 con 0x7f6250003750 2021-11-15T14:40:18.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680b06d0 con 0x7f6250004500 2021-11-15T14:40:18.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625000b930 con 0x7f62680b1f40 2021-11-15T14:40:18.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6250004500 0x7f6250004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 -- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 msgr2=0x7f6250004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62680b1f40 0x7f6250004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 -- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250003750 msgr2=0x7f6250003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:18.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250003750 0x7f6250003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 -- 172.21.2.135:0/503845949 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680b0970 con 0x7f6250004500 2021-11-15T14:40:18.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626d6b0700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6250004500 0x7f6250004980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264006ca0).ready entity=mon.1 client_cookie=4c9e30d318b76b2e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6264012410 con 0x7f6250004500 2021-11-15T14:40:18.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264012570 con 0x7f6250004500 2021-11-15T14:40:18.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626ceaf700 1 -- 172.21.2.135:0/503845949 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62640128d0 con 0x7f6250004500 2021-11-15T14:40:18.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/503845949 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6250004500 msgr2=0x7f6250004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 --2- 172.21.2.135:0/503845949 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6250004500 0x7f6250004980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264006ca0).stop 2021-11-15T14:40:18.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 -- 172.21.2.135:0/503845949 reap_dead start 2021-11-15T14:40:18.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/503845949 shutdown_connections 2021-11-15T14:40:18.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/503845949 >> 172.21.2.135:0/503845949 conn(0x7f626805f730 msgr2=0x7f626805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:18.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/503845949 shutdown_connections 2021-11-15T14:40:18.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/503845949 wait complete. 2021-11-15T14:40:18.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 Processor -- start 2021-11-15T14:40:18.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- start start 2021-11-15T14:40:18.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250004500 0x7f6268148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f626814b460 0x7f62681574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681570b0 con 0x7f6250004500 2021-11-15T14:40:18.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815a620 con 0x7f6268157990 2021-11-15T14:40:18.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626813a500 con 0x7f626814b460 2021-11-15T14:40:18.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59326/0 (socket says 172.21.2.135:59326) 2021-11-15T14:40:18.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 -- 172.21.2.135:0/867730762 learned_addr learned my addr 172.21.2.135:0/867730762 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:18.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 -- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f626814b460 msgr2=0x7f62681574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f626814b460 0x7f62681574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 -- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250004500 msgr2=0x7f6268148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:18.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250004500 0x7f6268148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:18.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 -- 172.21.2.135:0/867730762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626813a730 con 0x7f6268157990 2021-11-15T14:40:18.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f626e6b2700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f626814a9a0 tx=0x7f6260001e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6260007e20 con 0x7f6268157990 2021-11-15T14:40:18.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260004ab0 con 0x7f6268157990 2021-11-15T14:40:18.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6260004e10 con 0x7f6268157990 2021-11-15T14:40:18.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626813a9d0 con 0x7f6268157990 2021-11-15T14:40:18.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.480+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626814bb40 con 0x7f6268157990 2021-11-15T14:40:18.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626813ae70 con 0x7f6268157990 2021-11-15T14:40:18.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f626001d070 con 0x7f6268157990 2021-11-15T14:40:18.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f625affd700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 0x7f6248055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:18.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f626006aff0 con 0x7f6268157990 2021-11-15T14:40:18.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f626deb1700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 0x7f6248055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:18.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f626deb1700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 0x7f6248055b60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f625c002f70 tx=0x7f625c006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:18.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.484+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6260042000 con 0x7f6268157990 2021-11-15T14:40:18.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:18.592+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62680b0c10 con 0x7f6268157990 2021-11-15T14:40:19.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.120+0000 7f625affd700 1 -- 172.21.2.135:0/867730762 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6260045620 con 0x7f6268157990 2021-11-15T14:40:19.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.120+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 msgr2=0x7f6248055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.120+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 0x7f6248055b60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f625c002f70 tx=0x7f625c006a00).stop 2021-11-15T14:40:19.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.120+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 msgr2=0x7f626815a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.120+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f626814a9a0 tx=0x7f6260001e00).stop 2021-11-15T14:40:19.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 shutdown_connections 2021-11-15T14:40:19.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62480536a0 0x7f6248055b60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6268157990 0x7f626815a9e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f626814b460 0x7f62681574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 --2- 172.21.2.135:0/867730762 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6250004500 0x7f6268148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 >> 172.21.2.135:0/867730762 conn(0x7f626805f730 msgr2=0x7f626813ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 shutdown_connections 2021-11-15T14:40:19.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.124+0000 7f6270115700 1 -- 172.21.2.135:0/867730762 wait complete. 2021-11-15T14:40:19.133 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 Processor -- start 2021-11-15T14:40:19.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 -- start start 2021-11-15T14:40:19.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7d5c0b0520 0x7f7d5c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d5c0b0900 0x7f7d5c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0b2b70 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0b27f0 con 0x7f7d5c0b0520 2021-11-15T14:40:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d62912700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0b2da0 con 0x7f7d5c0b0900 2021-11-15T14:40:19.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d5c0b0900 0x7f7d5c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7d5c0b0900 0x7f7d5c140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59332/0 (socket says 172.21.2.135:59332) 2021-11-15T14:40:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 -- 172.21.2.135:0/3323420539 learned_addr learned my addr 172.21.2.135:0/3323420539 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 -- 172.21.2.135:0/3323420539 >> v2:172.21.2.119:3300/0 conn(0x7f7d5c0b0520 msgr2=0x7f7d5c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 --2- 172.21.2.135:0/3323420539 >> v2:172.21.2.119:3300/0 conn(0x7f7d5c0b0520 0x7f7d5c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 -- 172.21.2.135:0/3323420539 >> v1:172.21.2.135:6789/0 conn(0x7f7d5c0aa1a0 legacy=0x7f7d5c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d5affd700 1 -- 172.21.2.135:0/3323420539 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507695785 0 0) 0x7f7d5c0b2b70 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 -- 172.21.2.135:0/3323420539 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0a9bf0 con 0x7f7d5c0b0900 2021-11-15T14:40:19.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.180+0000 7f7d60eaf700 1 --2- 172.21.2.135:0/3323420539 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c140620 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f7d540032f0 tx=0x7f7d5400b530).ready entity=mon.1 client_cookie=2a37d53dc642cae1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5affd700 1 -- 172.21.2.135:0/3323420539 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d5400be70 con 0x7f7d5c0b0900 2021-11-15T14:40:19.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5affd700 1 -- 172.21.2.135:0/3323420539 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54010470 con 0x7f7d5c0b0900 2021-11-15T14:40:19.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5affd700 1 -- 172.21.2.135:0/3323420539 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d540107d0 con 0x7f7d5c0b0900 2021-11-15T14:40:19.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/3323420539 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0b0900 msgr2=0x7f7d5c140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- 172.21.2.135:0/3323420539 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c140620 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f7d540032f0 tx=0x7f7d5400b530).stop 2021-11-15T14:40:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/3323420539 shutdown_connections 2021-11-15T14:40:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- 172.21.2.135:0/3323420539 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c140620 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- 172.21.2.135:0/3323420539 >> v2:172.21.2.119:3300/0 conn(0x7f7d5c0b0520 0x7f7d5c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/3323420539 >> 172.21.2.135:0/3323420539 conn(0x7f7d5c060840 msgr2=0x7f7d5c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/3323420539 shutdown_connections 2021-11-15T14:40:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/3323420539 wait complete. 2021-11-15T14:40:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 Processor -- start 2021-11-15T14:40:19.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- start start 2021-11-15T14:40:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d5c0b0520 0x7f7d5c0646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a8a60 con 0x7f7d5c0b0900 2021-11-15T14:40:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c065430 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a87c0 con 0x7f7d5c0b0520 2021-11-15T14:40:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59340/0 (socket says 172.21.2.135:59340) 2021-11-15T14:40:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 -- 172.21.2.135:0/960533594 learned_addr learned my addr 172.21.2.135:0/960533594 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 -- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d5c0b0520 msgr2=0x7f7d5c0646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d5c0b0520 0x7f7d5c0646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 -- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d5c0b0900 msgr2=0x7f7d5c145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 -- 172.21.2.135:0/960533594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5400b7d0 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d5bfff700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f7d5c09efb0 tx=0x7f7d4c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c013460 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0135c0 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c065690 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c0a8440 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c013920 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c065820 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d4c01a060 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 0x7f7d40055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.184+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7d4c06b650 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.188+0000 7f7d5b7fe700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 0x7f7d40055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.188+0000 7f7d5b7fe700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 0x7f7d40055a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7d44000bc0 tx=0x7f7d44007630).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.188+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d4c042550 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.296+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d5c0573d0 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.296+0000 7f7d597fa700 1 -- 172.21.2.135:0/960533594 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f7d4c018030 con 0x7f7d5c0aa1a0 2021-11-15T14:40:19.302 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:19.302 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:19.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 msgr2=0x7f7d40055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 0x7f7d40055a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7d44000bc0 tx=0x7f7d44007630).stop 2021-11-15T14:40:19.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 msgr2=0x7f7d5c066a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f7d5c09efb0 tx=0x7f7d4c006ec0).stop 2021-11-15T14:40:19.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 shutdown_connections 2021-11-15T14:40:19.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d400535d0 0x7f7d40055a90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d5c0b0900 0x7f7d5c145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d5c0b0520 0x7f7d5c0646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 --2- 172.21.2.135:0/960533594 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d5c0aa1a0 0x7f7d5c066a20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 >> 172.21.2.135:0/960533594 conn(0x7f7d5c060840 msgr2=0x7f7d5c148c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 shutdown_connections 2021-11-15T14:40:19.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.300+0000 7f7d62912700 1 -- 172.21.2.135:0/960533594 wait complete. 2021-11-15T14:40:19.306 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:19.309 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:19.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 Processor -- start 2021-11-15T14:40:19.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- start start 2021-11-15T14:40:19.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f14ec067070 0x7f14ec143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec067450 con 0x7f14ec0ad0b0 2021-11-15T14:40:19.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0b0050 con 0x7f14ec067070 2021-11-15T14:40:19.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0b02f0 con 0x7f14ec0b0760 2021-11-15T14:40:19.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f14ec067070 0x7f14ec143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f14ec067070 0x7f14ec143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59344/0 (socket says 172.21.2.135:59344) 2021-11-15T14:40:19.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 -- 172.21.2.135:0/2181585478 learned_addr learned my addr 172.21.2.135:0/2181585478 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 -- 172.21.2.135:0/2181585478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 msgr2=0x7f14ec0b0f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:19.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 --2- 172.21.2.135:0/2181585478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 -- 172.21.2.135:0/2181585478 >> v1:172.21.2.119:6789/0 conn(0x7f14ec0ad0b0 legacy=0x7f14ec143e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:19.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 -- 172.21.2.135:0/2181585478 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0af420 con 0x7f14ec067070 2021-11-15T14:40:19.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f091d700 1 --2- 172.21.2.135:0/2181585478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec067070 0x7f14ec143950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f14ec0625a0 tx=0x7f14d4006eb0).ready entity=mon.1 client_cookie=44a2cd9ea648d851 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14eb7fe700 1 -- 172.21.2.135:0/2181585478 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d400d570 con 0x7f14ec067070 2021-11-15T14:40:19.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14eb7fe700 1 -- 172.21.2.135:0/2181585478 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4000e90 con 0x7f14ec067070 2021-11-15T14:40:19.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14eb7fe700 1 -- 172.21.2.135:0/2181585478 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d400d8c0 con 0x7f14ec067070 2021-11-15T14:40:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- 172.21.2.135:0/2181585478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec067070 msgr2=0x7f14ec143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 --2- 172.21.2.135:0/2181585478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec067070 0x7f14ec143950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f14ec0625a0 tx=0x7f14d4006eb0).stop 2021-11-15T14:40:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 -- 172.21.2.135:0/2181585478 shutdown_connections 2021-11-15T14:40:19.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 --2- 172.21.2.135:0/2181585478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.356+0000 7f14f2b81700 1 --2- 172.21.2.135:0/2181585478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec067070 0x7f14ec143950 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/2181585478 >> 172.21.2.135:0/2181585478 conn(0x7f14ec05f730 msgr2=0x7f14ec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/2181585478 shutdown_connections 2021-11-15T14:40:19.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/2181585478 wait complete. 2021-11-15T14:40:19.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 Processor -- start 2021-11-15T14:40:19.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- start start 2021-11-15T14:40:19.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f14ec067070 0x7f14ec0a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0a3300 con 0x7f14ec067070 2021-11-15T14:40:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec09fa50 con 0x7f14ec09ff10 2021-11-15T14:40:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec09edd0 con 0x7f14ec0b0760 2021-11-15T14:40:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59354/0 (socket says 172.21.2.135:59354) 2021-11-15T14:40:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 -- 172.21.2.135:0/3197570791 learned_addr learned my addr 172.21.2.135:0/3197570791 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 -- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 msgr2=0x7f14ec0a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 -- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f14ec067070 msgr2=0x7f14ec0a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f14ec067070 0x7f14ec0a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 -- 172.21.2.135:0/3197570791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d400b1e0 con 0x7f14ec09ff10 2021-11-15T14:40:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f111e700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f14ec0a26d0 tx=0x7f14e40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e40014e0 con 0x7f14ec09ff10 2021-11-15T14:40:19.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e4001640 con 0x7f14ec09ff10 2021-11-15T14:40:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e40019a0 con 0x7f14ec09ff10 2021-11-15T14:40:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec09f070 con 0x7f14ec09ff10 2021-11-15T14:40:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec09f5b0 con 0x7f14ec09ff10 2021-11-15T14:40:19.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec09f770 con 0x7f14ec09ff10 2021-11-15T14:40:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f14e4018030 con 0x7f14ec09ff10 2021-11-15T14:40:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 0x7f14d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.360+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f14e406b3b0 con 0x7f14ec09ff10 2021-11-15T14:40:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.364+0000 7f14f091d700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 0x7f14d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.364+0000 7f14f091d700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 0x7f14d0055b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f14ec0625a0 tx=0x7f14d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.364+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14e4042470 con 0x7f14ec09ff10 2021-11-15T14:40:19.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14ec0573d0 con 0x7f14ec09ff10 2021-11-15T14:40:19.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14e9ffb700 1 -- 172.21.2.135:0/3197570791 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f14e4023fb0 con 0x7f14ec09ff10 2021-11-15T14:40:19.452 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:19.453 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":78,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:18.107859+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:19.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 msgr2=0x7f14d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 0x7f14d0055b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f14ec0625a0 tx=0x7f14d4015000).stop 2021-11-15T14:40:19.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 msgr2=0x7f14ec0a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f14ec0a26d0 tx=0x7f14e40090f0).stop 2021-11-15T14:40:19.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 shutdown_connections 2021-11-15T14:40:19.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f14d00536a0 0x7f14d0055b60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f14ec09ff10 0x7f14ec0a03c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f14ec0b0760 0x7f14ec0a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 --2- 172.21.2.135:0/3197570791 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f14ec067070 0x7f14ec0a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 >> 172.21.2.135:0/3197570791 conn(0x7f14ec05f730 msgr2=0x7f14ec13e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 shutdown_connections 2021-11-15T14:40:19.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.448+0000 7f14f2b81700 1 -- 172.21.2.135:0/3197570791 wait complete. 2021-11-15T14:40:19.460 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:40:19.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.508+0000 7f4f7f40f700 1 Processor -- start 2021-11-15T14:40:19.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.508+0000 7f4f7f40f700 1 -- start start 2021-11-15T14:40:19.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4f780b1e30 0x7f4f780b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4f78148420 0x7f4f780b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780b03d0 con 0x7f4f780a7140 2021-11-15T14:40:19.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780a9140 con 0x7f4f780b1e30 2021-11-15T14:40:19.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780b0670 con 0x7f4f78148420 2021-11-15T14:40:19.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4f78148420 0x7f4f780b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4f78148420 0x7f4f780b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59358/0 (socket says 172.21.2.135:59358) 2021-11-15T14:40:19.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 -- 172.21.2.135:0/2340732900 learned_addr learned my addr 172.21.2.135:0/2340732900 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 -- 172.21.2.135:0/2340732900 >> v2:172.21.2.119:3300/0 conn(0x7f4f780b1e30 msgr2=0x7f4f780b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:19.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 --2- 172.21.2.135:0/2340732900 >> v2:172.21.2.119:3300/0 conn(0x7f4f780b1e30 0x7f4f780b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 -- 172.21.2.135:0/2340732900 >> v1:172.21.2.119:6789/0 conn(0x7f4f780a7140 legacy=0x7f4f781447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:19.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 -- 172.21.2.135:0/2340732900 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780b0910 con 0x7f4f78148420 2021-11-15T14:40:19.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7c9aa700 1 --2- 172.21.2.135:0/2340732900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f780b2210 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f4f780acee0 tx=0x7f4f74006eb0).ready entity=mon.1 client_cookie=cf89f15894637274 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f67fff700 1 -- 172.21.2.135:0/2340732900 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7400d5c0 con 0x7f4f78148420 2021-11-15T14:40:19.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f67fff700 1 -- 172.21.2.135:0/2340732900 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74000e90 con 0x7f4f78148420 2021-11-15T14:40:19.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f67fff700 1 -- 172.21.2.135:0/2340732900 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7400d950 con 0x7f4f78148420 2021-11-15T14:40:19.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/2340732900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 msgr2=0x7f4f780b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/2340732900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f780b2210 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f4f780acee0 tx=0x7f4f74006eb0).stop 2021-11-15T14:40:19.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/2340732900 shutdown_connections 2021-11-15T14:40:19.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/2340732900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f780b2210 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/2340732900 >> v2:172.21.2.119:3300/0 conn(0x7f4f780b1e30 0x7f4f780b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/2340732900 >> 172.21.2.135:0/2340732900 conn(0x7f4f7805f730 msgr2=0x7f4f7805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/2340732900 shutdown_connections 2021-11-15T14:40:19.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/2340732900 wait complete. 2021-11-15T14:40:19.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 Processor -- start 2021-11-15T14:40:19.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- start start 2021-11-15T14:40:19.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4f780a7140 0x7f4f78144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4f780b1e30 0x7f4f7815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78064010 con 0x7f4f780b1e30 2021-11-15T14:40:19.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780aa3d0 con 0x7f4f78148420 2021-11-15T14:40:19.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780aae00 con 0x7f4f780a7140 2021-11-15T14:40:19.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59366/0 (socket says 172.21.2.135:59366) 2021-11-15T14:40:19.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 -- 172.21.2.135:0/3314388808 learned_addr learned my addr 172.21.2.135:0/3314388808 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 -- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4f780a7140 msgr2=0x7f4f78144c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:19.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4f780a7140 0x7f4f78144c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 -- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4f780b1e30 msgr2=0x7f4f7815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4f780b1e30 0x7f4f7815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 -- 172.21.2.135:0/3314388808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7400b1e0 con 0x7f4f78148420 2021-11-15T14:40:19.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7d9ac700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f4f70003330 tx=0x7f4f700091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f70001520 con 0x7f4f78148420 2021-11-15T14:40:19.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70001680 con 0x7f4f78148420 2021-11-15T14:40:19.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f700019e0 con 0x7f4f78148420 2021-11-15T14:40:19.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f780ab0a0 con 0x7f4f78148420 2021-11-15T14:40:19.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.512+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f780aa0c0 con 0x7f4f78148420 2021-11-15T14:40:19.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f780b0bb0 con 0x7f4f78148420 2021-11-15T14:40:19.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f70018030 con 0x7f4f78148420 2021-11-15T14:40:19.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f667fc700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 0x7f4f58055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4f7006b590 con 0x7f4f78148420 2021-11-15T14:40:19.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f7d1ab700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 0x7f4f58055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f7d1ab700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 0x7f4f58055b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f4f68002fb0 tx=0x7f4f68006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.516+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f70042540 con 0x7f4f78148420 2021-11-15T14:40:19.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.628+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4f780573d0 con 0x7f4f78148420 2021-11-15T14:40:19.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.640+0000 7f4f667fc700 1 -- 172.21.2.135:0/3314388808 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4f70045b60 con 0x7f4f78148420 2021-11-15T14:40:19.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 msgr2=0x7f4f58055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 0x7f4f58055b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f4f68002fb0 tx=0x7f4f68006930).stop 2021-11-15T14:40:19.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 msgr2=0x7f4f7815a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f4f70003330 tx=0x7f4f700091a0).stop 2021-11-15T14:40:19.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 shutdown_connections 2021-11-15T14:40:19.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4f580536d0 0x7f4f58055b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4f78148420 0x7f4f7815a820 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4f780b1e30 0x7f4f7815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 --2- 172.21.2.135:0/3314388808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4f780a7140 0x7f4f78144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 >> 172.21.2.135:0/3314388808 conn(0x7f4f7805f730 msgr2=0x7f4f78143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 shutdown_connections 2021-11-15T14:40:19.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.644+0000 7f4f7f40f700 1 -- 172.21.2.135:0/3314388808 wait complete. 2021-11-15T14:40:19.650 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:40:19.653 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:40:19.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 Processor -- start 2021-11-15T14:40:19.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- start start 2021-11-15T14:40:19.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f01ac0a7140 0x7f01ac1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0b03d0 con 0x7f01ac0b1e30 2021-11-15T14:40:19.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0a9140 con 0x7f01ac0a7140 2021-11-15T14:40:19.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0b0670 con 0x7f01ac148420 2021-11-15T14:40:19.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f01ac0a7140 0x7f01ac1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f01ac0a7140 0x7f01ac1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59370/0 (socket says 172.21.2.135:59370) 2021-11-15T14:40:19.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 -- 172.21.2.135:0/1161604654 learned_addr learned my addr 172.21.2.135:0/1161604654 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 -- 172.21.2.135:0/1161604654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 msgr2=0x7f01ac0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:19.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 --2- 172.21.2.135:0/1161604654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 -- 172.21.2.135:0/1161604654 >> v1:172.21.2.119:6789/0 conn(0x7f01ac0b1e30 legacy=0x7f01ac0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:19.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 -- 172.21.2.135:0/1161604654 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0b0910 con 0x7f01ac0a7140 2021-11-15T14:40:19.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b2089700 1 --2- 172.21.2.135:0/1161604654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac1447a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f01ac061420 tx=0x7f01a4009290).ready entity=mon.1 client_cookie=78454a2638fe7d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b0886700 1 -- 172.21.2.135:0/1161604654 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a400b860 con 0x7f01ac0a7140 2021-11-15T14:40:19.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b0886700 1 -- 172.21.2.135:0/1161604654 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400b9c0 con 0x7f01ac0a7140 2021-11-15T14:40:19.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b0886700 1 -- 172.21.2.135:0/1161604654 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a400bb70 con 0x7f01ac0a7140 2021-11-15T14:40:19.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- 172.21.2.135:0/1161604654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 msgr2=0x7f01ac1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 --2- 172.21.2.135:0/1161604654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac1447a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f01ac061420 tx=0x7f01a4009290).stop 2021-11-15T14:40:19.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- 172.21.2.135:0/1161604654 shutdown_connections 2021-11-15T14:40:19.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 --2- 172.21.2.135:0/1161604654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac1447a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 --2- 172.21.2.135:0/1161604654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:19.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- 172.21.2.135:0/1161604654 >> 172.21.2.135:0/1161604654 conn(0x7f01ac05f730 msgr2=0x7f01ac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- 172.21.2.135:0/1161604654 shutdown_connections 2021-11-15T14:40:19.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.704+0000 7f01b3aec700 1 -- 172.21.2.135:0/1161604654 wait complete. 2021-11-15T14:40:19.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 Processor -- start 2021-11-15T14:40:19.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- start start 2021-11-15T14:40:19.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 0x7f01ac0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac149120 con 0x7f01ac0b1e30 2021-11-15T14:40:19.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0aad00 con 0x7f01ac0a7140 2021-11-15T14:40:19.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac148be0 con 0x7f01ac148420 2021-11-15T14:40:19.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59378/0 (socket says 172.21.2.135:59378) 2021-11-15T14:40:19.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 -- 172.21.2.135:0/2824559828 learned_addr learned my addr 172.21.2.135:0/2824559828 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 -- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 msgr2=0x7f01ac0abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b2089700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1087700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 0x7f01ac0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 -- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 msgr2=0x7f01ac0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 0x7f01ac0ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 -- 172.21.2.135:0/2824559828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4009530 con 0x7f01ac0a7140 2021-11-15T14:40:19.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b2089700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:19.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1087700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 0x7f01ac0ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:40:19.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1888700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f01ac149cb0 tx=0x7f01a0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a0013460 con 0x7f01ac0a7140 2021-11-15T14:40:19.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00135c0 con 0x7f01ac0a7140 2021-11-15T14:40:19.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac148e80 con 0x7f01ac0a7140 2021-11-15T14:40:19.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a0013920 con 0x7f01ac0a7140 2021-11-15T14:40:19.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac0ac090 con 0x7f01ac0a7140 2021-11-15T14:40:19.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac0aae50 con 0x7f01ac0a7140 2021-11-15T14:40:19.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f01a001a060 con 0x7f01ac0a7140 2021-11-15T14:40:19.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 0x7f018c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f01a006b2d0 con 0x7f01ac0a7140 2021-11-15T14:40:19.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.708+0000 7f01b1087700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 0x7f018c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.712+0000 7f01b1087700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 0x7f018c055b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f01a8007000 tx=0x7f01a8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.712+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01a00422e0 con 0x7f01ac0a7140 2021-11-15T14:40:19.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.824+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f01ac0573d0 con 0x7f01ac0a7140 2021-11-15T14:40:19.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f019effd700 1 -- 172.21.2.135:0/2824559828 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f01a0018020 con 0x7f01ac0a7140 2021-11-15T14:40:19.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 msgr2=0x7f018c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 0x7f018c055b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f01a8007000 tx=0x7f01a8008040).stop 2021-11-15T14:40:19.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 msgr2=0x7f01ac14a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f01ac149cb0 tx=0x7f01a0006df0).stop 2021-11-15T14:40:19.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 shutdown_connections 2021-11-15T14:40:19.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f018c053640 0x7f018c055b00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f01ac148420 0x7f01ac0abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f01ac0b1e30 0x7f01ac0ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 --2- 172.21.2.135:0/2824559828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f01ac0a7140 0x7f01ac14a770 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 >> 172.21.2.135:0/2824559828 conn(0x7f01ac05f730 msgr2=0x7f01ac0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 shutdown_connections 2021-11-15T14:40:19.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.836+0000 7f01b3aec700 1 -- 172.21.2.135:0/2824559828 wait complete. 2021-11-15T14:40:19.845 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:40:19.848 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:19.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 Processor -- start 2021-11-15T14:40:19.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- start start 2021-11-15T14:40:19.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd4e40b1e30 0x7fd4e40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40b03d0 con 0x7fd4e40a7140 2021-11-15T14:40:19.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40b0670 con 0x7fd4e4148420 2021-11-15T14:40:19.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e40a9140 con 0x7fd4e40b1e30 2021-11-15T14:40:19.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd4e40b1e30 0x7fd4e40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd4e40b1e30 0x7fd4e40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59384/0 (socket says 172.21.2.135:59384) 2021-11-15T14:40:19.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 -- 172.21.2.135:0/1735460696 learned_addr learned my addr 172.21.2.135:0/1735460696 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 -- 172.21.2.135:0/1735460696 >> v1:172.21.2.135:6789/0 conn(0x7fd4e4148420 legacy=0x7fd4e40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 -- 172.21.2.135:0/1735460696 >> v1:172.21.2.119:6789/0 conn(0x7fd4e40a7140 legacy=0x7fd4e41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:19.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 -- 172.21.2.135:0/1735460696 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40b0910 con 0x7fd4e40b1e30 2021-11-15T14:40:19.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e3fff700 1 --2- 172.21.2.135:0/1735460696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40b1e30 0x7fd4e40b1050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fd4e40acee0 tx=0x7fd4cc006eb0).ready entity=mon.1 client_cookie=75266e8d87b01dd0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e2ffd700 1 -- 172.21.2.135:0/1735460696 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc00d5c0 con 0x7fd4e40b1e30 2021-11-15T14:40:19.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e2ffd700 1 -- 172.21.2.135:0/1735460696 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc000e90 con 0x7fd4e40b1e30 2021-11-15T14:40:19.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4e2ffd700 1 -- 172.21.2.135:0/1735460696 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc00d950 con 0x7fd4e40b1e30 2021-11-15T14:40:19.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/1735460696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40b1e30 msgr2=0x7fd4e40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/1735460696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40b1e30 0x7fd4e40b1050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fd4e40acee0 tx=0x7fd4cc006eb0).stop 2021-11-15T14:40:19.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/1735460696 shutdown_connections 2021-11-15T14:40:19.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/1735460696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40b1e30 0x7fd4e40b1050 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/1735460696 >> 172.21.2.135:0/1735460696 conn(0x7fd4e405f730 msgr2=0x7fd4e405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:19.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/1735460696 shutdown_connections 2021-11-15T14:40:19.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/1735460696 wait complete. 2021-11-15T14:40:19.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 Processor -- start 2021-11-15T14:40:19.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.896+0000 7fd4ea5d6700 1 -- start start 2021-11-15T14:40:19.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd4e40b1e30 0x7fd4e415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd4e4148420 0x7fd4e415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40aa2f0 con 0x7fd4e40b1e30 2021-11-15T14:40:19.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40ac340 con 0x7fd4e40a7140 2021-11-15T14:40:19.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40aa670 con 0x7fd4e4148420 2021-11-15T14:40:19.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59390/0 (socket says 172.21.2.135:59390) 2021-11-15T14:40:19.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 -- 172.21.2.135:0/350945855 learned_addr learned my addr 172.21.2.135:0/350945855 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:19.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e37fe700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd4e40b1e30 0x7fd4e415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e8b73700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd4e4148420 0x7fd4e415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 -- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd4e4148420 msgr2=0x7fd4e415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd4e4148420 0x7fd4e415a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 -- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd4e40b1e30 msgr2=0x7fd4e415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:19.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd4e40b1e30 0x7fd4e415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:19.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 -- 172.21.2.135:0/350945855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc00b1e0 con 0x7fd4e40a7140 2021-11-15T14:40:19.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e3fff700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd4e40acee0 tx=0x7fd4cc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc00de90 con 0x7fd4e40a7140 2021-11-15T14:40:19.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc002f50 con 0x7fd4e40a7140 2021-11-15T14:40:19.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc01d450 con 0x7fd4e40a7140 2021-11-15T14:40:19.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e40aab10 con 0x7fd4e40a7140 2021-11-15T14:40:19.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e415ab40 con 0x7fd4e40a7140 2021-11-15T14:40:19.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e40a9d80 con 0x7fd4e40a7140 2021-11-15T14:40:19.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4cc00f070 con 0x7fd4e40a7140 2021-11-15T14:40:19.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 0x7fd4c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:19.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd4cc06d770 con 0x7fd4e40a7140 2021-11-15T14:40:19.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.900+0000 7fd4e37fe700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 0x7fd4c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:19.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.904+0000 7fd4e37fe700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 0x7fd4c8055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fd4d400b000 tx=0x7fd4d4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:19.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:19.904+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4cc044670 con 0x7fd4e40a7140 2021-11-15T14:40:20.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.012+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4e40b0bb0 con 0x7fd4e40a7140 2021-11-15T14:40:20.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.012+0000 7fd4e17fa700 1 -- 172.21.2.135:0/350945855 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd4cc047c90 con 0x7fd4e40a7140 2021-11-15T14:40:20.018 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:20.018 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:20.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 msgr2=0x7fd4c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 0x7fd4c8055ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fd4d400b000 tx=0x7fd4d4009040).stop 2021-11-15T14:40:20.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 msgr2=0x7fd4e40b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd4e40acee0 tx=0x7fd4cc015000).stop 2021-11-15T14:40:20.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 shutdown_connections 2021-11-15T14:40:20.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4c8053610 0x7fd4c8055ad0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd4e4148420 0x7fd4e415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd4e40b1e30 0x7fd4e415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 --2- 172.21.2.135:0/350945855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd4e40a7140 0x7fd4e40b35f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 >> 172.21.2.135:0/350945855 conn(0x7fd4e405f730 msgr2=0x7fd4e4143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 shutdown_connections 2021-11-15T14:40:20.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.016+0000 7fd4ea5d6700 1 -- 172.21.2.135:0/350945855 wait complete. 2021-11-15T14:40:20.022 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:20.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:40:18.108204+0000', 'modified': '2021-11-15T14:40:19.112767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6208': {'gid': 6208, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6834/1605423856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6832', 'nonce': 1605423856}, {'type': 'v1', 'addr': '172.21.2.135:6834', 'nonce': 1605423856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:40:20.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:40:20.329 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:40:20.394 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6208,"want_state":"up:active","state":"up:active","rank_uptime":2.2753456440000002,"mdsmap_epoch":38,"osdmap_epoch":78,"osdmap_epoch_barrier":78,"uptime":6.4095462300000001} 2021-11-15T14:40:20.394 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6208, "mdsmap_epoch": 38, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "rank_uptime": 2.275345644, "state": "up:active", "uptime": 6.40954623, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:40:20.395 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:20.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 Processor -- start 2021-11-15T14:40:20.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 -- start start 2021-11-15T14:40:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85700b1e30 0x7f85700b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85700b03d0 con 0x7f8570148420 2021-11-15T14:40:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85700b0670 con 0x7f85700a7140 2021-11-15T14:40:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8577cc8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700a9140 con 0x7f85700b1e30 2021-11-15T14:40:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85700b1e30 0x7f85700b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85700b1e30 0x7f85700b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59398/0 (socket says 172.21.2.135:59398) 2021-11-15T14:40:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 -- 172.21.2.135:0/1602804978 learned_addr learned my addr 172.21.2.135:0/1602804978 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 -- 172.21.2.135:0/1602804978 >> v1:172.21.2.135:6789/0 conn(0x7f85700a7140 legacy=0x7f85701447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 -- 172.21.2.135:0/1602804978 >> v1:172.21.2.119:6789/0 conn(0x7f8570148420 legacy=0x7f85700b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 -- 172.21.2.135:0/1602804978 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700b0910 con 0x7f85700b1e30 2021-11-15T14:40:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.440+0000 7f8575a64700 1 --2- 172.21.2.135:0/1602804978 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f85700b1050 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f85701477b0 tx=0x7f856c006eb0).ready entity=mon.1 client_cookie=5fa7e0e88e9fa712 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8574a62700 1 -- 172.21.2.135:0/1602804978 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f856c00d5c0 con 0x7f85700b1e30 2021-11-15T14:40:20.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8574a62700 1 -- 172.21.2.135:0/1602804978 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c000e90 con 0x7f85700b1e30 2021-11-15T14:40:20.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8574a62700 1 -- 172.21.2.135:0/1602804978 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f856c00d950 con 0x7f85700b1e30 2021-11-15T14:40:20.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1602804978 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 msgr2=0x7f85700b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1602804978 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f85700b1050 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f85701477b0 tx=0x7f856c006eb0).stop 2021-11-15T14:40:20.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1602804978 shutdown_connections 2021-11-15T14:40:20.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1602804978 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f85700b1050 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1602804978 >> 172.21.2.135:0/1602804978 conn(0x7f857005f730 msgr2=0x7f857005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1602804978 shutdown_connections 2021-11-15T14:40:20.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1602804978 wait complete. 2021-11-15T14:40:20.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 Processor -- start 2021-11-15T14:40:20.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- start start 2021-11-15T14:40:20.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85700a7140 0x7f8570153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8570148420 0x7f85700635b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700a9f20 con 0x7f85700a7140 2021-11-15T14:40:20.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8570157740 con 0x7f85700b1e30 2021-11-15T14:40:20.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85701574c0 con 0x7f8570148420 2021-11-15T14:40:20.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59406/0 (socket says 172.21.2.135:59406) 2021-11-15T14:40:20.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 -- 172.21.2.135:0/1134420884 learned_addr learned my addr 172.21.2.135:0/1134420884 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 -- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8570148420 msgr2=0x7f85700635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8570148420 0x7f85700635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 -- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85700a7140 msgr2=0x7f8570153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85700a7140 0x7f8570153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 -- 172.21.2.135:0/1134420884 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c00b1e0 con 0x7f85700b1e30 2021-11-15T14:40:20.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8575263700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f8564002f10 tx=0x7f8564006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8564009e00 con 0x7f85700b1e30 2021-11-15T14:40:20.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f510 con 0x7f85700b1e30 2021-11-15T14:40:20.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85700a9c80 con 0x7f85700b1e30 2021-11-15T14:40:20.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f856400f680 con 0x7f85700b1e30 2021-11-15T14:40:20.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85700aa160 con 0x7f85700b1e30 2021-11-15T14:40:20.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85700aac90 con 0x7f85700b1e30 2021-11-15T14:40:20.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f856400f070 con 0x7f85700b1e30 2021-11-15T14:40:20.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 0x7f8550055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.444+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f856406b270 con 0x7f85700b1e30 2021-11-15T14:40:20.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.448+0000 7f8575a64700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 0x7f8550055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.448+0000 7f8575a64700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 0x7f8550055b00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f85701477b0 tx=0x7f856c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.448+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8564068e90 con 0x7f85700b1e30 2021-11-15T14:40:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.528+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85700b0bb0 con 0x7f85700b1e30 2021-11-15T14:40:20.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8562ffd700 1 -- 172.21.2.135:0/1134420884 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f85700aac90 con 0x7f85700b1e30 2021-11-15T14:40:20.535 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:20.535 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":78,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:18.107859+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:20.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 msgr2=0x7f8550055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 0x7f8550055b00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f85701477b0 tx=0x7f856c015000).stop 2021-11-15T14:40:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 msgr2=0x7f8570154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f8564002f10 tx=0x7f8564006d60).stop 2021-11-15T14:40:20.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 shutdown_connections 2021-11-15T14:40:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8550053640 0x7f8550055b00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8570148420 0x7f85700635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85700b1e30 0x7f8570154400 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 --2- 172.21.2.135:0/1134420884 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85700a7140 0x7f8570153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 >> 172.21.2.135:0/1134420884 conn(0x7f857005f730 msgr2=0x7f8570143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 shutdown_connections 2021-11-15T14:40:20.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.532+0000 7f8577cc8700 1 -- 172.21.2.135:0/1134420884 wait complete. 2021-11-15T14:40:20.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:40:16.049940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:40:17.076402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:40:20.543 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:40:20.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 Processor -- start 2021-11-15T14:40:20.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 -- start start 2021-11-15T14:40:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd3841419e0 0x7fd3840b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840a7850 con 0x7fd3840b1350 2021-11-15T14:40:20.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840b06d0 con 0x7fd3840b1f40 2021-11-15T14:40:20.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd38af18700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3840b17c0 con 0x7fd3841419e0 2021-11-15T14:40:20.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd3840b1f40 0x7fd3840a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47000/0 (socket says 172.21.2.135:47000) 2021-11-15T14:40:20.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 -- 172.21.2.135:0/1133774807 learned_addr learned my addr 172.21.2.135:0/1133774807 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:20.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012944208 0 0) 0x7fd3840b06d0 con 0x7fd3840b1f40 2021-11-15T14:40:20.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003260 con 0x7fd3840b1f40 2021-11-15T14:40:20.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913622623 0 0) 0x7fd364003260 con 0x7fd3840b1f40 2021-11-15T14:40:20.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 >> v2:172.21.2.119:3300/0 conn(0x7fd3841419e0 msgr2=0x7fd3840b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 --2- 172.21.2.135:0/1133774807 >> v2:172.21.2.119:3300/0 conn(0x7fd3841419e0 0x7fd3840b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 >> v1:172.21.2.119:6789/0 conn(0x7fd3840b1350 legacy=0x7fd3841412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840b0970 con 0x7fd3840b1f40 2021-11-15T14:40:20.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd36c001660 con 0x7fd3840b1f40 2021-11-15T14:40:20.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 >> v1:172.21.2.135:6789/0 conn(0x7fd3840b1f40 legacy=0x7fd3840a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd364003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd364004500 0x7fd364004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd364005050 0x7fd36400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b17c0 con 0x7fd364005050 2021-11-15T14:40:20.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400bf40 con 0x7fd364003820 2021-11-15T14:40:20.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400c100 con 0x7fd364004500 2021-11-15T14:40:20.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd364003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 -- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd364004500 msgr2=0x7fd364004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd364004500 0x7fd364004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 -- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd364005050 msgr2=0x7fd36400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd364005050 0x7fd36400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 -- 172.21.2.135:0/1133774807 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364003260 con 0x7fd364003820 2021-11-15T14:40:20.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3894b5700 1 -- 172.21.2.135:0/1133774807 reap_dead start 2021-11-15T14:40:20.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd388cb4700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd364003c20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd3840ad350 tx=0x7fd3840b0b00).ready entity=mon.1 client_cookie=503c262f78eeb121 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c0070d0 con 0x7fd364003820 2021-11-15T14:40:20.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c007230 con 0x7fd364003820 2021-11-15T14:40:20.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.592+0000 7fd3837fe700 1 -- 172.21.2.135:0/1133774807 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c00c8f0 con 0x7fd364003820 2021-11-15T14:40:20.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 msgr2=0x7fd364003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd364003c20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd3840ad350 tx=0x7fd3840b0b00).stop 2021-11-15T14:40:20.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/1133774807 shutdown_connections 2021-11-15T14:40:20.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 --2- 172.21.2.135:0/1133774807 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd364003c20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/1133774807 >> 172.21.2.135:0/1133774807 conn(0x7fd38405f730 msgr2=0x7fd38405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/1133774807 shutdown_connections 2021-11-15T14:40:20.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/1133774807 wait complete. 2021-11-15T14:40:20.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 Processor -- start 2021-11-15T14:40:20.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- start start 2021-11-15T14:40:20.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38414aea0 0x7fd384157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd384140250 0x7fd384153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384148bb0 con 0x7fd38414aea0 2021-11-15T14:40:20.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384148de0 con 0x7fd364003820 2021-11-15T14:40:20.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384149080 con 0x7fd384140250 2021-11-15T14:40:20.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59426/0 (socket says 172.21.2.135:59426) 2021-11-15T14:40:20.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 -- 172.21.2.135:0/156832133 learned_addr learned my addr 172.21.2.135:0/156832133 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 -- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd384140250 msgr2=0x7fd384153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd384140250 0x7fd384153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 -- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38414aea0 msgr2=0x7fd384157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38414aea0 0x7fd384157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 -- 172.21.2.135:0/156832133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384156d20 con 0x7fd364003820 2021-11-15T14:40:20.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd388cb4700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd3840ad350 tx=0x7fd36c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c01a070 con 0x7fd364003820 2021-11-15T14:40:20.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c004920 con 0x7fd364003820 2021-11-15T14:40:20.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36c0070d0 con 0x7fd364003820 2021-11-15T14:40:20.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384156fc0 con 0x7fd364003820 2021-11-15T14:40:20.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3840ab7c0 con 0x7fd364003820 2021-11-15T14:40:20.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3840b0c10 con 0x7fd364003820 2021-11-15T14:40:20.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd36c010070 con 0x7fd364003820 2021-11-15T14:40:20.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 0x7fd368055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.596+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd36c06bed0 con 0x7fd364003820 2021-11-15T14:40:20.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.600+0000 7fd383fff700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 0x7fd368055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.600+0000 7fd383fff700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 0x7fd368055be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fd374000f70 tx=0x7fd3740069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.600+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd36c042dd0 con 0x7fd364003820 2021-11-15T14:40:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd3840573d0 con 0x7fd364003820 2021-11-15T14:40:20.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd381ffb700 1 -- 172.21.2.135:0/156832133 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v78) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd36c0463f0 con 0x7fd364003820 2021-11-15T14:40:20.688 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:40:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 msgr2=0x7fd368055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 0x7fd368055be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fd374000f70 tx=0x7fd3740069b0).stop 2021-11-15T14:40:20.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 msgr2=0x7fd38415a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fd3840ad350 tx=0x7fd36c013000).stop 2021-11-15T14:40:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 shutdown_connections 2021-11-15T14:40:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd368053720 0x7fd368055be0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd384140250 0x7fd384153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38414aea0 0x7fd384157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 --2- 172.21.2.135:0/156832133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd364003820 0x7fd38415a160 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 >> 172.21.2.135:0/156832133 conn(0x7fd38405f730 msgr2=0x7fd38413cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 shutdown_connections 2021-11-15T14:40:20.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.684+0000 7fd38af18700 1 -- 172.21.2.135:0/156832133 wait complete. 2021-11-15T14:40:20.695 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:40:20.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 Processor -- start 2021-11-15T14:40:20.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 -- start start 2021-11-15T14:40:20.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 0x7f98200b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200a7850 con 0x7f98200b1f40 2021-11-15T14:40:20.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b06d0 con 0x7f98200b2320 2021-11-15T14:40:20.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f9824807700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200b17c0 con 0x7f98200b1350 2021-11-15T14:40:20.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981ed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f98200b2320 0x7f98201412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47020/0 (socket says 172.21.2.135:47020) 2021-11-15T14:40:20.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981ed9d700 1 -- 172.21.2.135:0/2322793917 learned_addr learned my addr 172.21.2.135:0/2322793917 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:20.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446303406 0 0) 0x7f98200b06d0 con 0x7f98200b2320 2021-11-15T14:40:20.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800003260 con 0x7f98200b2320 2021-11-15T14:40:20.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981dd9b700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 0x7f98200b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010131703 0 0) 0x7f9800003260 con 0x7f98200b2320 2021-11-15T14:40:20.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 msgr2=0x7f98200b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 0x7f98200b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 >> v1:172.21.2.119:6789/0 conn(0x7f98200b1f40 legacy=0x7f98200a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200b0970 con 0x7f98200b2320 2021-11-15T14:40:20.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f98180019e0 con 0x7f98200b2320 2021-11-15T14:40:20.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 >> v1:172.21.2.135:6789/0 conn(0x7f98200b2320 legacy=0x7f98201412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98000037d0 0x7f9800003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9800004500 0x7f9800004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 0x7f9800005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200b17c0 con 0x7f9800004500 2021-11-15T14:40:20.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980000b910 con 0x7f98000037d0 2021-11-15T14:40:20.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980000bad0 con 0x7f98200b1350 2021-11-15T14:40:20.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981e59c700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98000037d0 0x7f9800003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.744+0000 7f981e59c700 1 -- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 msgr2=0x7f9800005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981e59c700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98200b1350 0x7f9800005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981e59c700 1 -- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9800004500 msgr2=0x7f9800004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981e59c700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9800004500 0x7f9800004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981e59c700 1 -- 172.21.2.135:0/2322793917 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800003260 con 0x7f98000037d0 2021-11-15T14:40:20.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981e59c700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98000037d0 0x7f9800003bd0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f9808001fa0 tx=0x7f9808007a00).ready entity=mon.1 client_cookie=648f59fa6c7e6b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9808007070 con 0x7f98000037d0 2021-11-15T14:40:20.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080071d0 con 0x7f98000037d0 2021-11-15T14:40:20.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981d59a700 1 -- 172.21.2.135:0/2322793917 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9808006510 con 0x7f98000037d0 2021-11-15T14:40:20.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/2322793917 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98000037d0 msgr2=0x7f9800003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 --2- 172.21.2.135:0/2322793917 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98000037d0 0x7f9800003bd0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f9808001fa0 tx=0x7f9808007a00).stop 2021-11-15T14:40:20.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 -- 172.21.2.135:0/2322793917 reap_dead start 2021-11-15T14:40:20.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/2322793917 shutdown_connections 2021-11-15T14:40:20.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/2322793917 >> 172.21.2.135:0/2322793917 conn(0x7f982005f730 msgr2=0x7f982005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/2322793917 shutdown_connections 2021-11-15T14:40:20.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/2322793917 wait complete. 2021-11-15T14:40:20.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 Processor -- start 2021-11-15T14:40:20.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- start start 2021-11-15T14:40:20.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98000037d0 0x7f9820140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9820141ec0 0x7f982013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982013c3f0 con 0x7f9820141ec0 2021-11-15T14:40:20.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820142dd0 con 0x7f982013bf40 2021-11-15T14:40:20.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9820149e60 con 0x7f98000037d0 2021-11-15T14:40:20.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59446/0 (socket says 172.21.2.135:59446) 2021-11-15T14:40:20.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 -- 172.21.2.135:0/3154597124 learned_addr learned my addr 172.21.2.135:0/3154597124 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 -- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98000037d0 msgr2=0x7f9820140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98000037d0 0x7f9820140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 -- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9820141ec0 msgr2=0x7f982013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9820141ec0 0x7f982013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 -- 172.21.2.135:0/3154597124 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98201425e0 con 0x7f982013bf40 2021-11-15T14:40:20.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f981ed9d700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f98200abdc0 tx=0x7f98200b0860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9818004ab0 con 0x7f982013bf40 2021-11-15T14:40:20.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818004c10 con 0x7f982013bf40 2021-11-15T14:40:20.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98180070d0 con 0x7f982013bf40 2021-11-15T14:40:20.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820143000 con 0x7f982013bf40 2021-11-15T14:40:20.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9820142880 con 0x7f982013bf40 2021-11-15T14:40:20.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.748+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98200b0c10 con 0x7f982013bf40 2021-11-15T14:40:20.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f981801b070 con 0x7f982013bf40 2021-11-15T14:40:20.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f98177fe700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 0x7f9804055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f981806b250 con 0x7f982013bf40 2021-11-15T14:40:20.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f981e59c700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 0x7f9804055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f981e59c700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 0x7f9804055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9808001fa0 tx=0x7f9808015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.752+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9818042150 con 0x7f982013bf40 2021-11-15T14:40:20.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98200573d0 con 0x7f982013bf40 2021-11-15T14:40:20.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f98177fe700 1 -- 172.21.2.135:0/3154597124 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9818045770 con 0x7f982013bf40 2021-11-15T14:40:20.839 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:20.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 msgr2=0x7f9804055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 0x7f9804055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9808001fa0 tx=0x7f9808015000).stop 2021-11-15T14:40:20.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 msgr2=0x7f9820143740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f98200abdc0 tx=0x7f98200b0860).stop 2021-11-15T14:40:20.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 shutdown_connections 2021-11-15T14:40:20.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9804053640 0x7f9804055b00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f982013bf40 0x7f9820143740 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9820141ec0 0x7f982013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 --2- 172.21.2.135:0/3154597124 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98000037d0 0x7f9820140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 >> 172.21.2.135:0/3154597124 conn(0x7f982005f730 msgr2=0x7f9820145b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 shutdown_connections 2021-11-15T14:40:20.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.836+0000 7f9824807700 1 -- 172.21.2.135:0/3154597124 wait complete. 2021-11-15T14:40:20.847 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:40:20.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 Processor -- start 2021-11-15T14:40:20.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- start start 2021-11-15T14:40:20.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15240af970 0x7f15240aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f15240af3b0 0x7f15241477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240b5f10 con 0x7f15240b5b30 2021-11-15T14:40:20.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240adbf0 con 0x7f15240af3b0 2021-11-15T14:40:20.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240b0a10 con 0x7f15240af970 2021-11-15T14:40:20.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15240af970 0x7f15240aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15240af970 0x7f15240aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59454/0 (socket says 172.21.2.135:59454) 2021-11-15T14:40:20.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 -- 172.21.2.135:0/4217369778 learned_addr learned my addr 172.21.2.135:0/4217369778 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 -- 172.21.2.135:0/4217369778 >> v2:172.21.2.119:3300/0 conn(0x7f15240af3b0 msgr2=0x7f15241477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 --2- 172.21.2.135:0/4217369778 >> v2:172.21.2.119:3300/0 conn(0x7f15240af3b0 0x7f15241477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 -- 172.21.2.135:0/4217369778 >> v1:172.21.2.119:6789/0 conn(0x7f15240b5b30 legacy=0x7f15240ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:20.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 -- 172.21.2.135:0/4217369778 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240b1d90 con 0x7f15240af970 2021-11-15T14:40:20.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1522ffd700 1 --2- 172.21.2.135:0/4217369778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af970 0x7f15240aedc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f15240ae600 tx=0x7f1514006eb0).ready entity=mon.1 client_cookie=1b1a6dac5bc356d1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15227fc700 1 -- 172.21.2.135:0/4217369778 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151400d5c0 con 0x7f15240af970 2021-11-15T14:40:20.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15227fc700 1 -- 172.21.2.135:0/4217369778 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514000e90 con 0x7f15240af970 2021-11-15T14:40:20.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15227fc700 1 -- 172.21.2.135:0/4217369778 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151400d950 con 0x7f15240af970 2021-11-15T14:40:20.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- 172.21.2.135:0/4217369778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af970 msgr2=0x7f15240aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- 172.21.2.135:0/4217369778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af970 0x7f15240aedc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f15240ae600 tx=0x7f1514006eb0).stop 2021-11-15T14:40:20.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- 172.21.2.135:0/4217369778 shutdown_connections 2021-11-15T14:40:20.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- 172.21.2.135:0/4217369778 >> v2:172.21.2.119:3300/0 conn(0x7f15240af3b0 0x7f15241477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- 172.21.2.135:0/4217369778 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af970 0x7f15240aedc0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- 172.21.2.135:0/4217369778 >> 172.21.2.135:0/4217369778 conn(0x7f152405c510 msgr2=0x7f152405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- 172.21.2.135:0/4217369778 shutdown_connections 2021-11-15T14:40:20.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- 172.21.2.135:0/4217369778 wait complete. 2021-11-15T14:40:20.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 Processor -- start 2021-11-15T14:40:20.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- start start 2021-11-15T14:40:20.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15240af970 0x7f15240671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15240b5b30 0x7f1524064790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524065a80 con 0x7f15240af970 2021-11-15T14:40:20.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240665a0 con 0x7f15240af3b0 2021-11-15T14:40:20.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f1529fd3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1524066840 con 0x7f15240b5b30 2021-11-15T14:40:20.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15237fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15237fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59462/0 (socket says 172.21.2.135:59462) 2021-11-15T14:40:20.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.896+0000 7f15237fe700 1 -- 172.21.2.135:0/3504797473 learned_addr learned my addr 172.21.2.135:0/3504797473 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:20.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 -- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15240b5b30 msgr2=0x7f1524064790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15240b5b30 0x7f1524064790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 -- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15240af970 msgr2=0x7f15240671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15240af970 0x7f15240671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 -- 172.21.2.135:0/3504797473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151400b1e0 con 0x7f15240af3b0 2021-11-15T14:40:20.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f15237fe700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f150c002f10 tx=0x7f150c006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150c00f510 con 0x7f15240af3b0 2021-11-15T14:40:20.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00f670 con 0x7f15240af3b0 2021-11-15T14:40:20.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150c00f7e0 con 0x7f15240af3b0 2021-11-15T14:40:20.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1524066ae0 con 0x7f15240af3b0 2021-11-15T14:40:20.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1524065ee0 con 0x7f15240af3b0 2021-11-15T14:40:20.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240b0520 con 0x7f15240af3b0 2021-11-15T14:40:20.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f150c017020 con 0x7f15240af3b0 2021-11-15T14:40:20.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 0x7f1508055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:20.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f150c06b330 con 0x7f15240af3b0 2021-11-15T14:40:20.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1522ffd700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 0x7f1508055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:20.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.900+0000 7f1522ffd700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 0x7f1508055bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f15240ae600 tx=0x7f1514015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:20.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.904+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f150c042230 con 0x7f15240af3b0 2021-11-15T14:40:20.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.984+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1524065bf0 con 0x7f15240af3b0 2021-11-15T14:40:20.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1520ff9700 1 -- 172.21.2.135:0/3504797473 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7f150c0150a0 con 0x7f15240af3b0 2021-11-15T14:40:20.991 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:20.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 msgr2=0x7f1508055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 0x7f1508055bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f15240ae600 tx=0x7f1514015000).stop 2021-11-15T14:40:20.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 msgr2=0x7f1524148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:20.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f150c002f10 tx=0x7f150c006d70).stop 2021-11-15T14:40:20.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 shutdown_connections 2021-11-15T14:40:20.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f15080536f0 0x7f1508055bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15240b5b30 0x7f1524064790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f15240af970 0x7f15240671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:20.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 --2- 172.21.2.135:0/3504797473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15240af3b0 0x7f1524148310 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:20.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 >> 172.21.2.135:0/3504797473 conn(0x7f152405c510 msgr2=0x7f15241498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:20.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 shutdown_connections 2021-11-15T14:40:20.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:20.988+0000 7f1529fd3700 1 -- 172.21.2.135:0/3504797473 wait complete. 2021-11-15T14:40:20.998 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:40:21.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 Processor -- start 2021-11-15T14:40:21.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- start start 2021-11-15T14:40:21.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7a48060040 0x7f7a48064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7a480b3950 0x7f7a48065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a480b2430 con 0x7f7a480b2ca0 2021-11-15T14:40:21.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a48065770 con 0x7f7a480b3950 2021-11-15T14:40:21.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480b26d0 con 0x7f7a48060040 2021-11-15T14:40:21.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7a48060040 0x7f7a48064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a46d9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7a480b2ca0 0x7f7a480b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47058/0 (socket says 172.21.2.135:47058) 2021-11-15T14:40:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a46d9d700 1 -- 172.21.2.135:0/59474986 learned_addr learned my addr 172.21.2.135:0/59474986 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 -- 172.21.2.135:0/59474986 >> v2:172.21.2.119:3300/0 conn(0x7f7a480b3950 msgr2=0x7f7a48065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 --2- 172.21.2.135:0/59474986 >> v2:172.21.2.119:3300/0 conn(0x7f7a480b3950 0x7f7a48065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 -- 172.21.2.135:0/59474986 >> v1:172.21.2.135:6789/0 conn(0x7f7a480b2ca0 legacy=0x7f7a480b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 -- 172.21.2.135:0/59474986 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480b2970 con 0x7f7a48060040 2021-11-15T14:40:21.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4659c700 1 --2- 172.21.2.135:0/59474986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a48060040 0x7f7a48064d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f7a30002f70 tx=0x7f7a30006df0).ready entity=mon.1 client_cookie=d0df99c74c56f0e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4559a700 1 -- 172.21.2.135:0/59474986 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a3000d5c0 con 0x7f7a48060040 2021-11-15T14:40:21.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4559a700 1 -- 172.21.2.135:0/59474986 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30000e90 con 0x7f7a48060040 2021-11-15T14:40:21.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4559a700 1 -- 172.21.2.135:0/59474986 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a3000d910 con 0x7f7a48060040 2021-11-15T14:40:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- 172.21.2.135:0/59474986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a48060040 msgr2=0x7f7a48064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/59474986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a48060040 0x7f7a48064d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f7a30002f70 tx=0x7f7a30006df0).stop 2021-11-15T14:40:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- 172.21.2.135:0/59474986 shutdown_connections 2021-11-15T14:40:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/59474986 >> v2:172.21.2.119:3300/0 conn(0x7f7a480b3950 0x7f7a48065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/59474986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a48060040 0x7f7a48064d90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- 172.21.2.135:0/59474986 >> 172.21.2.135:0/59474986 conn(0x7f7a4805cfe0 msgr2=0x7f7a4805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- 172.21.2.135:0/59474986 shutdown_connections 2021-11-15T14:40:21.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- 172.21.2.135:0/59474986 wait complete. 2021-11-15T14:40:21.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 Processor -- start 2021-11-15T14:40:21.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.048+0000 7f7a4cff2700 1 -- start start 2021-11-15T14:40:21.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a48060040 0x7f7a480b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a480b2ca0 0x7f7a4813c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481535e0 con 0x7f7a480b2ca0 2021-11-15T14:40:21.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48153340 con 0x7f7a480b3950 2021-11-15T14:40:21.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4813edc0 con 0x7f7a48060040 2021-11-15T14:40:21.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59474/0 (socket says 172.21.2.135:59474) 2021-11-15T14:40:21.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 -- 172.21.2.135:0/1306667008 learned_addr learned my addr 172.21.2.135:0/1306667008 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:21.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 -- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a48060040 msgr2=0x7f7a480b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a48060040 0x7f7a480b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 -- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a480b2ca0 msgr2=0x7f7a4813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a480b2ca0 0x7f7a4813c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 -- 172.21.2.135:0/1306667008 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3000b180 con 0x7f7a480b3950 2021-11-15T14:40:21.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a46d9d700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f7a4813b870 tx=0x7f7a40007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a40005ba0 con 0x7f7a480b3950 2021-11-15T14:40:21.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40005d00 con 0x7f7a480b3950 2021-11-15T14:40:21.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4813f060 con 0x7f7a480b3950 2021-11-15T14:40:21.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480b02e0 con 0x7f7a480b3950 2021-11-15T14:40:21.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a400072c0 con 0x7f7a480b3950 2021-11-15T14:40:21.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4813f1f0 con 0x7f7a480b3950 2021-11-15T14:40:21.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a40010070 con 0x7f7a480b3950 2021-11-15T14:40:21.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 0x7f7a2c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7a4006b460 con 0x7f7a480b3950 2021-11-15T14:40:21.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4659c700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 0x7f7a2c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.052+0000 7f7a4659c700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 0x7f7a2c055b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f7a30002f70 tx=0x7f7a30014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.056+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a40042300 con 0x7f7a480b3950 2021-11-15T14:40:21.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a480648f0 con 0x7f7a480b3950 2021-11-15T14:40:21.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a3f7fe700 1 -- 172.21.2.135:0/1306667008 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7a40045920 con 0x7f7a480b3950 2021-11-15T14:40:21.142 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 msgr2=0x7f7a2c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 0x7f7a2c055b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f7a30002f70 tx=0x7f7a30014000).stop 2021-11-15T14:40:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 msgr2=0x7f7a4813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f7a4813b870 tx=0x7f7a40007f00).stop 2021-11-15T14:40:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 shutdown_connections 2021-11-15T14:40:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7a2c053640 0x7f7a2c055b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7a480b3950 0x7f7a4813c890 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7a480b2ca0 0x7f7a4813c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 --2- 172.21.2.135:0/1306667008 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7a48060040 0x7f7a480b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.136+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 >> 172.21.2.135:0/1306667008 conn(0x7f7a4805cfe0 msgr2=0x7f7a480b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.140+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 shutdown_connections 2021-11-15T14:40:21.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.140+0000 7f7a4cff2700 1 -- 172.21.2.135:0/1306667008 wait complete. 2021-11-15T14:40:21.149 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:40:21.149 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:21.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 Processor -- start 2021-11-15T14:40:21.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 -- start start 2021-11-15T14:40:21.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 0x7f7ce00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7ce00a7140 0x7f7ce01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00b03d0 con 0x7f7ce0148420 2021-11-15T14:40:21.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00a9140 con 0x7f7ce00a7140 2021-11-15T14:40:21.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7ce5fda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00b0670 con 0x7f7ce00b1e30 2021-11-15T14:40:21.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdeffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7ce0148420 0x7f7ce00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47068/0 (socket says 172.21.2.135:47068) 2021-11-15T14:40:21.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdeffd700 1 -- 172.21.2.135:0/1541289220 learned_addr learned my addr 172.21.2.135:0/1541289220 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:21.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665356974 0 0) 0x7f7ce00b03d0 con 0x7f7ce0148420 2021-11-15T14:40:21.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc0003260 con 0x7f7ce0148420 2021-11-15T14:40:21.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 0x7f7ce00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdffff700 1 --2- 172.21.2.135:0/1541289220 >> v2:172.21.2.119:3300/0 conn(0x7f7ce00a7140 0x7f7ce01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101999565 0 0) 0x7f7cc0003260 con 0x7f7ce0148420 2021-11-15T14:40:21.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 msgr2=0x7f7ce00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:21.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 0x7f7ce00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 >> v2:172.21.2.119:3300/0 conn(0x7f7ce00a7140 msgr2=0x7f7ce01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:21.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 --2- 172.21.2.135:0/1541289220 >> v2:172.21.2.119:3300/0 conn(0x7f7ce00a7140 0x7f7ce01447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00b0910 con 0x7f7ce0148420 2021-11-15T14:40:21.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7cd0001660 con 0x7f7ce0148420 2021-11-15T14:40:21.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 >> v1:172.21.2.135:6789/0 conn(0x7f7ce0148420 legacy=0x7f7ce00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cc00037d0 0x7f7cc0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cc0004500 0x7f7cc0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 0x7f7cc0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00b0670 con 0x7f7cc0004500 2021-11-15T14:40:21.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc000b750 con 0x7f7cc00037d0 2021-11-15T14:40:21.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc000b910 con 0x7f7ce00b1e30 2021-11-15T14:40:21.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdffff700 1 --2- 172.21.2.135:0/1541289220 >> v2:172.21.2.119:3300/0 conn(0x7f7ce00a7140 0x7f7ce01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:40:21.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cc00037d0 0x7f7cc0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 -- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 msgr2=0x7f7cc0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:21.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7ce00b1e30 0x7f7cc0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 -- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cc0004500 msgr2=0x7f7cc0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:21.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cc0004500 0x7f7cc0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 -- 172.21.2.135:0/1541289220 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0003260 con 0x7f7cc00037d0 2021-11-15T14:40:21.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.196+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cc00037d0 0x7f7cc0003bf0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f7cc0004470 tx=0x7f7cc8006df0).ready entity=mon.1 client_cookie=b241e069bce3e0ae server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc800e830 con 0x7f7cc00037d0 2021-11-15T14:40:21.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800be90 con 0x7f7cc00037d0 2021-11-15T14:40:21.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cde7fc700 1 -- 172.21.2.135:0/1541289220 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc800eb80 con 0x7f7cc00037d0 2021-11-15T14:40:21.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/1541289220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cc00037d0 msgr2=0x7f7cc0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/1541289220 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cc00037d0 0x7f7cc0003bf0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f7cc0004470 tx=0x7f7cc8006df0).stop 2021-11-15T14:40:21.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 -- 172.21.2.135:0/1541289220 reap_dead start 2021-11-15T14:40:21.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/1541289220 shutdown_connections 2021-11-15T14:40:21.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/1541289220 >> 172.21.2.135:0/1541289220 conn(0x7f7ce005f730 msgr2=0x7f7ce005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:21.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/1541289220 shutdown_connections 2021-11-15T14:40:21.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/1541289220 wait complete. 2021-11-15T14:40:21.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 Processor -- start 2021-11-15T14:40:21.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- start start 2021-11-15T14:40:21.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cc00037d0 0x7f7ce00ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7ce00af870 0x7f7ce015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae990 con 0x7f7ce00af870 2021-11-15T14:40:21.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00af4e0 con 0x7f7ce00ad750 2021-11-15T14:40:21.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce015a990 con 0x7f7cc00037d0 2021-11-15T14:40:21.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59496/0 (socket says 172.21.2.135:59496) 2021-11-15T14:40:21.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 -- 172.21.2.135:0/2877094692 learned_addr learned my addr 172.21.2.135:0/2877094692 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:21.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 -- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cc00037d0 msgr2=0x7f7ce00ae4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:21.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cc00037d0 0x7f7ce00ae4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 -- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7ce00af870 msgr2=0x7f7ce015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7ce00af870 0x7f7ce015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 -- 172.21.2.135:0/2877094692 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce015ac30 con 0x7f7ce00ad750 2021-11-15T14:40:21.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdffff700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f7cd8000b60 tx=0x7f7cd8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd800c070 con 0x7f7ce00ad750 2021-11-15T14:40:21.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80135e0 con 0x7f7ce00ad750 2021-11-15T14:40:21.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8013940 con 0x7f7ce00ad750 2021-11-15T14:40:21.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce015a6b0 con 0x7f7ce00ad750 2021-11-15T14:40:21.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce00adbd0 con 0x7f7ce00ad750 2021-11-15T14:40:21.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce00af620 con 0x7f7ce00ad750 2021-11-15T14:40:21.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7cd801b030 con 0x7f7ce00ad750 2021-11-15T14:40:21.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 0x7f7cc4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:21.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7cd806ace0 con 0x7f7ce00ad750 2021-11-15T14:40:21.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.200+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 0x7f7cc4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:21.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.204+0000 7f7cdf7fe700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 0x7f7cc4055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7cc0004470 tx=0x7f7cc8019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:21.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.204+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7cd8041cf0 con 0x7f7ce00ad750 2021-11-15T14:40:21.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ce00573d0 con 0x7f7ce00ad750 2021-11-15T14:40:21.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7cdcff9700 1 -- 172.21.2.135:0/2877094692 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f7cd8045310 con 0x7f7ce00ad750 2021-11-15T14:40:21.317 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:21.318 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:21.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 msgr2=0x7f7cc4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 0x7f7cc4055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7cc0004470 tx=0x7f7cc8019000).stop 2021-11-15T14:40:21.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 msgr2=0x7f7ce0143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:21.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f7cd8000b60 tx=0x7f7cd8008040).stop 2021-11-15T14:40:21.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 shutdown_connections 2021-11-15T14:40:21.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7cc40536a0 0x7f7cc4055b60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7ce00ad750 0x7f7ce0143950 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:21.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7ce00af870 0x7f7ce015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 --2- 172.21.2.135:0/2877094692 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cc00037d0 0x7f7ce00ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:21.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 >> 172.21.2.135:0/2877094692 conn(0x7f7ce005f730 msgr2=0x7f7ce0144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:21.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 shutdown_connections 2021-11-15T14:40:21.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:21.312+0000 7f7ce5fda700 1 -- 172.21.2.135:0/2877094692 wait complete. 2021-11-15T14:40:21.321 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:21.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:40:18.108204+0000', 'modified': '2021-11-15T14:40:19.112767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6208': {'gid': 6208, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6834/1605423856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6832', 'nonce': 1605423856}, {'type': 'v1', 'addr': '172.21.2.135:6834', 'nonce': 1605423856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:40:21.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:40:21.628 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:40:21.693 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6208,"want_state":"up:active","state":"up:active","rank_uptime":3.5742544770000002,"mdsmap_epoch":38,"osdmap_epoch":78,"osdmap_epoch_barrier":78,"uptime":7.7084545899999997} 2021-11-15T14:40:21.693 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6208, "mdsmap_epoch": 38, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "rank_uptime": 3.574254477, "state": "up:active", "uptime": 7.70845459, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:40:21.694 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:40:21.694 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:40:21.695 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:40:21.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:21.695 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:21.706 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:40:21.760 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:21.761 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:21.766 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:21.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:21.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:21.768 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:40:21.772 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:40:21.773 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:21.816 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:40:21.825 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:21.826 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:21.831 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:21.832 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:21.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:21.833 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:40:21.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:40:21.858+0000 7fc2cf3ed080 -1 init, newargv = 0x55d38390f0e0 newargc=9 2021-11-15T14:40:21.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14587]: starting ceph client 2021-11-15T14:40:21.871 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14587]: starting fuse 2021-11-15T14:40:22.960 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:40:22.972 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:22.973 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:23.020 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:23.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:23.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:23.023 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:40:23.027 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:40:23.028 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:40:23.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:23.029 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:40:23.029 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:40:23.029 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:40:23.030 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:40:23.030 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:40:23.031 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:40:23.031 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:40:23.032 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:40:23.032 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:40:23.032 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:40:23.033 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:40:23.033 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:40:23.034 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:40:23.034 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:40:23.034 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:40:23.035 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:40:23.035 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:40:23.036 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:40:23.036 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:40:23.036 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:40:23.037 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:40:23.037 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:40:23.038 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:40:23.068 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14587.asok 2021-11-15T14:40:23.071 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14587.asok 2021-11-15T14:40:23.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:23.071 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14587.asok status 2021-11-15T14:40:23.176 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:40:23.176 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:40:23.176 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:40:23.176 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:40:23.177 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:40:23.177 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:40:23.177 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:40:23.177 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14587", 2021-11-15T14:40:23.177 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:40:23.178 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:40:23.178 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:40:23.178 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:40:23.178 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4661, 2021-11-15T14:40:23.179 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:40:23.179 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:40:23.179 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:40:23.179 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4661 2021-11-15T14:40:23.179 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:40:23.180 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:40:23.180 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:40:23.180 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:40:23.180 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1859864213 2021-11-15T14:40:23.181 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:40:23.181 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:40:23.181 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:40:23.181 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:40:23.181 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:40:23.182 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1859864213 2021-11-15T14:40:23.182 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:40:23.182 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4661 172.21.2.138:0/1859864213", 2021-11-15T14:40:23.182 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1859864213", 2021-11-15T14:40:23.183 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:40:23.183 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 38, 2021-11-15T14:40:23.183 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 78, 2021-11-15T14:40:23.183 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:40:23.183 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:40:23.184 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:40:23.184 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:40:23.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:23.185 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:23.186 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:23.190 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:40:23.191 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:40:23.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:23.192 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:23.200 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:40:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 Processor -- start 2021-11-15T14:40:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 -- start start 2021-11-15T14:40:23.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb4f8148420 0x7fb4f80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb4f80a7140 0x7fb4f81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80b03d0 con 0x7fb4f80b1e30 2021-11-15T14:40:23.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f80a9140 con 0x7fb4f80a7140 2021-11-15T14:40:23.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f80b0670 con 0x7fb4f8148420 2021-11-15T14:40:23.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb4f8148420 0x7fb4f80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb4f8148420 0x7fb4f80b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59502/0 (socket says 172.21.2.135:59502) 2021-11-15T14:40:23.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 -- 172.21.2.135:0/892426064 learned_addr learned my addr 172.21.2.135:0/892426064 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 -- 172.21.2.135:0/892426064 >> v2:172.21.2.119:3300/0 conn(0x7fb4f80a7140 msgr2=0x7fb4f81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 --2- 172.21.2.135:0/892426064 >> v2:172.21.2.119:3300/0 conn(0x7fb4f80a7140 0x7fb4f81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 -- 172.21.2.135:0/892426064 >> v1:172.21.2.119:6789/0 conn(0x7fb4f80b1e30 legacy=0x7fb4f80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 -- 172.21.2.135:0/892426064 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80b0910 con 0x7fb4f8148420 2021-11-15T14:40:23.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f67fc700 1 --2- 172.21.2.135:0/892426064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80b1050 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fb4f80acee0 tx=0x7fb4e8006eb0).ready entity=mon.1 client_cookie=cbcfc5b93c403406 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f5ffb700 1 -- 172.21.2.135:0/892426064 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4e800d5c0 con 0x7fb4f8148420 2021-11-15T14:40:23.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f5ffb700 1 -- 172.21.2.135:0/892426064 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8000e90 con 0x7fb4f8148420 2021-11-15T14:40:23.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4f5ffb700 1 -- 172.21.2.135:0/892426064 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4e800d950 con 0x7fb4f8148420 2021-11-15T14:40:23.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 -- 172.21.2.135:0/892426064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 msgr2=0x7fb4f80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.252+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/892426064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80b1050 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fb4f80acee0 tx=0x7fb4e8006eb0).stop 2021-11-15T14:40:23.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/892426064 shutdown_connections 2021-11-15T14:40:23.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/892426064 >> v2:172.21.2.119:3300/0 conn(0x7fb4f80a7140 0x7fb4f81447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/892426064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80b1050 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/892426064 >> 172.21.2.135:0/892426064 conn(0x7fb4f805f730 msgr2=0x7fb4f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/892426064 shutdown_connections 2021-11-15T14:40:23.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/892426064 wait complete. 2021-11-15T14:40:23.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 Processor -- start 2021-11-15T14:40:23.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- start start 2021-11-15T14:40:23.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb4f80a7140 0x7fb4f8149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb4f80b1e30 0x7fb4f80adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8159f40 con 0x7fb4f80a7140 2021-11-15T14:40:23.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f815a170 con 0x7fb4f8148420 2021-11-15T14:40:23.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f815a410 con 0x7fb4f80b1e30 2021-11-15T14:40:23.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59508/0 (socket says 172.21.2.135:59508) 2021-11-15T14:40:23.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 -- 172.21.2.135:0/3407187259 learned_addr learned my addr 172.21.2.135:0/3407187259 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 -- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb4f80b1e30 msgr2=0x7fb4f80adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb4f80b1e30 0x7fb4f80adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 -- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb4f80a7140 msgr2=0x7fb4f8149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb4f80a7140 0x7fb4f8149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 -- 172.21.2.135:0/3407187259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e800b1e0 con 0x7fb4f8148420 2021-11-15T14:40:23.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4f77fe700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fb4f80a9a00 tx=0x7fb4f0009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4f000d580 con 0x7fb4f8148420 2021-11-15T14:40:23.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000d6e0 con 0x7fb4f8148420 2021-11-15T14:40:23.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4f000da40 con 0x7fb4f8148420 2021-11-15T14:40:23.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f815a6b0 con 0x7fb4f8148420 2021-11-15T14:40:23.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f80a94c0 con 0x7fb4f8148420 2021-11-15T14:40:23.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f815a840 con 0x7fb4f8148420 2021-11-15T14:40:23.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb4f000dba0 con 0x7fb4f8148420 2021-11-15T14:40:23.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 0x7fb4dc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.256+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb4f006bf10 con 0x7fb4f8148420 2021-11-15T14:40:23.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.260+0000 7fb4f6ffd700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 0x7fb4dc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.260+0000 7fb4f6ffd700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 0x7fb4dc055b20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fb4e0002f90 tx=0x7fb4e00069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.260+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4f0042e10 con 0x7fb4f8148420 2021-11-15T14:40:23.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4f80b0bb0 con 0x7fb4f8148420 2021-11-15T14:40:23.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4effff700 1 -- 172.21.2.135:0/3407187259 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fb4f0046430 con 0x7fb4f8148420 2021-11-15T14:40:23.348 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:23.348 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":78,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:18.107859+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:40:23.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 msgr2=0x7fb4dc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 0x7fb4dc055b20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fb4e0002f90 tx=0x7fb4e00069b0).stop 2021-11-15T14:40:23.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 msgr2=0x7fb4f80ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fb4f80a9a00 tx=0x7fb4f0009220).stop 2021-11-15T14:40:23.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 shutdown_connections 2021-11-15T14:40:23.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb4dc053660 0x7fb4dc055b20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb4f8148420 0x7fb4f80ae3a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb4f80b1e30 0x7fb4f80adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 --2- 172.21.2.135:0/3407187259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb4f80a7140 0x7fb4f8149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 >> 172.21.2.135:0/3407187259 conn(0x7fb4f805f730 msgr2=0x7fb4f81477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 shutdown_connections 2021-11-15T14:40:23.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.344+0000 7fb4fd76d700 1 -- 172.21.2.135:0/3407187259 wait complete. 2021-11-15T14:40:23.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:40:16.049940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:40:17.076402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:40:23.356 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:40:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 Processor -- start 2021-11-15T14:40:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- start start 2021-11-15T14:40:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8a080b1350 0x7f8a080b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080a7850 con 0x7f8a080b2320 2021-11-15T14:40:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080b06d0 con 0x7f8a080b1f40 2021-11-15T14:40:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080b17c0 con 0x7f8a080b1350 2021-11-15T14:40:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8a080b1350 0x7f8a080b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8a080b1350 0x7f8a080b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59516/0 (socket says 172.21.2.135:59516) 2021-11-15T14:40:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 -- 172.21.2.135:0/2029764880 learned_addr learned my addr 172.21.2.135:0/2029764880 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 -- 172.21.2.135:0/2029764880 >> v1:172.21.2.135:6789/0 conn(0x7f8a080b1f40 legacy=0x7f8a080a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 -- 172.21.2.135:0/2029764880 >> v1:172.21.2.119:6789/0 conn(0x7f8a080b2320 legacy=0x7f8a081412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:40:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 -- 172.21.2.135:0/2029764880 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080b0970 con 0x7f8a080b1350 2021-11-15T14:40:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a07fff700 1 --2- 172.21.2.135:0/2029764880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b0030 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f8a080ad350 tx=0x7f89f8006eb0).ready entity=mon.1 client_cookie=6c983fe6ccb723c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a077fe700 1 -- 172.21.2.135:0/2029764880 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f800d610 con 0x7f8a080b1350 2021-11-15T14:40:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a077fe700 1 -- 172.21.2.135:0/2029764880 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8000e90 con 0x7f8a080b1350 2021-11-15T14:40:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a077fe700 1 -- 172.21.2.135:0/2029764880 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f800d960 con 0x7f8a080b1350 2021-11-15T14:40:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- 172.21.2.135:0/2029764880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 msgr2=0x7f8a080b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/2029764880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b0030 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f8a080ad350 tx=0x7f89f8006eb0).stop 2021-11-15T14:40:23.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- 172.21.2.135:0/2029764880 shutdown_connections 2021-11-15T14:40:23.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/2029764880 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b0030 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- 172.21.2.135:0/2029764880 >> 172.21.2.135:0/2029764880 conn(0x7f8a0805f730 msgr2=0x7f8a0805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- 172.21.2.135:0/2029764880 shutdown_connections 2021-11-15T14:40:23.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.404+0000 7f8a0ef90700 1 -- 172.21.2.135:0/2029764880 wait complete. 2021-11-15T14:40:23.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 Processor -- start 2021-11-15T14:40:23.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- start start 2021-11-15T14:40:23.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a080b1f40 0x7f8a0814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a080b2320 0x7f8a0814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080a9760 con 0x7f8a080b1f40 2021-11-15T14:40:23.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080aa190 con 0x7f8a080b1350 2021-11-15T14:40:23.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080aa3c0 con 0x7f8a080b2320 2021-11-15T14:40:23.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59524/0 (socket says 172.21.2.135:59524) 2021-11-15T14:40:23.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 -- 172.21.2.135:0/1811028163 learned_addr learned my addr 172.21.2.135:0/1811028163 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 -- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a080b2320 msgr2=0x7f8a0814b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a080b2320 0x7f8a0814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 -- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a080b1f40 msgr2=0x7f8a0814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a080b1f40 0x7f8a0814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 -- 172.21.2.135:0/1811028163 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f800b1e0 con 0x7f8a080b1350 2021-11-15T14:40:23.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0cd2c700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f8a080b2fd0 tx=0x7f89f0007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f000ce30 con 0x7f8a080b1350 2021-11-15T14:40:23.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0007240 con 0x7f8a080b1350 2021-11-15T14:40:23.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f0006700 con 0x7f8a080b1350 2021-11-15T14:40:23.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080aa660 con 0x7f8a080b1350 2021-11-15T14:40:23.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0814ba70 con 0x7f8a080b1350 2021-11-15T14:40:23.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080573d0 con 0x7f8a080b1350 2021-11-15T14:40:23.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89f0010030 con 0x7f8a080b1350 2021-11-15T14:40:23.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 0x7f89ec055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f89f006b730 con 0x7f8a080b1350 2021-11-15T14:40:23.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.408+0000 7f8a07fff700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 0x7f89ec055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.412+0000 7f8a07fff700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 0x7f89ec055b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f8a080ad350 tx=0x7f89f8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.412+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89f0042740 con 0x7f8a080b1350 2021-11-15T14:40:23.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8a080b64b0 con 0x7f8a080b1350 2021-11-15T14:40:23.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a05ffb700 1 -- 172.21.2.135:0/1811028163 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v78) v1 ==== 110+0+10 (secure 0 0 0) 0x7f89f0045d60 con 0x7f8a080b1350 2021-11-15T14:40:23.499 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:40:23.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 msgr2=0x7f89ec055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 0x7f89ec055b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f8a080ad350 tx=0x7f89f8015000).stop 2021-11-15T14:40:23.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 msgr2=0x7f8a080b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f8a080b2fd0 tx=0x7f89f0007c10).stop 2021-11-15T14:40:23.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 shutdown_connections 2021-11-15T14:40:23.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89ec053640 0x7f89ec055b00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a080b2320 0x7f8a0814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a080b1f40 0x7f8a0814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 --2- 172.21.2.135:0/1811028163 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a080b1350 0x7f8a080b4dd0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 >> 172.21.2.135:0/1811028163 conn(0x7f8a0805f730 msgr2=0x7f8a080b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 shutdown_connections 2021-11-15T14:40:23.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.496+0000 7f8a0ef90700 1 -- 172.21.2.135:0/1811028163 wait complete. 2021-11-15T14:40:23.506 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:40:23.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.552+0000 7ff0666ea700 1 Processor -- start 2021-11-15T14:40:23.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.552+0000 7ff0666ea700 1 -- start start 2021-11-15T14:40:23.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff0600ac2e0 0x7ff0600b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff0600b0740 0x7ff0600ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600b1ce0 con 0x7ff0600a99e0 2021-11-15T14:40:23.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600a9dc0 con 0x7ff0600ac2e0 2021-11-15T14:40:23.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600b29c0 con 0x7ff0600b0740 2021-11-15T14:40:23.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff0600a99e0 0x7ff0600aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47116/0 (socket says 172.21.2.135:47116) 2021-11-15T14:40:23.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 -- 172.21.2.135:0/4099449926 learned_addr learned my addr 172.21.2.135:0/4099449926 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:23.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 --2- 172.21.2.135:0/4099449926 >> v2:172.21.2.135:3300/0 conn(0x7ff0600b0740 0x7ff0600ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05effd700 1 -- 172.21.2.135:0/4099449926 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066162582 0 0) 0x7ff050001110 con 0x7ff0600a99e0 2021-11-15T14:40:23.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05effd700 1 -- 172.21.2.135:0/4099449926 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff04c003260 con 0x7ff0600a99e0 2021-11-15T14:40:23.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 -- 172.21.2.135:0/4099449926 >> v2:172.21.2.119:3300/0 conn(0x7ff0600ac2e0 msgr2=0x7ff0600b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 --2- 172.21.2.135:0/4099449926 >> v2:172.21.2.119:3300/0 conn(0x7ff0600ac2e0 0x7ff0600b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 -- 172.21.2.135:0/4099449926 >> v1:172.21.2.135:6789/0 conn(0x7ff0600a99e0 legacy=0x7ff0600aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 -- 172.21.2.135:0/4099449926 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600b0140 con 0x7ff0600b0740 2021-11-15T14:40:23.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff064c87700 1 --2- 172.21.2.135:0/4099449926 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600b0740 0x7ff0600ab020 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff0580032f0 tx=0x7ff0580091d0).ready entity=mon.1 client_cookie=3deda35e814b57a3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05effd700 1 -- 172.21.2.135:0/4099449926 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800b680 con 0x7ff0600b0740 2021-11-15T14:40:23.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05effd700 1 -- 172.21.2.135:0/4099449926 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800b7e0 con 0x7ff0600b0740 2021-11-15T14:40:23.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05effd700 1 -- 172.21.2.135:0/4099449926 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800b950 con 0x7ff0600b0740 2021-11-15T14:40:23.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- 172.21.2.135:0/4099449926 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600b0740 msgr2=0x7ff0600ab020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4099449926 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600b0740 0x7ff0600ab020 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff0580032f0 tx=0x7ff0580091d0).stop 2021-11-15T14:40:23.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- 172.21.2.135:0/4099449926 shutdown_connections 2021-11-15T14:40:23.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4099449926 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600b0740 0x7ff0600ab020 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4099449926 >> v2:172.21.2.119:3300/0 conn(0x7ff0600ac2e0 0x7ff0600b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- 172.21.2.135:0/4099449926 >> 172.21.2.135:0/4099449926 conn(0x7ff06005f730 msgr2=0x7ff06005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- 172.21.2.135:0/4099449926 shutdown_connections 2021-11-15T14:40:23.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- 172.21.2.135:0/4099449926 wait complete. 2021-11-15T14:40:23.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 Processor -- start 2021-11-15T14:40:23.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- start start 2021-11-15T14:40:23.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0600ac2e0 0x7ff060064640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0600b0740 0x7ff0601510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060150c80 con 0x7ff0600ac2e0 2021-11-15T14:40:23.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060063e40 con 0x7ff0600a99e0 2021-11-15T14:40:23.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff0666ea700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600640e0 con 0x7ff0600b0740 2021-11-15T14:40:23.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59536/0 (socket says 172.21.2.135:59536) 2021-11-15T14:40:23.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 -- 172.21.2.135:0/4012353873 learned_addr learned my addr 172.21.2.135:0/4012353873 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 -- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0600b0740 msgr2=0x7ff0601510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0600b0740 0x7ff0601510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 -- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0600ac2e0 msgr2=0x7ff060064640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0600ac2e0 0x7ff060064640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 -- 172.21.2.135:0/4012353873 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058009470 con 0x7ff0600a99e0 2021-11-15T14:40:23.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.556+0000 7ff05ffff700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7ff0500012a0 tx=0x7ff050007900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05000ce30 con 0x7ff0600a99e0 2021-11-15T14:40:23.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500072e0 con 0x7ff0600a99e0 2021-11-15T14:40:23.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff060062840 con 0x7ff0600a99e0 2021-11-15T14:40:23.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0600b4110 con 0x7ff0600a99e0 2021-11-15T14:40:23.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050005610 con 0x7ff0600a99e0 2021-11-15T14:40:23.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060150df0 con 0x7ff0600a99e0 2021-11-15T14:40:23.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff050010070 con 0x7ff0600a99e0 2021-11-15T14:40:23.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 0x7ff040055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff05006b260 con 0x7ff0600a99e0 2021-11-15T14:40:23.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05f7fe700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 0x7ff040055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05f7fe700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 0x7ff040055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7ff054002f70 tx=0x7ff054006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.560+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff050042160 con 0x7ff0600a99e0 2021-11-15T14:40:23.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0600b1ce0 con 0x7ff0600a99e0 2021-11-15T14:40:23.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff05d7fa700 1 -- 172.21.2.135:0/4012353873 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0600b1ce0 con 0x7ff0600a99e0 2021-11-15T14:40:23.648 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:23.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 msgr2=0x7ff040055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 0x7ff040055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7ff054002f70 tx=0x7ff054006a80).stop 2021-11-15T14:40:23.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 msgr2=0x7ff06009ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7ff0500012a0 tx=0x7ff050007900).stop 2021-11-15T14:40:23.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 shutdown_connections 2021-11-15T14:40:23.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0400535d0 0x7ff040055a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0600b0740 0x7ff0601510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0600ac2e0 0x7ff060064640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 --2- 172.21.2.135:0/4012353873 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0600a99e0 0x7ff06009ec70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 >> 172.21.2.135:0/4012353873 conn(0x7ff06005f730 msgr2=0x7ff06013d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 shutdown_connections 2021-11-15T14:40:23.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.644+0000 7ff0666ea700 1 -- 172.21.2.135:0/4012353873 wait complete. 2021-11-15T14:40:23.655 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:40:23.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 Processor -- start 2021-11-15T14:40:23.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- start start 2021-11-15T14:40:23.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7d340b2c70 0x7f7d340b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340ac840 con 0x7f7d340b1140 2021-11-15T14:40:23.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340ac0a0 con 0x7f7d340acbf0 2021-11-15T14:40:23.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d340ac300 con 0x7f7d340b2c70 2021-11-15T14:40:23.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d38838700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7d340acbf0 0x7f7d340b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47132/0 (socket says 172.21.2.135:47132) 2021-11-15T14:40:23.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d38838700 1 -- 172.21.2.135:0/428431965 learned_addr learned my addr 172.21.2.135:0/428431965 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:23.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3983a700 1 --2- 172.21.2.135:0/428431965 >> v2:172.21.2.119:3300/0 conn(0x7f7d340b2c70 0x7f7d340b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3983a700 1 -- 172.21.2.135:0/428431965 >> v1:172.21.2.135:6789/0 conn(0x7f7d340acbf0 legacy=0x7f7d340b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3983a700 1 -- 172.21.2.135:0/428431965 >> v1:172.21.2.119:6789/0 conn(0x7f7d340b1140 legacy=0x7f7d3413d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3983a700 1 -- 172.21.2.135:0/428431965 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340ac5a0 con 0x7f7d340b2c70 2021-11-15T14:40:23.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3983a700 1 --2- 172.21.2.135:0/428431965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d340b1520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7d2c0032f0 tx=0x7f7d2c0091d0).ready entity=mon.0 client_cookie=ae296b1189c6efb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d23fff700 1 -- 172.21.2.135:0/428431965 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2c009ea0 con 0x7f7d340b2c70 2021-11-15T14:40:23.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d23fff700 1 -- 172.21.2.135:0/428431965 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00b8a0 con 0x7f7d340b2c70 2021-11-15T14:40:23.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d23fff700 1 -- 172.21.2.135:0/428431965 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2c00ba10 con 0x7f7d340b2c70 2021-11-15T14:40:23.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- 172.21.2.135:0/428431965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 msgr2=0x7f7d340b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/428431965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d340b1520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7d2c0032f0 tx=0x7f7d2c0091d0).stop 2021-11-15T14:40:23.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- 172.21.2.135:0/428431965 shutdown_connections 2021-11-15T14:40:23.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/428431965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d340b1520 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.704+0000 7f7d3b29d700 1 -- 172.21.2.135:0/428431965 >> 172.21.2.135:0/428431965 conn(0x7f7d3405f730 msgr2=0x7f7d3405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- 172.21.2.135:0/428431965 shutdown_connections 2021-11-15T14:40:23.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- 172.21.2.135:0/428431965 wait complete. 2021-11-15T14:40:23.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 Processor -- start 2021-11-15T14:40:23.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- start start 2021-11-15T14:40:23.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d340b1140 0x7f7d3413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d34154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340674d0 con 0x7f7d340b2c70 2021-11-15T14:40:23.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b5f10 con 0x7f7d340acbf0 2021-11-15T14:40:23.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340a8ca0 con 0x7f7d340b1140 2021-11-15T14:40:23.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59552/0 (socket says 172.21.2.135:59552) 2021-11-15T14:40:23.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 -- 172.21.2.135:0/803162515 learned_addr learned my addr 172.21.2.135:0/803162515 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d38838700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d340b1140 0x7f7d3413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3983a700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d34154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 -- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d340b1140 msgr2=0x7f7d3413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d340b1140 0x7f7d3413f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 -- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 msgr2=0x7f7d34154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d34154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 -- 172.21.2.135:0/803162515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c009470 con 0x7f7d340acbf0 2021-11-15T14:40:23.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d39039700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7d340a9e30 tx=0x7f7d24007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d24012400 con 0x7f7d340acbf0 2021-11-15T14:40:23.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d24012560 con 0x7f7d340acbf0 2021-11-15T14:40:23.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d240128c0 con 0x7f7d340acbf0 2021-11-15T14:40:23.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d340a8f40 con 0x7f7d340acbf0 2021-11-15T14:40:23.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d34065890 con 0x7f7d340acbf0 2021-11-15T14:40:23.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3413efb0 con 0x7f7d340acbf0 2021-11-15T14:40:23.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7d24019030 con 0x7f7d340acbf0 2021-11-15T14:40:23.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 0x7f7d14055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7d2406aee0 con 0x7f7d340acbf0 2021-11-15T14:40:23.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.708+0000 7f7d38838700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 0x7f7d14055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.712+0000 7f7d38838700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 0x7f7d14055bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7d3000d000 tx=0x7f7d30009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.712+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d3413efb0 con 0x7f7d340acbf0 2021-11-15T14:40:23.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d3413efb0 con 0x7f7d340acbf0 2021-11-15T14:40:23.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d227fc700 1 -- 172.21.2.135:0/803162515 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7d3413efb0 con 0x7f7d340acbf0 2021-11-15T14:40:23.801 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:23.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 msgr2=0x7f7d14055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 0x7f7d14055bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7d3000d000 tx=0x7f7d30009040).stop 2021-11-15T14:40:23.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 msgr2=0x7f7d340b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7d340a9e30 tx=0x7f7d24007c50).stop 2021-11-15T14:40:23.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 shutdown_connections 2021-11-15T14:40:23.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d140536f0 0x7f7d14055bb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7d340b2c70 0x7f7d34154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7d340b1140 0x7f7d3413f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 --2- 172.21.2.135:0/803162515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7d340acbf0 0x7f7d340b5310 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 >> 172.21.2.135:0/803162515 conn(0x7f7d3405f730 msgr2=0x7f7d3405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 shutdown_connections 2021-11-15T14:40:23.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.796+0000 7f7d3b29d700 1 -- 172.21.2.135:0/803162515 wait complete. 2021-11-15T14:40:23.808 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:40:23.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 Processor -- start 2021-11-15T14:40:23.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 -- start start 2021-11-15T14:40:23.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 0x7f9ce40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce40a7850 con 0x7f9ce40b2320 2021-11-15T14:40:23.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce40b0470 con 0x7f9ce40b0030 2021-11-15T14:40:23.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce8c18700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40b06d0 con 0x7f9ce40b1f40 2021-11-15T14:40:23.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce1d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9ce40b0030 0x7f9ce40a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47146/0 (socket says 172.21.2.135:47146) 2021-11-15T14:40:23.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce1d9b700 1 -- 172.21.2.135:0/1116016810 learned_addr learned my addr 172.21.2.135:0/1116016810 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:23.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406206676 0 0) 0x7f9ce40b0470 con 0x7f9ce40b0030 2021-11-15T14:40:23.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc4003260 con 0x7f9ce40b0030 2021-11-15T14:40:23.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101974162 0 0) 0x7f9cc4003260 con 0x7f9ce40b0030 2021-11-15T14:40:23.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 msgr2=0x7f9ce40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 0x7f9ce40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 >> v1:172.21.2.119:6789/0 conn(0x7f9ce40b2320 legacy=0x7f9ce41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40b0970 con 0x7f9ce40b0030 2021-11-15T14:40:23.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9cd4001660 con 0x7f9ce40b0030 2021-11-15T14:40:23.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 >> v1:172.21.2.135:6789/0 conn(0x7f9ce40b0030 legacy=0x7f9ce40a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9cc40037d0 0x7f9cc4003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 0x7f9cc4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9cc4004b40 0x7f9cc4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40b06d0 con 0x7f9cc40037d0 2021-11-15T14:40:23.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400b9b0 con 0x7f9cc4004b40 2021-11-15T14:40:23.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.860+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400bb70 con 0x7f9ce40b1f40 2021-11-15T14:40:23.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9cc4004b40 0x7f9cc4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 msgr2=0x7f9cc4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9ce40b1f40 0x7f9cc4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9cc40037d0 msgr2=0x7f9cc4003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:23.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9cc40037d0 0x7f9cc4003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:23.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/1116016810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4003260 con 0x7f9cc4004b40 2021-11-15T14:40:23.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9cc4004b40 0x7f9cc4004fc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f9cdc0012f0 tx=0x7f9cdc007d60).ready entity=mon.1 client_cookie=bd7d2a78d2ed0189 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cdc0014c0 con 0x7f9cc4004b40 2021-11-15T14:40:23.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc006870 con 0x7f9cc4004b40 2021-11-15T14:40:23.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce159a700 1 -- 172.21.2.135:0/1116016810 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cdc006bd0 con 0x7f9cc4004b40 2021-11-15T14:40:23.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/1116016810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9cc4004b40 msgr2=0x7f9cc4004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/1116016810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9cc4004b40 0x7f9cc4004fc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f9cdc0012f0 tx=0x7f9cdc007d60).stop 2021-11-15T14:40:23.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/1116016810 reap_dead start 2021-11-15T14:40:23.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/1116016810 shutdown_connections 2021-11-15T14:40:23.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/1116016810 >> 172.21.2.135:0/1116016810 conn(0x7f9ce405f730 msgr2=0x7f9ce405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/1116016810 shutdown_connections 2021-11-15T14:40:23.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/1116016810 wait complete. 2021-11-15T14:40:23.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 Processor -- start 2021-11-15T14:40:23.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- start start 2021-11-15T14:40:23.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9cc4004b40 0x7f9ce40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ce40b3780 0x7f9ce41491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4157410 con 0x7f9ce40b3780 2021-11-15T14:40:23.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40b33f0 con 0x7f9ce41496c0 2021-11-15T14:40:23.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4157680 con 0x7f9cc4004b40 2021-11-15T14:40:23.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59572/0 (socket says 172.21.2.135:59572) 2021-11-15T14:40:23.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/666794587 learned_addr learned my addr 172.21.2.135:0/666794587 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:23.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce1d9b700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ce40b3780 0x7f9ce41491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce259c700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9cc4004b40 0x7f9ce40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9cc4004b40 msgr2=0x7f9ce40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9cc4004b40 0x7f9ce40abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ce40b3780 msgr2=0x7f9ce41491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ce40b3780 0x7f9ce41491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 -- 172.21.2.135:0/666794587 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4157920 con 0x7f9ce41496c0 2021-11-15T14:40:23.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce2d9d700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9ce4062380 tx=0x7f9cdc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cdc018030 con 0x7f9ce41496c0 2021-11-15T14:40:23.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc006e00 con 0x7f9ce41496c0 2021-11-15T14:40:23.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cdc0014c0 con 0x7f9ce41496c0 2021-11-15T14:40:23.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce40ab250 con 0x7f9ce41496c0 2021-11-15T14:40:23.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce415a6b0 con 0x7f9ce41496c0 2021-11-15T14:40:23.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.864+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce40b0c10 con 0x7f9ce41496c0 2021-11-15T14:40:23.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9cdc027020 con 0x7f9ce41496c0 2021-11-15T14:40:23.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9cdb7fe700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 0x7f9cc8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:23.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9cdc019070 con 0x7f9ce41496c0 2021-11-15T14:40:23.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9ce259c700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 0x7f9cc8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:23.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9ce259c700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 0x7f9cc8055b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9ccc007000 tx=0x7f9ccc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:23.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.868+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9cdc043f20 con 0x7f9ce41496c0 2021-11-15T14:40:23.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ce40573d0 con 0x7f9ce41496c0 2021-11-15T14:40:23.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9cdb7fe700 1 -- 172.21.2.135:0/666794587 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9cdc047540 con 0x7f9ce41496c0 2021-11-15T14:40:23.957 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:40:23.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 msgr2=0x7f9cc8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 0x7f9cc8055b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9ccc007000 tx=0x7f9ccc008040).stop 2021-11-15T14:40:23.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 msgr2=0x7f9ce4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:23.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f9ce4062380 tx=0x7f9cdc016000).stop 2021-11-15T14:40:23.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 shutdown_connections 2021-11-15T14:40:23.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9cc80536d0 0x7f9cc8055b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9ce41496c0 0x7f9ce4159fa0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9ce40b3780 0x7f9ce41491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 --2- 172.21.2.135:0/666794587 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9cc4004b40 0x7f9ce40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 >> 172.21.2.135:0/666794587 conn(0x7f9ce405f730 msgr2=0x7f9ce40af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:23.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 shutdown_connections 2021-11-15T14:40:23.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:23.952+0000 7f9ce8c18700 1 -- 172.21.2.135:0/666794587 wait complete. 2021-11-15T14:40:23.964 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:40:23.965 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:24.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 Processor -- start 2021-11-15T14:40:24.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 -- start start 2021-11-15T14:40:24.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 0x7fc2c00acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc2c00aa650 0x7fc2c013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c00b6d60 con 0x7fc2c0060990 2021-11-15T14:40:24.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c0061260 con 0x7fc2c00aa650 2021-11-15T14:40:24.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c7943700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0061500 con 0x7fc2c00b6980 2021-11-15T14:40:24.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc2c0060990 0x7fc2c00a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47166/0 (socket says 172.21.2.135:47166) 2021-11-15T14:40:24.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 -- 172.21.2.135:0/1279846374 learned_addr learned my addr 172.21.2.135:0/1279846374 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:24.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277427810 0 0) 0x7fc2c00b6d60 con 0x7fc2c0060990 2021-11-15T14:40:24.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a8003260 con 0x7fc2c0060990 2021-11-15T14:40:24.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2898157730 0 0) 0x7fc2a8003260 con 0x7fc2c0060990 2021-11-15T14:40:24.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 msgr2=0x7fc2c00acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:24.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 0x7fc2c00acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 >> v2:172.21.2.119:3300/0 conn(0x7fc2c00aa650 msgr2=0x7fc2c013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:24.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 --2- 172.21.2.135:0/1279846374 >> v2:172.21.2.119:3300/0 conn(0x7fc2c00aa650 0x7fc2c013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00617a0 con 0x7fc2c0060990 2021-11-15T14:40:24.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc2bc001680 con 0x7fc2c0060990 2021-11-15T14:40:24.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 >> v1:172.21.2.135:6789/0 conn(0x7fc2c0060990 legacy=0x7fc2c00a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 0x7fc2a80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2a8003ee0 0x7fc2a8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8004bf0 0x7fc2a8005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0061260 con 0x7fc2a8004bf0 2021-11-15T14:40:24.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0061500 con 0x7fc2a8003ee0 2021-11-15T14:40:24.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80053a0 con 0x7fc2c00b6980 2021-11-15T14:40:24.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2a8003ee0 0x7fc2a8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:24.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 -- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 msgr2=0x7fc2a80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:24.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00b6980 0x7fc2a80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 -- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8004bf0 msgr2=0x7fc2a8005720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:24.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8004bf0 0x7fc2a8005720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 -- 172.21.2.135:0/1279846374 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8003260 con 0x7fc2a8003ee0 2021-11-15T14:40:24.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2a8003ee0 0x7fc2a8004500 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc2bc001390 tx=0x7fc2c00ac010).ready entity=mon.1 client_cookie=fcb72c41c89c6670 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:24.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc007170 con 0x7fc2a8003ee0 2021-11-15T14:40:24.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0072d0 con 0x7fc2a8003ee0 2021-11-15T14:40:24.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.012+0000 7fc2affff700 1 -- 172.21.2.135:0/1279846374 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc00c9c0 con 0x7fc2a8003ee0 2021-11-15T14:40:24.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/1279846374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2a8003ee0 msgr2=0x7fc2a8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 --2- 172.21.2.135:0/1279846374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2a8003ee0 0x7fc2a8004500 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc2bc001390 tx=0x7fc2c00ac010).stop 2021-11-15T14:40:24.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c5ee0700 1 -- 172.21.2.135:0/1279846374 reap_dead start 2021-11-15T14:40:24.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/1279846374 shutdown_connections 2021-11-15T14:40:24.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/1279846374 >> 172.21.2.135:0/1279846374 conn(0x7fc2c00b3500 msgr2=0x7fc2c00b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:24.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/1279846374 shutdown_connections 2021-11-15T14:40:24.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/1279846374 wait complete. 2021-11-15T14:40:24.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 Processor -- start 2021-11-15T14:40:24.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- start start 2021-11-15T14:40:24.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8003ee0 0x7fc2c013d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00a7f60 0x7fc2c0156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015a940 con 0x7fc2a8003ee0 2021-11-15T14:40:24.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c013be80 con 0x7fc2c013b4a0 2021-11-15T14:40:24.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c013c120 con 0x7fc2c00a7f60 2021-11-15T14:40:24.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:24.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59592/0 (socket says 172.21.2.135:59592) 2021-11-15T14:40:24.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 -- 172.21.2.135:0/696054718 learned_addr learned my addr 172.21.2.135:0/696054718 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:24.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 -- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00a7f60 msgr2=0x7fc2c0156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00a7f60 0x7fc2c0156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 -- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8003ee0 msgr2=0x7fc2c013d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8003ee0 0x7fc2c013d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 -- 172.21.2.135:0/696054718 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c013bbd0 con 0x7fc2c013b4a0 2021-11-15T14:40:24.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c4ede700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fc2bc001390 tx=0x7fc2bc013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:24.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc001a20 con 0x7fc2c013b4a0 2021-11-15T14:40:24.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00c6d0 con 0x7fc2c013b4a0 2021-11-15T14:40:24.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc004920 con 0x7fc2c013b4a0 2021-11-15T14:40:24.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c015a660 con 0x7fc2c013b4a0 2021-11-15T14:40:24.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c013a550 con 0x7fc2c013b4a0 2021-11-15T14:40:24.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c0061a40 con 0x7fc2c013b4a0 2021-11-15T14:40:24.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2bc027070 con 0x7fc2c013b4a0 2021-11-15T14:40:24.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 0x7fc2a0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:24.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.016+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc2bc06c240 con 0x7fc2c013b4a0 2021-11-15T14:40:24.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.020+0000 7fc2c56df700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 0x7fc2a0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:24.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.020+0000 7fc2c56df700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 0x7fc2a0055b50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fc2b0002f70 tx=0x7fc2b0006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:24.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.020+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2bc0431f0 con 0x7fc2c013b4a0 2021-11-15T14:40:24.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.128+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2c00573d0 con 0x7fc2c013b4a0 2021-11-15T14:40:24.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2ae7fc700 1 -- 172.21.2.135:0/696054718 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fc2bc046810 con 0x7fc2c013b4a0 2021-11-15T14:40:24.135 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:24.135 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:24.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 msgr2=0x7fc2a0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 0x7fc2a0055b50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fc2b0002f70 tx=0x7fc2b0006a10).stop 2021-11-15T14:40:24.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 msgr2=0x7fc2c015a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:24.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fc2bc001390 tx=0x7fc2bc013000).stop 2021-11-15T14:40:24.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 shutdown_connections 2021-11-15T14:40:24.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc2a0053690 0x7fc2a0055b50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:24.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2c00a7f60 0x7fc2c0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2c013b4a0 0x7fc2c015a170 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:24.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 --2- 172.21.2.135:0/696054718 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2a8003ee0 0x7fc2c013d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:24.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 >> 172.21.2.135:0/696054718 conn(0x7fc2c00b3500 msgr2=0x7fc2c0135fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:24.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 shutdown_connections 2021-11-15T14:40:24.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:24.132+0000 7fc2c7943700 1 -- 172.21.2.135:0/696054718 wait complete. 2021-11-15T14:40:24.139 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:24.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:40:18.108204+0000', 'modified': '2021-11-15T14:40:19.112767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6208': {'gid': 6208, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6834/1605423856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6832', 'nonce': 1605423856}, {'type': 'v1', 'addr': '172.21.2.135:6834', 'nonce': 1605423856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:40:24.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:40:24.446 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:40:24.516 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6208,"want_state":"up:active","state":"up:active","rank_uptime":6.3976568020000002,"mdsmap_epoch":38,"osdmap_epoch":78,"osdmap_epoch_barrier":78,"uptime":10.531857923} 2021-11-15T14:40:24.517 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6208, "mdsmap_epoch": 38, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "rank_uptime": 6.397656802, "state": "up:active", "uptime": 10.531857923, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:40:24.517 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:40:24.518 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:40:24.518 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:40:24.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:24.519 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:24.529 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:40:24.581 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:24.581 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:24.587 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:24.587 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:24.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:24.589 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:40:24.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:40:24.593 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:24.636 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:40:24.645 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:24.646 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:24.650 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:24.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:24.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:24.652 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:40:24.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:40:24.672+0000 7f5cfefc0080 -1 init, newargv = 0x55578902b3e0 newargc=9 2021-11-15T14:40:24.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14187]: starting ceph client 2021-11-15T14:40:24.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14187]: starting fuse 2021-11-15T14:40:25.756 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:40:25.924 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:40:25.924 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:40:25.975 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:40:25.976 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:40:25.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:25.977 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:40:25.983 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:40:25.984 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:40:25.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:25.985 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:40:25.985 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:40:25.986 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:40:25.986 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:40:25.986 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:40:25.987 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:40:25.987 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:40:25.988 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:40:25.988 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:40:25.989 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:40:25.989 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:40:25.989 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:40:25.990 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:40:25.991 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:40:25.991 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:40:25.992 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:40:25.992 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:40:25.992 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:40:25.993 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:40:25.993 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:40:25.994 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:40:25.994 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:40:25.995 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:40:26.061 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14187.asok 2021-11-15T14:40:26.064 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14187.asok 2021-11-15T14:40:26.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:26.065 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14187.asok status 2021-11-15T14:40:26.114 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:40:26.114 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:40:26.114 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:40:26.115 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:40:26.115 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:40:26.115 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:40:26.115 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:40:26.116 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14187", 2021-11-15T14:40:26.116 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:40:26.116 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:40:26.116 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:40:26.117 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:40:26.117 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 6412, 2021-11-15T14:40:26.117 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:40:26.117 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:40:26.117 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:40:26.118 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 6412 2021-11-15T14:40:26.118 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:40:26.118 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:40:26.118 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:40:26.119 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:40:26.119 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3166307456 2021-11-15T14:40:26.119 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:40:26.119 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:40:26.120 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:40:26.120 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:40:26.120 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:40:26.121 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3166307456 2021-11-15T14:40:26.121 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:40:26.121 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.6412 172.21.2.132:0/3166307456", 2021-11-15T14:40:26.121 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3166307456", 2021-11-15T14:40:26.121 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:40:26.122 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 38, 2021-11-15T14:40:26.122 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 78, 2021-11-15T14:40:26.122 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:40:26.122 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:40:26.123 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:40:26.123 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:40:26.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:26.125 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:26.125 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:26.130 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:40:26.131 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:40:26.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:26.132 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:26.140 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:26.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 Processor -- start 2021-11-15T14:40:26.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- start start 2021-11-15T14:40:26.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15740b6600 0x7f15740b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f15740b4440 0x7f15740b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1574144130 con 0x7f1574061db0 2021-11-15T14:40:26.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15740b6ed0 con 0x7f15740b4440 2021-11-15T14:40:26.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1574143bf0 con 0x7f15740b6600 2021-11-15T14:40:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15740b6600 0x7f15740b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f15740b6600 0x7f15740b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59596/0 (socket says 172.21.2.135:59596) 2021-11-15T14:40:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 -- 172.21.2.135:0/2706453297 learned_addr learned my addr 172.21.2.135:0/2706453297 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 -- 172.21.2.135:0/2706453297 >> v2:172.21.2.119:3300/0 conn(0x7f15740b4440 msgr2=0x7f15740b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 --2- 172.21.2.135:0/2706453297 >> v2:172.21.2.119:3300/0 conn(0x7f15740b4440 0x7f15740b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 -- 172.21.2.135:0/2706453297 >> v1:172.21.2.119:6789/0 conn(0x7f1574061db0 legacy=0x7f1574146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 -- 172.21.2.135:0/2706453297 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1574143e90 con 0x7f15740b6600 2021-11-15T14:40:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1579eda700 1 --2- 172.21.2.135:0/2706453297 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b6600 0x7f15740b5c70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f15740b1d00 tx=0x7f1570006eb0).ready entity=mon.1 client_cookie=595013cdcb4985c2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1578ed8700 1 -- 172.21.2.135:0/2706453297 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f157000d5c0 con 0x7f15740b6600 2021-11-15T14:40:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1578ed8700 1 -- 172.21.2.135:0/2706453297 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570000e90 con 0x7f15740b6600 2021-11-15T14:40:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f1578ed8700 1 -- 172.21.2.135:0/2706453297 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f157000d950 con 0x7f15740b6600 2021-11-15T14:40:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- 172.21.2.135:0/2706453297 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b6600 msgr2=0x7f15740b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 --2- 172.21.2.135:0/2706453297 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b6600 0x7f15740b5c70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f15740b1d00 tx=0x7f1570006eb0).stop 2021-11-15T14:40:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- 172.21.2.135:0/2706453297 shutdown_connections 2021-11-15T14:40:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 --2- 172.21.2.135:0/2706453297 >> v2:172.21.2.119:3300/0 conn(0x7f15740b4440 0x7f15740b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 --2- 172.21.2.135:0/2706453297 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b6600 0x7f15740b5c70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- 172.21.2.135:0/2706453297 >> 172.21.2.135:0/2706453297 conn(0x7f157405c510 msgr2=0x7f157405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:26.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- 172.21.2.135:0/2706453297 shutdown_connections 2021-11-15T14:40:26.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.192+0000 7f157c13e700 1 -- 172.21.2.135:0/2706453297 wait complete. 2021-11-15T14:40:26.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 Processor -- start 2021-11-15T14:40:26.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- start start 2021-11-15T14:40:26.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1574061db0 0x7f1574141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15740b6600 0x7f1574147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740b1d40 con 0x7f1574061db0 2021-11-15T14:40:26.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740b1fa0 con 0x7f15740b4440 2021-11-15T14:40:26.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740b7610 con 0x7f15740b6600 2021-11-15T14:40:26.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59606/0 (socket says 172.21.2.135:59606) 2021-11-15T14:40:26.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 -- 172.21.2.135:0/2654802132 learned_addr learned my addr 172.21.2.135:0/2654802132 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:26.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 -- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15740b6600 msgr2=0x7f1574147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157a6db700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15740b6600 0x7f1574147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15740b6600 0x7f1574147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 -- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1574061db0 msgr2=0x7f1574141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1574061db0 0x7f1574141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 -- 172.21.2.135:0/2654802132 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157000b1e0 con 0x7f15740b4440 2021-11-15T14:40:26.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f15796d9700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f1564002f70 tx=0x7f1564006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1564013460 con 0x7f15740b4440 2021-11-15T14:40:26.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15640135c0 con 0x7f15740b4440 2021-11-15T14:40:26.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574147d70 con 0x7f15740b4440 2021-11-15T14:40:26.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1564013920 con 0x7f15740b4440 2021-11-15T14:40:26.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15740b39b0 con 0x7f15740b4440 2021-11-15T14:40:26.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15740b21a0 con 0x7f15740b4440 2021-11-15T14:40:26.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f156401a060 con 0x7f15740b4440 2021-11-15T14:40:26.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 0x7f1554055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f156406b4b0 con 0x7f15740b4440 2021-11-15T14:40:26.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.196+0000 7f1579eda700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 0x7f1554055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.200+0000 7f1579eda700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 0x7f1554055be0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f15740b1d00 tx=0x7f1570015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.200+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15640424c0 con 0x7f15740b4440 2021-11-15T14:40:26.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15740b77d0 con 0x7f15740b4440 2021-11-15T14:40:26.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f1562ffd700 1 -- 172.21.2.135:0/2654802132 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1564045ae0 con 0x7f15740b4440 2021-11-15T14:40:26.313 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:26.313 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:26.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 msgr2=0x7f1554055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 0x7f1554055be0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f15740b1d00 tx=0x7f1570015000).stop 2021-11-15T14:40:26.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 msgr2=0x7f1574129bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f1564002f70 tx=0x7f1564006e90).stop 2021-11-15T14:40:26.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 shutdown_connections 2021-11-15T14:40:26.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1554053720 0x7f1554055be0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f15740b6600 0x7f1574147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f15740b4440 0x7f1574129bd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 --2- 172.21.2.135:0/2654802132 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1574061db0 0x7f1574141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 >> 172.21.2.135:0/2654802132 conn(0x7f157405c510 msgr2=0x7f1574141eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:26.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 shutdown_connections 2021-11-15T14:40:26.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.308+0000 7f157c13e700 1 -- 172.21.2.135:0/2654802132 wait complete. 2021-11-15T14:40:26.318 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:26.320 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:40:26.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 Processor -- start 2021-11-15T14:40:26.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- start start 2021-11-15T14:40:26.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7feae80b1050 0x7feae81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80b03d0 con 0x7feae80b1e30 2021-11-15T14:40:26.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80b0670 con 0x7feae8148420 2021-11-15T14:40:26.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80a9140 con 0x7feae80b1050 2021-11-15T14:40:26.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaee8bc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7feae80b1050 0x7feae81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaed8ba700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feae8148420 0x7feae80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47202/0 (socket says 172.21.2.135:47202) 2021-11-15T14:40:26.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaed8ba700 1 -- 172.21.2.135:0/3104069457 learned_addr learned my addr 172.21.2.135:0/3104069457 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:40:26.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaee8bc700 1 -- 172.21.2.135:0/3104069457 >> v1:172.21.2.135:6789/0 conn(0x7feae8148420 legacy=0x7feae80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaee8bc700 1 -- 172.21.2.135:0/3104069457 >> v1:172.21.2.119:6789/0 conn(0x7feae80b1e30 legacy=0x7feae80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:40:26.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaee8bc700 1 -- 172.21.2.135:0/3104069457 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80b0910 con 0x7feae80b1050 2021-11-15T14:40:26.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaee8bc700 1 --2- 172.21.2.135:0/3104069457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae81447a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7feae80acee0 tx=0x7feae00091d0).ready entity=mon.1 client_cookie=71dab0e3d1be4ff server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaed0b9700 1 -- 172.21.2.135:0/3104069457 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000b820 con 0x7feae80b1050 2021-11-15T14:40:26.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaed0b9700 1 -- 172.21.2.135:0/3104069457 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000b980 con 0x7feae80b1050 2021-11-15T14:40:26.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaed0b9700 1 -- 172.21.2.135:0/3104069457 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000baf0 con 0x7feae80b1050 2021-11-15T14:40:26.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- 172.21.2.135:0/3104069457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 msgr2=0x7feae81447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 --2- 172.21.2.135:0/3104069457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae81447a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7feae80acee0 tx=0x7feae00091d0).stop 2021-11-15T14:40:26.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- 172.21.2.135:0/3104069457 shutdown_connections 2021-11-15T14:40:26.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 --2- 172.21.2.135:0/3104069457 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae81447a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- 172.21.2.135:0/3104069457 >> 172.21.2.135:0/3104069457 conn(0x7feae805f730 msgr2=0x7feae805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:26.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- 172.21.2.135:0/3104069457 shutdown_connections 2021-11-15T14:40:26.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- 172.21.2.135:0/3104069457 wait complete. 2021-11-15T14:40:26.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 Processor -- start 2021-11-15T14:40:26.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.368+0000 7feaf031f700 1 -- start start 2021-11-15T14:40:26.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feae80b1e30 0x7feae8062880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feae8148420 0x7feae8066720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8063190 con 0x7feae80b1e30 2021-11-15T14:40:26.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80633c0 con 0x7feae80b1050 2021-11-15T14:40:26.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8157460 con 0x7feae8148420 2021-11-15T14:40:26.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59616/0 (socket says 172.21.2.135:59616) 2021-11-15T14:40:26.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 -- 172.21.2.135:0/3567048078 learned_addr learned my addr 172.21.2.135:0/3567048078 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:40:26.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 -- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feae8148420 msgr2=0x7feae8066720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:26.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feae8148420 0x7feae8066720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 -- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feae80b1e30 msgr2=0x7feae8062880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:40:26.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feae80b1e30 0x7feae8062880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 -- 172.21.2.135:0/3567048078 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0009470 con 0x7feae80b1050 2021-11-15T14:40:26.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaee0bb700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7feae8066000 tx=0x7feae4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae4013460 con 0x7feae80b1050 2021-11-15T14:40:26.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae40135c0 con 0x7feae80b1050 2021-11-15T14:40:26.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8157700 con 0x7feae80b1050 2021-11-15T14:40:26.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae4013920 con 0x7feae80b1050 2021-11-15T14:40:26.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80ac110 con 0x7feae80b1050 2021-11-15T14:40:26.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8157890 con 0x7feae80b1050 2021-11-15T14:40:26.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feae401a060 con 0x7feae80b1050 2021-11-15T14:40:26.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 0x7feac80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:40:26.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6416+0+0 (secure 0 0 0) 0x7feae406b460 con 0x7feae80b1050 2021-11-15T14:40:26.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaed8ba700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 0x7feac80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:40:26.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.372+0000 7feaed8ba700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 0x7feac80559b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7feae80b31f0 tx=0x7feadc0077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:40:26.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.376+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feae4042470 con 0x7feae80b1050 2021-11-15T14:40:26.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.480+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feae80b0bb0 con 0x7feae80b1050 2021-11-15T14:40:26.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.480+0000 7feadb7fe700 1 -- 172.21.2.135:0/3567048078 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7feae4018030 con 0x7feae80b1050 2021-11-15T14:40:26.486 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:40:26.487 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:40:26.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 msgr2=0x7feac80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 0x7feac80559b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7feae80b31f0 tx=0x7feadc0077f0).stop 2021-11-15T14:40:26.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 msgr2=0x7feae8063ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:40:26.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7feae8066000 tx=0x7feae4006df0).stop 2021-11-15T14:40:26.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 shutdown_connections 2021-11-15T14:40:26.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feac80534f0 0x7feac80559b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feae8148420 0x7feae8066720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feae80b1e30 0x7feae8062880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:40:26.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 --2- 172.21.2.135:0/3567048078 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feae80b1050 0x7feae8063ea0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:40:26.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 >> 172.21.2.135:0/3567048078 conn(0x7feae805f730 msgr2=0x7feae8143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:40:26.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 shutdown_connections 2021-11-15T14:40:26.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:40:26.484+0000 7feaf031f700 1 -- 172.21.2.135:0/3567048078 wait complete. 2021-11-15T14:40:26.491 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:40:26.494 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-11-15T14:40:26.552 INFO:teuthology.orchestra.run.gibba035.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-11-15T14:40:26.552 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-11-15T14:40:26.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:26.553 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:26.554 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:40:26.566 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:40:26.567 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:40:26.568 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:40:26.568 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:40:26.569 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:40:26.569 DEBUG:teuthology.orchestra.run.gibba038:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-11-15T14:40:26.570 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:40:26.570 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:40:26.570 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content2'"'"') 2021-11-15T14:40:26.571 DEBUG:teuthology.orchestra.run.gibba038:> while True: 2021-11-15T14:40:26.571 DEBUG:teuthology.orchestra.run.gibba038:> time.sleep(1) 2021-11-15T14:40:26.571 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:40:26.576 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T14:40:26.590 INFO:teuthology.orchestra.run.gibba038.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-11-15T14:40:26.591 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-15T14:40:27.592 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T14:40:27.604 INFO:teuthology.orchestra.run.gibba038.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-11-15T14:40:27.605 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-11-15T14:40:27.606 DEBUG:teuthology.orchestra.run.gibba032:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-11-15T14:40:27.653 INFO:teuthology.orchestra.run.gibba032.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-11-15T14:40:27.655 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-11-15T14:40:27.655 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:40:27.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:40:27.665 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:40:27.666 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:40:27.677 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:40:27.678 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:40:27.678 DEBUG:teuthology.orchestra.run.gibba032:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:40:27.679 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:40:27.679 DEBUG:teuthology.orchestra.run.gibba032:> import time 2021-11-15T14:40:27.679 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:40:27.680 DEBUG:teuthology.orchestra.run.gibba032:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-11-15T14:40:27.680 DEBUG:teuthology.orchestra.run.gibba032:> try: 2021-11-15T14:40:27.680 DEBUG:teuthology.orchestra.run.gibba032:> while True: 2021-11-15T14:40:27.681 DEBUG:teuthology.orchestra.run.gibba032:> os.write(fd, b'"'"'content'"'"') 2021-11-15T14:40:27.681 DEBUG:teuthology.orchestra.run.gibba032:> time.sleep(1) 2021-11-15T14:40:27.682 DEBUG:teuthology.orchestra.run.gibba032:> if not False: 2021-11-15T14:40:27.682 DEBUG:teuthology.orchestra.run.gibba032:> break 2021-11-15T14:40:27.682 DEBUG:teuthology.orchestra.run.gibba032:> except IOError as e: 2021-11-15T14:40:27.683 DEBUG:teuthology.orchestra.run.gibba032:> pass 2021-11-15T14:40:27.683 DEBUG:teuthology.orchestra.run.gibba032:> os.close(fd) 2021-11-15T14:40:27.684 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:40:42.370 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:42.374 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:42.378 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:40:42.381 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:05.044 INFO:tasks.cephfs.test_misc:cap_waiter waited 37.357728481292725s 2021-11-15T14:41:05.045 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-11-15T14:41:05.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.096+0000 7ff8f28b1700 1 Processor -- start 2021-11-15T14:41:05.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.096+0000 7ff8f28b1700 1 -- start start 2021-11-15T14:41:05.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.096+0000 7ff8f28b1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff8ec0b1e30 0x7ff8ec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.096+0000 7ff8f28b1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8ec148420 0x7ff8ec0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.096+0000 7ff8f28b1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec0a7140 0x7ff8ec1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec0a9140 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec0b03d0 con 0x7ff8ec148420 2021-11-15T14:41:05.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec0b0670 con 0x7ff8ec0a7140 2021-11-15T14:41:05.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8ec148420 0x7ff8ec0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff8ec148420 0x7ff8ec0b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59626/0 (socket says 172.21.2.135:59626) 2021-11-15T14:41:05.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/412968212 learned_addr learned my addr 172.21.2.135:0/412968212 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/412968212 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec0a7140 msgr2=0x7ff8ec1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/412968212 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec0a7140 0x7ff8ec1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/412968212 >> v2:172.21.2.119:3300/0 conn(0x7ff8ec0b1e30 msgr2=0x7ff8ec0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/412968212 >> v2:172.21.2.119:3300/0 conn(0x7ff8ec0b1e30 0x7ff8ec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/412968212 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0b0910 con 0x7ff8ec148420 2021-11-15T14:41:05.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/412968212 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec148420 0x7ff8ec0b2210 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff8ec1477b0 tx=0x7ff8e0006eb0).ready entity=mon.1 client_cookie=83fbd7cc063c17e5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eaffd700 1 -- 172.21.2.135:0/412968212 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e000d570 con 0x7ff8ec148420 2021-11-15T14:41:05.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eaffd700 1 -- 172.21.2.135:0/412968212 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0000e90 con 0x7ff8ec148420 2021-11-15T14:41:05.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eaffd700 1 -- 172.21.2.135:0/412968212 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e000d8c0 con 0x7ff8ec148420 2021-11-15T14:41:05.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/412968212 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec148420 msgr2=0x7ff8ec0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/412968212 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec148420 0x7ff8ec0b2210 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff8ec1477b0 tx=0x7ff8e0006eb0).stop 2021-11-15T14:41:05.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/412968212 shutdown_connections 2021-11-15T14:41:05.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/412968212 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec0a7140 0x7ff8ec1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/412968212 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec148420 0x7ff8ec0b2210 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/412968212 >> v2:172.21.2.119:3300/0 conn(0x7ff8ec0b1e30 0x7ff8ec0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/412968212 >> 172.21.2.135:0/412968212 conn(0x7ff8ec05f730 msgr2=0x7ff8ec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/412968212 shutdown_connections 2021-11-15T14:41:05.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/412968212 wait complete. 2021-11-15T14:41:05.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 Processor -- start 2021-11-15T14:41:05.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- start start 2021-11-15T14:41:05.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8ec0a7140 0x7ff8ec0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec148420 0x7ff8ec15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14a400 con 0x7ff8ec0a7140 2021-11-15T14:41:05.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14a6a0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14a940 con 0x7ff8ec148420 2021-11-15T14:41:05.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59632/0 (socket says 172.21.2.135:59632) 2021-11-15T14:41:05.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/276942646 learned_addr learned my addr 172.21.2.135:0/276942646 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec148420 msgr2=0x7ff8ec15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec148420 0x7ff8ec15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8ec0a7140 msgr2=0x7ff8ec0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8ec0a7140 0x7ff8ec0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 -- 172.21.2.135:0/276942646 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e000b1e0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8eb7fe700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff8ec1477b0 tx=0x7ff8e0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0006be0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000de40 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec14abe0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e001e460 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.100+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec0a9e80 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec14ad70 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8e0025030 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8e97fa700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 0x7ff8cc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7ff8e006ccb0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8ebfff700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 0x7ff8cc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8ebfff700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 0x7ff8cc055b60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7ff8dc002f70 tx=0x7ff8dc006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.104+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8e0043c90 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7ff8ec0b0bb0 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8e97fa700 1 -- 172.21.2.135:0/276942646 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v79) v1 ==== 98+0+80 (secure 0 0 0) 0x7ff8e0023020 con 0x7ff8ec0b1e30 2021-11-15T14:41:05.199 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:05.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 msgr2=0x7ff8cc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 0x7ff8cc055b60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7ff8dc002f70 tx=0x7ff8dc006a00).stop 2021-11-15T14:41:05.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 msgr2=0x7ff8ec15a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7ff8ec1477b0 tx=0x7ff8e0015000).stop 2021-11-15T14:41:05.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 shutdown_connections 2021-11-15T14:41:05.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff8cc0536a0 0x7ff8cc055b60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff8ec148420 0x7ff8ec15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8ec0b1e30 0x7ff8ec15a150 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 --2- 172.21.2.135:0/276942646 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8ec0a7140 0x7ff8ec0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 >> 172.21.2.135:0/276942646 conn(0x7ff8ec05f730 msgr2=0x7ff8ec146fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 shutdown_connections 2021-11-15T14:41:05.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.196+0000 7ff8f28b1700 1 -- 172.21.2.135:0/276942646 wait complete. 2021-11-15T14:41:05.203 INFO:teuthology.orchestra.run.gibba035.stderr:listed 1 entries 2021-11-15T14:41:05.206 INFO:teuthology.orchestra.run.gibba035.stdout:[{"addr":"172.21.2.138:0/1859864213","until":"2021-11-15T15:40:58.985252+0000"}] 2021-11-15T14:41:05.217 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-15T14:41:05.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:05.218 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:05.219 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:05.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:05.224 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-15T14:41:05.224 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:05.224 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:41:05.225 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:05.225 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:05.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:05.275 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:05.276 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:05.281 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:41:05.282 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:05.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:05.283 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:05.290 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:05.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 Processor -- start 2021-11-15T14:41:05.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 -- start start 2021-11-15T14:41:05.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8143df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc7f80a9fc0 0x7fc7f8140190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80b3900 con 0x7fc7f80b3520 2021-11-15T14:41:05.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f81442e0 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7ff0cd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8146a30 con 0x7fc7f80af800 2021-11-15T14:41:05.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc7f80a9fc0 0x7fc7f8140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc7f80a9fc0 0x7fc7f8140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59644/0 (socket says 172.21.2.135:59644) 2021-11-15T14:41:05.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 -- 172.21.2.135:0/2349063976 learned_addr learned my addr 172.21.2.135:0/2349063976 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fce69700 1 --1- 172.21.2.135:0/2349063976 >> v1:172.21.2.135:6789/0 conn(0x7fc7f80b3520 0x7fc7f80af0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47228/0 (socket says 172.21.2.135:47228) 2021-11-15T14:41:05.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 -- 172.21.2.135:0/2349063976 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 msgr2=0x7fc7f8143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 --2- 172.21.2.135:0/2349063976 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 -- 172.21.2.135:0/2349063976 >> v1:172.21.2.135:6789/0 conn(0x7fc7f80b3520 legacy=0x7fc7f80af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 -- 172.21.2.135:0/2349063976 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8146cd0 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7fd66a700 1 --2- 172.21.2.135:0/2349063976 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f8140190 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fc7f00032f0 tx=0x7fc7f0009290).ready entity=mon.1 client_cookie=4b6707b204b9a365 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7f77fe700 1 -- 172.21.2.135:0/2349063976 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f000b8a0 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7f77fe700 1 -- 172.21.2.135:0/2349063976 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000ba00 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.348+0000 7fc7f77fe700 1 -- 172.21.2.135:0/2349063976 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f000bb70 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/2349063976 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80a9fc0 msgr2=0x7fc7f8140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/2349063976 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f8140190 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fc7f00032f0 tx=0x7fc7f0009290).stop 2021-11-15T14:41:05.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/2349063976 shutdown_connections 2021-11-15T14:41:05.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/2349063976 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f8140190 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/2349063976 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/2349063976 >> 172.21.2.135:0/2349063976 conn(0x7fc7f8060840 msgr2=0x7fc7f8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/2349063976 shutdown_connections 2021-11-15T14:41:05.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/2349063976 wait complete. 2021-11-15T14:41:05.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 Processor -- start 2021-11-15T14:41:05.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- start start 2021-11-15T14:41:05.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80b2e80 con 0x7fc7f80a9fc0 2021-11-15T14:41:05.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81427a0 con 0x7fc7f80b3520 2021-11-15T14:41:05.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8142a40 con 0x7fc7f80af800 2021-11-15T14:41:05.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59646/0 (socket says 172.21.2.135:59646) 2021-11-15T14:41:05.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 -- 172.21.2.135:0/4146823472 learned_addr learned my addr 172.21.2.135:0/4146823472 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 -- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 msgr2=0x7fc7f8152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 -- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f80a9fc0 msgr2=0x7fc7f814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 -- 172.21.2.135:0/4146823472 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009530 con 0x7fc7f80b3520 2021-11-15T14:41:05.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7fd66a700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fc7f00032f0 tx=0x7fc7f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f000b8a0 con 0x7fc7f80b3520 2021-11-15T14:41:05.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f0020430 con 0x7fc7f80b3520 2021-11-15T14:41:05.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f0006b60 con 0x7fc7f80b3520 2021-11-15T14:41:05.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f81424e0 con 0x7fc7f80b3520 2021-11-15T14:41:05.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f80b2590 con 0x7fc7f80b3520 2021-11-15T14:41:05.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8142c00 con 0x7fc7f80b3520 2021-11-15T14:41:05.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc7f0026020 con 0x7fc7f80b3520 2021-11-15T14:41:05.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 0x7fc7dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.352+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fc7f006c930 con 0x7fc7f80b3520 2021-11-15T14:41:05.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.356+0000 7fc7fce69700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 0x7fc7dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.356+0000 7fc7fce69700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 0x7fc7dc055b00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc7f80aeb70 tx=0x7fc7e00077c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.356+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc7f0043800 con 0x7fc7f80b3520 2021-11-15T14:41:05.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7f8146f70 con 0x7fc7f80b3520 2021-11-15T14:41:05.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7f5ffb700 1 -- 172.21.2.135:0/4146823472 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16335 (secure 0 0 0) 0x7fc7f0015020 con 0x7fc7f80b3520 2021-11-15T14:41:05.444 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:05.444 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":79,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:40:59.881257+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:40:16.049940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-15T14:40:17.076402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.138:0/1859864213":"2021-11-15T15:40:58.985252+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 msgr2=0x7fc7dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 0x7fc7dc055b00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc7f80aeb70 tx=0x7fc7e00077c0).stop 2021-11-15T14:41:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 msgr2=0x7fc7f8152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fc7f00032f0 tx=0x7fc7f0016000).stop 2021-11-15T14:41:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 shutdown_connections 2021-11-15T14:41:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc7dc053640 0x7fc7dc055b00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc7f80b3520 0x7fc7f8152e10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc7f80af800 0x7fc7f8152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 --2- 172.21.2.135:0/4146823472 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc7f80a9fc0 0x7fc7f814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 >> 172.21.2.135:0/4146823472 conn(0x7fc7f8060840 msgr2=0x7fc7f813d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 shutdown_connections 2021-11-15T14:41:05.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.440+0000 7fc7ff0cd700 1 -- 172.21.2.135:0/4146823472 wait complete. 2021-11-15T14:41:05.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:40:16.049940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:40:17.076402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:41:05.452 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:05.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 Processor -- start 2021-11-15T14:41:05.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 -- start start 2021-11-15T14:41:05.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0ad00b1f40 0x7f0ad00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0ad00b2320 0x7f0ad01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad00b04a0 con 0x7f0ad00b0030 2021-11-15T14:41:05.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00a7850 con 0x7f0ad00b1f40 2021-11-15T14:41:05.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0ad4c86700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00b06d0 con 0x7f0ad00b2320 2021-11-15T14:41:05.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0aced9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0ad00b2320 0x7f0ad01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0acdd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0ad00b0030 0x7f0ad00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47244/0 (socket says 172.21.2.135:47244) 2021-11-15T14:41:05.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0acdd9b700 1 -- 172.21.2.135:0/1352182545 learned_addr learned my addr 172.21.2.135:0/1352182545 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:05.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0aced9d700 1 -- 172.21.2.135:0/1352182545 >> v2:172.21.2.119:3300/0 conn(0x7f0ad00b1f40 msgr2=0x7f0ad00b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:05.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0aced9d700 1 --2- 172.21.2.135:0/1352182545 >> v2:172.21.2.119:3300/0 conn(0x7f0ad00b1f40 0x7f0ad00b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0aced9d700 1 -- 172.21.2.135:0/1352182545 >> v1:172.21.2.135:6789/0 conn(0x7f0ad00b0030 legacy=0x7f0ad00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.500+0000 7f0aced9d700 1 -- 172.21.2.135:0/1352182545 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00b0970 con 0x7f0ad00b2320 2021-11-15T14:41:05.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0aced9d700 1 --2- 172.21.2.135:0/1352182545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b2320 0x7f0ad01412d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f0ac80032f0 tx=0x7f0ac80091d0).ready entity=mon.1 client_cookie=30d22b51a8ebef6f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acd59a700 1 -- 172.21.2.135:0/1352182545 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac8009ea0 con 0x7f0ad00b2320 2021-11-15T14:41:05.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acd59a700 1 -- 172.21.2.135:0/1352182545 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800b870 con 0x7f0ad00b2320 2021-11-15T14:41:05.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acd59a700 1 -- 172.21.2.135:0/1352182545 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac800ba20 con 0x7f0ad00b2320 2021-11-15T14:41:05.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/1352182545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b2320 msgr2=0x7f0ad01412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/1352182545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b2320 0x7f0ad01412d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f0ac80032f0 tx=0x7f0ac80091d0).stop 2021-11-15T14:41:05.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/1352182545 shutdown_connections 2021-11-15T14:41:05.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/1352182545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b2320 0x7f0ad01412d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/1352182545 >> v2:172.21.2.119:3300/0 conn(0x7f0ad00b1f40 0x7f0ad00b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/1352182545 >> 172.21.2.135:0/1352182545 conn(0x7f0ad005f730 msgr2=0x7f0ad005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/1352182545 shutdown_connections 2021-11-15T14:41:05.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/1352182545 wait complete. 2021-11-15T14:41:05.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 Processor -- start 2021-11-15T14:41:05.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- start start 2021-11-15T14:41:05.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ad00b0030 0x7f0ad0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ad00b2320 0x7f0ad015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad015a4c0 con 0x7f0ad00b0030 2021-11-15T14:41:05.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0144770 con 0x7f0ad00b1f40 2021-11-15T14:41:05.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad00aa2a0 con 0x7f0ad00b2320 2021-11-15T14:41:05.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59660/0 (socket says 172.21.2.135:59660) 2021-11-15T14:41:05.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 -- 172.21.2.135:0/102205380 learned_addr learned my addr 172.21.2.135:0/102205380 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 -- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ad00b2320 msgr2=0x7f0ad015ab50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:05.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ad00b2320 0x7f0ad015ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 -- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ad00b0030 msgr2=0x7f0ad0156f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:05.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ad00b0030 0x7f0ad0156f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 -- 172.21.2.135:0/102205380 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8009470 con 0x7f0ad00b1f40 2021-11-15T14:41:05.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0acdd9b700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f0ad00ad350 tx=0x7f0ab8007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab800ce30 con 0x7f0ad00b1f40 2021-11-15T14:41:05.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab80072e0 con 0x7f0ad00b1f40 2021-11-15T14:41:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0142750 con 0x7f0ad00b1f40 2021-11-15T14:41:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab8005800 con 0x7f0ad00b1f40 2021-11-15T14:41:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad00ae720 con 0x7f0ad00b1f40 2021-11-15T14:41:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0142590 con 0x7f0ad00b1f40 2021-11-15T14:41:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ab8010070 con 0x7f0ad00b1f40 2021-11-15T14:41:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 0x7f0ab4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.504+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f0ab806b160 con 0x7f0ad00b1f40 2021-11-15T14:41:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.508+0000 7f0ace59c700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 0x7f0ab4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.508+0000 7f0ace59c700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 0x7f0ab4055ad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0ac0002fb0 tx=0x7f0ac0006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.508+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ab8042140 con 0x7f0ad00b1f40 2021-11-15T14:41:05.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0ad01428e0 con 0x7f0ad00b1f40 2021-11-15T14:41:05.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ac77fe700 1 -- 172.21.2.135:0/102205380 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ab8045760 con 0x7f0ad00b1f40 2021-11-15T14:41:05.596 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:05.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 msgr2=0x7f0ab4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 0x7f0ab4055ad0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0ac0002fb0 tx=0x7f0ac0006930).stop 2021-11-15T14:41:05.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 msgr2=0x7f0ad00b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f0ad00ad350 tx=0x7f0ab8007c40).stop 2021-11-15T14:41:05.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 shutdown_connections 2021-11-15T14:41:05.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ab4053610 0x7f0ab4055ad0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ad00b2320 0x7f0ad015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ad00b1f40 0x7f0ad00b4d50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 --2- 172.21.2.135:0/102205380 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ad00b0030 0x7f0ad0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 >> 172.21.2.135:0/102205380 conn(0x7f0ad005f730 msgr2=0x7f0ad00a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 shutdown_connections 2021-11-15T14:41:05.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.592+0000 7f0ad4c86700 1 -- 172.21.2.135:0/102205380 wait complete. 2021-11-15T14:41:05.603 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:05.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 Processor -- start 2021-11-15T14:41:05.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- start start 2021-11-15T14:41:05.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f797c0adfa0 0x7f797c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0af500 0x7f797c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0b1850 con 0x7f797c0b1470 2021-11-15T14:41:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c14be00 con 0x7f797c0adfa0 2021-11-15T14:41:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b3370 con 0x7f797c0af500 2021-11-15T14:41:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f797c0adfa0 0x7f797c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f797c0adfa0 0x7f797c0b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59668/0 (socket says 172.21.2.135:59668) 2021-11-15T14:41:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 -- 172.21.2.135:0/4149328193 learned_addr learned my addr 172.21.2.135:0/4149328193 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 -- 172.21.2.135:0/4149328193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0af500 msgr2=0x7f797c0af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 --2- 172.21.2.135:0/4149328193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0af500 0x7f797c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 -- 172.21.2.135:0/4149328193 >> v1:172.21.2.119:6789/0 conn(0x7f797c0b1470 legacy=0x7f797c14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 -- 172.21.2.135:0/4149328193 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0b3610 con 0x7f797c0adfa0 2021-11-15T14:41:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7979d9b700 1 --2- 172.21.2.135:0/4149328193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0adfa0 0x7f797c0b28a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f797c05cf10 tx=0x7f796c006eb0).ready entity=mon.1 client_cookie=4a9282bb87410fca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f797959a700 1 -- 172.21.2.135:0/4149328193 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f796c00d570 con 0x7f797c0adfa0 2021-11-15T14:41:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f797959a700 1 -- 172.21.2.135:0/4149328193 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c000e90 con 0x7f797c0adfa0 2021-11-15T14:41:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f797959a700 1 -- 172.21.2.135:0/4149328193 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f796c00d8c0 con 0x7f797c0adfa0 2021-11-15T14:41:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- 172.21.2.135:0/4149328193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0adfa0 msgr2=0x7f797c0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- 172.21.2.135:0/4149328193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0adfa0 0x7f797c0b28a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f797c05cf10 tx=0x7f796c006eb0).stop 2021-11-15T14:41:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- 172.21.2.135:0/4149328193 shutdown_connections 2021-11-15T14:41:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- 172.21.2.135:0/4149328193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0af500 0x7f797c0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- 172.21.2.135:0/4149328193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0adfa0 0x7f797c0b28a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- 172.21.2.135:0/4149328193 >> 172.21.2.135:0/4149328193 conn(0x7f797c060840 msgr2=0x7f797c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- 172.21.2.135:0/4149328193 shutdown_connections 2021-11-15T14:41:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- 172.21.2.135:0/4149328193 wait complete. 2021-11-15T14:41:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 Processor -- start 2021-11-15T14:41:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- start start 2021-11-15T14:41:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0adfa0 0x7f797c0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f797c0b1470 0x7f797c066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0a0560 con 0x7f797c0b1470 2021-11-15T14:41:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0a0800 con 0x7f797c0af500 2021-11-15T14:41:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.652+0000 7f7980938700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0a0aa0 con 0x7f797c0adfa0 2021-11-15T14:41:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59674/0 (socket says 172.21.2.135:59674) 2021-11-15T14:41:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 -- 172.21.2.135:0/1831892617 learned_addr learned my addr 172.21.2.135:0/1831892617 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 -- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0adfa0 msgr2=0x7f797c0b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0adfa0 0x7f797c0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 -- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f797c0b1470 msgr2=0x7f797c066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f797c0b1470 0x7f797c066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 -- 172.21.2.135:0/1831892617 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c00b1e0 con 0x7f797c0af500 2021-11-15T14:41:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7979d9b700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f797c05cf10 tx=0x7f796c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f796c006be0 con 0x7f797c0af500 2021-11-15T14:41:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c002f70 con 0x7f797c0af500 2021-11-15T14:41:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f796c00de60 con 0x7f797c0af500 2021-11-15T14:41:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0a0d40 con 0x7f797c0af500 2021-11-15T14:41:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c065b90 con 0x7f797c0af500 2021-11-15T14:41:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0a0ed0 con 0x7f797c0af500 2021-11-15T14:41:05.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f796c01a040 con 0x7f797c0af500 2021-11-15T14:41:05.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 0x7f7960055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f796c06ca90 con 0x7f797c0af500 2021-11-15T14:41:05.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f797a59c700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 0x7f7960055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.656+0000 7f797a59c700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 0x7f7960055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f7964002ef0 tx=0x7f7964006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.660+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f796c043a70 con 0x7f797c0af500 2021-11-15T14:41:05.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f797c0b38b0 con 0x7f797c0af500 2021-11-15T14:41:05.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f79737fe700 1 -- 172.21.2.135:0/1831892617 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f796c023020 con 0x7f797c0af500 2021-11-15T14:41:05.745 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 msgr2=0x7f7960055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 0x7f7960055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f7964002ef0 tx=0x7f7964006910).stop 2021-11-15T14:41:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 msgr2=0x7f797c065ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f797c05cf10 tx=0x7f796c015000).stop 2021-11-15T14:41:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 shutdown_connections 2021-11-15T14:41:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f79600536a0 0x7f7960055b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f797c0b1470 0x7f797c066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f797c0af500 0x7f797c065ef0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 --2- 172.21.2.135:0/1831892617 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f797c0adfa0 0x7f797c0b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 >> 172.21.2.135:0/1831892617 conn(0x7f797c060840 msgr2=0x7f797c0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 shutdown_connections 2021-11-15T14:41:05.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.740+0000 7f7980938700 1 -- 172.21.2.135:0/1831892617 wait complete. 2021-11-15T14:41:05.752 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:41:05.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 Processor -- start 2021-11-15T14:41:05.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 -- start start 2021-11-15T14:41:05.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7f800654a0 0x7f7f801444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7f800b3950 0x7f7f801449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f800b2430 con 0x7f7f80060040 2021-11-15T14:41:05.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f800b26d0 con 0x7f7f800b3950 2021-11-15T14:41:05.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f800b2970 con 0x7f7f800654a0 2021-11-15T14:41:05.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7f800654a0 0x7f7f801444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7f800654a0 0x7f7f801444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59682/0 (socket says 172.21.2.135:59682) 2021-11-15T14:41:05.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 -- 172.21.2.135:0/2163052228 learned_addr learned my addr 172.21.2.135:0/2163052228 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 -- 172.21.2.135:0/2163052228 >> v2:172.21.2.119:3300/0 conn(0x7f7f800b3950 msgr2=0x7f7f801449b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:05.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 --2- 172.21.2.135:0/2163052228 >> v2:172.21.2.119:3300/0 conn(0x7f7f800b3950 0x7f7f801449b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 -- 172.21.2.135:0/2163052228 >> v1:172.21.2.119:6789/0 conn(0x7f7f80060040 legacy=0x7f7f80064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:05.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 -- 172.21.2.135:0/2163052228 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800648f0 con 0x7f7f800654a0 2021-11-15T14:41:05.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f84f2a700 1 --2- 172.21.2.135:0/2163052228 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f800654a0 0x7f7f801444c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f7f8013b870 tx=0x7f7f74006eb0).ready entity=mon.1 client_cookie=ba75441567bf7b2a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f73fff700 1 -- 172.21.2.135:0/2163052228 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7400d5c0 con 0x7f7f800654a0 2021-11-15T14:41:05.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f73fff700 1 -- 172.21.2.135:0/2163052228 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74000e90 con 0x7f7f800654a0 2021-11-15T14:41:05.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f73fff700 1 -- 172.21.2.135:0/2163052228 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7400d910 con 0x7f7f800654a0 2021-11-15T14:41:05.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 -- 172.21.2.135:0/2163052228 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f800654a0 msgr2=0x7f7f801444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.800+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2163052228 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f800654a0 0x7f7f801444c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f7f8013b870 tx=0x7f7f74006eb0).stop 2021-11-15T14:41:05.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2163052228 shutdown_connections 2021-11-15T14:41:05.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2163052228 >> v2:172.21.2.119:3300/0 conn(0x7f7f800b3950 0x7f7f801449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2163052228 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f800654a0 0x7f7f801444c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2163052228 >> 172.21.2.135:0/2163052228 conn(0x7f7f8005cfe0 msgr2=0x7f7f8005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2163052228 shutdown_connections 2021-11-15T14:41:05.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2163052228 wait complete. 2021-11-15T14:41:05.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 Processor -- start 2021-11-15T14:41:05.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- start start 2021-11-15T14:41:05.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f800654a0 0x7f7f800ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f800b3950 0x7f7f800b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8013e350 con 0x7f7f800654a0 2021-11-15T14:41:05.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8013e5f0 con 0x7f7f80060040 2021-11-15T14:41:05.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8013e890 con 0x7f7f800b3950 2021-11-15T14:41:05.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59684/0 (socket says 172.21.2.135:59684) 2021-11-15T14:41:05.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 -- 172.21.2.135:0/2472642370 learned_addr learned my addr 172.21.2.135:0/2472642370 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 -- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f800b3950 msgr2=0x7f7f800b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f800b3950 0x7f7f800b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 -- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f800654a0 msgr2=0x7f7f800ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f800654a0 0x7f7f800ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 -- 172.21.2.135:0/2472642370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7400b1e0 con 0x7f7f80060040 2021-11-15T14:41:05.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8572b700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7f7c002fb0 tx=0x7f7f7c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7c013460 con 0x7f7f80060040 2021-11-15T14:41:05.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c0135c0 con 0x7f7f80060040 2021-11-15T14:41:05.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7c013920 con 0x7f7f80060040 2021-11-15T14:41:05.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8013eb30 con 0x7f7f80060040 2021-11-15T14:41:05.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f800afb70 con 0x7f7f80060040 2021-11-15T14:41:05.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8013ecc0 con 0x7f7f80060040 2021-11-15T14:41:05.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f7c00f070 con 0x7f7f80060040 2021-11-15T14:41:05.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 0x7f7f600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f7f7c06b350 con 0x7f7f80060040 2021-11-15T14:41:05.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.804+0000 7f7f84f2a700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 0x7f7f600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.808+0000 7f7f84f2a700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 0x7f7f600559b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7f8013b870 tx=0x7f7f74015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.808+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f7c042220 con 0x7f7f80060040 2021-11-15T14:41:05.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f800674f0 con 0x7f7f80060040 2021-11-15T14:41:05.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f727fc700 1 -- 172.21.2.135:0/2472642370 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7f7c018070 con 0x7f7f80060040 2021-11-15T14:41:05.896 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:05.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 msgr2=0x7f7f600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 0x7f7f600559b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7f8013b870 tx=0x7f7f74015000).stop 2021-11-15T14:41:05.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 msgr2=0x7f7f8013ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7f7c002fb0 tx=0x7f7f7c006df0).stop 2021-11-15T14:41:05.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 shutdown_connections 2021-11-15T14:41:05.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7f600534f0 0x7f7f600559b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7f800b3950 0x7f7f800b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7f800654a0 0x7f7f800ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 --2- 172.21.2.135:0/2472642370 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7f80060040 0x7f7f8013ca30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 >> 172.21.2.135:0/2472642370 conn(0x7f7f8005cfe0 msgr2=0x7f7f801397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 shutdown_connections 2021-11-15T14:41:05.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.892+0000 7f7f8798f700 1 -- 172.21.2.135:0/2472642370 wait complete. 2021-11-15T14:41:05.903 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:41:05.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 Processor -- start 2021-11-15T14:41:05.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 -- start start 2021-11-15T14:41:05.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2c140b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2c140b2320 0x7f2c141412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140a7850 con 0x7f2c140b0030 2021-11-15T14:41:05.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c140b0470 con 0x7f2c140b2320 2021-11-15T14:41:05.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c19efa700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b06d0 con 0x7f2c140b1f40 2021-11-15T14:41:05.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c12ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2c140b0030 0x7f2c140a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47284/0 (socket says 172.21.2.135:47284) 2021-11-15T14:41:05.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c12ffd700 1 -- 172.21.2.135:0/4017149136 learned_addr learned my addr 172.21.2.135:0/4017149136 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:05.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910224560 0 0) 0x7f2c140a7850 con 0x7f2c140b0030 2021-11-15T14:41:05.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf4003260 con 0x7f2c140b0030 2021-11-15T14:41:05.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c13fff700 1 --2- 172.21.2.135:0/4017149136 >> v2:172.21.2.119:3300/0 conn(0x7f2c140b2320 0x7f2c141412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2c140b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316789273 0 0) 0x7f2bf4003260 con 0x7f2c140b0030 2021-11-15T14:41:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 msgr2=0x7f2c140b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2c140b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 >> v2:172.21.2.119:3300/0 conn(0x7f2c140b2320 msgr2=0x7f2c141412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 --2- 172.21.2.135:0/4017149136 >> v2:172.21.2.119:3300/0 conn(0x7f2c140b2320 0x7f2c141412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140b0970 con 0x7f2c140b0030 2021-11-15T14:41:05.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2c04001660 con 0x7f2c140b0030 2021-11-15T14:41:05.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 >> v1:172.21.2.135:6789/0 conn(0x7f2c140b0030 legacy=0x7f2c140a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bf40037d0 0x7f2bf4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2bf4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bf40049f0 0x7f2bf4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b0470 con 0x7f2bf40049f0 2021-11-15T14:41:05.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b06d0 con 0x7f2bf40037d0 2021-11-15T14:41:05.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf400b750 con 0x7f2c140b1f40 2021-11-15T14:41:05.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.952+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bf40037d0 0x7f2bf4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c12ffd700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2bf4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 -- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 msgr2=0x7f2bf4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2bf4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 -- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bf40049f0 msgr2=0x7f2bf4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:05.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bf40049f0 0x7f2bf4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:05.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 -- 172.21.2.135:0/4017149136 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4003260 con 0x7f2bf40037d0 2021-11-15T14:41:05.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c12ffd700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c140b1f40 0x7f2bf4004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:05.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bf40037d0 0x7f2bf4003bf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f2bfc00c000 tx=0x7f2bfc006df0).ready entity=mon.1 client_cookie=ee87a67e5d6ca2e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bfc00e830 con 0x7f2bf40037d0 2021-11-15T14:41:05.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00e990 con 0x7f2bf40037d0 2021-11-15T14:41:05.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c127fc700 1 -- 172.21.2.135:0/4017149136 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bfc00ecf0 con 0x7f2bf40037d0 2021-11-15T14:41:05.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4017149136 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bf40037d0 msgr2=0x7f2bf4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4017149136 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bf40037d0 0x7f2bf4003bf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f2bfc00c000 tx=0x7f2bfc006df0).stop 2021-11-15T14:41:05.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 -- 172.21.2.135:0/4017149136 reap_dead start 2021-11-15T14:41:05.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4017149136 shutdown_connections 2021-11-15T14:41:05.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4017149136 >> 172.21.2.135:0/4017149136 conn(0x7f2c1405f730 msgr2=0x7f2c1405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:05.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4017149136 shutdown_connections 2021-11-15T14:41:05.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4017149136 wait complete. 2021-11-15T14:41:05.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 Processor -- start 2021-11-15T14:41:05.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- start start 2021-11-15T14:41:05.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 0x7f2c140b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 0x7f2c140b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b5580 con 0x7f2c1414a650 2021-11-15T14:41:05.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b5b30 con 0x7f2c1413dda0 2021-11-15T14:41:05.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b5dd0 con 0x7f2bf40037d0 2021-11-15T14:41:05.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59708/0 (socket says 172.21.2.135:59708) 2021-11-15T14:41:05.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 -- 172.21.2.135:0/4130775205 learned_addr learned my addr 172.21.2.135:0/4130775205 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:05.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 0x7f2c140b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c12ffd700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 0x7f2c140b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 -- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 msgr2=0x7f2c140b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 0x7f2c140b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 -- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 msgr2=0x7f2c140b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:05.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 0x7f2c140b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:05.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 -- 172.21.2.135:0/4130775205 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140b52c0 con 0x7f2c1413dda0 2021-11-15T14:41:05.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 0x7f2c140b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:05.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c12ffd700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 0x7f2c140b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:05.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c13fff700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f2c0c001210 tx=0x7f2c0c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c0c0127f0 con 0x7f2c1413dda0 2021-11-15T14:41:05.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c140b5820 con 0x7f2c1413dda0 2021-11-15T14:41:05.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c012950 con 0x7f2c1413dda0 2021-11-15T14:41:05.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c0c012cb0 con 0x7f2c1413dda0 2021-11-15T14:41:05.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1414b120 con 0x7f2c1413dda0 2021-11-15T14:41:05.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c140b5f90 con 0x7f2c1413dda0 2021-11-15T14:41:05.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c0c01a3b0 con 0x7f2c1413dda0 2021-11-15T14:41:05.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 0x7f2bf8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:05.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.956+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f2c0c06bab0 con 0x7f2c1413dda0 2021-11-15T14:41:05.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.960+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 0x7f2bf8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:05.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.960+0000 7f2c137fe700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 0x7f2bf8055bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2bfc01a000 tx=0x7f2bfc019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:05.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:05.960+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c0c042a30 con 0x7f2c1413dda0 2021-11-15T14:41:06.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c140b0c10 con 0x7f2c1413dda0 2021-11-15T14:41:06.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c10ff9700 1 -- 172.21.2.135:0/4130775205 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2c0c0160a0 con 0x7f2c1413dda0 2021-11-15T14:41:06.048 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:06.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 msgr2=0x7f2bf8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 0x7f2bf8055bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2bfc01a000 tx=0x7f2bfc019000).stop 2021-11-15T14:41:06.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 msgr2=0x7f2c1414ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f2c0c001210 tx=0x7f2c0c0091d0).stop 2021-11-15T14:41:06.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 shutdown_connections 2021-11-15T14:41:06.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bf80536f0 0x7f2bf8055bb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c1413dda0 0x7f2c1414ac30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c1414a650 0x7f2c140b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 --2- 172.21.2.135:0/4130775205 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bf40037d0 0x7f2c140b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 >> 172.21.2.135:0/4130775205 conn(0x7f2c1405f730 msgr2=0x7f2c141464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:06.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 shutdown_connections 2021-11-15T14:41:06.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.044+0000 7f2c19efa700 1 -- 172.21.2.135:0/4130775205 wait complete. 2021-11-15T14:41:06.055 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:41:06.056 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:06.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 Processor -- start 2021-11-15T14:41:06.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- start start 2021-11-15T14:41:06.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc18c0b35d0 0x7fc18c067190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c144d60 0x7fc18c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c066580 con 0x7fc18c064a00 2021-11-15T14:41:06.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0b3f20 con 0x7fc18c0b35d0 2021-11-15T14:41:06.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c140dc0 con 0x7fc18c144d60 2021-11-15T14:41:06.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc18c0b35d0 0x7fc18c067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:06.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc18c0b35d0 0x7fc18c067190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59716/0 (socket says 172.21.2.135:59716) 2021-11-15T14:41:06.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 -- 172.21.2.135:0/3635616974 learned_addr learned my addr 172.21.2.135:0/3635616974 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:06.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --1- 172.21.2.135:0/3635616974 >> v1:172.21.2.135:6789/0 conn(0x7fc18c064a00 0x7fc18c066a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47300/0 (socket says 172.21.2.135:47300) 2021-11-15T14:41:06.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 -- 172.21.2.135:0/3635616974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c144d60 msgr2=0x7fc18c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:06.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 --2- 172.21.2.135:0/3635616974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c144d60 0x7fc18c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 -- 172.21.2.135:0/3635616974 >> v1:172.21.2.135:6789/0 conn(0x7fc18c064a00 legacy=0x7fc18c066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 -- 172.21.2.135:0/3635616974 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0b4740 con 0x7fc18c0b35d0 2021-11-15T14:41:06.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc190b30700 1 --2- 172.21.2.135:0/3635616974 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c0b35d0 0x7fc18c067190 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fc188001110 tx=0x7fc17c006eb0).ready entity=mon.1 client_cookie=21c35d34bb2b749b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:06.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc17bfff700 1 -- 172.21.2.135:0/3635616974 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c00d570 con 0x7fc18c0b35d0 2021-11-15T14:41:06.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc17bfff700 1 -- 172.21.2.135:0/3635616974 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c000e90 con 0x7fc18c0b35d0 2021-11-15T14:41:06.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc17bfff700 1 -- 172.21.2.135:0/3635616974 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c00d900 con 0x7fc18c0b35d0 2021-11-15T14:41:06.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- 172.21.2.135:0/3635616974 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c0b35d0 msgr2=0x7fc18c067190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- 172.21.2.135:0/3635616974 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c0b35d0 0x7fc18c067190 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fc188001110 tx=0x7fc17c006eb0).stop 2021-11-15T14:41:06.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- 172.21.2.135:0/3635616974 shutdown_connections 2021-11-15T14:41:06.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- 172.21.2.135:0/3635616974 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c0b35d0 0x7fc18c067190 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- 172.21.2.135:0/3635616974 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c144d60 0x7fc18c1411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- 172.21.2.135:0/3635616974 >> 172.21.2.135:0/3635616974 conn(0x7fc18c05f730 msgr2=0x7fc18c05fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:06.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- 172.21.2.135:0/3635616974 shutdown_connections 2021-11-15T14:41:06.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- 172.21.2.135:0/3635616974 wait complete. 2021-11-15T14:41:06.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 Processor -- start 2021-11-15T14:41:06.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- start start 2021-11-15T14:41:06.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c0b35d0 0x7fc18c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc18c144d60 0x7fc18c13a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c13ce60 con 0x7fc18c144d60 2021-11-15T14:41:06.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0b0f50 con 0x7fc18c064a00 2021-11-15T14:41:06.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc192333700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c13caa0 con 0x7fc18c0b35d0 2021-11-15T14:41:06.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:06.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59720/0 (socket says 172.21.2.135:59720) 2021-11-15T14:41:06.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 -- 172.21.2.135:0/1991397214 learned_addr learned my addr 172.21.2.135:0/1991397214 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:06.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 -- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c0b35d0 msgr2=0x7fc18c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c0b35d0 0x7fc18c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 -- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc18c144d60 msgr2=0x7fc18c13a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc18c144d60 0x7fc18c13a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 -- 172.21.2.135:0/1991397214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c00b1e0 con 0x7fc18c064a00 2021-11-15T14:41:06.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc191331700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fc18c13e280 tx=0x7fc188007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:06.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.104+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc188007170 con 0x7fc18c064a00 2021-11-15T14:41:06.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1880072d0 con 0x7fc18c064a00 2021-11-15T14:41:06.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc188004920 con 0x7fc18c064a00 2021-11-15T14:41:06.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c13dfb0 con 0x7fc18c064a00 2021-11-15T14:41:06.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c0af530 con 0x7fc18c064a00 2021-11-15T14:41:06.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c13e540 con 0x7fc18c064a00 2021-11-15T14:41:06.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc188004a80 con 0x7fc18c064a00 2021-11-15T14:41:06.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 0x7fc16c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:06.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fc18806b550 con 0x7fc18c064a00 2021-11-15T14:41:06.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc190b30700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 0x7fc16c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:06.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc190b30700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 0x7fc16c055ad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc188001110 tx=0x7fc17c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:06.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.108+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc188042530 con 0x7fc18c064a00 2021-11-15T14:41:06.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc18c0573d0 con 0x7fc18c064a00 2021-11-15T14:41:06.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc17a7fc700 1 -- 172.21.2.135:0/1991397214 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fc188045b50 con 0x7fc18c064a00 2021-11-15T14:41:06.223 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:06.224 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:41:06.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 msgr2=0x7fc16c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 0x7fc16c055ad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc188001110 tx=0x7fc17c015000).stop 2021-11-15T14:41:06.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 msgr2=0x7fc18c1443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:06.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fc18c13e280 tx=0x7fc188007bd0).stop 2021-11-15T14:41:06.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 shutdown_connections 2021-11-15T14:41:06.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc16c053610 0x7fc16c055ad0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc18c144d60 0x7fc18c13a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc18c0b35d0 0x7fc18c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:06.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 --2- 172.21.2.135:0/1991397214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc18c064a00 0x7fc18c1443c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:06.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 >> 172.21.2.135:0/1991397214 conn(0x7fc18c05f730 msgr2=0x7fc18c0b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:06.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 shutdown_connections 2021-11-15T14:41:06.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:06.220+0000 7fc192333700 1 -- 172.21.2.135:0/1991397214 wait complete. 2021-11-15T14:41:06.228 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:41:06.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:40:18.108204+0000', 'modified': '2021-11-15T14:40:19.112767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6208': {'gid': 6208, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6834/1605423856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6832', 'nonce': 1605423856}, {'type': 'v1', 'addr': '172.21.2.135:6834', 'nonce': 1605423856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:06.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:06.534 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-15T14:41:06.598 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6208,"want_state":"up:active","state":"up:active","rank_uptime":48.479550068000002,"mdsmap_epoch":38,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":52.613752191000003} 2021-11-15T14:41:06.599 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6208, "mdsmap_epoch": 38, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 48.479550068, "state": "up:active", "uptime": 52.613752191, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:06.599 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:41:06.600 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:41:06.600 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:41:06.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:06.601 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:06.612 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:06.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:06.623 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:06.629 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:06.630 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:06.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:06.631 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:06.635 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:41:06.635 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:06.679 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:06.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:06.690 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:06.695 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:06.696 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:06.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:06.697 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:06.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14672]: starting ceph client 2021-11-15T14:41:06.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:41:06.722+0000 7f9ac6b15080 -1 init, newargv = 0x55fd671e30e0 newargc=9 2021-11-15T14:41:06.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14672]: starting fuse 2021-11-15T14:41:07.801 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:07.813 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:07.814 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:07.864 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:07.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:07.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:07.867 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:07.872 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:41:07.872 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:41:07.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:07.873 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:41:07.873 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:41:07.874 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:41:07.874 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:41:07.874 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:41:07.875 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:07.875 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:41:07.875 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:41:07.876 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:41:07.876 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:07.877 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:41:07.877 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:41:07.877 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:41:07.878 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:41:07.878 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:07.879 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:41:07.879 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:41:07.879 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:41:07.880 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:41:07.880 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:41:07.880 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:07.881 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:41:07.881 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:41:07.948 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14672.asok 2021-11-15T14:41:07.950 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14672.asok 2021-11-15T14:41:07.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:07.951 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14672.asok status 2021-11-15T14:41:07.998 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:41:07.999 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:41:07.999 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:41:07.999 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:41:07.999 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:41:08.000 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:41:08.000 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:41:08.000 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14672", 2021-11-15T14:41:08.000 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:41:08.001 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:08.001 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:41:08.001 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:41:08.001 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4679, 2021-11-15T14:41:08.001 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:41:08.002 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:41:08.002 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:41:08.002 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4679 2021-11-15T14:41:08.002 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:08.003 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:08.003 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:08.003 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:08.003 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3485947330 2021-11-15T14:41:08.004 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:41:08.004 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:08.004 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:08.004 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:08.005 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:08.005 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3485947330 2021-11-15T14:41:08.005 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:08.005 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4679 172.21.2.138:0/3485947330", 2021-11-15T14:41:08.006 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/3485947330", 2021-11-15T14:41:08.006 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:41:08.006 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 38, 2021-11-15T14:41:08.006 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 79, 2021-11-15T14:41:08.007 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:41:08.007 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:41:08.007 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:41:08.007 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:41:08.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.009 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:08.009 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.015 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:08.015 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:08.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.016 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.027 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:08.027 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:08.056 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:08.070 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:08.084 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:08.096 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:08.096 INFO:tasks.cephfs.mount:Terminating background process 2021-11-15T14:41:08.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.097 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:08.098 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.104 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:08.105 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:08.105 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:41:08.106 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:08.106 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14672]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:08.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.120 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:08.120 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.170 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:41:08.172 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:08.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:08.294 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:08.303 INFO:tasks.cephfs.mount:Terminating background process 2021-11-15T14:41:08.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.304 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:08.305 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:08.316 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:41:08.317 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:08.318 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:41:08.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:08.319 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:08.372 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14187]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:08.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:08.374 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:08.374 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:08.378 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:41:08.379 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:08.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:08.493 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:08.539 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:08.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.588+0000 7f9b75c30700 1 Processor -- start 2021-11-15T14:41:08.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.588+0000 7f9b75c30700 1 -- start start 2021-11-15T14:41:08.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 0x7f9b700abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b70143540 con 0x7f9b70139b60 2021-11-15T14:41:08.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b700b3090 con 0x7f9b700b29e0 2021-11-15T14:41:08.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700af3a0 con 0x7f9b700b1cd0 2021-11-15T14:41:08.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6ffff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 0x7f9b700abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41270/0 (socket says 172.21.2.135:41270) 2021-11-15T14:41:08.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 -- 172.21.2.135:0/2400760688 learned_addr learned my addr 172.21.2.135:0/2400760688 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:08.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 -- 172.21.2.135:0/2400760688 >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 msgr2=0x7f9b700abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:08.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 --2- 172.21.2.135:0/2400760688 >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 0x7f9b700abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 -- 172.21.2.135:0/2400760688 >> v1:172.21.2.119:6789/0 conn(0x7f9b70139b60 legacy=0x7f9b70142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 -- 172.21.2.135:0/2400760688 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700ac4f0 con 0x7f9b700b1cd0 2021-11-15T14:41:08.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6ffff700 1 --2- 172.21.2.135:0/2400760688 >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 0x7f9b700abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:41:08.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6effd700 1 --2- 172.21.2.135:0/2400760688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9b58002f70 tx=0x7f9b58006f40).ready entity=mon.2 client_cookie=b4249673cb939f81 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:08.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6e7fc700 1 -- 172.21.2.135:0/2400760688 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5800da80 con 0x7f9b700b1cd0 2021-11-15T14:41:08.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6e7fc700 1 -- 172.21.2.135:0/2400760688 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b58000e90 con 0x7f9b700b1cd0 2021-11-15T14:41:08.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b6e7fc700 1 -- 172.21.2.135:0/2400760688 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5800ddd0 con 0x7f9b700b1cd0 2021-11-15T14:41:08.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- 172.21.2.135:0/2400760688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 msgr2=0x7f9b700ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 --2- 172.21.2.135:0/2400760688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9b58002f70 tx=0x7f9b58006f40).stop 2021-11-15T14:41:08.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- 172.21.2.135:0/2400760688 shutdown_connections 2021-11-15T14:41:08.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 --2- 172.21.2.135:0/2400760688 >> v2:172.21.2.119:3300/0 conn(0x7f9b700b29e0 0x7f9b700abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 --2- 172.21.2.135:0/2400760688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b700ab5b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- 172.21.2.135:0/2400760688 >> 172.21.2.135:0/2400760688 conn(0x7f9b7005f730 msgr2=0x7f9b7005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:08.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- 172.21.2.135:0/2400760688 shutdown_connections 2021-11-15T14:41:08.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.592+0000 7f9b75c30700 1 -- 172.21.2.135:0/2400760688 wait complete. 2021-11-15T14:41:08.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 Processor -- start 2021-11-15T14:41:08.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- start start 2021-11-15T14:41:08.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b70065500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b700b29e0 0x7f9b700a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70063df0 con 0x7f9b700b29e0 2021-11-15T14:41:08.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700659f0 con 0x7f9b700a7630 2021-11-15T14:41:08.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700a7ae0 con 0x7f9b700b1cd0 2021-11-15T14:41:08.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59734/0 (socket says 172.21.2.135:59734) 2021-11-15T14:41:08.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 -- 172.21.2.135:0/1842006468 learned_addr learned my addr 172.21.2.135:0/1842006468 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:08.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6f7fe700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b70065500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6effd700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b700b29e0 0x7f9b700a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 -- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 msgr2=0x7f9b70065500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b70065500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 -- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b700b29e0 msgr2=0x7f9b700a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b700b29e0 0x7f9b700a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 -- 172.21.2.135:0/1842006468 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68009470 con 0x7f9b700a7630 2021-11-15T14:41:08.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6ffff700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f9b7013c310 tx=0x7f9b680091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:08.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b6800c9d0 con 0x7f9b700a7630 2021-11-15T14:41:08.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800cb30 con 0x7f9b700a7630 2021-11-15T14:41:08.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5800b460 con 0x7f9b700a7630 2021-11-15T14:41:08.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b6800ce90 con 0x7f9b700a7630 2021-11-15T14:41:08.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7013ca40 con 0x7f9b700a7630 2021-11-15T14:41:08.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7013c130 con 0x7f9b700a7630 2021-11-15T14:41:08.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b68022070 con 0x7f9b700a7630 2021-11-15T14:41:08.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 0x7f9b54055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f9b6806c350 con 0x7f9b700a7630 2021-11-15T14:41:08.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.596+0000 7f9b6f7fe700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 0x7f9b54055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.600+0000 7f9b6f7fe700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 0x7f9b54055b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f9b6000b000 tx=0x7f9b60009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:08.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.600+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b68043330 con 0x7f9b700a7630 2021-11-15T14:41:08.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.680+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9b701437b0 con 0x7f9b700a7630 2021-11-15T14:41:08.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b6cff9700 1 -- 172.21.2.135:0/1842006468 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v79) v1 ==== 81+0+34116 (secure 0 0 0) 0x7f9b68046950 con 0x7f9b700a7630 2021-11-15T14:41:08.688 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:08.688 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:08.688 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 79, 2021-11-15T14:41:08.689 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:08.689 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:08.689 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:40:59.881257+0000", 2021-11-15T14:41:08.689 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:08.689 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:08.690 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:08.690 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:08.690 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:08.691 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:08.691 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:08.691 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:08.691 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:08.691 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:08.692 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:08.692 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:08.692 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:08.692 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:08.693 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:08.693 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 14, 2021-11-15T14:41:08.693 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:08.693 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:08.694 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:08.694 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:08.694 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:08.694 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.694 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:08.695 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:08.695 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:08.695 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:08.695 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:08.696 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:08.696 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:08.696 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:08.696 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:08.697 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:08.697 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:08.697 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:08.697 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:08.698 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:08.698 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:08.698 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:08.698 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:08.699 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:08.699 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:08.699 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:08.699 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:08.699 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:08.700 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:08.700 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.700 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:08.700 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:08.701 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:08.701 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:08.701 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:08.701 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:08.701 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:08.702 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:08.702 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:08.702 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:08.702 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:08.703 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:08.703 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:08.703 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:08.703 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:08.703 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:08.704 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:08.704 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:08.704 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:08.704 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:08.704 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:08.705 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:08.705 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:08.705 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:08.705 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:08.706 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:08.706 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:08.706 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.707 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:08.707 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:08.707 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:08.707 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:08.708 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:08.708 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:08.708 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:08.708 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:08.709 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:08.709 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:08.709 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:08.709 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:08.709 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:08.710 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.710 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:08.710 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:08.710 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.711 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.711 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.711 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:08.711 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:08.712 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:08.712 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:08.712 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:08.712 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:08.712 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:08.713 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:08.713 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:08.713 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:08.713 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:08.714 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:08.714 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:08.714 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:08.714 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:08.715 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:08.715 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:08.715 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:08.715 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:08.716 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:08.716 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:08.716 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:08.716 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:08.717 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:08.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:08.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:08.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:08.718 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:08.718 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:08.718 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:08.718 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:08.719 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:08.719 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:08.719 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:08.719 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:08.720 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:08.720 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:08.720 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:08.720 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:08.720 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:08.721 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:08.721 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:08.721 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:08.721 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:08.722 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:08.722 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:08.722 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:08.722 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:08.723 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:08.723 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:08.723 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.723 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:08.723 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:08.724 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:08.724 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:08.724 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:08.724 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:08.725 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:08.725 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:08.725 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:08.725 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:08.726 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:08.726 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:08.726 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:08.726 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:08.726 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.727 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.727 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.727 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 13, 2021-11-15T14:41:08.727 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:41:08.728 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:40:16.049940+0000", 2021-11-15T14:41:08.728 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:08.728 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:08.728 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:08.729 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:08.729 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:08.729 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:08.729 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:08.729 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:08.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:08.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:08.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:08.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:08.731 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:08.731 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:08.731 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:08.731 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:08.731 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:08.732 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:08.732 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:08.732 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:08.732 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.733 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "78", 2021-11-15T14:41:08.733 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:08.733 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:08.733 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:08.733 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:08.734 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:08.734 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:08.734 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:08.734 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:08.735 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:08.735 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:08.735 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:08.735 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:08.736 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:08.736 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:08.736 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:08.736 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:08.737 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:08.737 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:08.737 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:08.737 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:08.737 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:08.738 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:08.738 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:08.738 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:08.738 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:08.739 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:08.739 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.739 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:08.739 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:08.740 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:08.740 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:08.740 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:08.740 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:08.741 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:08.741 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:08.741 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:08.741 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:08.741 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:08.742 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:08.742 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:41:08.742 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:41:08.742 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:41:08.743 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.743 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:08.743 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:08.743 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:41:08.744 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.744 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.744 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.744 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.745 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 14, 2021-11-15T14:41:08.745 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:41:08.745 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:40:17.076402+0000", 2021-11-15T14:41:08.745 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:08.745 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:08.746 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:08.746 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:08.746 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:08.746 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:08.747 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:08.747 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:08.747 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:08.747 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:08.748 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:08.748 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:08.748 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:08.748 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:08.748 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:08.749 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:08.749 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:08.749 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:08.749 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:08.750 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:08.750 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.750 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "78", 2021-11-15T14:41:08.750 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:08.751 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:08.751 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:08.751 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:08.751 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:08.752 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:08.752 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:08.752 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:08.752 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:08.754 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:08.754 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:08.754 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:08.754 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:08.755 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:08.755 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:08.755 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:08.755 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:08.755 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:08.756 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:08.756 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:08.756 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:08.756 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.757 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:08.757 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:08.757 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:08.757 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:08.758 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:08.758 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:08.758 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:08.758 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:08.758 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:08.759 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:08.759 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:08.759 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:08.759 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:08.760 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:08.760 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:41:08.760 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.760 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.760 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.761 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:08.761 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:08.761 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.761 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:08.761 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:08.762 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.762 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.762 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.762 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.763 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.763 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.763 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.763 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:41:08.763 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.764 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.764 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.764 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.764 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.765 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.765 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:08.765 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.765 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.765 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.766 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.766 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:08.766 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.766 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.767 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.767 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.767 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.767 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.767 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.768 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.768 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:08.768 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.768 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.769 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.769 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.769 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:08.769 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.769 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.770 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.770 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.770 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.770 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.770 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.771 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.771 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:08.771 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.771 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.772 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.772 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.772 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:08.772 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.772 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.773 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.773 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.773 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.773 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.774 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.774 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.774 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:08.774 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.774 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.775 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.775 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.775 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:08.775 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:08.776 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.776 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.776 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.776 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:08.776 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:08.777 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:08.777 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:08.777 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.777 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.778 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.778 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.778 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.778 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.778 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:08.779 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:08.779 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.779 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.779 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.780 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.780 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.780 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.780 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.780 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:08.781 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.781 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.781 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.781 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.782 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.782 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.782 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:08.782 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.782 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.783 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.783 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.783 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:08.783 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.784 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.784 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.784 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.784 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.784 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.785 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.785 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.785 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:08.785 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.785 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.786 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.786 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.786 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:08.786 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.787 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.787 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.787 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.787 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.787 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.788 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.788 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.788 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:08.788 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.789 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.789 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.789 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.789 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:08.789 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.790 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.790 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.790 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.790 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.791 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.791 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.791 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.791 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:08.791 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.792 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.792 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.792 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.792 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:08.793 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:08.793 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.793 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.793 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.793 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:08.794 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:08.794 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:08.794 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:08.794 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.795 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.795 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.795 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.795 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.795 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.796 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:08.796 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:08.796 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.796 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.796 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.797 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.797 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.797 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.797 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.798 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:08.798 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.798 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.798 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.798 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.799 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.799 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.799 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:08.799 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.800 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.800 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.800 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.800 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:08.800 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.801 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.801 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.801 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.801 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.802 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.802 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.802 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.802 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:08.802 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.803 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.803 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.803 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.803 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:08.804 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.804 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.804 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.804 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.804 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.805 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.805 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.805 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.805 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:08.805 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.806 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.806 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.806 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.806 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:08.807 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.807 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.807 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.807 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.808 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.808 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.808 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.808 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.808 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:08.809 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.809 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.809 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.809 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.810 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:08.810 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:08.810 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.810 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.811 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.811 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:08.811 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:08.811 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:08.811 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:08.812 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.812 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.812 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.812 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.813 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.813 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.813 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:08.813 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:08.814 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.814 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.814 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.814 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.814 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.815 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.815 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.815 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 75, 2021-11-15T14:41:08.815 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.816 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.816 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.816 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.816 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.816 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.817 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:08.817 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.817 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.817 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.818 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.818 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:08.818 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.818 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.819 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.819 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.819 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.819 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.820 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.820 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:08.820 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.820 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.821 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.821 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.821 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:08.821 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.821 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.822 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.822 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.822 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.822 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.823 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.823 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.823 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:08.823 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.823 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.824 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.824 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.824 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:08.824 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.825 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.825 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.825 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.825 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.826 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.826 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.826 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.826 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:08.826 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.827 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.827 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.827 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.827 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:08.828 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:08.828 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.828 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.828 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.829 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:08.829 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:08.829 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:08.829 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:08.829 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.830 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.830 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.830 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.830 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.831 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.831 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:08.831 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:08.831 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.831 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.832 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.832 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.832 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.832 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.833 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.833 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:08.833 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.833 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.833 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.834 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.834 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.834 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.834 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:08.835 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.835 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.835 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.835 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.835 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:08.836 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.836 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.836 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.836 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.837 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.837 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.837 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.837 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.837 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:08.838 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.838 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.838 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.838 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.839 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:08.839 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.839 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.839 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.839 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.840 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.840 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.840 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.840 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.841 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:08.841 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.841 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.841 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.841 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.842 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:08.842 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.842 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.842 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.843 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.843 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.843 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.843 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.843 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.844 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:08.844 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.844 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.844 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.845 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.845 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:08.845 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:08.845 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.845 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.846 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.846 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:08.846 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:08.846 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:08.847 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:08.847 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.847 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.847 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.847 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.848 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.848 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.848 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:08.848 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:08.849 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.849 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.849 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.849 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.849 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.850 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.850 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.850 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:08.850 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.851 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.851 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.851 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.851 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.851 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.852 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:08.852 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.852 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.852 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.852 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.853 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:08.853 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.853 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.853 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.854 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.854 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.854 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.854 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.854 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.855 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:08.855 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.855 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.855 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.856 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.856 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:08.856 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.856 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.856 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.857 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.857 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.857 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.857 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.858 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.858 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:08.858 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.858 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.858 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.859 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.859 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:08.859 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.859 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.860 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.860 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.860 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.860 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.860 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.861 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.861 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:08.861 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.861 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.862 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.862 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.862 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:08.862 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:08.862 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.863 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.863 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.863 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:08.863 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:08.864 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:08.864 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:08.864 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.864 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.864 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.865 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.865 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.865 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.865 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:08.866 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:08.866 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.866 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.866 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.866 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.867 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.867 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.867 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.867 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 75, 2021-11-15T14:41:08.868 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.868 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.868 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.868 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.868 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.869 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.869 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:08.869 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.869 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.870 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.870 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.870 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:08.870 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.870 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.871 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.871 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.871 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.871 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.872 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.872 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.872 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:08.872 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.872 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.873 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.873 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.873 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:08.873 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.873 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.874 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.874 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.874 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.874 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.875 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.875 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.875 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:08.875 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.875 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.876 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.876 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.876 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:08.876 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.877 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.877 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.877 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.877 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.877 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.878 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.878 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.878 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:08.878 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.879 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.879 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.879 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.879 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:08.879 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:08.880 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.880 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.880 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.880 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:08.881 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:08.881 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:08.881 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:08.881 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.881 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.882 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.882 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.882 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.882 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.883 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:08.883 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:08.883 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:08.883 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:08.883 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:08.884 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:08.884 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:08.884 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:08.884 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:08.885 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:08.885 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:08.885 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:08.885 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:08.885 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.886 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.886 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.886 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:08.886 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.887 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.887 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.887 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.887 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:08.887 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.888 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.888 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.888 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.888 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:08.889 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.889 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.889 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.889 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:08.889 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.890 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.890 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.890 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.890 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:08.891 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.891 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.891 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.891 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.891 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:08.892 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.892 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.892 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.892 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:08.893 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.893 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.893 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.893 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.893 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:08.894 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.894 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.894 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.894 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.895 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:08.895 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:08.895 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.895 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:08.895 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:08.896 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.896 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.896 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.896 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:08.897 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:08.897 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:08.897 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.897 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.897 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.898 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:08.898 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:08.898 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:08.898 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:08.899 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:08.899 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:08.899 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:08.899 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:08.899 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.900 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:08.900 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:08.900 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.900 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:08.900 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.901 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.901 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.901 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.901 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.902 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:08.902 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.902 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.902 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.902 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:08.903 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.903 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.903 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.903 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.904 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.904 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:08.904 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.904 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.905 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.905 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:08.905 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.905 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.905 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.906 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.906 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.906 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:08.906 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.907 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.907 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.907 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:08.907 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.907 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.908 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.908 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.908 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.908 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:08.908 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.909 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.909 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.909 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:08.909 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.910 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.910 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.910 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.910 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.910 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:08.911 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.911 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.911 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.911 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:08.912 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.912 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.912 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.912 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.912 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.913 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:08.913 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.913 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.913 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.914 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:08.914 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.914 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.914 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.914 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.915 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.915 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:08.915 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.915 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.916 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:08.916 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:08.916 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:08.916 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:08.916 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:08.917 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:08.917 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:08.917 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:08.917 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:08.918 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.918 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:08.918 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:08.918 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:08.918 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:08.919 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:08.919 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:41:08.919 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.138:0/1859864213": "2021-11-15T15:40:58.985252+0000" 2021-11-15T14:41:08.919 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.920 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:08.920 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:08.920 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:08.920 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:08.920 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:08.921 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:08.921 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:08.921 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:08.921 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:08.922 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:08.922 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:08.922 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:08.922 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.922 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:08.923 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:08.923 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:08.923 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:08.923 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:08.924 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:08.924 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:08.924 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:08.924 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:08.924 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:08.925 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:08.925 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:08.925 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:08.925 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:08.926 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:08.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 msgr2=0x7f9b54055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 0x7f9b54055b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f9b6000b000 tx=0x7f9b60009040).stop 2021-11-15T14:41:08.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 msgr2=0x7f9b70062d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f9b7013c310 tx=0x7f9b680091d0).stop 2021-11-15T14:41:08.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 shutdown_connections 2021-11-15T14:41:08.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9b54053640 0x7f9b54055b00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9b700a7630 0x7f9b70062d00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9b700b29e0 0x7f9b700a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 --2- 172.21.2.135:0/1842006468 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9b700b1cd0 0x7f9b70065500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 >> 172.21.2.135:0/1842006468 conn(0x7f9b7005f730 msgr2=0x7f9b700b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:08.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 shutdown_connections 2021-11-15T14:41:08.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.684+0000 7f9b75c30700 1 -- 172.21.2.135:0/1842006468 wait complete. 2021-11-15T14:41:08.930 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:08.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.980+0000 7fdfc9de2700 1 Processor -- start 2021-11-15T14:41:08.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.980+0000 7fdfc9de2700 1 -- start start 2021-11-15T14:41:08.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfc40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc4140390 con 0x7fdfc4140d70 2021-11-15T14:41:08.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc4140630 con 0x7fdfc40aee40 2021-11-15T14:41:08.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41408d0 con 0x7fdfc40b1300 2021-11-15T14:41:08.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc3fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fdfc40aee40 0x7fdfc40b0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47330/0 (socket says 172.21.2.135:47330) 2021-11-15T14:41:08.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc3fff700 1 -- 172.21.2.135:0/3972328099 learned_addr learned my addr 172.21.2.135:0/3972328099 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:08.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710535100 0 0) 0x7fdfc4140630 con 0x7fdfc40aee40 2021-11-15T14:41:08.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa4003260 con 0x7fdfc40aee40 2021-11-15T14:41:08.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfc40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992735391 0 0) 0x7fdfa4003260 con 0x7fdfc40aee40 2021-11-15T14:41:08.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 msgr2=0x7fdfc40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:08.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfc40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 >> v1:172.21.2.119:6789/0 conn(0x7fdfc4140d70 legacy=0x7fdfc40ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4140080 con 0x7fdfc40aee40 2021-11-15T14:41:08.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fdfbc0019e0 con 0x7fdfc40aee40 2021-11-15T14:41:08.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 >> v1:172.21.2.135:6789/0 conn(0x7fdfc40aee40 legacy=0x7fdfc40b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:08.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfa4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfa4004500 0x7fdfa4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfa4004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:08.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41408d0 con 0x7fdfa4004500 2021-11-15T14:41:08.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa400b850 con 0x7fdfa4003750 2021-11-15T14:41:08.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa400ba10 con 0x7fdfc40b1300 2021-11-15T14:41:08.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfa4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc3fff700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfa4004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc2ffd700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfa4004500 0x7fdfa4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:08.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 msgr2=0x7fdfa4004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:08.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc40b1300 0x7fdfa4004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfa4004500 msgr2=0x7fdfa4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:08.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfa4004500 0x7fdfa4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:08.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3972328099 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4003260 con 0x7fdfa4003750 2021-11-15T14:41:08.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfa4003b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fdfb400a000 tx=0x7fdfb4008040).ready entity=mon.1 client_cookie=1d3d0fdbb2c4893d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:08.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4013670 con 0x7fdfa4003750 2021-11-15T14:41:08.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40137d0 con 0x7fdfa4003750 2021-11-15T14:41:08.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc27fc700 1 -- 172.21.2.135:0/3972328099 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4013b30 con 0x7fdfa4003750 2021-11-15T14:41:09.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3972328099 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 msgr2=0x7fdfa4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3972328099 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfa4003b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fdfb400a000 tx=0x7fdfb4008040).stop 2021-11-15T14:41:09.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc3fff700 1 -- 172.21.2.135:0/3972328099 reap_dead start 2021-11-15T14:41:09.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3972328099 shutdown_connections 2021-11-15T14:41:09.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3972328099 >> 172.21.2.135:0/3972328099 conn(0x7fdfc405f730 msgr2=0x7fdfc405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:09.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3972328099 shutdown_connections 2021-11-15T14:41:09.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3972328099 wait complete. 2021-11-15T14:41:09.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 Processor -- start 2021-11-15T14:41:09.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.984+0000 7fdfc9de2700 1 -- start start 2021-11-15T14:41:09.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfc40b47d0 0x7fdfc414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc4151b20 0x7fdfc4151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4144530 con 0x7fdfc40b47d0 2021-11-15T14:41:09.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40b4d50 con 0x7fdfa4003750 2021-11-15T14:41:09.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414e550 con 0x7fdfc4151b20 2021-11-15T14:41:09.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59750/0 (socket says 172.21.2.135:59750) 2021-11-15T14:41:09.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3866892478 learned_addr learned my addr 172.21.2.135:0/3866892478 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:09.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc3fff700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc4151b20 0x7fdfc4151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc2ffd700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfc40b47d0 0x7fdfc414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc4151b20 msgr2=0x7fdfc4151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc4151b20 0x7fdfc4151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfc40b47d0 msgr2=0x7fdfc414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfc40b47d0 0x7fdfc414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 -- 172.21.2.135:0/3866892478 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc414e7f0 con 0x7fdfa4003750 2021-11-15T14:41:09.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc37fe700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fdfb400a000 tx=0x7fdfb4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:09.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4012c50 con 0x7fdfa4003750 2021-11-15T14:41:09.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4000e90 con 0x7fdfa4003750 2021-11-15T14:41:09.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb4013e60 con 0x7fdfa4003750 2021-11-15T14:41:09.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc414ea90 con 0x7fdfa4003750 2021-11-15T14:41:09.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc40ab6f0 con 0x7fdfa4003750 2021-11-15T14:41:09.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc40b4d50 con 0x7fdfa4003750 2021-11-15T14:41:09.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfb401d410 con 0x7fdfa4003750 2021-11-15T14:41:09.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 0x7fdfa8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fdfb406d320 con 0x7fdfa4003750 2021-11-15T14:41:09.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc2ffd700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 0x7fdfa8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.988+0000 7fdfc2ffd700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 0x7fdfa8055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fdfac00d000 tx=0x7fdfac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:09.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:08.992+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfb4044190 con 0x7fdfa4003750 2021-11-15T14:41:09.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc414ec20 con 0x7fdfa4003750 2021-11-15T14:41:09.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc0ff9700 1 -- 172.21.2.135:0/3866892478 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fdfb40477b0 con 0x7fdfa4003750 2021-11-15T14:41:09.104 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:09.105 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:40:19.112767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6208":{"gid":6208,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6834/1605423856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1605423856},{"type":"v1","addr":"172.21.2.135:6834","nonce":1605423856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:41:09.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 msgr2=0x7fdfa8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 0x7fdfa8055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fdfac00d000 tx=0x7fdfac009040).stop 2021-11-15T14:41:09.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 msgr2=0x7fdfc40aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fdfb400a000 tx=0x7fdfb4008040).stop 2021-11-15T14:41:09.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 shutdown_connections 2021-11-15T14:41:09.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdfa8053580 0x7fdfa8055a40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdfc4151b20 0x7fdfc4151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdfc40b47d0 0x7fdfc414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 --2- 172.21.2.135:0/3866892478 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdfa4003750 0x7fdfc40aab10 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 >> 172.21.2.135:0/3866892478 conn(0x7fdfc405f730 msgr2=0x7fdfc413df20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:09.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 shutdown_connections 2021-11-15T14:41:09.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.100+0000 7fdfc9de2700 1 -- 172.21.2.135:0/3866892478 wait complete. 2021-11-15T14:41:09.108 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 38 2021-11-15T14:41:09.112 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:41:09.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 Processor -- start 2021-11-15T14:41:09.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- start start 2021-11-15T14:41:09.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0aa00b1050 0x7f0aa01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00b03d0 con 0x7f0aa00b1e30 2021-11-15T14:41:09.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00b0670 con 0x7f0aa0148420 2021-11-15T14:41:09.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa00a9140 con 0x7f0aa00b1050 2021-11-15T14:41:09.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0aa00b1050 0x7f0aa01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0aa00b1050 0x7f0aa01447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59760/0 (socket says 172.21.2.135:59760) 2021-11-15T14:41:09.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 -- 172.21.2.135:0/771144554 learned_addr learned my addr 172.21.2.135:0/771144554 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:09.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 -- 172.21.2.135:0/771144554 >> v1:172.21.2.135:6789/0 conn(0x7f0aa0148420 legacy=0x7f0aa00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 -- 172.21.2.135:0/771144554 >> v1:172.21.2.119:6789/0 conn(0x7f0aa00b1e30 legacy=0x7f0aa00b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:09.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 -- 172.21.2.135:0/771144554 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00b0910 con 0x7f0aa00b1050 2021-11-15T14:41:09.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 --2- 172.21.2.135:0/771144554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa00b1050 0x7f0aa01447a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f0aa00acee0 tx=0x7f0a98009290).ready entity=mon.1 client_cookie=99920e7b21a3cb45 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:09.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0a8ffff700 1 -- 172.21.2.135:0/771144554 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9800b820 con 0x7f0aa00b1050 2021-11-15T14:41:09.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0a8ffff700 1 -- 172.21.2.135:0/771144554 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800b980 con 0x7f0aa00b1050 2021-11-15T14:41:09.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0a8ffff700 1 -- 172.21.2.135:0/771144554 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9800baf0 con 0x7f0aa00b1050 2021-11-15T14:41:09.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- 172.21.2.135:0/771144554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa00b1050 msgr2=0x7f0aa01447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/771144554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa00b1050 0x7f0aa01447a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f0aa00acee0 tx=0x7f0a98009290).stop 2021-11-15T14:41:09.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- 172.21.2.135:0/771144554 shutdown_connections 2021-11-15T14:41:09.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/771144554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa00b1050 0x7f0aa01447a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- 172.21.2.135:0/771144554 >> 172.21.2.135:0/771144554 conn(0x7f0aa005f730 msgr2=0x7f0aa005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:09.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- 172.21.2.135:0/771144554 shutdown_connections 2021-11-15T14:41:09.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- 172.21.2.135:0/771144554 wait complete. 2021-11-15T14:41:09.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 Processor -- start 2021-11-15T14:41:09.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- start start 2021-11-15T14:41:09.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa00b1050 0x7f0aa00a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa00b1e30 0x7f0aa00abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa014b970 con 0x7f0aa00b1050 2021-11-15T14:41:09.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa014aec0 con 0x7f0aa0148420 2021-11-15T14:41:09.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa79d6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa014b160 con 0x7f0aa00b1e30 2021-11-15T14:41:09.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59768/0 (socket says 172.21.2.135:59768) 2021-11-15T14:41:09.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.160+0000 7f0aa5f73700 1 -- 172.21.2.135:0/3448087128 learned_addr learned my addr 172.21.2.135:0/3448087128 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:09.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 -- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa00b1e30 msgr2=0x7f0aa00abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa00b1e30 0x7f0aa00abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:09.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 -- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa00b1050 msgr2=0x7f0aa00a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa00b1050 0x7f0aa00a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:09.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 -- 172.21.2.135:0/3448087128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98009530 con 0x7f0aa0148420 2021-11-15T14:41:09.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5f73700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f0aa00acee0 tx=0x7f0a98016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:09.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9801f3f0 con 0x7f0aa0148420 2021-11-15T14:41:09.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9801f550 con 0x7f0aa0148420 2021-11-15T14:41:09.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa014b6b0 con 0x7f0aa0148420 2021-11-15T14:41:09.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9801f8b0 con 0x7f0aa0148420 2021-11-15T14:41:09.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa0148f70 con 0x7f0aa0148420 2021-11-15T14:41:09.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa014b320 con 0x7f0aa0148420 2021-11-15T14:41:09.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a98026030 con 0x7f0aa0148420 2021-11-15T14:41:09.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 0x7f0a80055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:09.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f0a9806caa0 con 0x7f0aa0148420 2021-11-15T14:41:09.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5772700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 0x7f0a80055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:09.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.164+0000 7f0aa5772700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 0x7f0a80055b20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0a90002fb0 tx=0x7f0a900069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:09.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.168+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a980473a0 con 0x7f0aa0148420 2021-11-15T14:41:09.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.276+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0aa00b0bb0 con 0x7f0aa0148420 2021-11-15T14:41:09.949 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:41:09.943+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:41:09.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.956+0000 7f0a8e7fc700 1 -- 172.21.2.135:0/3448087128 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a98046f90 con 0x7f0aa0148420 2021-11-15T14:41:09.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 msgr2=0x7f0a80055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 0x7f0a80055b20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0a90002fb0 tx=0x7f0a900069b0).stop 2021-11-15T14:41:09.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 msgr2=0x7f0aa00ac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:09.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f0aa00acee0 tx=0x7f0a98016000).stop 2021-11-15T14:41:09.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 shutdown_connections 2021-11-15T14:41:09.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a80053660 0x7f0a80055b20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0aa0148420 0x7f0aa00ac120 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:09.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0aa00b1e30 0x7f0aa00abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:09.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 --2- 172.21.2.135:0/3448087128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0aa00b1050 0x7f0aa00a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:09.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 >> 172.21.2.135:0/3448087128 conn(0x7f0aa005f730 msgr2=0x7f0aa00b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:09.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 shutdown_connections 2021-11-15T14:41:09.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:09.960+0000 7f0aa79d6700 1 -- 172.21.2.135:0/3448087128 wait complete. 2021-11-15T14:41:09.967 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:41:09.970 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:09.978 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:41:10.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.016+0000 7fccbb6ce700 1 Processor -- start 2021-11-15T14:41:10.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.016+0000 7fccbb6ce700 1 -- start start 2021-11-15T14:41:10.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fccb40b0520 0x7fccb40addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40b2b70 con 0x7fccb40b0900 2021-11-15T14:41:10.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40b27f0 con 0x7fccb40aa1a0 2021-11-15T14:41:10.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb40b2da0 con 0x7fccb40b0520 2021-11-15T14:41:10.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb946a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fccb40b0520 0x7fccb40addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fccb40aa1a0 0x7fccb40ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47374/0 (socket says 172.21.2.135:47374) 2021-11-15T14:41:10.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 -- 172.21.2.135:0/2540044860 learned_addr learned my addr 172.21.2.135:0/2540044860 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:10.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb946a700 1 -- 172.21.2.135:0/2540044860 >> v1:172.21.2.135:6789/0 conn(0x7fccb40aa1a0 legacy=0x7fccb40ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb946a700 1 -- 172.21.2.135:0/2540044860 >> v1:172.21.2.119:6789/0 conn(0x7fccb40b0900 legacy=0x7fccb4140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:10.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb946a700 1 -- 172.21.2.135:0/2540044860 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40a9bf0 con 0x7fccb40b0520 2021-11-15T14:41:10.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb946a700 1 --2- 172.21.2.135:0/2540044860 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb40addb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fccb40b0130 tx=0x7fccb0006df0).ready entity=mon.1 client_cookie=248ae43a22f04f8c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca7fff700 1 -- 172.21.2.135:0/2540044860 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb000d5c0 con 0x7fccb40b0520 2021-11-15T14:41:10.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca7fff700 1 -- 172.21.2.135:0/2540044860 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0000e90 con 0x7fccb40b0520 2021-11-15T14:41:10.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca7fff700 1 -- 172.21.2.135:0/2540044860 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb000d910 con 0x7fccb40b0520 2021-11-15T14:41:10.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/2540044860 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 msgr2=0x7fccb40addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/2540044860 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb40addb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fccb40b0130 tx=0x7fccb0006df0).stop 2021-11-15T14:41:10.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/2540044860 shutdown_connections 2021-11-15T14:41:10.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/2540044860 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb40addb0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/2540044860 >> 172.21.2.135:0/2540044860 conn(0x7fccb4060840 msgr2=0x7fccb4060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:10.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/2540044860 shutdown_connections 2021-11-15T14:41:10.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/2540044860 wait complete. 2021-11-15T14:41:10.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 Processor -- start 2021-11-15T14:41:10.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- start start 2021-11-15T14:41:10.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccb40aa1a0 0x7fccb4143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccb40b0900 0x7fccb4152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4152870 con 0x7fccb40aa1a0 2021-11-15T14:41:10.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4145b20 con 0x7fccb40b0520 2021-11-15T14:41:10.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4145880 con 0x7fccb40b0900 2021-11-15T14:41:10.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59792/0 (socket says 172.21.2.135:59792) 2021-11-15T14:41:10.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 -- 172.21.2.135:0/3260909950 learned_addr learned my addr 172.21.2.135:0/3260909950 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:10.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 -- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccb40b0900 msgr2=0x7fccb4152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccb40b0900 0x7fccb4152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 -- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccb40aa1a0 msgr2=0x7fccb4143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccb40aa1a0 0x7fccb4143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 -- 172.21.2.135:0/3260909950 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb000b180 con 0x7fccb40b0520 2021-11-15T14:41:10.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccb8c69700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fccb40b77f0 tx=0x7fcca8007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca800ce30 con 0x7fccb40b0520 2021-11-15T14:41:10.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80072e0 con 0x7fccb40b0520 2021-11-15T14:41:10.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb4152ad0 con 0x7fccb40b0520 2021-11-15T14:41:10.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcca8005800 con 0x7fccb40b0520 2021-11-15T14:41:10.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.020+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb409fc60 con 0x7fccb40b0520 2021-11-15T14:41:10.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb4152c60 con 0x7fccb40b0520 2021-11-15T14:41:10.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcca8010070 con 0x7fccb40b0520 2021-11-15T14:41:10.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fcca67fc700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 0x7fcc940559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fcca806b220 con 0x7fccb40b0520 2021-11-15T14:41:10.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fccb946a700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 0x7fcc940559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fccb946a700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 0x7fcc940559b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fccb40b0130 tx=0x7fccb0012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.024+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcca8042100 con 0x7fccb40b0520 2021-11-15T14:41:10.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.132+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccb40573d0 con 0x7fccb40b0520 2021-11-15T14:41:10.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fcca67fc700 1 -- 172.21.2.135:0/3260909950 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fcca8018070 con 0x7fccb40b0520 2021-11-15T14:41:10.139 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:10.139 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":39,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:40:18.108204+0000","modified":"2021-11-15T14:41:09.948376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-15T14:41:10.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 msgr2=0x7fcc940559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 0x7fcc940559b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fccb40b0130 tx=0x7fccb0012000).stop 2021-11-15T14:41:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 msgr2=0x7fccb4066a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fccb40b77f0 tx=0x7fcca8007c10).stop 2021-11-15T14:41:10.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 shutdown_connections 2021-11-15T14:41:10.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc940534f0 0x7fcc940559b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fccb40b0900 0x7fccb4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fccb40b0520 0x7fccb4066a90 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 --2- 172.21.2.135:0/3260909950 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fccb40aa1a0 0x7fccb4143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 >> 172.21.2.135:0/3260909950 conn(0x7fccb4060840 msgr2=0x7fccb40b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:10.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 shutdown_connections 2021-11-15T14:41:10.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.136+0000 7fccbb6ce700 1 -- 172.21.2.135:0/3260909950 wait complete. 2021-11-15T14:41:10.143 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 39 2021-11-15T14:41:10.146 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:41:10.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 Processor -- start 2021-11-15T14:41:10.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 -- start start 2021-11-15T14:41:10.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd57c0b1f40 0x7fd57c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd57c0b2320 0x7fd57c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0b04a0 con 0x7fd57c0b0030 2021-11-15T14:41:10.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0a7850 con 0x7fd57c0b1f40 2021-11-15T14:41:10.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd580f56700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b06d0 con 0x7fd57c0b2320 2021-11-15T14:41:10.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd57c0b2320 0x7fd57c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd57c0b2320 0x7fd57c1412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59798/0 (socket says 172.21.2.135:59798) 2021-11-15T14:41:10.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 -- 172.21.2.135:0/178848918 learned_addr learned my addr 172.21.2.135:0/178848918 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:10.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 -- 172.21.2.135:0/178848918 >> v2:172.21.2.119:3300/0 conn(0x7fd57c0b1f40 msgr2=0x7fd57c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:10.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 --2- 172.21.2.135:0/178848918 >> v2:172.21.2.119:3300/0 conn(0x7fd57c0b1f40 0x7fd57c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 -- 172.21.2.135:0/178848918 >> v1:172.21.2.119:6789/0 conn(0x7fd57c0b0030 legacy=0x7fd57c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:10.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 -- 172.21.2.135:0/178848918 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0b0970 con 0x7fd57c0b2320 2021-11-15T14:41:10.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.192+0000 7fd57ad9d700 1 --2- 172.21.2.135:0/178848918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c1412d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fd57c0ad350 tx=0x7fd574009290).ready entity=mon.1 client_cookie=138b2d96de8fc859 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57959a700 1 -- 172.21.2.135:0/178848918 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57400b830 con 0x7fd57c0b2320 2021-11-15T14:41:10.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57959a700 1 -- 172.21.2.135:0/178848918 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57400b990 con 0x7fd57c0b2320 2021-11-15T14:41:10.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57959a700 1 -- 172.21.2.135:0/178848918 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57400bb40 con 0x7fd57c0b2320 2021-11-15T14:41:10.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/178848918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 msgr2=0x7fd57c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- 172.21.2.135:0/178848918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c1412d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fd57c0ad350 tx=0x7fd574009290).stop 2021-11-15T14:41:10.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/178848918 shutdown_connections 2021-11-15T14:41:10.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- 172.21.2.135:0/178848918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c1412d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- 172.21.2.135:0/178848918 >> v2:172.21.2.119:3300/0 conn(0x7fd57c0b1f40 0x7fd57c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/178848918 >> 172.21.2.135:0/178848918 conn(0x7fd57c05f730 msgr2=0x7fd57c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:10.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/178848918 shutdown_connections 2021-11-15T14:41:10.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/178848918 wait complete. 2021-11-15T14:41:10.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 Processor -- start 2021-11-15T14:41:10.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- start start 2021-11-15T14:41:10.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd57c0b0030 0x7fd57c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd57c0b1f40 0x7fd57c144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0af870 con 0x7fd57c0b1f40 2021-11-15T14:41:10.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c15ae30 con 0x7fd57c0b2320 2021-11-15T14:41:10.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c144cf0 con 0x7fd57c0b0030 2021-11-15T14:41:10.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59806/0 (socket says 172.21.2.135:59806) 2021-11-15T14:41:10.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 -- 172.21.2.135:0/3813911948 learned_addr learned my addr 172.21.2.135:0/3813911948 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:10.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 -- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd57c0b0030 msgr2=0x7fd57c0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd57c0b0030 0x7fd57c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 -- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd57c0b1f40 msgr2=0x7fd57c144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd57c0b1f40 0x7fd57c144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 -- 172.21.2.135:0/3813911948 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd574009530 con 0x7fd57c0b2320 2021-11-15T14:41:10.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd57ad9d700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fd57c0ad350 tx=0x7fd574016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57400bdb0 con 0x7fd57c0b2320 2021-11-15T14:41:10.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574020430 con 0x7fd57c0b2320 2021-11-15T14:41:10.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0ad880 con 0x7fd57c0b2320 2021-11-15T14:41:10.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c0a99b0 con 0x7fd57c0b2320 2021-11-15T14:41:10.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd574020790 con 0x7fd57c0b2320 2021-11-15T14:41:10.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c15ac70 con 0x7fd57c0b2320 2021-11-15T14:41:10.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.196+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd574027070 con 0x7fd57c0b2320 2021-11-15T14:41:10.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.200+0000 7fd5737fe700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 0x7fd560055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:10.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.200+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fd57406c590 con 0x7fd57c0b2320 2021-11-15T14:41:10.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.200+0000 7fd57a59c700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 0x7fd560055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:10.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.200+0000 7fd57a59c700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 0x7fd560055b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd564002f70 tx=0x7fd564006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:10.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.200+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd574043510 con 0x7fd57c0b2320 2021-11-15T14:41:10.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.312+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd57c0b0c10 con 0x7fd57c0b2320 2021-11-15T14:41:10.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd5737fe700 1 -- 172.21.2.135:0/3813911948 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd574015020 con 0x7fd57c0b2320 2021-11-15T14:41:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 msgr2=0x7fd560055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 0x7fd560055b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd564002f70 tx=0x7fd564006a80).stop 2021-11-15T14:41:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 msgr2=0x7fd57c144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7fd57c0ad350 tx=0x7fd574016000).stop 2021-11-15T14:41:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 shutdown_connections 2021-11-15T14:41:10.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5600536a0 0x7fd560055b60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd57c0b2320 0x7fd57c144800 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd57c0b1f40 0x7fd57c144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 --2- 172.21.2.135:0/3813911948 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd57c0b0030 0x7fd57c0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:10.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 >> 172.21.2.135:0/3813911948 conn(0x7fd57c05f730 msgr2=0x7fd57c145840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:10.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 shutdown_connections 2021-11-15T14:41:10.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:10.972+0000 7fd580f56700 1 -- 172.21.2.135:0/3813911948 wait complete. 2021-11-15T14:41:10.984 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:41:11.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 Processor -- start 2021-11-15T14:41:11.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 -- start start 2021-11-15T14:41:11.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff540060180 0x7ff5400b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400aac30 con 0x7ff5400b4cc0 2021-11-15T14:41:11.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff540060560 con 0x7ff540060180 2021-11-15T14:41:11.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff547485700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff540066f20 con 0x7ff540067380 2021-11-15T14:41:11.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff544a20700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff544a20700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41360/0 (socket says 172.21.2.135:41360) 2021-11-15T14:41:11.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff544a20700 1 -- 172.21.2.135:0/3100207424 learned_addr learned my addr 172.21.2.135:0/3100207424 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:11.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.036+0000 7ff545221700 1 --2- 172.21.2.135:0/3100207424 >> v2:172.21.2.119:3300/0 conn(0x7ff540060180 0x7ff5400b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 -- 172.21.2.135:0/3100207424 >> v2:172.21.2.119:3300/0 conn(0x7ff540060180 msgr2=0x7ff5400b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:11.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 --2- 172.21.2.135:0/3100207424 >> v2:172.21.2.119:3300/0 conn(0x7ff540060180 0x7ff5400b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 -- 172.21.2.135:0/3100207424 >> v1:172.21.2.119:6789/0 conn(0x7ff5400b4cc0 legacy=0x7ff540144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 -- 172.21.2.135:0/3100207424 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400b3430 con 0x7ff540067380 2021-11-15T14:41:11.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 --2- 172.21.2.135:0/3100207424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff530002f70 tx=0x7ff530006eb0).ready entity=mon.2 client_cookie=c4d1814d19bd21a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:11.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52ffff700 1 -- 172.21.2.135:0/3100207424 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff53000d570 con 0x7ff540067380 2021-11-15T14:41:11.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52ffff700 1 -- 172.21.2.135:0/3100207424 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530000e90 con 0x7ff540067380 2021-11-15T14:41:11.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52ffff700 1 -- 172.21.2.135:0/3100207424 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff53000d900 con 0x7ff540067380 2021-11-15T14:41:11.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/3100207424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 msgr2=0x7ff540143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- 172.21.2.135:0/3100207424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff530002f70 tx=0x7ff530006eb0).stop 2021-11-15T14:41:11.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/3100207424 shutdown_connections 2021-11-15T14:41:11.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- 172.21.2.135:0/3100207424 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540143970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- 172.21.2.135:0/3100207424 >> v2:172.21.2.119:3300/0 conn(0x7ff540060180 0x7ff5400b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/3100207424 >> 172.21.2.135:0/3100207424 conn(0x7ff54005cfb0 msgr2=0x7ff54005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:11.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/3100207424 shutdown_connections 2021-11-15T14:41:11.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/3100207424 wait complete. 2021-11-15T14:41:11.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 Processor -- start 2021-11-15T14:41:11.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- start start 2021-11-15T14:41:11.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 0x7ff5400ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401428d0 con 0x7ff540060180 2021-11-15T14:41:11.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400a4ab0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400a2d40 con 0x7ff540067380 2021-11-15T14:41:11.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59824/0 (socket says 172.21.2.135:59824) 2021-11-15T14:41:11.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 -- 172.21.2.135:0/319704820 learned_addr learned my addr 172.21.2.135:0/319704820 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:11.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545221700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 0x7ff5400ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 -- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 msgr2=0x7ff540152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 -- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 msgr2=0x7ff5400ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 0x7ff5400ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 -- 172.21.2.135:0/319704820 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53000b1e0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff544a20700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:11.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545221700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 0x7ff5400ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:11.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff545a22700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7ff540067260 tx=0x7ff538007ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:11.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff53800f470 con 0x7ff5400b4cc0 2021-11-15T14:41:11.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800f5d0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5400a9500 con 0x7ff5400b4cc0 2021-11-15T14:41:11.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff53800f930 con 0x7ff5400b4cc0 2021-11-15T14:41:11.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.040+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5400a9a40 con 0x7ff5400b4cc0 2021-11-15T14:41:11.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5400a2e80 con 0x7ff5400b4cc0 2021-11-15T14:41:11.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff538019030 con 0x7ff5400b4cc0 2021-11-15T14:41:11.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff52e7fc700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 0x7ff5200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:11.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6545+0+0 (secure 0 0 0) 0x7ff53806b120 con 0x7ff5400b4cc0 2021-11-15T14:41:11.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff545221700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 0x7ff5200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:11.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff545221700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 0x7ff5200559b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff53c00b000 tx=0x7ff53c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:11.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.044+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5380420a0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.128+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5400573d0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff52e7fc700 1 -- 172.21.2.135:0/319704820 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff5380456c0 con 0x7ff5400b4cc0 2021-11-15T14:41:11.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 msgr2=0x7ff5200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 0x7ff5200559b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff53c00b000 tx=0x7ff53c008040).stop 2021-11-15T14:41:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 msgr2=0x7ff5400a3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7ff540067260 tx=0x7ff538007ef0).stop 2021-11-15T14:41:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 shutdown_connections 2021-11-15T14:41:11.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff5200534f0 0x7ff5200559b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff5400b4cc0 0x7ff5400a3170 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff540067380 0x7ff540152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 --2- 172.21.2.135:0/319704820 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff540060180 0x7ff5400ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:11.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.980+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 >> 172.21.2.135:0/319704820 conn(0x7ff54005cfb0 msgr2=0x7ff5400b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:11.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.984+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 shutdown_connections 2021-11-15T14:41:11.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:11.984+0000 7ff547485700 1 -- 172.21.2.135:0/319704820 wait complete. 2021-11-15T14:41:11.989 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:41:11.992 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:41:12.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 Processor -- start 2021-11-15T14:41:12.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 -- start start 2021-11-15T14:41:12.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbe60148420 0x7fbe600b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbe600a7140 0x7fbe601447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600b03d0 con 0x7fbe600b1e30 2021-11-15T14:41:12.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe600a9140 con 0x7fbe60148420 2021-11-15T14:41:12.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.040+0000 7fbe67fe1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe600b0670 con 0x7fbe600a7140 2021-11-15T14:41:12.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbe600a7140 0x7fbe601447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:12.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbe600a7140 0x7fbe601447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59828/0 (socket says 172.21.2.135:59828) 2021-11-15T14:41:12.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/4140271094 learned_addr learned my addr 172.21.2.135:0/4140271094 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:12.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/4140271094 >> v2:172.21.2.119:3300/0 conn(0x7fbe60148420 msgr2=0x7fbe600b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:12.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- 172.21.2.135:0/4140271094 >> v2:172.21.2.119:3300/0 conn(0x7fbe60148420 0x7fbe600b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/4140271094 >> v1:172.21.2.119:6789/0 conn(0x7fbe600b1e30 legacy=0x7fbe600b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:12.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/4140271094 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600b0910 con 0x7fbe600a7140 2021-11-15T14:41:12.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- 172.21.2.135:0/4140271094 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe600a7140 0x7fbe601447a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fbe600acee0 tx=0x7fbe58009290).ready entity=mon.1 client_cookie=c4f68f611aa76f90 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:12.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe64d7b700 1 -- 172.21.2.135:0/4140271094 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5800b820 con 0x7fbe600a7140 2021-11-15T14:41:12.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe64d7b700 1 -- 172.21.2.135:0/4140271094 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b980 con 0x7fbe600a7140 2021-11-15T14:41:12.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe64d7b700 1 -- 172.21.2.135:0/4140271094 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5800bb30 con 0x7fbe600a7140 2021-11-15T14:41:12.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/4140271094 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe600a7140 msgr2=0x7fbe601447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:12.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/4140271094 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe600a7140 0x7fbe601447a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fbe600acee0 tx=0x7fbe58009290).stop 2021-11-15T14:41:12.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/4140271094 shutdown_connections 2021-11-15T14:41:12.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/4140271094 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe600a7140 0x7fbe601447a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:12.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/4140271094 >> v2:172.21.2.119:3300/0 conn(0x7fbe60148420 0x7fbe600b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/4140271094 >> 172.21.2.135:0/4140271094 conn(0x7fbe6005f730 msgr2=0x7fbe6005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:12.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/4140271094 shutdown_connections 2021-11-15T14:41:12.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/4140271094 wait complete. 2021-11-15T14:41:12.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 Processor -- start 2021-11-15T14:41:12.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- start start 2021-11-15T14:41:12.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbe600a7140 0x7fbe600abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbe600b1e30 0x7fbe600aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600a9b60 con 0x7fbe600a7140 2021-11-15T14:41:12.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600a9e00 con 0x7fbe60148420 2021-11-15T14:41:12.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600aa0a0 con 0x7fbe600b1e30 2021-11-15T14:41:12.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:12.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59838/0 (socket says 172.21.2.135:59838) 2021-11-15T14:41:12.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/1481413121 learned_addr learned my addr 172.21.2.135:0/1481413121 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbe600b1e30 msgr2=0x7fbe600aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbe600b1e30 0x7fbe600aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbe600a7140 msgr2=0x7fbe600abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbe600a7140 0x7fbe600abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 -- 172.21.2.135:0/1481413121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58009530 con 0x7fbe60148420 2021-11-15T14:41:12.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe6657e700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fbe600acee0 tx=0x7fbe58016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:12.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5800b820 con 0x7fbe60148420 2021-11-15T14:41:12.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580107a0 con 0x7fbe60148420 2021-11-15T14:41:12.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe60063950 con 0x7fbe60148420 2021-11-15T14:41:12.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe580032d0 con 0x7fbe60148420 2021-11-15T14:41:12.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe60063e30 con 0x7fbe60148420 2021-11-15T14:41:12.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe600aa260 con 0x7fbe60148420 2021-11-15T14:41:12.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.044+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe58029070 con 0x7fbe60148420 2021-11-15T14:41:12.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.048+0000 7fbe52ffd700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 0x7fbe40055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:12.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.048+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6107+0+0 (secure 0 0 0) 0x7fbe5806cb70 con 0x7fbe60148420 2021-11-15T14:41:12.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.048+0000 7fbe65d7d700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 0x7fbe40055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:12.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.048+0000 7fbe65d7d700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 0x7fbe40055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fbe54002fb0 tx=0x7fbe540069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:12.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.048+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe58043ba0 con 0x7fbe60148420 2021-11-15T14:41:12.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.132+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe600b0bb0 con 0x7fbe60148420 2021-11-15T14:41:12.421 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:12.425 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:12.428 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:12.431 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:12.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe52ffd700 1 -- 172.21.2.135:0/1481413121 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbe58015070 con 0x7fbe60148420 2021-11-15T14:41:12.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 msgr2=0x7fbe40055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:12.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 0x7fbe40055ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fbe54002fb0 tx=0x7fbe540069b0).stop 2021-11-15T14:41:12.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 msgr2=0x7fbe60063460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:12.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fbe600acee0 tx=0x7fbe58016000).stop 2021-11-15T14:41:12.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 shutdown_connections 2021-11-15T14:41:12.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbe40053610 0x7fbe40055ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:12.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbe60148420 0x7fbe60063460 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:12.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbe600b1e30 0x7fbe600aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 --2- 172.21.2.135:0/1481413121 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbe600a7140 0x7fbe600abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:12.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 >> 172.21.2.135:0/1481413121 conn(0x7fbe6005f730 msgr2=0x7fbe60143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:12.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 shutdown_connections 2021-11-15T14:41:12.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:12.992+0000 7fbe67fe1700 1 -- 172.21.2.135:0/1481413121 wait complete. 2021-11-15T14:41:12.999 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:41:13.003 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:41:13.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 Processor -- start 2021-11-15T14:41:13.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 -- start start 2021-11-15T14:41:13.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a780b0630 0x7f1a780b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a781439a0 con 0x7f1a780b3790 2021-11-15T14:41:13.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a78143c40 con 0x7f1a780b0630 2021-11-15T14:41:13.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7f8c3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78143ee0 con 0x7f1a780a9c90 2021-11-15T14:41:13.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7d65f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a780b0630 0x7f1a780b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7ce5e700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f1a780b3790 0x7f1a7813d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:56848/0 (socket says 172.21.2.135:56848) 2021-11-15T14:41:13.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41390/0 (socket says 172.21.2.135:41390) 2021-11-15T14:41:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7ce5e700 1 -- 172.21.2.135:0/3771327886 learned_addr learned my addr 172.21.2.135:0/3771327886 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 -- 172.21.2.135:0/3771327886 >> v2:172.21.2.119:3300/0 conn(0x7f1a780b0630 msgr2=0x7f1a780b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 --2- 172.21.2.135:0/3771327886 >> v2:172.21.2.119:3300/0 conn(0x7f1a780b0630 0x7f1a780b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 -- 172.21.2.135:0/3771327886 >> v1:172.21.2.119:6789/0 conn(0x7f1a780b3790 legacy=0x7f1a7813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 -- 172.21.2.135:0/3771327886 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78144180 con 0x7f1a780a9c90 2021-11-15T14:41:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.052+0000 7f1a7de60700 1 --2- 172.21.2.135:0/3771327886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1a700032f0 tx=0x7f1a700091d0).ready entity=mon.2 client_cookie=2d67e8d84c30c9f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6bfff700 1 -- 172.21.2.135:0/3771327886 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a7000b6c0 con 0x7f1a780a9c90 2021-11-15T14:41:13.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6bfff700 1 -- 172.21.2.135:0/3771327886 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000b820 con 0x7f1a780a9c90 2021-11-15T14:41:13.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6bfff700 1 -- 172.21.2.135:0/3771327886 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a7000b990 con 0x7f1a780a9c90 2021-11-15T14:41:13.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/3771327886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 msgr2=0x7f1a780b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/3771327886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1a700032f0 tx=0x7f1a700091d0).stop 2021-11-15T14:41:13.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/3771327886 shutdown_connections 2021-11-15T14:41:13.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/3771327886 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780a9c90 0x7f1a780b1130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/3771327886 >> v2:172.21.2.119:3300/0 conn(0x7f1a780b0630 0x7f1a780b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/3771327886 >> 172.21.2.135:0/3771327886 conn(0x7f1a78060840 msgr2=0x7f1a78060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:13.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/3771327886 shutdown_connections 2021-11-15T14:41:13.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/3771327886 wait complete. 2021-11-15T14:41:13.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 Processor -- start 2021-11-15T14:41:13.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- start start 2021-11-15T14:41:13.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780b0630 0x7f1a780aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a780b3790 0x7f1a780aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7813fa40 con 0x7f1a780b3790 2021-11-15T14:41:13.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7814c330 con 0x7f1a780a9c90 2021-11-15T14:41:13.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7814f360 con 0x7f1a780b0630 2021-11-15T14:41:13.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59848/0 (socket says 172.21.2.135:59848) 2021-11-15T14:41:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 -- 172.21.2.135:0/150460680 learned_addr learned my addr 172.21.2.135:0/150460680 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 -- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780b0630 msgr2=0x7f1a780aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780b0630 0x7f1a780aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 -- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a780b3790 msgr2=0x7f1a780aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a780b3790 0x7f1a780aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 -- 172.21.2.135:0/150460680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009470 con 0x7f1a780a9c90 2021-11-15T14:41:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7d65f700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f1a780ad4c0 tx=0x7f1a74006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a7400c830 con 0x7f1a780a9c90 2021-11-15T14:41:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400c990 con 0x7f1a780a9c90 2021-11-15T14:41:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a78140440 con 0x7f1a780a9c90 2021-11-15T14:41:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a7400ccf0 con 0x7f1a780a9c90 2021-11-15T14:41:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7814f080 con 0x7f1a780a9c90 2021-11-15T14:41:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a780ae410 con 0x7f1a780a9c90 2021-11-15T14:41:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.056+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a7401c460 con 0x7f1a780a9c90 2021-11-15T14:41:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.060+0000 7f1a6a7fc700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 0x7f1a58055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.060+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f1a7406bcd0 con 0x7f1a780a9c90 2021-11-15T14:41:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.060+0000 7f1a7ce5e700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 0x7f1a58055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.060+0000 7f1a7ce5e700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 0x7f1a58055a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f1a7806aad0 tx=0x7f1a6c0078b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.060+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a74042f30 con 0x7f1a780a9c90 2021-11-15T14:41:13.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.148+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1a781405d0 con 0x7f1a780a9c90 2021-11-15T14:41:13.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a6a7fc700 1 -- 172.21.2.135:0/150460680 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1a74046550 con 0x7f1a780a9c90 2021-11-15T14:41:13.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 msgr2=0x7f1a58055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 0x7f1a58055a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f1a7806aad0 tx=0x7f1a6c0078b0).stop 2021-11-15T14:41:13.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 msgr2=0x7f1a780ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f1a780ad4c0 tx=0x7f1a74006df0).stop 2021-11-15T14:41:13.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 shutdown_connections 2021-11-15T14:41:13.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1a58053580 0x7f1a58055a40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a780b3790 0x7f1a780aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a780b0630 0x7f1a780aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 --2- 172.21.2.135:0/150460680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a780a9c90 0x7f1a780ad8b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 >> 172.21.2.135:0/150460680 conn(0x7f1a78060840 msgr2=0x7f1a780b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:13.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 shutdown_connections 2021-11-15T14:41:13.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.160+0000 7f1a7f8c3700 1 -- 172.21.2.135:0/150460680 wait complete. 2021-11-15T14:41:13.172 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-15T14:41:13.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 Processor -- start 2021-11-15T14:41:13.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- start start 2021-11-15T14:41:13.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0520 0x7f5ad00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00b2b70 con 0x7f5ad00b0900 2021-11-15T14:41:13.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00b27f0 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00b2da0 con 0x7f5ad00b0520 2021-11-15T14:41:13.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59860/0 (socket says 172.21.2.135:59860) 2021-11-15T14:41:13.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/1408703252 learned_addr learned my addr 172.21.2.135:0/1408703252 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:13.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5aced9d700 1 --1- 172.21.2.135:0/1408703252 >> v1:172.21.2.135:6789/0 conn(0x7f5ad00b0900 0x7f5ad0143790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47446/0 (socket says 172.21.2.135:47446) 2021-11-15T14:41:13.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/1408703252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0520 msgr2=0x7f5ad00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:13.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- 172.21.2.135:0/1408703252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0520 0x7f5ad00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/1408703252 >> v1:172.21.2.135:6789/0 conn(0x7f5ad00b0900 legacy=0x7f5ad0143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/1408703252 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00a9bf0 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- 172.21.2.135:0/1408703252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f5ac8001490 tx=0x7f5ac0006f40).ready entity=mon.1 client_cookie=dbccf14768b8c71e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acd59a700 1 -- 172.21.2.135:0/1408703252 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac000db30 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acd59a700 1 -- 172.21.2.135:0/1408703252 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0000e90 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acd59a700 1 -- 172.21.2.135:0/1408703252 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac000be90 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/1408703252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00aa1a0 msgr2=0x7f5ad00ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:13.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/1408703252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f5ac8001490 tx=0x7f5ac0006f40).stop 2021-11-15T14:41:13.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/1408703252 shutdown_connections 2021-11-15T14:41:13.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/1408703252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00ae2a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:13.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/1408703252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0520 0x7f5ad00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/1408703252 >> 172.21.2.135:0/1408703252 conn(0x7f5ad0060840 msgr2=0x7f5ad0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:13.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/1408703252 shutdown_connections 2021-11-15T14:41:13.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/1408703252 wait complete. 2021-11-15T14:41:13.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 Processor -- start 2021-11-15T14:41:13.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- start start 2021-11-15T14:41:13.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0900 0x7f5ad0143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00a9840 con 0x7f5ad00aa1a0 2021-11-15T14:41:13.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0063e60 con 0x7f5ad00b0520 2021-11-15T14:41:13.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5ad4cf8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0064090 con 0x7f5ad00b0900 2021-11-15T14:41:13.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59862/0 (socket says 172.21.2.135:59862) 2021-11-15T14:41:13.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/725495395 learned_addr learned my addr 172.21.2.135:0/725495395 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:13.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0900 msgr2=0x7f5ad0143130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:13.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0900 0x7f5ad0143130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.220+0000 7f5acdd9b700 1 -- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ad00aa1a0 msgr2=0x7f5ad00b6a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:13.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5acdd9b700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00b6a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:13.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5acdd9b700 1 -- 172.21.2.135:0/725495395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac000b460 con 0x7f5ad00b0520 2021-11-15T14:41:13.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5acdd9b700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f5ad00a9980 tx=0x7f5ac0006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac001f070 con 0x7f5ad00b0520 2021-11-15T14:41:13.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0010d90 con 0x7f5ad00b0520 2021-11-15T14:41:13.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac0024600 con 0x7f5ad00b0520 2021-11-15T14:41:13.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad014e2d0 con 0x7f5ad00b0520 2021-11-15T14:41:13.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad00b7140 con 0x7f5ad00b0520 2021-11-15T14:41:13.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00573d0 con 0x7f5ad00b0520 2021-11-15T14:41:13.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ac0018410 con 0x7f5ad00b0520 2021-11-15T14:41:13.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 0x7f5ab4059f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:13.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f5ac006cd00 con 0x7f5ad00b0520 2021-11-15T14:41:13.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ace59c700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 0x7f5ab4059f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:13.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ace59c700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 0x7f5ab4059f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5ab8002f70 tx=0x7f5ab8006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:13.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.224+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ac0070030 con 0x7f5ad00b0520 2021-11-15T14:41:13.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:13.336+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f5ad00446d0 con 0x7f5ad00b0520 2021-11-15T14:41:14.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.000+0000 7f5ac77fe700 1 -- 172.21.2.135:0/725495395 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v279) v1 ==== 139+0+0 (secure 0 0 0) 0x7f5ac0043f60 con 0x7f5ad00b0520 2021-11-15T14:41:14.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 msgr2=0x7f5ab4059f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 0x7f5ab4059f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5ab8002f70 tx=0x7f5ab8006a00).stop 2021-11-15T14:41:14.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 msgr2=0x7f5ad014ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f5ad00a9980 tx=0x7f5ac0006f40).stop 2021-11-15T14:41:14.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 shutdown_connections 2021-11-15T14:41:14.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ab4057a50 0x7f5ab4059f10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:14.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ad00b0900 0x7f5ad0143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:14.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ad00b0520 0x7f5ad014ea10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:14.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 --2- 172.21.2.135:0/725495395 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ad00aa1a0 0x7f5ad00b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:14.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 >> 172.21.2.135:0/725495395 conn(0x7f5ad0060840 msgr2=0x7f5ad0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:14.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 shutdown_connections 2021-11-15T14:41:14.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.004+0000 7f5ad4cf8700 1 -- 172.21.2.135:0/725495395 wait complete. 2021-11-15T14:41:14.013 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:41:14.013 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:41:14.014 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-15T14:41:14.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.060+0000 7f241abd8700 1 Processor -- start 2021-11-15T14:41:14.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.060+0000 7f241abd8700 1 -- start start 2021-11-15T14:41:14.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 0x7f24140ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140af110 con 0x7f24140b1300 2021-11-15T14:41:14.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2414140390 con 0x7f2414140d70 2021-11-15T14:41:14.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2414140630 con 0x7f24140a8cf0 2021-11-15T14:41:14.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:14.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2413fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 0x7f24140ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:14.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41418/0 (socket says 172.21.2.135:41418) 2021-11-15T14:41:14.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 -- 172.21.2.135:0/719554208 learned_addr learned my addr 172.21.2.135:0/719554208 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:14.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 -- 172.21.2.135:0/719554208 >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 msgr2=0x7f24140ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:14.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 --2- 172.21.2.135:0/719554208 >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 0x7f24140ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:14.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 -- 172.21.2.135:0/719554208 >> v1:172.21.2.119:6789/0 conn(0x7f24140b1300 legacy=0x7f24140b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 -- 172.21.2.135:0/719554208 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24141408d0 con 0x7f24140a8cf0 2021-11-15T14:41:14.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2413fff700 1 --2- 172.21.2.135:0/719554208 >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 0x7f24140ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:41:14.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f2419175700 1 --2- 172.21.2.135:0/719554208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f240c0032f0 tx=0x7f240c009290).ready entity=mon.2 client_cookie=cd043ee46f6bb97 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:14.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f24137fe700 1 -- 172.21.2.135:0/719554208 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f240c00b8a0 con 0x7f24140a8cf0 2021-11-15T14:41:14.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f24137fe700 1 -- 172.21.2.135:0/719554208 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c00ba00 con 0x7f24140a8cf0 2021-11-15T14:41:14.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f24137fe700 1 -- 172.21.2.135:0/719554208 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f240c00bb70 con 0x7f24140a8cf0 2021-11-15T14:41:14.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- 172.21.2.135:0/719554208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 msgr2=0x7f24140aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 --2- 172.21.2.135:0/719554208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f240c0032f0 tx=0x7f240c009290).stop 2021-11-15T14:41:14.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- 172.21.2.135:0/719554208 shutdown_connections 2021-11-15T14:41:14.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 --2- 172.21.2.135:0/719554208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f24140aec20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:14.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 --2- 172.21.2.135:0/719554208 >> v2:172.21.2.119:3300/0 conn(0x7f2414140d70 0x7f24140ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:14.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.064+0000 7f241abd8700 1 -- 172.21.2.135:0/719554208 >> 172.21.2.135:0/719554208 conn(0x7f241405f730 msgr2=0x7f241405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:14.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- 172.21.2.135:0/719554208 shutdown_connections 2021-11-15T14:41:14.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- 172.21.2.135:0/719554208 wait complete. 2021-11-15T14:41:14.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 Processor -- start 2021-11-15T14:41:14.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- start start 2021-11-15T14:41:14.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f241412da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2414140d70 0x7f24140a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241412df30 con 0x7f2414140d70 2021-11-15T14:41:14.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241412e160 con 0x7f24140b1300 2021-11-15T14:41:14.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24140b5120 con 0x7f24140a8cf0 2021-11-15T14:41:14.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:14.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59876/0 (socket says 172.21.2.135:59876) 2021-11-15T14:41:14.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 -- 172.21.2.135:0/1420391454 learned_addr learned my addr 172.21.2.135:0/1420391454 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:14.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 -- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 msgr2=0x7f241412da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f241412da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:14.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 -- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2414140d70 msgr2=0x7f24140a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:14.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2414140d70 0x7f24140a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:14.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 -- 172.21.2.135:0/1420391454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc00b180 con 0x7f24140b1300 2021-11-15T14:41:14.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2413fff700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f24140b3820 tx=0x7f23fc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:14.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23fc00c9e0 con 0x7f24140b1300 2021-11-15T14:41:14.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc00cb40 con 0x7f24140b1300 2021-11-15T14:41:14.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c009530 con 0x7f24140b1300 2021-11-15T14:41:14.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241412e6f0 con 0x7f24140b1300 2021-11-15T14:41:14.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23fc00cea0 con 0x7f24140b1300 2021-11-15T14:41:14.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24140b5320 con 0x7f24140b1300 2021-11-15T14:41:14.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23fc01c460 con 0x7f24140b1300 2021-11-15T14:41:14.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 0x7f23f8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:14.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f23fc06bee0 con 0x7f24140b1300 2021-11-15T14:41:14.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.068+0000 7f2418974700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 0x7f23f8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:14.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.072+0000 7f2418974700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 0x7f23f8055bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f24140625a0 tx=0x7f24040077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:14.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.072+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23fc043030 con 0x7f24140b1300 2021-11-15T14:41:14.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:14.184+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f241412e330 con 0x7f24140b1300 2021-11-15T14:41:15.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f2411ffb700 1 -- 172.21.2.135:0/1420391454 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v280) v1 ==== 129+0+0 (secure 0 0 0) 0x7f23fc046650 con 0x7f24140b1300 2021-11-15T14:41:15.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 msgr2=0x7f23f8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 0x7f23f8055bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f24140625a0 tx=0x7f24040077d0).stop 2021-11-15T14:41:15.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 msgr2=0x7f24140a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f24140b3820 tx=0x7f23fc006df0).stop 2021-11-15T14:41:15.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 shutdown_connections 2021-11-15T14:41:15.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23f80536f0 0x7f23f8055bb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2414140d70 0x7f24140a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24140b1300 0x7f24140a74c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 --2- 172.21.2.135:0/1420391454 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24140a8cf0 0x7f241412da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 >> 172.21.2.135:0/1420391454 conn(0x7f241405f730 msgr2=0x7f241413ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 shutdown_connections 2021-11-15T14:41:15.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.008+0000 7f241abd8700 1 -- 172.21.2.135:0/1420391454 wait complete. 2021-11-15T14:41:15.018 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:41:15.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 Processor -- start 2021-11-15T14:41:15.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 -- start start 2021-11-15T14:41:15.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 0x7f1a18065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a180b2430 con 0x7f1a180b3950 2021-11-15T14:41:15.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a18065770 con 0x7f1a180b2ca0 2021-11-15T14:41:15.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1cd92700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180b26d0 con 0x7f1a18060040 2021-11-15T14:41:15.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1659c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a16d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 0x7f1a18065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1659c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41428/0 (socket says 172.21.2.135:41428) 2021-11-15T14:41:15.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a16d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 0x7f1a18065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:53702/0 (socket says 172.21.2.135:53702) 2021-11-15T14:41:15.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.068+0000 7f1a1659c700 1 -- 172.21.2.135:0/2038540947 learned_addr learned my addr 172.21.2.135:0/2038540947 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 -- 172.21.2.135:0/2038540947 >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 msgr2=0x7f1a18065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 --2- 172.21.2.135:0/2038540947 >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 0x7f1a18065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 -- 172.21.2.135:0/2038540947 >> v1:172.21.2.119:6789/0 conn(0x7f1a180b3950 legacy=0x7f1a180b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 -- 172.21.2.135:0/2038540947 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180b2970 con 0x7f1a18060040 2021-11-15T14:41:15.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 --2- 172.21.2.135:0/2038540947 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1a08002f70 tx=0x7f1a08006f40).ready entity=mon.2 client_cookie=e5fb5bd99aac9769 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1559a700 1 -- 172.21.2.135:0/2038540947 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a08012070 con 0x7f1a18060040 2021-11-15T14:41:15.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1559a700 1 -- 172.21.2.135:0/2038540947 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08000e90 con 0x7f1a18060040 2021-11-15T14:41:15.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1559a700 1 -- 172.21.2.135:0/2038540947 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a0800f9f0 con 0x7f1a18060040 2021-11-15T14:41:15.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/2038540947 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 msgr2=0x7f1a18064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/2038540947 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1a08002f70 tx=0x7f1a08006f40).stop 2021-11-15T14:41:15.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/2038540947 shutdown_connections 2021-11-15T14:41:15.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/2038540947 >> v2:172.21.2.119:3300/0 conn(0x7f1a180b2ca0 0x7f1a18065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/2038540947 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a18064d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/2038540947 >> 172.21.2.135:0/2038540947 conn(0x7f1a1805cfe0 msgr2=0x7f1a1805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/2038540947 shutdown_connections 2021-11-15T14:41:15.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/2038540947 wait complete. 2021-11-15T14:41:15.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 Processor -- start 2021-11-15T14:41:15.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- start start 2021-11-15T14:41:15.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a180b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a180b2ca0 0x7f1a180ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180af180 con 0x7f1a180b2ca0 2021-11-15T14:41:15.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180ab9c0 con 0x7f1a180b3950 2021-11-15T14:41:15.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180addc0 con 0x7f1a18060040 2021-11-15T14:41:15.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59894/0 (socket says 172.21.2.135:59894) 2021-11-15T14:41:15.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 -- 172.21.2.135:0/3863080821 learned_addr learned my addr 172.21.2.135:0/3863080821 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1659c700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a180b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a15d9b700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a180b2ca0 0x7f1a180ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 -- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 msgr2=0x7f1a180b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a180b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 -- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a180b2ca0 msgr2=0x7f1a180ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a180b2ca0 0x7f1a180ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 -- 172.21.2.135:0/3863080821 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0800d660 con 0x7f1a180b3950 2021-11-15T14:41:15.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a16d9d700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1a180af2c0 tx=0x7f1a100091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1000eee0 con 0x7f1a180b3950 2021-11-15T14:41:15.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000c850 con 0x7f1a180b3950 2021-11-15T14:41:15.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1000cbb0 con 0x7f1a180b3950 2021-11-15T14:41:15.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a180abbf0 con 0x7f1a180b3950 2021-11-15T14:41:15.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.072+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180ae060 con 0x7f1a180b3950 2021-11-15T14:41:15.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a180648f0 con 0x7f1a180b3950 2021-11-15T14:41:15.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a1000cd10 con 0x7f1a180b3950 2021-11-15T14:41:15.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a0f7fe700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 0x7f19fc0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f1a1006bb60 con 0x7f1a180b3950 2021-11-15T14:41:15.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a1659c700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 0x7f19fc0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a1659c700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 0x7f19fc0559e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1a0800c000 tx=0x7f1a1806a630).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.076+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a10042d10 con 0x7f1a180b3950 2021-11-15T14:41:15.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.160+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1a180573d0 con 0x7f1a180b3950 2021-11-15T14:41:15.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.168+0000 7f1a0f7fe700 1 -- 172.21.2.135:0/3863080821 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a10046330 con 0x7f1a180b3950 2021-11-15T14:41:15.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 msgr2=0x7f19fc0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 0x7f19fc0559e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1a0800c000 tx=0x7f1a1806a630).stop 2021-11-15T14:41:15.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 msgr2=0x7f1a180aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1a180af2c0 tx=0x7f1a100091d0).stop 2021-11-15T14:41:15.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 shutdown_connections 2021-11-15T14:41:15.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19fc053520 0x7f19fc0559e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1a180b3950 0x7f1a180aec90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1a180b2ca0 0x7f1a180ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 --2- 172.21.2.135:0/3863080821 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1a18060040 0x7f1a180b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 >> 172.21.2.135:0/3863080821 conn(0x7f1a1805cfe0 msgr2=0x7f1a18143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 shutdown_connections 2021-11-15T14:41:15.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.172+0000 7f1a1cd92700 1 -- 172.21.2.135:0/3863080821 wait complete. 2021-11-15T14:41:15.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:15.181 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:15.210 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:15.223 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:15.233 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:15.246 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:15.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:15.247 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:15.247 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:15.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:15.294 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:41:15.294 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:15.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:15.295 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:15.296 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:15.301 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:41:15.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:15.303 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:15.303 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:15.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.356+0000 7f5460d5e700 1 Processor -- start 2021-11-15T14:41:15.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.356+0000 7f5460d5e700 1 -- start start 2021-11-15T14:41:15.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f545c0b1e30 0x7f545c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f545c0a7140 0x7f545c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c0b03d0 con 0x7f545c148420 2021-11-15T14:41:15.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0a9140 con 0x7f545c0b1e30 2021-11-15T14:41:15.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0b0670 con 0x7f545c0a7140 2021-11-15T14:41:15.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f545c0a7140 0x7f545c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f545c0a7140 0x7f545c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59900/0 (socket says 172.21.2.135:59900) 2021-11-15T14:41:15.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 -- 172.21.2.135:0/80447138 learned_addr learned my addr 172.21.2.135:0/80447138 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 -- 172.21.2.135:0/80447138 >> v2:172.21.2.119:3300/0 conn(0x7f545c0b1e30 msgr2=0x7f545c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 --2- 172.21.2.135:0/80447138 >> v2:172.21.2.119:3300/0 conn(0x7f545c0b1e30 0x7f545c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 -- 172.21.2.135:0/80447138 >> v1:172.21.2.119:6789/0 conn(0x7f545c148420 legacy=0x7f545c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 -- 172.21.2.135:0/80447138 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c0b0910 con 0x7f545c0a7140 2021-11-15T14:41:15.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545ad9d700 1 --2- 172.21.2.135:0/80447138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0a7140 0x7f545c1447a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f545c1477b0 tx=0x7f5454009290).ready entity=mon.1 client_cookie=e00190108d2fce2e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545959a700 1 -- 172.21.2.135:0/80447138 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400b820 con 0x7f545c0a7140 2021-11-15T14:41:15.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545959a700 1 -- 172.21.2.135:0/80447138 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400b980 con 0x7f545c0a7140 2021-11-15T14:41:15.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f545959a700 1 -- 172.21.2.135:0/80447138 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400bb30 con 0x7f545c0a7140 2021-11-15T14:41:15.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- 172.21.2.135:0/80447138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0a7140 msgr2=0x7f545c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- 172.21.2.135:0/80447138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0a7140 0x7f545c1447a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f545c1477b0 tx=0x7f5454009290).stop 2021-11-15T14:41:15.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- 172.21.2.135:0/80447138 shutdown_connections 2021-11-15T14:41:15.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- 172.21.2.135:0/80447138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0a7140 0x7f545c1447a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- 172.21.2.135:0/80447138 >> v2:172.21.2.119:3300/0 conn(0x7f545c0b1e30 0x7f545c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- 172.21.2.135:0/80447138 >> 172.21.2.135:0/80447138 conn(0x7f545c05f730 msgr2=0x7f545c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- 172.21.2.135:0/80447138 shutdown_connections 2021-11-15T14:41:15.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- 172.21.2.135:0/80447138 wait complete. 2021-11-15T14:41:15.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 Processor -- start 2021-11-15T14:41:15.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- start start 2021-11-15T14:41:15.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c0a7140 0x7f545c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c148420 0x7f545c143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1444d0 con 0x7f545c0a7140 2021-11-15T14:41:15.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0abb50 con 0x7f545c0b1e30 2021-11-15T14:41:15.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5460d5e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0af8b0 con 0x7f545c148420 2021-11-15T14:41:15.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59906/0 (socket says 172.21.2.135:59906) 2021-11-15T14:41:15.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 -- 172.21.2.135:0/1825643909 learned_addr learned my addr 172.21.2.135:0/1825643909 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 -- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c148420 msgr2=0x7f545c143fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:15.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c148420 0x7f545c143fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 -- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c0a7140 msgr2=0x7f545c0a9800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:15.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c0a7140 0x7f545c0a9800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.360+0000 7f5459d9b700 1 -- 172.21.2.135:0/1825643909 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009530 con 0x7f545c0b1e30 2021-11-15T14:41:15.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f5459d9b700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f5444002f10 tx=0x7f5444006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5444009e00 con 0x7f545c0b1e30 2021-11-15T14:41:15.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400f510 con 0x7f545c0b1e30 2021-11-15T14:41:15.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c0afb50 con 0x7f545c0b1e30 2021-11-15T14:41:15.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544400f680 con 0x7f545c0b1e30 2021-11-15T14:41:15.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c0ae8f0 con 0x7f545c0b1e30 2021-11-15T14:41:15.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c0adee0 con 0x7f545c0b1e30 2021-11-15T14:41:15.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f544400f070 con 0x7f545c0b1e30 2021-11-15T14:41:15.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 0x7f5440055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f544406b0a0 con 0x7f545c0b1e30 2021-11-15T14:41:15.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f545a59c700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 0x7f5440055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f545a59c700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 0x7f5440055b60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f544c002f70 tx=0x7f544c006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.364+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5444042360 con 0x7f545c0b1e30 2021-11-15T14:41:15.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f545c0aea80 con 0x7f545c0b1e30 2021-11-15T14:41:15.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f54537fe700 1 -- 172.21.2.135:0/1825643909 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v82) v1 ==== 81+0+29292 (secure 0 0 0) 0x7f5444045980 con 0x7f545c0b1e30 2021-11-15T14:41:15.452 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:15.452 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 82, 2021-11-15T14:41:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:41:12.981815+0000", 2021-11-15T14:41:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 14, 2021-11-15T14:41:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:15.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:15.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:15.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:15.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:15.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:15.469 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:15.469 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:15.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:15.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.470 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:15.470 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:15.470 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:15.470 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:15.470 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 66, 2021-11-15T14:41:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 75, 2021-11-15T14:41:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 75, 2021-11-15T14:41:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:15.622 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.622 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:15.622 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.622 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.622 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.623 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.623 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.623 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:15.623 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.624 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.624 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.624 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:15.624 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.625 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.625 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.625 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.625 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.626 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:15.626 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.626 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.626 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.627 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:15.627 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.627 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.627 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.627 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.628 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.628 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:15.628 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.628 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.628 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.629 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:15.629 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.629 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.629 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.629 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.630 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.630 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:15.630 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.630 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.630 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.631 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:15.631 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.631 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.631 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.631 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.632 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.632 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:15.632 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.632 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.633 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.633 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:15.633 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.633 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.633 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.634 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.634 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.634 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:15.634 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.634 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.635 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.635 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:15.635 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.635 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.635 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.636 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.636 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.636 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:15.636 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.636 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.637 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:15.637 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:15.637 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:15.637 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:15.637 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:15.638 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:15.638 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:15.638 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:15.638 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:15.639 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.639 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:15.639 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:15.639 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:15.640 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:15.640 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:15.640 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:41:15.640 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/1605423856": "2021-11-16T14:41:09.280467+0000", 2021-11-15T14:41:15.640 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6832/1605423856": "2021-11-16T14:41:09.280467+0000", 2021-11-15T14:41:15.641 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.138:0/1859864213": "2021-11-15T15:40:58.985252+0000" 2021-11-15T14:41:15.641 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.641 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:15.641 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:15.641 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:15.642 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:15.642 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:15.642 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:15.642 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:15.643 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:15.643 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:15.643 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:15.643 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:15.643 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:15.644 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.644 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:15.644 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:15.644 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:15.644 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:15.645 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:15.645 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:15.645 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:15.645 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:15.645 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:15.646 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:15.646 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:15.646 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:15.646 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:15.647 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:15.647 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 msgr2=0x7f5440055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 0x7f5440055b60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f544c002f70 tx=0x7f544c006a00).stop 2021-11-15T14:41:15.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 msgr2=0x7f545c143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f5444002f10 tx=0x7f5444006d60).stop 2021-11-15T14:41:15.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 shutdown_connections 2021-11-15T14:41:15.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f54400536a0 0x7f5440055b60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f545c148420 0x7f545c143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f545c0b1e30 0x7f545c143af0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 --2- 172.21.2.135:0/1825643909 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f545c0a7140 0x7f545c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 >> 172.21.2.135:0/1825643909 conn(0x7f545c05f730 msgr2=0x7f545c0b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 shutdown_connections 2021-11-15T14:41:15.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.448+0000 7f5460d5e700 1 -- 172.21.2.135:0/1825643909 wait complete. 2021-11-15T14:41:15.651 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:15.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 Processor -- start 2021-11-15T14:41:15.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 -- start start 2021-11-15T14:41:15.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 0x7efd980b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd980b03d0 con 0x7efd980b1e30 2021-11-15T14:41:15.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd980b0670 con 0x7efd980a7140 2021-11-15T14:41:15.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9fc83700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980a9140 con 0x7efd98148420 2021-11-15T14:41:15.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9e220700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7efd980a7140 0x7efd981447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47504/0 (socket says 172.21.2.135:47504) 2021-11-15T14:41:15.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9e220700 1 -- 172.21.2.135:0/4206084106 learned_addr learned my addr 172.21.2.135:0/4206084106 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:15.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9d21e700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 0x7efd980b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451282694 0 0) 0x7efd980b0670 con 0x7efd980a7140 2021-11-15T14:41:15.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd80003260 con 0x7efd980a7140 2021-11-15T14:41:15.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637190969 0 0) 0x7efd80003260 con 0x7efd980a7140 2021-11-15T14:41:15.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 msgr2=0x7efd980b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 0x7efd980b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 >> v1:172.21.2.119:6789/0 conn(0x7efd980b1e30 legacy=0x7efd980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980b0910 con 0x7efd980a7140 2021-11-15T14:41:15.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7efd900019e0 con 0x7efd980a7140 2021-11-15T14:41:15.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 >> v1:172.21.2.135:6789/0 conn(0x7efd980a7140 legacy=0x7efd981447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd800037d0 0x7efd80003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 0x7efd80004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd800049f0 0x7efd80004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8000b800 con 0x7efd800049f0 2021-11-15T14:41:15.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8000b970 con 0x7efd800037d0 2021-11-15T14:41:15.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8000bb30 con 0x7efd98148420 2021-11-15T14:41:15.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.760+0000 7efd9da1f700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd800037d0 0x7efd80003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 -- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 msgr2=0x7efd80004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd98148420 0x7efd80004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 -- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd800049f0 msgr2=0x7efd80004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd800049f0 0x7efd80004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 -- 172.21.2.135:0/4206084106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80003260 con 0x7efd800037d0 2021-11-15T14:41:15.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd800037d0 0x7efd80003bf0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7efd98061420 tx=0x7efd94007a00).ready entity=mon.1 client_cookie=69d8463bc4767483 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd94007d10 con 0x7efd800037d0 2021-11-15T14:41:15.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd94007030 con 0x7efd800037d0 2021-11-15T14:41:15.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9ca1d700 1 -- 172.21.2.135:0/4206084106 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd94007390 con 0x7efd800037d0 2021-11-15T14:41:15.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/4206084106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd800037d0 msgr2=0x7efd80003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 --2- 172.21.2.135:0/4206084106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd800037d0 0x7efd80003bf0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7efd98061420 tx=0x7efd94007a00).stop 2021-11-15T14:41:15.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9e220700 1 -- 172.21.2.135:0/4206084106 reap_dead start 2021-11-15T14:41:15.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/4206084106 shutdown_connections 2021-11-15T14:41:15.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/4206084106 >> 172.21.2.135:0/4206084106 conn(0x7efd9805f730 msgr2=0x7efd9805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/4206084106 shutdown_connections 2021-11-15T14:41:15.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/4206084106 wait complete. 2021-11-15T14:41:15.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 Processor -- start 2021-11-15T14:41:15.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- start start 2021-11-15T14:41:15.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd98149f50 0x7efd980aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd980ac440 0x7efd98143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9814a330 con 0x7efd98149f50 2021-11-15T14:41:15.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980ab0c0 con 0x7efd9814b5d0 2021-11-15T14:41:15.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980ab320 con 0x7efd980ac440 2021-11-15T14:41:15.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59928/0 (socket says 172.21.2.135:59928) 2021-11-15T14:41:15.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 -- 172.21.2.135:0/104573245 learned_addr learned my addr 172.21.2.135:0/104573245 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9e220700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd980ac440 0x7efd98143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9da1f700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd98149f50 0x7efd980aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 -- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd980ac440 msgr2=0x7efd98143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd980ac440 0x7efd98143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 -- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd98149f50 msgr2=0x7efd980aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd98149f50 0x7efd980aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 -- 172.21.2.135:0/104573245 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980ab5c0 con 0x7efd9814b5d0 2021-11-15T14:41:15.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9d21e700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7efd8c00c000 tx=0x7efd8c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd8c016070 con 0x7efd9814b5d0 2021-11-15T14:41:15.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c000e90 con 0x7efd9814b5d0 2021-11-15T14:41:15.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd98149050 con 0x7efd9814b5d0 2021-11-15T14:41:15.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd8c00ca20 con 0x7efd9814b5d0 2021-11-15T14:41:15.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.764+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9814af30 con 0x7efd9814b5d0 2021-11-15T14:41:15.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd980ab750 con 0x7efd9814b5d0 2021-11-15T14:41:15.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd8c00cb80 con 0x7efd9814b5d0 2021-11-15T14:41:15.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd8affd700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 0x7efd780559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7efd8c06b840 con 0x7efd9814b5d0 2021-11-15T14:41:15.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd9da1f700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 0x7efd780559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd9da1f700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 0x7efd780559b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7efd94016000 tx=0x7efd94013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.768+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd8c0429f0 con 0x7efd9814b5d0 2021-11-15T14:41:15.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.876+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd980573d0 con 0x7efd9814b5d0 2021-11-15T14:41:15.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.876+0000 7efd8affd700 1 -- 172.21.2.135:0/104573245 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1559 (secure 0 0 0) 0x7efd8c046010 con 0x7efd9814b5d0 2021-11-15T14:41:15.882 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:15.882 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/610157651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":610157651},{"type":"v1","addr":"172.21.2.135:6834","nonce":610157651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-11-15T14:41:15.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 msgr2=0x7efd780559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 0x7efd780559b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7efd94016000 tx=0x7efd94013000).stop 2021-11-15T14:41:15.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 msgr2=0x7efd980abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7efd8c00c000 tx=0x7efd8c006df0).stop 2021-11-15T14:41:15.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 shutdown_connections 2021-11-15T14:41:15.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd780534f0 0x7efd780559b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd980ac440 0x7efd98143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd9814b5d0 0x7efd980abf50 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 --2- 172.21.2.135:0/104573245 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd98149f50 0x7efd980aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 >> 172.21.2.135:0/104573245 conn(0x7efd9805f730 msgr2=0x7efd980b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 shutdown_connections 2021-11-15T14:41:15.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.880+0000 7efd9fc83700 1 -- 172.21.2.135:0/104573245 wait complete. 2021-11-15T14:41:15.886 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 40 2021-11-15T14:41:15.890 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:15.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 Processor -- start 2021-11-15T14:41:15.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 -- start start 2021-11-15T14:41:15.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ee4060990 0x7f2ee40acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40b6d60 con 0x7f2ee40b6980 2021-11-15T14:41:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee4061260 con 0x7f2ee40aa650 2021-11-15T14:41:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee9740700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee4061500 con 0x7f2ee4060990 2021-11-15T14:41:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ee4060990 0x7f2ee40acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ee4060990 0x7f2ee40acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59934/0 (socket says 172.21.2.135:59934) 2021-11-15T14:41:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2ee40aa650 0x7f2ee413c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47522/0 (socket says 172.21.2.135:47522) 2021-11-15T14:41:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 -- 172.21.2.135:0/147093265 learned_addr learned my addr 172.21.2.135:0/147093265 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 -- 172.21.2.135:0/147093265 >> v1:172.21.2.135:6789/0 conn(0x7f2ee40aa650 legacy=0x7f2ee413c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 -- 172.21.2.135:0/147093265 >> v1:172.21.2.119:6789/0 conn(0x7f2ee40b6980 legacy=0x7f2ee40a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:15.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 -- 172.21.2.135:0/147093265 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40617a0 con 0x7f2ee4060990 2021-11-15T14:41:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee27fc700 1 --2- 172.21.2.135:0/147093265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee4060990 0x7f2ee40acdd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f2ee4060380 tx=0x7f2ed4006eb0).ready entity=mon.1 client_cookie=6a64a99a43e489e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee1ffb700 1 -- 172.21.2.135:0/147093265 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed4010810 con 0x7f2ee4060990 2021-11-15T14:41:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee1ffb700 1 -- 172.21.2.135:0/147093265 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4000e90 con 0x7f2ee4060990 2021-11-15T14:41:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.936+0000 7f2ee1ffb700 1 -- 172.21.2.135:0/147093265 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed4010ba0 con 0x7f2ee4060990 2021-11-15T14:41:15.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/147093265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee4060990 msgr2=0x7f2ee40acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 --2- 172.21.2.135:0/147093265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee4060990 0x7f2ee40acdd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f2ee4060380 tx=0x7f2ed4006eb0).stop 2021-11-15T14:41:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/147093265 shutdown_connections 2021-11-15T14:41:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 --2- 172.21.2.135:0/147093265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee4060990 0x7f2ee40acdd0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:15.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/147093265 >> 172.21.2.135:0/147093265 conn(0x7f2ee40b3500 msgr2=0x7f2ee40b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:15.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/147093265 shutdown_connections 2021-11-15T14:41:15.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/147093265 wait complete. 2021-11-15T14:41:15.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 Processor -- start 2021-11-15T14:41:15.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- start start 2021-11-15T14:41:15.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ee4060990 0x7f2ee40a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ee40b6980 0x7f2ee40adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4157ad0 con 0x7f2ee4060990 2021-11-15T14:41:15.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40acd80 con 0x7f2ee40aa650 2021-11-15T14:41:15.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40a8b30 con 0x7f2ee40b6980 2021-11-15T14:41:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59938/0 (socket says 172.21.2.135:59938) 2021-11-15T14:41:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 -- 172.21.2.135:0/198849493 learned_addr learned my addr 172.21.2.135:0/198849493 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 -- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ee40b6980 msgr2=0x7f2ee40adf50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:15.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ee40b6980 0x7f2ee40adf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 -- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ee4060990 msgr2=0x7f2ee40a8150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ee4060990 0x7f2ee40a8150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 -- 172.21.2.135:0/198849493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed400c2f0 con 0x7f2ee40aa650 2021-11-15T14:41:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee27fc700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f2ee4157c10 tx=0x7f2ed4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed4002f70 con 0x7f2ee40aa650 2021-11-15T14:41:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400c030 con 0x7f2ee40aa650 2021-11-15T14:41:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee4157670 con 0x7f2ee40aa650 2021-11-15T14:41:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40ad7e0 con 0x7f2ee40aa650 2021-11-15T14:41:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed4023630 con 0x7f2ee40aa650 2021-11-15T14:41:15.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee4061a40 con 0x7f2ee40aa650 2021-11-15T14:41:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ed400e040 con 0x7f2ee40aa650 2021-11-15T14:41:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 0x7f2ec8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f2ed406d250 con 0x7f2ee40aa650 2021-11-15T14:41:15.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.940+0000 7f2ee2ffd700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 0x7f2ec8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.944+0000 7f2ee2ffd700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 0x7f2ec8055be0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f2ecc002ef0 tx=0x7f2ecc006890).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:15.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:15.944+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ed4044400 con 0x7f2ee40aa650 2021-11-15T14:41:16.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ee40573d0 con 0x7f2ee40aa650 2021-11-15T14:41:16.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2edbfff700 1 -- 172.21.2.135:0/198849493 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f2ed4047a20 con 0x7f2ee40aa650 2021-11-15T14:41:16.056 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:16.056 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/2752728836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2752728836},{"type":"v1","addr":"172.21.2.119:6835","nonce":2752728836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/2845428553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":2845428553},{"type":"v1","addr":"172.21.2.135:6835","nonce":2845428553}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/610157651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":610157651},{"type":"v1","addr":"172.21.2.135:6834","nonce":610157651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40}],"filesystems":[]} 2021-11-15T14:41:16.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 msgr2=0x7f2ec8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 0x7f2ec8055be0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f2ecc002ef0 tx=0x7f2ecc006890).stop 2021-11-15T14:41:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 msgr2=0x7f2ee40a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f2ee4157c10 tx=0x7f2ed4017000).stop 2021-11-15T14:41:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 shutdown_connections 2021-11-15T14:41:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ec8053720 0x7f2ec8055be0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ee40b6980 0x7f2ee40adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ee40aa650 0x7f2ee40a8640 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 --2- 172.21.2.135:0/198849493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ee4060990 0x7f2ee40a8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 >> 172.21.2.135:0/198849493 conn(0x7f2ee40b3500 msgr2=0x7f2ee40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 shutdown_connections 2021-11-15T14:41:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.052+0000 7f2ee9740700 1 -- 172.21.2.135:0/198849493 wait complete. 2021-11-15T14:41:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 40 2021-11-15T14:41:16.063 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:41:16.063 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:41:16.064 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:41:16.064 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:16.064 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:41:16.065 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:41:16.065 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:41:16.065 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:16.066 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:41:16.066 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:41:16.066 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:41:16.066 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:16.069 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:41:16.069 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:41:16.071 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:41:16.071 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:41:16.072 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:41:16.072 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:16.073 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:41:16.074 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:16.075 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:41:16.075 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:41:16.103 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:41:16.104 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:41:16.124 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:41:16.124 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:16.124 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:41:16.162 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:41:16.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 Processor -- start 2021-11-15T14:41:16.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 -- start start 2021-11-15T14:41:16.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f986c148420 0x7f986c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:16.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0b03d0 con 0x7f986c0a7140 2021-11-15T14:41:16.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0b0670 con 0x7f986c0b1e30 2021-11-15T14:41:16.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9870c04700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0a9140 con 0x7f986c148420 2021-11-15T14:41:16.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f986c0b1e30 0x7f986c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47554/0 (socket says 172.21.2.135:47554) 2021-11-15T14:41:16.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9869d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f986c148420 0x7f986c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:16.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986a59c700 1 -- 172.21.2.135:0/420082680 learned_addr learned my addr 172.21.2.135:0/420082680 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:16.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986959a700 1 -- 172.21.2.135:0/420082680 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415453013 0 0) 0x7f986c0b0670 con 0x7f986c0b1e30 2021-11-15T14:41:16.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9869d9b700 1 -- 172.21.2.135:0/420082680 >> v1:172.21.2.135:6789/0 conn(0x7f986c0b1e30 legacy=0x7f986c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9869d9b700 1 -- 172.21.2.135:0/420082680 >> v1:172.21.2.119:6789/0 conn(0x7f986c0a7140 legacy=0x7f986c1447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:16.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9869d9b700 1 -- 172.21.2.135:0/420082680 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0b0910 con 0x7f986c148420 2021-11-15T14:41:16.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f9869d9b700 1 --2- 172.21.2.135:0/420082680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c148420 0x7f986c0b1050 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f986c0acee0 tx=0x7f9860006df0).ready entity=mon.1 client_cookie=93b92db875ef03e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:16.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986959a700 1 -- 172.21.2.135:0/420082680 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986000d5c0 con 0x7f986c148420 2021-11-15T14:41:16.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986959a700 1 -- 172.21.2.135:0/420082680 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860000e90 con 0x7f986c148420 2021-11-15T14:41:16.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.172+0000 7f986959a700 1 -- 172.21.2.135:0/420082680 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986000d910 con 0x7f986c148420 2021-11-15T14:41:16.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/420082680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c148420 msgr2=0x7f986c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 --2- 172.21.2.135:0/420082680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c148420 0x7f986c0b1050 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f986c0acee0 tx=0x7f9860006df0).stop 2021-11-15T14:41:16.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/420082680 shutdown_connections 2021-11-15T14:41:16.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 --2- 172.21.2.135:0/420082680 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c148420 0x7f986c0b1050 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:16.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/420082680 >> 172.21.2.135:0/420082680 conn(0x7f986c05f730 msgr2=0x7f986c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:16.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/420082680 shutdown_connections 2021-11-15T14:41:16.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/420082680 wait complete. 2021-11-15T14:41:16.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 Processor -- start 2021-11-15T14:41:16.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- start start 2021-11-15T14:41:16.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:16.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f986c0b1e30 0x7f986c0abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:16.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f986c148420 0x7f986c0ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:16.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0ac060 con 0x7f986c0b1e30 2021-11-15T14:41:16.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0aae90 con 0x7f986c0a7140 2021-11-15T14:41:16.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c14b020 con 0x7f986c148420 2021-11-15T14:41:16.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:16.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:59972/0 (socket says 172.21.2.135:59972) 2021-11-15T14:41:16.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 -- 172.21.2.135:0/2703128727 learned_addr learned my addr 172.21.2.135:0/2703128727 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:16.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 -- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f986c148420 msgr2=0x7f986c0ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f986c148420 0x7f986c0ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:16.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 -- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f986c0b1e30 msgr2=0x7f986c0abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:16.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f986c0b1e30 0x7f986c0abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:16.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 -- 172.21.2.135:0/2703128727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986000b180 con 0x7f986c0a7140 2021-11-15T14:41:16.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f986a59c700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f9864001250 tx=0x7f9864007e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:16.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9864005ba0 con 0x7f986c0a7140 2021-11-15T14:41:16.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9864005d00 con 0x7f986c0a7140 2021-11-15T14:41:16.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c14b2c0 con 0x7f986c0a7140 2021-11-15T14:41:16.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9864007300 con 0x7f986c0a7140 2021-11-15T14:41:16.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c14b800 con 0x7f986c0a7140 2021-11-15T14:41:16.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0b0bb0 con 0x7f986c0a7140 2021-11-15T14:41:16.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9864010030 con 0x7f986c0a7140 2021-11-15T14:41:16.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 0x7f9848055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:16.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f986406b870 con 0x7f986c0a7140 2021-11-15T14:41:16.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9869d9b700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 0x7f9848055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:16.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.176+0000 7f9869d9b700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 0x7f9848055be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f986c0acee0 tx=0x7f9860014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:16.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.180+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9864042b30 con 0x7f986c0a7140 2021-11-15T14:41:16.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:16.272+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f986c0aafd0 con 0x7f986c0a7140 2021-11-15T14:41:17.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.200+0000 7f985b7fe700 1 -- 172.21.2.135:0/2703128727 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9864046150 con 0x7f986c0a7140 2021-11-15T14:41:17.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 msgr2=0x7f9848055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 0x7f9848055be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f986c0acee0 tx=0x7f9860014000).stop 2021-11-15T14:41:17.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 msgr2=0x7f986c149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f9864001250 tx=0x7f9864007e40).stop 2021-11-15T14:41:17.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 shutdown_connections 2021-11-15T14:41:17.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9848053720 0x7f9848055be0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f986c148420 0x7f986c0ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f986c0b1e30 0x7f986c0abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 --2- 172.21.2.135:0/2703128727 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f986c0a7140 0x7f986c149de0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 >> 172.21.2.135:0/2703128727 conn(0x7f986c05f730 msgr2=0x7f986c146fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 shutdown_connections 2021-11-15T14:41:17.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.204+0000 7f9870c04700 1 -- 172.21.2.135:0/2703128727 wait complete. 2021-11-15T14:41:17.211 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:41:17.214 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:41:17.214 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:41:17.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 Processor -- start 2021-11-15T14:41:17.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 -- start start 2021-11-15T14:41:17.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 0x7f0f600b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0f600a7140 0x7f0f601447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600b03d0 con 0x7f0f600b1e30 2021-11-15T14:41:17.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600a9140 con 0x7f0f600a7140 2021-11-15T14:41:17.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f68636700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b0670 con 0x7f0f60148420 2021-11-15T14:41:17.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f663d2700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0f600b1e30 0x7f0f600b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47572/0 (socket says 172.21.2.135:47572) 2021-11-15T14:41:17.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.260+0000 7f0f663d2700 1 -- 172.21.2.135:0/2695402986 learned_addr learned my addr 172.21.2.135:0/2695402986 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:17.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919890760 0 0) 0x7f0f600b03d0 con 0x7f0f600b1e30 2021-11-15T14:41:17.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f48003260 con 0x7f0f600b1e30 2021-11-15T14:41:17.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345838001 0 0) 0x7f0f48003260 con 0x7f0f600b1e30 2021-11-15T14:41:17.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 msgr2=0x7f0f600b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 0x7f0f600b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 >> v2:172.21.2.119:3300/0 conn(0x7f0f600a7140 msgr2=0x7f0f601447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 --2- 172.21.2.135:0/2695402986 >> v2:172.21.2.119:3300/0 conn(0x7f0f600a7140 0x7f0f601447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600b0910 con 0x7f0f600b1e30 2021-11-15T14:41:17.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0f5c001660 con 0x7f0f600b1e30 2021-11-15T14:41:17.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 >> v1:172.21.2.135:6789/0 conn(0x7f0f600b1e30 legacy=0x7f0f600b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f48003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f48004500 0x7f0f48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 0x7f0f4800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b0670 con 0x7f0f48004500 2021-11-15T14:41:17.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48005280 con 0x7f0f480037d0 2021-11-15T14:41:17.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4800bc40 con 0x7f0f60148420 2021-11-15T14:41:17.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f48003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 msgr2=0x7f0f4800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f60148420 0x7f0f4800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f48004500 msgr2=0x7f0f48004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f48004500 0x7f0f48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/2695402986 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48003260 con 0x7f0f480037d0 2021-11-15T14:41:17.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f48003bf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f0f5c001370 tx=0x7f0f600b0aa0).ready entity=mon.1 client_cookie=49d6326473b550e3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f5c0070d0 con 0x7f0f480037d0 2021-11-15T14:41:17.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c007230 con 0x7f0f480037d0 2021-11-15T14:41:17.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f653d0700 1 -- 172.21.2.135:0/2695402986 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f5c00c8f0 con 0x7f0f480037d0 2021-11-15T14:41:17.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/2695402986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 msgr2=0x7f0f48003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 --2- 172.21.2.135:0/2695402986 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f48003bf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f0f5c001370 tx=0x7f0f600b0aa0).stop 2021-11-15T14:41:17.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f66bd3700 1 -- 172.21.2.135:0/2695402986 reap_dead start 2021-11-15T14:41:17.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/2695402986 shutdown_connections 2021-11-15T14:41:17.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/2695402986 >> 172.21.2.135:0/2695402986 conn(0x7f0f6005f730 msgr2=0x7f0f6005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/2695402986 shutdown_connections 2021-11-15T14:41:17.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/2695402986 wait complete. 2021-11-15T14:41:17.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 Processor -- start 2021-11-15T14:41:17.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- start start 2021-11-15T14:41:17.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f6014b850 0x7f0f600b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 0x7f0f600ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6014af30 con 0x7f0f600ab160 2021-11-15T14:41:17.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6014b1d0 con 0x7f0f480037d0 2021-11-15T14:41:17.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6014b470 con 0x7f0f6014b850 2021-11-15T14:41:17.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60000/0 (socket says 172.21.2.135:60000) 2021-11-15T14:41:17.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/3039051589 learned_addr learned my addr 172.21.2.135:0/3039051589 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f65bd1700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f6014b850 0x7f0f600b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f66bd3700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 0x7f0f600ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f6014b850 msgr2=0x7f0f600b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f6014b850 0x7f0f600b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 msgr2=0x7f0f600ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 0x7f0f600ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 -- 172.21.2.135:0/3039051589 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600abb00 con 0x7f0f480037d0 2021-11-15T14:41:17.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f66bd3700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 0x7f0f600ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:17.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f663d2700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f0f5c001370 tx=0x7f0f5c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f5c017070 con 0x7f0f480037d0 2021-11-15T14:41:17.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00ce50 con 0x7f0f480037d0 2021-11-15T14:41:17.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f60149eb0 con 0x7f0f480037d0 2021-11-15T14:41:17.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f5c0070d0 con 0x7f0f480037d0 2021-11-15T14:41:17.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.264+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f60143560 con 0x7f0f480037d0 2021-11-15T14:41:17.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6014b630 con 0x7f0f480037d0 2021-11-15T14:41:17.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f5c010070 con 0x7f0f480037d0 2021-11-15T14:41:17.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f4f7fe700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 0x7f0f40055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0f5c06c410 con 0x7f0f480037d0 2021-11-15T14:41:17.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f65bd1700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 0x7f0f40055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f65bd1700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 0x7f0f40055b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0f5000a000 tx=0x7f0f50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.268+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f5c043750 con 0x7f0f480037d0 2021-11-15T14:41:17.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0f600573d0 con 0x7f0f480037d0 2021-11-15T14:41:17.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f4f7fe700 1 -- 172.21.2.135:0/3039051589 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f0f5c046d70 con 0x7f0f480037d0 2021-11-15T14:41:17.388 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:17.388 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:17.388 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:41:17.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.389 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:41:17.389 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:41:17.389 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:17.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.390 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.391 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:41:17.391 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:41:17.392 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:17.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.392 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.393 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.393 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:41:17.394 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:41:17.394 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.394 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:17.394 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.395 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.395 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.395 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.396 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:41:17.396 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:41:17.396 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.396 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.397 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.397 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.397 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.398 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:41:17.398 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:41:17.398 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.398 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.399 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.399 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.399 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.399 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.400 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:41:17.400 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:41:17.400 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.400 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.401 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.401 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.401 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.402 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.402 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:41:17.402 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:41:17.402 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.403 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.403 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.403 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.403 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.404 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:41:17.404 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:41:17.404 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.405 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.405 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.405 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.405 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.405 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.406 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.406 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:41:17.406 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:41:17.406 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.407 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.407 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.407 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.407 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.407 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.408 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.408 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:41:17.408 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:41:17.408 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.409 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.409 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.409 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.409 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.410 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:41:17.410 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:41:17.410 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.411 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.411 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.411 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.411 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.412 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.412 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:41:17.412 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:41:17.412 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.413 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:17.413 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:17.413 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:17.413 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.414 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:41:17.414 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:41:17.414 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.415 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:17.415 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:17.415 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:17.415 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.416 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.416 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:41:17.416 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:41:17.416 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.417 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:17.417 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:17.417 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:17.417 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.418 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.418 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.418 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:41:17.418 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:41:17.419 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.419 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:17.419 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:17.419 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.420 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:17.420 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:17.420 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:41:17.421 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:41:17.421 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:17.421 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:17.421 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:17.421 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:17.422 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.422 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:17.422 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:17.422 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 msgr2=0x7f0f40055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 0x7f0f40055b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0f5000a000 tx=0x7f0f50008040).stop 2021-11-15T14:41:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 msgr2=0x7f0f6014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f0f5c001370 tx=0x7f0f5c013000).stop 2021-11-15T14:41:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 shutdown_connections 2021-11-15T14:41:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f40053660 0x7f0f40055b20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f600ab160 0x7f0f600ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f6014b850 0x7f0f600b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 --2- 172.21.2.135:0/3039051589 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f480037d0 0x7f0f6014a140 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 >> 172.21.2.135:0/3039051589 conn(0x7f0f6005f730 msgr2=0x7f0f601467e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 shutdown_connections 2021-11-15T14:41:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.384+0000 7f0f68636700 1 -- 172.21.2.135:0/3039051589 wait complete. 2021-11-15T14:41:17.427 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:17.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 Processor -- start 2021-11-15T14:41:17.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- start start 2021-11-15T14:41:17.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6da40a7140 0x7f6da41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40b03d0 con 0x7f6da4148420 2021-11-15T14:41:17.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40a9140 con 0x7f6da40a7140 2021-11-15T14:41:17.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b0670 con 0x7f6da40b1e30 2021-11-15T14:41:17.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6da40a7140 0x7f6da41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6da40a7140 0x7f6da41447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60008/0 (socket says 172.21.2.135:60008) 2021-11-15T14:41:17.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 -- 172.21.2.135:0/2536412580 learned_addr learned my addr 172.21.2.135:0/2536412580 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 -- 172.21.2.135:0/2536412580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 msgr2=0x7f6da40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 --2- 172.21.2.135:0/2536412580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 -- 172.21.2.135:0/2536412580 >> v1:172.21.2.119:6789/0 conn(0x7f6da4148420 legacy=0x7f6da40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 -- 172.21.2.135:0/2536412580 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40b0910 con 0x7f6da40a7140 2021-11-15T14:41:17.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da2d9d700 1 --2- 172.21.2.135:0/2536412580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da40a7140 0x7f6da41447a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f6da4061420 tx=0x7f6d9c009290).ready entity=mon.1 client_cookie=cc803161b6568cf0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da159a700 1 -- 172.21.2.135:0/2536412580 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9c00b860 con 0x7f6da40a7140 2021-11-15T14:41:17.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da159a700 1 -- 172.21.2.135:0/2536412580 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00b9c0 con 0x7f6da40a7140 2021-11-15T14:41:17.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da159a700 1 -- 172.21.2.135:0/2536412580 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9c00bb70 con 0x7f6da40a7140 2021-11-15T14:41:17.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- 172.21.2.135:0/2536412580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da40a7140 msgr2=0x7f6da41447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/2536412580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da40a7140 0x7f6da41447a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f6da4061420 tx=0x7f6d9c009290).stop 2021-11-15T14:41:17.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- 172.21.2.135:0/2536412580 shutdown_connections 2021-11-15T14:41:17.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/2536412580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da40a7140 0x7f6da41447a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/2536412580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- 172.21.2.135:0/2536412580 >> 172.21.2.135:0/2536412580 conn(0x7f6da405f730 msgr2=0x7f6da405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- 172.21.2.135:0/2536412580 shutdown_connections 2021-11-15T14:41:17.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- 172.21.2.135:0/2536412580 wait complete. 2021-11-15T14:41:17.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 Processor -- start 2021-11-15T14:41:17.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.476+0000 7f6da8cbb700 1 -- start start 2021-11-15T14:41:17.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6da40a7140 0x7f6da41427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da4149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da413e810 con 0x7f6da40a7140 2021-11-15T14:41:17.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da413f7e0 con 0x7f6da4148420 2021-11-15T14:41:17.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da413fdd0 con 0x7f6da40b1e30 2021-11-15T14:41:17.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60010/0 (socket says 172.21.2.135:60010) 2021-11-15T14:41:17.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 -- 172.21.2.135:0/947466007 learned_addr learned my addr 172.21.2.135:0/947466007 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 -- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 msgr2=0x7f6da4149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da4149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 -- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6da40a7140 msgr2=0x7f6da41427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6da40a7140 0x7f6da41427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 -- 172.21.2.135:0/947466007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009530 con 0x7f6da4148420 2021-11-15T14:41:17.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da2d9d700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f6da4061420 tx=0x7f6d9c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9c0032d0 con 0x7f6da4148420 2021-11-15T14:41:17.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00bb30 con 0x7f6da4148420 2021-11-15T14:41:17.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da4140070 con 0x7f6da4148420 2021-11-15T14:41:17.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da413f340 con 0x7f6da4148420 2021-11-15T14:41:17.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d9c020620 con 0x7f6da4148420 2021-11-15T14:41:17.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40b3b30 con 0x7f6da4148420 2021-11-15T14:41:17.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d9c026020 con 0x7f6da4148420 2021-11-15T14:41:17.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 0x7f6d88055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f6d9c06c790 con 0x7f6da4148420 2021-11-15T14:41:17.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da259c700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 0x7f6d88055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.480+0000 7f6da259c700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 0x7f6d88055b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.484+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d9c0439c0 con 0x7f6da4148420 2021-11-15T14:41:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6da4140200 con 0x7f6da4148420 2021-11-15T14:41:17.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6d9b7fe700 1 -- 172.21.2.135:0/947466007 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f6d9c015090 con 0x7f6da4148420 2021-11-15T14:41:17.572 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:17.573 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":86,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:17.191827+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 msgr2=0x7f6d88055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 0x7f6d88055b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d94006a80).stop 2021-11-15T14:41:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 msgr2=0x7f6da4149a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f6da4061420 tx=0x7f6d9c016000).stop 2021-11-15T14:41:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 shutdown_connections 2021-11-15T14:41:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d88053660 0x7f6d88055b20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6da4148420 0x7f6da4149a80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6da40b1e30 0x7f6da4149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 --2- 172.21.2.135:0/947466007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6da40a7140 0x7f6da41427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 >> 172.21.2.135:0/947466007 conn(0x7f6da405f730 msgr2=0x7f6da41433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 shutdown_connections 2021-11-15T14:41:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.568+0000 7f6da8cbb700 1 -- 172.21.2.135:0/947466007 wait complete. 2021-11-15T14:41:17.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:41:17.580 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:17.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 Processor -- start 2021-11-15T14:41:17.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 -- start start 2021-11-15T14:41:17.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f640c0b1f40 0x7f640c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0b0030 0x7f640c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0b04a0 con 0x7f640c0a7140 2021-11-15T14:41:17.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0b2810 con 0x7f640c0b1f40 2021-11-15T14:41:17.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f641215b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0b06d0 con 0x7f640c0b0030 2021-11-15T14:41:17.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f640c0b1f40 0x7f640c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f640c0b1f40 0x7f640c0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60018/0 (socket says 172.21.2.135:60018) 2021-11-15T14:41:17.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 -- 172.21.2.135:0/1270947586 learned_addr learned my addr 172.21.2.135:0/1270947586 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 -- 172.21.2.135:0/1270947586 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0b0030 msgr2=0x7f640c0b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:17.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 --2- 172.21.2.135:0/1270947586 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0b0030 0x7f640c0b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 -- 172.21.2.135:0/1270947586 >> v1:172.21.2.119:6789/0 conn(0x7f640c0a7140 legacy=0x7f640c1412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:17.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 -- 172.21.2.135:0/1270947586 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0b0970 con 0x7f640c0b1f40 2021-11-15T14:41:17.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.628+0000 7f640b7fe700 1 --2- 172.21.2.135:0/1270947586 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b1f40 0x7f640c0b1350 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f640c06a170 tx=0x7f63fc006eb0).ready entity=mon.1 client_cookie=3b7b44c345d2ab53 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640a7fc700 1 -- 172.21.2.135:0/1270947586 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc00d570 con 0x7f640c0b1f40 2021-11-15T14:41:17.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640a7fc700 1 -- 172.21.2.135:0/1270947586 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc000e90 con 0x7f640c0b1f40 2021-11-15T14:41:17.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640a7fc700 1 -- 172.21.2.135:0/1270947586 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc00d8c0 con 0x7f640c0b1f40 2021-11-15T14:41:17.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/1270947586 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b1f40 msgr2=0x7f640c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- 172.21.2.135:0/1270947586 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b1f40 0x7f640c0b1350 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f640c06a170 tx=0x7f63fc006eb0).stop 2021-11-15T14:41:17.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/1270947586 shutdown_connections 2021-11-15T14:41:17.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- 172.21.2.135:0/1270947586 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0b0030 0x7f640c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- 172.21.2.135:0/1270947586 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b1f40 0x7f640c0b1350 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/1270947586 >> 172.21.2.135:0/1270947586 conn(0x7f640c05f730 msgr2=0x7f640c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/1270947586 shutdown_connections 2021-11-15T14:41:17.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/1270947586 wait complete. 2021-11-15T14:41:17.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 Processor -- start 2021-11-15T14:41:17.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- start start 2021-11-15T14:41:17.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0a7140 0x7f640c14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f640c0b1f40 0x7f640c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c154920 con 0x7f640c0b1f40 2021-11-15T14:41:17.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0ac270 con 0x7f640c0b0030 2021-11-15T14:41:17.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0abfd0 con 0x7f640c0a7140 2021-11-15T14:41:17.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60024/0 (socket says 172.21.2.135:60024) 2021-11-15T14:41:17.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 -- 172.21.2.135:0/2786095458 learned_addr learned my addr 172.21.2.135:0/2786095458 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 -- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0a7140 msgr2=0x7f640c14a000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:17.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0a7140 0x7f640c14a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 -- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f640c0b1f40 msgr2=0x7f640c154430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:17.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f640c0b1f40 0x7f640c154430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 -- 172.21.2.135:0/2786095458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc00b1e0 con 0x7f640c0b0030 2021-11-15T14:41:17.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f640affd700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f640c156c30 tx=0x7f6400006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6400013460 con 0x7f640c0b0030 2021-11-15T14:41:17.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000135c0 con 0x7f640c0b0030 2021-11-15T14:41:17.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c157790 con 0x7f640c0b0030 2021-11-15T14:41:17.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6400013920 con 0x7f640c0b0030 2021-11-15T14:41:17.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c0a9b20 con 0x7f640c0b0030 2021-11-15T14:41:17.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c14a830 con 0x7f640c0b0030 2021-11-15T14:41:17.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f640000f070 con 0x7f640c0b0030 2021-11-15T14:41:17.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 0x7f63ec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.632+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f640006b180 con 0x7f640c0b0030 2021-11-15T14:41:17.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.636+0000 7f640b7fe700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 0x7f63ec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.636+0000 7f640b7fe700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 0x7f63ec0559b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f640c06a170 tx=0x7f63fc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.636+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64000424c0 con 0x7f640c0b0030 2021-11-15T14:41:17.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.720+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f640c1334d0 con 0x7f640c0b0030 2021-11-15T14:41:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f6408ff9700 1 -- 172.21.2.135:0/2786095458 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6400045ae0 con 0x7f640c0b0030 2021-11-15T14:41:17.731 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:17.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 msgr2=0x7f63ec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 0x7f63ec0559b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f640c06a170 tx=0x7f63fc015000).stop 2021-11-15T14:41:17.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 msgr2=0x7f640c153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f640c156c30 tx=0x7f6400006df0).stop 2021-11-15T14:41:17.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 shutdown_connections 2021-11-15T14:41:17.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63ec0534f0 0x7f63ec0559b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f640c0b1f40 0x7f640c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f640c0b0030 0x7f640c153f40 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 --2- 172.21.2.135:0/2786095458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f640c0a7140 0x7f640c14a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 >> 172.21.2.135:0/2786095458 conn(0x7f640c05f730 msgr2=0x7f640c0a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 shutdown_connections 2021-11-15T14:41:17.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.728+0000 7f641215b700 1 -- 172.21.2.135:0/2786095458 wait complete. 2021-11-15T14:41:17.738 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:17.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 Processor -- start 2021-11-15T14:41:17.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- start start 2021-11-15T14:41:17.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f66200b3790 0x7f66200b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66201439a0 con 0x7f66200a9c90 2021-11-15T14:41:17.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6620143c40 con 0x7f66200b0630 2021-11-15T14:41:17.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6620143ee0 con 0x7f66200b3790 2021-11-15T14:41:17.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661ffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f66200b0630 0x7f662013d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47620/0 (socket says 172.21.2.135:47620) 2021-11-15T14:41:17.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661ffff700 1 -- 172.21.2.135:0/1641176072 learned_addr learned my addr 172.21.2.135:0/1641176072 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:17.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661f7fe700 1 --2- 172.21.2.135:0/1641176072 >> v2:172.21.2.135:3300/0 conn(0x7f66200b3790 0x7f66200b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661effd700 1 -- 172.21.2.135:0/1641176072 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326075158 0 0) 0x7f6620143c40 con 0x7f66200b0630 2021-11-15T14:41:17.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661effd700 1 -- 172.21.2.135:0/1641176072 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6600003260 con 0x7f66200b0630 2021-11-15T14:41:17.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661f7fe700 1 -- 172.21.2.135:0/1641176072 >> v1:172.21.2.135:6789/0 conn(0x7f66200b0630 legacy=0x7f662013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661f7fe700 1 -- 172.21.2.135:0/1641176072 >> v1:172.21.2.119:6789/0 conn(0x7f66200a9c90 legacy=0x7f66200b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:17.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661f7fe700 1 -- 172.21.2.135:0/1641176072 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620144180 con 0x7f66200b3790 2021-11-15T14:41:17.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661f7fe700 1 --2- 172.21.2.135:0/1641176072 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b3790 0x7f66200b0a10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f662006aad0 tx=0x7f6610006df0).ready entity=mon.1 client_cookie=72acd45e96a37cb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661effd700 1 -- 172.21.2.135:0/1641176072 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661000d5c0 con 0x7f66200b3790 2021-11-15T14:41:17.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661effd700 1 -- 172.21.2.135:0/1641176072 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610000e90 con 0x7f66200b3790 2021-11-15T14:41:17.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f661effd700 1 -- 172.21.2.135:0/1641176072 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661000d910 con 0x7f66200b3790 2021-11-15T14:41:17.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- 172.21.2.135:0/1641176072 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b3790 msgr2=0x7f66200b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- 172.21.2.135:0/1641176072 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b3790 0x7f66200b0a10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f662006aad0 tx=0x7f6610006df0).stop 2021-11-15T14:41:17.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- 172.21.2.135:0/1641176072 shutdown_connections 2021-11-15T14:41:17.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- 172.21.2.135:0/1641176072 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b3790 0x7f66200b0a10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- 172.21.2.135:0/1641176072 >> 172.21.2.135:0/1641176072 conn(0x7f6620060840 msgr2=0x7f6620060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- 172.21.2.135:0/1641176072 shutdown_connections 2021-11-15T14:41:17.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- 172.21.2.135:0/1641176072 wait complete. 2021-11-15T14:41:17.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 Processor -- start 2021-11-15T14:41:17.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- start start 2021-11-15T14:41:17.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 0x7f66200aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f66200b3790 0x7f6620065cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620140950 con 0x7f66200b3790 2021-11-15T14:41:17.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620064430 con 0x7f66200b0630 2021-11-15T14:41:17.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.788+0000 7f66263b9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6620064e50 con 0x7f66200a9c90 2021-11-15T14:41:17.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60042/0 (socket says 172.21.2.135:60042) 2021-11-15T14:41:17.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 -- 172.21.2.135:0/2900564313 learned_addr learned my addr 172.21.2.135:0/2900564313 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661ffff700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 0x7f66200aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 -- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 msgr2=0x7f66200aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 0x7f66200aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 -- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f66200b3790 msgr2=0x7f6620065cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f66200b3790 0x7f6620065cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 -- 172.21.2.135:0/2900564313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661000b180 con 0x7f66200b0630 2021-11-15T14:41:17.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661ffff700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 0x7f66200aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:17.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661f7fe700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f6620064fe0 tx=0x7f6610014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6610016070 con 0x7f66200b0630 2021-11-15T14:41:17.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610013780 con 0x7f66200b0630 2021-11-15T14:41:17.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6610013ae0 con 0x7f66200b0630 2021-11-15T14:41:17.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6620064910 con 0x7f66200b0630 2021-11-15T14:41:17.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66200640b0 con 0x7f66200b0630 2021-11-15T14:41:17.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662013dce0 con 0x7f66200b0630 2021-11-15T14:41:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6610025030 con 0x7f66200b0630 2021-11-15T14:41:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 0x7f6604055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f661006c6a0 con 0x7f66200b0630 2021-11-15T14:41:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661ffff700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 0x7f6604055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.792+0000 7f661ffff700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 0x7f6604055b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f6608008000 tx=0x7f6608009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.796+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66100439e0 con 0x7f66200b0630 2021-11-15T14:41:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66200573d0 con 0x7f66200b0630 2021-11-15T14:41:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f661d7fa700 1 -- 172.21.2.135:0/2900564313 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6610023020 con 0x7f66200b0630 2021-11-15T14:41:17.884 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 msgr2=0x7f6604055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 0x7f6604055b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f6608008000 tx=0x7f6608009040).stop 2021-11-15T14:41:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 msgr2=0x7f66200657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f6620064fe0 tx=0x7f6610014000).stop 2021-11-15T14:41:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 shutdown_connections 2021-11-15T14:41:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6604053690 0x7f6604055b50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f66200b3790 0x7f6620065cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f66200b0630 0x7f66200657e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 --2- 172.21.2.135:0/2900564313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f66200a9c90 0x7f66200aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 >> 172.21.2.135:0/2900564313 conn(0x7f6620060840 msgr2=0x7f662005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 shutdown_connections 2021-11-15T14:41:17.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.880+0000 7f66263b9700 1 -- 172.21.2.135:0/2900564313 wait complete. 2021-11-15T14:41:17.891 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:41:17.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 Processor -- start 2021-11-15T14:41:17.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 -- start start 2021-11-15T14:41:17.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7e680b0520 0x7f7e680addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7e680aa1a0 0x7f7e680ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680b0900 0x7f7e68143790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680b2b70 con 0x7f7e680b0520 2021-11-15T14:41:17.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680b27f0 con 0x7f7e680aa1a0 2021-11-15T14:41:17.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e6ed26700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680b2da0 con 0x7f7e680b0900 2021-11-15T14:41:17.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e67fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7e680aa1a0 0x7f7e680ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e67fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7e680aa1a0 0x7f7e680ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60048/0 (socket says 172.21.2.135:60048) 2021-11-15T14:41:17.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.936+0000 7f7e67fff700 1 -- 172.21.2.135:0/3086987984 learned_addr learned my addr 172.21.2.135:0/3086987984 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/3086987984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680b0900 msgr2=0x7f7e68143790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:17.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/3086987984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680b0900 0x7f7e68143790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/3086987984 >> v2:172.21.2.119:3300/0 conn(0x7f7e680b0520 msgr2=0x7f7e680addb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:17.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/3086987984 >> v2:172.21.2.119:3300/0 conn(0x7f7e680b0520 0x7f7e680addb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/3086987984 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680a9bf0 con 0x7f7e680aa1a0 2021-11-15T14:41:17.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/3086987984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680aa1a0 0x7f7e680ae2a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f7e5c002f70 tx=0x7f7e5c006eb0).ready entity=mon.1 client_cookie=6e322844051c28ef server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e677fe700 1 -- 172.21.2.135:0/3086987984 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c00d570 con 0x7f7e680aa1a0 2021-11-15T14:41:17.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e677fe700 1 -- 172.21.2.135:0/3086987984 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c000e90 con 0x7f7e680aa1a0 2021-11-15T14:41:17.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e677fe700 1 -- 172.21.2.135:0/3086987984 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c00d900 con 0x7f7e680aa1a0 2021-11-15T14:41:17.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/3086987984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680aa1a0 msgr2=0x7f7e680ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/3086987984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680aa1a0 0x7f7e680ae2a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f7e5c002f70 tx=0x7f7e5c006eb0).stop 2021-11-15T14:41:17.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/3086987984 shutdown_connections 2021-11-15T14:41:17.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/3086987984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680b0900 0x7f7e68143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/3086987984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680aa1a0 0x7f7e680ae2a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:17.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/3086987984 >> v2:172.21.2.119:3300/0 conn(0x7f7e680b0520 0x7f7e680addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/3086987984 >> 172.21.2.135:0/3086987984 conn(0x7f7e68060840 msgr2=0x7f7e68060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:17.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/3086987984 shutdown_connections 2021-11-15T14:41:17.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/3086987984 wait complete. 2021-11-15T14:41:17.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 Processor -- start 2021-11-15T14:41:17.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- start start 2021-11-15T14:41:17.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680aa1a0 0x7f7e681482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e680b0900 0x7f7e68149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6814bc50 con 0x7f7e680b0900 2021-11-15T14:41:17.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68142720 con 0x7f7e680b0520 2021-11-15T14:41:17.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681422e0 con 0x7f7e680aa1a0 2021-11-15T14:41:17.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60056/0 (socket says 172.21.2.135:60056) 2021-11-15T14:41:17.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/4141285306 learned_addr learned my addr 172.21.2.135:0/4141285306 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:17.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680aa1a0 msgr2=0x7f7e681482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680aa1a0 0x7f7e681482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e680b0900 msgr2=0x7f7e68149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:17.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e680b0900 0x7f7e68149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:17.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 -- 172.21.2.135:0/4141285306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c00b1e0 con 0x7f7e680b0520 2021-11-15T14:41:17.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e67fff700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f7e5c002f70 tx=0x7f7e5c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c00de20 con 0x7f7e680b0520 2021-11-15T14:41:17.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c011ce0 con 0x7f7e680b0520 2021-11-15T14:41:17.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c01e650 con 0x7f7e680b0520 2021-11-15T14:41:17.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68148be0 con 0x7f7e680b0520 2021-11-15T14:41:17.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68157a70 con 0x7f7e680b0520 2021-11-15T14:41:17.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68141cc0 con 0x7f7e680b0520 2021-11-15T14:41:17.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.940+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e5c01a040 con 0x7f7e680b0520 2021-11-15T14:41:17.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.944+0000 7f7e65ffb700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 0x7f7e48055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:17.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.944+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f7e5c06c730 con 0x7f7e680b0520 2021-11-15T14:41:17.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.944+0000 7f7e6cac2700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 0x7f7e48055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:17.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.944+0000 7f7e6cac2700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 0x7f7e48055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7e58002fb0 tx=0x7f7e580069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:17.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:17.944+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e5c043a70 con 0x7f7e680b0520 2021-11-15T14:41:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.028+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e68148d70 con 0x7f7e680b0520 2021-11-15T14:41:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.028+0000 7f7e65ffb700 1 -- 172.21.2.135:0/4141285306 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7e5c023020 con 0x7f7e680b0520 2021-11-15T14:41:18.034 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:18.034 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:41:18.035 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:18.035 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:41:18.035 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:41:18.036 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:18.036 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:18.036 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:41:18.036 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:41:18.037 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:18.037 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:41:18.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 msgr2=0x7f7e48055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:18.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 0x7f7e48055b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f7e58002fb0 tx=0x7f7e580069b0).stop 2021-11-15T14:41:18.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 msgr2=0x7f7e6814aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f7e5c002f70 tx=0x7f7e5c015000).stop 2021-11-15T14:41:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 shutdown_connections 2021-11-15T14:41:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7e480536d0 0x7f7e48055b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7e680b0900 0x7f7e68149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7e680b0520 0x7f7e6814aaa0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 --2- 172.21.2.135:0/4141285306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7e680aa1a0 0x7f7e681482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 >> 172.21.2.135:0/4141285306 conn(0x7f7e68060840 msgr2=0x7f7e68060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 shutdown_connections 2021-11-15T14:41:18.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.032+0000 7f7e6ed26700 1 -- 172.21.2.135:0/4141285306 wait complete. 2021-11-15T14:41:18.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:41:18.044 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:41:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.104+0000 7f4e23438700 1 Processor -- start 2021-11-15T14:41:18.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.104+0000 7f4e23438700 1 -- start start 2021-11-15T14:41:18.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4e1c0b2320 0x7f4e1c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c0b04a0 con 0x7f4e1c0b0030 2021-11-15T14:41:18.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0a7850 con 0x7f4e1c0b2320 2021-11-15T14:41:18.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0b06d0 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:18.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60060/0 (socket says 172.21.2.135:60060) 2021-11-15T14:41:18.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 -- 172.21.2.135:0/2571228544 learned_addr learned my addr 172.21.2.135:0/2571228544 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:18.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 -- 172.21.2.135:0/2571228544 >> v2:172.21.2.119:3300/0 conn(0x7f4e1c0b2320 msgr2=0x7f4e1c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:18.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 --2- 172.21.2.135:0/2571228544 >> v2:172.21.2.119:3300/0 conn(0x7f4e1c0b2320 0x7f4e1c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 -- 172.21.2.135:0/2571228544 >> v1:172.21.2.119:6789/0 conn(0x7f4e1c0b0030 legacy=0x7f4e1c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:18.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 -- 172.21.2.135:0/2571228544 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0b0970 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e211d4700 1 --2- 172.21.2.135:0/2571228544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f4e1c0ad350 tx=0x7f4e10006eb0).ready entity=mon.1 client_cookie=ecbc87a5e7ececf4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:18.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0ffff700 1 -- 172.21.2.135:0/2571228544 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1000d5c0 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0ffff700 1 -- 172.21.2.135:0/2571228544 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10000e90 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0ffff700 1 -- 172.21.2.135:0/2571228544 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1000d910 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2571228544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b1f40 msgr2=0x7f4e1c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:18.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- 172.21.2.135:0/2571228544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f4e1c0ad350 tx=0x7f4e10006eb0).stop 2021-11-15T14:41:18.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2571228544 shutdown_connections 2021-11-15T14:41:18.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- 172.21.2.135:0/2571228544 >> v2:172.21.2.119:3300/0 conn(0x7f4e1c0b2320 0x7f4e1c1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- 172.21.2.135:0/2571228544 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b1f40 0x7f4e1c0b1350 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:18.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2571228544 >> 172.21.2.135:0/2571228544 conn(0x7f4e1c05f730 msgr2=0x7f4e1c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:18.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2571228544 shutdown_connections 2021-11-15T14:41:18.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2571228544 wait complete. 2021-11-15T14:41:18.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 Processor -- start 2021-11-15T14:41:18.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- start start 2021-11-15T14:41:18.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4e1c0b0030 0x7f4e1c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4e1c0b1f40 0x7f4e1c0ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c143130 con 0x7f4e1c0b0030 2021-11-15T14:41:18.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0ac1a0 con 0x7f4e1c0b2320 2021-11-15T14:41:18.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c144dd0 con 0x7f4e1c0b1f40 2021-11-15T14:41:18.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:18.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60066/0 (socket says 172.21.2.135:60066) 2021-11-15T14:41:18.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 -- 172.21.2.135:0/2870114081 learned_addr learned my addr 172.21.2.135:0/2870114081 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:18.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 -- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4e1c0b1f40 msgr2=0x7f4e1c0ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:18.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4e1c0b1f40 0x7f4e1c0ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 -- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4e1c0b0030 msgr2=0x7f4e1c1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:18.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4e1c0b0030 0x7f4e1c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:18.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 -- 172.21.2.135:0/2870114081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1000b1e0 con 0x7f4e1c0b2320 2021-11-15T14:41:18.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e219d5700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4e140032f0 tx=0x7f4e140091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:18.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1400f510 con 0x7f4e1c0b2320 2021-11-15T14:41:18.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1400f670 con 0x7f4e1c0b2320 2021-11-15T14:41:18.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1400f7e0 con 0x7f4e1c0b2320 2021-11-15T14:41:18.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c143380 con 0x7f4e1c0b2320 2021-11-15T14:41:18.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.108+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c15a440 con 0x7f4e1c0b2320 2021-11-15T14:41:18.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c0b0c10 con 0x7f4e1c0b2320 2021-11-15T14:41:18.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e1400f070 con 0x7f4e1c0b2320 2021-11-15T14:41:18.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e0e7fc700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 0x7f4dfc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:18.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f4e1406b360 con 0x7f4e1c0b2320 2021-11-15T14:41:18.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e211d4700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 0x7f4dfc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:18.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e211d4700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 0x7f4dfc055b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f4e1c0ad350 tx=0x7f4e10015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:18.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.112+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e140426a0 con 0x7f4e1c0b2320 2021-11-15T14:41:18.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:18.196+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4e1c0573d0 con 0x7f4e1c0b2320 2021-11-15T14:41:19.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e0e7fc700 1 -- 172.21.2.135:0/2870114081 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v87) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4e14045cc0 con 0x7f4e1c0b2320 2021-11-15T14:41:19.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 msgr2=0x7f4dfc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 0x7f4dfc055b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f4e1c0ad350 tx=0x7f4e10015000).stop 2021-11-15T14:41:19.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 msgr2=0x7f4e1c0abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4e140032f0 tx=0x7f4e140091a0).stop 2021-11-15T14:41:19.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 shutdown_connections 2021-11-15T14:41:19.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dfc0536d0 0x7f4dfc055b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:19.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4e1c0b2320 0x7f4e1c0abcb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:19.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4e1c0b1f40 0x7f4e1c0ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:19.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 --2- 172.21.2.135:0/2870114081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4e1c0b0030 0x7f4e1c1456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:19.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 >> 172.21.2.135:0/2870114081 conn(0x7f4e1c05f730 msgr2=0x7f4e1c0a7990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:19.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 shutdown_connections 2021-11-15T14:41:19.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.212+0000 7f4e23438700 1 -- 172.21.2.135:0/2870114081 wait complete. 2021-11-15T14:41:19.219 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:41:19.223 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:41:19.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 Processor -- start 2021-11-15T14:41:19.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- start start 2021-11-15T14:41:19.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f73cc0b1f40 0x7f73cc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:19.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0b04a0 con 0x7f73cc0b2320 2021-11-15T14:41:19.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0a7850 con 0x7f73cc0b0030 2021-11-15T14:41:19.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc0b06d0 con 0x7f73cc0b1f40 2021-11-15T14:41:19.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73caffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f73cc0b0030 0x7f73cc0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47662/0 (socket says 172.21.2.135:47662) 2021-11-15T14:41:19.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73caffd700 1 -- 172.21.2.135:0/1626736492 learned_addr learned my addr 172.21.2.135:0/1626736492 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:19.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73cb7fe700 1 --2- 172.21.2.135:0/1626736492 >> v2:172.21.2.135:3300/0 conn(0x7f73cc0b1f40 0x7f73cc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:19.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73cb7fe700 1 -- 172.21.2.135:0/1626736492 >> v1:172.21.2.135:6789/0 conn(0x7f73cc0b0030 legacy=0x7f73cc0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73cb7fe700 1 -- 172.21.2.135:0/1626736492 >> v1:172.21.2.119:6789/0 conn(0x7f73cc0b2320 legacy=0x7f73cc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:19.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73cb7fe700 1 -- 172.21.2.135:0/1626736492 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0b0970 con 0x7f73cc0b1f40 2021-11-15T14:41:19.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73cb7fe700 1 --2- 172.21.2.135:0/1626736492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc0b1350 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f73cc0ad350 tx=0x7f73bc006df0).ready entity=mon.1 client_cookie=7236d1ff114fee1c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:19.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73ca7fc700 1 -- 172.21.2.135:0/1626736492 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73bc00d5c0 con 0x7f73cc0b1f40 2021-11-15T14:41:19.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73ca7fc700 1 -- 172.21.2.135:0/1626736492 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc000e90 con 0x7f73cc0b1f40 2021-11-15T14:41:19.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73ca7fc700 1 -- 172.21.2.135:0/1626736492 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73bc00d910 con 0x7f73cc0b1f40 2021-11-15T14:41:19.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- 172.21.2.135:0/1626736492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 msgr2=0x7f73cc0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 --2- 172.21.2.135:0/1626736492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc0b1350 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f73cc0ad350 tx=0x7f73bc006df0).stop 2021-11-15T14:41:19.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- 172.21.2.135:0/1626736492 shutdown_connections 2021-11-15T14:41:19.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 --2- 172.21.2.135:0/1626736492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc0b1350 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:19.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- 172.21.2.135:0/1626736492 >> 172.21.2.135:0/1626736492 conn(0x7f73cc05f730 msgr2=0x7f73cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:19.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.324+0000 7f73d1b35700 1 -- 172.21.2.135:0/1626736492 shutdown_connections 2021-11-15T14:41:19.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- 172.21.2.135:0/1626736492 wait complete. 2021-11-15T14:41:19.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 Processor -- start 2021-11-15T14:41:19.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- start start 2021-11-15T14:41:19.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73cc0b0030 0x7f73cc142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:19.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:19.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73cc0b2320 0x7f73cc146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:19.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc142e80 con 0x7f73cc0b2320 2021-11-15T14:41:19.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0ab540 con 0x7f73cc0b1f40 2021-11-15T14:41:19.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0a9f90 con 0x7f73cc0b0030 2021-11-15T14:41:19.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:19.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60080/0 (socket says 172.21.2.135:60080) 2021-11-15T14:41:19.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 -- 172.21.2.135:0/660643450 learned_addr learned my addr 172.21.2.135:0/660643450 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:19.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 -- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73cc0b0030 msgr2=0x7f73cc142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73cc0b0030 0x7f73cc142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:19.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 -- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73cc0b2320 msgr2=0x7f73cc146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:19.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73cc0b2320 0x7f73cc146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:19.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 -- 172.21.2.135:0/660643450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc00b180 con 0x7f73cc0b1f40 2021-11-15T14:41:19.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73caffd700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f73cc144240 tx=0x7f73b4007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:19.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73b400ce10 con 0x7f73cc0b1f40 2021-11-15T14:41:19.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b40072e0 con 0x7f73cc0b1f40 2021-11-15T14:41:19.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73b4005800 con 0x7f73cc0b1f40 2021-11-15T14:41:19.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc146880 con 0x7f73cc0b1f40 2021-11-15T14:41:19.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc0aa1c0 con 0x7f73cc0b1f40 2021-11-15T14:41:19.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc0aa380 con 0x7f73cc0b1f40 2021-11-15T14:41:19.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73b4010070 con 0x7f73cc0b1f40 2021-11-15T14:41:19.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 0x7f73b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:19.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f73b406ae70 con 0x7f73cc0b1f40 2021-11-15T14:41:19.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.328+0000 7f73cb7fe700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 0x7f73b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:19.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.332+0000 7f73cb7fe700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 0x7f73b0055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f73cc0ad350 tx=0x7f73bc012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:19.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.332+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73b4042050 con 0x7f73cc0b1f40 2021-11-15T14:41:19.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:19.416+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f73cc0b0c10 con 0x7f73cc0b1f40 2021-11-15T14:41:20.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.224+0000 7f73c8ff9700 1 -- 172.21.2.135:0/660643450 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v88) v1 ==== 125+0+0 (secure 0 0 0) 0x7f73b4045670 con 0x7f73cc0b1f40 2021-11-15T14:41:20.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 msgr2=0x7f73b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 0x7f73b0055ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f73cc0ad350 tx=0x7f73bc012000).stop 2021-11-15T14:41:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 msgr2=0x7f73cc145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f73cc144240 tx=0x7f73b4007c40).stop 2021-11-15T14:41:20.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 shutdown_connections 2021-11-15T14:41:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f73b0053610 0x7f73b0055ad0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f73cc0b2320 0x7f73cc146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f73cc0b1f40 0x7f73cc145ea0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 --2- 172.21.2.135:0/660643450 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f73cc0b0030 0x7f73cc142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 >> 172.21.2.135:0/660643450 conn(0x7f73cc05f730 msgr2=0x7f73cc13f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 shutdown_connections 2021-11-15T14:41:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.228+0000 7f73d1b35700 1 -- 172.21.2.135:0/660643450 wait complete. 2021-11-15T14:41:20.233 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:41:20.237 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:41:20.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.288+0000 7f9295854700 1 Processor -- start 2021-11-15T14:41:20.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.288+0000 7f9295854700 1 -- start start 2021-11-15T14:41:20.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f9295854700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f9295854700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 0x7f9290065e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f9295854700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9290060560 con 0x7f92900659f0 2021-11-15T14:41:20.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f9295854700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900671a0 con 0x7f9290066d60 2021-11-15T14:41:20.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f9295854700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9290060cf0 con 0x7f9290060180 2021-11-15T14:41:20.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928f7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 0x7f9290065e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41630/0 (socket says 172.21.2.135:41630) 2021-11-15T14:41:20.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928f7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 0x7f9290065e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:53902/0 (socket says 172.21.2.135:53902) 2021-11-15T14:41:20.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 -- 172.21.2.135:0/1359850595 learned_addr learned my addr 172.21.2.135:0/1359850595 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928e7fc700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f92900659f0 0x7f9290066650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:57092/0 (socket says 172.21.2.135:57092) 2021-11-15T14:41:20.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 -- 172.21.2.135:0/1359850595 >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 msgr2=0x7f9290065e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:20.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 --2- 172.21.2.135:0/1359850595 >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 0x7f9290065e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 -- 172.21.2.135:0/1359850595 >> v1:172.21.2.119:6789/0 conn(0x7f92900659f0 legacy=0x7f9290066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 -- 172.21.2.135:0/1359850595 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290060f90 con 0x7f9290060180 2021-11-15T14:41:20.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928effd700 1 --2- 172.21.2.135:0/1359850595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9278002f70 tx=0x7f9278006eb0).ready entity=mon.2 client_cookie=fa9482056d7a3942 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928dffb700 1 -- 172.21.2.135:0/1359850595 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927800d570 con 0x7f9290060180 2021-11-15T14:41:20.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928dffb700 1 -- 172.21.2.135:0/1359850595 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278000e90 con 0x7f9290060180 2021-11-15T14:41:20.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.292+0000 7f928dffb700 1 -- 172.21.2.135:0/1359850595 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927800d900 con 0x7f9290060180 2021-11-15T14:41:20.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1359850595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 msgr2=0x7f92900616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- 172.21.2.135:0/1359850595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9278002f70 tx=0x7f9278006eb0).stop 2021-11-15T14:41:20.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1359850595 shutdown_connections 2021-11-15T14:41:20.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- 172.21.2.135:0/1359850595 >> v2:172.21.2.119:3300/0 conn(0x7f9290066d60 0x7f9290065e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- 172.21.2.135:0/1359850595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900616d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1359850595 >> 172.21.2.135:0/1359850595 conn(0x7f929005cfb0 msgr2=0x7f929005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1359850595 shutdown_connections 2021-11-15T14:41:20.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1359850595 wait complete. 2021-11-15T14:41:20.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 Processor -- start 2021-11-15T14:41:20.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- start start 2021-11-15T14:41:20.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92900659f0 0x7f92900a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900a8df0 con 0x7f92900659f0 2021-11-15T14:41:20.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900a7ed0 con 0x7f9290066d60 2021-11-15T14:41:20.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900a8170 con 0x7f9290060180 2021-11-15T14:41:20.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60094/0 (socket says 172.21.2.135:60094) 2021-11-15T14:41:20.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 -- 172.21.2.135:0/1514548659 learned_addr learned my addr 172.21.2.135:0/1514548659 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 -- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 msgr2=0x7f92900abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 -- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92900659f0 msgr2=0x7f92900a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92900659f0 0x7f92900a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 -- 172.21.2.135:0/1514548659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927800b1e0 con 0x7f9290066d60 2021-11-15T14:41:20.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f928f7fe700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f9288006e00 tx=0x7f92880091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f928800c7f0 con 0x7f9290066d60 2021-11-15T14:41:20.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800c950 con 0x7f9290066d60 2021-11-15T14:41:20.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92900a8410 con 0x7f9290066d60 2021-11-15T14:41:20.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f928800ccb0 con 0x7f9290066d60 2021-11-15T14:41:20.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92900a8950 con 0x7f9290066d60 2021-11-15T14:41:20.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900a8b10 con 0x7f9290066d60 2021-11-15T14:41:20.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9288022070 con 0x7f9290066d60 2021-11-15T14:41:20.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 0x7f9274055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.296+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f928806c240 con 0x7f9290066d60 2021-11-15T14:41:20.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.300+0000 7f928effd700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 0x7f9274055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.300+0000 7f928effd700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 0x7f9274055a90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9278002f70 tx=0x7f9278015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.300+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92880431b0 con 0x7f9290066d60 2021-11-15T14:41:20.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.408+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9290061230 con 0x7f9290066d60 2021-11-15T14:41:20.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9287fff700 1 -- 172.21.2.135:0/1514548659 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v42) v1 ==== 189+0+0 (secure 0 0 0) 0x7f92880160d0 con 0x7f9290066d60 2021-11-15T14:41:20.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 msgr2=0x7f9274055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 0x7f9274055a90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9278002f70 tx=0x7f9278015000).stop 2021-11-15T14:41:20.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 msgr2=0x7f92900a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f9288006e00 tx=0x7f92880091d0).stop 2021-11-15T14:41:20.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 shutdown_connections 2021-11-15T14:41:20.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f92740535d0 0x7f9274055a90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9290066d60 0x7f92900a99e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f92900659f0 0x7f92900a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 --2- 172.21.2.135:0/1514548659 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9290060180 0x7f92900abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 >> 172.21.2.135:0/1514548659 conn(0x7f929005cfb0 msgr2=0x7f9290143e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 shutdown_connections 2021-11-15T14:41:20.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.424+0000 7f9295854700 1 -- 172.21.2.135:0/1514548659 wait complete. 2021-11-15T14:41:20.431 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 15 and data pool 16 2021-11-15T14:41:20.435 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:20.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 Processor -- start 2021-11-15T14:41:20.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 -- start start 2021-11-15T14:41:20.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f56b80b0520 0x7f56b80addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f56b80aa1a0 0x7f56b80ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b8143790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80b2b70 con 0x7f56b80b0520 2021-11-15T14:41:20.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80b27f0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.480+0000 7f56be649700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80b2da0 con 0x7f56b80b0900 2021-11-15T14:41:20.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f56b80aa1a0 0x7f56b80ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f56b80aa1a0 0x7f56b80ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60106/0 (socket says 172.21.2.135:60106) 2021-11-15T14:41:20.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 -- 172.21.2.135:0/3131172463 learned_addr learned my addr 172.21.2.135:0/3131172463 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 -- 172.21.2.135:0/3131172463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 msgr2=0x7f56b8143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:20.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 --2- 172.21.2.135:0/3131172463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b8143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 -- 172.21.2.135:0/3131172463 >> v2:172.21.2.119:3300/0 conn(0x7f56b80b0520 msgr2=0x7f56b80addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:20.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 --2- 172.21.2.135:0/3131172463 >> v2:172.21.2.119:3300/0 conn(0x7f56b80b0520 0x7f56b80addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 -- 172.21.2.135:0/3131172463 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80a9bf0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b77fe700 1 --2- 172.21.2.135:0/3131172463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b80ae2a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f56a0002f70 tx=0x7f56a0006eb0).ready entity=mon.1 client_cookie=331ba9706db443be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b6ffd700 1 -- 172.21.2.135:0/3131172463 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a000d570 con 0x7f56b80aa1a0 2021-11-15T14:41:20.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b6ffd700 1 -- 172.21.2.135:0/3131172463 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a0000e90 con 0x7f56b80aa1a0 2021-11-15T14:41:20.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b6ffd700 1 -- 172.21.2.135:0/3131172463 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a000d900 con 0x7f56b80aa1a0 2021-11-15T14:41:20.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3131172463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 msgr2=0x7f56b80ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- 172.21.2.135:0/3131172463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b80ae2a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f56a0002f70 tx=0x7f56a0006eb0).stop 2021-11-15T14:41:20.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3131172463 shutdown_connections 2021-11-15T14:41:20.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- 172.21.2.135:0/3131172463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b8143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- 172.21.2.135:0/3131172463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b80ae2a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- 172.21.2.135:0/3131172463 >> v2:172.21.2.119:3300/0 conn(0x7f56b80b0520 0x7f56b80addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3131172463 >> 172.21.2.135:0/3131172463 conn(0x7f56b8060840 msgr2=0x7f56b8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3131172463 shutdown_connections 2021-11-15T14:41:20.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3131172463 wait complete. 2021-11-15T14:41:20.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 Processor -- start 2021-11-15T14:41:20.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- start start 2021-11-15T14:41:20.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56b80b0520 0x7f56b8065b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b81439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8066210 con 0x7f56b80b0520 2021-11-15T14:41:20.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8144ef0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8145190 con 0x7f56b80b0900 2021-11-15T14:41:20.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60114/0 (socket says 172.21.2.135:60114) 2021-11-15T14:41:20.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 -- 172.21.2.135:0/3112330551 learned_addr learned my addr 172.21.2.135:0/3112330551 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 -- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 msgr2=0x7f56b81439d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:20.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b81439d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 -- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56b80b0520 msgr2=0x7f56b8065b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:20.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56b80b0520 0x7f56b8065b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 -- 172.21.2.135:0/3112330551 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a000b1e0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b7fff700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f56a8002f70 tx=0x7f56a8006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a8013460 con 0x7f56b80aa1a0 2021-11-15T14:41:20.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a80135c0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a8013920 con 0x7f56b80aa1a0 2021-11-15T14:41:20.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b8145430 con 0x7f56b80aa1a0 2021-11-15T14:41:20.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8066b90 con 0x7f56b80aa1a0 2021-11-15T14:41:20.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b80573d0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f56a800f070 con 0x7f56b80aa1a0 2021-11-15T14:41:20.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 0x7f569c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.484+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f56a806b400 con 0x7f56b80aa1a0 2021-11-15T14:41:20.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.488+0000 7f56b77fe700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 0x7f569c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.488+0000 7f56b77fe700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 0x7f569c055b60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f56a0002f70 tx=0x7f56a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.488+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56a8042410 con 0x7f56b80aa1a0 2021-11-15T14:41:20.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56b80446d0 con 0x7f56b80aa1a0 2021-11-15T14:41:20.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56b57fa700 1 -- 172.21.2.135:0/3112330551 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16300 (secure 0 0 0) 0x7f56a8045a30 con 0x7f56b80aa1a0 2021-11-15T14:41:20.579 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:20.580 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":89,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:20.413032+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:18.216736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:19.436050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:20.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 msgr2=0x7f569c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 0x7f569c055b60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f56a0002f70 tx=0x7f56a0015000).stop 2021-11-15T14:41:20.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 msgr2=0x7f56b805fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f56a8002f70 tx=0x7f56a8006ec0).stop 2021-11-15T14:41:20.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 shutdown_connections 2021-11-15T14:41:20.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f569c0536a0 0x7f569c055b60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56b80b0900 0x7f56b81439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56b80b0520 0x7f56b8065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 --2- 172.21.2.135:0/3112330551 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56b80aa1a0 0x7f56b805fa70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 >> 172.21.2.135:0/3112330551 conn(0x7f56b8060840 msgr2=0x7f56b80b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 shutdown_connections 2021-11-15T14:41:20.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.576+0000 7f56be649700 1 -- 172.21.2.135:0/3112330551 wait complete. 2021-11-15T14:41:20.587 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:20.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 Processor -- start 2021-11-15T14:41:20.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- start start 2021-11-15T14:41:20.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb8180b6600 0x7fb8180b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb8180b4440 0x7fb8180b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb818061db0 0x7fb818062220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb818144130 con 0x7fb8180b6600 2021-11-15T14:41:20.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180b6ed0 con 0x7fb8180b4440 2021-11-15T14:41:20.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb818143bf0 con 0x7fb818061db0 2021-11-15T14:41:20.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb8180b4440 0x7fb8180b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb8180b4440 0x7fb8180b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60120/0 (socket says 172.21.2.135:60120) 2021-11-15T14:41:20.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/2753048480 learned_addr learned my addr 172.21.2.135:0/2753048480 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/2753048480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb818061db0 msgr2=0x7fb818062220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:20.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/2753048480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb818061db0 0x7fb818062220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/2753048480 >> v2:172.21.2.119:3300/0 conn(0x7fb8180b6600 msgr2=0x7fb8180b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:20.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/2753048480 >> v2:172.21.2.119:3300/0 conn(0x7fb8180b6600 0x7fb8180b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/2753048480 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818143e90 con 0x7fb8180b4440 2021-11-15T14:41:20.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/2753048480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb8180b69e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fb8181431a0 tx=0x7fb808006eb0).ready entity=mon.1 client_cookie=cb8bf96b771b7cda server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb815ffb700 1 -- 172.21.2.135:0/2753048480 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80800d570 con 0x7fb8180b4440 2021-11-15T14:41:20.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb815ffb700 1 -- 172.21.2.135:0/2753048480 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808000e90 con 0x7fb8180b4440 2021-11-15T14:41:20.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb815ffb700 1 -- 172.21.2.135:0/2753048480 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80800d8c0 con 0x7fb8180b4440 2021-11-15T14:41:20.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- 172.21.2.135:0/2753048480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 msgr2=0x7fb8180b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- 172.21.2.135:0/2753048480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb8180b69e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fb8181431a0 tx=0x7fb808006eb0).stop 2021-11-15T14:41:20.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- 172.21.2.135:0/2753048480 shutdown_connections 2021-11-15T14:41:20.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- 172.21.2.135:0/2753048480 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb818061db0 0x7fb818062220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- 172.21.2.135:0/2753048480 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb8180b69e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- 172.21.2.135:0/2753048480 >> v2:172.21.2.119:3300/0 conn(0x7fb8180b6600 0x7fb8180b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- 172.21.2.135:0/2753048480 >> 172.21.2.135:0/2753048480 conn(0x7fb81805c510 msgr2=0x7fb81805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- 172.21.2.135:0/2753048480 shutdown_connections 2021-11-15T14:41:20.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- 172.21.2.135:0/2753048480 wait complete. 2021-11-15T14:41:20.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 Processor -- start 2021-11-15T14:41:20.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- start start 2021-11-15T14:41:20.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb818061db0 0x7fb818159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8180b6600 0x7fb8181406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180b0760 con 0x7fb818061db0 2021-11-15T14:41:20.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180b83e0 con 0x7fb8180b4440 2021-11-15T14:41:20.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb81d64c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180af120 con 0x7fb8180b6600 2021-11-15T14:41:20.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60124/0 (socket says 172.21.2.135:60124) 2021-11-15T14:41:20.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/3038403015 learned_addr learned my addr 172.21.2.135:0/3038403015 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8180b6600 msgr2=0x7fb8181406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8180b6600 0x7fb8181406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb818061db0 msgr2=0x7fb818159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb818061db0 0x7fb818159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 -- 172.21.2.135:0/3038403015 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80800b1e0 con 0x7fb8180b4440 2021-11-15T14:41:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.636+0000 7fb8167fc700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fb8181431a0 tx=0x7fb808015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb808002f70 con 0x7fb8180b4440 2021-11-15T14:41:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800d8f0 con 0x7fb8180b4440 2021-11-15T14:41:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180af3c0 con 0x7fb8180b4440 2021-11-15T14:41:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8180b7dd0 con 0x7fb8180b4440 2021-11-15T14:41:20.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80801e460 con 0x7fb8180b4440 2021-11-15T14:41:20.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818061670 con 0x7fb8180b4440 2021-11-15T14:41:20.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb808025030 con 0x7fb8180b4440 2021-11-15T14:41:20.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 0x7fb7fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb80806cc40 con 0x7fb8180b4440 2021-11-15T14:41:20.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb816ffd700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 0x7fb7fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb816ffd700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 0x7fb7fc055ad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fb800002f70 tx=0x7fb800006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.640+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb808043c50 con 0x7fb8180b4440 2021-11-15T14:41:20.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.728+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8180573d0 con 0x7fb8180b4440 2021-11-15T14:41:20.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.728+0000 7fb80ffff700 1 -- 172.21.2.135:0/3038403015 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fb808023070 con 0x7fb8180b4440 2021-11-15T14:41:20.734 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:20.734 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":89,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:20.413032+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:18.216736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:19.436050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:20.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 msgr2=0x7fb7fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 0x7fb7fc055ad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fb800002f70 tx=0x7fb800006a10).stop 2021-11-15T14:41:20.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 msgr2=0x7fb81815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fb8181431a0 tx=0x7fb808015000).stop 2021-11-15T14:41:20.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 shutdown_connections 2021-11-15T14:41:20.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7fc053610 0x7fb7fc055ad0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8180b6600 0x7fb8181406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8180b4440 0x7fb81815a360 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 --2- 172.21.2.135:0/3038403015 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb818061db0 0x7fb818159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 >> 172.21.2.135:0/3038403015 conn(0x7fb81805c510 msgr2=0x7fb818128d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 shutdown_connections 2021-11-15T14:41:20.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.732+0000 7fb81d64c700 1 -- 172.21.2.135:0/3038403015 wait complete. 2021-11-15T14:41:20.741 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:41:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 Processor -- start 2021-11-15T14:41:20.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 -- start start 2021-11-15T14:41:20.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1eb41469d0 0x7f1eb41402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1eb40b4200 0x7f1eb41407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4710 0x7f1eb40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb4147590 con 0x7f1eb41469d0 2021-11-15T14:41:20.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb4143be0 con 0x7f1eb40b4200 2021-11-15T14:41:20.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eba53c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4143e80 con 0x7f1eb40b4710 2021-11-15T14:41:20.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1eb40b4200 0x7f1eb41407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1eb40b4200 0x7f1eb41407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60136/0 (socket says 172.21.2.135:60136) 2021-11-15T14:41:20.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 -- 172.21.2.135:0/885396177 learned_addr learned my addr 172.21.2.135:0/885396177 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 -- 172.21.2.135:0/885396177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4710 msgr2=0x7f1eb40b4f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:20.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 --2- 172.21.2.135:0/885396177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4710 0x7f1eb40b4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 -- 172.21.2.135:0/885396177 >> v2:172.21.2.119:3300/0 conn(0x7f1eb41469d0 msgr2=0x7f1eb41402b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:20.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 --2- 172.21.2.135:0/885396177 >> v2:172.21.2.119:3300/0 conn(0x7f1eb41469d0 0x7f1eb41402b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.788+0000 7f1eb37fe700 1 -- 172.21.2.135:0/885396177 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40b0d10 con 0x7f1eb40b4200 2021-11-15T14:41:20.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb37fe700 1 --2- 172.21.2.135:0/885396177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb40b4200 0x7f1eb41407a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f1ea4002f70 tx=0x7f1ea4006eb0).ready entity=mon.1 client_cookie=67254ed0e81f6d76 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb2ffd700 1 -- 172.21.2.135:0/885396177 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea400d570 con 0x7f1eb40b4200 2021-11-15T14:41:20.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb2ffd700 1 -- 172.21.2.135:0/885396177 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4000e90 con 0x7f1eb40b4200 2021-11-15T14:41:20.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb2ffd700 1 -- 172.21.2.135:0/885396177 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea400d900 con 0x7f1eb40b4200 2021-11-15T14:41:20.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/885396177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb40b4200 msgr2=0x7f1eb41407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- 172.21.2.135:0/885396177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb40b4200 0x7f1eb41407a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f1ea4002f70 tx=0x7f1ea4006eb0).stop 2021-11-15T14:41:20.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/885396177 shutdown_connections 2021-11-15T14:41:20.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- 172.21.2.135:0/885396177 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4710 0x7f1eb40b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- 172.21.2.135:0/885396177 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb40b4200 0x7f1eb41407a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:20.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- 172.21.2.135:0/885396177 >> v2:172.21.2.119:3300/0 conn(0x7f1eb41469d0 0x7f1eb41402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/885396177 >> 172.21.2.135:0/885396177 conn(0x7f1eb405c510 msgr2=0x7f1eb405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:20.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/885396177 shutdown_connections 2021-11-15T14:41:20.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/885396177 wait complete. 2021-11-15T14:41:20.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 Processor -- start 2021-11-15T14:41:20.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- start start 2021-11-15T14:41:20.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4200 0x7f1eb40b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1eb40b4710 0x7f1eb4144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40b9c30 con 0x7f1eb40b4710 2021-11-15T14:41:20.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40b9910 con 0x7f1eb41469d0 2021-11-15T14:41:20.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4144900 con 0x7f1eb40b4200 2021-11-15T14:41:20.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60142/0 (socket says 172.21.2.135:60142) 2021-11-15T14:41:20.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 -- 172.21.2.135:0/2750233190 learned_addr learned my addr 172.21.2.135:0/2750233190 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:20.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 -- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4200 msgr2=0x7f1eb40b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4200 0x7f1eb40b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 -- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1eb40b4710 msgr2=0x7f1eb4144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:20.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1eb40b4710 0x7f1eb4144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:20.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 -- 172.21.2.135:0/2750233190 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea400b1e0 con 0x7f1eb41469d0 2021-11-15T14:41:20.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb8ad9700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f1eb40aef90 tx=0x7f1eac0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d4a0 con 0x7f1eb41469d0 2021-11-15T14:41:20.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac00d600 con 0x7f1eb41469d0 2021-11-15T14:41:20.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d960 con 0x7f1eb41469d0 2021-11-15T14:41:20.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb40b9e60 con 0x7f1eb41469d0 2021-11-15T14:41:20.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb40b8710 con 0x7f1eb41469d0 2021-11-15T14:41:20.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.792+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4144a70 con 0x7f1eb41469d0 2021-11-15T14:41:20.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1eac018030 con 0x7f1eb41469d0 2021-11-15T14:41:20.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb17fa700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:20.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1eac06b450 con 0x7f1eb41469d0 2021-11-15T14:41:20.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb3fff700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:20.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb3fff700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 0x7f1e94055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f1ea8002fb0 tx=0x7f1ea80069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:20.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.796+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1eac042400 con 0x7f1eb41469d0 2021-11-15T14:41:20.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:20.908+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1eb40573d0 con 0x7f1eb41469d0 2021-11-15T14:41:21.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eb17fa700 1 -- 172.21.2.135:0/2750233190 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1eac045a20 con 0x7f1eb41469d0 2021-11-15T14:41:21.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 msgr2=0x7f1e94055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 0x7f1e94055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f1ea8002fb0 tx=0x7f1ea80069b0).stop 2021-11-15T14:41:21.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 msgr2=0x7f1eb40b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f1eb40aef90 tx=0x7f1eac0090f0).stop 2021-11-15T14:41:21.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 shutdown_connections 2021-11-15T14:41:21.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1e940536a0 0x7f1e94055b60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1eb41469d0 0x7f1eb40b8fa0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1eb40b4710 0x7f1eb4144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 --2- 172.21.2.135:0/2750233190 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1eb40b4200 0x7f1eb40b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 >> 172.21.2.135:0/2750233190 conn(0x7f1eb405c510 msgr2=0x7f1eb40b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 shutdown_connections 2021-11-15T14:41:21.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.432+0000 7f1eba53c700 1 -- 172.21.2.135:0/2750233190 wait complete. 2021-11-15T14:41:21.443 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:21.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 Processor -- start 2021-11-15T14:41:21.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 -- start start 2021-11-15T14:41:21.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f65900aa1a0 0x7f65900ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900b2b70 con 0x7f65900b0520 2021-11-15T14:41:21.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900b27f0 con 0x7f65900aa1a0 2021-11-15T14:41:21.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f6596380700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b2da0 con 0x7f65900b0900 2021-11-15T14:41:21.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f659491d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f659491d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:41690/0 (socket says 172.21.2.135:41690) 2021-11-15T14:41:21.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f659491d700 1 -- 172.21.2.135:0/922581572 learned_addr learned my addr 172.21.2.135:0/922581572 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:21.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f658ffff700 1 --1- 172.21.2.135:0/922581572 >> v1:172.21.2.119:6789/0 conn(0x7f65900b0520 0x7f65900addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:57152/0 (socket says 172.21.2.135:57152) 2021-11-15T14:41:21.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.492+0000 7f658f7fe700 1 --2- 172.21.2.135:0/922581572 >> v2:172.21.2.119:3300/0 conn(0x7f65900aa1a0 0x7f65900ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/922581572 >> v2:172.21.2.119:3300/0 conn(0x7f65900aa1a0 msgr2=0x7f65900ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:21.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- 172.21.2.135:0/922581572 >> v2:172.21.2.119:3300/0 conn(0x7f65900aa1a0 0x7f65900ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/922581572 >> v1:172.21.2.119:6789/0 conn(0x7f65900b0520 legacy=0x7f65900addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/922581572 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900a9bf0 con 0x7f65900b0900 2021-11-15T14:41:21.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- 172.21.2.135:0/922581572 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f65880032f0 tx=0x7f658800b530).ready entity=mon.2 client_cookie=15cf6be0f229aa10 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658effd700 1 -- 172.21.2.135:0/922581572 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658800de20 con 0x7f65900b0900 2021-11-15T14:41:21.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658effd700 1 -- 172.21.2.135:0/922581572 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588010470 con 0x7f65900b0900 2021-11-15T14:41:21.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658effd700 1 -- 172.21.2.135:0/922581572 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65880107d0 con 0x7f65900b0900 2021-11-15T14:41:21.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/922581572 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 msgr2=0x7f6590140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- 172.21.2.135:0/922581572 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f65880032f0 tx=0x7f658800b530).stop 2021-11-15T14:41:21.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/922581572 shutdown_connections 2021-11-15T14:41:21.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- 172.21.2.135:0/922581572 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900b0900 0x7f6590140620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- 172.21.2.135:0/922581572 >> v2:172.21.2.119:3300/0 conn(0x7f65900aa1a0 0x7f65900ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/922581572 >> 172.21.2.135:0/922581572 conn(0x7f6590060840 msgr2=0x7f6590060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/922581572 shutdown_connections 2021-11-15T14:41:21.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/922581572 wait complete. 2021-11-15T14:41:21.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 Processor -- start 2021-11-15T14:41:21.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- start start 2021-11-15T14:41:21.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900aa1a0 0x7f65900b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f65900b0520 0x7f6590063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b7600 con 0x7f65900b0520 2021-11-15T14:41:21.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b3aa0 con 0x7f65900b0900 2021-11-15T14:41:21.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590137d50 con 0x7f65900aa1a0 2021-11-15T14:41:21.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60156/0 (socket says 172.21.2.135:60156) 2021-11-15T14:41:21.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/920472296 learned_addr learned my addr 172.21.2.135:0/920472296 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:21.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658ffff700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900aa1a0 0x7f65900b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658f7fe700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f65900b0520 0x7f6590063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900aa1a0 msgr2=0x7f65900b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900aa1a0 0x7f65900b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f65900b0520 msgr2=0x7f6590063c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f65900b0520 0x7f6590063c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 -- 172.21.2.135:0/920472296 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658800b7d0 con 0x7f65900b0900 2021-11-15T14:41:21.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f659491d700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f65880032f0 tx=0x7f658800b530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658801d070 con 0x7f65900b0900 2021-11-15T14:41:21.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588018800 con 0x7f65900b0900 2021-11-15T14:41:21.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6590067190 con 0x7f65900b0900 2021-11-15T14:41:21.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6588018b60 con 0x7f65900b0900 2021-11-15T14:41:21.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6590138b30 con 0x7f65900b0900 2021-11-15T14:41:21.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590067320 con 0x7f65900b0900 2021-11-15T14:41:21.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.496+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6588018cc0 con 0x7f65900b0900 2021-11-15T14:41:21.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.500+0000 7f658d7fa700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 0x7f65740559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.500+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f658806d180 con 0x7f65900b0900 2021-11-15T14:41:21.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.500+0000 7f658ffff700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 0x7f65740559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.500+0000 7f658ffff700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 0x7f65740559e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f658000d000 tx=0x7f6580007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.500+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6590067320 con 0x7f65900b0900 2021-11-15T14:41:21.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.608+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6590067320 con 0x7f65900b0900 2021-11-15T14:41:21.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.608+0000 7f658d7fa700 1 -- 172.21.2.135:0/920472296 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f6590067320 con 0x7f65900b0900 2021-11-15T14:41:21.615 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:21.615 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:21.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 msgr2=0x7f65740559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 0x7f65740559e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f658000d000 tx=0x7f6580007b80).stop 2021-11-15T14:41:21.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 msgr2=0x7f6590064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f65880032f0 tx=0x7f658800b530).stop 2021-11-15T14:41:21.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 shutdown_connections 2021-11-15T14:41:21.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6574053520 0x7f65740559e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f65900b0900 0x7f6590064180 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f65900b0520 0x7f6590063c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 --2- 172.21.2.135:0/920472296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f65900aa1a0 0x7f65900b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 >> 172.21.2.135:0/920472296 conn(0x7f6590060840 msgr2=0x7f6590060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 shutdown_connections 2021-11-15T14:41:21.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.612+0000 7f6596380700 1 -- 172.21.2.135:0/920472296 wait complete. 2021-11-15T14:41:21.619 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:21.621 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:21.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 Processor -- start 2021-11-15T14:41:21.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- start start 2021-11-15T14:41:21.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7fe40b4440 0x7f7fe40b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7fe40b69e0 0x7f7fe412ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe4144130 con 0x7f7fe40b6600 2021-11-15T14:41:21.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe4143bf0 con 0x7f7fe40b69e0 2021-11-15T14:41:21.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe4143e90 con 0x7f7fe40b4440 2021-11-15T14:41:21.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9d61700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7fe40b6600 0x7f7fe4061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47748/0 (socket says 172.21.2.135:47748) 2021-11-15T14:41:21.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9d61700 1 -- 172.21.2.135:0/2602470046 learned_addr learned my addr 172.21.2.135:0/2602470046 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:21.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 --2- 172.21.2.135:0/2602470046 >> v2:172.21.2.135:3300/0 conn(0x7f7fe40b4440 0x7f7fe40b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 -- 172.21.2.135:0/2602470046 >> v2:172.21.2.119:3300/0 conn(0x7f7fe40b69e0 msgr2=0x7f7fe412ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:21.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 --2- 172.21.2.135:0/2602470046 >> v2:172.21.2.119:3300/0 conn(0x7f7fe40b69e0 0x7f7fe412ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 -- 172.21.2.135:0/2602470046 >> v1:172.21.2.135:6789/0 conn(0x7f7fe40b6600 legacy=0x7f7fe4061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 -- 172.21.2.135:0/2602470046 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4061670 con 0x7f7fe40b4440 2021-11-15T14:41:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe9560700 1 --2- 172.21.2.135:0/2602470046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b4440 0x7f7fe40b5c70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f7fe41431a0 tx=0x7f7fd8006df0).ready entity=mon.1 client_cookie=5e6c6971c54d3868 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe8d5f700 1 -- 172.21.2.135:0/2602470046 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800d5c0 con 0x7f7fe40b4440 2021-11-15T14:41:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe8d5f700 1 -- 172.21.2.135:0/2602470046 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8000e90 con 0x7f7fe40b4440 2021-11-15T14:41:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7fe8d5f700 1 -- 172.21.2.135:0/2602470046 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800d910 con 0x7f7fe40b4440 2021-11-15T14:41:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- 172.21.2.135:0/2602470046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b4440 msgr2=0x7f7fe40b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 --2- 172.21.2.135:0/2602470046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b4440 0x7f7fe40b5c70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f7fe41431a0 tx=0x7f7fd8006df0).stop 2021-11-15T14:41:21.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- 172.21.2.135:0/2602470046 shutdown_connections 2021-11-15T14:41:21.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 --2- 172.21.2.135:0/2602470046 >> v2:172.21.2.119:3300/0 conn(0x7f7fe40b69e0 0x7f7fe412ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 --2- 172.21.2.135:0/2602470046 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b4440 0x7f7fe40b5c70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- 172.21.2.135:0/2602470046 >> 172.21.2.135:0/2602470046 conn(0x7f7fe405c510 msgr2=0x7f7fe405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- 172.21.2.135:0/2602470046 shutdown_connections 2021-11-15T14:41:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.668+0000 7f7febfc5700 1 -- 172.21.2.135:0/2602470046 wait complete. 2021-11-15T14:41:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 Processor -- start 2021-11-15T14:41:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- start start 2021-11-15T14:41:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fe40b4440 0x7f7fe40ba380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fe40b6600 0x7f7fe4126070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40b3d80 con 0x7f7fe40b6600 2021-11-15T14:41:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe412b790 con 0x7f7fe40b69e0 2021-11-15T14:41:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40b3700 con 0x7f7fe40b4440 2021-11-15T14:41:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60168/0 (socket says 172.21.2.135:60168) 2021-11-15T14:41:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 -- 172.21.2.135:0/642300346 learned_addr learned my addr 172.21.2.135:0/642300346 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:21.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 -- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fe40b4440 msgr2=0x7f7fe40ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fe40b4440 0x7f7fe40ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 -- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fe40b6600 msgr2=0x7f7fe4126070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fe40b6600 0x7f7fe4126070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 -- 172.21.2.135:0/642300346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd800b180 con 0x7f7fe40b69e0 2021-11-15T14:41:21.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fea562700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f7fdc0032f0 tx=0x7f7fdc0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fdc00d4a0 con 0x7f7fe40b69e0 2021-11-15T14:41:21.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00d600 con 0x7f7fe40b69e0 2021-11-15T14:41:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe40b3960 con 0x7f7fe40b69e0 2021-11-15T14:41:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fdc00d960 con 0x7f7fe40b69e0 2021-11-15T14:41:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4126560 con 0x7f7fe40b69e0 2021-11-15T14:41:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4061910 con 0x7f7fe40b69e0 2021-11-15T14:41:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fdc018030 con 0x7f7fe40b69e0 2021-11-15T14:41:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 0x7f7fc4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7fdc06b440 con 0x7f7fe40b69e0 2021-11-15T14:41:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.672+0000 7f7fe9d61700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 0x7f7fc4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.676+0000 7f7fe9d61700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 0x7f7fc4055b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7fe40b1d00 tx=0x7f7fe0007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.676+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fdc0423f0 con 0x7f7fe40b69e0 2021-11-15T14:41:21.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fe40573d0 con 0x7f7fe40b69e0 2021-11-15T14:41:21.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7fd6ffd700 1 -- 172.21.2.135:0/642300346 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f7fdc023fb0 con 0x7f7fe40b69e0 2021-11-15T14:41:21.764 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:21.764 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":90,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:21.418485+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:18.216736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:19.436050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:21.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 msgr2=0x7f7fc4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 0x7f7fc4055b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7fe40b1d00 tx=0x7f7fe0007800).stop 2021-11-15T14:41:21.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 msgr2=0x7f7fe40b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f7fdc0032f0 tx=0x7f7fdc0091a0).stop 2021-11-15T14:41:21.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 shutdown_connections 2021-11-15T14:41:21.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7fc40536d0 0x7f7fc4055b90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7fe40b69e0 0x7f7fe40b1f50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7fe40b6600 0x7f7fe4126070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 --2- 172.21.2.135:0/642300346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7fe40b4440 0x7f7fe40ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 >> 172.21.2.135:0/642300346 conn(0x7f7fe405c510 msgr2=0x7f7fe41431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 shutdown_connections 2021-11-15T14:41:21.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.760+0000 7f7febfc5700 1 -- 172.21.2.135:0/642300346 wait complete. 2021-11-15T14:41:21.771 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:41:21.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 Processor -- start 2021-11-15T14:41:21.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 -- start start 2021-11-15T14:41:21.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a00b1e30 0x7fe3a00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe3a0148420 0x7fe3a00b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe3a00a7140 0x7fe3a01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00a9140 con 0x7fe3a00a7140 2021-11-15T14:41:21.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00b03d0 con 0x7fe3a0148420 2021-11-15T14:41:21.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.820+0000 7fe3a83db700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b0670 con 0x7fe3a00b1e30 2021-11-15T14:41:21.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe3a0148420 0x7fe3a00b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe3a0148420 0x7fe3a00b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60178/0 (socket says 172.21.2.135:60178) 2021-11-15T14:41:21.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/4167997388 learned_addr learned my addr 172.21.2.135:0/4167997388 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:21.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/4167997388 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a00b1e30 msgr2=0x7fe3a00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:21.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/4167997388 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a00b1e30 0x7fe3a00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/4167997388 >> v2:172.21.2.119:3300/0 conn(0x7fe3a00a7140 msgr2=0x7fe3a01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:21.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/4167997388 >> v2:172.21.2.119:3300/0 conn(0x7fe3a00a7140 0x7fe3a01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/4167997388 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b0910 con 0x7fe3a0148420 2021-11-15T14:41:21.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/4167997388 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a0148420 0x7fe3a00b2210 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fe394002f70 tx=0x7fe394006eb0).ready entity=mon.1 client_cookie=37914a8f692b911 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5175700 1 -- 172.21.2.135:0/4167997388 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39400d570 con 0x7fe3a0148420 2021-11-15T14:41:21.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5175700 1 -- 172.21.2.135:0/4167997388 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394000e90 con 0x7fe3a0148420 2021-11-15T14:41:21.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5175700 1 -- 172.21.2.135:0/4167997388 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39400d900 con 0x7fe3a0148420 2021-11-15T14:41:21.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/4167997388 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a0148420 msgr2=0x7fe3a00b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- 172.21.2.135:0/4167997388 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a0148420 0x7fe3a00b2210 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fe394002f70 tx=0x7fe394006eb0).stop 2021-11-15T14:41:21.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/4167997388 shutdown_connections 2021-11-15T14:41:21.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- 172.21.2.135:0/4167997388 >> v2:172.21.2.119:3300/0 conn(0x7fe3a00a7140 0x7fe3a01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- 172.21.2.135:0/4167997388 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a0148420 0x7fe3a00b2210 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- 172.21.2.135:0/4167997388 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a00b1e30 0x7fe3a00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:21.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/4167997388 >> 172.21.2.135:0/4167997388 conn(0x7fe3a005f730 msgr2=0x7fe3a005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/4167997388 shutdown_connections 2021-11-15T14:41:21.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/4167997388 wait complete. 2021-11-15T14:41:21.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 Processor -- start 2021-11-15T14:41:21.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- start start 2021-11-15T14:41:21.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 0x7fe3a014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 0x7fe3a00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a014b6c0 con 0x7fe3a00a7140 2021-11-15T14:41:21.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b4aa0 con 0x7fe3a00b1e30 2021-11-15T14:41:21.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b4d30 con 0x7fe3a0148420 2021-11-15T14:41:21.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60184/0 (socket says 172.21.2.135:60184) 2021-11-15T14:41:21.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/2005142185 learned_addr learned my addr 172.21.2.135:0/2005142185 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:21.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a6978700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 0x7fe3a00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a6177700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 0x7fe3a014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 msgr2=0x7fe3a00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 0x7fe3a00b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 msgr2=0x7fe3a014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 0x7fe3a014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 -- 172.21.2.135:0/2005142185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39400b1e0 con 0x7fe3a00b1e30 2021-11-15T14:41:21.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a6978700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 0x7fe3a00b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:21.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a6177700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 0x7fe3a014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:21.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a5976700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fe394002f70 tx=0x7fe394015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394006be0 con 0x7fe3a00b1e30 2021-11-15T14:41:21.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400de00 con 0x7fe3a00b1e30 2021-11-15T14:41:21.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a00b4fd0 con 0x7fe3a00b1e30 2021-11-15T14:41:21.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39401e460 con 0x7fe3a00b1e30 2021-11-15T14:41:21.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.824+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0140a40 con 0x7fe3a00b1e30 2021-11-15T14:41:21.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a0140c00 con 0x7fe3a00b1e30 2021-11-15T14:41:21.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe394025030 con 0x7fe3a00b1e30 2021-11-15T14:41:21.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3937fe700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 0x7fe3800559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:21.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe39406cb00 con 0x7fe3a00b1e30 2021-11-15T14:41:21.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3a6177700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 0x7fe3800559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:21.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3a6177700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 0x7fe3800559b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe39c007000 tx=0x7fe39c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:21.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.828+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe394043b10 con 0x7fe3a00b1e30 2021-11-15T14:41:21.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.940+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe3a00b0bb0 con 0x7fe3a00b1e30 2021-11-15T14:41:21.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.952+0000 7fe3937fe700 1 -- 172.21.2.135:0/2005142185 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe394023020 con 0x7fe3a00b1e30 2021-11-15T14:41:21.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 msgr2=0x7fe3800559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 0x7fe3800559b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe39c007000 tx=0x7fe39c008040).stop 2021-11-15T14:41:21.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 msgr2=0x7fe3a014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:21.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fe394002f70 tx=0x7fe394015000).stop 2021-11-15T14:41:21.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 shutdown_connections 2021-11-15T14:41:21.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3800534f0 0x7fe3800559b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3a0148420 0x7fe3a00b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3a00b1e30 0x7fe3a014e4f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 --2- 172.21.2.135:0/2005142185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3a00a7140 0x7fe3a014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:21.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 >> 172.21.2.135:0/2005142185 conn(0x7fe3a005f730 msgr2=0x7fe3a00ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:21.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 shutdown_connections 2021-11-15T14:41:21.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:21.956+0000 7fe3a83db700 1 -- 172.21.2.135:0/2005142185 wait complete. 2021-11-15T14:41:21.961 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:41:21.965 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:41:22.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 Processor -- start 2021-11-15T14:41:22.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 -- start start 2021-11-15T14:41:22.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700a9c90 0x7f8d70060840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8d701401c0 0x7f8d70140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d70066f20 con 0x7f8d700b30c0 2021-11-15T14:41:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d70064960 con 0x7f8d701401c0 2021-11-15T14:41:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d76196700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70061e50 con 0x7f8d700a9c90 2021-11-15T14:41:22.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75194700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8d700b30c0 0x7f8d70065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47776/0 (socket says 172.21.2.135:47776) 2021-11-15T14:41:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75194700 1 -- 172.21.2.135:0/1091571294 learned_addr learned my addr 172.21.2.135:0/1091571294 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d74993700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700a9c90 0x7f8d70060840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 --2- 172.21.2.135:0/1091571294 >> v2:172.21.2.119:3300/0 conn(0x7f8d701401c0 0x7f8d70140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d63fff700 1 -- 172.21.2.135:0/1091571294 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014911527 0 0) 0x7f8d70066f20 con 0x7f8d700b30c0 2021-11-15T14:41:22.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d63fff700 1 -- 172.21.2.135:0/1091571294 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d58003260 con 0x7f8d700b30c0 2021-11-15T14:41:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 -- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700a9c90 msgr2=0x7f8d70060840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700a9c90 0x7f8d70060840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 -- 172.21.2.135:0/1091571294 >> v1:172.21.2.135:6789/0 conn(0x7f8d700b30c0 legacy=0x7f8d70065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 -- 172.21.2.135:0/1091571294 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700b34a0 con 0x7f8d701401c0 2021-11-15T14:41:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d75995700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d70140650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f8d680032f0 tx=0x7f8d680091d0).ready entity=mon.0 client_cookie=1c094575593992e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d63fff700 1 -- 172.21.2.135:0/1091571294 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6800b600 con 0x7f8d701401c0 2021-11-15T14:41:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d63fff700 1 -- 172.21.2.135:0/1091571294 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6800b760 con 0x7f8d701401c0 2021-11-15T14:41:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.016+0000 7f8d63fff700 1 -- 172.21.2.135:0/1091571294 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6800b910 con 0x7f8d701401c0 2021-11-15T14:41:22.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 msgr2=0x7f8d70140650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d70140650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f8d680032f0 tx=0x7f8d680091d0).stop 2021-11-15T14:41:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/1091571294 shutdown_connections 2021-11-15T14:41:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d70140650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- 172.21.2.135:0/1091571294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700a9c90 0x7f8d70060840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/1091571294 >> 172.21.2.135:0/1091571294 conn(0x7f8d70063760 msgr2=0x7f8d70063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/1091571294 shutdown_connections 2021-11-15T14:41:22.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/1091571294 wait complete. 2021-11-15T14:41:22.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 Processor -- start 2021-11-15T14:41:22.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- start start 2021-11-15T14:41:22.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700b30c0 0x7f8d700ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d700abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70149320 con 0x7f8d701401c0 2021-11-15T14:41:22.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70141dd0 con 0x7f8d700a9c90 2021-11-15T14:41:22.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70142070 con 0x7f8d700b30c0 2021-11-15T14:41:22.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60194/0 (socket says 172.21.2.135:60194) 2021-11-15T14:41:22.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 -- 172.21.2.135:0/2823323185 learned_addr learned my addr 172.21.2.135:0/2823323185 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:22.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75995700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d700abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d74993700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700b30c0 0x7f8d700ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 -- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700b30c0 msgr2=0x7f8d700ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700b30c0 0x7f8d700ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 -- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 msgr2=0x7f8d700abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d700abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 -- 172.21.2.135:0/2823323185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68009470 con 0x7f8d700a9c90 2021-11-15T14:41:22.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75995700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d700abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:22.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d75194700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f8d64001110 tx=0x7f8d64007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d640070d0 con 0x7f8d700a9c90 2021-11-15T14:41:22.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64007230 con 0x7f8d700a9c90 2021-11-15T14:41:22.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70142310 con 0x7f8d700a9c90 2021-11-15T14:41:22.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d64005610 con 0x7f8d700a9c90 2021-11-15T14:41:22.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700aaca0 con 0x7f8d700a9c90 2021-11-15T14:41:22.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d700669e0 con 0x7f8d700a9c90 2021-11-15T14:41:22.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d64010070 con 0x7f8d700a9c90 2021-11-15T14:41:22.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 0x7f8d500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8d6406b260 con 0x7f8d700a9c90 2021-11-15T14:41:22.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.020+0000 7f8d74993700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 0x7f8d500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.024+0000 7f8d74993700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 0x7f8d500559b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f8d6c00b000 tx=0x7f8d6c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.024+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d640420e0 con 0x7f8d700a9c90 2021-11-15T14:41:22.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.136+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8d700573d0 con 0x7f8d700a9c90 2021-11-15T14:41:22.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d627fc700 1 -- 172.21.2.135:0/2823323185 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8d64018070 con 0x7f8d700a9c90 2021-11-15T14:41:22.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 msgr2=0x7f8d500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 0x7f8d500559b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f8d6c00b000 tx=0x7f8d6c008040).stop 2021-11-15T14:41:22.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 msgr2=0x7f8d700b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f8d64001110 tx=0x7f8d64007aa0).stop 2021-11-15T14:41:22.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 shutdown_connections 2021-11-15T14:41:22.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8d500534f0 0x7f8d500559b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d701401c0 0x7f8d700abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d700b30c0 0x7f8d700ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 --2- 172.21.2.135:0/2823323185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d700a9c90 0x7f8d700b2100 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 >> 172.21.2.135:0/2823323185 conn(0x7f8d70063760 msgr2=0x7f8d7005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 shutdown_connections 2021-11-15T14:41:22.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.152+0000 7f8d76196700 1 -- 172.21.2.135:0/2823323185 wait complete. 2021-11-15T14:41:22.159 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:41:22.162 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 Processor -- start 2021-11-15T14:41:22.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- start start 2021-11-15T14:41:22.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1f680b1050 0x7f1f681447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f680b03d0 con 0x7f1f68148420 2021-11-15T14:41:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f680b0670 con 0x7f1f680b1e30 2021-11-15T14:41:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f680a9140 con 0x7f1f680b1050 2021-11-15T14:41:22.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f66ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f1f680b1e30 0x7f1f680b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47792/0 (socket says 172.21.2.135:47792) 2021-11-15T14:41:22.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f66ffd700 1 -- 172.21.2.135:0/1061372119 learned_addr learned my addr 172.21.2.135:0/1061372119 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:22.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f677fe700 1 --2- 172.21.2.135:0/1061372119 >> v2:172.21.2.135:3300/0 conn(0x7f1f680b1050 0x7f1f681447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f677fe700 1 -- 172.21.2.135:0/1061372119 >> v1:172.21.2.135:6789/0 conn(0x7f1f680b1e30 legacy=0x7f1f680b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f677fe700 1 -- 172.21.2.135:0/1061372119 >> v1:172.21.2.119:6789/0 conn(0x7f1f68148420 legacy=0x7f1f680a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:22.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f65ffb700 1 -- 172.21.2.135:0/1061372119 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414750830 0 0) 0x7f1f680b0670 con 0x7f1f680b1e30 2021-11-15T14:41:22.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f677fe700 1 -- 172.21.2.135:0/1061372119 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680b0910 con 0x7f1f680b1050 2021-11-15T14:41:22.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f677fe700 1 --2- 172.21.2.135:0/1061372119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1050 0x7f1f681447a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f1f681477b0 tx=0x7f1f600091d0).ready entity=mon.1 client_cookie=dd5cfe861323d9ef server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f65ffb700 1 -- 172.21.2.135:0/1061372119 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6000b820 con 0x7f1f680b1050 2021-11-15T14:41:22.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f65ffb700 1 -- 172.21.2.135:0/1061372119 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6000b980 con 0x7f1f680b1050 2021-11-15T14:41:22.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f65ffb700 1 -- 172.21.2.135:0/1061372119 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6000baf0 con 0x7f1f680b1050 2021-11-15T14:41:22.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- 172.21.2.135:0/1061372119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1050 msgr2=0x7f1f681447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1061372119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1050 0x7f1f681447a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f1f681477b0 tx=0x7f1f600091d0).stop 2021-11-15T14:41:22.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- 172.21.2.135:0/1061372119 shutdown_connections 2021-11-15T14:41:22.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1061372119 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1050 0x7f1f681447a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- 172.21.2.135:0/1061372119 >> 172.21.2.135:0/1061372119 conn(0x7f1f6805f730 msgr2=0x7f1f6805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- 172.21.2.135:0/1061372119 shutdown_connections 2021-11-15T14:41:22.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.208+0000 7f1f6d683700 1 -- 172.21.2.135:0/1061372119 wait complete. 2021-11-15T14:41:22.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 Processor -- start 2021-11-15T14:41:22.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- start start 2021-11-15T14:41:22.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1f680b1050 0x7f1f680ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 0x7f1f680ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6814b570 con 0x7f1f68148420 2021-11-15T14:41:22.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6814aab0 con 0x7f1f680b1e30 2021-11-15T14:41:22.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6814b7c0 con 0x7f1f680b1050 2021-11-15T14:41:22.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60210/0 (socket says 172.21.2.135:60210) 2021-11-15T14:41:22.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 -- 172.21.2.135:0/1361851679 learned_addr learned my addr 172.21.2.135:0/1361851679 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:22.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f66ffd700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1f680b1050 0x7f1f680ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f677fe700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 0x7f1f680ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 -- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1f680b1050 msgr2=0x7f1f680ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1f680b1050 0x7f1f680ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 -- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 msgr2=0x7f1f680ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 0x7f1f680ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 -- 172.21.2.135:0/1361851679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009470 con 0x7f1f680b1e30 2021-11-15T14:41:22.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f677fe700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 0x7f1f680ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:22.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f667fc700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f1f58002f30 tx=0x7f1f58006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f58009e00 con 0x7f1f680b1e30 2021-11-15T14:41:22.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5800f510 con 0x7f1f680b1e30 2021-11-15T14:41:22.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f5800f680 con 0x7f1f680b1e30 2021-11-15T14:41:22.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6814ba60 con 0x7f1f680b1e30 2021-11-15T14:41:22.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f68149c80 con 0x7f1f680b1e30 2021-11-15T14:41:22.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f680b0bb0 con 0x7f1f680b1e30 2021-11-15T14:41:22.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f5800f070 con 0x7f1f680b1e30 2021-11-15T14:41:22.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 0x7f1f4c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1f5806b310 con 0x7f1f680b1e30 2021-11-15T14:41:22.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.212+0000 7f1f66ffd700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 0x7f1f4c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.216+0000 7f1f66ffd700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 0x7f1f4c055ad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1f5000b000 tx=0x7f1f50009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.216+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f58042320 con 0x7f1f680b1e30 2021-11-15T14:41:22.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f680573d0 con 0x7f1f680b1e30 2021-11-15T14:41:22.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f5ffff700 1 -- 172.21.2.135:0/1361851679 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f1f58045940 con 0x7f1f680b1e30 2021-11-15T14:41:22.328 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:22.328 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:22.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 msgr2=0x7f1f4c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 0x7f1f4c055ad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1f5000b000 tx=0x7f1f50009040).stop 2021-11-15T14:41:22.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 msgr2=0x7f1f680ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f1f58002f30 tx=0x7f1f58006d60).stop 2021-11-15T14:41:22.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 shutdown_connections 2021-11-15T14:41:22.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1f4c053610 0x7f1f4c055ad0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1f68148420 0x7f1f680ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1f680b1e30 0x7f1f680ab470 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 --2- 172.21.2.135:0/1361851679 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1f680b1050 0x7f1f680ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 >> 172.21.2.135:0/1361851679 conn(0x7f1f6805f730 msgr2=0x7f1f680b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 shutdown_connections 2021-11-15T14:41:22.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.324+0000 7f1f6d683700 1 -- 172.21.2.135:0/1361851679 wait complete. 2021-11-15T14:41:22.332 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:22.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:20.413532+0000', 'modified': '2021-11-15T14:41:21.420118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6592': {'gid': 6592, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2353104627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2353104627}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2353104627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:22.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:22.639 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:22.708 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6592,"want_state":"up:active","state":"up:active","rank_uptime":2.2830270480000001,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":6.5978331739999998} 2021-11-15T14:41:22.708 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6592, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 2.283027048, "state": "up:active", "uptime": 6.597833174, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:22.709 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:22.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 Processor -- start 2021-11-15T14:41:22.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 -- start start 2021-11-15T14:41:22.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f05fc148420 0x7f05fc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc0b03d0 con 0x7f05fc0a7140 2021-11-15T14:41:22.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc0b0670 con 0x7f05fc0b1e30 2021-11-15T14:41:22.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0603386700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05fc0a9140 con 0x7f05fc148420 2021-11-15T14:41:22.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0601122700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f05fc0b1e30 0x7f05fc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47804/0 (socket says 172.21.2.135:47804) 2021-11-15T14:41:22.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0601122700 1 -- 172.21.2.135:0/3467601606 learned_addr learned my addr 172.21.2.135:0/3467601606 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:22.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031144723 0 0) 0x7f05fc0b0670 con 0x7f05fc0b1e30 2021-11-15T14:41:22.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e4003260 con 0x7f05fc0b1e30 2021-11-15T14:41:22.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 --2- 172.21.2.135:0/3467601606 >> v2:172.21.2.119:3300/0 conn(0x7f05fc148420 0x7f05fc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907086043 0 0) 0x7f05e4003260 con 0x7f05fc0b1e30 2021-11-15T14:41:22.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 >> v2:172.21.2.119:3300/0 conn(0x7f05fc148420 msgr2=0x7f05fc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:22.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 --2- 172.21.2.135:0/3467601606 >> v2:172.21.2.119:3300/0 conn(0x7f05fc148420 0x7f05fc0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 >> v1:172.21.2.119:6789/0 conn(0x7f05fc0a7140 legacy=0x7f05fc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0b0910 con 0x7f05fc0b1e30 2021-11-15T14:41:22.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f05f8001660 con 0x7f05fc0b1e30 2021-11-15T14:41:22.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 >> v1:172.21.2.135:6789/0 conn(0x7f05fc0b1e30 legacy=0x7f05fc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4003750 0x7f05e4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 0x7f05e4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05e4004ec0 0x7f05e400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e400bd70 con 0x7f05e4003750 2021-11-15T14:41:22.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e400bee0 con 0x7f05e4004500 2021-11-15T14:41:22.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e400c0a0 con 0x7f05e4004ec0 2021-11-15T14:41:22.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 0x7f05e4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0601122700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4003750 0x7f05e4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0601923700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05e4004ec0 0x7f05e400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 -- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05e4004ec0 msgr2=0x7f05e400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:22.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05e4004ec0 0x7f05e400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 -- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4003750 msgr2=0x7f05e4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:22.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4003750 0x7f05e4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 -- 172.21.2.135:0/3467601606 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4003260 con 0x7f05e4004500 2021-11-15T14:41:22.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0601923700 1 -- 172.21.2.135:0/3467601606 reap_dead start 2021-11-15T14:41:22.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f0600921700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 0x7f05e4004980 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f05f000a000 tx=0x7f05f0008040).ready entity=mon.1 client_cookie=8ba3cb07ae3fe172 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0013670 con 0x7f05e4004500 2021-11-15T14:41:22.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f00137d0 con 0x7f05e4004500 2021-11-15T14:41:22.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.756+0000 7f05effff700 1 -- 172.21.2.135:0/3467601606 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0013b30 con 0x7f05e4004500 2021-11-15T14:41:22.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 msgr2=0x7f05e4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 0x7f05e4004980 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f05f000a000 tx=0x7f05f0008040).stop 2021-11-15T14:41:22.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/3467601606 shutdown_connections 2021-11-15T14:41:22.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 --2- 172.21.2.135:0/3467601606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05e4004500 0x7f05e4004980 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/3467601606 >> 172.21.2.135:0/3467601606 conn(0x7f05fc05f730 msgr2=0x7f05fc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/3467601606 shutdown_connections 2021-11-15T14:41:22.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/3467601606 wait complete. 2021-11-15T14:41:22.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 Processor -- start 2021-11-15T14:41:22.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- start start 2021-11-15T14:41:22.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4004500 0x7f05fc0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 0x7f05fc0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14b420 con 0x7f05e4004500 2021-11-15T14:41:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14b6c0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14b960 con 0x7f05fc1568f0 2021-11-15T14:41:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60232/0 (socket says 172.21.2.135:60232) 2021-11-15T14:41:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 -- 172.21.2.135:0/2888903696 learned_addr learned my addr 172.21.2.135:0/2888903696 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601122700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4004500 0x7f05fc0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0600921700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 0x7f05fc0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 -- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 msgr2=0x7f05fc0ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 0x7f05fc0ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 -- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4004500 msgr2=0x7f05fc0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4004500 0x7f05fc0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 -- 172.21.2.135:0/2888903696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc14bc00 con 0x7f05fc0a94c0 2021-11-15T14:41:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0600921700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 0x7f05fc0ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0601923700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f05f4000b60 tx=0x7f05f4007d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f4006c90 con 0x7f05fc0a94c0 2021-11-15T14:41:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4006df0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc0aea00 con 0x7f05fc0a94c0 2021-11-15T14:41:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f4007220 con 0x7f05fc0a94c0 2021-11-15T14:41:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc143790 con 0x7f05fc0a94c0 2021-11-15T14:41:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc0aadb0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f05f4007380 con 0x7f05fc0a94c0 2021-11-15T14:41:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 0x7f05dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.760+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f05f406b710 con 0x7f05fc0a94c0 2021-11-15T14:41:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.764+0000 7f0601122700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 0x7f05dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.764+0000 7f0601122700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 0x7f05dc0559b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f05f8005000 tx=0x7f05fc0b0aa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.764+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05fc0aadb0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.848+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05fc0aadb0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.848+0000 7f05ee7fc700 1 -- 172.21.2.135:0/2888903696 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f05f4025fb0 con 0x7f05fc0a94c0 2021-11-15T14:41:22.853 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:22.854 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":91,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:22.433725+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:18.216736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:19.436050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:22.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 msgr2=0x7f05dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 0x7f05dc0559b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f05f8005000 tx=0x7f05fc0b0aa0).stop 2021-11-15T14:41:22.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 msgr2=0x7f05fc0ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f05f4000b60 tx=0x7f05f4007d80).stop 2021-11-15T14:41:22.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 shutdown_connections 2021-11-15T14:41:22.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc0534f0 0x7f05dc0559b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05fc0a94c0 0x7f05fc0ab540 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05fc1568f0 0x7f05fc0ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 --2- 172.21.2.135:0/2888903696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05e4004500 0x7f05fc0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 >> 172.21.2.135:0/2888903696 conn(0x7f05fc05f730 msgr2=0x7f05fc0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 shutdown_connections 2021-11-15T14:41:22.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.852+0000 7f0603386700 1 -- 172.21.2.135:0/2888903696 wait complete. 2021-11-15T14:41:22.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:18.216736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:19.436050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:41:22.862 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:22.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 Processor -- start 2021-11-15T14:41:22.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- start start 2021-11-15T14:41:22.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd0400b1350 0x7fd0400b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400a7850 con 0x7fd0400b1f40 2021-11-15T14:41:22.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400b06d0 con 0x7fd0400b2320 2021-11-15T14:41:22.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400b17c0 con 0x7fd0400b1350 2021-11-15T14:41:22.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd0400b1350 0x7fd0400b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd0400b1350 0x7fd0400b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60240/0 (socket says 172.21.2.135:60240) 2021-11-15T14:41:22.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 -- 172.21.2.135:0/1403962464 learned_addr learned my addr 172.21.2.135:0/1403962464 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:22.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 -- 172.21.2.135:0/1403962464 >> v1:172.21.2.135:6789/0 conn(0x7fd0400b2320 legacy=0x7fd0401412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 -- 172.21.2.135:0/1403962464 >> v1:172.21.2.119:6789/0 conn(0x7fd0400b1f40 legacy=0x7fd0400a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:22.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 -- 172.21.2.135:0/1403962464 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400b0970 con 0x7fd0400b1350 2021-11-15T14:41:22.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd045216700 1 --2- 172.21.2.135:0/1403962464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400b0030 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd0400ad350 tx=0x7fd030006eb0).ready entity=mon.1 client_cookie=a05262da0068d2a8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd044a15700 1 -- 172.21.2.135:0/1403962464 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000d610 con 0x7fd0400b1350 2021-11-15T14:41:22.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd044a15700 1 -- 172.21.2.135:0/1403962464 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030000e90 con 0x7fd0400b1350 2021-11-15T14:41:22.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd044a15700 1 -- 172.21.2.135:0/1403962464 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000d960 con 0x7fd0400b1350 2021-11-15T14:41:22.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- 172.21.2.135:0/1403962464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 msgr2=0x7fd0400b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 --2- 172.21.2.135:0/1403962464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400b0030 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd0400ad350 tx=0x7fd030006eb0).stop 2021-11-15T14:41:22.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- 172.21.2.135:0/1403962464 shutdown_connections 2021-11-15T14:41:22.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 --2- 172.21.2.135:0/1403962464 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400b0030 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:22.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- 172.21.2.135:0/1403962464 >> 172.21.2.135:0/1403962464 conn(0x7fd04005f730 msgr2=0x7fd04005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:22.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- 172.21.2.135:0/1403962464 shutdown_connections 2021-11-15T14:41:22.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.912+0000 7fd047c7b700 1 -- 172.21.2.135:0/1403962464 wait complete. 2021-11-15T14:41:22.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 Processor -- start 2021-11-15T14:41:22.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- start start 2021-11-15T14:41:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd0400b1f40 0x7fd040156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0400b2320 0x7fd0400af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400aba00 con 0x7fd0400b1f40 2021-11-15T14:41:22.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400abe90 con 0x7fd0400b1350 2021-11-15T14:41:22.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400aa7c0 con 0x7fd0400b2320 2021-11-15T14:41:22.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60244/0 (socket says 172.21.2.135:60244) 2021-11-15T14:41:22.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 -- 172.21.2.135:0/3015925010 learned_addr learned my addr 172.21.2.135:0/3015925010 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:22.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 -- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0400b2320 msgr2=0x7fd0400af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0400b2320 0x7fd0400af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:22.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 -- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd0400b1f40 msgr2=0x7fd040156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:22.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd0400b1f40 0x7fd040156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:22.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 -- 172.21.2.135:0/3015925010 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03000b1e0 con 0x7fd0400b1350 2021-11-15T14:41:22.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045a17700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fd03c002fb0 tx=0x7fd03c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03c013460 con 0x7fd0400b1350 2021-11-15T14:41:22.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c0135c0 con 0x7fd0400b1350 2021-11-15T14:41:22.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400aac50 con 0x7fd0400b1350 2021-11-15T14:41:22.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03c013920 con 0x7fd0400b1350 2021-11-15T14:41:22.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0400ab4d0 con 0x7fd0400b1350 2021-11-15T14:41:22.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400a9640 con 0x7fd0400b1350 2021-11-15T14:41:22.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd03c00f070 con 0x7fd0400b1350 2021-11-15T14:41:22.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 0x7fd020055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:22.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd03c06b5e0 con 0x7fd0400b1350 2021-11-15T14:41:22.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.916+0000 7fd045216700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 0x7fd020055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:22.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.920+0000 7fd045216700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 0x7fd020055be0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd0400ad350 tx=0x7fd030015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:22.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:22.920+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd03c0424e0 con 0x7fd0400b1350 2021-11-15T14:41:23.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd0400a9e40 con 0x7fd0400b1350 2021-11-15T14:41:23.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd02effd700 1 -- 172.21.2.135:0/3015925010 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd03c045b00 con 0x7fd0400b1350 2021-11-15T14:41:23.008 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:23.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 msgr2=0x7fd020055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 0x7fd020055be0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd0400ad350 tx=0x7fd030015000).stop 2021-11-15T14:41:23.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 msgr2=0x7fd0400aafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fd03c002fb0 tx=0x7fd03c006df0).stop 2021-11-15T14:41:23.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 shutdown_connections 2021-11-15T14:41:23.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd020053720 0x7fd020055be0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0400b2320 0x7fd0400af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd0400b1f40 0x7fd040156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 --2- 172.21.2.135:0/3015925010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0400b1350 0x7fd0400aafe0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 >> 172.21.2.135:0/3015925010 conn(0x7fd04005f730 msgr2=0x7fd0400b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 shutdown_connections 2021-11-15T14:41:23.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.004+0000 7fd047c7b700 1 -- 172.21.2.135:0/3015925010 wait complete. 2021-11-15T14:41:23.015 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:23.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 Processor -- start 2021-11-15T14:41:23.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- start start 2021-11-15T14:41:23.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a84064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a840b3950 0x7f6a84065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6a840b2ca0 0x7f6a840b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a84065770 con 0x7f6a840b2ca0 2021-11-15T14:41:23.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a840b2430 con 0x7f6a840b3950 2021-11-15T14:41:23.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840b26d0 con 0x7f6a84060040 2021-11-15T14:41:23.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a840b3950 0x7f6a84065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a840b3950 0x7f6a84065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60250/0 (socket says 172.21.2.135:60250) 2021-11-15T14:41:23.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 -- 172.21.2.135:0/3680745210 learned_addr learned my addr 172.21.2.135:0/3680745210 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:23.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 -- 172.21.2.135:0/3680745210 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 msgr2=0x7f6a84064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:23.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 --2- 172.21.2.135:0/3680745210 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a84064d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 -- 172.21.2.135:0/3680745210 >> v2:172.21.2.119:3300/0 conn(0x7f6a840b2ca0 msgr2=0x7f6a840b4090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:23.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 --2- 172.21.2.135:0/3680745210 >> v2:172.21.2.119:3300/0 conn(0x7f6a840b2ca0 0x7f6a840b4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 -- 172.21.2.135:0/3680745210 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840b2970 con 0x7f6a840b3950 2021-11-15T14:41:23.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a83fff700 1 --2- 172.21.2.135:0/3680745210 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a84065280 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f6a6c002f70 tx=0x7f6a6c006eb0).ready entity=mon.1 client_cookie=5c2aaa0c795af240 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a837fe700 1 -- 172.21.2.135:0/3680745210 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6c010b60 con 0x7f6a840b3950 2021-11-15T14:41:23.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a837fe700 1 -- 172.21.2.135:0/3680745210 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c000e90 con 0x7f6a840b3950 2021-11-15T14:41:23.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a837fe700 1 -- 172.21.2.135:0/3680745210 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6c0183d0 con 0x7f6a840b3950 2021-11-15T14:41:23.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- 172.21.2.135:0/3680745210 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 msgr2=0x7f6a84065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/3680745210 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a84065280 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f6a6c002f70 tx=0x7f6a6c006eb0).stop 2021-11-15T14:41:23.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- 172.21.2.135:0/3680745210 shutdown_connections 2021-11-15T14:41:23.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/3680745210 >> v2:172.21.2.119:3300/0 conn(0x7f6a840b2ca0 0x7f6a840b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/3680745210 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a84065280 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/3680745210 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a84064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- 172.21.2.135:0/3680745210 >> 172.21.2.135:0/3680745210 conn(0x7f6a8405cfe0 msgr2=0x7f6a8405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- 172.21.2.135:0/3680745210 shutdown_connections 2021-11-15T14:41:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.064+0000 7f6a8ad58700 1 -- 172.21.2.135:0/3680745210 wait complete. 2021-11-15T14:41:23.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 Processor -- start 2021-11-15T14:41:23.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- start start 2021-11-15T14:41:23.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a8413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a840b2ca0 0x7f6a840ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840ae880 con 0x7f6a840b2ca0 2021-11-15T14:41:23.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840afd30 con 0x7f6a840b3950 2021-11-15T14:41:23.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840aef70 con 0x7f6a84060040 2021-11-15T14:41:23.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60260/0 (socket says 172.21.2.135:60260) 2021-11-15T14:41:23.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 -- 172.21.2.135:0/17645214 learned_addr learned my addr 172.21.2.135:0/17645214 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:23.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 -- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 msgr2=0x7f6a8413bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a8413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 -- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a840b2ca0 msgr2=0x7f6a840ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a840b2ca0 0x7f6a840ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 -- 172.21.2.135:0/17645214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c00b1e0 con 0x7f6a840b3950 2021-11-15T14:41:23.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a892f5700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6a8413eca0 tx=0x7f6a7c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7c001520 con 0x7f6a840b3950 2021-11-15T14:41:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c001680 con 0x7f6a840b3950 2021-11-15T14:41:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a840afa90 con 0x7f6a840b3950 2021-11-15T14:41:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a840aec60 con 0x7f6a840b3950 2021-11-15T14:41:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7c0019e0 con 0x7f6a840b3950 2021-11-15T14:41:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a840648f0 con 0x7f6a840b3950 2021-11-15T14:41:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a7c018030 con 0x7f6a840b3950 2021-11-15T14:41:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 0x7f6a68055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.068+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6a7c06b510 con 0x7f6a840b3950 2021-11-15T14:41:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.072+0000 7f6a88af4700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 0x7f6a68055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.072+0000 7f6a88af4700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 0x7f6a68055b20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f6a74002fb0 tx=0x7f6a740069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.072+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a7c0425d0 con 0x7f6a840b3950 2021-11-15T14:41:23.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.152+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a840573d0 con 0x7f6a840b3950 2021-11-15T14:41:23.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a81ffb700 1 -- 172.21.2.135:0/17645214 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a7c045bf0 con 0x7f6a840b3950 2021-11-15T14:41:23.158 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:23.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 msgr2=0x7f6a68055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 0x7f6a68055b20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f6a74002fb0 tx=0x7f6a740069b0).stop 2021-11-15T14:41:23.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 msgr2=0x7f6a840ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f6a8413eca0 tx=0x7f6a7c0091a0).stop 2021-11-15T14:41:23.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 shutdown_connections 2021-11-15T14:41:23.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a68053660 0x7f6a68055b20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a840b3950 0x7f6a840ac560 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a840b2ca0 0x7f6a840ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 --2- 172.21.2.135:0/17645214 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a84060040 0x7f6a8413bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 >> 172.21.2.135:0/17645214 conn(0x7f6a8405cfe0 msgr2=0x7f6a84140100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 shutdown_connections 2021-11-15T14:41:23.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.156+0000 7f6a8ad58700 1 -- 172.21.2.135:0/17645214 wait complete. 2021-11-15T14:41:23.165 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:41:23.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.212+0000 7f2ec2285700 1 Processor -- start 2021-11-15T14:41:23.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.212+0000 7f2ec2285700 1 -- start start 2021-11-15T14:41:23.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.212+0000 7f2ec2285700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.212+0000 7f2ec2285700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc0b3790 0x7f2ebc13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.212+0000 7f2ec2285700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc1439a0 con 0x7f2ebc13dac0 2021-11-15T14:41:23.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc143c40 con 0x7f2ebc0b0630 2021-11-15T14:41:23.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc143ee0 con 0x7f2ebc0b3790 2021-11-15T14:41:23.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec0822700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2ebc13dac0 0x7f2ebc0b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47854/0 (socket says 172.21.2.135:47854) 2021-11-15T14:41:23.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60264/0 (socket says 172.21.2.135:60264) 2021-11-15T14:41:23.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec0822700 1 -- 172.21.2.135:0/3663945828 learned_addr learned my addr 172.21.2.135:0/3663945828 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:23.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 -- 172.21.2.135:0/3663945828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc0b3790 msgr2=0x7f2ebc13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 --2- 172.21.2.135:0/3663945828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc0b3790 0x7f2ebc13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 -- 172.21.2.135:0/3663945828 >> v1:172.21.2.135:6789/0 conn(0x7f2ebc13dac0 legacy=0x7f2ebc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 -- 172.21.2.135:0/3663945828 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc144180 con 0x7f2ebc0b0630 2021-11-15T14:41:23.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebbfff700 1 --2- 172.21.2.135:0/3663945828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f2eac002f70 tx=0x7f2eac006df0).ready entity=mon.1 client_cookie=b9cced261299cac2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebaffd700 1 -- 172.21.2.135:0/3663945828 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eac00d570 con 0x7f2ebc0b0630 2021-11-15T14:41:23.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebaffd700 1 -- 172.21.2.135:0/3663945828 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac000e90 con 0x7f2ebc0b0630 2021-11-15T14:41:23.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebaffd700 1 -- 172.21.2.135:0/3663945828 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eac00d8c0 con 0x7f2ebc0b0630 2021-11-15T14:41:23.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/3663945828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b0630 msgr2=0x7f2ebc0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- 172.21.2.135:0/3663945828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f2eac002f70 tx=0x7f2eac006df0).stop 2021-11-15T14:41:23.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/3663945828 shutdown_connections 2021-11-15T14:41:23.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- 172.21.2.135:0/3663945828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc0b3790 0x7f2ebc13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- 172.21.2.135:0/3663945828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0b0a10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/3663945828 >> 172.21.2.135:0/3663945828 conn(0x7f2ebc060840 msgr2=0x7f2ebc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/3663945828 shutdown_connections 2021-11-15T14:41:23.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/3663945828 wait complete. 2021-11-15T14:41:23.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 Processor -- start 2021-11-15T14:41:23.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- start start 2021-11-15T14:41:23.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc13dac0 0x7f2ebc0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc153780 con 0x7f2ebc0b0630 2021-11-15T14:41:23.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0ab500 con 0x7f2ebc0b3790 2021-11-15T14:41:23.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0ab7a0 con 0x7f2ebc13dac0 2021-11-15T14:41:23.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60274/0 (socket says 172.21.2.135:60274) 2021-11-15T14:41:23.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 -- 172.21.2.135:0/1249514528 learned_addr learned my addr 172.21.2.135:0/1249514528 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:23.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 -- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc13dac0 msgr2=0x7f2ebc0670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc13dac0 0x7f2ebc0670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 -- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ebc0b0630 msgr2=0x7f2ebc0644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 -- 172.21.2.135:0/1249514528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac00b180 con 0x7f2ebc0b3790 2021-11-15T14:41:23.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ebb7fe700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f2ea4002f70 tx=0x7f2ea4006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea4013460 con 0x7f2ebc0b3790 2021-11-15T14:41:23.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40135c0 con 0x7f2ebc0b3790 2021-11-15T14:41:23.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0aba40 con 0x7f2ebc0b3790 2021-11-15T14:41:23.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea4013920 con 0x7f2ebc0b3790 2021-11-15T14:41:23.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.216+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc0ab1f0 con 0x7f2ebc0b3790 2021-11-15T14:41:23.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc143620 con 0x7f2ebc0b3790 2021-11-15T14:41:23.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ea401a060 con 0x7f2ebc0b3790 2021-11-15T14:41:23.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2eb97fa700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 0x7f2ea0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2ea406b570 con 0x7f2ebc0b3790 2021-11-15T14:41:23.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2ebbfff700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 0x7f2ea0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2ebbfff700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 0x7f2ea0055a70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f2eac002f70 tx=0x7f2eac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.220+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ea4042470 con 0x7f2ebc0b3790 2021-11-15T14:41:23.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ebc0573d0 con 0x7f2ebc0b3790 2021-11-15T14:41:23.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2eb97fa700 1 -- 172.21.2.135:0/1249514528 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2ea4045a90 con 0x7f2ebc0b3790 2021-11-15T14:41:23.309 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:23.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 msgr2=0x7f2ea0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 0x7f2ea0055a70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f2eac002f70 tx=0x7f2eac015000).stop 2021-11-15T14:41:23.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 msgr2=0x7f2ebc153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.304+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f2ea4002f70 tx=0x7f2ea4006e90).stop 2021-11-15T14:41:23.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 shutdown_connections 2021-11-15T14:41:23.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ea00535b0 0x7f2ea0055a70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2ebc13dac0 0x7f2ebc0670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ebc0b3790 0x7f2ebc153290 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 --2- 172.21.2.135:0/1249514528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ebc0b0630 0x7f2ebc0644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 >> 172.21.2.135:0/1249514528 conn(0x7f2ebc060840 msgr2=0x7f2ebc0b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 shutdown_connections 2021-11-15T14:41:23.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.308+0000 7f2ec2285700 1 -- 172.21.2.135:0/1249514528 wait complete. 2021-11-15T14:41:23.316 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:41:23.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 Processor -- start 2021-11-15T14:41:23.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 -- start start 2021-11-15T14:41:23.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2f940b1350 0x7f2f940b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f940a7850 con 0x7f2f940b2320 2021-11-15T14:41:23.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f940b06d0 con 0x7f2f940b1f40 2021-11-15T14:41:23.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f9c229700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f940b17c0 con 0x7f2f940b1350 2021-11-15T14:41:23.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f99fc5700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2f940b1f40 0x7f2f940a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47866/0 (socket says 172.21.2.135:47866) 2021-11-15T14:41:23.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f99fc5700 1 -- 172.21.2.135:0/2294954230 learned_addr learned my addr 172.21.2.135:0/2294954230 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:23.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f997c4700 1 --2- 172.21.2.135:0/2294954230 >> v2:172.21.2.135:3300/0 conn(0x7f2f940b1350 0x7f2f940b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f997c4700 1 -- 172.21.2.135:0/2294954230 >> v1:172.21.2.135:6789/0 conn(0x7f2f940b1f40 legacy=0x7f2f940a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f997c4700 1 -- 172.21.2.135:0/2294954230 >> v1:172.21.2.119:6789/0 conn(0x7f2f940b2320 legacy=0x7f2f941412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.364+0000 7f2f997c4700 1 -- 172.21.2.135:0/2294954230 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f940b0970 con 0x7f2f940b1350 2021-11-15T14:41:23.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f997c4700 1 --2- 172.21.2.135:0/2294954230 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b1350 0x7f2f940b0030 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2f940ad350 tx=0x7f2f88006df0).ready entity=mon.1 client_cookie=1feda80957afd1a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f98fc3700 1 -- 172.21.2.135:0/2294954230 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8800d5c0 con 0x7f2f940b1350 2021-11-15T14:41:23.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f98fc3700 1 -- 172.21.2.135:0/2294954230 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88000e90 con 0x7f2f940b1350 2021-11-15T14:41:23.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f98fc3700 1 -- 172.21.2.135:0/2294954230 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8800d910 con 0x7f2f940b1350 2021-11-15T14:41:23.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2294954230 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b1350 msgr2=0x7f2f940b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2294954230 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b1350 0x7f2f940b0030 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2f940ad350 tx=0x7f2f88006df0).stop 2021-11-15T14:41:23.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2294954230 shutdown_connections 2021-11-15T14:41:23.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2294954230 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b1350 0x7f2f940b0030 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2294954230 >> 172.21.2.135:0/2294954230 conn(0x7f2f9405f730 msgr2=0x7f2f9405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2294954230 shutdown_connections 2021-11-15T14:41:23.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2294954230 wait complete. 2021-11-15T14:41:23.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 Processor -- start 2021-11-15T14:41:23.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- start start 2021-11-15T14:41:23.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2f940b1350 0x7f2f940aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2f940b1f40 0x7f2f94148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940aad50 con 0x7f2f940b1f40 2021-11-15T14:41:23.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9414a970 con 0x7f2f940b2320 2021-11-15T14:41:23.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9414ac10 con 0x7f2f940b1350 2021-11-15T14:41:23.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60286/0 (socket says 172.21.2.135:60286) 2021-11-15T14:41:23.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 -- 172.21.2.135:0/2298550211 learned_addr learned my addr 172.21.2.135:0/2298550211 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:23.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 -- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2f940b1350 msgr2=0x7f2f940aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2f940b1350 0x7f2f940aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 -- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2f940b1f40 msgr2=0x7f2f94148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2f940b1f40 0x7f2f94148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 -- 172.21.2.135:0/2298550211 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8800b180 con 0x7f2f940b2320 2021-11-15T14:41:23.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9a7c6700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2f8c003270 tx=0x7f2f8c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c00d4a0 con 0x7f2f940b2320 2021-11-15T14:41:23.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00d600 con 0x7f2f940b2320 2021-11-15T14:41:23.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9414aeb0 con 0x7f2f940b2320 2021-11-15T14:41:23.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c00d960 con 0x7f2f940b2320 2021-11-15T14:41:23.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f940aa190 con 0x7f2f940b2320 2021-11-15T14:41:23.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f940573d0 con 0x7f2f940b2320 2021-11-15T14:41:23.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.368+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f8c018030 con 0x7f2f940b2320 2021-11-15T14:41:23.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.372+0000 7f2f86ffd700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 0x7f2f74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.372+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2f8c06b430 con 0x7f2f940b2320 2021-11-15T14:41:23.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.372+0000 7f2f99fc5700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 0x7f2f74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.372+0000 7f2f99fc5700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 0x7f2f74055ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f2f940b2fd0 tx=0x7f2f90007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.372+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f8c0423e0 con 0x7f2f940b2320 2021-11-15T14:41:23.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.456+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f940b64b0 con 0x7f2f940b2320 2021-11-15T14:41:23.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.456+0000 7f2f86ffd700 1 -- 172.21.2.135:0/2298550211 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2f8c045a00 con 0x7f2f940b2320 2021-11-15T14:41:23.461 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:23.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 msgr2=0x7f2f74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 0x7f2f74055ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f2f940b2fd0 tx=0x7f2f90007800).stop 2021-11-15T14:41:23.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 msgr2=0x7f2f94157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2f8c003270 tx=0x7f2f8c0090f0).stop 2021-11-15T14:41:23.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 shutdown_connections 2021-11-15T14:41:23.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2f74053610 0x7f2f74055ad0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2f940b2320 0x7f2f94157570 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2f940b1f40 0x7f2f94148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 --2- 172.21.2.135:0/2298550211 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2f940b1350 0x7f2f940aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 >> 172.21.2.135:0/2298550211 conn(0x7f2f9405f730 msgr2=0x7f2f940b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 shutdown_connections 2021-11-15T14:41:23.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.460+0000 7f2f9c229700 1 -- 172.21.2.135:0/2298550211 wait complete. 2021-11-15T14:41:23.469 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:41:23.470 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:23.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 Processor -- start 2021-11-15T14:41:23.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 -- start start 2021-11-15T14:41:23.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 0x7fc04414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0440aac30 con 0x7fc044067380 2021-11-15T14:41:23.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc044060560 con 0x7fc044060180 2021-11-15T14:41:23.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0498d5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc044066f20 con 0x7fc044144080 2021-11-15T14:41:23.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc042ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc044060180 0x7fc0440b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47880/0 (socket says 172.21.2.135:47880) 2021-11-15T14:41:23.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc042ffd700 1 -- 172.21.2.135:0/2182160535 learned_addr learned my addr 172.21.2.135:0/2182160535 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:23.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125761947 0 0) 0x7fc044060560 con 0x7fc044060180 2021-11-15T14:41:23.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc024003260 con 0x7fc044060180 2021-11-15T14:41:23.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 0x7fc04414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543012073 0 0) 0x7fc024003260 con 0x7fc044060180 2021-11-15T14:41:23.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 msgr2=0x7fc04414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 0x7fc04414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 >> v1:172.21.2.119:6789/0 conn(0x7fc044067380 legacy=0x7fc044143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440b3430 con 0x7fc044060180 2021-11-15T14:41:23.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc034001660 con 0x7fc044060180 2021-11-15T14:41:23.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 >> v1:172.21.2.135:6789/0 conn(0x7fc044060180 legacy=0x7fc0440b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0240037d0 0x7fc024003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 0x7fc024004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc024004a60 0x7fc024004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044066f20 con 0x7fc0240037d0 2021-11-15T14:41:23.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400b8e0 con 0x7fc024004a60 2021-11-15T14:41:23.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400baa0 con 0x7fc044144080 2021-11-15T14:41:23.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc024004a60 0x7fc024004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 -- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 msgr2=0x7fc024004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc044144080 0x7fc024004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 -- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0240037d0 msgr2=0x7fc024003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:23.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0240037d0 0x7fc024003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:23.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 -- 172.21.2.135:0/2182160535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024003260 con 0x7fc024004a60 2021-11-15T14:41:23.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.516+0000 7fc0437fe700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc024004a60 0x7fc024004ee0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc03c00a000 tx=0x7fc03c008040).ready entity=mon.1 client_cookie=438a1edd33b94ec2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c00c070 con 0x7fc024004a60 2021-11-15T14:41:23.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00e620 con 0x7fc024004a60 2021-11-15T14:41:23.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc041ffb700 1 -- 172.21.2.135:0/2182160535 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c00e980 con 0x7fc024004a60 2021-11-15T14:41:23.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/2182160535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc024004a60 msgr2=0x7fc024004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 --2- 172.21.2.135:0/2182160535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc024004a60 0x7fc024004ee0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc03c00a000 tx=0x7fc03c008040).stop 2021-11-15T14:41:23.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 -- 172.21.2.135:0/2182160535 reap_dead start 2021-11-15T14:41:23.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/2182160535 shutdown_connections 2021-11-15T14:41:23.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/2182160535 >> 172.21.2.135:0/2182160535 conn(0x7fc04405cfb0 msgr2=0x7fc04405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/2182160535 shutdown_connections 2021-11-15T14:41:23.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/2182160535 wait complete. 2021-11-15T14:41:23.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 Processor -- start 2021-11-15T14:41:23.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- start start 2021-11-15T14:41:23.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc024004a60 0x7fc0440b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0440abf90 0x7fc044150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440accf0 con 0x7fc024004a60 2021-11-15T14:41:23.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044154830 con 0x7fc044150870 2021-11-15T14:41:23.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc044154320 con 0x7fc0440abf90 2021-11-15T14:41:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60306/0 (socket says 172.21.2.135:60306) 2021-11-15T14:41:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 -- 172.21.2.135:0/1342623483 learned_addr learned my addr 172.21.2.135:0/1342623483 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc042ffd700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc024004a60 0x7fc0440b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0427fc700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0440abf90 0x7fc044150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 -- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0440abf90 msgr2=0x7fc044150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0440abf90 0x7fc044150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 -- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc024004a60 msgr2=0x7fc0440b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc024004a60 0x7fc0440b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 -- 172.21.2.135:0/1342623483 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044154590 con 0x7fc044150870 2021-11-15T14:41:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0437fe700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fc0440acbd0 tx=0x7fc03c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c0094a0 con 0x7fc044150870 2021-11-15T14:41:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c01d440 con 0x7fc044150870 2021-11-15T14:41:23.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c01d5b0 con 0x7fc044150870 2021-11-15T14:41:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440ac5b0 con 0x7fc044150870 2021-11-15T14:41:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0440b1080 con 0x7fc044150870 2021-11-15T14:41:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0440573d0 con 0x7fc044150870 2021-11-15T14:41:23.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc03c01d710 con 0x7fc044150870 2021-11-15T14:41:23.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 0x7fc028055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:23.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.520+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc03c06c560 con 0x7fc044150870 2021-11-15T14:41:23.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.524+0000 7fc042ffd700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 0x7fc028055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:23.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.524+0000 7fc042ffd700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 0x7fc028055b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fc03400b000 tx=0x7fc034001690).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:23.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.524+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc03c043550 con 0x7fc044150870 2021-11-15T14:41:23.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.632+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc044069960 con 0x7fc044150870 2021-11-15T14:41:23.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc03bfff700 1 -- 172.21.2.135:0/1342623483 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fc03c046b30 con 0x7fc044150870 2021-11-15T14:41:23.638 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:23.639 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:23.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 msgr2=0x7fc028055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 0x7fc028055b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fc03400b000 tx=0x7fc034001690).stop 2021-11-15T14:41:23.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 msgr2=0x7fc0440afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:23.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fc0440acbd0 tx=0x7fc03c008040).stop 2021-11-15T14:41:23.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 shutdown_connections 2021-11-15T14:41:23.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc028053690 0x7fc028055b50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc044150870 0x7fc0440afe20 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0440abf90 0x7fc044150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 --2- 172.21.2.135:0/1342623483 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc024004a60 0x7fc0440b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:23.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 >> 172.21.2.135:0/1342623483 conn(0x7fc04405cfb0 msgr2=0x7fc04405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:23.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 shutdown_connections 2021-11-15T14:41:23.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:23.636+0000 7fc0498d5700 1 -- 172.21.2.135:0/1342623483 wait complete. 2021-11-15T14:41:23.642 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:23.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:20.413532+0000', 'modified': '2021-11-15T14:41:21.420118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6592': {'gid': 6592, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2353104627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2353104627}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2353104627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:23.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:23.949 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:24.014 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6592,"want_state":"up:active","state":"up:active","rank_uptime":3.5893091429999999,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":7.9041140969999999} 2021-11-15T14:41:24.015 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6592, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 3.589309143, "state": "up:active", "uptime": 7.904114097, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:24.015 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:41:24.016 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:41:24.016 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:41:24.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:24.017 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:24.028 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:24.039 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:24.039 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:24.088 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:24.089 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:24.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:24.090 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:24.095 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:41:24.096 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:24.140 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:24.151 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:24.151 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:24.156 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:24.157 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:24.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:24.158 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:24.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14756]: starting ceph client 2021-11-15T14:41:24.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:41:24.182+0000 7fdab3dbf080 -1 init, newargv = 0x55bec123b0c0 newargc=9 2021-11-15T14:41:24.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14756]: starting fuse 2021-11-15T14:41:25.263 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:25.275 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:25.276 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:25.324 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:25.325 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:25.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:25.327 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:25.331 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:41:25.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:41:25.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:25.333 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:41:25.333 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:41:25.334 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:41:25.334 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:41:25.334 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:41:25.335 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:25.335 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:41:25.336 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:41:25.336 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:41:25.336 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:25.337 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:41:25.337 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:41:25.338 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:41:25.338 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:41:25.339 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:25.339 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:41:25.339 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:41:25.340 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:41:25.340 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:41:25.341 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:41:25.341 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:25.342 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:41:25.342 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:41:25.407 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14756.asok 2021-11-15T14:41:25.410 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14756.asok 2021-11-15T14:41:25.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:25.411 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14756.asok status 2021-11-15T14:41:25.457 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:41:25.458 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:41:25.458 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:41:25.458 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:41:25.459 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:41:25.459 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:41:25.459 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:41:25.459 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14756", 2021-11-15T14:41:25.460 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:41:25.460 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:25.460 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:41:25.460 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:41:25.460 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 6760, 2021-11-15T14:41:25.461 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:41:25.461 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:41:25.461 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:41:25.461 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 6760 2021-11-15T14:41:25.462 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:25.462 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:25.462 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:25.462 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:25.462 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2147890304 2021-11-15T14:41:25.463 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:41:25.463 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:25.463 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:25.463 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:25.464 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:25.464 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2147890304 2021-11-15T14:41:25.464 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:25.464 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.6760 172.21.2.138:0/2147890304", 2021-11-15T14:41:25.464 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2147890304", 2021-11-15T14:41:25.465 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:41:25.465 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 43, 2021-11-15T14:41:25.465 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 91, 2021-11-15T14:41:25.465 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:41:25.466 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:41:25.466 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:41:25.466 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:41:25.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:25.468 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:25.468 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:25.473 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:25.474 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:25.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:25.475 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:25.526 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:25.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 Processor -- start 2021-11-15T14:41:25.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 -- start start 2021-11-15T14:41:25.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f71e40b0050 0x7f71e40ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71e4141720 0x7f71e4141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40ac860 con 0x7f71e4141720 2021-11-15T14:41:25.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e41452d0 con 0x7f71e40b0050 2021-11-15T14:41:25.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71eb57a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4145570 con 0x7f71e40b2280 2021-11-15T14:41:25.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f71e40b0050 0x7f71e40ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f71e40b0050 0x7f71e40ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60312/0 (socket says 172.21.2.135:60312) 2021-11-15T14:41:25.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 -- 172.21.2.135:0/3314155584 learned_addr learned my addr 172.21.2.135:0/3314155584 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:25.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 -- 172.21.2.135:0/3314155584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 msgr2=0x7f71e40abe80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:25.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 --2- 172.21.2.135:0/3314155584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e40abe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 -- 172.21.2.135:0/3314155584 >> v2:172.21.2.119:3300/0 conn(0x7f71e4141720 msgr2=0x7f71e4141b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:25.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 --2- 172.21.2.135:0/3314155584 >> v2:172.21.2.119:3300/0 conn(0x7f71e4141720 0x7f71e4141b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 -- 172.21.2.135:0/3314155584 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4141280 con 0x7f71e40b0050 2021-11-15T14:41:25.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71e8b15700 1 --2- 172.21.2.135:0/3314155584 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e40ac370 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f71e0002f70 tx=0x7f71e0006eb0).ready entity=mon.1 client_cookie=3b996577b9447d1f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71d3fff700 1 -- 172.21.2.135:0/3314155584 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e000d570 con 0x7f71e40b0050 2021-11-15T14:41:25.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71d3fff700 1 -- 172.21.2.135:0/3314155584 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0000e90 con 0x7f71e40b0050 2021-11-15T14:41:25.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.576+0000 7f71d3fff700 1 -- 172.21.2.135:0/3314155584 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e000d900 con 0x7f71e40b0050 2021-11-15T14:41:25.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/3314155584 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 msgr2=0x7f71e40ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- 172.21.2.135:0/3314155584 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e40ac370 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f71e0002f70 tx=0x7f71e0006eb0).stop 2021-11-15T14:41:25.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/3314155584 shutdown_connections 2021-11-15T14:41:25.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- 172.21.2.135:0/3314155584 >> v2:172.21.2.119:3300/0 conn(0x7f71e4141720 0x7f71e4141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- 172.21.2.135:0/3314155584 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e40ac370 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- 172.21.2.135:0/3314155584 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e40abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/3314155584 >> 172.21.2.135:0/3314155584 conn(0x7f71e405f730 msgr2=0x7f71e405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/3314155584 shutdown_connections 2021-11-15T14:41:25.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/3314155584 wait complete. 2021-11-15T14:41:25.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 Processor -- start 2021-11-15T14:41:25.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- start start 2021-11-15T14:41:25.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71e4141720 0x7f71e40b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40ade90 con 0x7f71e4141720 2021-11-15T14:41:25.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40ae460 con 0x7f71e40b0050 2021-11-15T14:41:25.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41449b0 con 0x7f71e40b2280 2021-11-15T14:41:25.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60320/0 (socket says 172.21.2.135:60320) 2021-11-15T14:41:25.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 -- 172.21.2.135:0/1258366458 learned_addr learned my addr 172.21.2.135:0/1258366458 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:25.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 -- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 msgr2=0x7f71e413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e413fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 -- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71e4141720 msgr2=0x7f71e40b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71e4141720 0x7f71e40b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 -- 172.21.2.135:0/1258366458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e000b1e0 con 0x7f71e40b0050 2021-11-15T14:41:25.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71e9316700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f71d4002fb0 tx=0x7f71d4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d4013460 con 0x7f71e40b0050 2021-11-15T14:41:25.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40135c0 con 0x7f71e40b0050 2021-11-15T14:41:25.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e41405a0 con 0x7f71e40b0050 2021-11-15T14:41:25.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d4013920 con 0x7f71e40b0050 2021-11-15T14:41:25.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41439d0 con 0x7f71e40b0050 2021-11-15T14:41:25.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4144b70 con 0x7f71e40b0050 2021-11-15T14:41:25.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71d400f070 con 0x7f71e40b0050 2021-11-15T14:41:25.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 0x7f71c4055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.580+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f71d406b4d0 con 0x7f71e40b0050 2021-11-15T14:41:25.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.584+0000 7f71e8b15700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 0x7f71c4055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.584+0000 7f71e8b15700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 0x7f71c4055ac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f71e0002f70 tx=0x7f71e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.584+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71d40424e0 con 0x7f71e40b0050 2021-11-15T14:41:25.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.664+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71e40573d0 con 0x7f71e40b0050 2021-11-15T14:41:25.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71d27fc700 1 -- 172.21.2.135:0/1258366458 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f71d4045b00 con 0x7f71e40b0050 2021-11-15T14:41:25.670 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:25.671 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":91,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:22.433725+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:18.216736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:19.436050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:25.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 msgr2=0x7f71c4055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 0x7f71c4055ac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f71e0002f70 tx=0x7f71e0015000).stop 2021-11-15T14:41:25.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 msgr2=0x7f71e413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f71d4002fb0 tx=0x7f71d4006df0).stop 2021-11-15T14:41:25.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 shutdown_connections 2021-11-15T14:41:25.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71c4053600 0x7f71c4055ac0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71e4141720 0x7f71e40b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71e40b2280 0x7f71e413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 --2- 172.21.2.135:0/1258366458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71e40b0050 0x7f71e413f890 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 >> 172.21.2.135:0/1258366458 conn(0x7f71e405f730 msgr2=0x7f71e41396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 shutdown_connections 2021-11-15T14:41:25.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.668+0000 7f71eb57a700 1 -- 172.21.2.135:0/1258366458 wait complete. 2021-11-15T14:41:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:18.216736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:19.436050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:41:25.679 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:25.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 Processor -- start 2021-11-15T14:41:25.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 -- start start 2021-11-15T14:41:25.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 0x7f2db00b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2db00afb70 0x7f2db013c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00b5fc0 con 0x7f2db013c820 2021-11-15T14:41:25.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db00ad4a0 con 0x7f2db00afb70 2021-11-15T14:41:25.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2db5d69700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db013cc50 con 0x7f2db00ad0c0 2021-11-15T14:41:25.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2db013c820 0x7f2db013f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47916/0 (socket says 172.21.2.135:47916) 2021-11-15T14:41:25.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daffff700 1 -- 172.21.2.135:0/201870795 learned_addr learned my addr 172.21.2.135:0/201870795 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:25.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454225353 0 0) 0x7f2db00b5fc0 con 0x7f2db013c820 2021-11-15T14:41:25.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d90003260 con 0x7f2db013c820 2021-11-15T14:41:25.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daf7fe700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 0x7f2db00b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 --2- 172.21.2.135:0/201870795 >> v2:172.21.2.119:3300/0 conn(0x7f2db00afb70 0x7f2db013c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 833062396 0 0) 0x7f2d90003260 con 0x7f2db013c820 2021-11-15T14:41:25.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 msgr2=0x7f2db00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 0x7f2db00b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 >> v2:172.21.2.119:3300/0 conn(0x7f2db00afb70 msgr2=0x7f2db013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 --2- 172.21.2.135:0/201870795 >> v2:172.21.2.119:3300/0 conn(0x7f2db00afb70 0x7f2db013c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00aebe0 con 0x7f2db013c820 2021-11-15T14:41:25.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2da8004d60 con 0x7f2db013c820 2021-11-15T14:41:25.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 >> v1:172.21.2.135:6789/0 conn(0x7f2db013c820 legacy=0x7f2db013f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 0x7f2d90003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d90003c40 0x7f2d90004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d900049f0 0x7f2d90004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00ad4a0 con 0x7f2d900049f0 2021-11-15T14:41:25.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db013cc50 con 0x7f2d90003c40 2021-11-15T14:41:25.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9000fd60 con 0x7f2db00ad0c0 2021-11-15T14:41:25.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d90003c40 0x7f2d90004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 -- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 msgr2=0x7f2d90003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db00ad0c0 0x7f2d90003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 -- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d900049f0 msgr2=0x7f2d90004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2d900049f0 0x7f2d90004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 -- 172.21.2.135:0/201870795 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90003260 con 0x7f2d90003c40 2021-11-15T14:41:25.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.728+0000 7f2daeffd700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d90003c40 0x7f2d90004500 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f2d90004470 tx=0x7f2d98008040).ready entity=mon.1 client_cookie=28eae9fe09a54ab1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9800d7e0 con 0x7f2d90003c40 2021-11-15T14:41:25.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9800d940 con 0x7f2d90003c40 2021-11-15T14:41:25.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dae7fc700 1 -- 172.21.2.135:0/201870795 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9800dca0 con 0x7f2d90003c40 2021-11-15T14:41:25.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/201870795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d90003c40 msgr2=0x7f2d90004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 --2- 172.21.2.135:0/201870795 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2d90003c40 0x7f2d90004500 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f2d90004470 tx=0x7f2d98008040).stop 2021-11-15T14:41:25.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daffff700 1 -- 172.21.2.135:0/201870795 reap_dead start 2021-11-15T14:41:25.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/201870795 shutdown_connections 2021-11-15T14:41:25.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/201870795 >> 172.21.2.135:0/201870795 conn(0x7f2db005c510 msgr2=0x7f2db005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/201870795 shutdown_connections 2021-11-15T14:41:25.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/201870795 wait complete. 2021-11-15T14:41:25.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 Processor -- start 2021-11-15T14:41:25.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- start start 2021-11-15T14:41:25.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2db01410d0 0x7f2db0135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db0135f90 0x7f2db014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db013dc40 con 0x7f2db01410d0 2021-11-15T14:41:25.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db013de70 con 0x7f2db0140cf0 2021-11-15T14:41:25.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db013e110 con 0x7f2db0135f90 2021-11-15T14:41:25.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60338/0 (socket says 172.21.2.135:60338) 2021-11-15T14:41:25.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 -- 172.21.2.135:0/590285956 learned_addr learned my addr 172.21.2.135:0/590285956 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:25.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 -- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db0135f90 msgr2=0x7f2db014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db0135f90 0x7f2db014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 -- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2db01410d0 msgr2=0x7f2db0135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2db01410d0 0x7f2db0135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 -- 172.21.2.135:0/590285956 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db013e3b0 con 0x7f2db0140cf0 2021-11-15T14:41:25.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2daf7fe700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f2da000a000 tx=0x7f2da0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da0016070 con 0x7f2db0140cf0 2021-11-15T14:41:25.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0000e90 con 0x7f2db0140cf0 2021-11-15T14:41:25.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da0011970 con 0x7f2db0140cf0 2021-11-15T14:41:25.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db0136440 con 0x7f2db0140cf0 2021-11-15T14:41:25.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db0143c10 con 0x7f2db0140cf0 2021-11-15T14:41:25.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db013e540 con 0x7f2db0140cf0 2021-11-15T14:41:25.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2da0011ad0 con 0x7f2db0140cf0 2021-11-15T14:41:25.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 0x7f2d940559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.732+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2da006b840 con 0x7f2db0140cf0 2021-11-15T14:41:25.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.736+0000 7f2daeffd700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 0x7f2d940559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.736+0000 7f2daeffd700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 0x7f2d940559b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f2d9800bfc0 tx=0x7f2d98008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.736+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2da0042850 con 0x7f2db0140cf0 2021-11-15T14:41:25.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2db00aee80 con 0x7f2db0140cf0 2021-11-15T14:41:25.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2dacff9700 1 -- 172.21.2.135:0/590285956 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2da0045e70 con 0x7f2db0140cf0 2021-11-15T14:41:25.826 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:25.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 msgr2=0x7f2d940559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 0x7f2d940559b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f2d9800bfc0 tx=0x7f2d98008040).stop 2021-11-15T14:41:25.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 msgr2=0x7f2db0152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.820+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f2da000a000 tx=0x7f2da0008040).stop 2021-11-15T14:41:25.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 shutdown_connections 2021-11-15T14:41:25.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2d940534f0 0x7f2d940559b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2db0135f90 0x7f2db014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2db01410d0 0x7f2db0135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 --2- 172.21.2.135:0/590285956 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2db0140cf0 0x7f2db0152320 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 >> 172.21.2.135:0/590285956 conn(0x7f2db005c510 msgr2=0x7f2db0137430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 shutdown_connections 2021-11-15T14:41:25.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.824+0000 7f2db5d69700 1 -- 172.21.2.135:0/590285956 wait complete. 2021-11-15T14:41:25.832 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:25.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 Processor -- start 2021-11-15T14:41:25.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 -- start start 2021-11-15T14:41:25.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2ed81419e0 0x7f2ed80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80a7850 con 0x7f2ed80b1f40 2021-11-15T14:41:25.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80b06d0 con 0x7f2ed80b1350 2021-11-15T14:41:25.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2edf091700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80b17c0 con 0x7f2ed81419e0 2021-11-15T14:41:25.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed7fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2ed80b1350 0x7f2ed81412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47936/0 (socket says 172.21.2.135:47936) 2021-11-15T14:41:25.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed7fff700 1 -- 172.21.2.135:0/3439298771 learned_addr learned my addr 172.21.2.135:0/3439298771 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:25.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998305513 0 0) 0x7f2ed80b06d0 con 0x7f2ed80b1350 2021-11-15T14:41:25.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb8003260 con 0x7f2ed80b1350 2021-11-15T14:41:25.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1352178213 0 0) 0x7f2eb8003260 con 0x7f2ed80b1350 2021-11-15T14:41:25.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 >> v2:172.21.2.119:3300/0 conn(0x7f2ed81419e0 msgr2=0x7f2ed80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 --2- 172.21.2.135:0/3439298771 >> v2:172.21.2.119:3300/0 conn(0x7f2ed81419e0 0x7f2ed80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 >> v1:172.21.2.119:6789/0 conn(0x7f2ed80b1f40 legacy=0x7f2ed80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80b0970 con 0x7f2ed80b1350 2021-11-15T14:41:25.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2ec8001660 con 0x7f2ed80b1350 2021-11-15T14:41:25.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 >> v1:172.21.2.135:6789/0 conn(0x7f2ed80b1350 legacy=0x7f2ed81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8003820 0x7f2eb8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 0x7f2eb8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2eb8005050 0x7f2eb800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b17c0 con 0x7f2eb8005050 2021-11-15T14:41:25.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800bf40 con 0x7f2eb8004500 2021-11-15T14:41:25.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c100 con 0x7f2eb8003820 2021-11-15T14:41:25.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.880+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 0x7f2eb8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8003820 msgr2=0x7f2eb8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8003820 0x7f2eb8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2eb8005050 msgr2=0x7f2eb800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:25.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2eb8005050 0x7f2eb800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/3439298771 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8003260 con 0x7f2eb8004500 2021-11-15T14:41:25.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edd62e700 1 -- 172.21.2.135:0/3439298771 reap_dead start 2021-11-15T14:41:25.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 0x7f2eb8004980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2ed80ad350 tx=0x7f2ed80b0b00).ready entity=mon.1 client_cookie=1f7590d2c11837ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec80070d0 con 0x7f2eb8004500 2021-11-15T14:41:25.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8007230 con 0x7f2eb8004500 2021-11-15T14:41:25.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed77fe700 1 -- 172.21.2.135:0/3439298771 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec800c8f0 con 0x7f2eb8004500 2021-11-15T14:41:25.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 msgr2=0x7f2eb8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 0x7f2eb8004980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2ed80ad350 tx=0x7f2ed80b0b00).stop 2021-11-15T14:41:25.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/3439298771 shutdown_connections 2021-11-15T14:41:25.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 --2- 172.21.2.135:0/3439298771 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8004500 0x7f2eb8004980 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/3439298771 >> 172.21.2.135:0/3439298771 conn(0x7f2ed805f730 msgr2=0x7f2ed805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/3439298771 shutdown_connections 2021-11-15T14:41:25.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/3439298771 wait complete. 2021-11-15T14:41:25.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 Processor -- start 2021-11-15T14:41:25.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- start start 2021-11-15T14:41:25.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8004500 0x7f2ed814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ed813bfd0 0x7f2ed815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8140cc0 con 0x7f2ed813bfd0 2021-11-15T14:41:25.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81434e0 con 0x7f2ed8140860 2021-11-15T14:41:25.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed814a040 con 0x7f2eb8004500 2021-11-15T14:41:25.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60358/0 (socket says 172.21.2.135:60358) 2021-11-15T14:41:25.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/1925759500 learned_addr learned my addr 172.21.2.135:0/1925759500 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:25.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8004500 msgr2=0x7f2ed814b150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:25.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8004500 0x7f2ed814b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ed813bfd0 msgr2=0x7f2ed815a610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:25.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ed813bfd0 0x7f2ed815a610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 -- 172.21.2.135:0/1925759500 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed814ac40 con 0x7f2ed8140860 2021-11-15T14:41:25.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed7fff700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f2ed80ad350 tx=0x7f2ec8013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec801b070 con 0x7f2ed8140860 2021-11-15T14:41:25.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8004920 con 0x7f2ed8140860 2021-11-15T14:41:25.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed814a2a0 con 0x7f2ed8140860 2021-11-15T14:41:25.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed814a900 con 0x7f2ed8140860 2021-11-15T14:41:25.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec80070d0 con 0x7f2ed8140860 2021-11-15T14:41:25.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed813c5f0 con 0x7f2ed8140860 2021-11-15T14:41:25.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ec8010070 con 0x7f2ed8140860 2021-11-15T14:41:25.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 0x7f2ebc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:25.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.884+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2ec806bf50 con 0x7f2ed8140860 2021-11-15T14:41:25.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.888+0000 7f2edce2d700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 0x7f2ebc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:25.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.888+0000 7f2edce2d700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 0x7f2ebc055be0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f2ec0000f70 tx=0x7f2ec0006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:25.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.888+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ec8042e50 con 0x7f2ed8140860 2021-11-15T14:41:25.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2ed80b0c10 con 0x7f2ed8140860 2021-11-15T14:41:25.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2ed5ffb700 1 -- 172.21.2.135:0/1925759500 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ec8046470 con 0x7f2ed8140860 2021-11-15T14:41:25.975 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:25.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 msgr2=0x7f2ebc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 0x7f2ebc055be0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f2ec0000f70 tx=0x7f2ec0006930).stop 2021-11-15T14:41:25.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 msgr2=0x7f2ed813bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:25.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f2ed80ad350 tx=0x7f2ec8013000).stop 2021-11-15T14:41:25.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 shutdown_connections 2021-11-15T14:41:25.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2ebc053720 0x7f2ebc055be0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2ed813bfd0 0x7f2ed815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2ed8140860 0x7f2ed813bae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:25.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 --2- 172.21.2.135:0/1925759500 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8004500 0x7f2ed814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:25.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 >> 172.21.2.135:0/1925759500 conn(0x7f2ed805f730 msgr2=0x7f2ed813e080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:25.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 shutdown_connections 2021-11-15T14:41:25.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:25.972+0000 7f2edf091700 1 -- 172.21.2.135:0/1925759500 wait complete. 2021-11-15T14:41:25.983 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:41:26.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 Processor -- start 2021-11-15T14:41:26.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- start start 2021-11-15T14:41:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f11000b1f40 0x7f11000b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11000b0030 0x7f11000b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000b04a0 con 0x7f11000a7140 2021-11-15T14:41:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000b2810 con 0x7f11000b1f40 2021-11-15T14:41:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000b06d0 con 0x7f11000b0030 2021-11-15T14:41:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11000b0030 0x7f11000b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11000b0030 0x7f11000b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60370/0 (socket says 172.21.2.135:60370) 2021-11-15T14:41:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 -- 172.21.2.135:0/1418544744 learned_addr learned my addr 172.21.2.135:0/1418544744 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 -- 172.21.2.135:0/1418544744 >> v2:172.21.2.119:3300/0 conn(0x7f11000b1f40 msgr2=0x7f11000b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 --2- 172.21.2.135:0/1418544744 >> v2:172.21.2.119:3300/0 conn(0x7f11000b1f40 0x7f11000b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 -- 172.21.2.135:0/1418544744 >> v1:172.21.2.119:6789/0 conn(0x7f11000a7140 legacy=0x7f11001412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 -- 172.21.2.135:0/1418544744 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000b0970 con 0x7f11000b0030 2021-11-15T14:41:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10feffd700 1 --2- 172.21.2.135:0/1418544744 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b0030 0x7f11000b2320 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f11000ad350 tx=0x7f10e8006eb0).ready entity=mon.1 client_cookie=b45605b525cc0b7d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10fe7fc700 1 -- 172.21.2.135:0/1418544744 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e800d5c0 con 0x7f11000b0030 2021-11-15T14:41:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10fe7fc700 1 -- 172.21.2.135:0/1418544744 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8000e90 con 0x7f11000b0030 2021-11-15T14:41:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f10fe7fc700 1 -- 172.21.2.135:0/1418544744 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e800d910 con 0x7f11000b0030 2021-11-15T14:41:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- 172.21.2.135:0/1418544744 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b0030 msgr2=0x7f11000b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 --2- 172.21.2.135:0/1418544744 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b0030 0x7f11000b2320 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f11000ad350 tx=0x7f10e8006eb0).stop 2021-11-15T14:41:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- 172.21.2.135:0/1418544744 shutdown_connections 2021-11-15T14:41:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 --2- 172.21.2.135:0/1418544744 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b0030 0x7f11000b2320 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 --2- 172.21.2.135:0/1418544744 >> v2:172.21.2.119:3300/0 conn(0x7f11000b1f40 0x7f11000b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- 172.21.2.135:0/1418544744 >> 172.21.2.135:0/1418544744 conn(0x7f110005f730 msgr2=0x7f110005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- 172.21.2.135:0/1418544744 shutdown_connections 2021-11-15T14:41:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.032+0000 7f1106246700 1 -- 172.21.2.135:0/1418544744 wait complete. 2021-11-15T14:41:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 Processor -- start 2021-11-15T14:41:26.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- start start 2021-11-15T14:41:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11000a7140 0x7f11000ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11000b0030 0x7f110013c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110014a950 con 0x7f11000a7140 2021-11-15T14:41:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110014ab80 con 0x7f11000b1f40 2021-11-15T14:41:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110014ae20 con 0x7f11000b0030 2021-11-15T14:41:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60376/0 (socket says 172.21.2.135:60376) 2021-11-15T14:41:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 -- 172.21.2.135:0/2204461509 learned_addr learned my addr 172.21.2.135:0/2204461509 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 -- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11000b0030 msgr2=0x7f110013c830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11000b0030 0x7f110013c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 -- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11000a7140 msgr2=0x7f11000ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11000a7140 0x7f11000ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 -- 172.21.2.135:0/2204461509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e800b1e0 con 0x7f11000b1f40 2021-11-15T14:41:26.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fffff700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f11000af7e0 tx=0x7f10f80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f8001520 con 0x7f11000b1f40 2021-11-15T14:41:26.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8001680 con 0x7f11000b1f40 2021-11-15T14:41:26.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110014b0c0 con 0x7f11000b1f40 2021-11-15T14:41:26.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f80019e0 con 0x7f11000b1f40 2021-11-15T14:41:26.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000af380 con 0x7f11000b1f40 2021-11-15T14:41:26.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10f8018030 con 0x7f11000b1f40 2021-11-15T14:41:26.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110013d3b0 con 0x7f11000b1f40 2021-11-15T14:41:26.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 0x7f10e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f10f806b450 con 0x7f11000b1f40 2021-11-15T14:41:26.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.036+0000 7f10ff7fe700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 0x7f10e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.040+0000 7f10ff7fe700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 0x7f10e4055ad0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f10f0000ed0 tx=0x7f10f0006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.040+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10f8068e90 con 0x7f11000b1f40 2021-11-15T14:41:26.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11000b0c10 con 0x7f11000b1f40 2021-11-15T14:41:26.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f10fcff9700 1 -- 172.21.2.135:0/2204461509 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+10 (secure 0 0 0) 0x7f110013d3b0 con 0x7f11000b1f40 2021-11-15T14:41:26.127 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:26.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 msgr2=0x7f10e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 0x7f10e4055ad0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f10f0000ed0 tx=0x7f10f0006930).stop 2021-11-15T14:41:26.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 msgr2=0x7f110013cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f11000af7e0 tx=0x7f10f80091a0).stop 2021-11-15T14:41:26.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 shutdown_connections 2021-11-15T14:41:26.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f10e4053610 0x7f10e4055ad0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11000b1f40 0x7f110013cd20 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11000b0030 0x7f110013c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 --2- 172.21.2.135:0/2204461509 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11000a7140 0x7f11000ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 >> 172.21.2.135:0/2204461509 conn(0x7f110005f730 msgr2=0x7f11000a7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 shutdown_connections 2021-11-15T14:41:26.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.124+0000 7f1106246700 1 -- 172.21.2.135:0/2204461509 wait complete. 2021-11-15T14:41:26.134 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:41:26.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 Processor -- start 2021-11-15T14:41:26.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- start start 2021-11-15T14:41:26.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c0a9f40 0x7f569c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f569c060450 0x7f569c13cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c061a10 con 0x7f569c13d240 2021-11-15T14:41:26.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c061cb0 con 0x7f569c060450 2021-11-15T14:41:26.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c060c10 con 0x7f569c0a9f40 2021-11-15T14:41:26.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f569c060450 0x7f569c13cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f569c060450 0x7f569c13cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60384/0 (socket says 172.21.2.135:60384) 2021-11-15T14:41:26.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 -- 172.21.2.135:0/1056780882 learned_addr learned my addr 172.21.2.135:0/1056780882 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 -- 172.21.2.135:0/1056780882 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c0a9f40 msgr2=0x7f569c0aa320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:26.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 --2- 172.21.2.135:0/1056780882 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c0a9f40 0x7f569c0aa320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 -- 172.21.2.135:0/1056780882 >> v1:172.21.2.119:6789/0 conn(0x7f569c13d240 legacy=0x7f569c13f810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:26.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 -- 172.21.2.135:0/1056780882 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c060eb0 con 0x7f569c060450 2021-11-15T14:41:26.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569a7fc700 1 --2- 172.21.2.135:0/1056780882 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c060450 0x7f569c13cd50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f569c05f8f0 tx=0x7f5684006eb0).ready entity=mon.1 client_cookie=af0472285db679ec server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5699ffb700 1 -- 172.21.2.135:0/1056780882 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568400d570 con 0x7f569c060450 2021-11-15T14:41:26.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5699ffb700 1 -- 172.21.2.135:0/1056780882 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684000e90 con 0x7f569c060450 2021-11-15T14:41:26.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5699ffb700 1 -- 172.21.2.135:0/1056780882 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f568400d900 con 0x7f569c060450 2021-11-15T14:41:26.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/1056780882 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c060450 msgr2=0x7f569c13cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- 172.21.2.135:0/1056780882 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c060450 0x7f569c13cd50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f569c05f8f0 tx=0x7f5684006eb0).stop 2021-11-15T14:41:26.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/1056780882 shutdown_connections 2021-11-15T14:41:26.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- 172.21.2.135:0/1056780882 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c060450 0x7f569c13cd50 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- 172.21.2.135:0/1056780882 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c0a9f40 0x7f569c0aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/1056780882 >> 172.21.2.135:0/1056780882 conn(0x7f569c0b29f0 msgr2=0x7f569c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/1056780882 shutdown_connections 2021-11-15T14:41:26.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/1056780882 wait complete. 2021-11-15T14:41:26.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 Processor -- start 2021-11-15T14:41:26.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- start start 2021-11-15T14:41:26.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c060450 0x7f569c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f569c0a9f40 0x7f569c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c14f480 con 0x7f569c0a9f40 2021-11-15T14:41:26.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0aeac0 con 0x7f569c13d240 2021-11-15T14:41:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0aed60 con 0x7f569c060450 2021-11-15T14:41:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60390/0 (socket says 172.21.2.135:60390) 2021-11-15T14:41:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 -- 172.21.2.135:0/4268340892 learned_addr learned my addr 172.21.2.135:0/4268340892 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 -- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c060450 msgr2=0x7f569c0adf80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c060450 0x7f569c0adf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 -- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f569c0a9f40 msgr2=0x7f569c0ae470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f569c0a9f40 0x7f569c0ae470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 -- 172.21.2.135:0/4268340892 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568400b1e0 con 0x7f569c13d240 2021-11-15T14:41:26.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f569b7fe700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f5694001250 tx=0x7f56940090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56940014e0 con 0x7f569c13d240 2021-11-15T14:41:26.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694001640 con 0x7f569c13d240 2021-11-15T14:41:26.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c14f0f0 con 0x7f569c13d240 2021-11-15T14:41:26.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56940019a0 con 0x7f569c13d240 2021-11-15T14:41:26.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.184+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c144290 con 0x7f569c13d240 2021-11-15T14:41:26.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c0aef20 con 0x7f569c13d240 2021-11-15T14:41:26.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5694018030 con 0x7f569c13d240 2021-11-15T14:41:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f5693fff700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 0x7f5680055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f569406b3b0 con 0x7f569c13d240 2021-11-15T14:41:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f569affd700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 0x7f5680055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f569affd700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 0x7f5680055a40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f568c002fb0 tx=0x7f568c006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.188+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5694042470 con 0x7f569c13d240 2021-11-15T14:41:26.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.272+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f569c14f650 con 0x7f569c13d240 2021-11-15T14:41:26.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.272+0000 7f5693fff700 1 -- 172.21.2.135:0/4268340892 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5694045a90 con 0x7f569c13d240 2021-11-15T14:41:26.278 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:26.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 msgr2=0x7f5680055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 0x7f5680055a40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f568c002fb0 tx=0x7f568c006930).stop 2021-11-15T14:41:26.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 msgr2=0x7f569c1426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f5694001250 tx=0x7f56940090f0).stop 2021-11-15T14:41:26.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 shutdown_connections 2021-11-15T14:41:26.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5680053580 0x7f5680055a40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f569c13d240 0x7f569c1426f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f569c0a9f40 0x7f569c0ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 --2- 172.21.2.135:0/4268340892 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f569c060450 0x7f569c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 >> 172.21.2.135:0/4268340892 conn(0x7f569c0b29f0 msgr2=0x7f569c0b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 shutdown_connections 2021-11-15T14:41:26.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.276+0000 7f56a1a24700 1 -- 172.21.2.135:0/4268340892 wait complete. 2021-11-15T14:41:26.284 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:41:26.285 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:26.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 Processor -- start 2021-11-15T14:41:26.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- start start 2021-11-15T14:41:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4acc0b0520 0x7f4acc0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4acc0b0900 0x7f4acc140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc0b2b70 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc0b27f0 con 0x7f4acc0b0900 2021-11-15T14:41:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc0b2da0 con 0x7f4acc0b0520 2021-11-15T14:41:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4acc0b0520 0x7f4acc0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4acc0b0520 0x7f4acc0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60394/0 (socket says 172.21.2.135:60394) 2021-11-15T14:41:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 -- 172.21.2.135:0/2554429436 learned_addr learned my addr 172.21.2.135:0/2554429436 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 -- 172.21.2.135:0/2554429436 >> v2:172.21.2.119:3300/0 conn(0x7f4acc0b0900 msgr2=0x7f4acc140620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 --2- 172.21.2.135:0/2554429436 >> v2:172.21.2.119:3300/0 conn(0x7f4acc0b0900 0x7f4acc140620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 -- 172.21.2.135:0/2554429436 >> v1:172.21.2.135:6789/0 conn(0x7f4acc0aa1a0 legacy=0x7f4acc0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 -- 172.21.2.135:0/2554429436 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0a9bf0 con 0x7f4acc0b0520 2021-11-15T14:41:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4acad9d700 1 --2- 172.21.2.135:0/2554429436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0b0520 0x7f4acc0addb0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f4abc002f70 tx=0x7f4abc006eb0).ready entity=mon.1 client_cookie=bc0189d121fad919 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ac9d9b700 1 -- 172.21.2.135:0/2554429436 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc00d610 con 0x7f4acc0b0520 2021-11-15T14:41:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ac9d9b700 1 -- 172.21.2.135:0/2554429436 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc000e90 con 0x7f4acc0b0520 2021-11-15T14:41:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ac9d9b700 1 -- 172.21.2.135:0/2554429436 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc00d9a0 con 0x7f4acc0b0520 2021-11-15T14:41:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- 172.21.2.135:0/2554429436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0b0520 msgr2=0x7f4acc0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2554429436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0b0520 0x7f4acc0addb0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f4abc002f70 tx=0x7f4abc006eb0).stop 2021-11-15T14:41:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- 172.21.2.135:0/2554429436 shutdown_connections 2021-11-15T14:41:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2554429436 >> v2:172.21.2.119:3300/0 conn(0x7f4acc0b0900 0x7f4acc140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2554429436 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0b0520 0x7f4acc0addb0 secure :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0x7f4abc002f70 tx=0x7f4abc006eb0).stop 2021-11-15T14:41:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- 172.21.2.135:0/2554429436 >> 172.21.2.135:0/2554429436 conn(0x7f4acc060840 msgr2=0x7f4acc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- 172.21.2.135:0/2554429436 shutdown_connections 2021-11-15T14:41:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.336+0000 7f4ad1095700 1 -- 172.21.2.135:0/2554429436 wait complete. 2021-11-15T14:41:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 Processor -- start 2021-11-15T14:41:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- start start 2021-11-15T14:41:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4acc0b0900 0x7f4acc13a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4acc13a750 0x7f4acc153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0b2390 con 0x7f4acc13a750 2021-11-15T14:41:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0b15d0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0b1080 con 0x7f4acc0b0900 2021-11-15T14:41:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60400/0 (socket says 172.21.2.135:60400) 2021-11-15T14:41:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 -- 172.21.2.135:0/2542070488 learned_addr learned my addr 172.21.2.135:0/2542070488 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 -- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4acc0b0900 msgr2=0x7f4acc13a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4acc0b0900 0x7f4acc13a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 -- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4acc13a750 msgr2=0x7f4acc153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4acc13a750 0x7f4acc153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 -- 172.21.2.135:0/2542070488 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc00b1e0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4acad9d700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f4abc002f70 tx=0x7f4abc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc011ce0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc011e40 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc146760 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc13abd0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc01e650 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc0ae8d0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4abc025030 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 0x7f4ab0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4abc06cf40 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.340+0000 7f4aca59c700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 0x7f4ab0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.344+0000 7f4aca59c700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 0x7f4ab0055bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f4acc0b0130 tx=0x7f4ab4007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.344+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4abc043e40 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.452+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4acc13efc0 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ac3fff700 1 -- 172.21.2.135:0/2542070488 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f4abc023020 con 0x7f4acc0aa1a0 2021-11-15T14:41:26.459 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:26.460 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:26.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 msgr2=0x7f4ab0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 0x7f4ab0055bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f4acc0b0130 tx=0x7f4ab4007810).stop 2021-11-15T14:41:26.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 msgr2=0x7f4acc146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:26.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f4abc002f70 tx=0x7f4abc015000).stop 2021-11-15T14:41:26.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 shutdown_connections 2021-11-15T14:41:26.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4ab00536f0 0x7f4ab0055bb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4acc13a750 0x7f4acc153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4acc0b0900 0x7f4acc13a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:26.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 --2- 172.21.2.135:0/2542070488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4acc0aa1a0 0x7f4acc146130 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:26.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 >> 172.21.2.135:0/2542070488 conn(0x7f4acc060840 msgr2=0x7f4acc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:26.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 shutdown_connections 2021-11-15T14:41:26.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:26.456+0000 7f4ad1095700 1 -- 172.21.2.135:0/2542070488 wait complete. 2021-11-15T14:41:26.464 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:26.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:20.413532+0000', 'modified': '2021-11-15T14:41:21.420118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6592': {'gid': 6592, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2353104627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2353104627}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2353104627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:26.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:26.771 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:26.851 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6592,"want_state":"up:active","state":"up:active","rank_uptime":6.4268530520000002,"mdsmap_epoch":43,"osdmap_epoch":91,"osdmap_epoch_barrier":90,"uptime":10.74165893} 2021-11-15T14:41:26.852 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6592, "mdsmap_epoch": 43, "osdmap_epoch": 91, "osdmap_epoch_barrier": 90, "rank_uptime": 6.426853052, "state": "up:active", "uptime": 10.74165893, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:26.852 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:41:26.853 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:41:26.853 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:41:26.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:26.854 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:26.864 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:41:26.918 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:26.918 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:26.924 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:26.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:26.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:26.926 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:41:26.930 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:41:26.931 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:26.973 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:41:26.983 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:26.983 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:26.988 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:26.989 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:26.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:26.990 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:41:27.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:41:27.009+0000 7fa96d2fc080 -1 init, newargv = 0x55fc32a21110 newargc=9 2021-11-15T14:41:27.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14282]: starting ceph client 2021-11-15T14:41:27.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14282]: starting fuse 2021-11-15T14:41:28.119 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:41:28.132 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:28.133 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:28.182 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:28.182 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:28.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.184 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:41:28.189 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:41:28.189 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:41:28.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.190 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:41:28.191 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:41:28.191 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:41:28.191 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:41:28.192 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:41:28.192 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:28.193 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:41:28.193 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:41:28.194 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:41:28.194 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:28.195 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:41:28.195 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:41:28.195 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:41:28.196 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:41:28.196 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:28.197 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:41:28.197 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:41:28.198 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:41:28.198 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:41:28.198 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:41:28.199 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:28.199 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:41:28.200 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:41:28.227 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14282.asok 2021-11-15T14:41:28.230 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14282.asok 2021-11-15T14:41:28.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.231 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14282.asok status 2021-11-15T14:41:28.335 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:41:28.336 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:41:28.336 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:41:28.336 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:41:28.336 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:41:28.337 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:41:28.337 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:41:28.337 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14282", 2021-11-15T14:41:28.337 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:41:28.337 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:28.338 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:41:28.338 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:41:28.338 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 4763, 2021-11-15T14:41:28.338 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:41:28.339 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:41:28.339 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:41:28.339 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 4763 2021-11-15T14:41:28.339 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:28.340 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:41:28.340 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:41:28.340 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:41:28.340 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3803232709 2021-11-15T14:41:28.340 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:41:28.341 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:28.341 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:41:28.341 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:41:28.341 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:41:28.342 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3803232709 2021-11-15T14:41:28.342 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:28.342 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.4763 172.21.2.132:0/3803232709", 2021-11-15T14:41:28.342 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3803232709", 2021-11-15T14:41:28.343 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:41:28.343 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 43, 2021-11-15T14:41:28.343 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 91, 2021-11-15T14:41:28.343 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:41:28.343 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:41:28.344 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:41:28.344 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:41:28.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.346 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:28.346 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.354 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:41:28.355 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:28.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.356 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.372 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:28.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 Processor -- start 2021-11-15T14:41:28.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- start start 2021-11-15T14:41:28.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe65c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b03d0 con 0x7fe65c0b1e30 2021-11-15T14:41:28.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b0670 con 0x7fe65c148420 2021-11-15T14:41:28.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0a9140 con 0x7fe65c0b1050 2021-11-15T14:41:28.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe65c148420 0x7fe65c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:47998/0 (socket says 172.21.2.135:47998) 2021-11-15T14:41:28.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65b7fe700 1 -- 172.21.2.135:0/3925829494 learned_addr learned my addr 172.21.2.135:0/3925829494 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:28.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe65c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145352697 0 0) 0x7fe65c0b0670 con 0x7fe65c148420 2021-11-15T14:41:28.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe648003260 con 0x7fe65c148420 2021-11-15T14:41:28.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672904221 0 0) 0x7fe648003260 con 0x7fe65c148420 2021-11-15T14:41:28.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 msgr2=0x7fe65c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:28.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe65c1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 >> v1:172.21.2.119:6789/0 conn(0x7fe65c0b1e30 legacy=0x7fe65c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0b0910 con 0x7fe65c148420 2021-11-15T14:41:28.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fe650001660 con 0x7fe65c148420 2021-11-15T14:41:28.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 >> v1:172.21.2.135:6789/0 conn(0x7fe65c148420 legacy=0x7fe65c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe648003780 0x7fe648003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe648004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6480049f0 0x7fe648004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64800b750 con 0x7fe648003780 2021-11-15T14:41:28.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64800b8c0 con 0x7fe6480049f0 2021-11-15T14:41:28.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64800ba80 con 0x7fe65c0b1050 2021-11-15T14:41:28.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6480049f0 0x7fe648004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65b7fe700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe648004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65bfff700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe648003780 0x7fe648003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 -- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 msgr2=0x7fe648004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:28.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c0b1050 0x7fe648004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 -- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe648003780 msgr2=0x7fe648003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:28.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe648003780 0x7fe648003ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 -- 172.21.2.135:0/3925829494 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe648003260 con 0x7fe6480049f0 2021-11-15T14:41:28.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6480049f0 0x7fe648004e70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fe65400c000 tx=0x7fe6540091d0).ready entity=mon.1 client_cookie=f87e695984771166 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:28.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65400e7e0 con 0x7fe6480049f0 2021-11-15T14:41:28.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400e940 con 0x7fe6480049f0 2021-11-15T14:41:28.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe65affd700 1 -- 172.21.2.135:0/3925829494 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65400eca0 con 0x7fe6480049f0 2021-11-15T14:41:28.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- 172.21.2.135:0/3925829494 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6480049f0 msgr2=0x7fe648004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 --2- 172.21.2.135:0/3925829494 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6480049f0 0x7fe648004e70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fe65400c000 tx=0x7fe6540091d0).stop 2021-11-15T14:41:28.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe660cb9700 1 -- 172.21.2.135:0/3925829494 reap_dead start 2021-11-15T14:41:28.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- 172.21.2.135:0/3925829494 shutdown_connections 2021-11-15T14:41:28.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- 172.21.2.135:0/3925829494 >> 172.21.2.135:0/3925829494 conn(0x7fe65c05f730 msgr2=0x7fe65c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:28.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- 172.21.2.135:0/3925829494 shutdown_connections 2021-11-15T14:41:28.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.424+0000 7fe66271c700 1 -- 172.21.2.135:0/3925829494 wait complete. 2021-11-15T14:41:28.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 Processor -- start 2021-11-15T14:41:28.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- start start 2021-11-15T14:41:28.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 0x7fe65c13d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c13d9f0 0x7fe65c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c142330 con 0x7fe6480049f0 2021-11-15T14:41:28.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c15ae10 con 0x7fe65c140370 2021-11-15T14:41:28.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c142b00 con 0x7fe65c13d9f0 2021-11-15T14:41:28.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60424/0 (socket says 172.21.2.135:60424) 2021-11-15T14:41:28.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 -- 172.21.2.135:0/1303413287 learned_addr learned my addr 172.21.2.135:0/1303413287 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:28.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe65b7fe700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c13d9f0 0x7fe65c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe65bfff700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 0x7fe65c13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 -- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c13d9f0 msgr2=0x7fe65c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c13d9f0 0x7fe65c156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 -- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 msgr2=0x7fe65c13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 0x7fe65c13d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 -- 172.21.2.135:0/1303413287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c142560 con 0x7fe65c140370 2021-11-15T14:41:28.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe65bfff700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 0x7fe65c13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:28.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe660cb9700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fe65c13de10 tx=0x7fe65401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:28.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe654009600 con 0x7fe65c140370 2021-11-15T14:41:28.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65401de50 con 0x7fe65c140370 2021-11-15T14:41:28.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe65401b640 con 0x7fe65c140370 2021-11-15T14:41:28.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c15ab70 con 0x7fe65c140370 2021-11-15T14:41:28.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c157690 con 0x7fe65c140370 2021-11-15T14:41:28.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c0573d0 con 0x7fe65c140370 2021-11-15T14:41:28.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe65401b7a0 con 0x7fe65c140370 2021-11-15T14:41:28.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 0x7fe63c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:28.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe65406cf60 con 0x7fe65c140370 2021-11-15T14:41:28.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.428+0000 7fe65bfff700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 0x7fe63c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:28.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.432+0000 7fe65bfff700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 0x7fe63c055a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fe64c009000 tx=0x7fe64c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:28.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.432+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe654043f50 con 0x7fe65c140370 2021-11-15T14:41:28.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.540+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe65c0446d0 con 0x7fe65c140370 2021-11-15T14:41:28.545 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.540+0000 7fe6597fa700 1 -- 172.21.2.135:0/1303413287 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fe654016030 con 0x7fe65c140370 2021-11-15T14:41:28.546 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:28.546 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:28.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 msgr2=0x7fe63c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.547 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 0x7fe63c055a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fe64c009000 tx=0x7fe64c009040).stop 2021-11-15T14:41:28.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 msgr2=0x7fe65c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:28.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fe65c13de10 tx=0x7fe65401a000).stop 2021-11-15T14:41:28.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 shutdown_connections 2021-11-15T14:41:28.548 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe63c0535b0 0x7fe63c055a70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe65c140370 0x7fe65c1571a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe65c13d9f0 0x7fe65c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 --2- 172.21.2.135:0/1303413287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6480049f0 0x7fe65c13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:28.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 >> 172.21.2.135:0/1303413287 conn(0x7fe65c05f730 msgr2=0x7fe65c144190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:28.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 shutdown_connections 2021-11-15T14:41:28.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:28.544+0000 7fe66271c700 1 -- 172.21.2.135:0/1303413287 wait complete. 2021-11-15T14:41:28.550 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:28.553 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1 2021-11-15T14:41:28.612 INFO:teuthology.orchestra.run.gibba035.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-11-15T14:41:25.529582+0000","btime":"2021-11-15T14:41:20.422596+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-15T14:41:20.422596+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-15T14:41:25.529582+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-15T14:41:20.422596+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":4763,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6760,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-11-15T14:41:28.613 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-11-15T14:41:20.422596+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-11-15T14:41:20.422596+0000", "change_attr": 1, "client_caps": [ { "client_id": 4763, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6760, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-15T14:41:25.529582+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-11-15T14:41:20.422596+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-11-15T14:41:25.529582+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-11-15T14:41:28.613 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:28.614 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:28.627 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:28.640 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:28.652 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:28.666 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:28.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.667 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:28.667 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:28.671 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:28.672 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:28.672 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:41:28.672 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:28.673 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:28.721 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14756]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:28.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.723 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:28.723 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:28.728 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:41:28.729 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:28.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:28.789 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:28.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.794 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:28.794 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.805 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:41:28.806 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:28.807 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:41:28.807 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:28.808 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14282]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:28.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:28.825 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:28.825 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.876 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:41:28.877 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:28.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:28.989 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:28.993 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:29.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.060+0000 7fc8edb27700 1 Processor -- start 2021-11-15T14:41:29.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.060+0000 7fc8edb27700 1 -- start start 2021-11-15T14:41:29.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc8e80b1e30 0x7fc8e80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc8e8148420 0x7fc8e80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80b03d0 con 0x7fc8e80a7140 2021-11-15T14:41:29.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80a9140 con 0x7fc8e80b1e30 2021-11-15T14:41:29.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80b0670 con 0x7fc8e8148420 2021-11-15T14:41:29.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc8e80a7140 0x7fc8e81447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48020/0 (socket says 172.21.2.135:48020) 2021-11-15T14:41:29.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 -- 172.21.2.135:0/3918200668 learned_addr learned my addr 172.21.2.135:0/3918200668 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:29.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 --2- 172.21.2.135:0/3918200668 >> v2:172.21.2.135:3300/0 conn(0x7fc8e8148420 0x7fc8e80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 -- 172.21.2.135:0/3918200668 >> v2:172.21.2.119:3300/0 conn(0x7fc8e80b1e30 msgr2=0x7fc8e80b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:29.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 --2- 172.21.2.135:0/3918200668 >> v2:172.21.2.119:3300/0 conn(0x7fc8e80b1e30 0x7fc8e80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 -- 172.21.2.135:0/3918200668 >> v1:172.21.2.135:6789/0 conn(0x7fc8e80a7140 legacy=0x7fc8e81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 -- 172.21.2.135:0/3918200668 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80b0910 con 0x7fc8e8148420 2021-11-15T14:41:29.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e6ffd700 1 --2- 172.21.2.135:0/3918200668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80b2210 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fc8e81477b0 tx=0x7fc8d0006df0).ready entity=mon.1 client_cookie=fdb2ff3f6e5f1d39 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e67fc700 1 -- 172.21.2.135:0/3918200668 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d000d5c0 con 0x7fc8e8148420 2021-11-15T14:41:29.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e67fc700 1 -- 172.21.2.135:0/3918200668 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0000e90 con 0x7fc8e8148420 2021-11-15T14:41:29.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e67fc700 1 -- 172.21.2.135:0/3918200668 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d000d910 con 0x7fc8e8148420 2021-11-15T14:41:29.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/3918200668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 msgr2=0x7fc8e80b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- 172.21.2.135:0/3918200668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80b2210 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fc8e81477b0 tx=0x7fc8d0006df0).stop 2021-11-15T14:41:29.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/3918200668 shutdown_connections 2021-11-15T14:41:29.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- 172.21.2.135:0/3918200668 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80b2210 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- 172.21.2.135:0/3918200668 >> v2:172.21.2.119:3300/0 conn(0x7fc8e80b1e30 0x7fc8e80b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/3918200668 >> 172.21.2.135:0/3918200668 conn(0x7fc8e805f730 msgr2=0x7fc8e805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:29.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/3918200668 shutdown_connections 2021-11-15T14:41:29.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/3918200668 wait complete. 2021-11-15T14:41:29.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 Processor -- start 2021-11-15T14:41:29.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- start start 2021-11-15T14:41:29.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8e80a7140 0x7fc8e8149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc8e80b1e30 0x7fc8e80ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80acb50 con 0x7fc8e80a7140 2021-11-15T14:41:29.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a94c0 con 0x7fc8e8148420 2021-11-15T14:41:29.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a96f0 con 0x7fc8e80b1e30 2021-11-15T14:41:29.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60438/0 (socket says 172.21.2.135:60438) 2021-11-15T14:41:29.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 -- 172.21.2.135:0/4084768282 learned_addr learned my addr 172.21.2.135:0/4084768282 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:29.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 -- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc8e80b1e30 msgr2=0x7fc8e80ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc8e80b1e30 0x7fc8e80ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 -- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8e80a7140 msgr2=0x7fc8e8149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8e80a7140 0x7fc8e8149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 -- 172.21.2.135:0/4084768282 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d000b180 con 0x7fc8e8148420 2021-11-15T14:41:29.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e7fff700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fc8e80ab200 tx=0x7fc8e0007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e0005ba0 con 0x7fc8e8148420 2021-11-15T14:41:29.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0005d00 con 0x7fc8e8148420 2021-11-15T14:41:29.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80a9990 con 0x7fc8e8148420 2021-11-15T14:41:29.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.064+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e00072c0 con 0x7fc8e8148420 2021-11-15T14:41:29.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e80a9ed0 con 0x7fc8e8148420 2021-11-15T14:41:29.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e80ab340 con 0x7fc8e8148420 2021-11-15T14:41:29.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8e0010070 con 0x7fc8e8148420 2021-11-15T14:41:29.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e4ff9700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 0x7fc8cc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc8e006b340 con 0x7fc8e8148420 2021-11-15T14:41:29.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e77fe700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 0x7fc8cc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e77fe700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 0x7fc8cc055ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc8d8002f70 tx=0x7fc8d8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.068+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8e80ab340 con 0x7fc8e8148420 2021-11-15T14:41:29.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc8e80ab340 con 0x7fc8e8148420 2021-11-15T14:41:29.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8e4ff9700 1 -- 172.21.2.135:0/4084768282 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v91) v1 ==== 81+0+34040 (secure 0 0 0) 0x7fc8e80ab340 con 0x7fc8e8148420 2021-11-15T14:41:29.157 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:29.157 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:29.158 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 91, 2021-11-15T14:41:29.158 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:29.158 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:29.158 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:41:22.433725+0000", 2021-11-15T14:41:29.159 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:29.159 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:29.159 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:29.159 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:29.160 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:29.160 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:29.160 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:29.160 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:29.160 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:29.161 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:29.161 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:29.161 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:29.161 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:29.162 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:29.162 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:29.162 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 16, 2021-11-15T14:41:29.162 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:29.162 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:29.163 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:29.163 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:29.163 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:29.163 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.163 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:29.164 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:29.164 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:29.164 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:29.164 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:29.165 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:29.165 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:29.165 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:29.165 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:29.165 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:29.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:29.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:29.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:29.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:29.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:29.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:29.167 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:29.167 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:29.167 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:29.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:29.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:29.168 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:29.168 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:29.169 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:29.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:29.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:29.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:29.170 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:29.170 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:29.170 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:29.170 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:29.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:29.171 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:29.171 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:29.171 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:29.171 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:29.172 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:29.172 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:29.172 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:29.172 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:29.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:29.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:29.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:29.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:29.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:29.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:29.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:29.174 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:29.174 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:29.174 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:29.175 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.175 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:29.175 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:29.175 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:29.176 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:29.176 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:29.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:29.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:29.176 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:29.177 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:29.177 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:29.177 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:29.177 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:29.177 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:29.178 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.178 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:29.178 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:29.178 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.179 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.179 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.179 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:29.179 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:29.179 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:29.180 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:29.180 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:29.180 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:29.181 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:29.181 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:29.181 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:29.181 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:29.181 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:29.182 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:29.182 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:29.182 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:29.182 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:29.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:29.183 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:29.183 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:29.183 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:29.183 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:29.184 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:29.184 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:29.184 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:29.185 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:29.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:29.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:29.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:29.186 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:29.186 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:29.186 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:29.186 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:29.187 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:29.187 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:29.187 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:29.187 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:29.187 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:29.188 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:29.188 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:29.188 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:29.188 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:29.188 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:29.189 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:29.189 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:29.189 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:29.189 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:29.190 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:29.190 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:29.190 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:29.190 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:29.190 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:29.191 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.191 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:29.191 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:29.191 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:29.192 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:29.192 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:29.192 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:29.192 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:29.193 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:29.193 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:29.193 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:29.193 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:29.193 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:29.194 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:29.194 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:29.194 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.194 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.194 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.195 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 15, 2021-11-15T14:41:29.195 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:41:29.195 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:18.216736+0000", 2021-11-15T14:41:29.195 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:29.196 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:29.196 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:29.196 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:29.196 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:29.196 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:29.197 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:29.197 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:29.197 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:29.197 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:29.198 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:29.198 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:29.198 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:29.198 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:29.198 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:29.199 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:29.199 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:29.199 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:29.199 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:29.200 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:29.200 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "90", 2021-11-15T14:41:29.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:29.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:29.201 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:29.201 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:29.201 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:29.201 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:29.202 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:29.202 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:29.202 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:29.202 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:29.202 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:29.203 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:29.203 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:29.203 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:29.203 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:29.204 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:29.204 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:29.204 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:29.204 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:29.204 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:29.205 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:29.205 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:29.205 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:29.205 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:29.205 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:29.206 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:29.206 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.206 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:29.206 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:29.207 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:29.207 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:29.207 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:29.207 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:29.208 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:29.208 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:29.208 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:29.208 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:29.208 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:29.209 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:29.209 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:41:29.209 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:41:29.209 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:41:29.209 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.210 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:29.210 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:29.210 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:41:29.210 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.211 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.211 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.211 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.211 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 16, 2021-11-15T14:41:29.212 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:41:29.212 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:19.436050+0000", 2021-11-15T14:41:29.212 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:29.212 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:29.212 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:29.213 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:29.213 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:29.213 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:29.213 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:29.213 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:29.214 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:29.214 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:29.214 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:29.214 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:29.215 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:29.215 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:29.215 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:29.215 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:29.215 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:29.216 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:29.216 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:29.216 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:29.216 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.217 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "91", 2021-11-15T14:41:29.217 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:29.217 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:29.217 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:29.217 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:29.218 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:29.218 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:29.218 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:29.218 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:29.219 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:29.219 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:29.219 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:29.219 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:29.219 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:29.220 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:29.220 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:29.220 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:29.220 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:29.221 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:29.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:29.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:29.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:29.221 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:29.222 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:29.222 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:29.222 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:29.222 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:29.223 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.223 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:29.223 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:29.223 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:29.223 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:29.224 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:29.224 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:29.224 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:29.224 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:29.225 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:29.225 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:29.225 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:29.225 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:29.225 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:29.226 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:29.226 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:41:29.226 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.226 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.227 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.227 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:29.227 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:29.227 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.227 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:29.228 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:29.228 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.228 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.228 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.229 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.229 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.229 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.229 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.229 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 89, 2021-11-15T14:41:29.230 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.230 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.230 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.230 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.231 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.231 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.231 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:29.231 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.231 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.232 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.232 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.232 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:29.232 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.232 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.233 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.233 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.233 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.234 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.234 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.234 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:29.234 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.234 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.235 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.235 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:29.235 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.236 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.236 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.236 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.236 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.236 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.237 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.237 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:29.237 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.237 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.238 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.238 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.238 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:29.238 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.239 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.239 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.239 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.239 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.240 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.240 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.240 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:29.240 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.241 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.241 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.241 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.241 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:29.241 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:29.242 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.242 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.242 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.242 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:29.243 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:29.243 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:29.243 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:29.243 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.243 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.244 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.244 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.244 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.245 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:29.245 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:29.245 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.245 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.245 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.246 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.246 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.246 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.246 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.247 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 87, 2021-11-15T14:41:29.247 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.247 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.247 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.247 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.248 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.248 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.248 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:29.248 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.249 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.249 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.249 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:29.249 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.250 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.250 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.250 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.250 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.251 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.251 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.251 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.251 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:29.251 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.252 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.252 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.252 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.252 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:29.253 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.253 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.253 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.253 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.253 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.254 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.254 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.254 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.254 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:29.255 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.255 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.255 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.255 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.255 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:29.256 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.256 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.256 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.256 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.257 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.257 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.257 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.257 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.257 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:29.258 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.258 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.258 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.258 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.259 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:29.259 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:29.259 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.259 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.259 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.260 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:29.260 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:29.260 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:29.260 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:29.261 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.261 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.261 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.261 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.261 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.262 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.262 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:29.262 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:29.262 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.263 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.263 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.263 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.263 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.263 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.264 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.264 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:29.264 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.264 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.264 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.265 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.265 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.265 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.265 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:29.266 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.266 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.266 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.266 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.266 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:29.267 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.267 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.267 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.267 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.267 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.268 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:29.269 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.269 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.269 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.269 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.269 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:29.270 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.270 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.270 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.270 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.270 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.271 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.271 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.271 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.271 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:29.271 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.272 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.272 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.272 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.272 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:29.273 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.273 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.273 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.273 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.273 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.274 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.274 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.274 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.274 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:29.274 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.275 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.275 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.275 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.275 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:29.276 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:29.276 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.276 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.276 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.276 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:29.277 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:29.277 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:29.277 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:29.277 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.278 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.278 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.278 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.278 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.278 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.279 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:29.279 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:29.279 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.279 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.279 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.280 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.280 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.280 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.280 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.281 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:29.281 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.281 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.281 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.281 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.282 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.282 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.282 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:29.282 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.283 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.283 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.283 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.283 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:29.283 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.284 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.284 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.284 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.284 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.285 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.285 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.285 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.285 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:29.285 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.286 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.286 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.286 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:29.286 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.287 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.287 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.287 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.287 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.288 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.288 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:29.289 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.289 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.289 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.289 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.289 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:29.290 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.290 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.290 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.290 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.291 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.291 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.291 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.291 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.292 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:29.292 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.292 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.292 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.292 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.293 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:29.293 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:29.293 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.293 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.294 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.294 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:29.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:29.294 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:29.295 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:29.295 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.295 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.295 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.295 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.296 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.296 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.296 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:29.296 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:29.296 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.297 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.297 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.297 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.297 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.298 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.298 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.298 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:29.298 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.298 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.299 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.299 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.299 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.299 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.299 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:29.300 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.300 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.300 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.301 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:29.301 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.301 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.301 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.301 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.302 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.302 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.302 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.302 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.302 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:29.303 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.303 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.303 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.303 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.303 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:29.304 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.304 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.304 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.304 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.304 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.305 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:29.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.306 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.306 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:29.307 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.307 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.308 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.308 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:29.309 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.309 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.309 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.309 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:29.310 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:29.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.310 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.310 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.310 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:29.311 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:29.311 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:29.311 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:29.311 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.312 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.312 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.312 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.312 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.313 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:29.313 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:29.313 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.313 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.313 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.314 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.314 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.314 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.314 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.315 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:29.315 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.315 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.315 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.315 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.316 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.316 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:29.316 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.317 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.317 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.317 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.317 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:29.317 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.318 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.318 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.318 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.318 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.319 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:29.320 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.320 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.320 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.320 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:29.321 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.321 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.321 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.321 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.322 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.322 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:29.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.323 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:29.324 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.324 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.324 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.325 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.325 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.325 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:29.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.326 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:29.327 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:29.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.328 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:29.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:29.328 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:29.328 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:29.329 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.329 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.329 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.329 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.330 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.330 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:29.330 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:29.330 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.331 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.331 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.331 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.331 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.332 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.332 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.332 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:29.332 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.332 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.333 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.333 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.333 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.334 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:29.334 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.334 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.335 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:29.335 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.335 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.335 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.336 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.336 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.336 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.336 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.336 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.337 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:29.337 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.337 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:29.338 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.338 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.338 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.339 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.339 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:29.340 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.340 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:29.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.341 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.341 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.342 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.342 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:29.343 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.343 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.343 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:29.344 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:29.344 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.344 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.345 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:29.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:29.345 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:29.345 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:29.346 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.346 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.346 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.347 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.347 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:29.347 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:29.347 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:29.348 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:29.348 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:29.348 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:29.348 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:29.349 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:29.349 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:29.349 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:29.349 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:29.349 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:29.350 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:29.350 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.350 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.350 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.351 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:29.351 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.351 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.351 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.351 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.352 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:29.352 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.352 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.352 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.353 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.353 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:29.353 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.353 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.353 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.354 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:29.354 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.354 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.354 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.355 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:29.355 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.355 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.355 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.356 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:29.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.357 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:29.357 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.357 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.357 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:29.358 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.358 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.358 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.359 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.359 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:29.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:29.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.360 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:29.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:29.360 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.360 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.361 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:29.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:29.361 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:29.361 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.362 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.362 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:29.362 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:29.362 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:29.363 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:29.363 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:29.363 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:29.363 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:29.363 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:29.364 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.364 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:29.364 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:29.364 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.365 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:29.365 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.365 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.365 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.365 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.366 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.366 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:29.366 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.366 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.367 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.367 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:29.367 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.367 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.367 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.368 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.368 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.368 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:29.368 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.369 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.369 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.369 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:29.369 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.369 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.370 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.370 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.370 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.370 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:29.371 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.371 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.371 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.371 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:29.371 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.372 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.372 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.372 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.372 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.372 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:29.373 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.373 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.373 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.373 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:29.374 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.374 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.374 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.374 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.374 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.375 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:29.375 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.376 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:29.376 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.376 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.376 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.376 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.377 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.377 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:29.377 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.377 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.378 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.378 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:29.378 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.378 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.379 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.379 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.379 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.379 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:29.379 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:29.380 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:29.380 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:29.381 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:29.381 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:29.381 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:29.381 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:29.381 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:29.382 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:29.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.382 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:29.382 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:29.383 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:29.383 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:29.383 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:29.383 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:41:29.383 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:29.384 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:29.384 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:29.384 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:29.384 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:29.385 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:29.385 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:29.385 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:29.385 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:29.385 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:29.386 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:29.386 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:29.386 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.386 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:29.387 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:29.387 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:29.387 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:29.387 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:29.387 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:29.388 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:29.388 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:29.388 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:29.388 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:29.388 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:29.389 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:29.389 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:29.389 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:29.389 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:29.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 msgr2=0x7fc8cc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 0x7fc8cc055ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fc8d8002f70 tx=0x7fc8d8006a80).stop 2021-11-15T14:41:29.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 msgr2=0x7fc8e80abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fc8e80ab200 tx=0x7fc8e0007f00).stop 2021-11-15T14:41:29.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 shutdown_connections 2021-11-15T14:41:29.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc8cc053610 0x7fc8cc055ad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc8e8148420 0x7fc8e80abaf0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc8e80b1e30 0x7fc8e80ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 --2- 172.21.2.135:0/4084768282 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc8e80a7140 0x7fc8e8149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.152+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 >> 172.21.2.135:0/4084768282 conn(0x7fc8e805f730 msgr2=0x7fc8e80b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:29.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.156+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 shutdown_connections 2021-11-15T14:41:29.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.156+0000 7fc8edb27700 1 -- 172.21.2.135:0/4084768282 wait complete. 2021-11-15T14:41:29.394 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:29.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.444+0000 7f0f3e6ba700 1 Processor -- start 2021-11-15T14:41:29.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.444+0000 7f0f3e6ba700 1 -- start start 2021-11-15T14:41:29.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380b1e30 0x7f0f380b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0f38148420 0x7f0f380b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0f380a7140 0x7f0f381447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380a9140 con 0x7f0f380a7140 2021-11-15T14:41:29.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380b03d0 con 0x7f0f38148420 2021-11-15T14:41:29.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b0670 con 0x7f0f380b1e30 2021-11-15T14:41:29.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0f38148420 0x7f0f380b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0f38148420 0x7f0f380b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60444/0 (socket says 172.21.2.135:60444) 2021-11-15T14:41:29.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 -- 172.21.2.135:0/2741158767 learned_addr learned my addr 172.21.2.135:0/2741158767 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:29.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 -- 172.21.2.135:0/2741158767 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380b1e30 msgr2=0x7f0f380b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:29.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- 172.21.2.135:0/2741158767 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380b1e30 0x7f0f380b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 -- 172.21.2.135:0/2741158767 >> v2:172.21.2.119:3300/0 conn(0x7f0f380a7140 msgr2=0x7f0f381447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:29.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- 172.21.2.135:0/2741158767 >> v2:172.21.2.119:3300/0 conn(0x7f0f380a7140 0x7f0f381447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 -- 172.21.2.135:0/2741158767 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380b0910 con 0x7f0f38148420 2021-11-15T14:41:29.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- 172.21.2.135:0/2741158767 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f38148420 0x7f0f380b2210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f0f28002f70 tx=0x7f0f28006eb0).ready entity=mon.1 client_cookie=fba2d15f0e37f6b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f36ffd700 1 -- 172.21.2.135:0/2741158767 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800d570 con 0x7f0f38148420 2021-11-15T14:41:29.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f36ffd700 1 -- 172.21.2.135:0/2741158767 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28000e90 con 0x7f0f38148420 2021-11-15T14:41:29.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f36ffd700 1 -- 172.21.2.135:0/2741158767 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800d900 con 0x7f0f38148420 2021-11-15T14:41:29.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/2741158767 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f38148420 msgr2=0x7f0f380b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/2741158767 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f38148420 0x7f0f380b2210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f0f28002f70 tx=0x7f0f28006eb0).stop 2021-11-15T14:41:29.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/2741158767 shutdown_connections 2021-11-15T14:41:29.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/2741158767 >> v2:172.21.2.119:3300/0 conn(0x7f0f380a7140 0x7f0f381447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/2741158767 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f38148420 0x7f0f380b2210 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/2741158767 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380b1e30 0x7f0f380b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/2741158767 >> 172.21.2.135:0/2741158767 conn(0x7f0f3805f730 msgr2=0x7f0f3805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:29.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/2741158767 shutdown_connections 2021-11-15T14:41:29.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/2741158767 wait complete. 2021-11-15T14:41:29.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 Processor -- start 2021-11-15T14:41:29.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- start start 2021-11-15T14:41:29.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380a7140 0x7f0f3814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f38148420 0x7f0f380b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3814b6c0 con 0x7f0f38148420 2021-11-15T14:41:29.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b4aa0 con 0x7f0f380b1e30 2021-11-15T14:41:29.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f3e6ba700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b4d30 con 0x7f0f380a7140 2021-11-15T14:41:29.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60448/0 (socket says 172.21.2.135:60448) 2021-11-15T14:41:29.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.448+0000 7f0f377fe700 1 -- 172.21.2.135:0/3898894810 learned_addr learned my addr 172.21.2.135:0/3898894810 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:29.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 -- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380a7140 msgr2=0x7f0f3814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380a7140 0x7f0f3814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 -- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f38148420 msgr2=0x7f0f380b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f38148420 0x7f0f380b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 -- 172.21.2.135:0/3898894810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2800b1e0 con 0x7f0f380b1e30 2021-11-15T14:41:29.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f377fe700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0f28002f70 tx=0x7f0f28015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800de40 con 0x7f0f380b1e30 2021-11-15T14:41:29.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28006780 con 0x7f0f380b1e30 2021-11-15T14:41:29.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f380b4fd0 con 0x7f0f380b1e30 2021-11-15T14:41:29.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2801e460 con 0x7f0f380b1e30 2021-11-15T14:41:29.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f38140a40 con 0x7f0f380b1e30 2021-11-15T14:41:29.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f38140bd0 con 0x7f0f380b1e30 2021-11-15T14:41:29.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f28025030 con 0x7f0f380b1e30 2021-11-15T14:41:29.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 0x7f0f1c055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0f2806cd60 con 0x7f0f380b1e30 2021-11-15T14:41:29.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f37fff700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 0x7f0f1c055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.452+0000 7f0f37fff700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 0x7f0f1c055a00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f0f20002f70 tx=0x7f0f20006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.456+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f28043c60 con 0x7f0f380b1e30 2021-11-15T14:41:29.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.560+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f380b0bb0 con 0x7f0f380b1e30 2021-11-15T14:41:29.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f357fa700 1 -- 172.21.2.135:0/3898894810 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f0f28023020 con 0x7f0f380b1e30 2021-11-15T14:41:29.567 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:29.567 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:21.420118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2353104627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2353104627},{"type":"v1","addr":"172.21.2.135:6835","nonce":2353104627}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:29.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 msgr2=0x7f0f1c055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 0x7f0f1c055a00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f0f20002f70 tx=0x7f0f20006a00).stop 2021-11-15T14:41:29.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 msgr2=0x7f0f3814e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0f28002f70 tx=0x7f0f28015000).stop 2021-11-15T14:41:29.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 shutdown_connections 2021-11-15T14:41:29.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f1c053540 0x7f0f1c055a00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f38148420 0x7f0f380b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f380b1e30 0x7f0f3814e4f0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 --2- 172.21.2.135:0/3898894810 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f380a7140 0x7f0f3814c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 >> 172.21.2.135:0/3898894810 conn(0x7f0f3805f730 msgr2=0x7f0f380ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:29.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 shutdown_connections 2021-11-15T14:41:29.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.564+0000 7f0f3e6ba700 1 -- 172.21.2.135:0/3898894810 wait complete. 2021-11-15T14:41:29.571 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 43 2021-11-15T14:41:29.574 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:41:29.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.620+0000 7f9e5d7ad700 1 Processor -- start 2021-11-15T14:41:29.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- start start 2021-11-15T14:41:29.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9e580b1e30 0x7f9e580b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9e580a7140 0x7f9e581447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e580b03d0 con 0x7f9e58148420 2021-11-15T14:41:29.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580a9140 con 0x7f9e580a7140 2021-11-15T14:41:29.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580b0670 con 0x7f9e580b1e30 2021-11-15T14:41:29.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e567fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9e58148420 0x7f9e580b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48048/0 (socket says 172.21.2.135:48048) 2021-11-15T14:41:29.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e567fc700 1 -- 172.21.2.135:0/1286978843 learned_addr learned my addr 172.21.2.135:0/1286978843 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:29.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/1286978843 >> v2:172.21.2.135:3300/0 conn(0x7f9e580b1e30 0x7f9e580b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/1286978843 >> v2:172.21.2.119:3300/0 conn(0x7f9e580a7140 msgr2=0x7f9e581447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:29.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/1286978843 >> v2:172.21.2.119:3300/0 conn(0x7f9e580a7140 0x7f9e581447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/1286978843 >> v1:172.21.2.135:6789/0 conn(0x7f9e58148420 legacy=0x7f9e580b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/1286978843 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580b0910 con 0x7f9e580b1e30 2021-11-15T14:41:29.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/1286978843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580b1e30 0x7f9e580b1050 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f9e581477b0 tx=0x7f9e40006df0).ready entity=mon.1 client_cookie=e8778f14e0cadba9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e55ffb700 1 -- 172.21.2.135:0/1286978843 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4000d4a0 con 0x7f9e580b1e30 2021-11-15T14:41:29.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e55ffb700 1 -- 172.21.2.135:0/1286978843 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40000e90 con 0x7f9e580b1e30 2021-11-15T14:41:29.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e55ffb700 1 -- 172.21.2.135:0/1286978843 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4000d7f0 con 0x7f9e580b1e30 2021-11-15T14:41:29.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/1286978843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580b1e30 msgr2=0x7f9e580b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/1286978843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580b1e30 0x7f9e580b1050 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f9e581477b0 tx=0x7f9e40006df0).stop 2021-11-15T14:41:29.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/1286978843 shutdown_connections 2021-11-15T14:41:29.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/1286978843 >> v2:172.21.2.119:3300/0 conn(0x7f9e580a7140 0x7f9e581447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/1286978843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580b1e30 0x7f9e580b1050 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:29.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/1286978843 >> 172.21.2.135:0/1286978843 conn(0x7f9e5805f730 msgr2=0x7f9e5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:29.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/1286978843 shutdown_connections 2021-11-15T14:41:29.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/1286978843 wait complete. 2021-11-15T14:41:29.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 Processor -- start 2021-11-15T14:41:29.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- start start 2021-11-15T14:41:29.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9e580b1e30 0x7f9e58157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9e58148420 0x7f9e580aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580ac410 con 0x7f9e58148420 2021-11-15T14:41:29.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580ad540 con 0x7f9e580a7140 2021-11-15T14:41:29.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580ac170 con 0x7f9e580b1e30 2021-11-15T14:41:29.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60462/0 (socket says 172.21.2.135:60462) 2021-11-15T14:41:29.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/2838322379 learned_addr learned my addr 172.21.2.135:0/2838322379 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:29.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9e580b1e30 msgr2=0x7f9e58157390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:29.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9e580b1e30 0x7f9e58157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9e58148420 msgr2=0x7f9e580aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:29.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9e58148420 0x7f9e580aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:29.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 -- 172.21.2.135:0/2838322379 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4000b180 con 0x7f9e580a7140 2021-11-15T14:41:29.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e56ffd700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f9e581477b0 tx=0x7f9e40014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e40016070 con 0x7f9e580a7140 2021-11-15T14:41:29.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40013840 con 0x7f9e580a7140 2021-11-15T14:41:29.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e40013ba0 con 0x7f9e580a7140 2021-11-15T14:41:29.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e58156c50 con 0x7f9e580a7140 2021-11-15T14:41:29.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.624+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e58157880 con 0x7f9e580a7140 2021-11-15T14:41:29.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e580ab4c0 con 0x7f9e580a7140 2021-11-15T14:41:29.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e40025030 con 0x7f9e580a7140 2021-11-15T14:41:29.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e4ffff700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 0x7f9e3c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:29.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9e4006cb30 con 0x7f9e580a7140 2021-11-15T14:41:29.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e567fc700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 0x7f9e3c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:29.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e567fc700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 0x7f9e3c055b20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f9e48001110 tx=0x7f9e480077b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:29.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.628+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e40043c00 con 0x7f9e580a7140 2021-11-15T14:41:29.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:29.740+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9e581570f0 con 0x7f9e580a7140 2021-11-15T14:41:30.741 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:41:30.735+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:41:30.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.748+0000 7f9e4ffff700 1 -- 172.21.2.135:0/2838322379 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9e581570f0 con 0x7f9e580a7140 2021-11-15T14:41:30.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 msgr2=0x7f9e3c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 0x7f9e3c055b20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f9e48001110 tx=0x7f9e480077b0).stop 2021-11-15T14:41:30.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 msgr2=0x7f9e580adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f9e581477b0 tx=0x7f9e40014000).stop 2021-11-15T14:41:30.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 shutdown_connections 2021-11-15T14:41:30.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9e3c053660 0x7f9e3c055b20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9e58148420 0x7f9e580aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:30.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9e580b1e30 0x7f9e58157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:30.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 --2- 172.21.2.135:0/2838322379 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9e580a7140 0x7f9e580adf10 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 >> 172.21.2.135:0/2838322379 conn(0x7f9e5805f730 msgr2=0x7f9e580af700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:30.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 shutdown_connections 2021-11-15T14:41:30.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.752+0000 7f9e5d7ad700 1 -- 172.21.2.135:0/2838322379 wait complete. 2021-11-15T14:41:30.758 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:41:30.762 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:30.766 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:41:30.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 Processor -- start 2021-11-15T14:41:30.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 -- start start 2021-11-15T14:41:30.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3968067070 0x7f3968143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3968067450 con 0x7f39680b0760 2021-11-15T14:41:30.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39680b0050 con 0x7f39680ad0b0 2021-11-15T14:41:30.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396d05e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680b02f0 con 0x7f3968067070 2021-11-15T14:41:30.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396659c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f39680ad0b0 0x7f3968143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48074/0 (socket says 172.21.2.135:48074) 2021-11-15T14:41:30.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f396659c700 1 -- 172.21.2.135:0/1965888874 learned_addr learned my addr 172.21.2.135:0/1965888874 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:30.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3966d9d700 1 --2- 172.21.2.135:0/1965888874 >> v2:172.21.2.119:3300/0 conn(0x7f3968067070 0x7f3968143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918677057 0 0) 0x7f39680b0050 con 0x7f39680ad0b0 2021-11-15T14:41:30.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c003260 con 0x7f39680ad0b0 2021-11-15T14:41:30.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635068184 0 0) 0x7f394c003260 con 0x7f39680ad0b0 2021-11-15T14:41:30.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 >> v2:172.21.2.119:3300/0 conn(0x7f3968067070 msgr2=0x7f3968143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:30.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 --2- 172.21.2.135:0/1965888874 >> v2:172.21.2.119:3300/0 conn(0x7f3968067070 0x7f3968143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 >> v1:172.21.2.119:6789/0 conn(0x7f39680b0760 legacy=0x7f39680b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680af420 con 0x7f39680ad0b0 2021-11-15T14:41:30.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f395c001660 con 0x7f39680ad0b0 2021-11-15T14:41:30.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.808+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 >> v1:172.21.2.135:6789/0 conn(0x7f39680ad0b0 legacy=0x7f3968143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f394c003750 0x7f394c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004500 0x7f394c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 0x7f394c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b02f0 con 0x7f394c004500 2021-11-15T14:41:30.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00bdd0 con 0x7f394c004e70 2021-11-15T14:41:30.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00bf60 con 0x7f394c003750 2021-11-15T14:41:30.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 0x7f394c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396659c700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004500 0x7f394c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f394c003750 msgr2=0x7f394c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:30.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f394c003750 0x7f394c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:30.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004500 msgr2=0x7f394c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:30.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004500 0x7f394c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1965888874 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c003260 con 0x7f394c004e70 2021-11-15T14:41:30.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1965888874 reap_dead start 2021-11-15T14:41:30.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 0x7f394c00b750 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f39680625a0 tx=0x7f3960007d60).ready entity=mon.1 client_cookie=4fef6ee0a0f446fc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:30.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3960006890 con 0x7f394c004e70 2021-11-15T14:41:30.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600069f0 con 0x7f394c004e70 2021-11-15T14:41:30.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3965d9b700 1 -- 172.21.2.135:0/1965888874 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3960006d50 con 0x7f394c004e70 2021-11-15T14:41:30.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 msgr2=0x7f394c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 0x7f394c00b750 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f39680625a0 tx=0x7f3960007d60).stop 2021-11-15T14:41:30.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1965888874 shutdown_connections 2021-11-15T14:41:30.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 --2- 172.21.2.135:0/1965888874 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f394c004e70 0x7f394c00b750 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1965888874 >> 172.21.2.135:0/1965888874 conn(0x7f396805f730 msgr2=0x7f396805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:30.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1965888874 shutdown_connections 2021-11-15T14:41:30.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1965888874 wait complete. 2021-11-15T14:41:30.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 Processor -- start 2021-11-15T14:41:30.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- start start 2021-11-15T14:41:30.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 0x7f396809fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f396809e930 0x7f396809ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680a04b0 con 0x7f394c004e70 2021-11-15T14:41:30.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396809f150 con 0x7f3968146e20 2021-11-15T14:41:30.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680a2e10 con 0x7f396809e930 2021-11-15T14:41:30.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60496/0 (socket says 172.21.2.135:60496) 2021-11-15T14:41:30.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1035834137 learned_addr learned my addr 172.21.2.135:0/1035834137 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:30.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396659c700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f396809e930 0x7f396809ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3966d9d700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 0x7f396809fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f396809e930 msgr2=0x7f396809ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f396809e930 0x7f396809ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 msgr2=0x7f396809fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 0x7f396809fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 -- 172.21.2.135:0/1035834137 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396809eeb0 con 0x7f3968146e20 2021-11-15T14:41:30.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3966d9d700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 0x7f396809fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:30.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396759e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f39680625a0 tx=0x7f3960016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:30.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3960006890 con 0x7f3968146e20 2021-11-15T14:41:30.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960001210 con 0x7f3968146e20 2021-11-15T14:41:30.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3960007b40 con 0x7f3968146e20 2021-11-15T14:41:30.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968152a50 con 0x7f3968146e20 2021-11-15T14:41:30.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.812+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39681472a0 con 0x7f3968146e20 2021-11-15T14:41:30.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39680573d0 con 0x7f3968146e20 2021-11-15T14:41:30.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3960028070 con 0x7f3968146e20 2021-11-15T14:41:30.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3957fff700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 0x7f3944055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:30.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f396006cbf0 con 0x7f3968146e20 2021-11-15T14:41:30.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3966d9d700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 0x7f3944055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:30.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3966d9d700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 0x7f3944055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f395800b000 tx=0x7f3958008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:30.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.816+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3960043a90 con 0x7f3968146e20 2021-11-15T14:41:30.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3968067890 con 0x7f3968146e20 2021-11-15T14:41:30.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f3957fff700 1 -- 172.21.2.135:0/1035834137 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2129 (secure 0 0 0) 0x7f39600470b0 con 0x7f3968146e20 2021-11-15T14:41:30.931 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:30.931 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:20.413532+0000","modified":"2021-11-15T14:41:30.740746+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-15T14:41:30.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 msgr2=0x7f3944055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 0x7f3944055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f395800b000 tx=0x7f3958008040).stop 2021-11-15T14:41:30.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 msgr2=0x7f3968153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:30.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f39680625a0 tx=0x7f3960016000).stop 2021-11-15T14:41:30.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 shutdown_connections 2021-11-15T14:41:30.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39440536a0 0x7f3944055b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3968146e20 0x7f3968153190 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f396809e930 0x7f396809ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 --2- 172.21.2.135:0/1035834137 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f394c004e70 0x7f396809fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:30.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 >> 172.21.2.135:0/1035834137 conn(0x7f396805f730 msgr2=0x7f39680b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:30.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 shutdown_connections 2021-11-15T14:41:30.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:30.928+0000 7f396d05e700 1 -- 172.21.2.135:0/1035834137 wait complete. 2021-11-15T14:41:30.935 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 44 2021-11-15T14:41:30.938 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:41:31.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 Processor -- start 2021-11-15T14:41:31.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- start start 2021-11-15T14:41:31.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f313c0b1f40 0x7f313c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c0b04a0 con 0x7f313c0a7140 2021-11-15T14:41:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313c0b2810 con 0x7f313c0b1f40 2021-11-15T14:41:31.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0b06d0 con 0x7f313c0b0030 2021-11-15T14:41:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f313c0a7140 0x7f313c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48092/0 (socket says 172.21.2.135:48092) 2021-11-15T14:41:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313bfff700 1 -- 172.21.2.135:0/852186043 learned_addr learned my addr 172.21.2.135:0/852186043 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 --2- 172.21.2.135:0/852186043 >> v2:172.21.2.135:3300/0 conn(0x7f313c0b1f40 0x7f313c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313a7fc700 1 -- 172.21.2.135:0/852186043 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851349187 0 0) 0x7f313c0b04a0 con 0x7f313c0a7140 2021-11-15T14:41:31.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313a7fc700 1 -- 172.21.2.135:0/852186043 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c003260 con 0x7f313c0a7140 2021-11-15T14:41:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313affd700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 -- 172.21.2.135:0/852186043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 msgr2=0x7f313c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 -- 172.21.2.135:0/852186043 >> v1:172.21.2.135:6789/0 conn(0x7f313c0a7140 legacy=0x7f313c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 -- 172.21.2.135:0/852186043 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0b0970 con 0x7f313c0b1f40 2021-11-15T14:41:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313affd700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313b7fe700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0b1f40 0x7f313c0b1350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f3124002f70 tx=0x7f3124006df0).ready entity=mon.1 client_cookie=55a5b7718ec779c2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313a7fc700 1 -- 172.21.2.135:0/852186043 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312400d570 con 0x7f313c0b1f40 2021-11-15T14:41:31.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313a7fc700 1 -- 172.21.2.135:0/852186043 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124000e90 con 0x7f313c0b1f40 2021-11-15T14:41:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f313a7fc700 1 -- 172.21.2.135:0/852186043 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312400d8c0 con 0x7f313c0b1f40 2021-11-15T14:41:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- 172.21.2.135:0/852186043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0b1f40 msgr2=0x7f313c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0b1f40 0x7f313c0b1350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f3124002f70 tx=0x7f3124006df0).stop 2021-11-15T14:41:31.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- 172.21.2.135:0/852186043 shutdown_connections 2021-11-15T14:41:31.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 --2- 172.21.2.135:0/852186043 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0b1f40 0x7f313c0b1350 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- 172.21.2.135:0/852186043 >> 172.21.2.135:0/852186043 conn(0x7f313c05f730 msgr2=0x7f313c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:31.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- 172.21.2.135:0/852186043 shutdown_connections 2021-11-15T14:41:31.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.036+0000 7f3141deb700 1 -- 172.21.2.135:0/852186043 wait complete. 2021-11-15T14:41:31.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 Processor -- start 2021-11-15T14:41:31.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- start start 2021-11-15T14:41:31.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f313c0b1f40 0x7f313c145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c13eec0 con 0x7f313c0b1f40 2021-11-15T14:41:31.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0aa370 con 0x7f313c0a7140 2021-11-15T14:41:31.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0aa600 con 0x7f313c0b0030 2021-11-15T14:41:31.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60508/0 (socket says 172.21.2.135:60508) 2021-11-15T14:41:31.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 -- 172.21.2.135:0/27167673 learned_addr learned my addr 172.21.2.135:0/27167673 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:31.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 -- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 msgr2=0x7f313c0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 -- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f313c0b1f40 msgr2=0x7f313c145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f313c0b1f40 0x7f313c145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 -- 172.21.2.135:0/27167673 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312400b180 con 0x7f313c0a7140 2021-11-15T14:41:31.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313b7fe700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f3124002f70 tx=0x7f3124014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312400dea0 con 0x7f313c0a7140 2021-11-15T14:41:31.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312401e400 con 0x7f313c0a7140 2021-11-15T14:41:31.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312401e760 con 0x7f313c0a7140 2021-11-15T14:41:31.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c0aa8a0 con 0x7f313c0a7140 2021-11-15T14:41:31.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c145850 con 0x7f313c0a7140 2021-11-15T14:41:31.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c145a10 con 0x7f313c0a7140 2021-11-15T14:41:31.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f312401c070 con 0x7f313c0a7140 2021-11-15T14:41:31.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 0x7f31200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f312406c640 con 0x7f313c0a7140 2021-11-15T14:41:31.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.040+0000 7f313affd700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 0x7f31200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.044+0000 7f313affd700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 0x7f31200559b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f312c007000 tx=0x7f312c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.044+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31240435f0 con 0x7f313c0a7140 2021-11-15T14:41:31.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.152+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f313c0b0c10 con 0x7f313c0a7140 2021-11-15T14:41:31.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.764+0000 7f3138ff9700 1 -- 172.21.2.135:0/27167673 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3124046c10 con 0x7f313c0a7140 2021-11-15T14:41:31.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 msgr2=0x7f31200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 0x7f31200559b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f312c007000 tx=0x7f312c008040).stop 2021-11-15T14:41:31.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 msgr2=0x7f313c0a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f3124002f70 tx=0x7f3124014000).stop 2021-11-15T14:41:31.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 shutdown_connections 2021-11-15T14:41:31.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31200534f0 0x7f31200559b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f313c0b1f40 0x7f313c145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f313c0b0030 0x7f313c0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 --2- 172.21.2.135:0/27167673 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f313c0a7140 0x7f313c0a9e80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 >> 172.21.2.135:0/27167673 conn(0x7f313c05f730 msgr2=0x7f313c13df40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:31.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 shutdown_connections 2021-11-15T14:41:31.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.768+0000 7f3141deb700 1 -- 172.21.2.135:0/27167673 wait complete. 2021-11-15T14:41:31.778 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:41:31.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.824+0000 7f6aa01ab700 1 Processor -- start 2021-11-15T14:41:31.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.824+0000 7f6aa01ab700 1 -- start start 2021-11-15T14:41:31.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980b1e30 0x7f6a980b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a980a7140 0x7f6a981447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a980b03d0 con 0x7f6a98148420 2021-11-15T14:41:31.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a980a9140 con 0x7f6a980a7140 2021-11-15T14:41:31.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980b0670 con 0x7f6a980b1e30 2021-11-15T14:41:31.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a980a7140 0x7f6a981447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6a980a7140 0x7f6a981447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60520/0 (socket says 172.21.2.135:60520) 2021-11-15T14:41:31.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 -- 172.21.2.135:0/3482292474 learned_addr learned my addr 172.21.2.135:0/3482292474 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:31.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 -- 172.21.2.135:0/3482292474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980b1e30 msgr2=0x7f6a980b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:31.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 --2- 172.21.2.135:0/3482292474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980b1e30 0x7f6a980b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 -- 172.21.2.135:0/3482292474 >> v1:172.21.2.119:6789/0 conn(0x7f6a98148420 legacy=0x7f6a980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:31.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 -- 172.21.2.135:0/3482292474 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980b0910 con 0x7f6a980a7140 2021-11-15T14:41:31.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9e748700 1 --2- 172.21.2.135:0/3482292474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980a7140 0x7f6a981447a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6a98061420 tx=0x7f6a90006eb0).ready entity=mon.1 client_cookie=99f18355960720aa server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9cf45700 1 -- 172.21.2.135:0/3482292474 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000d570 con 0x7f6a980a7140 2021-11-15T14:41:31.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9cf45700 1 -- 172.21.2.135:0/3482292474 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90000e90 con 0x7f6a980a7140 2021-11-15T14:41:31.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9cf45700 1 -- 172.21.2.135:0/3482292474 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000d8c0 con 0x7f6a980a7140 2021-11-15T14:41:31.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- 172.21.2.135:0/3482292474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980a7140 msgr2=0x7f6a981447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/3482292474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980a7140 0x7f6a981447a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6a98061420 tx=0x7f6a90006eb0).stop 2021-11-15T14:41:31.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- 172.21.2.135:0/3482292474 shutdown_connections 2021-11-15T14:41:31.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/3482292474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980a7140 0x7f6a981447a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:31.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/3482292474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980b1e30 0x7f6a980b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- 172.21.2.135:0/3482292474 >> 172.21.2.135:0/3482292474 conn(0x7f6a9805f730 msgr2=0x7f6a9805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:31.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- 172.21.2.135:0/3482292474 shutdown_connections 2021-11-15T14:41:31.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- 172.21.2.135:0/3482292474 wait complete. 2021-11-15T14:41:31.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 Processor -- start 2021-11-15T14:41:31.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- start start 2021-11-15T14:41:31.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980a7140 0x7f6a9814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98148420 0x7f6a9813df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981569e0 con 0x7f6a98148420 2021-11-15T14:41:31.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9814d930 con 0x7f6a980b1e30 2021-11-15T14:41:31.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6aa01ab700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9814a0b0 con 0x7f6a980a7140 2021-11-15T14:41:31.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60526/0 (socket says 172.21.2.135:60526) 2021-11-15T14:41:31.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 -- 172.21.2.135:0/1713144219 learned_addr learned my addr 172.21.2.135:0/1713144219 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:31.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 -- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980a7140 msgr2=0x7f6a9814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980a7140 0x7f6a9814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 -- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98148420 msgr2=0x7f6a9813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:31.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98148420 0x7f6a9813df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:31.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 -- 172.21.2.135:0/1713144219 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9000b1e0 con 0x7f6a980b1e30 2021-11-15T14:41:31.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.828+0000 7f6a9d746700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f6a88002f10 tx=0x7f6a88006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a88009e00 con 0x7f6a980b1e30 2021-11-15T14:41:31.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9814a350 con 0x7f6a980b1e30 2021-11-15T14:41:31.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800f510 con 0x7f6a980b1e30 2021-11-15T14:41:31.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a98149330 con 0x7f6a980b1e30 2021-11-15T14:41:31.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8800f680 con 0x7f6a980b1e30 2021-11-15T14:41:31.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9813e5b0 con 0x7f6a980b1e30 2021-11-15T14:41:31.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a8800f070 con 0x7f6a980b1e30 2021-11-15T14:41:31.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 0x7f6a78055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:31.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f6a8806b3c0 con 0x7f6a980b1e30 2021-11-15T14:41:31.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a9df47700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 0x7f6a78055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:31.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a9df47700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 0x7f6a78055a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f6a940032f0 tx=0x7f6a94006e00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:31.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.832+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a880422d0 con 0x7f6a980b1e30 2021-11-15T14:41:31.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:31.916+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a981490f0 con 0x7f6a980b1e30 2021-11-15T14:41:32.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.780+0000 7f6a86ffd700 1 -- 172.21.2.135:0/1713144219 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6a880458f0 con 0x7f6a980b1e30 2021-11-15T14:41:32.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 msgr2=0x7f6a78055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 0x7f6a78055a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f6a940032f0 tx=0x7f6a94006e00).stop 2021-11-15T14:41:32.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 msgr2=0x7f6a9813da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f6a88002f10 tx=0x7f6a88006d60).stop 2021-11-15T14:41:32.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 shutdown_connections 2021-11-15T14:41:32.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a78053580 0x7f6a78055a40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:32.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98148420 0x7f6a9813df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a980b1e30 0x7f6a9813da30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:32.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 --2- 172.21.2.135:0/1713144219 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a980a7140 0x7f6a9814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 >> 172.21.2.135:0/1713144219 conn(0x7f6a9805f730 msgr2=0x7f6a980ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:32.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 shutdown_connections 2021-11-15T14:41:32.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.784+0000 7f6aa01ab700 1 -- 172.21.2.135:0/1713144219 wait complete. 2021-11-15T14:41:32.789 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:41:32.793 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:41:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 Processor -- start 2021-11-15T14:41:32.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 -- start start 2021-11-15T14:41:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f69000b0520 0x7f69000addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b2b70 con 0x7f69000b0900 2021-11-15T14:41:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b27f0 con 0x7f69000aa1a0 2021-11-15T14:41:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f6907e15700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000b2da0 con 0x7f69000b0520 2021-11-15T14:41:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f69053b0700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f69000aa1a0 0x7f69000ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48120/0 (socket says 172.21.2.135:48120) 2021-11-15T14:41:32.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.844+0000 7f69053b0700 1 -- 172.21.2.135:0/4176422013 learned_addr learned my addr 172.21.2.135:0/4176422013 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322370538 0 0) 0x7f69000b27f0 con 0x7f69000aa1a0 2021-11-15T14:41:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e8003260 con 0x7f69000aa1a0 2021-11-15T14:41:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518729288 0 0) 0x7f68e8003260 con 0x7f69000aa1a0 2021-11-15T14:41:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 >> v2:172.21.2.119:3300/0 conn(0x7f69000b0520 msgr2=0x7f69000addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:32.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 --2- 172.21.2.135:0/4176422013 >> v2:172.21.2.119:3300/0 conn(0x7f69000b0520 0x7f69000addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 >> v1:172.21.2.119:6789/0 conn(0x7f69000b0900 legacy=0x7f6900140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000a9bf0 con 0x7f69000aa1a0 2021-11-15T14:41:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f68f0001660 con 0x7f69000aa1a0 2021-11-15T14:41:32.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 >> v1:172.21.2.135:6789/0 conn(0x7f69000aa1a0 legacy=0x7f69000ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 0x7f68e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8004500 0x7f68e8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68e8005050 0x7f68e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000b2da0 con 0x7f68e8004500 2021-11-15T14:41:32.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e800bf40 con 0x7f68e8003820 2021-11-15T14:41:32.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e800c100 con 0x7f68e8005050 2021-11-15T14:41:32.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 0x7f68e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:32.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 -- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68e8005050 msgr2=0x7f68e800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:32.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68e8005050 0x7f68e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 -- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8004500 msgr2=0x7f68e8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:32.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8004500 0x7f68e8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 -- 172.21.2.135:0/4176422013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8003260 con 0x7f68e8003820 2021-11-15T14:41:32.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69063b2700 1 -- 172.21.2.135:0/4176422013 reap_dead start 2021-11-15T14:41:32.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6905bb1700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 0x7f68e8003c20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f68fc002f70 tx=0x7f68fc006d30).ready entity=mon.1 client_cookie=ef25515fb9712b8b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:32.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68fc017070 con 0x7f68e8003820 2021-11-15T14:41:32.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc012a30 con 0x7f68e8003820 2021-11-15T14:41:32.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6904baf700 1 -- 172.21.2.135:0/4176422013 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68fc012d90 con 0x7f68e8003820 2021-11-15T14:41:32.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 msgr2=0x7f68e8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 0x7f68e8003c20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f68fc002f70 tx=0x7f68fc006d30).stop 2021-11-15T14:41:32.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/4176422013 shutdown_connections 2021-11-15T14:41:32.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 --2- 172.21.2.135:0/4176422013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68e8003820 0x7f68e8003c20 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:32.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/4176422013 >> 172.21.2.135:0/4176422013 conn(0x7f6900060840 msgr2=0x7f6900060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:32.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/4176422013 shutdown_connections 2021-11-15T14:41:32.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/4176422013 wait complete. 2021-11-15T14:41:32.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 Processor -- start 2021-11-15T14:41:32.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- start start 2021-11-15T14:41:32.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8003820 0x7f69000672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6900144ec0 0x7f6900156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900156800 con 0x7f68e8003820 2021-11-15T14:41:32.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000ae200 con 0x7f69000a8280 2021-11-15T14:41:32.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690013f240 con 0x7f6900144ec0 2021-11-15T14:41:32.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:32.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60548/0 (socket says 172.21.2.135:60548) 2021-11-15T14:41:32.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 -- 172.21.2.135:0/867604928 learned_addr learned my addr 172.21.2.135:0/867604928 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:32.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 -- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6900144ec0 msgr2=0x7f6900156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6900144ec0 0x7f6900156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 -- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8003820 msgr2=0x7f69000672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:32.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8003820 0x7f69000672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:32.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 -- 172.21.2.135:0/867604928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690013f4e0 con 0x7f69000a8280 2021-11-15T14:41:32.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f69053b0700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f69000b0130 tx=0x7f68f0001810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:32.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f0007170 con 0x7f69000a8280 2021-11-15T14:41:32.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f00072d0 con 0x7f69000a8280 2021-11-15T14:41:32.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690013f780 con 0x7f69000a8280 2021-11-15T14:41:32.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f0004920 con 0x7f69000a8280 2021-11-15T14:41:32.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.848+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69000ae800 con 0x7f69000a8280 2021-11-15T14:41:32.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690013f910 con 0x7f69000a8280 2021-11-15T14:41:32.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68f0004a80 con 0x7f69000a8280 2021-11-15T14:41:32.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f68eeffd700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 0x7f68e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:32.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f68f006b660 con 0x7f69000a8280 2021-11-15T14:41:32.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f6905bb1700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 0x7f68e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:32.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f6905bb1700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 0x7f68e0055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f68fc002f70 tx=0x7f68fc019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:32.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.852+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68f00426c0 con 0x7f69000a8280 2021-11-15T14:41:32.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:32.940+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6900156970 con 0x7f69000a8280 2021-11-15T14:41:33.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f68eeffd700 1 -- 172.21.2.135:0/867604928 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 173+0+0 (secure 0 0 0) 0x7f68f0045ce0 con 0x7f69000a8280 2021-11-15T14:41:33.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 msgr2=0x7f68e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 0x7f68e0055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f68fc002f70 tx=0x7f68fc019000).stop 2021-11-15T14:41:33.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 msgr2=0x7f69001449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f69000b0130 tx=0x7f68f0001810).stop 2021-11-15T14:41:33.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 shutdown_connections 2021-11-15T14:41:33.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f68e0053610 0x7f68e0055ad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:33.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6900144ec0 0x7f6900156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f69000a8280 0x7f69001449d0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:33.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 --2- 172.21.2.135:0/867604928 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68e8003820 0x7f69000672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 >> 172.21.2.135:0/867604928 conn(0x7f6900060840 msgr2=0x7f69000abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:33.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 shutdown_connections 2021-11-15T14:41:33.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.788+0000 7f6907e15700 1 -- 172.21.2.135:0/867604928 wait complete. 2021-11-15T14:41:33.796 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:41:33.800 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:41:33.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.848+0000 7fac767ed700 1 Processor -- start 2021-11-15T14:41:33.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.848+0000 7fac767ed700 1 -- start start 2021-11-15T14:41:33.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fac700afb50 0x7fac700b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700b5f10 con 0x7fac700b5b30 2021-11-15T14:41:33.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700b08b0 con 0x7fac700aef90 2021-11-15T14:41:33.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700b1ca0 con 0x7fac700afb50 2021-11-15T14:41:33.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fac700aef90 0x7fac7013dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48142/0 (socket says 172.21.2.135:48142) 2021-11-15T14:41:33.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/312362441 learned_addr learned my addr 172.21.2.135:0/312362441 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:33.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104148354 0 0) 0x7fac700b08b0 con 0x7fac700aef90 2021-11-15T14:41:33.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003260 con 0x7fac700aef90 2021-11-15T14:41:33.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213745252 0 0) 0x7fac50003260 con 0x7fac700aef90 2021-11-15T14:41:33.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 >> v2:172.21.2.119:3300/0 conn(0x7fac700afb50 msgr2=0x7fac700b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:33.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 --2- 172.21.2.135:0/312362441 >> v2:172.21.2.119:3300/0 conn(0x7fac700afb50 0x7fac700b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 >> v1:172.21.2.119:6789/0 conn(0x7fac700b5b30 legacy=0x7fac70140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:33.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700b0b50 con 0x7fac700aef90 2021-11-15T14:41:33.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fac680019e0 con 0x7fac700aef90 2021-11-15T14:41:33.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 >> v1:172.21.2.135:6789/0 conn(0x7fac700aef90 legacy=0x7fac7013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac500037d0 0x7fac50003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50004500 0x7fac50004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 0x7fac5000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700b1ca0 con 0x7fac50004500 2021-11-15T14:41:33.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000bf00 con 0x7fac50005020 2021-11-15T14:41:33.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c0c0 con 0x7fac500037d0 2021-11-15T14:41:33.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 0x7fac5000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:33.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac500037d0 msgr2=0x7fac50003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:33.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac500037d0 0x7fac50003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50004500 msgr2=0x7fac50004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:33.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50004500 0x7fac50004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/312362441 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700b0b50 con 0x7fac50005020 2021-11-15T14:41:33.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/312362441 reap_dead start 2021-11-15T14:41:33.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 0x7fac5000b750 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fac680013a0 tx=0x7fac680021a0).ready entity=mon.1 client_cookie=92afed6bed5b473a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:33.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6800cca0 con 0x7fac50005020 2021-11-15T14:41:33.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800ce00 con 0x7fac50005020 2021-11-15T14:41:33.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6effd700 1 -- 172.21.2.135:0/312362441 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac68005b80 con 0x7fac50005020 2021-11-15T14:41:33.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 msgr2=0x7fac5000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 0x7fac5000b750 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fac680013a0 tx=0x7fac680021a0).stop 2021-11-15T14:41:33.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/312362441 shutdown_connections 2021-11-15T14:41:33.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- 172.21.2.135:0/312362441 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac50005020 0x7fac5000b750 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:33.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/312362441 >> 172.21.2.135:0/312362441 conn(0x7fac7005c510 msgr2=0x7fac7005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:33.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/312362441 shutdown_connections 2021-11-15T14:41:33.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/312362441 wait complete. 2021-11-15T14:41:33.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 Processor -- start 2021-11-15T14:41:33.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- start start 2021-11-15T14:41:33.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50005020 0x7fac7013faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac70140470 0x7fac70141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac70064d60 con 0x7fac50005020 2021-11-15T14:41:33.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac70065000 con 0x7fac70067330 2021-11-15T14:41:33.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac70130700 con 0x7fac70140470 2021-11-15T14:41:33.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:33.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60566/0 (socket says 172.21.2.135:60566) 2021-11-15T14:41:33.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/2400514648 learned_addr learned my addr 172.21.2.135:0/2400514648 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:33.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac70140470 msgr2=0x7fac70141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac70140470 0x7fac70141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50005020 msgr2=0x7fac7013faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50005020 0x7fac7013faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 -- 172.21.2.135:0/2400514648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7013ffe0 con 0x7fac70067330 2021-11-15T14:41:33.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac74d8a700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fac680013a0 tx=0x7fac68015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:33.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac68017070 con 0x7fac70067330 2021-11-15T14:41:33.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680072e0 con 0x7fac70067330 2021-11-15T14:41:33.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac68007640 con 0x7fac70067330 2021-11-15T14:41:33.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.852+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7013ed90 con 0x7fac70067330 2021-11-15T14:41:33.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac70130dc0 con 0x7fac70067330 2021-11-15T14:41:33.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac70065200 con 0x7fac70067330 2021-11-15T14:41:33.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac68025030 con 0x7fac70067330 2021-11-15T14:41:33.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6d7fa700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 0x7fac54055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:33.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fac6806c660 con 0x7fac70067330 2021-11-15T14:41:33.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6ffff700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 0x7fac54055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:33.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6ffff700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 0x7fac54055b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fac60000f70 tx=0x7fac600069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:33.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.856+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac68043940 con 0x7fac70067330 2021-11-15T14:41:33.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.944+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac700b0df0 con 0x7fac70067330 2021-11-15T14:41:33.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.952+0000 7fac6d7fa700 1 -- 172.21.2.135:0/2400514648 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac68046f60 con 0x7fac70067330 2021-11-15T14:41:33.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 msgr2=0x7fac54055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 0x7fac54055b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fac60000f70 tx=0x7fac600069b0).stop 2021-11-15T14:41:33.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 msgr2=0x7fac701414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:33.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fac680013a0 tx=0x7fac68015000).stop 2021-11-15T14:41:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 shutdown_connections 2021-11-15T14:41:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac540536a0 0x7fac54055b60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac70067330 0x7fac701414f0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac70140470 0x7fac70141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 --2- 172.21.2.135:0/2400514648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac50005020 0x7fac7013faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 >> 172.21.2.135:0/2400514648 conn(0x7fac7005c510 msgr2=0x7fac700b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 shutdown_connections 2021-11-15T14:41:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:33.956+0000 7fac767ed700 1 -- 172.21.2.135:0/2400514648 wait complete. 2021-11-15T14:41:33.965 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-15T14:41:34.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 Processor -- start 2021-11-15T14:41:34.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 -- start start 2021-11-15T14:41:34.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 0x7fd6000b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000b03d0 con 0x7fd6000a7140 2021-11-15T14:41:34.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000b0670 con 0x7fd6000b1e30 2021-11-15T14:41:34.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd606282700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000a9140 con 0x7fd600148420 2021-11-15T14:41:34.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5fffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd6000b1e30 0x7fd6000b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48160/0 (socket says 172.21.2.135:48160) 2021-11-15T14:41:34.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5fffff700 1 -- 172.21.2.135:0/3610807495 learned_addr learned my addr 172.21.2.135:0/3610807495 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:34.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221680033 0 0) 0x7fd6000b0670 con 0x7fd6000b1e30 2021-11-15T14:41:34.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e0003260 con 0x7fd6000b1e30 2021-11-15T14:41:34.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059238874 0 0) 0x7fd5e0003260 con 0x7fd6000b1e30 2021-11-15T14:41:34.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 msgr2=0x7fd6000b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:34.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 0x7fd6000b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.012+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 >> v1:172.21.2.119:6789/0 conn(0x7fd6000a7140 legacy=0x7fd6001447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:34.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000b0910 con 0x7fd6000b1e30 2021-11-15T14:41:34.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd5e8001660 con 0x7fd6000b1e30 2021-11-15T14:41:34.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 >> v1:172.21.2.135:6789/0 conn(0x7fd6000b1e30 legacy=0x7fd6000b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 0x7fd5e0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5e0003df0 0x7fd5e0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0004b10 0x7fd5e0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000b910 con 0x7fd5e0004b10 2021-11-15T14:41:34.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000ba80 con 0x7fd5e0003df0 2021-11-15T14:41:34.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000bc40 con 0x7fd600148420 2021-11-15T14:41:34.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5e0003df0 0x7fd5e0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd60481f700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0004b10 0x7fd5e0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5fffff700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 0x7fd5e0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 msgr2=0x7fd5e0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:34.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600148420 0x7fd5e0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:34.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0004b10 msgr2=0x7fd5e0004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:34.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0004b10 0x7fd5e0004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:34.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/3610807495 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0003260 con 0x7fd5e0003df0 2021-11-15T14:41:34.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5e0003df0 0x7fd5e0004500 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fd5f0002f70 tx=0x7fd5f0006ca0).ready entity=mon.1 client_cookie=6a3eff3472cf57e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f0013410 con 0x7fd5e0003df0 2021-11-15T14:41:34.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0013570 con 0x7fd5e0003df0 2021-11-15T14:41:34.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5feffd700 1 -- 172.21.2.135:0/3610807495 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f00138d0 con 0x7fd5e0003df0 2021-11-15T14:41:34.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/3610807495 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5e0003df0 msgr2=0x7fd5e0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 --2- 172.21.2.135:0/3610807495 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5e0003df0 0x7fd5e0004500 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fd5f0002f70 tx=0x7fd5f0006ca0).stop 2021-11-15T14:41:34.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd60481f700 1 -- 172.21.2.135:0/3610807495 reap_dead start 2021-11-15T14:41:34.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/3610807495 shutdown_connections 2021-11-15T14:41:34.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/3610807495 >> 172.21.2.135:0/3610807495 conn(0x7fd60005f730 msgr2=0x7fd60005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:34.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/3610807495 shutdown_connections 2021-11-15T14:41:34.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/3610807495 wait complete. 2021-11-15T14:41:34.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 Processor -- start 2021-11-15T14:41:34.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- start start 2021-11-15T14:41:34.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0003df0 0x7fd6000b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600064a10 0x7fd600064e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000b4630 con 0x7fd5e0003df0 2021-11-15T14:41:34.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600067670 con 0x7fd6001439c0 2021-11-15T14:41:34.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd600065eb0 con 0x7fd600064a10 2021-11-15T14:41:34.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60586/0 (socket says 172.21.2.135:60586) 2021-11-15T14:41:34.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/1286070520 learned_addr learned my addr 172.21.2.135:0/1286070520 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:34.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600064a10 msgr2=0x7fd600064e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600064a10 0x7fd600064e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0003df0 msgr2=0x7fd6000b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0003df0 0x7fd6000b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 -- 172.21.2.135:0/1286070520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600157280 con 0x7fd6001439c0 2021-11-15T14:41:34.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5ff7fe700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fd6001575c0 tx=0x7fd5f0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f0013410 con 0x7fd6001439c0 2021-11-15T14:41:34.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0012da0 con 0x7fd6001439c0 2021-11-15T14:41:34.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f0021660 con 0x7fd6001439c0 2021-11-15T14:41:34.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6000673d0 con 0x7fd6001439c0 2021-11-15T14:41:34.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd600065ba0 con 0x7fd6001439c0 2021-11-15T14:41:34.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.016+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6001570c0 con 0x7fd6001439c0 2021-11-15T14:41:34.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5f00217c0 con 0x7fd6001439c0 2021-11-15T14:41:34.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fd7fa700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 0x7fd5e4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd5f001b040 con 0x7fd6001439c0 2021-11-15T14:41:34.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fffff700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 0x7fd5e4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fffff700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 0x7fd5e4055b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fd5e800b000 tx=0x7fd6000b0800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.020+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5f0043c50 con 0x7fd6001439c0 2021-11-15T14:41:34.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.136+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fd600157410 con 0x7fd6001439c0 2021-11-15T14:41:34.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.796+0000 7fd5fd7fa700 1 -- 172.21.2.135:0/1286070520 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v298) v1 ==== 126+0+0 (secure 0 0 0) 0x7fd5f0047270 con 0x7fd6001439c0 2021-11-15T14:41:34.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 msgr2=0x7fd5e4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 0x7fd5e4055b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fd5e800b000 tx=0x7fd6000b0800).stop 2021-11-15T14:41:34.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 msgr2=0x7fd600143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fd6001575c0 tx=0x7fd5f0014000).stop 2021-11-15T14:41:34.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 shutdown_connections 2021-11-15T14:41:34.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd5e40536d0 0x7fd5e4055b90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:34.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd600064a10 0x7fd600064e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6001439c0 0x7fd600143e40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 --2- 172.21.2.135:0/1286070520 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5e0003df0 0x7fd6000b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 >> 172.21.2.135:0/1286070520 conn(0x7fd60005f730 msgr2=0x7fd600146cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 shutdown_connections 2021-11-15T14:41:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.800+0000 7fd606282700 1 -- 172.21.2.135:0/1286070520 wait complete. 2021-11-15T14:41:34.810 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:41:34.811 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:41:34.811 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-15T14:41:34.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 Processor -- start 2021-11-15T14:41:34.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- start start 2021-11-15T14:41:34.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe24c0b1e30 0x7fe24c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c0b03d0 con 0x7fe24c0a7140 2021-11-15T14:41:34.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c0b0670 con 0x7fe24c148420 2021-11-15T14:41:34.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0a9140 con 0x7fe24c0b1e30 2021-11-15T14:41:34.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24affd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe24c148420 0x7fe24c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48182/0 (socket says 172.21.2.135:48182) 2021-11-15T14:41:34.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24affd700 1 -- 172.21.2.135:0/1456670492 learned_addr learned my addr 172.21.2.135:0/1456670492 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:34.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- 172.21.2.135:0/1456670492 >> v2:172.21.2.135:3300/0 conn(0x7fe24c0b1e30 0x7fe24c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/1456670492 >> v1:172.21.2.135:6789/0 conn(0x7fe24c148420 legacy=0x7fe24c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/1456670492 >> v1:172.21.2.119:6789/0 conn(0x7fe24c0a7140 legacy=0x7fe24c1447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:34.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/1456670492 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0b0910 con 0x7fe24c0b1e30 2021-11-15T14:41:34.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- 172.21.2.135:0/1456670492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0b1e30 0x7fe24c0b1050 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fe24c0acee0 tx=0x7fe23c006df0).ready entity=mon.1 client_cookie=95e7e59f7f8b63ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24a7fc700 1 -- 172.21.2.135:0/1456670492 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23c00d5c0 con 0x7fe24c0b1e30 2021-11-15T14:41:34.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24a7fc700 1 -- 172.21.2.135:0/1456670492 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c000e90 con 0x7fe24c0b1e30 2021-11-15T14:41:34.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24a7fc700 1 -- 172.21.2.135:0/1456670492 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23c00d910 con 0x7fe24c0b1e30 2021-11-15T14:41:34.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- 172.21.2.135:0/1456670492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0b1e30 msgr2=0x7fe24c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- 172.21.2.135:0/1456670492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0b1e30 0x7fe24c0b1050 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fe24c0acee0 tx=0x7fe23c006df0).stop 2021-11-15T14:41:34.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- 172.21.2.135:0/1456670492 shutdown_connections 2021-11-15T14:41:34.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- 172.21.2.135:0/1456670492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0b1e30 0x7fe24c0b1050 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:34.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- 172.21.2.135:0/1456670492 >> 172.21.2.135:0/1456670492 conn(0x7fe24c05f730 msgr2=0x7fe24c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:34.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- 172.21.2.135:0/1456670492 shutdown_connections 2021-11-15T14:41:34.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- 172.21.2.135:0/1456670492 wait complete. 2021-11-15T14:41:34.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 Processor -- start 2021-11-15T14:41:34.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- start start 2021-11-15T14:41:34.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe24c0b1e30 0x7fe24c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe24c148420 0x7fe24c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0aa2f0 con 0x7fe24c0b1e30 2021-11-15T14:41:34.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0ac340 con 0x7fe24c0a7140 2021-11-15T14:41:34.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe251bc2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0aa670 con 0x7fe24c148420 2021-11-15T14:41:34.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60598/0 (socket says 172.21.2.135:60598) 2021-11-15T14:41:34.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/226726479 learned_addr learned my addr 172.21.2.135:0/226726479 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:34.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe24c148420 msgr2=0x7fe24c15a650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:34.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe24c148420 0x7fe24c15a650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe24c0b1e30 msgr2=0x7fe24c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:34.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe24c0b1e30 0x7fe24c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:34.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 -- 172.21.2.135:0/226726479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c00b180 con 0x7fe24c0a7140 2021-11-15T14:41:34.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe24b7fe700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fe24c0acee0 tx=0x7fe23c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.860+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23c016070 con 0x7fe24c0a7140 2021-11-15T14:41:34.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00de70 con 0x7fe24c0a7140 2021-11-15T14:41:34.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c0aab10 con 0x7fe24c0a7140 2021-11-15T14:41:34.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c15ab40 con 0x7fe24c0a7140 2021-11-15T14:41:34.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23c01e450 con 0x7fe24c0a7140 2021-11-15T14:41:34.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c0a9d80 con 0x7fe24c0a7140 2021-11-15T14:41:34.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe23c025030 con 0x7fe24c0a7140 2021-11-15T14:41:34.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 0x7fe230055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:34.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe23c06c9a0 con 0x7fe24c0a7140 2021-11-15T14:41:34.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe24affd700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 0x7fe230055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:34.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe24affd700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 0x7fe230055ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fe24c0b31f0 tx=0x7fe234007860).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:34.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.864+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe23c043c80 con 0x7fe24c0a7140 2021-11-15T14:41:34.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:34.976+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fe24c0aa830 con 0x7fe24c0a7140 2021-11-15T14:41:35.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe248ff9700 1 -- 172.21.2.135:0/226726479 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v299) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe23c0472a0 con 0x7fe24c0a7140 2021-11-15T14:41:35.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 msgr2=0x7fe230055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 0x7fe230055ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fe24c0b31f0 tx=0x7fe234007860).stop 2021-11-15T14:41:35.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 msgr2=0x7fe24c0b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fe24c0acee0 tx=0x7fe23c014000).stop 2021-11-15T14:41:35.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 shutdown_connections 2021-11-15T14:41:35.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe230053610 0x7fe230055ad0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe24c148420 0x7fe24c15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:35.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe24c0b1e30 0x7fe24c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 --2- 172.21.2.135:0/226726479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe24c0a7140 0x7fe24c0b35f0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 >> 172.21.2.135:0/226726479 conn(0x7fe24c05f730 msgr2=0x7fe24c143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 shutdown_connections 2021-11-15T14:41:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.804+0000 7fe251bc2700 1 -- 172.21.2.135:0/226726479 wait complete. 2021-11-15T14:41:35.815 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:41:35.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 Processor -- start 2021-11-15T14:41:35.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 -- start start 2021-11-15T14:41:35.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efdb80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7efdb80b2320 0x7efdb81412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb80a7850 con 0x7efdb80b0030 2021-11-15T14:41:35.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb80b0470 con 0x7efdb80b2320 2021-11-15T14:41:35.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbe2d0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b06d0 con 0x7efdb80b1f40 2021-11-15T14:41:35.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7efdb80b0030 0x7efdb80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48198/0 (socket says 172.21.2.135:48198) 2021-11-15T14:41:35.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb77fe700 1 -- 172.21.2.135:0/2468563064 learned_addr learned my addr 172.21.2.135:0/2468563064 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260959757 0 0) 0x7efdb80a7850 con 0x7efdb80b0030 2021-11-15T14:41:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd98003260 con 0x7efdb80b0030 2021-11-15T14:41:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb7fff700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efdb80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862866798 0 0) 0x7efd98003260 con 0x7efdb80b0030 2021-11-15T14:41:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbc86d700 1 --2- 172.21.2.135:0/2468563064 >> v2:172.21.2.119:3300/0 conn(0x7efdb80b2320 0x7efdb81412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 msgr2=0x7efdb80b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efdb80b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 >> v2:172.21.2.119:3300/0 conn(0x7efdb80b2320 msgr2=0x7efdb81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 --2- 172.21.2.135:0/2468563064 >> v2:172.21.2.119:3300/0 conn(0x7efdb80b2320 0x7efdb81412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80b0970 con 0x7efdb80b0030 2021-11-15T14:41:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7efda8001660 con 0x7efdb80b0030 2021-11-15T14:41:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdbc86d700 1 --2- 172.21.2.135:0/2468563064 >> v2:172.21.2.119:3300/0 conn(0x7efdb80b2320 0x7efdb81412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb7fff700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efdb80b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 >> v1:172.21.2.135:6789/0 conn(0x7efdb80b0030 legacy=0x7efdb80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd980037d0 0x7efd98003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efd98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efd9800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b0470 con 0x7efd980037d0 2021-11-15T14:41:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b06d0 con 0x7efd98004500 2021-11-15T14:41:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980052e0 con 0x7efdb80b1f40 2021-11-15T14:41:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.864+0000 7efdb77fe700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efd98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 -- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 msgr2=0x7efd9800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb80b1f40 0x7efd9800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 -- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd980037d0 msgr2=0x7efd98003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd980037d0 0x7efd98003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 -- 172.21.2.135:0/2468563064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98003260 con 0x7efd98004500 2021-11-15T14:41:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efd98004980 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7efda8001370 tx=0x7efdb80b2a80).ready entity=mon.1 client_cookie=6495e8eac98702b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda80070d0 con 0x7efd98004500 2021-11-15T14:41:35.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8007230 con 0x7efd98004500 2021-11-15T14:41:35.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb6ffd700 1 -- 172.21.2.135:0/2468563064 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda800c8f0 con 0x7efd98004500 2021-11-15T14:41:35.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/2468563064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 msgr2=0x7efd98004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/2468563064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efd98004980 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7efda8001370 tx=0x7efdb80b2a80).stop 2021-11-15T14:41:35.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbc86d700 1 -- 172.21.2.135:0/2468563064 reap_dead start 2021-11-15T14:41:35.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/2468563064 shutdown_connections 2021-11-15T14:41:35.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/2468563064 >> 172.21.2.135:0/2468563064 conn(0x7efdb805f730 msgr2=0x7efdb805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:35.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/2468563064 shutdown_connections 2021-11-15T14:41:35.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/2468563064 wait complete. 2021-11-15T14:41:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 Processor -- start 2021-11-15T14:41:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- start start 2021-11-15T14:41:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 0x7efdb814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb814ab30 0x7efdb815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b6430 con 0x7efdb80b4940 2021-11-15T14:41:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb814b6f0 con 0x7efd98004500 2021-11-15T14:41:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81454a0 con 0x7efdb814ab30 2021-11-15T14:41:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60618/0 (socket says 172.21.2.135:60618) 2021-11-15T14:41:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 -- 172.21.2.135:0/3862993444 learned_addr learned my addr 172.21.2.135:0/3862993444 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 0x7efdb814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbc86d700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb814ab30 0x7efdb815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 -- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb814ab30 msgr2=0x7efdb815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb814ab30 0x7efdb815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 -- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 msgr2=0x7efdb814a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 0x7efdb814a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 -- 172.21.2.135:0/3862993444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80ab680 con 0x7efd98004500 2021-11-15T14:41:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb77fe700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 0x7efdb814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb7fff700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7efdb814ba20 tx=0x7efda0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda0015070 con 0x7efd98004500 2021-11-15T14:41:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0000e90 con 0x7efd98004500 2021-11-15T14:41:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb80ac320 con 0x7efd98004500 2021-11-15T14:41:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda0010770 con 0x7efd98004500 2021-11-15T14:41:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb814b450 con 0x7efd98004500 2021-11-15T14:41:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.868+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb814a330 con 0x7efd98004500 2021-11-15T14:41:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efda00108d0 con 0x7efd98004500 2021-11-15T14:41:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb57fa700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 0x7efd9c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efda006b5e0 con 0x7efd98004500 2021-11-15T14:41:35.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb77fe700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 0x7efd9c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb77fe700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 0x7efd9c055ad0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efda8017000 tx=0x7efda8013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:35.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.872+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efda00427b0 con 0x7efd98004500 2021-11-15T14:41:35.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.956+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efdb80b0c10 con 0x7efd98004500 2021-11-15T14:41:35.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.968+0000 7efdb57fa700 1 -- 172.21.2.135:0/3862993444 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7efda0045dd0 con 0x7efd98004500 2021-11-15T14:41:35.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 msgr2=0x7efd9c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 0x7efd9c055ad0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efda8017000 tx=0x7efda8013000).stop 2021-11-15T14:41:35.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 msgr2=0x7efdb80aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:35.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7efdb814ba20 tx=0x7efda0008040).stop 2021-11-15T14:41:35.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 shutdown_connections 2021-11-15T14:41:35.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd9c053610 0x7efd9c055ad0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efdb814ab30 0x7efdb815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efdb80b4940 0x7efdb814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 --2- 172.21.2.135:0/3862993444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd98004500 0x7efdb80aa9f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:35.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 >> 172.21.2.135:0/3862993444 conn(0x7efdb805f730 msgr2=0x7efdb8147080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:35.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 shutdown_connections 2021-11-15T14:41:35.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:35.972+0000 7efdbe2d0700 1 -- 172.21.2.135:0/3862993444 wait complete. 2021-11-15T14:41:35.981 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:35.982 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:35.990 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:36.002 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:36.010 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:36.023 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:36.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:36.024 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:36.024 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:36.069 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:41:36.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:36.071 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:36.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:36.072 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:36.072 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:36.078 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:41:36.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:36.079 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:36.080 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:36.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 Processor -- start 2021-11-15T14:41:36.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 -- start start 2021-11-15T14:41:36.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f78f4148420 0x7f78f40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f40b03d0 con 0x7f78f40b1e30 2021-11-15T14:41:36.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f40b0670 con 0x7f78f40a7140 2021-11-15T14:41:36.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f99ed700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f40a9140 con 0x7f78f4148420 2021-11-15T14:41:36.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f27fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f78f4148420 0x7f78f40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f78f40a7140 0x7f78f41447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48218/0 (socket says 172.21.2.135:48218) 2021-11-15T14:41:36.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f37fe700 1 -- 172.21.2.135:0/3881958061 learned_addr learned my addr 172.21.2.135:0/3881958061 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:36.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f27fc700 1 -- 172.21.2.135:0/3881958061 >> v1:172.21.2.135:6789/0 conn(0x7f78f40a7140 legacy=0x7f78f41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f27fc700 1 -- 172.21.2.135:0/3881958061 >> v1:172.21.2.119:6789/0 conn(0x7f78f40b1e30 legacy=0x7f78f40b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:36.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.136+0000 7f78f27fc700 1 -- 172.21.2.135:0/3881958061 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40b0910 con 0x7f78f4148420 2021-11-15T14:41:36.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f27fc700 1 --2- 172.21.2.135:0/3881958061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f40b1050 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f78f40acee0 tx=0x7f78e4006df0).ready entity=mon.1 client_cookie=4092f25e5c817201 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f1ffb700 1 -- 172.21.2.135:0/3881958061 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e400d5c0 con 0x7f78f4148420 2021-11-15T14:41:36.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f1ffb700 1 -- 172.21.2.135:0/3881958061 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4000e90 con 0x7f78f4148420 2021-11-15T14:41:36.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f1ffb700 1 -- 172.21.2.135:0/3881958061 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e400d910 con 0x7f78f4148420 2021-11-15T14:41:36.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/3881958061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 msgr2=0x7f78f40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 --2- 172.21.2.135:0/3881958061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f40b1050 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f78f40acee0 tx=0x7f78e4006df0).stop 2021-11-15T14:41:36.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/3881958061 shutdown_connections 2021-11-15T14:41:36.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 --2- 172.21.2.135:0/3881958061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f40b1050 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/3881958061 >> 172.21.2.135:0/3881958061 conn(0x7f78f405f730 msgr2=0x7f78f405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/3881958061 shutdown_connections 2021-11-15T14:41:36.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/3881958061 wait complete. 2021-11-15T14:41:36.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 Processor -- start 2021-11-15T14:41:36.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- start start 2021-11-15T14:41:36.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78f40a7140 0x7f78f4063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78f40b1e30 0x7f78f4063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40640e0 con 0x7f78f40a7140 2021-11-15T14:41:36.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40a9c50 con 0x7f78f4148420 2021-11-15T14:41:36.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40aa320 con 0x7f78f40b1e30 2021-11-15T14:41:36.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60636/0 (socket says 172.21.2.135:60636) 2021-11-15T14:41:36.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 -- 172.21.2.135:0/826070128 learned_addr learned my addr 172.21.2.135:0/826070128 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:36.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 -- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78f40b1e30 msgr2=0x7f78f4063bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:36.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78f40b1e30 0x7f78f4063bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 -- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78f40a7140 msgr2=0x7f78f4063700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:36.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78f40a7140 0x7f78f4063700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 -- 172.21.2.135:0/826070128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e400b180 con 0x7f78f4148420 2021-11-15T14:41:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f37fe700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f78f40b31f0 tx=0x7f78ec007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec005ba0 con 0x7f78f4148420 2021-11-15T14:41:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec005d00 con 0x7f78f4148420 2021-11-15T14:41:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f414b990 con 0x7f78f4148420 2021-11-15T14:41:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec0072c0 con 0x7f78f4148420 2021-11-15T14:41:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f41579f0 con 0x7f78f4148420 2021-11-15T14:41:36.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f4157830 con 0x7f78f4148420 2021-11-15T14:41:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78ec010070 con 0x7f78f4148420 2021-11-15T14:41:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 0x7f78d8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.140+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f78ec06b020 con 0x7f78f4148420 2021-11-15T14:41:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.144+0000 7f78f2ffd700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 0x7f78d8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.144+0000 7f78f2ffd700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 0x7f78d8055b90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f78dc002fb0 tx=0x7f78dc006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.144+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78ec042300 con 0x7f78f4148420 2021-11-15T14:41:36.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f78f40aa020 con 0x7f78f4148420 2021-11-15T14:41:36.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78ebfff700 1 -- 172.21.2.135:0/826070128 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v94) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f78ec045920 con 0x7f78f4148420 2021-11-15T14:41:36.231 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:36.232 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:36.232 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 94, 2021-11-15T14:41:36.232 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:36.232 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:36.232 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:41:33.777341+0000", 2021-11-15T14:41:36.233 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:36.233 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:36.233 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:36.233 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:36.234 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:36.234 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:36.234 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:36.234 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:36.234 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:36.235 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:36.235 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:36.235 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:36.235 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:36.236 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:36.236 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:36.236 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 16, 2021-11-15T14:41:36.236 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:36.236 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:36.237 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:36.237 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:36.237 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:36.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.238 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:36.238 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:36.238 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:36.238 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:36.238 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:36.239 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:36.239 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:36.239 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:36.239 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:36.240 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:36.240 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:36.240 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:36.240 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:36.240 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:36.241 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:36.241 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:36.241 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:36.241 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:36.242 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:36.242 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:36.242 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:36.242 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:36.242 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:36.243 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.243 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:36.243 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:36.243 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:36.244 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:36.244 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:36.244 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:36.244 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:36.244 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:36.245 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:36.245 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:36.245 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:36.245 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:36.245 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:36.246 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:36.246 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:36.246 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:36.246 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:36.246 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:36.247 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:36.247 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:36.247 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:36.247 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:36.247 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:36.248 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:36.248 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:36.248 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:36.248 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:36.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.249 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:36.249 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:36.249 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:36.249 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:36.250 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:36.250 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:36.250 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:36.250 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:36.251 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:36.251 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:36.251 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:36.251 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:36.251 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:36.252 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.252 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:36.252 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:36.252 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.253 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.253 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.253 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:36.253 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:36.253 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:36.254 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:36.254 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:36.254 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:36.254 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:36.255 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:36.255 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:36.255 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:36.255 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:36.255 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:36.256 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:36.256 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:36.256 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:36.256 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:36.257 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:36.257 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:36.257 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:36.257 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:36.257 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:36.258 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:36.258 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:36.258 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.258 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:36.259 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:36.259 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:36.259 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:36.259 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:36.259 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:36.260 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:36.260 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:36.260 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:36.260 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:36.260 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:36.261 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:36.261 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:36.261 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:36.261 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:36.262 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:36.262 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:36.262 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:36.262 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:36.262 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:36.263 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:36.263 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:36.263 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:36.263 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:36.264 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:36.264 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:36.264 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:36.264 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.264 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:36.265 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:36.265 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:36.265 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:36.265 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:36.265 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:36.266 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:36.266 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:36.266 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:36.266 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:36.266 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:36.267 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:36.267 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:36.267 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:36.267 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.268 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.268 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:36.268 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:36.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.268 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:36.269 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:36.269 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.269 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.269 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.270 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.270 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.270 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.270 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.270 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 89, 2021-11-15T14:41:36.271 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.271 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.271 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.271 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.271 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.272 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.272 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:36.272 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.272 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.273 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.273 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.273 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:36.273 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.274 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.274 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.274 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.274 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.275 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.275 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.275 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.275 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:36.275 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.276 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.276 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.276 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.276 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:36.276 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.277 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.277 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.277 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.277 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.278 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.278 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.278 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.278 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:36.278 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.279 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.279 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.279 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.279 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:36.280 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.280 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.280 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.280 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.280 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.281 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.281 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.281 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.281 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:36.281 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.282 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.282 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.282 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.282 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:36.283 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:36.283 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.283 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.283 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.283 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:36.284 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:36.284 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:36.284 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:36.284 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.285 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.285 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.285 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.285 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.285 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.286 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:36.286 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:36.286 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.286 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.287 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.287 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.287 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.287 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.287 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.288 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 87, 2021-11-15T14:41:36.288 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.288 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.288 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.289 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.289 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.289 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.289 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:36.289 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.290 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.290 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.290 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.290 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:36.290 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.291 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.291 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.291 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.291 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.291 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.292 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.292 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.292 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:36.292 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.292 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.293 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.293 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.293 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:36.293 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.293 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.294 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.294 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.294 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.294 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.295 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.295 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.295 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:36.295 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.295 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.296 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.296 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.296 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:36.296 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.296 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.297 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.297 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.297 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.297 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.298 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.298 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.298 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:36.298 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.298 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.299 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.299 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.299 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:36.299 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:36.299 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.300 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.300 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:36.300 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:36.300 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:36.301 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:36.301 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.301 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.301 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.301 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.302 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.302 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.302 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:36.302 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:36.302 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.303 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.303 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.303 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.303 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.303 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.304 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.304 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:36.304 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.304 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.305 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.305 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:36.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.306 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.306 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:36.307 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.307 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.308 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.308 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:36.309 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.309 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.309 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.309 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:36.310 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.310 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.310 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.311 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.311 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.311 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.311 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.311 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:36.312 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.312 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.312 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.312 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:36.313 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.313 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.313 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.313 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.314 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.314 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.314 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.314 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.314 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:36.315 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.315 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.315 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.315 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:36.316 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:36.316 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.316 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.316 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.317 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:36.317 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:36.317 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:36.317 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:36.317 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.318 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.318 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.318 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.318 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.319 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:36.319 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:36.319 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.319 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.319 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.320 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.320 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.320 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.320 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.320 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:36.321 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.321 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.321 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.322 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:36.322 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:36.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.324 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.324 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.324 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.325 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.325 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:36.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:36.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.327 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:36.328 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:36.329 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.329 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.330 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.330 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.330 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.331 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.331 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.331 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:36.331 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.332 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.332 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.332 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:36.332 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:36.333 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.333 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.333 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.333 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:36.333 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:36.334 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:36.334 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:36.334 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.334 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.334 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.335 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.335 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.335 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:36.335 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:36.336 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.336 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.336 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.336 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.336 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.337 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.337 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.337 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:36.337 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.337 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.338 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.338 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:36.339 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.339 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:36.340 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.340 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.340 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.341 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:36.342 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.342 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:36.343 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.343 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.343 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.344 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:36.345 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.345 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.345 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.345 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:36.346 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.346 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.347 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.347 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:36.348 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.348 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.348 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.349 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:36.349 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:36.349 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.349 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.349 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.350 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:36.350 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:36.350 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:36.350 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:36.351 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.351 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.351 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.351 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.351 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.352 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.352 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:36.352 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:36.352 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.352 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.353 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.353 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.354 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.354 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:36.354 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.354 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.354 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.355 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.355 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:36.356 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:36.357 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.357 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.357 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.357 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.358 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.358 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:36.359 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.360 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.360 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.360 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.361 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.361 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:36.361 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.362 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.362 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:36.362 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.363 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.363 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.363 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.363 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.364 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.364 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.364 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:36.364 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.365 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.365 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.365 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.365 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:36.365 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:36.366 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.366 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.366 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.366 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:36.367 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:36.367 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:36.367 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:36.367 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.367 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.368 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.368 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.368 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.368 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.369 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:36.369 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:36.369 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.369 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.369 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.370 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.370 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.370 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.370 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.370 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:36.371 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.371 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.371 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.371 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.371 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.372 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.372 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:36.372 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.372 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.373 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.373 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:36.373 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.373 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.374 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.374 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.374 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.374 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.375 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.375 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:36.375 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.376 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.376 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.376 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:36.376 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.376 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.377 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.377 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.377 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.377 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.377 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.378 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:36.378 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.378 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.379 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.379 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.379 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:36.379 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.379 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.380 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.380 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.380 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.381 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:36.381 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.381 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.382 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.382 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:36.382 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:36.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.383 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.383 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.383 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:36.383 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:36.383 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:36.384 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:36.384 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.384 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.384 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.385 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.385 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.385 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.385 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:36.385 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:36.386 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:36.386 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:36.386 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:36.386 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:36.386 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:36.387 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:36.387 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:36.387 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 76, 2021-11-15T14:41:36.387 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:36.388 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:36.388 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:36.388 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.388 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.388 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:36.389 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.389 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.389 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.390 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:36.390 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.390 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.391 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:36.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.392 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:36.392 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.392 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.393 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.393 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:36.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.393 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.393 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.394 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.394 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:36.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.395 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.395 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:36.395 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:36.396 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.396 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.396 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.397 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:36.397 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:36.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.398 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:36.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:36.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.398 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.399 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:36.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:36.399 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:36.399 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.399 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.400 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:36.400 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:36.400 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:36.400 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:36.401 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:36.401 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:36.401 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:36.401 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:36.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.402 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:36.402 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:36.402 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.402 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:36.403 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.403 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.403 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.403 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.403 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.404 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:36.404 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.404 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.405 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:36.405 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.405 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.405 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.405 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.406 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.406 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:36.406 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.406 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.407 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:36.407 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.407 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.407 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.408 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.408 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.408 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:36.408 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.409 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.409 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:36.409 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.409 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.410 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.410 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.410 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.410 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:36.410 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.411 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.411 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:36.411 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.412 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.412 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.412 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.412 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.412 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:36.413 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.413 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.413 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.413 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:36.414 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.414 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.414 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.414 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.414 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:36.415 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.415 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.415 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:36.416 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.416 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.416 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.416 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.416 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:36.417 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.417 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.417 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:36.418 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:36.418 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:36.418 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:36.418 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:36.418 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:36.419 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:36.419 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:36.419 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:36.419 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.419 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:36.420 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:36.420 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:36.420 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:36.420 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:36.420 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:41:36.421 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/2353104627": "2021-11-16T14:41:29.747044+0000", 2021-11-15T14:41:36.421 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/2353104627": "2021-11-16T14:41:29.747044+0000" 2021-11-15T14:41:36.421 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.421 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:36.422 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:36.422 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:36.422 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:36.422 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:36.422 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:36.423 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:36.423 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:36.423 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:36.423 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:36.423 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:36.424 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:36.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.424 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:36.424 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:36.424 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:36.425 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:36.425 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:36.425 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:36.425 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:36.425 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:36.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:36.426 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:36.426 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:36.426 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:36.426 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:36.427 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:36.427 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:36.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 msgr2=0x7f78d8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 0x7f78d8055b90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f78dc002fb0 tx=0x7f78dc006930).stop 2021-11-15T14:41:36.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 msgr2=0x7f78f4153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f78f40b31f0 tx=0x7f78ec007f00).stop 2021-11-15T14:41:36.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 shutdown_connections 2021-11-15T14:41:36.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78d80536d0 0x7f78d8055b90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f78f4148420 0x7f78f4153e90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f78f40b1e30 0x7f78f4063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 --2- 172.21.2.135:0/826070128 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f78f40a7140 0x7f78f4063700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 >> 172.21.2.135:0/826070128 conn(0x7f78f405f730 msgr2=0x7f78f4143e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 shutdown_connections 2021-11-15T14:41:36.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.228+0000 7f78f99ed700 1 -- 172.21.2.135:0/826070128 wait complete. 2021-11-15T14:41:36.432 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:36.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 Processor -- start 2021-11-15T14:41:36.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 -- start start 2021-11-15T14:41:36.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 0x7f75fc0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f75fc144c10 0x7f75fc14a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc061ac0 con 0x7f75fc0616e0 2021-11-15T14:41:36.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0a9ec0 con 0x7f75fc144c10 2021-11-15T14:41:36.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fbfff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0a87d0 con 0x7f75fc0b4530 2021-11-15T14:41:36.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fa7fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 0x7f75fc0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fb7fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f75fc144c10 0x7f75fc14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75faffd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f75fc0616e0 0x7f75fc144500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:57644/0 (socket says 172.21.2.135:57644) 2021-11-15T14:41:36.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75faffd700 1 -- 172.21.2.135:0/2575062758 learned_addr learned my addr 172.21.2.135:0/2575062758 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:36.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2575062758 >> v2:172.21.2.119:3300/0 conn(0x7f75fc144c10 msgr2=0x7f75fc14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fa7fc700 1 --2- 172.21.2.135:0/2575062758 >> v2:172.21.2.119:3300/0 conn(0x7f75fc144c10 0x7f75fc14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.488+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2575062758 >> v1:172.21.2.119:6789/0 conn(0x7f75fc0616e0 legacy=0x7f75fc144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2575062758 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0a8a70 con 0x7f75fc0b4530 2021-11-15T14:41:36.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- 172.21.2.135:0/2575062758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 0x7f75fc0b3e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f75f0002f70 tx=0x7f75f0006df0).ready entity=mon.2 client_cookie=c79559781df7a1e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75f9ffb700 1 -- 172.21.2.135:0/2575062758 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f000d570 con 0x7f75fc0b4530 2021-11-15T14:41:36.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75f9ffb700 1 -- 172.21.2.135:0/2575062758 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0000e90 con 0x7f75fc0b4530 2021-11-15T14:41:36.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75f9ffb700 1 -- 172.21.2.135:0/2575062758 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f000d8c0 con 0x7f75fc0b4530 2021-11-15T14:41:36.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- 172.21.2.135:0/2575062758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 msgr2=0x7f75fc0b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2575062758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 0x7f75fc0b3e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f75f0002f70 tx=0x7f75f0006df0).stop 2021-11-15T14:41:36.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- 172.21.2.135:0/2575062758 shutdown_connections 2021-11-15T14:41:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2575062758 >> v2:172.21.2.119:3300/0 conn(0x7f75fc144c10 0x7f75fc14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2575062758 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0b4530 0x7f75fc0b3e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- 172.21.2.135:0/2575062758 >> 172.21.2.135:0/2575062758 conn(0x7f75fc066e60 msgr2=0x7f75fc067240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- 172.21.2.135:0/2575062758 shutdown_connections 2021-11-15T14:41:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- 172.21.2.135:0/2575062758 wait complete. 2021-11-15T14:41:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 Processor -- start 2021-11-15T14:41:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- start start 2021-11-15T14:41:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0616e0 0x7f75fc14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75fc144c10 0x7f75fc156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc157390 con 0x7f75fc144c10 2021-11-15T14:41:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15a020 con 0x7f75fc0b4530 2021-11-15T14:41:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fbfff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15a2c0 con 0x7f75fc0616e0 2021-11-15T14:41:36.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60646/0 (socket says 172.21.2.135:60646) 2021-11-15T14:41:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2904571204 learned_addr learned my addr 172.21.2.135:0/2904571204 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0616e0 msgr2=0x7f75fc14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0616e0 0x7f75fc14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75fc144c10 msgr2=0x7f75fc156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75fc144c10 0x7f75fc156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 -- 172.21.2.135:0/2904571204 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f000b180 con 0x7f75fc0b4530 2021-11-15T14:41:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.492+0000 7f75fa7fc700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f75f0002f70 tx=0x7f75f0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f000dea0 con 0x7f75fc0b4530 2021-11-15T14:41:36.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f001e400 con 0x7f75fc0b4530 2021-11-15T14:41:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc15a560 con 0x7f75fc0b4530 2021-11-15T14:41:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f001e760 con 0x7f75fc0b4530 2021-11-15T14:41:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc063cd0 con 0x7f75fc0b4530 2021-11-15T14:41:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0a8d10 con 0x7f75fc0b4530 2021-11-15T14:41:36.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75f0025030 con 0x7f75fc0b4530 2021-11-15T14:41:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 0x7f75d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f75f006c5d0 con 0x7f75fc0b4530 2021-11-15T14:41:36.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75faffd700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 0x7f75d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75faffd700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 0x7f75d8055ad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f75fc0b95d0 tx=0x7f75ec007ba0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.496+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75f00438b0 con 0x7f75fc0b4530 2021-11-15T14:41:36.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.604+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75fc062180 con 0x7f75fc0b4530 2021-11-15T14:41:36.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.604+0000 7f75ebfff700 1 -- 172.21.2.135:0/2904571204 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f75f0023090 con 0x7f75fc0b4530 2021-11-15T14:41:36.609 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:36.610 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/4241738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4241738179},{"type":"v1","addr":"172.21.2.135:6835","nonce":4241738179}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[]} 2021-11-15T14:41:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 msgr2=0x7f75d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 0x7f75d8055ad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f75fc0b95d0 tx=0x7f75ec007ba0).stop 2021-11-15T14:41:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 msgr2=0x7f75fc1569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f75f0002f70 tx=0x7f75f0014000).stop 2021-11-15T14:41:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 shutdown_connections 2021-11-15T14:41:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75d8053610 0x7f75d8055ad0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75fc144c10 0x7f75fc156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75fc0b4530 0x7f75fc1569b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 --2- 172.21.2.135:0/2904571204 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75fc0616e0 0x7f75fc14ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 >> 172.21.2.135:0/2904571204 conn(0x7f75fc066e60 msgr2=0x7f75fc145f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 shutdown_connections 2021-11-15T14:41:36.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.608+0000 7f75fbfff700 1 -- 172.21.2.135:0/2904571204 wait complete. 2021-11-15T14:41:36.614 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 45 2021-11-15T14:41:36.620 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:36.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 Processor -- start 2021-11-15T14:41:36.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- start start 2021-11-15T14:41:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 0x7efd600b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efd60148420 0x7efd600b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600b03d0 con 0x7efd600a7140 2021-11-15T14:41:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600a9140 con 0x7efd600b1e30 2021-11-15T14:41:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600b0670 con 0x7efd60148420 2021-11-15T14:41:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efd60148420 0x7efd600b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efd60148420 0x7efd600b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60658/0 (socket says 172.21.2.135:60658) 2021-11-15T14:41:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 -- 172.21.2.135:0/2760893963 learned_addr learned my addr 172.21.2.135:0/2760893963 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd65ac3700 1 --2- 172.21.2.135:0/2760893963 >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 0x7efd600b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 -- 172.21.2.135:0/2760893963 >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 msgr2=0x7efd600b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 --2- 172.21.2.135:0/2760893963 >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 0x7efd600b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 -- 172.21.2.135:0/2760893963 >> v1:172.21.2.119:6789/0 conn(0x7efd600a7140 legacy=0x7efd601447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 -- 172.21.2.135:0/2760893963 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600b0910 con 0x7efd60148420 2021-11-15T14:41:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd65ac3700 1 --2- 172.21.2.135:0/2760893963 >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 0x7efd600b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd652c2700 1 --2- 172.21.2.135:0/2760893963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd600b2210 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7efd600acee0 tx=0x7efd5c006eb0).ready entity=mon.1 client_cookie=c8ad17af952b0590 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd64ac1700 1 -- 172.21.2.135:0/2760893963 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5c00d5c0 con 0x7efd60148420 2021-11-15T14:41:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd64ac1700 1 -- 172.21.2.135:0/2760893963 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c000e90 con 0x7efd60148420 2021-11-15T14:41:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd64ac1700 1 -- 172.21.2.135:0/2760893963 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5c00d950 con 0x7efd60148420 2021-11-15T14:41:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- 172.21.2.135:0/2760893963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 msgr2=0x7efd600b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 --2- 172.21.2.135:0/2760893963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd600b2210 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7efd600acee0 tx=0x7efd5c006eb0).stop 2021-11-15T14:41:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- 172.21.2.135:0/2760893963 shutdown_connections 2021-11-15T14:41:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 --2- 172.21.2.135:0/2760893963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd600b2210 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 --2- 172.21.2.135:0/2760893963 >> v2:172.21.2.119:3300/0 conn(0x7efd600b1e30 0x7efd600b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- 172.21.2.135:0/2760893963 >> 172.21.2.135:0/2760893963 conn(0x7efd6005f730 msgr2=0x7efd6005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- 172.21.2.135:0/2760893963 shutdown_connections 2021-11-15T14:41:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- 172.21.2.135:0/2760893963 wait complete. 2021-11-15T14:41:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 Processor -- start 2021-11-15T14:41:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.668+0000 7efd67d27700 1 -- start start 2021-11-15T14:41:36.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd600a7140 0x7efd6014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd600b1e30 0x7efd600aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6014a800 con 0x7efd600a7140 2021-11-15T14:41:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600a9560 con 0x7efd60148420 2021-11-15T14:41:36.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600a9800 con 0x7efd600b1e30 2021-11-15T14:41:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60662/0 (socket says 172.21.2.135:60662) 2021-11-15T14:41:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 -- 172.21.2.135:0/316278401 learned_addr learned my addr 172.21.2.135:0/316278401 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 -- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd600b1e30 msgr2=0x7efd600aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd600b1e30 0x7efd600aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 -- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd600a7140 msgr2=0x7efd6014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd600a7140 0x7efd6014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 -- 172.21.2.135:0/316278401 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c00b1e0 con 0x7efd60148420 2021-11-15T14:41:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd662c4700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7efd58002320 tx=0x7efd580023f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd58006aa0 con 0x7efd60148420 2021-11-15T14:41:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58006c00 con 0x7efd60148420 2021-11-15T14:41:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd600a9aa0 con 0x7efd60148420 2021-11-15T14:41:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd58007030 con 0x7efd60148420 2021-11-15T14:41:36.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600a9f40 con 0x7efd60148420 2021-11-15T14:41:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd600b0bb0 con 0x7efd60148420 2021-11-15T14:41:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd58010030 con 0x7efd60148420 2021-11-15T14:41:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 0x7efd40055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efd5806b7f0 con 0x7efd60148420 2021-11-15T14:41:36.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd65ac3700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 0x7efd40055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.672+0000 7efd65ac3700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 0x7efd40055b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7efd50007000 tx=0x7efd50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.676+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd58042ad0 con 0x7efd60148420 2021-11-15T14:41:36.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd600573d0 con 0x7efd60148420 2021-11-15T14:41:36.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd4effd700 1 -- 172.21.2.135:0/316278401 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+1559 (secure 0 0 0) 0x7efd580460f0 con 0x7efd60148420 2021-11-15T14:41:36.787 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:36.787 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/1153240919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":1153240919},{"type":"v1","addr":"172.21.2.119:6835","nonce":1153240919}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/915740270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":915740270},{"type":"v1","addr":"172.21.2.135:6833","nonce":915740270}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6844,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/4241738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4241738179},{"type":"v1","addr":"172.21.2.135:6835","nonce":4241738179}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[]} 2021-11-15T14:41:36.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 msgr2=0x7efd40055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 0x7efd40055b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7efd50007000 tx=0x7efd50008040).stop 2021-11-15T14:41:36.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 msgr2=0x7efd6014ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7efd58002320 tx=0x7efd580023f0).stop 2021-11-15T14:41:36.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 shutdown_connections 2021-11-15T14:41:36.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efd40053690 0x7efd40055b50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efd60148420 0x7efd6014ae10 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efd600b1e30 0x7efd600aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 --2- 172.21.2.135:0/316278401 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efd600a7140 0x7efd6014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 >> 172.21.2.135:0/316278401 conn(0x7efd6005f730 msgr2=0x7efd601449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 shutdown_connections 2021-11-15T14:41:36.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.784+0000 7efd67d27700 1 -- 172.21.2.135:0/316278401 wait complete. 2021-11-15T14:41:36.791 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 45 2021-11-15T14:41:36.794 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:41:36.794 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:41:36.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:41:36.795 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:36.796 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:41:36.796 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:41:36.796 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:41:36.796 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:36.797 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:41:36.797 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:41:36.797 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:41:36.798 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:36.800 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:41:36.800 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:41:36.802 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:41:36.802 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:41:36.803 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:41:36.804 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:36.805 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:41:36.805 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:36.809 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:41:36.809 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:41:36.811 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:41:36.812 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:36.812 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:41:36.835 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:41:36.836 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:41:36.845 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:41:36.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 Processor -- start 2021-11-15T14:41:36.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- start start 2021-11-15T14:41:36.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6ab80b5c70 0x7f6ab80b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab8144130 con 0x7f6ab80b6600 2021-11-15T14:41:36.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80b6ed0 con 0x7f6ab80b4440 2021-11-15T14:41:36.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab8143bf0 con 0x7f6ab80b5c70 2021-11-15T14:41:36.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f6ab80b4440 0x7f6ab812ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48282/0 (socket says 172.21.2.135:48282) 2021-11-15T14:41:36.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 -- 172.21.2.135:0/786235475 learned_addr learned my addr 172.21.2.135:0/786235475 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:36.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513872828 0 0) 0x7f6ab80b6ed0 con 0x7f6ab80b4440 2021-11-15T14:41:36.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a98003260 con 0x7f6ab80b4440 2021-11-15T14:41:36.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abce68700 1 --2- 172.21.2.135:0/786235475 >> v2:172.21.2.119:3300/0 conn(0x7f6ab80b5c70 0x7f6ab80b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483586629 0 0) 0x7f6a98003260 con 0x7f6ab80b4440 2021-11-15T14:41:36.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 >> v2:172.21.2.119:3300/0 conn(0x7f6ab80b5c70 msgr2=0x7f6ab80b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 --2- 172.21.2.135:0/786235475 >> v2:172.21.2.119:3300/0 conn(0x7f6ab80b5c70 0x7f6ab80b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 >> v1:172.21.2.119:6789/0 conn(0x7f6ab80b6600 legacy=0x7f6ab8061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8143e90 con 0x7f6ab80b4440 2021-11-15T14:41:36.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6aa8001660 con 0x7f6ab80b4440 2021-11-15T14:41:36.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 >> v1:172.21.2.135:6789/0 conn(0x7f6ab80b4440 legacy=0x7f6ab812ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 0x7f6a98003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a98004500 0x7f6a98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98004e70 0x7f6a9800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8143bf0 con 0x7f6a98004e70 2021-11-15T14:41:36.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9800bd20 con 0x7f6a98003750 2021-11-15T14:41:36.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9800bee0 con 0x7f6a98004500 2021-11-15T14:41:36.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 0x7f6a98003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a98004500 0x7f6a98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 -- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a98004500 msgr2=0x7f6a98004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a98004500 0x7f6a98004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 -- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98004e70 msgr2=0x7f6a9800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:36.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98004e70 0x7f6a9800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:36.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abce68700 1 -- 172.21.2.135:0/786235475 reap_dead start 2021-11-15T14:41:36.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 -- 172.21.2.135:0/786235475 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98003260 con 0x7f6a98003750 2021-11-15T14:41:36.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a98004500 0x7f6a98004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:36.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 0x7f6a98003b70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f6ab80b1d00 tx=0x7f6aa0007a00).ready entity=mon.1 client_cookie=ba00c183a7414824 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0007d10 con 0x7f6a98003750 2021-11-15T14:41:36.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0007030 con 0x7f6a98003750 2021-11-15T14:41:36.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab6ffd700 1 -- 172.21.2.135:0/786235475 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0007390 con 0x7f6a98003750 2021-11-15T14:41:36.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 msgr2=0x7f6a98003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 0x7f6a98003b70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f6ab80b1d00 tx=0x7f6aa0007a00).stop 2021-11-15T14:41:36.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- 172.21.2.135:0/786235475 shutdown_connections 2021-11-15T14:41:36.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/786235475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a98003750 0x7f6a98003b70 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- 172.21.2.135:0/786235475 >> 172.21.2.135:0/786235475 conn(0x7f6ab805c510 msgr2=0x7f6ab805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:36.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- 172.21.2.135:0/786235475 shutdown_connections 2021-11-15T14:41:36.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- 172.21.2.135:0/786235475 wait complete. 2021-11-15T14:41:36.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 Processor -- start 2021-11-15T14:41:36.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- start start 2021-11-15T14:41:36.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 0x7f6ab812bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 0x7f6ab80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8129800 con 0x7f6a98003750 2021-11-15T14:41:36.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8148320 con 0x7f6ab8152eb0 2021-11-15T14:41:36.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6abe8cb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8129a30 con 0x7f6ab8147e70 2021-11-15T14:41:36.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60708/0 (socket says 172.21.2.135:60708) 2021-11-15T14:41:36.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.864+0000 7f6ab77fe700 1 -- 172.21.2.135:0/3501500826 learned_addr learned my addr 172.21.2.135:0/3501500826 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:36.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6abce68700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 0x7f6ab80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 0x7f6ab812bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 -- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 msgr2=0x7f6ab80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 0x7f6ab80b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 -- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 msgr2=0x7f6ab812bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:36.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 0x7f6ab812bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:36.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 -- 172.21.2.135:0/3501500826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8129cd0 con 0x7f6ab8152eb0 2021-11-15T14:41:36.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6abce68700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 0x7f6ab80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:36.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 0x7f6ab812bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:36.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab77fe700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f6aa8008000 tx=0x7f6aa8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa8007170 con 0x7f6ab8152eb0 2021-11-15T14:41:36.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa80072d0 con 0x7f6ab8152eb0 2021-11-15T14:41:36.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8129f70 con 0x7f6ab8152eb0 2021-11-15T14:41:36.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa8004920 con 0x7f6ab8152eb0 2021-11-15T14:41:36.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab80b3ba0 con 0x7f6ab8152eb0 2021-11-15T14:41:36.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8061670 con 0x7f6ab8152eb0 2021-11-15T14:41:36.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6aa801b060 con 0x7f6ab8152eb0 2021-11-15T14:41:36.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 0x7f6a9c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:36.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6aa806b2a0 con 0x7f6ab8152eb0 2021-11-15T14:41:36.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 0x7f6a9c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:36.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab7fff700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 0x7f6a9c055be0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f6aa0016000 tx=0x7f6aa0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:36.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.868+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6aa8042520 con 0x7f6ab8152eb0 2021-11-15T14:41:36.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:36.964+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6ab80573d0 con 0x7f6ab8152eb0 2021-11-15T14:41:37.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6ab57fa700 1 -- 172.21.2.135:0/3501500826 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6aa8019030 con 0x7f6ab8152eb0 2021-11-15T14:41:37.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 msgr2=0x7f6a9c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:37.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 0x7f6a9c055be0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f6aa0016000 tx=0x7f6aa0015000).stop 2021-11-15T14:41:37.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 msgr2=0x7f6ab8147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:37.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f6aa8008000 tx=0x7f6aa8009040).stop 2021-11-15T14:41:37.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 shutdown_connections 2021-11-15T14:41:37.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a9c053720 0x7f6a9c055be0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:37.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6ab8147e70 0x7f6ab80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:37.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6ab8152eb0 0x7f6ab8147980 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:37.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 --2- 172.21.2.135:0/3501500826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a98003750 0x7f6ab812bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:37.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 >> 172.21.2.135:0/3501500826 conn(0x7f6ab805c510 msgr2=0x7f6ab80621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:37.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.888+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 shutdown_connections 2021-11-15T14:41:37.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.892+0000 7f6abe8cb700 1 -- 172.21.2.135:0/3501500826 wait complete. 2021-11-15T14:41:37.897 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:41:37.900 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:41:37.901 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:41:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 Processor -- start 2021-11-15T14:41:37.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- start start 2021-11-15T14:41:38.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 0x7fbdf8149c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80b04b0 con 0x7fbdf80afca0 2021-11-15T14:41:38.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80ad530 con 0x7fbdf80ad150 2021-11-15T14:41:38.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80b57d0 con 0x7fbdf80b0bb0 2021-11-15T14:41:38.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfd50e700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fbdf80ad150 0x7fbdf813f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48304/0 (socket says 172.21.2.135:48304) 2021-11-15T14:41:38.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfd50e700 1 -- 172.21.2.135:0/90314609 learned_addr learned my addr 172.21.2.135:0/90314609 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454966085 0 0) 0x7fbdf80ad530 con 0x7fbdf80ad150 2021-11-15T14:41:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde0003260 con 0x7fbdf80ad150 2021-11-15T14:41:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfdd0f700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 0x7fbdf8149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748404386 0 0) 0x7fbde0003260 con 0x7fbdf80ad150 2021-11-15T14:41:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 msgr2=0x7fbdf8149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 0x7fbdf8149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 >> v1:172.21.2.119:6789/0 conn(0x7fbdf80afca0 legacy=0x7fbdf813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80b06e0 con 0x7fbdf80ad150 2021-11-15T14:41:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fbdec001660 con 0x7fbdf80ad150 2021-11-15T14:41:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 >> v1:172.21.2.135:6789/0 conn(0x7fbdf80ad150 legacy=0x7fbdf813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbde0003a30 0x7fbde0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbde0004520 0x7fbde00049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 0x7fbde00051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80b57d0 con 0x7fbde0003a30 2021-11-15T14:41:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde00058a0 con 0x7fbde0004520 2021-11-15T14:41:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000dd70 con 0x7fbdf80b0bb0 2021-11-15T14:41:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbde0004520 0x7fbde00049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 msgr2=0x7fbde00051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbdf80b0bb0 0x7fbde00051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfd50e700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbde0003a30 0x7fbde0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbde0003a30 msgr2=0x7fbde0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbde0003a30 0x7fbde0003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/90314609 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0003260 con 0x7fbde0004520 2021-11-15T14:41:38.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbde0004520 0x7fbde00049a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbdf4001fa0 tx=0x7fbdf4007a00).ready entity=mon.1 client_cookie=158b4e3e034eafac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf4007070 con 0x7fbde0004520 2021-11-15T14:41:38.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40071d0 con 0x7fbde0004520 2021-11-15T14:41:38.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdebfff700 1 -- 172.21.2.135:0/90314609 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf4006510 con 0x7fbde0004520 2021-11-15T14:41:38.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- 172.21.2.135:0/90314609 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbde0004520 msgr2=0x7fbde00049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 --2- 172.21.2.135:0/90314609 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbde0004520 0x7fbde00049a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fbdf4001fa0 tx=0x7fbdf4007a00).stop 2021-11-15T14:41:38.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdfdd0f700 1 -- 172.21.2.135:0/90314609 reap_dead start 2021-11-15T14:41:38.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- 172.21.2.135:0/90314609 shutdown_connections 2021-11-15T14:41:38.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- 172.21.2.135:0/90314609 >> 172.21.2.135:0/90314609 conn(0x7fbdf8062cb0 msgr2=0x7fbdf8063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- 172.21.2.135:0/90314609 shutdown_connections 2021-11-15T14:41:38.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:37.996+0000 7fbdff772700 1 -- 172.21.2.135:0/90314609 wait complete. 2021-11-15T14:41:38.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 Processor -- start 2021-11-15T14:41:38.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- start start 2021-11-15T14:41:38.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbde0004520 0x7fbdf80675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbdf814dd30 0x7fbdf814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8066740 con 0x7fbdf814dd30 2021-11-15T14:41:38.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8065770 con 0x7fbdf8065210 2021-11-15T14:41:38.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8065a10 con 0x7fbde0004520 2021-11-15T14:41:38.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60730/0 (socket says 172.21.2.135:60730) 2021-11-15T14:41:38.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/1452365156 learned_addr learned my addr 172.21.2.135:0/1452365156 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbde0004520 msgr2=0x7fbdf80675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbde0004520 0x7fbdf80675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbdf814dd30 msgr2=0x7fbdf814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbdf814dd30 0x7fbdf814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 -- 172.21.2.135:0/1452365156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf813f180 con 0x7fbdf8065210 2021-11-15T14:41:38.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfcd0d700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fbdf4001fa0 tx=0x7fbdf4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf4014890 con 0x7fbdf8065210 2021-11-15T14:41:38.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40149f0 con 0x7fbdf8065210 2021-11-15T14:41:38.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf814e6a0 con 0x7fbdf8065210 2021-11-15T14:41:38.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf4014d50 con 0x7fbdf8065210 2021-11-15T14:41:38.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf81511a0 con 0x7fbdf8065210 2021-11-15T14:41:38.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf8066940 con 0x7fbdf8065210 2021-11-15T14:41:38.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdf401d070 con 0x7fbdf8065210 2021-11-15T14:41:38.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 0x7fbdd8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fbdf406c980 con 0x7fbdf8065210 2021-11-15T14:41:38.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.000+0000 7fbdfd50e700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 0x7fbdd8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.004+0000 7fbdfd50e700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 0x7fbdd8055a00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fbdec008000 tx=0x7fbdec009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.004+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbdf4043bb0 con 0x7fbdf8065210 2021-11-15T14:41:38.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbdf80b5a30 con 0x7fbdf8065210 2021-11-15T14:41:38.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdea7fc700 1 -- 172.21.2.135:0/1452365156 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fbdf40471d0 con 0x7fbdf8065210 2021-11-15T14:41:38.123 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:38.123 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:38.123 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:41:38.124 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.124 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:41:38.124 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:41:38.124 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.125 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:38.125 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.125 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.125 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.125 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.126 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.126 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.126 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:41:38.126 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:41:38.126 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.127 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:38.127 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.127 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.127 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.127 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.128 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.128 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.128 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:41:38.128 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:41:38.128 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.129 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:38.129 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.129 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.129 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.130 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.130 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.130 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.130 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:41:38.130 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:41:38.131 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.131 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.131 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.131 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.131 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.132 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.132 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.132 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:41:38.132 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:41:38.132 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.133 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.133 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.133 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.133 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.134 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.134 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.134 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:41:38.134 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:41:38.134 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.135 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.135 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.135 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.135 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.135 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.136 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.136 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:41:38.136 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:41:38.136 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.137 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.137 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.137 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.137 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.137 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.138 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.138 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:41:38.138 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:41:38.138 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.138 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.139 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.139 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.139 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.139 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.140 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.140 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:41:38.140 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:41:38.140 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.140 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.141 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.141 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.141 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.141 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.141 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.142 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:41:38.142 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:41:38.142 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.142 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.143 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.143 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.143 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.143 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.143 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.144 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:41:38.144 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:41:38.144 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.144 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.144 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.145 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.145 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.145 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.145 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.145 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:41:38.146 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:41:38.146 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.146 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:38.146 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:38.146 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:38.147 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.147 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.147 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.147 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:41:38.147 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:41:38.148 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.148 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:38.148 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:38.148 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:38.148 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.149 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.149 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.149 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:41:38.149 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:41:38.150 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.150 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:38.150 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:38.150 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:38.151 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.151 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.151 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.151 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.152 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:41:38.152 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:41:38.152 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.152 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:38.153 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:38.153 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.153 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.153 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.154 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.154 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:41:38.154 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:41:38.154 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:38.155 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:38.155 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:38.155 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:38.155 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.156 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.156 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:38.156 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 msgr2=0x7fbdd8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 0x7fbdd8055a00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fbdec008000 tx=0x7fbdec009040).stop 2021-11-15T14:41:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 msgr2=0x7fbdf813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fbdf4001fa0 tx=0x7fbdf4015000).stop 2021-11-15T14:41:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 shutdown_connections 2021-11-15T14:41:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbdd8053540 0x7fbdd8055a00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbdf814dd30 0x7fbdf814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbdf8065210 0x7fbdf813e520 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 --2- 172.21.2.135:0/1452365156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbde0004520 0x7fbdf80675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 >> 172.21.2.135:0/1452365156 conn(0x7fbdf8062cb0 msgr2=0x7fbdf80b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 shutdown_connections 2021-11-15T14:41:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.120+0000 7fbdff772700 1 -- 172.21.2.135:0/1452365156 wait complete. 2021-11-15T14:41:38.161 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:38.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 Processor -- start 2021-11-15T14:41:38.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 -- start start 2021-11-15T14:41:38.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa534148420 0x7fa5340b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340b03d0 con 0x7fa5340a7140 2021-11-15T14:41:38.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340a9140 con 0x7fa534148420 2021-11-15T14:41:38.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa5388ea700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b0670 con 0x7fa5340b1e30 2021-11-15T14:41:38.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa53259c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa531d9b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa534148420 0x7fa5340b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa532d9d700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa5340a7140 0x7fa5341447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:57740/0 (socket says 172.21.2.135:57740) 2021-11-15T14:41:38.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.212+0000 7fa532d9d700 1 -- 172.21.2.135:0/3843575567 learned_addr learned my addr 172.21.2.135:0/3843575567 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:38.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa53159a700 1 -- 172.21.2.135:0/3843575567 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539195284 0 0) 0x7fa5340b03d0 con 0x7fa5340a7140 2021-11-15T14:41:38.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa53159a700 1 -- 172.21.2.135:0/3843575567 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa518003260 con 0x7fa5340a7140 2021-11-15T14:41:38.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa531d9b700 1 -- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 msgr2=0x7fa5340b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa531d9b700 1 --2- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa531d9b700 1 -- 172.21.2.135:0/3843575567 >> v1:172.21.2.119:6789/0 conn(0x7fa5340a7140 legacy=0x7fa5341447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa531d9b700 1 -- 172.21.2.135:0/3843575567 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340b0910 con 0x7fa534148420 2021-11-15T14:41:38.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa531d9b700 1 --2- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa534148420 0x7fa5340b2210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa524002f70 tx=0x7fa524006df0).ready entity=mon.0 client_cookie=c47602fd2da7ae24 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa53159a700 1 -- 172.21.2.135:0/3843575567 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52400d4a0 con 0x7fa534148420 2021-11-15T14:41:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa53159a700 1 -- 172.21.2.135:0/3843575567 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524000e90 con 0x7fa534148420 2021-11-15T14:41:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa53159a700 1 -- 172.21.2.135:0/3843575567 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52400d7f0 con 0x7fa534148420 2021-11-15T14:41:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa534148420 msgr2=0x7fa5340b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa534148420 0x7fa5340b2210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa524002f70 tx=0x7fa524006df0).stop 2021-11-15T14:41:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- 172.21.2.135:0/3843575567 shutdown_connections 2021-11-15T14:41:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa534148420 0x7fa5340b2210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- 172.21.2.135:0/3843575567 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- 172.21.2.135:0/3843575567 >> 172.21.2.135:0/3843575567 conn(0x7fa53405f730 msgr2=0x7fa53405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- 172.21.2.135:0/3843575567 shutdown_connections 2021-11-15T14:41:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- 172.21.2.135:0/3843575567 wait complete. 2021-11-15T14:41:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 Processor -- start 2021-11-15T14:41:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- start start 2021-11-15T14:41:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5340a7140 0x7fa5340ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340ac860 con 0x7fa5340a7140 2021-11-15T14:41:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53414a0e0 con 0x7fa534148420 2021-11-15T14:41:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa5388ea700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340ac5c0 con 0x7fa5340b1e30 2021-11-15T14:41:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa532d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa532d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60746/0 (socket says 172.21.2.135:60746) 2021-11-15T14:41:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.216+0000 7fa532d9d700 1 -- 172.21.2.135:0/1276265352 learned_addr learned my addr 172.21.2.135:0/1276265352 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa53259c700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5340a7140 0x7fa5340ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa531d9b700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 -- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 msgr2=0x7fa5340a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 -- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5340a7140 msgr2=0x7fa5340ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5340a7140 0x7fa5340ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 -- 172.21.2.135:0/1276265352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52400b180 con 0x7fa534148420 2021-11-15T14:41:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa532d9d700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fa5340aad40 tx=0x7fa52c007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52c005ba0 con 0x7fa534148420 2021-11-15T14:41:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5340a9ea0 con 0x7fa534148420 2021-11-15T14:41:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c005d00 con 0x7fa534148420 2021-11-15T14:41:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa52c0072c0 con 0x7fa534148420 2021-11-15T14:41:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5340aeef0 con 0x7fa534148420 2021-11-15T14:41:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5340b0bb0 con 0x7fa534148420 2021-11-15T14:41:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa52c010070 con 0x7fa534148420 2021-11-15T14:41:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 0x7fa5100559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa52c06b300 con 0x7fa534148420 2021-11-15T14:41:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa53259c700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 0x7fa5100559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.220+0000 7fa53259c700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 0x7fa5100559b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fa52800b000 tx=0x7fa528008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.224+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa52c0425a0 con 0x7fa534148420 2021-11-15T14:41:38.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.304+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa53414a220 con 0x7fa534148420 2021-11-15T14:41:38.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5237fe700 1 -- 172.21.2.135:0/1276265352 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fa52c018020 con 0x7fa534148420 2021-11-15T14:41:38.311 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:38.311 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":98,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:37.878053+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:38.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 msgr2=0x7fa5100559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 0x7fa5100559b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fa52800b000 tx=0x7fa528008040).stop 2021-11-15T14:41:38.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 msgr2=0x7fa5340a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fa5340aad40 tx=0x7fa52c007e00).stop 2021-11-15T14:41:38.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 shutdown_connections 2021-11-15T14:41:38.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa5100534f0 0x7fa5100559b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa534148420 0x7fa5340a99b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5340b1e30 0x7fa5340a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 --2- 172.21.2.135:0/1276265352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5340a7140 0x7fa5340ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 >> 172.21.2.135:0/1276265352 conn(0x7fa53405f730 msgr2=0x7fa5340b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 shutdown_connections 2021-11-15T14:41:38.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.308+0000 7fa5388ea700 1 -- 172.21.2.135:0/1276265352 wait complete. 2021-11-15T14:41:38.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:41:38.319 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:38.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 Processor -- start 2021-11-15T14:41:38.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- start start 2021-11-15T14:41:38.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd080654a0 0x7fcd081444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcd080b3950 0x7fcd081449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080b2430 con 0x7fcd08060040 2021-11-15T14:41:38.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080b26d0 con 0x7fcd080b3950 2021-11-15T14:41:38.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080b2970 con 0x7fcd080654a0 2021-11-15T14:41:38.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd080654a0 0x7fcd081444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd080654a0 0x7fcd081444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60754/0 (socket says 172.21.2.135:60754) 2021-11-15T14:41:38.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 -- 172.21.2.135:0/1026756603 learned_addr learned my addr 172.21.2.135:0/1026756603 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 -- 172.21.2.135:0/1026756603 >> v2:172.21.2.119:3300/0 conn(0x7fcd080b3950 msgr2=0x7fcd081449b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:38.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 --2- 172.21.2.135:0/1026756603 >> v2:172.21.2.119:3300/0 conn(0x7fcd080b3950 0x7fcd081449b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 -- 172.21.2.135:0/1026756603 >> v1:172.21.2.119:6789/0 conn(0x7fcd08060040 legacy=0x7fcd08064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:38.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 -- 172.21.2.135:0/1026756603 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080648f0 con 0x7fcd080654a0 2021-11-15T14:41:38.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd07fff700 1 --2- 172.21.2.135:0/1026756603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd080654a0 0x7fcd081444c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fcd0813b870 tx=0x7fccf0006eb0).ready entity=mon.1 client_cookie=185d02f223654c3e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd077fe700 1 -- 172.21.2.135:0/1026756603 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf000d5c0 con 0x7fcd080654a0 2021-11-15T14:41:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd077fe700 1 -- 172.21.2.135:0/1026756603 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0000e90 con 0x7fcd080654a0 2021-11-15T14:41:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd077fe700 1 -- 172.21.2.135:0/1026756603 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf000d910 con 0x7fcd080654a0 2021-11-15T14:41:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- 172.21.2.135:0/1026756603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd080654a0 msgr2=0x7fcd081444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/1026756603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd080654a0 0x7fcd081444c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fcd0813b870 tx=0x7fccf0006eb0).stop 2021-11-15T14:41:38.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- 172.21.2.135:0/1026756603 shutdown_connections 2021-11-15T14:41:38.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/1026756603 >> v2:172.21.2.119:3300/0 conn(0x7fcd080b3950 0x7fcd081449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/1026756603 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd080654a0 0x7fcd081444c0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- 172.21.2.135:0/1026756603 >> 172.21.2.135:0/1026756603 conn(0x7fcd0805cfe0 msgr2=0x7fcd0805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- 172.21.2.135:0/1026756603 shutdown_connections 2021-11-15T14:41:38.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.368+0000 7fcd0edb1700 1 -- 172.21.2.135:0/1026756603 wait complete. 2021-11-15T14:41:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 Processor -- start 2021-11-15T14:41:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- start start 2021-11-15T14:41:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd080654a0 0x7fcd0814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd080b3950 0x7fcd0814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080aff60 con 0x7fcd080654a0 2021-11-15T14:41:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080aebc0 con 0x7fcd08060040 2021-11-15T14:41:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080af1d0 con 0x7fcd080b3950 2021-11-15T14:41:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60756/0 (socket says 172.21.2.135:60756) 2021-11-15T14:41:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 -- 172.21.2.135:0/627195989 learned_addr learned my addr 172.21.2.135:0/627195989 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 -- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd080b3950 msgr2=0x7fcd0814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd080b3950 0x7fcd0814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 -- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd080654a0 msgr2=0x7fcd0814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd080654a0 0x7fcd0814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 -- 172.21.2.135:0/627195989 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf000b1e0 con 0x7fcd08060040 2021-11-15T14:41:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0cb4d700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fccf8002fb0 tx=0x7fccf8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf8013460 con 0x7fcd08060040 2021-11-15T14:41:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080aedf0 con 0x7fcd08060040 2021-11-15T14:41:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf80135c0 con 0x7fcd08060040 2021-11-15T14:41:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf8013920 con 0x7fcd08060040 2021-11-15T14:41:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0814dfe0 con 0x7fcd08060040 2021-11-15T14:41:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd080b1030 con 0x7fcd08060040 2021-11-15T14:41:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccf800f070 con 0x7fcd08060040 2021-11-15T14:41:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 0x7fccec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fccf806b2e0 con 0x7fcd08060040 2021-11-15T14:41:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.372+0000 7fcd07fff700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 0x7fccec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.376+0000 7fcd07fff700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 0x7fccec055b20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fcd0813b870 tx=0x7fccf0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.376+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccf8042510 con 0x7fcd08060040 2021-11-15T14:41:38.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.456+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcd080674f0 con 0x7fcd08060040 2021-11-15T14:41:38.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.456+0000 7fcd05ffb700 1 -- 172.21.2.135:0/627195989 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7fccf8045b30 con 0x7fcd08060040 2021-11-15T14:41:38.462 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:38.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 msgr2=0x7fccec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 0x7fccec055b20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fcd0813b870 tx=0x7fccf0015000).stop 2021-11-15T14:41:38.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 msgr2=0x7fcd0813c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fccf8002fb0 tx=0x7fccf8006df0).stop 2021-11-15T14:41:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 shutdown_connections 2021-11-15T14:41:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fccec053660 0x7fccec055b20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd080b3950 0x7fcd0814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd080654a0 0x7fcd0814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 --2- 172.21.2.135:0/627195989 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd08060040 0x7fcd0813c790 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 >> 172.21.2.135:0/627195989 conn(0x7fcd0805cfe0 msgr2=0x7fcd08139960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 shutdown_connections 2021-11-15T14:41:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.460+0000 7fcd0edb1700 1 -- 172.21.2.135:0/627195989 wait complete. 2021-11-15T14:41:38.469 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:38.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 Processor -- start 2021-11-15T14:41:38.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- start start 2021-11-15T14:41:38.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b0630 0x7fa1c00b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa1c00a9c90 0x7fa1c00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c01439a0 con 0x7fa1c00b3790 2021-11-15T14:41:38.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c0143c40 con 0x7fa1c00a9c90 2021-11-15T14:41:38.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0143ee0 con 0x7fa1c00b0630 2021-11-15T14:41:38.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa1c00b3790 0x7fa1c013d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48352/0 (socket says 172.21.2.135:48352) 2021-11-15T14:41:38.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bffff700 1 -- 172.21.2.135:0/3315117918 learned_addr learned my addr 172.21.2.135:0/3315117918 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:38.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 --2- 172.21.2.135:0/3315117918 >> v2:172.21.2.135:3300/0 conn(0x7fa1c00a9c90 0x7fa1c00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bf7fe700 1 -- 172.21.2.135:0/3315117918 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882298371 0 0) 0x7fa1c01439a0 con 0x7fa1c00b3790 2021-11-15T14:41:38.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bf7fe700 1 -- 172.21.2.135:0/3315117918 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a0003260 con 0x7fa1c00b3790 2021-11-15T14:41:38.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 -- 172.21.2.135:0/3315117918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b0630 msgr2=0x7fa1c00b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 --2- 172.21.2.135:0/3315117918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b0630 0x7fa1c00b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 -- 172.21.2.135:0/3315117918 >> v1:172.21.2.135:6789/0 conn(0x7fa1c00b3790 legacy=0x7fa1c013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 -- 172.21.2.135:0/3315117918 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0144180 con 0x7fa1c00a9c90 2021-11-15T14:41:38.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c5400700 1 --2- 172.21.2.135:0/3315117918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00b1130 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fa1b80032f0 tx=0x7fa1b80091d0).ready entity=mon.1 client_cookie=5840b2ad1e238e21 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bf7fe700 1 -- 172.21.2.135:0/3315117918 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b800b6c0 con 0x7fa1c00a9c90 2021-11-15T14:41:38.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bf7fe700 1 -- 172.21.2.135:0/3315117918 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800b820 con 0x7fa1c00a9c90 2021-11-15T14:41:38.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bf7fe700 1 -- 172.21.2.135:0/3315117918 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b800b990 con 0x7fa1c00a9c90 2021-11-15T14:41:38.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- 172.21.2.135:0/3315117918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00a9c90 msgr2=0x7fa1c00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/3315117918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00b1130 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fa1b80032f0 tx=0x7fa1b80091d0).stop 2021-11-15T14:41:38.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- 172.21.2.135:0/3315117918 shutdown_connections 2021-11-15T14:41:38.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/3315117918 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00b1130 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/3315117918 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b0630 0x7fa1c00b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.532 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- 172.21.2.135:0/3315117918 >> 172.21.2.135:0/3315117918 conn(0x7fa1c0060840 msgr2=0x7fa1c0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- 172.21.2.135:0/3315117918 shutdown_connections 2021-11-15T14:41:38.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- 172.21.2.135:0/3315117918 wait complete. 2021-11-15T14:41:38.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 Processor -- start 2021-11-15T14:41:38.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- start start 2021-11-15T14:41:38.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b3790 0x7fa1c013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01547d0 con 0x7fa1c00a9c90 2021-11-15T14:41:38.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0156bf0 con 0x7fa1c00b0630 2021-11-15T14:41:38.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1c6e63700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0156e90 con 0x7fa1c00b3790 2021-11-15T14:41:38.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60774/0 (socket says 172.21.2.135:60774) 2021-11-15T14:41:38.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.520+0000 7fa1bffff700 1 -- 172.21.2.135:0/4271054040 learned_addr learned my addr 172.21.2.135:0/4271054040 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 -- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b3790 msgr2=0x7fa1c013f430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:38.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b3790 0x7fa1c013f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 -- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1c00a9c90 msgr2=0x7fa1c00a8270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:38.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00a8270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 -- 172.21.2.135:0/4271054040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8009470 con 0x7fa1c00b0630 2021-11-15T14:41:38.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bffff700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fa1c00ab640 tx=0x7fa1a8007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a80070d0 con 0x7fa1c00b0630 2021-11-15T14:41:38.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8007230 con 0x7fa1c00b0630 2021-11-15T14:41:38.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c0157130 con 0x7fa1c00b0630 2021-11-15T14:41:38.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c00a8760 con 0x7fa1c00b0630 2021-11-15T14:41:38.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a8005610 con 0x7fa1c00b0630 2021-11-15T14:41:38.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c013dce0 con 0x7fa1c00b0630 2021-11-15T14:41:38.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1a8010070 con 0x7fa1c00b0630 2021-11-15T14:41:38.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 0x7fa1a4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa1a806af50 con 0x7fa1c00b0630 2021-11-15T14:41:38.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1c4bff700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 0x7fa1a4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1c4bff700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 0x7fa1a4055bb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fa1b0002f70 tx=0x7fa1b0006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.524+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1a8042180 con 0x7fa1c00b0630 2021-11-15T14:41:38.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa1c00573d0 con 0x7fa1c00b0630 2021-11-15T14:41:38.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1bdffb700 1 -- 172.21.2.135:0/4271054040 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1a80457a0 con 0x7fa1c00b0630 2021-11-15T14:41:38.615 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:38.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 msgr2=0x7fa1a4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 0x7fa1a4055bb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fa1b0002f70 tx=0x7fa1b0006a00).stop 2021-11-15T14:41:38.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 msgr2=0x7fa1c013ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fa1c00ab640 tx=0x7fa1a8007aa0).stop 2021-11-15T14:41:38.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 shutdown_connections 2021-11-15T14:41:38.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1a40536f0 0x7fa1a4055bb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1c00b3790 0x7fa1c013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1c00b0630 0x7fa1c013ef40 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 --2- 172.21.2.135:0/4271054040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa1c00a9c90 0x7fa1c00a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 >> 172.21.2.135:0/4271054040 conn(0x7fa1c0060840 msgr2=0x7fa1c005ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 shutdown_connections 2021-11-15T14:41:38.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.612+0000 7fa1c6e63700 1 -- 172.21.2.135:0/4271054040 wait complete. 2021-11-15T14:41:38.623 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:41:38.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 Processor -- start 2021-11-15T14:41:38.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 -- start start 2021-11-15T14:41:38.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f1d40148420 0x7f1d400b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1d400a7140 0x7f1d401447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d400b03d0 con 0x7f1d400b1e30 2021-11-15T14:41:38.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400a9140 con 0x7f1d400a7140 2021-11-15T14:41:38.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d44d52700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400b0670 con 0x7f1d40148420 2021-11-15T14:41:38.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d3e59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f1d400b1e30 0x7f1d400b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48366/0 (socket says 172.21.2.135:48366) 2021-11-15T14:41:38.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d3e59c700 1 -- 172.21.2.135:0/4013597244 learned_addr learned my addr 172.21.2.135:0/4013597244 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:38.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/4013597244 >> v2:172.21.2.135:3300/0 conn(0x7f1d40148420 0x7f1d400b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.668+0000 7f1d3d59a700 1 -- 172.21.2.135:0/4013597244 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564983766 0 0) 0x7f1d400b03d0 con 0x7f1d400b1e30 2021-11-15T14:41:38.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3d59a700 1 -- 172.21.2.135:0/4013597244 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d20003260 con 0x7f1d400b1e30 2021-11-15T14:41:38.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/4013597244 >> v2:172.21.2.119:3300/0 conn(0x7f1d400a7140 msgr2=0x7f1d401447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/4013597244 >> v2:172.21.2.119:3300/0 conn(0x7f1d400a7140 0x7f1d401447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/4013597244 >> v1:172.21.2.135:6789/0 conn(0x7f1d400b1e30 legacy=0x7f1d400b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/4013597244 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400b0910 con 0x7f1d40148420 2021-11-15T14:41:38.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/4013597244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d40148420 0x7f1d400b1050 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f1d401477b0 tx=0x7f1d30006df0).ready entity=mon.1 client_cookie=86e1337dba7470ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3d59a700 1 -- 172.21.2.135:0/4013597244 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3000d5c0 con 0x7f1d40148420 2021-11-15T14:41:38.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3d59a700 1 -- 172.21.2.135:0/4013597244 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30000e90 con 0x7f1d40148420 2021-11-15T14:41:38.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3d59a700 1 -- 172.21.2.135:0/4013597244 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3000d910 con 0x7f1d40148420 2021-11-15T14:41:38.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/4013597244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d40148420 msgr2=0x7f1d400b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- 172.21.2.135:0/4013597244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d40148420 0x7f1d400b1050 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f1d401477b0 tx=0x7f1d30006df0).stop 2021-11-15T14:41:38.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/4013597244 shutdown_connections 2021-11-15T14:41:38.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- 172.21.2.135:0/4013597244 >> v2:172.21.2.119:3300/0 conn(0x7f1d400a7140 0x7f1d401447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- 172.21.2.135:0/4013597244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d40148420 0x7f1d400b1050 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/4013597244 >> 172.21.2.135:0/4013597244 conn(0x7f1d4005f730 msgr2=0x7f1d4005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/4013597244 shutdown_connections 2021-11-15T14:41:38.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/4013597244 wait complete. 2021-11-15T14:41:38.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 Processor -- start 2021-11-15T14:41:38.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- start start 2021-11-15T14:41:38.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1d400a7140 0x7f1d400aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1d40148420 0x7f1d40148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400a9fb0 con 0x7f1d40148420 2021-11-15T14:41:38.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4014a510 con 0x7f1d400b1e30 2021-11-15T14:41:38.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400abfc0 con 0x7f1d400a7140 2021-11-15T14:41:38.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60786/0 (socket says 172.21.2.135:60786) 2021-11-15T14:41:38.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/3010898452 learned_addr learned my addr 172.21.2.135:0/3010898452 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1d400a7140 msgr2=0x7f1d400aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1d400a7140 0x7f1d400aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1d40148420 msgr2=0x7f1d40148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1d40148420 0x7f1d40148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 -- 172.21.2.135:0/3010898452 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3000b180 con 0x7f1d400b1e30 2021-11-15T14:41:38.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d3dd9b700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f1d400ab210 tx=0x7f1d30014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d30002f70 con 0x7f1d400b1e30 2021-11-15T14:41:38.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3001e400 con 0x7f1d400b1e30 2021-11-15T14:41:38.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d400ac260 con 0x7f1d400b1e30 2021-11-15T14:41:38.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3001e760 con 0x7f1d400b1e30 2021-11-15T14:41:38.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400aca60 con 0x7f1d400b1e30 2021-11-15T14:41:38.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d400b0bb0 con 0x7f1d400b1e30 2021-11-15T14:41:38.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d3001c070 con 0x7f1d400b1e30 2021-11-15T14:41:38.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 0x7f1d24055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.672+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f1d3006c130 con 0x7f1d400b1e30 2021-11-15T14:41:38.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.676+0000 7f1d3e59c700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 0x7f1d24055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.676+0000 7f1d3e59c700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 0x7f1d24055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1d28001110 tx=0x7f1d280076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.676+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d300434b0 con 0x7f1d400b1e30 2021-11-15T14:41:38.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.760+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1d400573d0 con 0x7f1d400b1e30 2021-11-15T14:41:38.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.760+0000 7f1d377fe700 1 -- 172.21.2.135:0/3010898452 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1d30023020 con 0x7f1d400b1e30 2021-11-15T14:41:38.766 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:38.766 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:41:38.766 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.766 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:41:38.767 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:41:38.767 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:38.767 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:38.767 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:41:38.768 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:41:38.768 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:38.768 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:41:38.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 msgr2=0x7f1d24055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 0x7f1d24055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1d28001110 tx=0x7f1d280076c0).stop 2021-11-15T14:41:38.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 msgr2=0x7f1d4014a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f1d400ab210 tx=0x7f1d30014000).stop 2021-11-15T14:41:38.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 shutdown_connections 2021-11-15T14:41:38.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1d240536a0 0x7f1d24055b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1d40148420 0x7f1d40148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1d400b1e30 0x7f1d4014a750 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 --2- 172.21.2.135:0/3010898452 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1d400a7140 0x7f1d400aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 >> 172.21.2.135:0/3010898452 conn(0x7f1d4005f730 msgr2=0x7f1d401448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 shutdown_connections 2021-11-15T14:41:38.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.764+0000 7f1d44d52700 1 -- 172.21.2.135:0/3010898452 wait complete. 2021-11-15T14:41:38.773 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:41:38.774 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:41:38.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 Processor -- start 2021-11-15T14:41:38.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- start start 2021-11-15T14:41:38.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80b21a0 0x7f3ec80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3ec80ad0b0 0x7f3ec8143c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80ae540 con 0x7f3ec8144120 2021-11-15T14:41:38.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80ae770 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80aea10 con 0x7f3ec80b21a0 2021-11-15T14:41:38.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3eced5a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3ec8144120 0x7f3ec80b0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48380/0 (socket says 172.21.2.135:48380) 2021-11-15T14:41:38.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3eced5a700 1 -- 172.21.2.135:0/3181209061 learned_addr learned my addr 172.21.2.135:0/3181209061 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:38.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/3181209061 >> v2:172.21.2.135:3300/0 conn(0x7f3ec80ad0b0 0x7f3ec8143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 -- 172.21.2.135:0/3181209061 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80b21a0 msgr2=0x7f3ec80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:38.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/3181209061 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80b21a0 0x7f3ec80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 -- 172.21.2.135:0/3181209061 >> v1:172.21.2.135:6789/0 conn(0x7f3ec8144120 legacy=0x7f3ec80b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 -- 172.21.2.135:0/3181209061 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80aecb0 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/3181209061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80ad0b0 0x7f3ec8143c30 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f3eb8002f70 tx=0x7f3eb8006df0).ready entity=mon.1 client_cookie=a47ee54b7c06a03f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecd557700 1 -- 172.21.2.135:0/3181209061 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb800d570 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecd557700 1 -- 172.21.2.135:0/3181209061 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8000e90 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecd557700 1 -- 172.21.2.135:0/3181209061 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb800d8c0 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- 172.21.2.135:0/3181209061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80ad0b0 msgr2=0x7f3ec8143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/3181209061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80ad0b0 0x7f3ec8143c30 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f3eb8002f70 tx=0x7f3eb8006df0).stop 2021-11-15T14:41:38.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- 172.21.2.135:0/3181209061 shutdown_connections 2021-11-15T14:41:38.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/3181209061 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80ad0b0 0x7f3ec8143c30 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:38.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/3181209061 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80b21a0 0x7f3ec80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- 172.21.2.135:0/3181209061 >> 172.21.2.135:0/3181209061 conn(0x7f3ec805f730 msgr2=0x7f3ec805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:38.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- 172.21.2.135:0/3181209061 shutdown_connections 2021-11-15T14:41:38.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- 172.21.2.135:0/3181209061 wait complete. 2021-11-15T14:41:38.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 Processor -- start 2021-11-15T14:41:38.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- start start 2021-11-15T14:41:38.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80ad0b0 0x7f3ec8144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec8144120 0x7f3ec8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8148c80 con 0x7f3ec8144120 2021-11-15T14:41:38.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8144720 con 0x7f3ec80b21a0 2021-11-15T14:41:38.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ed07bd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815af50 con 0x7f3ec80ad0b0 2021-11-15T14:41:38.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60798/0 (socket says 172.21.2.135:60798) 2021-11-15T14:41:38.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.824+0000 7f3ecdd58700 1 -- 172.21.2.135:0/895455492 learned_addr learned my addr 172.21.2.135:0/895455492 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:38.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 -- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80ad0b0 msgr2=0x7f3ec8144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80ad0b0 0x7f3ec8144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 -- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec8144120 msgr2=0x7f3ec8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:38.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec8144120 0x7f3ec8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:38.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 -- 172.21.2.135:0/895455492 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb800b180 con 0x7f3ec80b21a0 2021-11-15T14:41:38.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ecdd58700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f3ec814bfd0 tx=0x7f3eb8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb800d8f0 con 0x7f3ec80b21a0 2021-11-15T14:41:38.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8011ca0 con 0x7f3ec80b21a0 2021-11-15T14:41:38.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb801e460 con 0x7f3ec80b21a0 2021-11-15T14:41:38.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec815b1f0 con 0x7f3ec80b21a0 2021-11-15T14:41:38.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec814bcc0 con 0x7f3ec80b21a0 2021-11-15T14:41:38.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80b2580 con 0x7f3ec80b21a0 2021-11-15T14:41:38.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3eb8025030 con 0x7f3ec80b21a0 2021-11-15T14:41:38.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 0x7f3ea8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:38.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f3eb806cc20 con 0x7f3ec80b21a0 2021-11-15T14:41:38.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ece559700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 0x7f3ea8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:38.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3ece559700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 0x7f3ea8055bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f3ec4002f70 tx=0x7f3ec4006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:38.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3eb8043e50 con 0x7f3ec80b21a0 2021-11-15T14:41:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:38.912+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3ec80573d0 con 0x7f3ec80b21a0 2021-11-15T14:41:39.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3eb77fe700 1 -- 172.21.2.135:0/895455492 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v99) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3eb8023020 con 0x7f3ec80b21a0 2021-11-15T14:41:39.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 msgr2=0x7f3ea8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:39.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 0x7f3ea8055bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f3ec4002f70 tx=0x7f3ec4006a80).stop 2021-11-15T14:41:39.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 msgr2=0x7f3ec814b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:39.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f3ec814bfd0 tx=0x7f3eb8015000).stop 2021-11-15T14:41:39.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 shutdown_connections 2021-11-15T14:41:39.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ea80536f0 0x7f3ea8055bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:39.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ec8144120 0x7f3ec8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:39.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ec80b21a0 0x7f3ec814b0c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:39.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 --2- 172.21.2.135:0/895455492 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ec80ad0b0 0x7f3ec8144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:39.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 >> 172.21.2.135:0/895455492 conn(0x7f3ec805f730 msgr2=0x7f3ec8141820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:39.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 shutdown_connections 2021-11-15T14:41:39.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.828+0000 7f3ed07bd700 1 -- 172.21.2.135:0/895455492 wait complete. 2021-11-15T14:41:39.835 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:41:39.839 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:41:39.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 Processor -- start 2021-11-15T14:41:39.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 -- start start 2021-11-15T14:41:39.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f82280b1350 0x7f82280b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f82280b2320 0x7f82281412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280a7850 con 0x7f82280b1f40 2021-11-15T14:41:39.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82280b17c0 con 0x7f82280b2320 2021-11-15T14:41:39.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f82305d9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82280b06d0 con 0x7f82280b1350 2021-11-15T14:41:39.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f82280b1350 0x7f82280b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:39.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f82280b1350 0x7f82280b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60806/0 (socket says 172.21.2.135:60806) 2021-11-15T14:41:39.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 -- 172.21.2.135:0/3807776638 learned_addr learned my addr 172.21.2.135:0/3807776638 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:39.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 -- 172.21.2.135:0/3807776638 >> v2:172.21.2.119:3300/0 conn(0x7f82280b2320 msgr2=0x7f82281412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:39.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 --2- 172.21.2.135:0/3807776638 >> v2:172.21.2.119:3300/0 conn(0x7f82280b2320 0x7f82281412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:39.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 -- 172.21.2.135:0/3807776638 >> v1:172.21.2.119:6789/0 conn(0x7f82280b1f40 legacy=0x7f82280a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:39.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 -- 172.21.2.135:0/3807776638 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280b0970 con 0x7f82280b1350 2021-11-15T14:41:39.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822db74700 1 --2- 172.21.2.135:0/3807776638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b1350 0x7f82280b0030 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f82280ad350 tx=0x7f8218006eb0).ready entity=mon.1 client_cookie=f853a93d97cd3522 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:39.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822d373700 1 -- 172.21.2.135:0/3807776638 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821800d5c0 con 0x7f82280b1350 2021-11-15T14:41:39.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822d373700 1 -- 172.21.2.135:0/3807776638 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218000e90 con 0x7f82280b1350 2021-11-15T14:41:39.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.888+0000 7f822d373700 1 -- 172.21.2.135:0/3807776638 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821800d910 con 0x7f82280b1350 2021-11-15T14:41:39.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/3807776638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b1350 msgr2=0x7f82280b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:39.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- 172.21.2.135:0/3807776638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b1350 0x7f82280b0030 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f82280ad350 tx=0x7f8218006eb0).stop 2021-11-15T14:41:39.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/3807776638 shutdown_connections 2021-11-15T14:41:39.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- 172.21.2.135:0/3807776638 >> v2:172.21.2.119:3300/0 conn(0x7f82280b2320 0x7f82281412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:39.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- 172.21.2.135:0/3807776638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b1350 0x7f82280b0030 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:39.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/3807776638 >> 172.21.2.135:0/3807776638 conn(0x7f822805f730 msgr2=0x7f822805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:39.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/3807776638 shutdown_connections 2021-11-15T14:41:39.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/3807776638 wait complete. 2021-11-15T14:41:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 Processor -- start 2021-11-15T14:41:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- start start 2021-11-15T14:41:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 0x7f822815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 0x7f82280a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82281427d0 con 0x7f82280b1350 2021-11-15T14:41:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8228142a70 con 0x7f82280b2320 2021-11-15T14:41:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228142d10 con 0x7f82280b1f40 2021-11-15T14:41:39.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:39.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60814/0 (socket says 172.21.2.135:60814) 2021-11-15T14:41:39.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 -- 172.21.2.135:0/768515307 learned_addr learned my addr 172.21.2.135:0/768515307 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:39.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822e375700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 0x7f822815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:39.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822db74700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 0x7f82280a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:39.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 -- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 msgr2=0x7f82280a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:39.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 0x7f82280a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:39.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 -- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 msgr2=0x7f822815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:39.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 0x7f822815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:39.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 -- 172.21.2.135:0/768515307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821800b1e0 con 0x7f82280b2320 2021-11-15T14:41:39.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822db74700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 0x7f82280a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:39.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822e375700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 0x7f822815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:39.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f822eb76700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f82200032f0 tx=0x7f82200091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:39.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822000f510 con 0x7f82280b2320 2021-11-15T14:41:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000f670 con 0x7f82280b2320 2021-11-15T14:41:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8228144b20 con 0x7f82280b2320 2021-11-15T14:41:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822000f7e0 con 0x7f82280b2320 2021-11-15T14:41:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82280abd50 con 0x7f82280b2320 2021-11-15T14:41:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280ac3a0 con 0x7f82280b2320 2021-11-15T14:41:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f822000f070 con 0x7f82280b2320 2021-11-15T14:41:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.892+0000 7f82177fe700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 0x7f8208055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.896+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f822006b520 con 0x7f82280b2320 2021-11-15T14:41:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.896+0000 7f822e375700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 0x7f8208055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:39.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.896+0000 7f822e375700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 0x7f8208055be0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f8224007000 tx=0x7f8224008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:39.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.896+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8220042700 con 0x7f82280b2320 2021-11-15T14:41:39.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:39.980+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f82280573d0 con 0x7f82280b2320 2021-11-15T14:41:40.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.840+0000 7f82177fe700 1 -- 172.21.2.135:0/768515307 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v100) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8220045d20 con 0x7f82280b2320 2021-11-15T14:41:40.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 msgr2=0x7f8208055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 0x7f8208055be0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f8224007000 tx=0x7f8224008040).stop 2021-11-15T14:41:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 msgr2=0x7f82280ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f82200032f0 tx=0x7f82200091a0).stop 2021-11-15T14:41:40.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 shutdown_connections 2021-11-15T14:41:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8208053720 0x7f8208055be0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f82280b2320 0x7f82280ab860 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f82280b1f40 0x7f82280a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 --2- 172.21.2.135:0/768515307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f82280b1350 0x7f822815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 >> 172.21.2.135:0/768515307 conn(0x7f822805f730 msgr2=0x7f8228145100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 shutdown_connections 2021-11-15T14:41:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.844+0000 7f82305d9700 1 -- 172.21.2.135:0/768515307 wait complete. 2021-11-15T14:41:40.850 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:41:40.854 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:41:40.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 Processor -- start 2021-11-15T14:41:40.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- start start 2021-11-15T14:41:40.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 0x7f0ce40ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40b2b70 con 0x7f0ce40b0520 2021-11-15T14:41:40.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40b27f0 con 0x7f0ce40b0900 2021-11-15T14:41:40.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40b2da0 con 0x7f0ce40aa1a0 2021-11-15T14:41:40.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0ce40b0900 0x7f0ce4140620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48408/0 (socket says 172.21.2.135:48408) 2021-11-15T14:41:40.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 -- 172.21.2.135:0/3296461605 learned_addr learned my addr 172.21.2.135:0/3296461605 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:40.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212749634 0 0) 0x7f0ce40b27f0 con 0x7f0ce40b0900 2021-11-15T14:41:40.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd0003260 con 0x7f0ce40b0900 2021-11-15T14:41:40.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce3fff700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 0x7f0ce40ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2777352887 0 0) 0x7f0cd0003260 con 0x7f0ce40b0900 2021-11-15T14:41:40.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 msgr2=0x7f0ce40ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:40.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 0x7f0ce40ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 >> v1:172.21.2.119:6789/0 conn(0x7f0ce40b0520 legacy=0x7f0ce40addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40a9bf0 con 0x7f0ce40b0900 2021-11-15T14:41:40.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0cdc0019e0 con 0x7f0ce40b0900 2021-11-15T14:41:40.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 >> v1:172.21.2.135:6789/0 conn(0x7f0ce40b0900 legacy=0x7f0ce4140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0cd0003750 0x7f0cd0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 0x7f0cd0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0cd0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40b2da0 con 0x7f0cd0003750 2021-11-15T14:41:40.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd000b800 con 0x7f0cd00049f0 2021-11-15T14:41:40.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd000b9c0 con 0x7f0ce40aa1a0 2021-11-15T14:41:40.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0cd0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 -- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 msgr2=0x7f0cd0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:40.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40aa1a0 0x7f0cd0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:40.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 -- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0cd0003750 msgr2=0x7f0cd0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:40.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0cd0003750 0x7f0cd0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:40.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 -- 172.21.2.135:0/3296461605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0003260 con 0x7f0cd00049f0 2021-11-15T14:41:40.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0cd0004e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f0cdc0016f0 tx=0x7f0cdc002190).ready entity=mon.1 client_cookie=ada704442978c6f8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:40.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc00cd10 con 0x7f0cd00049f0 2021-11-15T14:41:40.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00ce70 con 0x7f0cd00049f0 2021-11-15T14:41:40.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce37fe700 1 -- 172.21.2.135:0/3296461605 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cdc005b80 con 0x7f0cd00049f0 2021-11-15T14:41:40.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- 172.21.2.135:0/3296461605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 msgr2=0x7f0cd0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/3296461605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0cd0004e70 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f0cdc0016f0 tx=0x7f0cdc002190).stop 2021-11-15T14:41:40.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ce9544700 1 -- 172.21.2.135:0/3296461605 reap_dead start 2021-11-15T14:41:40.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- 172.21.2.135:0/3296461605 shutdown_connections 2021-11-15T14:41:40.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- 172.21.2.135:0/3296461605 >> 172.21.2.135:0/3296461605 conn(0x7f0ce4060840 msgr2=0x7f0ce4060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:40.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- 172.21.2.135:0/3296461605 shutdown_connections 2021-11-15T14:41:40.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- 172.21.2.135:0/3296461605 wait complete. 2021-11-15T14:41:40.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 Processor -- start 2021-11-15T14:41:40.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.904+0000 7f0ceafa7700 1 -- start start 2021-11-15T14:41:40.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40661a0 0x7f0ce415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 0x7f0ce4120230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4144610 con 0x7f0ce415aaa0 2021-11-15T14:41:40.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4067230 con 0x7f0cd00049f0 2021-11-15T14:41:40.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40674d0 con 0x7f0ce40661a0 2021-11-15T14:41:40.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60832/0 (socket says 172.21.2.135:60832) 2021-11-15T14:41:40.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 -- 172.21.2.135:0/1226442619 learned_addr learned my addr 172.21.2.135:0/1226442619 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:40.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce3fff700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40661a0 0x7f0ce415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce9544700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 0x7f0ce4120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 -- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40661a0 msgr2=0x7f0ce415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40661a0 0x7f0ce415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 -- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 msgr2=0x7f0ce4120230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:40.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 0x7f0ce4120230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:40.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 -- 172.21.2.135:0/1226442619 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4067770 con 0x7f0cd00049f0 2021-11-15T14:41:40.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce9544700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 0x7f0ce4120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:40.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce8d43700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f0ce4067d90 tx=0x7f0cd4007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:40.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd4012400 con 0x7f0cd00049f0 2021-11-15T14:41:40.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4012560 con 0x7f0cd00049f0 2021-11-15T14:41:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4067a10 con 0x7f0cd00049f0 2021-11-15T14:41:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce4159f00 con 0x7f0cd00049f0 2021-11-15T14:41:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cd40128c0 con 0x7f0cd00049f0 2021-11-15T14:41:40.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce40667c0 con 0x7f0cd00049f0 2021-11-15T14:41:40.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cd4010070 con 0x7f0cd00049f0 2021-11-15T14:41:40.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 0x7f0cc4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:40.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f0cd406ac30 con 0x7f0cd00049f0 2021-11-15T14:41:40.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce3fff700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 0x7f0cc4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:40.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.908+0000 7f0ce3fff700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 0x7f0cc4055b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f0cd800c000 tx=0x7f0cd8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:40.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:40.912+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cd4041ba0 con 0x7f0cd00049f0 2021-11-15T14:41:41.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.024+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f0ce4065fa0 con 0x7f0cd00049f0 2021-11-15T14:41:41.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ce1ffb700 1 -- 172.21.2.135:0/1226442619 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v47) v1 ==== 189+0+0 (secure 0 0 0) 0x7f0cd40451c0 con 0x7f0cd00049f0 2021-11-15T14:41:41.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 msgr2=0x7f0cc4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 0x7f0cc4055b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f0cd800c000 tx=0x7f0cd8008040).stop 2021-11-15T14:41:41.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 msgr2=0x7f0ce411e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f0ce4067d90 tx=0x7f0cd4007bd0).stop 2021-11-15T14:41:41.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 shutdown_connections 2021-11-15T14:41:41.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cc4053690 0x7f0cc4055b50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ce415aaa0 0x7f0ce4120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ce40661a0 0x7f0ce415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.036+0000 7f0ceafa7700 1 --2- 172.21.2.135:0/1226442619 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0cd00049f0 0x7f0ce411e5a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.040+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 >> 172.21.2.135:0/1226442619 conn(0x7f0ce4060840 msgr2=0x7f0ce40a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.040+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 shutdown_connections 2021-11-15T14:41:41.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.040+0000 7f0ceafa7700 1 -- 172.21.2.135:0/1226442619 wait complete. 2021-11-15T14:41:41.047 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 17 and data pool 18 2021-11-15T14:41:41.051 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:41.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.104+0000 7f7cb9f44700 1 Processor -- start 2021-11-15T14:41:41.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.104+0000 7f7cb9f44700 1 -- start start 2021-11-15T14:41:41.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7cb4060df0 0x7f7cb40b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7cb40ac670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40acd10 con 0x7f7cb40b6640 2021-11-15T14:41:41.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb40ae5e0 con 0x7f7cb4060df0 2021-11-15T14:41:41.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4144760 con 0x7f7cb4145140 2021-11-15T14:41:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7cb40b6640 0x7f7cb4141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48436/0 (socket says 172.21.2.135:48436) 2021-11-15T14:41:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb37fe700 1 -- 172.21.2.135:0/3098272493 learned_addr learned my addr 172.21.2.135:0/3098272493 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306480048 0 0) 0x7f7cb40acd10 con 0x7f7cb40b6640 2021-11-15T14:41:41.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c94003260 con 0x7f7cb40b6640 2021-11-15T14:41:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511448318 0 0) 0x7f7c94003260 con 0x7f7cb40b6640 2021-11-15T14:41:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 msgr2=0x7f7cb40ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7cb40ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 >> v2:172.21.2.119:3300/0 conn(0x7f7cb4060df0 msgr2=0x7f7cb40b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 --2- 172.21.2.135:0/3098272493 >> v2:172.21.2.119:3300/0 conn(0x7f7cb4060df0 0x7f7cb40b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4144a00 con 0x7f7cb40b6640 2021-11-15T14:41:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7ca4001660 con 0x7f7cb40b6640 2021-11-15T14:41:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 >> v1:172.21.2.135:6789/0 conn(0x7f7cb40b6640 legacy=0x7f7cb4141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c940037d0 0x7f7c94003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7c94004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c94004bf0 0x7f7c9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40ae5e0 con 0x7f7c940037d0 2021-11-15T14:41:41.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4144760 con 0x7f7c94004bf0 2021-11-15T14:41:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94005330 con 0x7f7cb4145140 2021-11-15T14:41:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c94004bf0 0x7f7c9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb37fe700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c940037d0 0x7f7c94003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 -- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 msgr2=0x7f7c94004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb2ffd700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7c94004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7c94004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 -- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c940037d0 msgr2=0x7f7c94003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c940037d0 0x7f7c94003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 -- 172.21.2.135:0/3098272493 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94003260 con 0x7f7c94004bf0 2021-11-15T14:41:41.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb37fe700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c940037d0 0x7f7c94003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:41.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb2ffd700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7cb4145140 0x7f7c94004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:41.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c94004bf0 0x7f7c9400b750 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f7cac0032f0 tx=0x7f7cac006f90).ready entity=mon.1 client_cookie=82ee1f3fb2d4d8b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac00b460 con 0x7f7c94004bf0 2021-11-15T14:41:41.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b5c0 con 0x7f7c94004bf0 2021-11-15T14:41:41.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb27fc700 1 -- 172.21.2.135:0/3098272493 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac00b920 con 0x7f7c94004bf0 2021-11-15T14:41:41.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- 172.21.2.135:0/3098272493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c94004bf0 msgr2=0x7f7c9400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/3098272493 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c94004bf0 0x7f7c9400b750 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f7cac0032f0 tx=0x7f7cac006f90).stop 2021-11-15T14:41:41.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 -- 172.21.2.135:0/3098272493 reap_dead start 2021-11-15T14:41:41.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- 172.21.2.135:0/3098272493 shutdown_connections 2021-11-15T14:41:41.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- 172.21.2.135:0/3098272493 >> 172.21.2.135:0/3098272493 conn(0x7f7cb40b3500 msgr2=0x7f7cb40b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- 172.21.2.135:0/3098272493 shutdown_connections 2021-11-15T14:41:41.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- 172.21.2.135:0/3098272493 wait complete. 2021-11-15T14:41:41.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 Processor -- start 2021-11-15T14:41:41.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- start start 2021-11-15T14:41:41.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c94004bf0 0x7f7cb4143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cb4135e30 0x7f7cb40630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4066740 con 0x7f7cb4135e30 2021-11-15T14:41:41.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4066970 con 0x7f7cb40635a0 2021-11-15T14:41:41.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb9f44700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4066c10 con 0x7f7c94004bf0 2021-11-15T14:41:41.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60864/0 (socket says 172.21.2.135:60864) 2021-11-15T14:41:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.108+0000 7f7cb3fff700 1 -- 172.21.2.135:0/2264431031 learned_addr learned my addr 172.21.2.135:0/2264431031 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 -- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c94004bf0 msgr2=0x7f7cb4143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c94004bf0 0x7f7cb4143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 -- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cb4135e30 msgr2=0x7f7cb40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cb4135e30 0x7f7cb40630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 -- 172.21.2.135:0/2264431031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4066eb0 con 0x7f7cb40635a0 2021-11-15T14:41:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb3fff700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f7cb40665f0 tx=0x7f7cac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac011800 con 0x7f7cb40635a0 2021-11-15T14:41:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac011960 con 0x7f7cb40635a0 2021-11-15T14:41:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb40673a0 con 0x7f7cb40635a0 2021-11-15T14:41:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac011cc0 con 0x7f7cb40635a0 2021-11-15T14:41:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb4143d50 con 0x7f7cb40635a0 2021-11-15T14:41:41.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb4067040 con 0x7f7cb40635a0 2021-11-15T14:41:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7cac00f070 con 0x7f7cb40635a0 2021-11-15T14:41:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 0x7f7c98055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7cac06d1d0 con 0x7f7cb40635a0 2021-11-15T14:41:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb37fe700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 0x7f7c98055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb37fe700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 0x7f7c98055b20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f7ca4008000 tx=0x7f7ca4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.112+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7cac0440d0 con 0x7f7cb40635a0 2021-11-15T14:41:41.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb4144ca0 con 0x7f7cb40635a0 2021-11-15T14:41:41.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb0ff9700 1 -- 172.21.2.135:0/2264431031 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16296 (secure 0 0 0) 0x7f7cac0476f0 con 0x7f7cb40635a0 2021-11-15T14:41:41.204 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:41.205 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":101,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:41.027416+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:38.935483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:40.012670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:41.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 msgr2=0x7f7c98055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 0x7f7c98055b20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f7ca4008000 tx=0x7f7ca4009040).stop 2021-11-15T14:41:41.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 msgr2=0x7f7cb4063a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f7cb40665f0 tx=0x7f7cac016000).stop 2021-11-15T14:41:41.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 shutdown_connections 2021-11-15T14:41:41.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c98053660 0x7f7c98055b20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7cb40635a0 0x7f7cb4063a20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7cb4135e30 0x7f7cb40630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 --2- 172.21.2.135:0/2264431031 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c94004bf0 0x7f7cb4143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 >> 172.21.2.135:0/2264431031 conn(0x7f7cb40b3500 msgr2=0x7f7cb4142480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 shutdown_connections 2021-11-15T14:41:41.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.200+0000 7f7cb9f44700 1 -- 172.21.2.135:0/2264431031 wait complete. 2021-11-15T14:41:41.212 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:41.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 Processor -- start 2021-11-15T14:41:41.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 -- start start 2021-11-15T14:41:41.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc9640b4440 0x7fc9640b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 0x7fc96412ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc964144130 con 0x7fc9640b6600 2021-11-15T14:41:41.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc964143bf0 con 0x7fc9640b4440 2021-11-15T14:41:41.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc969728700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964143e90 con 0x7fc9640b69e0 2021-11-15T14:41:41.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc9640b4440 0x7fc9640b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9637fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 0x7fc96412ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9637fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 0x7fc96412ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:42416/0 (socket says 172.21.2.135:42416) 2021-11-15T14:41:41.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9637fe700 1 -- 172.21.2.135:0/2465129332 learned_addr learned my addr 172.21.2.135:0/2465129332 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:41.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc9640b4440 0x7fc9640b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:54684/0 (socket says 172.21.2.135:54684) 2021-11-15T14:41:41.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 -- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 msgr2=0x7fc96412ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 --2- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 0x7fc96412ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 -- 172.21.2.135:0/2465129332 >> v1:172.21.2.119:6789/0 conn(0x7fc9640b6600 legacy=0x7fc964061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.268+0000 7fc9627fc700 1 -- 172.21.2.135:0/2465129332 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964061670 con 0x7fc9640b4440 2021-11-15T14:41:41.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc9627fc700 1 --2- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b4440 0x7fc9640b5c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc9641431a0 tx=0x7fc954006df0).ready entity=mon.0 client_cookie=966f95b615dfce76 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc961ffb700 1 -- 172.21.2.135:0/2465129332 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400d570 con 0x7fc9640b4440 2021-11-15T14:41:41.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc961ffb700 1 -- 172.21.2.135:0/2465129332 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954000e90 con 0x7fc9640b4440 2021-11-15T14:41:41.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc961ffb700 1 -- 172.21.2.135:0/2465129332 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400d8c0 con 0x7fc9640b4440 2021-11-15T14:41:41.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b4440 msgr2=0x7fc9640b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b4440 0x7fc9640b5c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc9641431a0 tx=0x7fc954006df0).stop 2021-11-15T14:41:41.277 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2465129332 shutdown_connections 2021-11-15T14:41:41.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b69e0 0x7fc96412ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- 172.21.2.135:0/2465129332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b4440 0x7fc9640b5c70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2465129332 >> 172.21.2.135:0/2465129332 conn(0x7fc96405c510 msgr2=0x7fc96405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2465129332 shutdown_connections 2021-11-15T14:41:41.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2465129332 wait complete. 2021-11-15T14:41:41.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 Processor -- start 2021-11-15T14:41:41.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- start start 2021-11-15T14:41:41.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b6600 0x7fc9640b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b69e0 0x7fc9640b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96412ac90 con 0x7fc9640b69e0 2021-11-15T14:41:41.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96412aec0 con 0x7fc9640b4440 2021-11-15T14:41:41.282 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96412b160 con 0x7fc9640b6600 2021-11-15T14:41:41.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60876/0 (socket says 172.21.2.135:60876) 2021-11-15T14:41:41.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 -- 172.21.2.135:0/2342954411 learned_addr learned my addr 172.21.2.135:0/2342954411 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:41.283 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc9637fe700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b69e0 0x7fc9640b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 -- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b6600 msgr2=0x7fc9640b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b6600 0x7fc9640b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 -- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b69e0 msgr2=0x7fc9640b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b69e0 0x7fc9640b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.284 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 -- 172.21.2.135:0/2342954411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95400b180 con 0x7fc9640b4440 2021-11-15T14:41:41.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc962ffd700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fc96412b430 tx=0x7fc94c007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94c00ce20 con 0x7fc9640b4440 2021-11-15T14:41:41.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c00f470 con 0x7fc9640b4440 2021-11-15T14:41:41.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640b0490 con 0x7fc9640b4440 2021-11-15T14:41:41.285 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc964148330 con 0x7fc9640b4440 2021-11-15T14:41:41.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.272+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94c00f7d0 con 0x7fc9640b4440 2021-11-15T14:41:41.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc964061910 con 0x7fc9640b4440 2021-11-15T14:41:41.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc94c019030 con 0x7fc9640b4440 2021-11-15T14:41:41.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc95bfff700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 0x7fc948055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc94c06af20 con 0x7fc9640b4440 2021-11-15T14:41:41.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc9627fc700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 0x7fc948055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc9627fc700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 0x7fc948055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9641431a0 tx=0x7fc954014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.276+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc94c041dc0 con 0x7fc9640b4440 2021-11-15T14:41:41.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.360+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9640573d0 con 0x7fc9640b4440 2021-11-15T14:41:41.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.360+0000 7fc95bfff700 1 -- 172.21.2.135:0/2342954411 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16296 (secure 0 0 0) 0x7fc94c0453e0 con 0x7fc9640b4440 2021-11-15T14:41:41.366 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:41.366 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":101,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:41.027416+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:38.935483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:40.012670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:41.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 msgr2=0x7fc948055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 0x7fc948055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9641431a0 tx=0x7fc954014000).stop 2021-11-15T14:41:41.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 msgr2=0x7fc96412a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fc96412b430 tx=0x7fc94c007c50).stop 2021-11-15T14:41:41.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 shutdown_connections 2021-11-15T14:41:41.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc9480536f0 0x7fc948055bb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc9640b69e0 0x7fc9640b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc9640b6600 0x7fc9640b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 --2- 172.21.2.135:0/2342954411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc9640b4440 0x7fc96412a2f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 >> 172.21.2.135:0/2342954411 conn(0x7fc96405c510 msgr2=0x7fc9641420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 shutdown_connections 2021-11-15T14:41:41.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.364+0000 7fc969728700 1 -- 172.21.2.135:0/2342954411 wait complete. 2021-11-15T14:41:41.373 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:41:41.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 Processor -- start 2021-11-15T14:41:41.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- start start 2021-11-15T14:41:41.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b1f40 0x7f3f0c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3f0c0b0030 0x7f3f0c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3f0c0a7140 0x7f3f0c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b2810 con 0x7f3f0c0a7140 2021-11-15T14:41:41.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b0470 con 0x7f3f0c0b0030 2021-11-15T14:41:41.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b06d0 con 0x7f3f0c0b1f40 2021-11-15T14:41:41.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3f0c0b0030 0x7f3f0c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3f0c0b0030 0x7f3f0c0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60886/0 (socket says 172.21.2.135:60886) 2021-11-15T14:41:41.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 -- 172.21.2.135:0/2856823687 learned_addr learned my addr 172.21.2.135:0/2856823687 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:41.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 -- 172.21.2.135:0/2856823687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b1f40 msgr2=0x7f3f0c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 --2- 172.21.2.135:0/2856823687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b1f40 0x7f3f0c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 -- 172.21.2.135:0/2856823687 >> v2:172.21.2.119:3300/0 conn(0x7f3f0c0a7140 msgr2=0x7f3f0c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:41.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 --2- 172.21.2.135:0/2856823687 >> v2:172.21.2.119:3300/0 conn(0x7f3f0c0a7140 0x7f3f0c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 -- 172.21.2.135:0/2856823687 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0b0970 con 0x7f3f0c0b0030 2021-11-15T14:41:41.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0b7fe700 1 --2- 172.21.2.135:0/2856823687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0b0030 0x7f3f0c0b2320 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f3efc002f70 tx=0x7f3efc006eb0).ready entity=mon.1 client_cookie=f0663e31cf659ae server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0affd700 1 -- 172.21.2.135:0/2856823687 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3efc00d570 con 0x7f3f0c0b0030 2021-11-15T14:41:41.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0affd700 1 -- 172.21.2.135:0/2856823687 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc000e90 con 0x7f3f0c0b0030 2021-11-15T14:41:41.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f0affd700 1 -- 172.21.2.135:0/2856823687 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3efc00d900 con 0x7f3f0c0b0030 2021-11-15T14:41:41.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- 172.21.2.135:0/2856823687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0b0030 msgr2=0x7f3f0c0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- 172.21.2.135:0/2856823687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0b0030 0x7f3f0c0b2320 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f3efc002f70 tx=0x7f3efc006eb0).stop 2021-11-15T14:41:41.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- 172.21.2.135:0/2856823687 shutdown_connections 2021-11-15T14:41:41.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- 172.21.2.135:0/2856823687 >> v2:172.21.2.119:3300/0 conn(0x7f3f0c0a7140 0x7f3f0c1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- 172.21.2.135:0/2856823687 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0b0030 0x7f3f0c0b2320 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:41.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 --2- 172.21.2.135:0/2856823687 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b1f40 0x7f3f0c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- 172.21.2.135:0/2856823687 >> 172.21.2.135:0/2856823687 conn(0x7f3f0c05f730 msgr2=0x7f3f0c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:41.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- 172.21.2.135:0/2856823687 shutdown_connections 2021-11-15T14:41:41.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.432+0000 7f3f12764700 1 -- 172.21.2.135:0/2856823687 wait complete. 2021-11-15T14:41:41.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 Processor -- start 2021-11-15T14:41:41.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- start start 2021-11-15T14:41:41.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b0030 0x7f3f0c13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f0c0b1f40 0x7f3f0c0a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b4490 con 0x7f3f0c0b1f40 2021-11-15T14:41:41.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b53d0 con 0x7f3f0c0a7140 2021-11-15T14:41:41.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b4c30 con 0x7f3f0c0b0030 2021-11-15T14:41:41.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60888/0 (socket says 172.21.2.135:60888) 2021-11-15T14:41:41.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 -- 172.21.2.135:0/3060583356 learned_addr learned my addr 172.21.2.135:0/3060583356 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:41.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 -- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b0030 msgr2=0x7f3f0c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b0030 0x7f3f0c13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 -- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f0c0b1f40 msgr2=0x7f3f0c0a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:41.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f0c0b1f40 0x7f3f0c0a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:41.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 -- 172.21.2.135:0/3060583356 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc00b1e0 con 0x7f3f0c0a7140 2021-11-15T14:41:41.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f0bfff700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f3f0c0ab330 tx=0x7f3ef4006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef400e470 con 0x7f3f0c0a7140 2021-11-15T14:41:41.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400e5d0 con 0x7f3f0c0a7140 2021-11-15T14:41:41.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0b5130 con 0x7f3f0c0a7140 2021-11-15T14:41:41.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef400e930 con 0x7f3f0c0a7140 2021-11-15T14:41:41.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c140940 con 0x7f3f0c0a7140 2021-11-15T14:41:41.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0b4180 con 0x7f3f0c0a7140 2021-11-15T14:41:41.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ef4018030 con 0x7f3f0c0a7140 2021-11-15T14:41:41.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 0x7f3ef0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:41.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.436+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3ef406aeb0 con 0x7f3f0c0a7140 2021-11-15T14:41:41.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.440+0000 7f3f0b7fe700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 0x7f3ef0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:41.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.440+0000 7f3f0b7fe700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 0x7f3ef0055ad0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3efc002f70 tx=0x7f3efc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:41.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.440+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ef4041f10 con 0x7f3f0c0a7140 2021-11-15T14:41:41.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:41.548+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3f0c0b0c10 con 0x7f3f0c0a7140 2021-11-15T14:41:42.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f097fa700 1 -- 172.21.2.135:0/3060583356 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3ef4045530 con 0x7f3f0c0a7140 2021-11-15T14:41:42.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 msgr2=0x7f3ef0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 0x7f3ef0055ad0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3efc002f70 tx=0x7f3efc015000).stop 2021-11-15T14:41:42.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 msgr2=0x7f3f0c0abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f3f0c0ab330 tx=0x7f3ef4006db0).stop 2021-11-15T14:41:42.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 shutdown_connections 2021-11-15T14:41:42.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ef0053610 0x7f3ef0055ad0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3f0c0b1f40 0x7f3f0c0a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3f0c0b0030 0x7f3f0c13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 --2- 172.21.2.135:0/3060583356 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3f0c0a7140 0x7f3f0c0abe60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 >> 172.21.2.135:0/3060583356 conn(0x7f3f0c05f730 msgr2=0x7f3f0c13e470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 shutdown_connections 2021-11-15T14:41:42.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.040+0000 7f3f12764700 1 -- 172.21.2.135:0/3060583356 wait complete. 2021-11-15T14:41:42.052 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:42.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 Processor -- start 2021-11-15T14:41:42.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- start start 2021-11-15T14:41:42.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f90a80b1e30 0x7f90a80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8148420 0x7f90a80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a80b03d0 con 0x7f90a80a7140 2021-11-15T14:41:42.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80a9140 con 0x7f90a80b1e30 2021-11-15T14:41:42.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80b0670 con 0x7f90a8148420 2021-11-15T14:41:42.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a6d9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f90a80a7140 0x7f90a81447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48486/0 (socket says 172.21.2.135:48486) 2021-11-15T14:41:42.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a6d9d700 1 -- 172.21.2.135:0/2846860253 learned_addr learned my addr 172.21.2.135:0/2846860253 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:42.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 --2- 172.21.2.135:0/2846860253 >> v2:172.21.2.135:3300/0 conn(0x7f90a80b1e30 0x7f90a80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 -- 172.21.2.135:0/2846860253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8148420 msgr2=0x7f90a80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 --2- 172.21.2.135:0/2846860253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8148420 0x7f90a80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 -- 172.21.2.135:0/2846860253 >> v1:172.21.2.135:6789/0 conn(0x7f90a80a7140 legacy=0x7f90a81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 -- 172.21.2.135:0/2846860253 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80b0910 con 0x7f90a80b1e30 2021-11-15T14:41:42.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a659c700 1 --2- 172.21.2.135:0/2846860253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a80b1050 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f9098002f70 tx=0x7f9098006df0).ready entity=mon.1 client_cookie=1aecabcde45470d1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a559a700 1 -- 172.21.2.135:0/2846860253 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909800d570 con 0x7f90a80b1e30 2021-11-15T14:41:42.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a559a700 1 -- 172.21.2.135:0/2846860253 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9098000e90 con 0x7f90a80b1e30 2021-11-15T14:41:42.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90a559a700 1 -- 172.21.2.135:0/2846860253 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909800d8c0 con 0x7f90a80b1e30 2021-11-15T14:41:42.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- 172.21.2.135:0/2846860253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 msgr2=0x7f90a80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/2846860253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a80b1050 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f9098002f70 tx=0x7f9098006df0).stop 2021-11-15T14:41:42.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- 172.21.2.135:0/2846860253 shutdown_connections 2021-11-15T14:41:42.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/2846860253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8148420 0x7f90a80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/2846860253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a80b1050 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- 172.21.2.135:0/2846860253 >> 172.21.2.135:0/2846860253 conn(0x7f90a805f730 msgr2=0x7f90a805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- 172.21.2.135:0/2846860253 shutdown_connections 2021-11-15T14:41:42.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.116+0000 7f90ac9ff700 1 -- 172.21.2.135:0/2846860253 wait complete. 2021-11-15T14:41:42.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 Processor -- start 2021-11-15T14:41:42.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- start start 2021-11-15T14:41:42.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80a7140 0x7f90a8144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 0x7f90a813de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8142370 con 0x7f90a8148420 2021-11-15T14:41:42.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8149720 con 0x7f90a80b1e30 2021-11-15T14:41:42.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81499c0 con 0x7f90a80a7140 2021-11-15T14:41:42.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60904/0 (socket says 172.21.2.135:60904) 2021-11-15T14:41:42.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 -- 172.21.2.135:0/1202480194 learned_addr learned my addr 172.21.2.135:0/1202480194 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 -- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80a7140 msgr2=0x7f90a8144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a659c700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80a7140 0x7f90a8144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a6d9d700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 0x7f90a813de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80a7140 0x7f90a8144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 -- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 msgr2=0x7f90a813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 0x7f90a813de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 -- 172.21.2.135:0/1202480194 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909800b180 con 0x7f90a80b1e30 2021-11-15T14:41:42.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a6d9d700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 0x7f90a813de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:42.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a5d9b700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f90a8142610 tx=0x7f909c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909c013460 con 0x7f90a80b1e30 2021-11-15T14:41:42.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c0135c0 con 0x7f90a80b1e30 2021-11-15T14:41:42.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8149c60 con 0x7f90a80b1e30 2021-11-15T14:41:42.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a813e320 con 0x7f90a80b1e30 2021-11-15T14:41:42.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f909c013920 con 0x7f90a80b1e30 2021-11-15T14:41:42.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a8143d00 con 0x7f90a80b1e30 2021-11-15T14:41:42.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f909c01a060 con 0x7f90a80b1e30 2021-11-15T14:41:42.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 0x7f9084055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f909c06b510 con 0x7f90a80b1e30 2021-11-15T14:41:42.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.120+0000 7f90a659c700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 0x7f9084055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.124+0000 7f90a659c700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 0x7f9084055b20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f9098017000 tx=0x7f9098015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.124+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f909c042410 con 0x7f90a80b1e30 2021-11-15T14:41:42.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.236+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90a80b0bb0 con 0x7f90a80b1e30 2021-11-15T14:41:42.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.236+0000 7f90977fe700 1 -- 172.21.2.135:0/1202480194 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f909c018020 con 0x7f90a80b1e30 2021-11-15T14:41:42.242 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:42.242 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:42.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 msgr2=0x7f9084055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 0x7f9084055b20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f9098017000 tx=0x7f9098015000).stop 2021-11-15T14:41:42.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 msgr2=0x7f90a813d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f90a8142610 tx=0x7f909c006df0).stop 2021-11-15T14:41:42.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 shutdown_connections 2021-11-15T14:41:42.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9084053660 0x7f9084055b20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a8148420 0x7f90a813de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f90a80b1e30 0x7f90a813d940 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 --2- 172.21.2.135:0/1202480194 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80a7140 0x7f90a8144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 >> 172.21.2.135:0/1202480194 conn(0x7f90a805f730 msgr2=0x7f90a80aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 shutdown_connections 2021-11-15T14:41:42.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.240+0000 7f90ac9ff700 1 -- 172.21.2.135:0/1202480194 wait complete. 2021-11-15T14:41:42.246 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:42.249 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:42.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 Processor -- start 2021-11-15T14:41:42.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- start start 2021-11-15T14:41:42.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb9b00b1e30 0x7fb9b00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb9b00a7140 0x7fb9b01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b00b03d0 con 0x7fb9b0148420 2021-11-15T14:41:42.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b00a9140 con 0x7fb9b00b1e30 2021-11-15T14:41:42.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b00b0670 con 0x7fb9b00a7140 2021-11-15T14:41:42.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b4fd7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb9b0148420 0x7fb9b00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48498/0 (socket says 172.21.2.135:48498) 2021-11-15T14:41:42.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b4fd7700 1 -- 172.21.2.135:0/1627728803 learned_addr learned my addr 172.21.2.135:0/1627728803 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:42.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 --2- 172.21.2.135:0/1627728803 >> v2:172.21.2.135:3300/0 conn(0x7fb9b00a7140 0x7fb9b01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9a3fff700 1 -- 172.21.2.135:0/1627728803 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672305264 0 0) 0x7fb9b00b03d0 con 0x7fb9b0148420 2021-11-15T14:41:42.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 -- 172.21.2.135:0/1627728803 >> v2:172.21.2.119:3300/0 conn(0x7fb9b00b1e30 msgr2=0x7fb9b00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 --2- 172.21.2.135:0/1627728803 >> v2:172.21.2.119:3300/0 conn(0x7fb9b00b1e30 0x7fb9b00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 -- 172.21.2.135:0/1627728803 >> v1:172.21.2.135:6789/0 conn(0x7fb9b0148420 legacy=0x7fb9b00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 -- 172.21.2.135:0/1627728803 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00b0910 con 0x7fb9b00a7140 2021-11-15T14:41:42.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b5fd9700 1 --2- 172.21.2.135:0/1627728803 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00a7140 0x7fb9b01447a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fb9b01477b0 tx=0x7fb9a80091d0).ready entity=mon.1 client_cookie=cf4fe6a4d0227fd6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9a3fff700 1 -- 172.21.2.135:0/1627728803 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a8009ea0 con 0x7fb9b00a7140 2021-11-15T14:41:42.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9a3fff700 1 -- 172.21.2.135:0/1627728803 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a800b860 con 0x7fb9b00a7140 2021-11-15T14:41:42.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9a3fff700 1 -- 172.21.2.135:0/1627728803 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a800b9d0 con 0x7fb9b00a7140 2021-11-15T14:41:42.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/1627728803 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00a7140 msgr2=0x7fb9b01447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/1627728803 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00a7140 0x7fb9b01447a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fb9b01477b0 tx=0x7fb9a80091d0).stop 2021-11-15T14:41:42.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/1627728803 shutdown_connections 2021-11-15T14:41:42.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/1627728803 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00a7140 0x7fb9b01447a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/1627728803 >> v2:172.21.2.119:3300/0 conn(0x7fb9b00b1e30 0x7fb9b00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/1627728803 >> 172.21.2.135:0/1627728803 conn(0x7fb9b005f730 msgr2=0x7fb9b005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/1627728803 shutdown_connections 2021-11-15T14:41:42.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/1627728803 wait complete. 2021-11-15T14:41:42.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 Processor -- start 2021-11-15T14:41:42.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.308+0000 7fb9b7a3c700 1 -- start start 2021-11-15T14:41:42.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9b00a7140 0x7fb9b00aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9b0148420 0x7fb9b014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01578c0 con 0x7fb9b0148420 2021-11-15T14:41:42.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00aa940 con 0x7fb9b00b1e30 2021-11-15T14:41:42.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0157620 con 0x7fb9b00a7140 2021-11-15T14:41:42.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60920/0 (socket says 172.21.2.135:60920) 2021-11-15T14:41:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 -- 172.21.2.135:0/125576815 learned_addr learned my addr 172.21.2.135:0/125576815 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 -- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9b00a7140 msgr2=0x7fb9b00aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9b00a7140 0x7fb9b00aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 -- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9b0148420 msgr2=0x7fb9b014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9b0148420 0x7fb9b014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 -- 172.21.2.135:0/125576815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009470 con 0x7fb9b00b1e30 2021-11-15T14:41:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b4fd7700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fb9ac000bc0 tx=0x7fb9ac007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9ac001d50 con 0x7fb9b00b1e30 2021-11-15T14:41:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0072e0 con 0x7fb9b00b1e30 2021-11-15T14:41:42.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9ac005800 con 0x7fb9b00b1e30 2021-11-15T14:41:42.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b014a160 con 0x7fb9b00b1e30 2021-11-15T14:41:42.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b0157340 con 0x7fb9b00b1e30 2021-11-15T14:41:42.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b00b0bb0 con 0x7fb9b00b1e30 2021-11-15T14:41:42.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9ac01a060 con 0x7fb9b00b1e30 2021-11-15T14:41:42.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 0x7fb990055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb9ac06b290 con 0x7fb9b00b1e30 2021-11-15T14:41:42.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.312+0000 7fb9b57d8700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 0x7fb990055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.316+0000 7fb9b57d8700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 0x7fb990055ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fb9a4002f70 tx=0x7fb9a4006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.316+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9ac042190 con 0x7fb9b00b1e30 2021-11-15T14:41:42.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9b00573d0 con 0x7fb9b00b1e30 2021-11-15T14:41:42.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9a27fc700 1 -- 172.21.2.135:0/125576815 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16283 (secure 0 0 0) 0x7fb9ac018070 con 0x7fb9b00b1e30 2021-11-15T14:41:42.403 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:42.403 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":102,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:42.033690+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:38.935483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:40.012670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:42.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 msgr2=0x7fb990055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 0x7fb990055ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fb9a4002f70 tx=0x7fb9a4006a80).stop 2021-11-15T14:41:42.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 msgr2=0x7fb9b0149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fb9ac000bc0 tx=0x7fb9ac007c60).stop 2021-11-15T14:41:42.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 shutdown_connections 2021-11-15T14:41:42.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb990053600 0x7fb990055ac0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb9b0148420 0x7fb9b014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb9b00b1e30 0x7fb9b0149820 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 --2- 172.21.2.135:0/125576815 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb9b00a7140 0x7fb9b00aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 >> 172.21.2.135:0/125576815 conn(0x7fb9b005f730 msgr2=0x7fb9b0144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 shutdown_connections 2021-11-15T14:41:42.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.400+0000 7fb9b7a3c700 1 -- 172.21.2.135:0/125576815 wait complete. 2021-11-15T14:41:42.411 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:41:42.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 Processor -- start 2021-11-15T14:41:42.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- start start 2021-11-15T14:41:42.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81480b1e30 0x7f81480b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f81480a7140 0x7f81481447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480b03d0 con 0x7f8148148420 2021-11-15T14:41:42.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480a9140 con 0x7f81480a7140 2021-11-15T14:41:42.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480b0670 con 0x7f81480b1e30 2021-11-15T14:41:42.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f81480a7140 0x7f81481447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f81480a7140 0x7f81481447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60926/0 (socket says 172.21.2.135:60926) 2021-11-15T14:41:42.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 -- 172.21.2.135:0/121095953 learned_addr learned my addr 172.21.2.135:0/121095953 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 -- 172.21.2.135:0/121095953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81480b1e30 msgr2=0x7f81480b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 --2- 172.21.2.135:0/121095953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81480b1e30 0x7f81480b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 -- 172.21.2.135:0/121095953 >> v1:172.21.2.119:6789/0 conn(0x7f8148148420 legacy=0x7f81480b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 -- 172.21.2.135:0/121095953 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480b0910 con 0x7f81480a7140 2021-11-15T14:41:42.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814e603700 1 --2- 172.21.2.135:0/121095953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480a7140 0x7f81481447a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f8148061420 tx=0x7f8140009290).ready entity=mon.1 client_cookie=ffc56f35f6fea01a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814ce00700 1 -- 172.21.2.135:0/121095953 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814000b860 con 0x7f81480a7140 2021-11-15T14:41:42.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814ce00700 1 -- 172.21.2.135:0/121095953 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000b9c0 con 0x7f81480a7140 2021-11-15T14:41:42.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f814ce00700 1 -- 172.21.2.135:0/121095953 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814000bb70 con 0x7f81480a7140 2021-11-15T14:41:42.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- 172.21.2.135:0/121095953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480a7140 msgr2=0x7f81481447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 --2- 172.21.2.135:0/121095953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480a7140 0x7f81481447a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f8148061420 tx=0x7f8140009290).stop 2021-11-15T14:41:42.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- 172.21.2.135:0/121095953 shutdown_connections 2021-11-15T14:41:42.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 --2- 172.21.2.135:0/121095953 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480a7140 0x7f81481447a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 --2- 172.21.2.135:0/121095953 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81480b1e30 0x7f81480b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- 172.21.2.135:0/121095953 >> 172.21.2.135:0/121095953 conn(0x7f814805f730 msgr2=0x7f814805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- 172.21.2.135:0/121095953 shutdown_connections 2021-11-15T14:41:42.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.464+0000 7f8150066700 1 -- 172.21.2.135:0/121095953 wait complete. 2021-11-15T14:41:42.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 Processor -- start 2021-11-15T14:41:42.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- start start 2021-11-15T14:41:42.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81480a7140 0x7f8148144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 0x7f8148149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814a2e0 con 0x7f81480a7140 2021-11-15T14:41:42.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480ac920 con 0x7f81480b1e30 2021-11-15T14:41:42.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480b38a0 con 0x7f8148148420 2021-11-15T14:41:42.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60934/0 (socket says 172.21.2.135:60934) 2021-11-15T14:41:42.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 -- 172.21.2.135:0/3876321793 learned_addr learned my addr 172.21.2.135:0/3876321793 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814e603700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 0x7f8148149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814de02700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81480a7140 0x7f8148144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 -- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 msgr2=0x7f8148149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 0x7f8148149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 -- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81480a7140 msgr2=0x7f8148144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81480a7140 0x7f8148144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 -- 172.21.2.135:0/3876321793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009530 con 0x7f81480b1e30 2021-11-15T14:41:42.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814e603700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 0x7f8148149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:42.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814d601700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f813c002f10 tx=0x7f813c006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813c009e00 con 0x7f81480b1e30 2021-11-15T14:41:42.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c00f510 con 0x7f81480b1e30 2021-11-15T14:41:42.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81480b3b40 con 0x7f81480b1e30 2021-11-15T14:41:42.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814813f0b0 con 0x7f81480b1e30 2021-11-15T14:41:42.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813c00f680 con 0x7f81480b1e30 2021-11-15T14:41:42.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480b36e0 con 0x7f81480b1e30 2021-11-15T14:41:42.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f813c00f070 con 0x7f81480b1e30 2021-11-15T14:41:42.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 0x7f8128055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f813c06b3e0 con 0x7f81480b1e30 2021-11-15T14:41:42.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.468+0000 7f814de02700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 0x7f8128055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.472+0000 7f814de02700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 0x7f8128055a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8144007000 tx=0x7f8144008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.472+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f813c0422e0 con 0x7f81480b1e30 2021-11-15T14:41:42.490 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:42.498 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:42.504 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:42.507 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:41:42.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.580+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f81480acab0 con 0x7f81480b1e30 2021-11-15T14:41:42.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f813affd700 1 -- 172.21.2.135:0/3876321793 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f813c045900 con 0x7f81480b1e30 2021-11-15T14:41:42.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 msgr2=0x7f8128055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 0x7f8128055a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8144007000 tx=0x7f8144008040).stop 2021-11-15T14:41:42.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 msgr2=0x7f8148148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f813c002f10 tx=0x7f813c006d60).stop 2021-11-15T14:41:42.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 shutdown_connections 2021-11-15T14:41:42.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f81280535d0 0x7f8128055a90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8148148420 0x7f8148149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81480b1e30 0x7f8148148b80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 --2- 172.21.2.135:0/3876321793 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81480a7140 0x7f8148144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 >> 172.21.2.135:0/3876321793 conn(0x7f814805f730 msgr2=0x7f81480ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 shutdown_connections 2021-11-15T14:41:42.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.596+0000 7f8150066700 1 -- 172.21.2.135:0/3876321793 wait complete. 2021-11-15T14:41:42.605 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:41:42.607 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:41:42.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.660+0000 7f95c3fbe700 1 Processor -- start 2021-11-15T14:41:42.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.660+0000 7f95c3fbe700 1 -- start start 2021-11-15T14:41:42.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95bc0ad0b0 0x7f95bc144060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc067450 con 0x7f95bc0b0760 2021-11-15T14:41:42.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0b0050 con 0x7f95bc067070 2021-11-15T14:41:42.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0b02f0 con 0x7f95bc0ad0b0 2021-11-15T14:41:42.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c1d5a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f95bc067070 0x7f95bc143950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48526/0 (socket says 172.21.2.135:48526) 2021-11-15T14:41:42.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c1d5a700 1 -- 172.21.2.135:0/3226690599 learned_addr learned my addr 172.21.2.135:0/3226690599 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:42.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090543750 0 0) 0x7f95bc0b0050 con 0x7f95bc067070 2021-11-15T14:41:42.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a4003260 con 0x7f95bc067070 2021-11-15T14:41:42.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059612814 0 0) 0x7f95a4003260 con 0x7f95bc067070 2021-11-15T14:41:42.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95bc0ad0b0 msgr2=0x7f95bc144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c1559700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95bc0ad0b0 0x7f95bc144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95bc0ad0b0 0x7f95bc144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 >> v1:172.21.2.119:6789/0 conn(0x7f95bc0b0760 legacy=0x7f95bc0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0af420 con 0x7f95bc067070 2021-11-15T14:41:42.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f95b0001660 con 0x7f95bc067070 2021-11-15T14:41:42.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 >> v1:172.21.2.135:6789/0 conn(0x7f95bc067070 legacy=0x7f95bc143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95a40037d0 0x7f95a4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4004500 0x7f95a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95a4005070 0x7f95a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0b02f0 con 0x7f95a40037d0 2021-11-15T14:41:42.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a400bf20 con 0x7f95a4005070 2021-11-15T14:41:42.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a400c0e0 con 0x7f95a4004500 2021-11-15T14:41:42.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c1559700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95bc0ad0b0 0x7f95bc144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:42.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95a4005070 0x7f95a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 -- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4004500 msgr2=0x7f95a4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4004500 0x7f95a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 -- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95a40037d0 msgr2=0x7f95a4003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:42.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c1d5a700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95a40037d0 0x7f95a4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95a40037d0 0x7f95a4003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 -- 172.21.2.135:0/3226690599 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4003260 con 0x7f95a4005070 2021-11-15T14:41:42.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95a4005070 0x7f95a400b750 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f95b4002320 tx=0x7f95b4007d80).ready entity=mon.1 client_cookie=c9e7a4c366490a9b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b4002510 con 0x7f95a4005070 2021-11-15T14:41:42.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4006890 con 0x7f95a4005070 2021-11-15T14:41:42.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c0d58700 1 -- 172.21.2.135:0/3226690599 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b4006bf0 con 0x7f95a4005070 2021-11-15T14:41:42.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- 172.21.2.135:0/3226690599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95a4005070 msgr2=0x7f95a400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/3226690599 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95a4005070 0x7f95a400b750 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f95b4002320 tx=0x7f95b4007d80).stop 2021-11-15T14:41:42.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c255b700 1 -- 172.21.2.135:0/3226690599 reap_dead start 2021-11-15T14:41:42.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- 172.21.2.135:0/3226690599 shutdown_connections 2021-11-15T14:41:42.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- 172.21.2.135:0/3226690599 >> 172.21.2.135:0/3226690599 conn(0x7f95bc05f730 msgr2=0x7f95bc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- 172.21.2.135:0/3226690599 shutdown_connections 2021-11-15T14:41:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- 172.21.2.135:0/3226690599 wait complete. 2021-11-15T14:41:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 Processor -- start 2021-11-15T14:41:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.664+0000 7f95c3fbe700 1 -- start start 2021-11-15T14:41:42.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4005070 0x7f95bc09fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95bc0b47f0 0x7f95bc13e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0b2b60 con 0x7f95bc0b47f0 2021-11-15T14:41:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc13ff10 con 0x7f95bc0b4d00 2021-11-15T14:41:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1401b0 con 0x7f95a4005070 2021-11-15T14:41:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60954/0 (socket says 172.21.2.135:60954) 2021-11-15T14:41:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 -- 172.21.2.135:0/1749653285 learned_addr learned my addr 172.21.2.135:0/1749653285 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 -- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4005070 msgr2=0x7f95bc09fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4005070 0x7f95bc09fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 -- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95bc0b47f0 msgr2=0x7f95bc13e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95bc0b47f0 0x7f95bc13e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 -- 172.21.2.135:0/1749653285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc140450 con 0x7f95bc0b4d00 2021-11-15T14:41:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c255b700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f95b0001370 tx=0x7f95b4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b4002510 con 0x7f95bc0b4d00 2021-11-15T14:41:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4013810 con 0x7f95bc0b4d00 2021-11-15T14:41:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc13eba0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc155cd0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b4006ea0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc0573d0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f95b4010030 con 0x7f95bc0b4d00 2021-11-15T14:41:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 0x7f959c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f95b406cbb0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c1d5a700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 0x7f959c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.668+0000 7f95c1d5a700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 0x7f959c055b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f95b0008000 tx=0x7f95b0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.672+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95b4043ab0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.780+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f95bc0b45d0 con 0x7f95bc0b4d00 2021-11-15T14:41:42.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95aeffd700 1 -- 172.21.2.135:0/1749653285 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f95b4024070 con 0x7f95bc0b4d00 2021-11-15T14:41:42.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 msgr2=0x7f959c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 0x7f959c055b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f95b0008000 tx=0x7f95b0009040).stop 2021-11-15T14:41:42.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 msgr2=0x7f95bc0a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f95b0001370 tx=0x7f95b4016000).stop 2021-11-15T14:41:42.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 shutdown_connections 2021-11-15T14:41:42.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f959c0536d0 0x7f959c055b90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95bc0b4d00 0x7f95bc0a15b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95bc0b47f0 0x7f95bc13e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 --2- 172.21.2.135:0/1749653285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95a4005070 0x7f95bc09fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 >> 172.21.2.135:0/1749653285 conn(0x7f95bc05f730 msgr2=0x7f95bc141180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 shutdown_connections 2021-11-15T14:41:42.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.788+0000 7f95c3fbe700 1 -- 172.21.2.135:0/1749653285 wait complete. 2021-11-15T14:41:42.796 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:41:42.800 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:42.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 Processor -- start 2021-11-15T14:41:42.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 -- start start 2021-11-15T14:41:42.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f719c0aa1a0 0x7f719c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0b2b70 con 0x7f719c0b0520 2021-11-15T14:41:42.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0b27f0 con 0x7f719c0aa1a0 2021-11-15T14:41:42.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a430e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0b2da0 con 0x7f719c0b0900 2021-11-15T14:41:42.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.892+0000 7f71a18a9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f719c0aa1a0 0x7f719c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f719c0aa1a0 0x7f719c0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60960/0 (socket says 172.21.2.135:60960) 2021-11-15T14:41:42.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/4055857916 learned_addr learned my addr 172.21.2.135:0/4055857916 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/4055857916 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 msgr2=0x7f719c140620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:42.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- 172.21.2.135:0/4055857916 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c140620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/4055857916 >> v1:172.21.2.135:6789/0 conn(0x7f719c0b0520 legacy=0x7f719c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/4055857916 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0a9bf0 con 0x7f719c0aa1a0 2021-11-15T14:41:42.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- 172.21.2.135:0/4055857916 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0aa1a0 0x7f719c0ae4c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f7198002f70 tx=0x7f7198006eb0).ready entity=mon.1 client_cookie=acf25631802afd66 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a10a8700 1 -- 172.21.2.135:0/4055857916 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719800d5c0 con 0x7f719c0aa1a0 2021-11-15T14:41:42.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a10a8700 1 -- 172.21.2.135:0/4055857916 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7198000e90 con 0x7f719c0aa1a0 2021-11-15T14:41:42.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a10a8700 1 -- 172.21.2.135:0/4055857916 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719800d950 con 0x7f719c0aa1a0 2021-11-15T14:41:42.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/4055857916 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0aa1a0 msgr2=0x7f719c0ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- 172.21.2.135:0/4055857916 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0aa1a0 0x7f719c0ae4c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f7198002f70 tx=0x7f7198006eb0).stop 2021-11-15T14:41:42.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/4055857916 shutdown_connections 2021-11-15T14:41:42.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- 172.21.2.135:0/4055857916 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0aa1a0 0x7f719c0ae4c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:42.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- 172.21.2.135:0/4055857916 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/4055857916 >> 172.21.2.135:0/4055857916 conn(0x7f719c060840 msgr2=0x7f719c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:42.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/4055857916 shutdown_connections 2021-11-15T14:41:42.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/4055857916 wait complete. 2021-11-15T14:41:42.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 Processor -- start 2021-11-15T14:41:42.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- start start 2021-11-15T14:41:42.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719c0aa1a0 0x7f719c0aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c0a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0a31a0 con 0x7f719c0aa1a0 2021-11-15T14:41:42.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0a2f00 con 0x7f719c0b0520 2021-11-15T14:41:42.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0a4660 con 0x7f719c0b0900 2021-11-15T14:41:42.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60966/0 (socket says 172.21.2.135:60966) 2021-11-15T14:41:42.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/2377734176 learned_addr learned my addr 172.21.2.135:0/2377734176 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:42.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 msgr2=0x7f719c0a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c0a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719c0aa1a0 msgr2=0x7f719c0aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:42.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719c0aa1a0 0x7f719c0aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:42.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 -- 172.21.2.135:0/2377734176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719800b1e0 con 0x7f719c0b0520 2021-11-15T14:41:42.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a18a9700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f719c0a32e0 tx=0x7f7198015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7198006b60 con 0x7f719c0b0520 2021-11-15T14:41:42.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7198011ca0 con 0x7f719c0b0520 2021-11-15T14:41:42.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0a4900 con 0x7f719c0b0520 2021-11-15T14:41:42.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c09fbf0 con 0x7f719c0b0520 2021-11-15T14:41:42.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.896+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719801e460 con 0x7f719c0b0520 2021-11-15T14:41:42.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0a4a90 con 0x7f719c0b0520 2021-11-15T14:41:42.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7198025030 con 0x7f719c0b0520 2021-11-15T14:41:42.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f718b7fe700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 0x7f717c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:42.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f719806cf10 con 0x7f719c0b0520 2021-11-15T14:41:42.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f71a20aa700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 0x7f717c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:42.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f71a20aa700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 0x7f717c055bb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f719c0b77f0 tx=0x7f718c0077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:42.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:42.900+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7198043e10 con 0x7f719c0b0520 2021-11-15T14:41:43.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f719c0573d0 con 0x7f719c0b0520 2021-11-15T14:41:43.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f718b7fe700 1 -- 172.21.2.135:0/2377734176 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f7198023070 con 0x7f719c0b0520 2021-11-15T14:41:43.015 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:43.016 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:43.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 msgr2=0x7f717c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 0x7f717c055bb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f719c0b77f0 tx=0x7f718c0077d0).stop 2021-11-15T14:41:43.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 msgr2=0x7f719c0a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f719c0a32e0 tx=0x7f7198015000).stop 2021-11-15T14:41:43.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 shutdown_connections 2021-11-15T14:41:43.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f717c0536f0 0x7f717c055bb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f719c0b0900 0x7f719c0a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f719c0b0520 0x7f719c0a0b80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 --2- 172.21.2.135:0/2377734176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719c0aa1a0 0x7f719c0aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 >> 172.21.2.135:0/2377734176 conn(0x7f719c060840 msgr2=0x7f719c0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 shutdown_connections 2021-11-15T14:41:43.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.012+0000 7f71a430e700 1 -- 172.21.2.135:0/2377734176 wait complete. 2021-11-15T14:41:43.020 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:43.324 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:41.027941+0000', 'modified': '2021-11-15T14:41:42.032548+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6934}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6934': {'gid': 6934, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/4146626151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 4146626151}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 4146626151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:43.324 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:43.325 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:43.389 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6934,"want_state":"up:active","state":"up:active","rank_uptime":2.3502691649999998,"mdsmap_epoch":48,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":6.547059269} 2021-11-15T14:41:43.389 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6934, "mdsmap_epoch": 48, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 2.350269165, "state": "up:active", "uptime": 6.547059269, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:43.390 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:43.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 Processor -- start 2021-11-15T14:41:43.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- start start 2021-11-15T14:41:43.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f23340b1e30 0x7f23340b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23340a7140 0x7f23341447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340b03d0 con 0x7f2334148420 2021-11-15T14:41:43.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23340a9140 con 0x7f23340b1e30 2021-11-15T14:41:43.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23340b0670 con 0x7f23340a7140 2021-11-15T14:41:43.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23340a7140 0x7f23341447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f23340a7140 0x7f23341447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60976/0 (socket says 172.21.2.135:60976) 2021-11-15T14:41:43.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 -- 172.21.2.135:0/1323587341 learned_addr learned my addr 172.21.2.135:0/1323587341 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 -- 172.21.2.135:0/1323587341 >> v2:172.21.2.119:3300/0 conn(0x7f23340b1e30 msgr2=0x7f23340b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:43.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 --2- 172.21.2.135:0/1323587341 >> v2:172.21.2.119:3300/0 conn(0x7f23340b1e30 0x7f23340b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 -- 172.21.2.135:0/1323587341 >> v1:172.21.2.119:6789/0 conn(0x7f2334148420 legacy=0x7f23340b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:43.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 -- 172.21.2.135:0/1323587341 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340b0910 con 0x7f23340a7140 2021-11-15T14:41:43.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2339a82700 1 --2- 172.21.2.135:0/1323587341 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23341447a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f23341477b0 tx=0x7f232c009290).ready entity=mon.1 client_cookie=486b3accce16f57e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2327fff700 1 -- 172.21.2.135:0/1323587341 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c00b820 con 0x7f23340a7140 2021-11-15T14:41:43.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2327fff700 1 -- 172.21.2.135:0/1323587341 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00b980 con 0x7f23340a7140 2021-11-15T14:41:43.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f2327fff700 1 -- 172.21.2.135:0/1323587341 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c00bb30 con 0x7f23340a7140 2021-11-15T14:41:43.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- 172.21.2.135:0/1323587341 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 msgr2=0x7f23341447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 --2- 172.21.2.135:0/1323587341 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23341447a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f23341477b0 tx=0x7f232c009290).stop 2021-11-15T14:41:43.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- 172.21.2.135:0/1323587341 shutdown_connections 2021-11-15T14:41:43.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 --2- 172.21.2.135:0/1323587341 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23341447a0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 --2- 172.21.2.135:0/1323587341 >> v2:172.21.2.119:3300/0 conn(0x7f23340b1e30 0x7f23340b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- 172.21.2.135:0/1323587341 >> 172.21.2.135:0/1323587341 conn(0x7f233405f730 msgr2=0x7f233405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- 172.21.2.135:0/1323587341 shutdown_connections 2021-11-15T14:41:43.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.436+0000 7f233b4e5700 1 -- 172.21.2.135:0/1323587341 wait complete. 2021-11-15T14:41:43.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 Processor -- start 2021-11-15T14:41:43.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- start start 2021-11-15T14:41:43.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23340b1e30 0x7f2334143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2334148420 0x7f2334143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23341444d0 con 0x7f23340b1e30 2021-11-15T14:41:43.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340abb50 con 0x7f23340a7140 2021-11-15T14:41:43.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23340af8b0 con 0x7f2334148420 2021-11-15T14:41:43.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60978/0 (socket says 172.21.2.135:60978) 2021-11-15T14:41:43.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 -- 172.21.2.135:0/2110453196 learned_addr learned my addr 172.21.2.135:0/2110453196 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 -- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2334148420 msgr2=0x7f2334143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2334148420 0x7f2334143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 -- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23340b1e30 msgr2=0x7f2334143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23340b1e30 0x7f2334143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 -- 172.21.2.135:0/2110453196 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009530 con 0x7f23340a7140 2021-11-15T14:41:43.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f2339281700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2330002f70 tx=0x7f2330006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2330013460 con 0x7f23340a7140 2021-11-15T14:41:43.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23300135c0 con 0x7f23340a7140 2021-11-15T14:41:43.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2330013920 con 0x7f23340a7140 2021-11-15T14:41:43.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23340afb50 con 0x7f23340a7140 2021-11-15T14:41:43.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23340ae8f0 con 0x7f23340a7140 2021-11-15T14:41:43.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23340aeab0 con 0x7f23340a7140 2021-11-15T14:41:43.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f233001a060 con 0x7f23340a7140 2021-11-15T14:41:43.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 0x7f2314055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.440+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f233006b660 con 0x7f23340a7140 2021-11-15T14:41:43.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.444+0000 7f2338a80700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 0x7f2314055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.444+0000 7f2338a80700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 0x7f2314055bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f2328002f10 tx=0x7f2328006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.444+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2330042560 con 0x7f23340a7140 2021-11-15T14:41:43.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23340adee0 con 0x7f23340a7140 2021-11-15T14:41:43.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f23267fc700 1 -- 172.21.2.135:0/2110453196 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16283 (secure 0 0 0) 0x7f2330018030 con 0x7f23340a7140 2021-11-15T14:41:43.532 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:43.532 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":102,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:42.033690+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:38.935483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:40.012670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:43.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 msgr2=0x7f2314055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 0x7f2314055bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f2328002f10 tx=0x7f2328006930).stop 2021-11-15T14:41:43.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 msgr2=0x7f23340a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2330002f70 tx=0x7f2330006ec0).stop 2021-11-15T14:41:43.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 shutdown_connections 2021-11-15T14:41:43.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f23140536f0 0x7f2314055bb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2334148420 0x7f2334143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f23340b1e30 0x7f2334143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 --2- 172.21.2.135:0/2110453196 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f23340a7140 0x7f23340a9800 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 >> 172.21.2.135:0/2110453196 conn(0x7f233405f730 msgr2=0x7f23340b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 shutdown_connections 2021-11-15T14:41:43.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.528+0000 7f233b4e5700 1 -- 172.21.2.135:0/2110453196 wait complete. 2021-11-15T14:41:43.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:38.935483+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:40.012670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:41:43.540 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:43.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 Processor -- start 2021-11-15T14:41:43.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 -- start start 2021-11-15T14:41:43.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24a80b1f40 0x7f24a80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f24a80b0030 0x7f24a80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a81412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80b04a0 con 0x7f24a80b0030 2021-11-15T14:41:43.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80b2810 con 0x7f24a80b1f40 2021-11-15T14:41:43.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b06d0 con 0x7f24a80a7140 2021-11-15T14:41:43.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24a80b1f40 0x7f24a80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f24a80b1f40 0x7f24a80b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60986/0 (socket says 172.21.2.135:60986) 2021-11-15T14:41:43.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 -- 172.21.2.135:0/3845981574 learned_addr learned my addr 172.21.2.135:0/3845981574 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 -- 172.21.2.135:0/3845981574 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 msgr2=0x7f24a81412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:43.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 --2- 172.21.2.135:0/3845981574 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a81412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 -- 172.21.2.135:0/3845981574 >> v2:172.21.2.119:3300/0 conn(0x7f24a80b0030 msgr2=0x7f24a80b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:43.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 --2- 172.21.2.135:0/3845981574 >> v2:172.21.2.119:3300/0 conn(0x7f24a80b0030 0x7f24a80b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 -- 172.21.2.135:0/3845981574 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80b0970 con 0x7f24a80b1f40 2021-11-15T14:41:43.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24ac90a700 1 --2- 172.21.2.135:0/3845981574 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b1f40 0x7f24a80b1350 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2498002f70 tx=0x7f2498006eb0).ready entity=mon.1 client_cookie=f07f6018b3021968 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24a77fe700 1 -- 172.21.2.135:0/3845981574 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249800d570 con 0x7f24a80b1f40 2021-11-15T14:41:43.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24a77fe700 1 -- 172.21.2.135:0/3845981574 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498000e90 con 0x7f24a80b1f40 2021-11-15T14:41:43.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24a77fe700 1 -- 172.21.2.135:0/3845981574 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249800d900 con 0x7f24a80b1f40 2021-11-15T14:41:43.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 -- 172.21.2.135:0/3845981574 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b1f40 msgr2=0x7f24a80b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.588+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/3845981574 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b1f40 0x7f24a80b1350 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f2498002f70 tx=0x7f2498006eb0).stop 2021-11-15T14:41:43.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/3845981574 shutdown_connections 2021-11-15T14:41:43.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/3845981574 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a81412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/3845981574 >> v2:172.21.2.119:3300/0 conn(0x7f24a80b0030 0x7f24a80b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/3845981574 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b1f40 0x7f24a80b1350 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/3845981574 >> 172.21.2.135:0/3845981574 conn(0x7f24a805f730 msgr2=0x7f24a805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/3845981574 shutdown_connections 2021-11-15T14:41:43.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/3845981574 wait complete. 2021-11-15T14:41:43.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 Processor -- start 2021-11-15T14:41:43.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- start start 2021-11-15T14:41:43.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a8140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24a80b1f40 0x7f24a815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80ae030 con 0x7f24a80b1f40 2021-11-15T14:41:43.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80ae2d0 con 0x7f24a80b0030 2021-11-15T14:41:43.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a815a2f0 con 0x7f24a80a7140 2021-11-15T14:41:43.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:60994/0 (socket says 172.21.2.135:60994) 2021-11-15T14:41:43.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 -- 172.21.2.135:0/716375740 learned_addr learned my addr 172.21.2.135:0/716375740 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 -- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 msgr2=0x7f24a8140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a8140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 -- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24a80b1f40 msgr2=0x7f24a815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24a80b1f40 0x7f24a815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 -- 172.21.2.135:0/716375740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249800b1e0 con 0x7f24a80b0030 2021-11-15T14:41:43.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a7fff700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f249c002fb0 tx=0x7f249c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c013460 con 0x7f24a80b0030 2021-11-15T14:41:43.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0135c0 con 0x7f24a80b0030 2021-11-15T14:41:43.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c013920 con 0x7f24a80b0030 2021-11-15T14:41:43.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80aaff0 con 0x7f24a80b0030 2021-11-15T14:41:43.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80adcb0 con 0x7f24a80b0030 2021-11-15T14:41:43.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80ae4d0 con 0x7f24a80b0030 2021-11-15T14:41:43.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f249c00f070 con 0x7f24a80b0030 2021-11-15T14:41:43.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 0x7f2488055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.592+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f249c06b320 con 0x7f24a80b0030 2021-11-15T14:41:43.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.596+0000 7f24ac90a700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 0x7f2488055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.596+0000 7f24ac90a700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 0x7f2488055b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f2498002f70 tx=0x7f2498015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.596+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f249c042220 con 0x7f24a80b0030 2021-11-15T14:41:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f24a80b0c10 con 0x7f24a80b0030 2021-11-15T14:41:43.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24a5ffb700 1 -- 172.21.2.135:0/716375740 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f249c018030 con 0x7f24a80b0030 2021-11-15T14:41:43.683 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 msgr2=0x7f2488055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 0x7f2488055b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f2498002f70 tx=0x7f2498015000).stop 2021-11-15T14:41:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 msgr2=0x7f24a815a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f249c002fb0 tx=0x7f249c006df0).stop 2021-11-15T14:41:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 shutdown_connections 2021-11-15T14:41:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f24880536a0 0x7f2488055b60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f24a80b1f40 0x7f24a815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f24a80b0030 0x7f24a815a790 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 --2- 172.21.2.135:0/716375740 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f24a80a7140 0x7f24a8140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 >> 172.21.2.135:0/716375740 conn(0x7f24a805f730 msgr2=0x7f24a80a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 shutdown_connections 2021-11-15T14:41:43.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.680+0000 7f24aeb6e700 1 -- 172.21.2.135:0/716375740 wait complete. 2021-11-15T14:41:43.690 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:43.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 Processor -- start 2021-11-15T14:41:43.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- start start 2021-11-15T14:41:43.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f21140b1350 0x7f21140b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f21140b2320 0x7f21141412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140a7850 con 0x7f21140b1f40 2021-11-15T14:41:43.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b17c0 con 0x7f21140b1350 2021-11-15T14:41:43.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b06d0 con 0x7f21140b2320 2021-11-15T14:41:43.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f211259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f21140b1f40 0x7f21140a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48588/0 (socket says 172.21.2.135:48588) 2021-11-15T14:41:43.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f211259c700 1 -- 172.21.2.135:0/3363348910 learned_addr learned my addr 172.21.2.135:0/3363348910 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:43.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3363348910 >> v2:172.21.2.135:3300/0 conn(0x7f21140b2320 0x7f21141412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 -- 172.21.2.135:0/3363348910 >> v2:172.21.2.119:3300/0 conn(0x7f21140b1350 msgr2=0x7f21140b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:43.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3363348910 >> v2:172.21.2.119:3300/0 conn(0x7f21140b1350 0x7f21140b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 -- 172.21.2.135:0/3363348910 >> v1:172.21.2.135:6789/0 conn(0x7f21140b1f40 legacy=0x7f21140a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 -- 172.21.2.135:0/3363348910 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140b0970 con 0x7f21140b2320 2021-11-15T14:41:43.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3363348910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f21141412d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f210c0032f0 tx=0x7f210c0091d0).ready entity=mon.1 client_cookie=e927bf1c3c4c5363 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f211159a700 1 -- 172.21.2.135:0/3363348910 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c009ea0 con 0x7f21140b2320 2021-11-15T14:41:43.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f211159a700 1 -- 172.21.2.135:0/3363348910 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00b870 con 0x7f21140b2320 2021-11-15T14:41:43.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f211159a700 1 -- 172.21.2.135:0/3363348910 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c00b9e0 con 0x7f21140b2320 2021-11-15T14:41:43.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- 172.21.2.135:0/3363348910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 msgr2=0x7f21141412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3363348910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f21141412d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f210c0032f0 tx=0x7f210c0091d0).stop 2021-11-15T14:41:43.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- 172.21.2.135:0/3363348910 shutdown_connections 2021-11-15T14:41:43.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3363348910 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f21141412d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3363348910 >> v2:172.21.2.119:3300/0 conn(0x7f21140b1350 0x7f21140b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- 172.21.2.135:0/3363348910 >> 172.21.2.135:0/3363348910 conn(0x7f211405f730 msgr2=0x7f211405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- 172.21.2.135:0/3363348910 shutdown_connections 2021-11-15T14:41:43.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- 172.21.2.135:0/3363348910 wait complete. 2021-11-15T14:41:43.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 Processor -- start 2021-11-15T14:41:43.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- start start 2021-11-15T14:41:43.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21140b1350 0x7f2114063670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21140b1f40 0x7f2114157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211414ad60 con 0x7f21140b1350 2021-11-15T14:41:43.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140b34b0 con 0x7f21140b2320 2021-11-15T14:41:43.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2118c7c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140b3b80 con 0x7f21140b1f40 2021-11-15T14:41:43.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32778/0 (socket says 172.21.2.135:32778) 2021-11-15T14:41:43.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.740+0000 7f2112d9d700 1 -- 172.21.2.135:0/3137009710 learned_addr learned my addr 172.21.2.135:0/3137009710 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 -- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21140b1f40 msgr2=0x7f2114157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21140b1f40 0x7f2114157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 -- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21140b1350 msgr2=0x7f2114063670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:43.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21140b1350 0x7f2114063670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 -- 172.21.2.135:0/3137009710 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c009470 con 0x7f21140b2320 2021-11-15T14:41:43.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2112d9d700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f211414b860 tx=0x7f210c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c009ea0 con 0x7f21140b2320 2021-11-15T14:41:43.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c0107a0 con 0x7f21140b2320 2021-11-15T14:41:43.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2114157bc0 con 0x7f21140b2320 2021-11-15T14:41:43.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21140b36e0 con 0x7f21140b2320 2021-11-15T14:41:43.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c010b00 con 0x7f21140b2320 2021-11-15T14:41:43.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21140b38a0 con 0x7f21140b2320 2021-11-15T14:41:43.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f210c00f070 con 0x7f21140b2320 2021-11-15T14:41:43.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 0x7f20f8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f210c06cf30 con 0x7f21140b2320 2021-11-15T14:41:43.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f211259c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 0x7f20f8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.744+0000 7f211259c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 0x7f20f8055a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f21140ad350 tx=0x7f20fc007770).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.748+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f210c043e30 con 0x7f21140b2320 2021-11-15T14:41:43.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21140573d0 con 0x7f21140b2320 2021-11-15T14:41:43.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f210b7fe700 1 -- 172.21.2.135:0/3137009710 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f210c015070 con 0x7f21140b2320 2021-11-15T14:41:43.833 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:43.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 msgr2=0x7f20f8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 0x7f20f8055a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f21140ad350 tx=0x7f20fc007770).stop 2021-11-15T14:41:43.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 msgr2=0x7f2114157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f211414b860 tx=0x7f210c016000).stop 2021-11-15T14:41:43.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 shutdown_connections 2021-11-15T14:41:43.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f20f80535d0 0x7f20f8055a90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f21140b2320 0x7f2114157520 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f21140b1f40 0x7f2114157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 --2- 172.21.2.135:0/3137009710 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f21140b1350 0x7f2114063670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 >> 172.21.2.135:0/3137009710 conn(0x7f211405f730 msgr2=0x7f21140aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 shutdown_connections 2021-11-15T14:41:43.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.828+0000 7f2118c7c700 1 -- 172.21.2.135:0/3137009710 wait complete. 2021-11-15T14:41:43.840 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:41:43.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 Processor -- start 2021-11-15T14:41:43.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 -- start start 2021-11-15T14:41:43.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe0fc0b1f40 0x7fe0fc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe0fc0b0030 0x7fe0fc0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0b04a0 con 0x7fe0fc0a7140 2021-11-15T14:41:43.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b2810 con 0x7fe0fc0b1f40 2021-11-15T14:41:43.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe101781700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b06d0 con 0x7fe0fc0b0030 2021-11-15T14:41:43.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fb7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe0fc0a7140 0x7fe0fc1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48604/0 (socket says 172.21.2.135:48604) 2021-11-15T14:41:43.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fb7fe700 1 -- 172.21.2.135:0/3570389298 learned_addr learned my addr 172.21.2.135:0/3570389298 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:43.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 --2- 172.21.2.135:0/3570389298 >> v2:172.21.2.135:3300/0 conn(0x7fe0fc0b0030 0x7fe0fc0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 -- 172.21.2.135:0/3570389298 >> v2:172.21.2.119:3300/0 conn(0x7fe0fc0b1f40 msgr2=0x7fe0fc0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:43.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 --2- 172.21.2.135:0/3570389298 >> v2:172.21.2.119:3300/0 conn(0x7fe0fc0b1f40 0x7fe0fc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 -- 172.21.2.135:0/3570389298 >> v1:172.21.2.135:6789/0 conn(0x7fe0fc0a7140 legacy=0x7fe0fc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 -- 172.21.2.135:0/3570389298 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0b0970 con 0x7fe0fc0b0030 2021-11-15T14:41:43.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0fa7fc700 1 --2- 172.21.2.135:0/3570389298 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b2320 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fe0e4002f70 tx=0x7fe0e4006df0).ready entity=mon.1 client_cookie=1db2a3257f1fb974 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0f9ffb700 1 -- 172.21.2.135:0/3570389298 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0e400d5c0 con 0x7fe0fc0b0030 2021-11-15T14:41:43.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0f9ffb700 1 -- 172.21.2.135:0/3570389298 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4000e90 con 0x7fe0fc0b0030 2021-11-15T14:41:43.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.888+0000 7fe0f9ffb700 1 -- 172.21.2.135:0/3570389298 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0e400d910 con 0x7fe0fc0b0030 2021-11-15T14:41:43.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3570389298 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0b0030 msgr2=0x7fe0fc0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- 172.21.2.135:0/3570389298 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b2320 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fe0e4002f70 tx=0x7fe0e4006df0).stop 2021-11-15T14:41:43.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3570389298 shutdown_connections 2021-11-15T14:41:43.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- 172.21.2.135:0/3570389298 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b2320 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- 172.21.2.135:0/3570389298 >> v2:172.21.2.119:3300/0 conn(0x7fe0fc0b1f40 0x7fe0fc0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3570389298 >> 172.21.2.135:0/3570389298 conn(0x7fe0fc05f730 msgr2=0x7fe0fc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3570389298 shutdown_connections 2021-11-15T14:41:43.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3570389298 wait complete. 2021-11-15T14:41:43.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 Processor -- start 2021-11-15T14:41:43.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- start start 2021-11-15T14:41:43.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0fc0b1f40 0x7fe0fc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc15b220 con 0x7fe0fc0b0030 2021-11-15T14:41:43.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0aa180 con 0x7fe0fc0a7140 2021-11-15T14:41:43.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0a99a0 con 0x7fe0fc0b1f40 2021-11-15T14:41:43.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32788/0 (socket says 172.21.2.135:32788) 2021-11-15T14:41:43.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 -- 172.21.2.135:0/3838204719 learned_addr learned my addr 172.21.2.135:0/3838204719 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:43.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 -- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0fc0b1f40 msgr2=0x7fe0fc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0fc0b1f40 0x7fe0fc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 -- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0fc0b0030 msgr2=0x7fe0fc0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 -- 172.21.2.135:0/3838204719 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e400b180 con 0x7fe0fc0a7140 2021-11-15T14:41:43.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0faffd700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fe0fc14ae50 tx=0x7fe0ec006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec013460 con 0x7fe0fc0a7140 2021-11-15T14:41:43.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0135c0 con 0x7fe0fc0a7140 2021-11-15T14:41:43.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0a9c40 con 0x7fe0fc0a7140 2021-11-15T14:41:43.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0aa920 con 0x7fe0fc0a7140 2021-11-15T14:41:43.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec013920 con 0x7fe0fc0a7140 2021-11-15T14:41:43.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc0b3d80 con 0x7fe0fc0a7140 2021-11-15T14:41:43.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe0ec01a060 con 0x7fe0fc0a7140 2021-11-15T14:41:43.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 0x7fe0e0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:43.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.892+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe0ec06b5e0 con 0x7fe0fc0a7140 2021-11-15T14:41:43.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.896+0000 7fe0fa7fc700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 0x7fe0e0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:43.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.896+0000 7fe0fa7fc700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 0x7fe0e0055b20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe0e4002f70 tx=0x7fe0e4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:43.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.896+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0ec0424e0 con 0x7fe0fc0a7140 2021-11-15T14:41:43.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0fc0b0c10 con 0x7fe0fc0a7140 2021-11-15T14:41:43.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe0f3fff700 1 -- 172.21.2.135:0/3838204719 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe0ec045b00 con 0x7fe0fc0a7140 2021-11-15T14:41:43.984 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:43.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 msgr2=0x7fe0e0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 0x7fe0e0055b20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe0e4002f70 tx=0x7fe0e4014000).stop 2021-11-15T14:41:43.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 msgr2=0x7fe0fc148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:43.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fe0fc14ae50 tx=0x7fe0ec006e20).stop 2021-11-15T14:41:43.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 shutdown_connections 2021-11-15T14:41:43.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0e0053660 0x7fe0e0055b20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0fc0b1f40 0x7fe0fc0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0fc0b0030 0x7fe0fc0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:43.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 --2- 172.21.2.135:0/3838204719 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe0fc0a7140 0x7fe0fc148cf0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:43.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 >> 172.21.2.135:0/3838204719 conn(0x7fe0fc05f730 msgr2=0x7fe0fc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:43.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 shutdown_connections 2021-11-15T14:41:43.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:43.980+0000 7fe101781700 1 -- 172.21.2.135:0/3838204719 wait complete. 2021-11-15T14:41:43.991 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:41:44.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 Processor -- start 2021-11-15T14:41:44.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- start start 2021-11-15T14:41:44.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe6f40b1f40 0x7fe6f40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe6f40b0030 0x7fe6f40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40b04a0 con 0x7fe6f40a7140 2021-11-15T14:41:44.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40b2810 con 0x7fe6f40b1f40 2021-11-15T14:41:44.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40b06d0 con 0x7fe6f40b0030 2021-11-15T14:41:44.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe6f40a7140 0x7fe6f41412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48618/0 (socket says 172.21.2.135:48618) 2021-11-15T14:41:44.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f37fe700 1 -- 172.21.2.135:0/694961617 learned_addr learned my addr 172.21.2.135:0/694961617 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:44.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 --2- 172.21.2.135:0/694961617 >> v2:172.21.2.135:3300/0 conn(0x7fe6f40b0030 0x7fe6f40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f1ffb700 1 -- 172.21.2.135:0/694961617 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349701637 0 0) 0x7fe6f40b04a0 con 0x7fe6f40a7140 2021-11-15T14:41:44.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f1ffb700 1 -- 172.21.2.135:0/694961617 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d4003260 con 0x7fe6f40a7140 2021-11-15T14:41:44.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 -- 172.21.2.135:0/694961617 >> v2:172.21.2.119:3300/0 conn(0x7fe6f40b1f40 msgr2=0x7fe6f40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:44.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 --2- 172.21.2.135:0/694961617 >> v2:172.21.2.119:3300/0 conn(0x7fe6f40b1f40 0x7fe6f40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 -- 172.21.2.135:0/694961617 >> v1:172.21.2.135:6789/0 conn(0x7fe6f40a7140 legacy=0x7fe6f41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 -- 172.21.2.135:0/694961617 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40b0970 con 0x7fe6f40b0030 2021-11-15T14:41:44.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f27fc700 1 --2- 172.21.2.135:0/694961617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b0030 0x7fe6f40b2320 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fe6e4002f70 tx=0x7fe6e4006df0).ready entity=mon.1 client_cookie=8a9ee970636665c1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f1ffb700 1 -- 172.21.2.135:0/694961617 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400d570 con 0x7fe6f40b0030 2021-11-15T14:41:44.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f1ffb700 1 -- 172.21.2.135:0/694961617 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4000e90 con 0x7fe6f40b0030 2021-11-15T14:41:44.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f1ffb700 1 -- 172.21.2.135:0/694961617 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400d8c0 con 0x7fe6f40b0030 2021-11-15T14:41:44.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- 172.21.2.135:0/694961617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b0030 msgr2=0x7fe6f40b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/694961617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b0030 0x7fe6f40b2320 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fe6e4002f70 tx=0x7fe6e4006df0).stop 2021-11-15T14:41:44.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- 172.21.2.135:0/694961617 shutdown_connections 2021-11-15T14:41:44.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/694961617 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b0030 0x7fe6f40b2320 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/694961617 >> v2:172.21.2.119:3300/0 conn(0x7fe6f40b1f40 0x7fe6f40b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- 172.21.2.135:0/694961617 >> 172.21.2.135:0/694961617 conn(0x7fe6f405f730 msgr2=0x7fe6f405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:44.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- 172.21.2.135:0/694961617 shutdown_connections 2021-11-15T14:41:44.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.040+0000 7fe6f99a0700 1 -- 172.21.2.135:0/694961617 wait complete. 2021-11-15T14:41:44.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 Processor -- start 2021-11-15T14:41:44.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- start start 2021-11-15T14:41:44.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6f40a7140 0x7fe6f40aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6f40b0030 0x7fe6f40ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40ac1c0 con 0x7fe6f40a7140 2021-11-15T14:41:44.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40abe00 con 0x7fe6f40b1f40 2021-11-15T14:41:44.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f414b960 con 0x7fe6f40b0030 2021-11-15T14:41:44.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32804/0 (socket says 172.21.2.135:32804) 2021-11-15T14:41:44.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 -- 172.21.2.135:0/1655411305 learned_addr learned my addr 172.21.2.135:0/1655411305 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:44.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 -- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6f40b0030 msgr2=0x7fe6f40ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6f40b0030 0x7fe6f40ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 -- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6f40a7140 msgr2=0x7fe6f40aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6f40a7140 0x7fe6f40aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 -- 172.21.2.135:0/1655411305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e400b180 con 0x7fe6f40b1f40 2021-11-15T14:41:44.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f37fe700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fe6ec001490 tx=0x7fe6ec007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6ec005ba0 con 0x7fe6f40b1f40 2021-11-15T14:41:44.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec005d00 con 0x7fe6f40b1f40 2021-11-15T14:41:44.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f414b690 con 0x7fe6f40b1f40 2021-11-15T14:41:44.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6ec0072c0 con 0x7fe6f40b1f40 2021-11-15T14:41:44.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f40ab750 con 0x7fe6f40b1f40 2021-11-15T14:41:44.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40b0c10 con 0x7fe6f40b1f40 2021-11-15T14:41:44.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6ec01a060 con 0x7fe6f40b1f40 2021-11-15T14:41:44.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 0x7fe6d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe6ec06b710 con 0x7fe6f40b1f40 2021-11-15T14:41:44.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.044+0000 7fe6f2ffd700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 0x7fe6d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.048+0000 7fe6f2ffd700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 0x7fe6d8055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fe6dc002f70 tx=0x7fe6dc0069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.048+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6ec042680 con 0x7fe6f40b1f40 2021-11-15T14:41:44.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.128+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6f40573d0 con 0x7fe6f40b1f40 2021-11-15T14:41:44.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.128+0000 7fe6ebfff700 1 -- 172.21.2.135:0/1655411305 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe6ec018070 con 0x7fe6f40b1f40 2021-11-15T14:41:44.133 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:44.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 msgr2=0x7fe6d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 0x7fe6d8055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fe6dc002f70 tx=0x7fe6dc0069e0).stop 2021-11-15T14:41:44.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 msgr2=0x7fe6f413ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7fe6ec001490 tx=0x7fe6ec007e00).stop 2021-11-15T14:41:44.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 shutdown_connections 2021-11-15T14:41:44.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe6d8053610 0x7fe6d8055ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6f40b1f40 0x7fe6f413ba80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6f40b0030 0x7fe6f40ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 --2- 172.21.2.135:0/1655411305 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6f40a7140 0x7fe6f40aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 >> 172.21.2.135:0/1655411305 conn(0x7fe6f405f730 msgr2=0x7fe6f40af660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:44.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 shutdown_connections 2021-11-15T14:41:44.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.132+0000 7fe6f99a0700 1 -- 172.21.2.135:0/1655411305 wait complete. 2021-11-15T14:41:44.140 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:41:44.141 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:44.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 Processor -- start 2021-11-15T14:41:44.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 -- start start 2021-11-15T14:41:44.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1bf8067380 0x7f1bf8143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf80aac30 con 0x7f1bf8060180 2021-11-15T14:41:44.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf8060560 con 0x7f1bf8143e60 2021-11-15T14:41:44.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfe860700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf8066f20 con 0x7f1bf8067380 2021-11-15T14:41:44.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfcdfd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f1bf8143e60 0x7f1bf814b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48630/0 (socket says 172.21.2.135:48630) 2021-11-15T14:41:44.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfcdfd700 1 -- 172.21.2.135:0/3425480073 learned_addr learned my addr 172.21.2.135:0/3425480073 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:44.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363432692 0 0) 0x7f1bf8060560 con 0x7f1bf8143e60 2021-11-15T14:41:44.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd8003260 con 0x7f1bf8143e60 2021-11-15T14:41:44.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471109864 0 0) 0x7f1bd8003260 con 0x7f1bf8143e60 2021-11-15T14:41:44.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 >> v2:172.21.2.119:3300/0 conn(0x7f1bf8067380 msgr2=0x7f1bf8143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:44.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 --2- 172.21.2.135:0/3425480073 >> v2:172.21.2.119:3300/0 conn(0x7f1bf8067380 0x7f1bf8143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 >> v1:172.21.2.119:6789/0 conn(0x7f1bf8060180 legacy=0x7f1bf80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:44.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80b3430 con 0x7f1bf8143e60 2021-11-15T14:41:44.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f1bf00019e0 con 0x7f1bf8143e60 2021-11-15T14:41:44.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 >> v1:172.21.2.135:6789/0 conn(0x7f1bf8143e60 legacy=0x7f1bf814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8003820 0x7f1bd8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 0x7f1bd8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bd8005050 0x7f1bd800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8066f20 con 0x7f1bd8003820 2021-11-15T14:41:44.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8010350 con 0x7f1bd8004500 2021-11-15T14:41:44.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8010510 con 0x7f1bd8005050 2021-11-15T14:41:44.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 0x7f1bd8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf7fff700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8003820 0x7f1bd8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 -- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bd8005050 msgr2=0x7f1bd800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:44.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bd8005050 0x7f1bd800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 -- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8003820 msgr2=0x7f1bd8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:44.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8003820 0x7f1bd8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bfcdfd700 1 -- 172.21.2.135:0/3425480073 reap_dead start 2021-11-15T14:41:44.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 -- 172.21.2.135:0/3425480073 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8003260 con 0x7f1bd8004500 2021-11-15T14:41:44.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf7fff700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8003820 0x7f1bd8003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:44.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 0x7f1bd8004980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f1be0002f70 tx=0x7f1be0006ca0).ready entity=mon.1 client_cookie=4db230bd247423ed server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be0013410 con 0x7f1bd8004500 2021-11-15T14:41:44.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0013570 con 0x7f1bd8004500 2021-11-15T14:41:44.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.188+0000 7f1bf6ffd700 1 -- 172.21.2.135:0/3425480073 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be00138d0 con 0x7f1bd8004500 2021-11-15T14:41:44.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 msgr2=0x7f1bd8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 0x7f1bd8004980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f1be0002f70 tx=0x7f1be0006ca0).stop 2021-11-15T14:41:44.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/3425480073 shutdown_connections 2021-11-15T14:41:44.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 --2- 172.21.2.135:0/3425480073 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bd8004500 0x7f1bd8004980 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/3425480073 >> 172.21.2.135:0/3425480073 conn(0x7f1bf805cfb0 msgr2=0x7f1bf805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:44.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/3425480073 shutdown_connections 2021-11-15T14:41:44.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/3425480073 wait complete. 2021-11-15T14:41:44.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 Processor -- start 2021-11-15T14:41:44.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- start start 2021-11-15T14:41:44.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8004500 0x7f1bf80b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bf80ab980 0x7f1bf815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf813c890 con 0x7f1bd8004500 2021-11-15T14:41:44.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8159f80 con 0x7f1bf813db70 2021-11-15T14:41:44.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf813ce50 con 0x7f1bf80ab980 2021-11-15T14:41:44.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32822/0 (socket says 172.21.2.135:32822) 2021-11-15T14:41:44.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 -- 172.21.2.135:0/2500888761 learned_addr learned my addr 172.21.2.135:0/2500888761 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:44.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 -- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bf80ab980 msgr2=0x7f1bf815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bf80ab980 0x7f1bf815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 -- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8004500 msgr2=0x7f1bf80b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8004500 0x7f1bf80b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 -- 172.21.2.135:0/2500888761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf813d0f0 con 0x7f1bf813db70 2021-11-15T14:41:44.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf77fe700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1bf813c9d0 tx=0x7f1be0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be0013410 con 0x7f1bf813db70 2021-11-15T14:41:44.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0012da0 con 0x7f1bf813db70 2021-11-15T14:41:44.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be0021660 con 0x7f1bf813db70 2021-11-15T14:41:44.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf813d390 con 0x7f1bf813db70 2021-11-15T14:41:44.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf813ec80 con 0x7f1bf813db70 2021-11-15T14:41:44.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf813d550 con 0x7f1bf813db70 2021-11-15T14:41:44.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1be00217c0 con 0x7f1bf813db70 2021-11-15T14:41:44.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 0x7f1bdc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:44.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.192+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1be001b040 con 0x7f1bf813db70 2021-11-15T14:41:44.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.196+0000 7f1bf7fff700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 0x7f1bdc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:44.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.196+0000 7f1bf7fff700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 0x7f1bdc055a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f1be8008000 tx=0x7f1be8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:44.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.196+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1be0043c40 con 0x7f1bf813db70 2021-11-15T14:41:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.304+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bf80573d0 con 0x7f1bf813db70 2021-11-15T14:41:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.304+0000 7f1bf57fa700 1 -- 172.21.2.135:0/2500888761 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f1be006c9d0 con 0x7f1bf813db70 2021-11-15T14:41:44.310 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:44.310 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:44.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 msgr2=0x7f1bdc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 0x7f1bdc055a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f1be8008000 tx=0x7f1be8009040).stop 2021-11-15T14:41:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 msgr2=0x7f1bf80ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1bf813c9d0 tx=0x7f1be0014000).stop 2021-11-15T14:41:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 shutdown_connections 2021-11-15T14:41:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1bdc0535b0 0x7f1bdc055a70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1bf80ab980 0x7f1bf815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1bf813db70 0x7f1bf80ab490 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 --2- 172.21.2.135:0/2500888761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1bd8004500 0x7f1bf80b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 >> 172.21.2.135:0/2500888761 conn(0x7f1bf805cfb0 msgr2=0x7f1bf80b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:44.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 shutdown_connections 2021-11-15T14:41:44.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:44.308+0000 7f1bfe860700 1 -- 172.21.2.135:0/2500888761 wait complete. 2021-11-15T14:41:44.314 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:44.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:41.027941+0000', 'modified': '2021-11-15T14:41:42.032548+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6934}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6934': {'gid': 6934, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/4146626151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 4146626151}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 4146626151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:44.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:44.622 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:44.687 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6934,"want_state":"up:active","state":"up:active","rank_uptime":3.647838819,"mdsmap_epoch":48,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":7.8446304519999996} 2021-11-15T14:41:44.687 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6934, "mdsmap_epoch": 48, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 3.647838819, "state": "up:active", "uptime": 7.844630452, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:44.688 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:41:44.688 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:41:44.688 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:41:44.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:44.689 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:44.700 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:44.752 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:44.752 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:44.758 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:44.758 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:44.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:44.760 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:44.764 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:41:44.764 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:44.807 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:44.816 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:44.817 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:44.822 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:44.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:44.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:44.824 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:44.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:41:44.850+0000 7f44bb3cd080 -1 init, newargv = 0x564b0fa59ee0 newargc=9 2021-11-15T14:41:44.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14842]: starting ceph client 2021-11-15T14:41:44.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14842]: starting fuse 2021-11-15T14:41:45.929 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:41:45.941 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:45.941 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:45.992 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:45.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:45.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:45.994 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:41:46.000 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:41:46.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:41:46.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:46.001 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:41:46.002 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:41:46.002 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:41:46.003 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:41:46.003 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:41:46.003 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:46.004 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:41:46.004 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:41:46.005 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:41:46.005 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:46.006 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:41:46.006 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:41:46.007 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:41:46.007 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:41:46.007 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:46.008 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:41:46.008 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:41:46.009 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:41:46.009 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:41:46.010 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:41:46.010 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:46.010 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:41:46.011 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:41:46.075 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14842.asok 2021-11-15T14:41:46.078 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14842.asok 2021-11-15T14:41:46.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:46.079 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14842.asok status 2021-11-15T14:41:46.126 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:41:46.127 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:41:46.127 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:41:46.127 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:41:46.127 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:41:46.128 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:41:46.128 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:41:46.128 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14842", 2021-11-15T14:41:46.128 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:41:46.129 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:46.129 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:41:46.129 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:41:46.129 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4989, 2021-11-15T14:41:46.130 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:41:46.130 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:41:46.130 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:41:46.130 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4989 2021-11-15T14:41:46.130 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:46.131 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:46.131 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:46.131 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:46.131 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2516774592 2021-11-15T14:41:46.132 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:41:46.132 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:46.132 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:41:46.132 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:41:46.133 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:41:46.133 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2516774592 2021-11-15T14:41:46.133 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:41:46.133 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4989 172.21.2.138:0/2516774592", 2021-11-15T14:41:46.133 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2516774592", 2021-11-15T14:41:46.134 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:41:46.134 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 48, 2021-11-15T14:41:46.134 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 102, 2021-11-15T14:41:46.134 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:41:46.135 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:41:46.135 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:41:46.135 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:41:46.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:46.137 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:46.137 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:46.143 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:46.143 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:46.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:46.144 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:46.194 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:46.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 Processor -- start 2021-11-15T14:41:46.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- start start 2021-11-15T14:41:46.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa5480b0520 0x7fa5480addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5480b2b70 con 0x7fa5480aa1a0 2021-11-15T14:41:46.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5480b27f0 con 0x7fa5480b0520 2021-11-15T14:41:46.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480b2da0 con 0x7fa5480b0900 2021-11-15T14:41:46.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa5480b0520 0x7fa5480addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa5480b0520 0x7fa5480addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32832/0 (socket says 172.21.2.135:32832) 2021-11-15T14:41:46.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 -- 172.21.2.135:0/1716614553 learned_addr learned my addr 172.21.2.135:0/1716614553 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 -- 172.21.2.135:0/1716614553 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 msgr2=0x7fa548140620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:46.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 --2- 172.21.2.135:0/1716614553 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548140620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 -- 172.21.2.135:0/1716614553 >> v1:172.21.2.119:6789/0 conn(0x7fa5480aa1a0 legacy=0x7fa5480ae2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:46.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 -- 172.21.2.135:0/1716614553 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480a9bf0 con 0x7fa5480b0520 2021-11-15T14:41:46.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54dc3c700 1 --2- 172.21.2.135:0/1716614553 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480b0520 0x7fa5480addb0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa5480b77f0 tx=0x7fa53c006f40).ready entity=mon.1 client_cookie=a515e62bed1fc33f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54cc3a700 1 -- 172.21.2.135:0/1716614553 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c00dc30 con 0x7fa5480b0520 2021-11-15T14:41:46.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54cc3a700 1 -- 172.21.2.135:0/1716614553 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c000e90 con 0x7fa5480b0520 2021-11-15T14:41:46.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54cc3a700 1 -- 172.21.2.135:0/1716614553 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c00be90 con 0x7fa5480b0520 2021-11-15T14:41:46.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- 172.21.2.135:0/1716614553 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480b0520 msgr2=0x7fa5480addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 --2- 172.21.2.135:0/1716614553 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480b0520 0x7fa5480addb0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa5480b77f0 tx=0x7fa53c006f40).stop 2021-11-15T14:41:46.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- 172.21.2.135:0/1716614553 shutdown_connections 2021-11-15T14:41:46.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 --2- 172.21.2.135:0/1716614553 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 --2- 172.21.2.135:0/1716614553 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480b0520 0x7fa5480addb0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- 172.21.2.135:0/1716614553 >> 172.21.2.135:0/1716614553 conn(0x7fa548060840 msgr2=0x7fa548060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- 172.21.2.135:0/1716614553 shutdown_connections 2021-11-15T14:41:46.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- 172.21.2.135:0/1716614553 wait complete. 2021-11-15T14:41:46.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 Processor -- start 2021-11-15T14:41:46.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.248+0000 7fa54fea0700 1 -- start start 2021-11-15T14:41:46.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5480b0520 0x7fa548067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548067a60 con 0x7fa5480b0520 2021-11-15T14:41:46.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548063ee0 con 0x7fa5480aa1a0 2021-11-15T14:41:46.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa548064180 con 0x7fa5480b0900 2021-11-15T14:41:46.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32836/0 (socket says 172.21.2.135:32836) 2021-11-15T14:41:46.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 -- 172.21.2.135:0/2298168517 learned_addr learned my addr 172.21.2.135:0/2298168517 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 -- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 msgr2=0x7fa548143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 -- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5480b0520 msgr2=0x7fa548067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5480b0520 0x7fa548067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 -- 172.21.2.135:0/2298168517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c00b460 con 0x7fa5480aa1a0 2021-11-15T14:41:46.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54dc3c700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fa5480b77f0 tx=0x7fa53c006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c01d070 con 0x7fa5480aa1a0 2021-11-15T14:41:46.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c022410 con 0x7fa5480aa1a0 2021-11-15T14:41:46.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa548146360 con 0x7fa5480aa1a0 2021-11-15T14:41:46.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c022770 con 0x7fa5480aa1a0 2021-11-15T14:41:46.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa548064400 con 0x7fa5480aa1a0 2021-11-15T14:41:46.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5480573d0 con 0x7fa5480aa1a0 2021-11-15T14:41:46.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa53c029070 con 0x7fa5480aa1a0 2021-11-15T14:41:46.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 0x7fa528055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa53c06ce50 con 0x7fa5480aa1a0 2021-11-15T14:41:46.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.252+0000 7fa54d43b700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 0x7fa528055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.256+0000 7fa54d43b700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 0x7fa528055b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa544002fb0 tx=0x7fa5440069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.256+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa53c043ea0 con 0x7fa5480aa1a0 2021-11-15T14:41:46.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5480446d0 con 0x7fa5480aa1a0 2021-11-15T14:41:46.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa53affd700 1 -- 172.21.2.135:0/2298168517 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16283 (secure 0 0 0) 0x7fa53c047480 con 0x7fa5480aa1a0 2021-11-15T14:41:46.341 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:46.341 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":102,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:42.033690+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:38.935483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:40.012670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:46.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 msgr2=0x7fa528055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 0x7fa528055b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fa544002fb0 tx=0x7fa5440069b0).stop 2021-11-15T14:41:46.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 msgr2=0x7fa548146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fa5480b77f0 tx=0x7fa53c006f40).stop 2021-11-15T14:41:46.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 shutdown_connections 2021-11-15T14:41:46.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa528053660 0x7fa528055b20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5480b0900 0x7fa548143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa5480b0520 0x7fa548067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 --2- 172.21.2.135:0/2298168517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa5480aa1a0 0x7fa548146c10 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.336+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 >> 172.21.2.135:0/2298168517 conn(0x7fa548060840 msgr2=0x7fa548060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.340+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 shutdown_connections 2021-11-15T14:41:46.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.340+0000 7fa54fea0700 1 -- 172.21.2.135:0/2298168517 wait complete. 2021-11-15T14:41:46.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:38.935483+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:40.012670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:41:46.349 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:46.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 Processor -- start 2021-11-15T14:41:46.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 -- start start 2021-11-15T14:41:46.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 0x7f87ec0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec1439a0 con 0x7f87ec0b0630 2021-11-15T14:41:46.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec143c40 con 0x7f87ec0b3790 2021-11-15T14:41:46.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87f2b03700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec143ee0 con 0x7f87ec0a9c90 2021-11-15T14:41:46.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.396+0000 7f87ebfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f87ec0b3790 0x7f87ec0b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48666/0 (socket says 172.21.2.135:48666) 2021-11-15T14:41:46.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87ebfff700 1 -- 172.21.2.135:0/531407186 learned_addr learned my addr 172.21.2.135:0/531407186 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:46.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996619281 0 0) 0x7f87ec143c40 con 0x7f87ec0b3790 2021-11-15T14:41:46.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87cc003260 con 0x7f87ec0b3790 2021-11-15T14:41:46.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2539874997 0 0) 0x7f87cc003260 con 0x7f87ec0b3790 2021-11-15T14:41:46.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 msgr2=0x7f87ec0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 0x7f87ec0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 >> v1:172.21.2.119:6789/0 conn(0x7f87ec0b0630 legacy=0x7f87ec13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec144180 con 0x7f87ec0b3790 2021-11-15T14:41:46.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f87d4001660 con 0x7f87ec0b3790 2021-11-15T14:41:46.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 >> v1:172.21.2.135:6789/0 conn(0x7f87ec0b3790 legacy=0x7f87ec0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87cc0037d0 0x7f87cc003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 0x7f87cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc004b40 0x7f87cc004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec143ee0 con 0x7f87cc004b40 2021-11-15T14:41:46.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc00b9b0 con 0x7f87cc0037d0 2021-11-15T14:41:46.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc00bb70 con 0x7f87ec0a9c90 2021-11-15T14:41:46.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87cc0037d0 0x7f87cc003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 -- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 msgr2=0x7f87cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec0a9c90 0x7f87cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 -- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc004b40 msgr2=0x7f87cc004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc004b40 0x7f87cc004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 -- 172.21.2.135:0/531407186 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc003260 con 0x7f87cc0037d0 2021-11-15T14:41:46.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f089f700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87cc0037d0 0x7f87cc003bd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f87dc000f70 tx=0x7f87dc0079e0).ready entity=mon.1 client_cookie=29ad9041dcfe2721 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc007cf0 con 0x7f87cc0037d0 2021-11-15T14:41:46.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc014410 con 0x7f87cc0037d0 2021-11-15T14:41:46.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87eb7fe700 1 -- 172.21.2.135:0/531407186 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc014770 con 0x7f87cc0037d0 2021-11-15T14:41:46.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/531407186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87cc0037d0 msgr2=0x7f87cc003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 --2- 172.21.2.135:0/531407186 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87cc0037d0 0x7f87cc003bd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f87dc000f70 tx=0x7f87dc0079e0).stop 2021-11-15T14:41:46.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 -- 172.21.2.135:0/531407186 reap_dead start 2021-11-15T14:41:46.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/531407186 shutdown_connections 2021-11-15T14:41:46.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/531407186 >> 172.21.2.135:0/531407186 conn(0x7f87ec060840 msgr2=0x7f87ec060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/531407186 shutdown_connections 2021-11-15T14:41:46.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/531407186 wait complete. 2021-11-15T14:41:46.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 Processor -- start 2021-11-15T14:41:46.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- start start 2021-11-15T14:41:46.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc0037d0 0x7f87ec0aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec146530 0x7f87ec1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1451f0 con 0x7f87cc0037d0 2021-11-15T14:41:46.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1533b0 con 0x7f87ec066100 2021-11-15T14:41:46.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec146a40 con 0x7f87ec146530 2021-11-15T14:41:46.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32856/0 (socket says 172.21.2.135:32856) 2021-11-15T14:41:46.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 -- 172.21.2.135:0/3613414842 learned_addr learned my addr 172.21.2.135:0/3613414842 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 -- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec146530 msgr2=0x7f87ec1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec146530 0x7f87ec1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 -- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc0037d0 msgr2=0x7f87ec0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc0037d0 0x7f87ec0aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 -- 172.21.2.135:0/3613414842 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec146ce0 con 0x7f87ec066100 2021-11-15T14:41:46.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f10a0700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f87ec1461e0 tx=0x7f87e400a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e400cea0 con 0x7f87ec066100 2021-11-15T14:41:46.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4005c30 con 0x7f87ec066100 2021-11-15T14:41:46.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec152530 con 0x7f87ec066100 2021-11-15T14:41:46.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec146f80 con 0x7f87ec066100 2021-11-15T14:41:46.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e4007070 con 0x7f87ec066100 2021-11-15T14:41:46.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.400+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c4003410 con 0x7f87ec066100 2021-11-15T14:41:46.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f87e401d070 con 0x7f87ec066100 2021-11-15T14:41:46.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87e9ffb700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 0x7f87d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f87e406ac50 con 0x7f87ec066100 2021-11-15T14:41:46.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87f089f700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 0x7f87d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87f089f700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 0x7f87d0055b60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f87dc000f70 tx=0x7f87dc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.404+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f87e4041c00 con 0x7f87ec066100 2021-11-15T14:41:46.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f87c4003c40 con 0x7f87ec066100 2021-11-15T14:41:46.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87e9ffb700 1 -- 172.21.2.135:0/3613414842 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f87e401b030 con 0x7f87ec066100 2021-11-15T14:41:46.492 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:46.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 msgr2=0x7f87d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 0x7f87d0055b60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f87dc000f70 tx=0x7f87dc015000).stop 2021-11-15T14:41:46.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 msgr2=0x7f87ec152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f87ec1461e0 tx=0x7f87e400a060).stop 2021-11-15T14:41:46.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 shutdown_connections 2021-11-15T14:41:46.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f87d00536a0 0x7f87d0055b60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f87ec066100 0x7f87ec152ec0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f87ec146530 0x7f87ec1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 --2- 172.21.2.135:0/3613414842 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f87cc0037d0 0x7f87ec0aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 >> 172.21.2.135:0/3613414842 conn(0x7f87ec060840 msgr2=0x7f87ec135630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 shutdown_connections 2021-11-15T14:41:46.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.488+0000 7f87f2b03700 1 -- 172.21.2.135:0/3613414842 wait complete. 2021-11-15T14:41:46.500 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:46.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 Processor -- start 2021-11-15T14:41:46.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 -- start start 2021-11-15T14:41:46.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa57c0b1f40 0x7fa57c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa57c0b0030 0x7fa57c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c0b04a0 con 0x7fa57c0a7140 2021-11-15T14:41:46.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0b2810 con 0x7fa57c0b0030 2021-11-15T14:41:46.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa582109700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0b06d0 con 0x7fa57c0b1f40 2021-11-15T14:41:46.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa57c0a7140 0x7fa57c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48688/0 (socket says 172.21.2.135:48688) 2021-11-15T14:41:46.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57bfff700 1 -- 172.21.2.135:0/2272013125 learned_addr learned my addr 172.21.2.135:0/2272013125 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:46.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 --2- 172.21.2.135:0/2272013125 >> v2:172.21.2.135:3300/0 conn(0x7fa57c0b1f40 0x7fa57c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 -- 172.21.2.135:0/2272013125 >> v2:172.21.2.119:3300/0 conn(0x7fa57c0b0030 msgr2=0x7fa57c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 --2- 172.21.2.135:0/2272013125 >> v2:172.21.2.119:3300/0 conn(0x7fa57c0b0030 0x7fa57c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 -- 172.21.2.135:0/2272013125 >> v1:172.21.2.135:6789/0 conn(0x7fa57c0a7140 legacy=0x7fa57c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 -- 172.21.2.135:0/2272013125 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0b0970 con 0x7fa57c0b1f40 2021-11-15T14:41:46.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57b7fe700 1 --2- 172.21.2.135:0/2272013125 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c0b1350 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fa56c002f70 tx=0x7fa56c006df0).ready entity=mon.1 client_cookie=2c7a0a144e701859 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57a7fc700 1 -- 172.21.2.135:0/2272013125 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c00d5c0 con 0x7fa57c0b1f40 2021-11-15T14:41:46.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57a7fc700 1 -- 172.21.2.135:0/2272013125 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c000e90 con 0x7fa57c0b1f40 2021-11-15T14:41:46.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.548+0000 7fa57a7fc700 1 -- 172.21.2.135:0/2272013125 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c00d910 con 0x7fa57c0b1f40 2021-11-15T14:41:46.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/2272013125 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 msgr2=0x7fa57c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- 172.21.2.135:0/2272013125 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c0b1350 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fa56c002f70 tx=0x7fa56c006df0).stop 2021-11-15T14:41:46.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/2272013125 shutdown_connections 2021-11-15T14:41:46.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- 172.21.2.135:0/2272013125 >> v2:172.21.2.119:3300/0 conn(0x7fa57c0b0030 0x7fa57c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- 172.21.2.135:0/2272013125 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c0b1350 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/2272013125 >> 172.21.2.135:0/2272013125 conn(0x7fa57c05f730 msgr2=0x7fa57c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/2272013125 shutdown_connections 2021-11-15T14:41:46.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/2272013125 wait complete. 2021-11-15T14:41:46.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 Processor -- start 2021-11-15T14:41:46.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- start start 2021-11-15T14:41:46.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa57c0a7140 0x7fa57c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa57c0b0030 0x7fa57c0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b5b90 con 0x7fa57c0a7140 2021-11-15T14:41:46.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b3290 con 0x7fa57c0b1f40 2021-11-15T14:41:46.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b58f0 con 0x7fa57c0b0030 2021-11-15T14:41:46.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32872/0 (socket says 172.21.2.135:32872) 2021-11-15T14:41:46.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 -- 172.21.2.135:0/552513511 learned_addr learned my addr 172.21.2.135:0/552513511 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 -- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa57c0b0030 msgr2=0x7fa57c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa57c0b0030 0x7fa57c0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 -- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa57c0a7140 msgr2=0x7fa57c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa57c0a7140 0x7fa57c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 -- 172.21.2.135:0/552513511 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c00b180 con 0x7fa57c0b1f40 2021-11-15T14:41:46.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa57bfff700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa57c062f70 tx=0x7fa574007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa574005ba0 con 0x7fa57c0b1f40 2021-11-15T14:41:46.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574005d00 con 0x7fa57c0b1f40 2021-11-15T14:41:46.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c0b3810 con 0x7fa57c0b1f40 2021-11-15T14:41:46.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c14afd0 con 0x7fa57c0b1f40 2021-11-15T14:41:46.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5740072c0 con 0x7fa57c0b1f40 2021-11-15T14:41:46.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0b3560 con 0x7fa57c0b1f40 2021-11-15T14:41:46.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa574010070 con 0x7fa57c0b1f40 2021-11-15T14:41:46.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 0x7fa55c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.552+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa57406b380 con 0x7fa57c0b1f40 2021-11-15T14:41:46.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.556+0000 7fa57b7fe700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 0x7fa55c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.556+0000 7fa57b7fe700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 0x7fa55c055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fa56c002f70 tx=0x7fa56c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.556+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa574042330 con 0x7fa57c0b1f40 2021-11-15T14:41:46.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa57c0b0c10 con 0x7fa57c0b1f40 2021-11-15T14:41:46.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa578ff9700 1 -- 172.21.2.135:0/552513511 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa574045950 con 0x7fa57c0b1f40 2021-11-15T14:41:46.644 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:46.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 msgr2=0x7fa55c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 0x7fa55c055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fa56c002f70 tx=0x7fa56c014000).stop 2021-11-15T14:41:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 msgr2=0x7fa57c063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa57c062f70 tx=0x7fa574007f40).stop 2021-11-15T14:41:46.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 shutdown_connections 2021-11-15T14:41:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa55c0536a0 0x7fa55c055b60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa57c0b1f40 0x7fa57c063360 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa57c0b0030 0x7fa57c0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 --2- 172.21.2.135:0/552513511 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa57c0a7140 0x7fa57c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 >> 172.21.2.135:0/552513511 conn(0x7fa57c05f730 msgr2=0x7fa57c13ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 shutdown_connections 2021-11-15T14:41:46.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.640+0000 7fa582109700 1 -- 172.21.2.135:0/552513511 wait complete. 2021-11-15T14:41:46.651 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:41:46.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 Processor -- start 2021-11-15T14:41:46.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- start start 2021-11-15T14:41:46.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0d140a9f40 0x7f0d140aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0d1413cd50 0x7f0d1413d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d14061a10 con 0x7f0d14060450 2021-11-15T14:41:46.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1405cc20 con 0x7f0d1413cd50 2021-11-15T14:41:46.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d14061cb0 con 0x7f0d140a9f40 2021-11-15T14:41:46.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d127fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0d14060450 0x7f0d1405c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48700/0 (socket says 172.21.2.135:48700) 2021-11-15T14:41:46.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d127fc700 1 -- 172.21.2.135:0/284100756 learned_addr learned my addr 172.21.2.135:0/284100756 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:46.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/284100756 >> v2:172.21.2.135:3300/0 conn(0x7f0d140a9f40 0x7f0d140aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 -- 172.21.2.135:0/284100756 >> v2:172.21.2.119:3300/0 conn(0x7f0d1413cd50 msgr2=0x7f0d1413d1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:46.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/284100756 >> v2:172.21.2.119:3300/0 conn(0x7f0d1413cd50 0x7f0d1413d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 -- 172.21.2.135:0/284100756 >> v1:172.21.2.135:6789/0 conn(0x7f0d14060450 legacy=0x7f0d1405c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 -- 172.21.2.135:0/284100756 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14060c10 con 0x7f0d140a9f40 2021-11-15T14:41:46.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/284100756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d140a9f40 0x7f0d140aa320 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f0d140aab70 tx=0x7f0d04006df0).ready entity=mon.1 client_cookie=71f3fde84b771bd7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d11ffb700 1 -- 172.21.2.135:0/284100756 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0400d5c0 con 0x7f0d140a9f40 2021-11-15T14:41:46.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d11ffb700 1 -- 172.21.2.135:0/284100756 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04000e90 con 0x7f0d140a9f40 2021-11-15T14:41:46.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d11ffb700 1 -- 172.21.2.135:0/284100756 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0400d950 con 0x7f0d140a9f40 2021-11-15T14:41:46.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- 172.21.2.135:0/284100756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d140a9f40 msgr2=0x7f0d140aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 --2- 172.21.2.135:0/284100756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d140a9f40 0x7f0d140aa320 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f0d140aab70 tx=0x7f0d04006df0).stop 2021-11-15T14:41:46.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- 172.21.2.135:0/284100756 shutdown_connections 2021-11-15T14:41:46.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 --2- 172.21.2.135:0/284100756 >> v2:172.21.2.119:3300/0 conn(0x7f0d1413cd50 0x7f0d1413d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 --2- 172.21.2.135:0/284100756 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d140a9f40 0x7f0d140aa320 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- 172.21.2.135:0/284100756 >> 172.21.2.135:0/284100756 conn(0x7f0d140b29f0 msgr2=0x7f0d140b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- 172.21.2.135:0/284100756 shutdown_connections 2021-11-15T14:41:46.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- 172.21.2.135:0/284100756 wait complete. 2021-11-15T14:41:46.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 Processor -- start 2021-11-15T14:41:46.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.700+0000 7f0d1940c700 1 -- start start 2021-11-15T14:41:46.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d140a9f40 0x7f0d140aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d1413cd50 0x7f0d140af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140ad260 con 0x7f0d140a9f40 2021-11-15T14:41:46.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140ad500 con 0x7f0d14060450 2021-11-15T14:41:46.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141401d0 con 0x7f0d1413cd50 2021-11-15T14:41:46.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32886/0 (socket says 172.21.2.135:32886) 2021-11-15T14:41:46.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 -- 172.21.2.135:0/3210930240 learned_addr learned my addr 172.21.2.135:0/3210930240 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 -- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d1413cd50 msgr2=0x7f0d140af2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:46.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d1413cd50 0x7f0d140af2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 -- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d140a9f40 msgr2=0x7f0d140aee00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:46.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d140a9f40 0x7f0d140aee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 -- 172.21.2.135:0/3210930240 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0400b180 con 0x7f0d14060450 2021-11-15T14:41:46.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d12ffd700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0d140aab70 tx=0x7f0d04012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d04016070 con 0x7f0d14060450 2021-11-15T14:41:46.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04002f70 con 0x7f0d14060450 2021-11-15T14:41:46.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d04013f00 con 0x7f0d14060450 2021-11-15T14:41:46.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14140470 con 0x7f0d14060450 2021-11-15T14:41:46.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1415a740 con 0x7f0d14060450 2021-11-15T14:41:46.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1413e930 con 0x7f0d14060450 2021-11-15T14:41:46.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d04025030 con 0x7f0d14060450 2021-11-15T14:41:46.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 0x7f0cf8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0d0406ce50 con 0x7f0d14060450 2021-11-15T14:41:46.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d127fc700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 0x7f0cf8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.704+0000 7f0d127fc700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 0x7f0cf8055a90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0d140abcc0 tx=0x7f0cfc007790).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.708+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d04043d50 con 0x7f0d14060450 2021-11-15T14:41:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.788+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d14060eb0 con 0x7f0d14060450 2021-11-15T14:41:46.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.788+0000 7f0d0bfff700 1 -- 172.21.2.135:0/3210930240 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0d0406e020 con 0x7f0d14060450 2021-11-15T14:41:46.794 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:46.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 msgr2=0x7f0cf8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 0x7f0cf8055a90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0d140abcc0 tx=0x7f0cfc007790).stop 2021-11-15T14:41:46.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 msgr2=0x7f0d14142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f0d140aab70 tx=0x7f0d04012000).stop 2021-11-15T14:41:46.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 shutdown_connections 2021-11-15T14:41:46.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0cf80535d0 0x7f0cf8055a90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0d1413cd50 0x7f0d140af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0d140a9f40 0x7f0d140aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 --2- 172.21.2.135:0/3210930240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0d14060450 0x7f0d14142550 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 >> 172.21.2.135:0/3210930240 conn(0x7f0d140b29f0 msgr2=0x7f0d140b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 shutdown_connections 2021-11-15T14:41:46.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.792+0000 7f0d1940c700 1 -- 172.21.2.135:0/3210930240 wait complete. 2021-11-15T14:41:46.802 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:41:46.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 Processor -- start 2021-11-15T14:41:46.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- start start 2021-11-15T14:41:46.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 0x7fc3f00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f00a7850 con 0x7fc3f00b1f40 2021-11-15T14:41:46.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f00b06d0 con 0x7fc3f00b1350 2021-11-15T14:41:46.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00b17c0 con 0x7fc3f01419e0 2021-11-15T14:41:46.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3edd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc3f00b1350 0x7fc3f01412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48716/0 (socket says 172.21.2.135:48716) 2021-11-15T14:41:46.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3edd9b700 1 -- 172.21.2.135:0/3306790317 learned_addr learned my addr 172.21.2.135:0/3306790317 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:46.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619180175 0 0) 0x7fc3f00b06d0 con 0x7fc3f00b1350 2021-11-15T14:41:46.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3d0003260 con 0x7fc3f00b1350 2021-11-15T14:41:46.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3eed9d700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 0x7fc3f00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661349369 0 0) 0x7fc3d0003260 con 0x7fc3f00b1350 2021-11-15T14:41:46.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 msgr2=0x7fc3f00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 0x7fc3f00b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 >> v1:172.21.2.119:6789/0 conn(0x7fc3f00b1f40 legacy=0x7fc3f00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f00b0970 con 0x7fc3f00b1350 2021-11-15T14:41:46.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc3d8001660 con 0x7fc3f00b1350 2021-11-15T14:41:46.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 >> v1:172.21.2.135:6789/0 conn(0x7fc3f00b1350 legacy=0x7fc3f01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3d0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 0x7fc3d0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3d0004a60 0x7fc3d0004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00b17c0 con 0x7fc3d0004a60 2021-11-15T14:41:46.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d000b8e0 con 0x7fc3d00037d0 2021-11-15T14:41:46.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d000baa0 con 0x7fc3f01419e0 2021-11-15T14:41:46.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3d0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 -- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 msgr2=0x7fc3d0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f01419e0 0x7fc3d0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 -- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3d0004a60 msgr2=0x7fc3d0004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:46.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3d0004a60 0x7fc3d0004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 -- 172.21.2.135:0/3306790317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0003260 con 0x7fc3d00037d0 2021-11-15T14:41:46.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3d0003bd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fc3e0001fa0 tx=0x7fc3e0007a00).ready entity=mon.1 client_cookie=3fdbdc88f7689f67 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0007070 con 0x7fc3d00037d0 2021-11-15T14:41:46.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e00071d0 con 0x7fc3d00037d0 2021-11-15T14:41:46.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3ed59a700 1 -- 172.21.2.135:0/3306790317 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0006510 con 0x7fc3d00037d0 2021-11-15T14:41:46.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/3306790317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 msgr2=0x7fc3d0003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/3306790317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3d0003bd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fc3e0001fa0 tx=0x7fc3e0007a00).stop 2021-11-15T14:41:46.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3eed9d700 1 -- 172.21.2.135:0/3306790317 reap_dead start 2021-11-15T14:41:46.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/3306790317 shutdown_connections 2021-11-15T14:41:46.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/3306790317 >> 172.21.2.135:0/3306790317 conn(0x7fc3f005f730 msgr2=0x7fc3f005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/3306790317 shutdown_connections 2021-11-15T14:41:46.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.852+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/3306790317 wait complete. 2021-11-15T14:41:46.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 Processor -- start 2021-11-15T14:41:46.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- start start 2021-11-15T14:41:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f0148a60 0x7fc3f01499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3f0149ea0 0x7fc3f00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f014a320 con 0x7fc3f0149ea0 2021-11-15T14:41:46.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f015a110 con 0x7fc3d00037d0 2021-11-15T14:41:46.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f015a3b0 con 0x7fc3f0148a60 2021-11-15T14:41:46.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32904/0 (socket says 172.21.2.135:32904) 2021-11-15T14:41:46.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 -- 172.21.2.135:0/1854048227 learned_addr learned my addr 172.21.2.135:0/1854048227 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:46.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 -- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f0148a60 msgr2=0x7fc3f01499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f0148a60 0x7fc3f01499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 -- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3f0149ea0 msgr2=0x7fc3f00b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3f0149ea0 0x7fc3f00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 -- 172.21.2.135:0/1854048227 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f015a650 con 0x7fc3d00037d0 2021-11-15T14:41:46.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3ee59c700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fc3e0001fa0 tx=0x7fc3e0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0014810 con 0x7fc3d00037d0 2021-11-15T14:41:46.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0006e90 con 0x7fc3d00037d0 2021-11-15T14:41:46.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f015a8f0 con 0x7fc3d00037d0 2021-11-15T14:41:46.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0014b60 con 0x7fc3d00037d0 2021-11-15T14:41:46.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f00ab070 con 0x7fc3d00037d0 2021-11-15T14:41:46.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f015a110 con 0x7fc3d00037d0 2021-11-15T14:41:46.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3e001d070 con 0x7fc3d00037d0 2021-11-15T14:41:46.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 0x7fc3d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:46.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc3e006c780 con 0x7fc3d00037d0 2021-11-15T14:41:46.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.856+0000 7fc3edd9b700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 0x7fc3d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:46.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.860+0000 7fc3edd9b700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 0x7fc3d4055b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc3f00b2fd0 tx=0x7fc3f00b2a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:46.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.860+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3e0043680 con 0x7fc3d00037d0 2021-11-15T14:41:46.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3f015aa80 con 0x7fc3d00037d0 2021-11-15T14:41:46.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3e77fe700 1 -- 172.21.2.135:0/1854048227 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc3e0046ca0 con 0x7fc3d00037d0 2021-11-15T14:41:46.948 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:46.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 msgr2=0x7fc3d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 0x7fc3d4055b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc3f00b2fd0 tx=0x7fc3f00b2a80).stop 2021-11-15T14:41:46.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 msgr2=0x7fc3f00abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:46.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fc3e0001fa0 tx=0x7fc3e0015000).stop 2021-11-15T14:41:46.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 shutdown_connections 2021-11-15T14:41:46.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3d4053640 0x7fc3d4055b00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc3f0149ea0 0x7fc3f00b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc3f0148a60 0x7fc3f01499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:46.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 --2- 172.21.2.135:0/1854048227 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc3d00037d0 0x7fc3f00abdd0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:46.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 >> 172.21.2.135:0/1854048227 conn(0x7fc3f005f730 msgr2=0x7fc3f013f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:46.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 shutdown_connections 2021-11-15T14:41:46.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:46.944+0000 7fc3f4ff2700 1 -- 172.21.2.135:0/1854048227 wait complete. 2021-11-15T14:41:46.955 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:41:46.956 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:47.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 Processor -- start 2021-11-15T14:41:47.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- start start 2021-11-15T14:41:47.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd0840b6600 0x7fd0840b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd084144130 con 0x7fd0840b69e0 2021-11-15T14:41:47.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd084143bf0 con 0x7fd0840b4440 2021-11-15T14:41:47.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd084143e90 con 0x7fd0840b6600 2021-11-15T14:41:47.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd0840b4440 0x7fd084061db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48732/0 (socket says 172.21.2.135:48732) 2021-11-15T14:41:47.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 -- 172.21.2.135:0/2514739089 learned_addr learned my addr 172.21.2.135:0/2514739089 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:47.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729487942 0 0) 0x7fd084143bf0 con 0x7fd0840b4440 2021-11-15T14:41:47.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06c003260 con 0x7fd0840b4440 2021-11-15T14:41:47.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161386385 0 0) 0x7fd06c003260 con 0x7fd0840b4440 2021-11-15T14:41:47.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 >> v2:172.21.2.119:3300/0 conn(0x7fd0840b6600 msgr2=0x7fd0840b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:47.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 --2- 172.21.2.135:0/2514739089 >> v2:172.21.2.119:3300/0 conn(0x7fd0840b6600 0x7fd0840b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 >> v1:172.21.2.119:6789/0 conn(0x7fd0840b69e0 legacy=0x7fd08412ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:47.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084061670 con 0x7fd0840b4440 2021-11-15T14:41:47.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd078001660 con 0x7fd0840b4440 2021-11-15T14:41:47.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 >> v1:172.21.2.135:6789/0 conn(0x7fd0840b4440 legacy=0x7fd084061db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd06c003820 0x7fd06c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 0x7fd06c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c005050 0x7fd06c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd084143e90 con 0x7fd06c003820 2021-11-15T14:41:47.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00bf40 con 0x7fd06c004500 2021-11-15T14:41:47.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00c100 con 0x7fd06c005050 2021-11-15T14:41:47.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 0x7fd06c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:47.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 -- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c005050 msgr2=0x7fd06c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:47.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c005050 0x7fd06c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 -- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd06c003820 msgr2=0x7fd06c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:47.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd06c003820 0x7fd06c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 -- 172.21.2.135:0/2514739089 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c003260 con 0x7fd06c004500 2021-11-15T14:41:47.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd089be6700 1 -- 172.21.2.135:0/2514739089 reap_dead start 2021-11-15T14:41:47.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd088be4700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 0x7fd06c004980 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fd0841431a0 tx=0x7fd084061800).ready entity=mon.1 client_cookie=588109249cfbb36e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:47.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0780070d0 con 0x7fd06c004500 2021-11-15T14:41:47.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078007230 con 0x7fd06c004500 2021-11-15T14:41:47.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd077fff700 1 -- 172.21.2.135:0/2514739089 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07800c8c0 con 0x7fd06c004500 2021-11-15T14:41:47.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 msgr2=0x7fd06c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 0x7fd06c004980 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7fd0841431a0 tx=0x7fd084061800).stop 2021-11-15T14:41:47.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- 172.21.2.135:0/2514739089 shutdown_connections 2021-11-15T14:41:47.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 --2- 172.21.2.135:0/2514739089 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd06c004500 0x7fd06c004980 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:47.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- 172.21.2.135:0/2514739089 >> 172.21.2.135:0/2514739089 conn(0x7fd08405c510 msgr2=0x7fd08405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:47.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- 172.21.2.135:0/2514739089 shutdown_connections 2021-11-15T14:41:47.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- 172.21.2.135:0/2514739089 wait complete. 2021-11-15T14:41:47.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 Processor -- start 2021-11-15T14:41:47.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.004+0000 7fd08b649700 1 -- start start 2021-11-15T14:41:47.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c004500 0x7fd084129f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd084152360 0x7fd0841527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b3c30 con 0x7fd084152360 2021-11-15T14:41:47.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840afe60 con 0x7fd0840b3630 2021-11-15T14:41:47.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd084156640 con 0x7fd06c004500 2021-11-15T14:41:47.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:47.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32926/0 (socket says 172.21.2.135:32926) 2021-11-15T14:41:47.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 -- 172.21.2.135:0/2820662593 learned_addr learned my addr 172.21.2.135:0/2820662593 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:47.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 -- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c004500 msgr2=0x7fd084129f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c004500 0x7fd084129f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 -- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd084152360 msgr2=0x7fd0841527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd084152360 0x7fd0841527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 -- 172.21.2.135:0/2820662593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840b0200 con 0x7fd0840b3630 2021-11-15T14:41:47.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd088be4700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fd0841431a0 tx=0x7fd078013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:47.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0780070d0 con 0x7fd0840b3630 2021-11-15T14:41:47.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078018070 con 0x7fd0840b3630 2021-11-15T14:41:47.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd078004920 con 0x7fd0840b3630 2021-11-15T14:41:47.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840b04a0 con 0x7fd0840b3630 2021-11-15T14:41:47.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08412b580 con 0x7fd0840b3630 2021-11-15T14:41:47.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd084061910 con 0x7fd0840b3630 2021-11-15T14:41:47.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd078025070 con 0x7fd0840b3630 2021-11-15T14:41:47.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 0x7fd064055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:47.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd07806bf10 con 0x7fd0840b3630 2021-11-15T14:41:47.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0893e5700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 0x7fd064055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:47.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.008+0000 7fd0893e5700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 0x7fd064055a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fd080002f70 tx=0x7fd080006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:47.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.012+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd078042fd0 con 0x7fd0840b3630 2021-11-15T14:41:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.120+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0840573d0 con 0x7fd0840b3630 2021-11-15T14:41:47.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.120+0000 7fd0767fc700 1 -- 172.21.2.135:0/2820662593 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fd0780465f0 con 0x7fd0840b3630 2021-11-15T14:41:47.126 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:47.126 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 msgr2=0x7fd064055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 0x7fd064055a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fd080002f70 tx=0x7fd080006a00).stop 2021-11-15T14:41:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 msgr2=0x7fd084128b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fd0841431a0 tx=0x7fd078013000).stop 2021-11-15T14:41:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 shutdown_connections 2021-11-15T14:41:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd064053580 0x7fd064055a40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd084152360 0x7fd0841527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0840b3630 0x7fd084128b30 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 --2- 172.21.2.135:0/2820662593 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd06c004500 0x7fd084129f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 >> 172.21.2.135:0/2820662593 conn(0x7fd08405c510 msgr2=0x7fd0841435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 shutdown_connections 2021-11-15T14:41:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:47.124+0000 7fd08b649700 1 -- 172.21.2.135:0/2820662593 wait complete. 2021-11-15T14:41:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:47.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:41:41.027941+0000', 'modified': '2021-11-15T14:41:42.032548+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6934}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6934': {'gid': 6934, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/4146626151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 4146626151}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 4146626151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:41:47.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:41:47.436 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:41:47.515 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":6934,"want_state":"up:active","state":"up:active","rank_uptime":6.4767908270000003,"mdsmap_epoch":48,"osdmap_epoch":102,"osdmap_epoch_barrier":101,"uptime":10.673582457} 2021-11-15T14:41:47.516 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 6934, "mdsmap_epoch": 48, "osdmap_epoch": 102, "osdmap_epoch_barrier": 101, "rank_uptime": 6.476790827, "state": "up:active", "uptime": 10.673582457, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:41:47.516 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:41:47.517 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:41:47.517 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:41:47.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.518 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:47.529 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:41:47.540 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:47.541 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:47.547 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:47.548 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:47.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.549 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:41:47.596 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:41:47.596 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:47.599 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:41:47.609 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:41:47.609 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:41:47.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14365]: starting ceph client 2021-11-15T14:41:47.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:41:47.629+0000 7f1540349080 -1 init, newargv = 0x55a64648f9e0 newargc=9 2021-11-15T14:41:47.644 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:41:47.644 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:41:47.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.645 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:41:47.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14365]: starting fuse 2021-11-15T14:41:47.655 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:41:47.655 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:41:47.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.656 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:41:47.656 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:41:47.657 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:41:47.657 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:41:47.657 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:41:47.658 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:47.658 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:41:47.659 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:41:47.659 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:41:47.659 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:47.660 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:41:47.660 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:41:47.661 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:41:47.661 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:41:47.661 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:47.662 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:41:47.662 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:41:47.663 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:41:47.663 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:41:47.663 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:41:47.664 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:41:47.664 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:41:47.665 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:41:47.717 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14365.asok 2021-11-15T14:41:47.720 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14365.asok 2021-11-15T14:41:47.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.721 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14365.asok status 2021-11-15T14:41:47.775 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:41:47.775 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:41:47.775 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:41:47.775 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:41:47.776 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:41:47.776 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:41:47.776 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:41:47.776 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14365", 2021-11-15T14:41:47.776 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:41:47.777 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:47.777 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:41:47.777 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:41:47.777 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 4995, 2021-11-15T14:41:47.777 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:41:47.778 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:41:47.778 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:41:47.778 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 4995 2021-11-15T14:41:47.778 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:47.779 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:41:47.779 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:41:47.779 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:41:47.779 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3544165300 2021-11-15T14:41:47.780 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:41:47.780 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:47.780 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:41:47.780 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:41:47.780 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:41:47.781 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3544165300 2021-11-15T14:41:47.781 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:41:47.781 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.4995 172.21.2.132:0/3544165300", 2021-11-15T14:41:47.781 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3544165300", 2021-11-15T14:41:47.782 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:41:47.782 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 48, 2021-11-15T14:41:47.782 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 102, 2021-11-15T14:41:47.782 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:41:47.782 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:41:47.783 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:41:47.783 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:41:47.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.784 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:47.785 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:47.790 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:41:47.790 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:47.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:47.791 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:47.840 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T14:41:47.840 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-11-15T14:41:47.877 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:41:47.878 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:41:47.878 DEBUG:teuthology.orchestra.run.gibba038:> import stat 2021-11-15T14:41:47.878 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:41:47.879 DEBUG:teuthology.orchestra.run.gibba038:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-11-15T14:41:47.879 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:41:47.915 INFO:teuthology.orchestra.run.gibba038.stdout:1099511627776 2021-11-15T14:41:48.124 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:48.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 Processor -- start 2021-11-15T14:41:48.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- start start 2021-11-15T14:41:48.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe9b80a9f30 0x7fe9b80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe9b80b31b0 0x7fe9b80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80aa310 con 0x7fe9b814b5e0 2021-11-15T14:41:48.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b80ae380 con 0x7fe9b80a9f30 2021-11-15T14:41:48.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b80af5e0 con 0x7fe9b80b31b0 2021-11-15T14:41:48.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe9b80b31b0 0x7fe9b80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe9b80b31b0 0x7fe9b80af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32936/0 (socket says 172.21.2.135:32936) 2021-11-15T14:41:48.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 -- 172.21.2.135:0/3349480116 learned_addr learned my addr 172.21.2.135:0/3349480116 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:48.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 -- 172.21.2.135:0/3349480116 >> v2:172.21.2.119:3300/0 conn(0x7fe9b80a9f30 msgr2=0x7fe9b80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 --2- 172.21.2.135:0/3349480116 >> v2:172.21.2.119:3300/0 conn(0x7fe9b80a9f30 0x7fe9b80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 -- 172.21.2.135:0/3349480116 >> v1:172.21.2.119:6789/0 conn(0x7fe9b814b5e0 legacy=0x7fe9b805f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 -- 172.21.2.135:0/3349480116 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b81481f0 con 0x7fe9b80b31b0 2021-11-15T14:41:48.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b7fff700 1 --2- 172.21.2.135:0/3349480116 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80b31b0 0x7fe9b80af0f0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe9b80b77f0 tx=0x7fe9ac006eb0).ready entity=mon.1 client_cookie=eeb85c555890c8c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b77fe700 1 -- 172.21.2.135:0/3349480116 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ac00d5c0 con 0x7fe9b80b31b0 2021-11-15T14:41:48.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b77fe700 1 -- 172.21.2.135:0/3349480116 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac000e90 con 0x7fe9b80b31b0 2021-11-15T14:41:48.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9b77fe700 1 -- 172.21.2.135:0/3349480116 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ac00d910 con 0x7fe9b80b31b0 2021-11-15T14:41:48.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- 172.21.2.135:0/3349480116 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80b31b0 msgr2=0x7fe9b80af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3349480116 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80b31b0 0x7fe9b80af0f0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe9b80b77f0 tx=0x7fe9ac006eb0).stop 2021-11-15T14:41:48.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- 172.21.2.135:0/3349480116 shutdown_connections 2021-11-15T14:41:48.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3349480116 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80b31b0 0x7fe9b80af0f0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:48.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3349480116 >> v2:172.21.2.119:3300/0 conn(0x7fe9b80a9f30 0x7fe9b80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- 172.21.2.135:0/3349480116 >> 172.21.2.135:0/3349480116 conn(0x7fe9b8060840 msgr2=0x7fe9b8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:48.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- 172.21.2.135:0/3349480116 shutdown_connections 2021-11-15T14:41:48.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.176+0000 7fe9befc3700 1 -- 172.21.2.135:0/3349480116 wait complete. 2021-11-15T14:41:48.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 Processor -- start 2021-11-15T14:41:48.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- start start 2021-11-15T14:41:48.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9b80b31b0 0x7fe9b80b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9b814b5e0 0x7fe9b80b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8142420 con 0x7fe9b814b5e0 2021-11-15T14:41:48.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81431c0 con 0x7fe9b80a9f30 2021-11-15T14:41:48.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8148a80 con 0x7fe9b80b31b0 2021-11-15T14:41:48.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32938/0 (socket says 172.21.2.135:32938) 2021-11-15T14:41:48.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 -- 172.21.2.135:0/3607738271 learned_addr learned my addr 172.21.2.135:0/3607738271 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:48.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 -- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9b80b31b0 msgr2=0x7fe9b80b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9b80b31b0 0x7fe9b80b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 -- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9b814b5e0 msgr2=0x7fe9b80b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9b814b5e0 0x7fe9b80b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 -- 172.21.2.135:0/3607738271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac00b1e0 con 0x7fe9b80a9f30 2021-11-15T14:41:48.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9bcd5f700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe9a8002f70 tx=0x7fe9a8006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a8013460 con 0x7fe9b80a9f30 2021-11-15T14:41:48.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a80135c0 con 0x7fe9b80a9f30 2021-11-15T14:41:48.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b8148d20 con 0x7fe9b80a9f30 2021-11-15T14:41:48.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b80b1a40 con 0x7fe9b80a9f30 2021-11-15T14:41:48.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a8013920 con 0x7fe9b80a9f30 2021-11-15T14:41:48.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80b2d20 con 0x7fe9b80a9f30 2021-11-15T14:41:48.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9a801a060 con 0x7fe9b80a9f30 2021-11-15T14:41:48.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 0x7fe998055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe9a806b5b0 con 0x7fe9b80a9f30 2021-11-15T14:41:48.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.180+0000 7fe9b7fff700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 0x7fe998055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.184+0000 7fe9b7fff700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 0x7fe998055be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe9b80b77f0 tx=0x7fe9ac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.184+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9a80424b0 con 0x7fe9b80a9f30 2021-11-15T14:41:48.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.288+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9b8148490 con 0x7fe9b80a9f30 2021-11-15T14:41:48.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9b5ffb700 1 -- 172.21.2.135:0/3607738271 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fe9a8018090 con 0x7fe9b80a9f30 2021-11-15T14:41:48.295 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:48.295 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:48.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 msgr2=0x7fe998055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 0x7fe998055be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe9b80b77f0 tx=0x7fe9ac015000).stop 2021-11-15T14:41:48.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 msgr2=0x7fe9b814e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe9a8002f70 tx=0x7fe9a8006e20).stop 2021-11-15T14:41:48.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 shutdown_connections 2021-11-15T14:41:48.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe998053720 0x7fe998055be0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:48.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9b814b5e0 0x7fe9b80b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9b80b31b0 0x7fe9b80b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 --2- 172.21.2.135:0/3607738271 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9b80a9f30 0x7fe9b814e800 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:48.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 >> 172.21.2.135:0/3607738271 conn(0x7fe9b8060840 msgr2=0x7fe9b80afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:48.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 shutdown_connections 2021-11-15T14:41:48.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.292+0000 7fe9befc3700 1 -- 172.21.2.135:0/3607738271 wait complete. 2021-11-15T14:41:48.299 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:48.302 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 0x10000000000 2021-11-15T14:41:48.360 INFO:teuthology.orchestra.run.gibba035.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-11-15T14:41:47.871116+0000","btime":"2021-11-15T14:41:47.871116+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-15T14:41:47.871116+0000","atime":"2021-11-15T14:41:47.871116+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4989,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":4989,"want_loner":4989,"mds_caps_wanted":[]} 2021-11-15T14:41:48.361 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-11-15T14:41:47.871116+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-11-15T14:41:47.871116+0000", "change_attr": 0, "client_caps": [ { "client_id": 4989, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-15T14:41:47.871116+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4989, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-11-15T14:41:47.871116+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 4989, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-11-15T14:41:48.361 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:48.362 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:48.375 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:48.388 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:48.397 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:48.410 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:48.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:48.411 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:48.411 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:48.415 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:41:48.415 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:48.416 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:41:48.416 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:48.417 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:48.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14842]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:48.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:48.423 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:48.424 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:48.496 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:41:48.496 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:48.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:48.497 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:48.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:48.503 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:48.504 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:48.515 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:41:48.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:48.516 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:41:48.517 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:41:48.517 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:48.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14365]: fuse finished with error 0 and tester_r 0 2021-11-15T14:41:48.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:48.574 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:48.574 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:48.578 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:41:48.579 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:41:48.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:41:48.636 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:48.640 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:48.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 Processor -- start 2021-11-15T14:41:48.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 -- start start 2021-11-15T14:41:48.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2a600b2280 0x7f2a600abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a601452d0 con 0x7f2a60141e30 2021-11-15T14:41:48.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a60145570 con 0x7f2a600b0050 2021-11-15T14:41:48.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a672b0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a60141280 con 0x7f2a600b2280 2021-11-15T14:41:48.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6484b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2a600b0050 0x7f2a60141720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48768/0 (socket says 172.21.2.135:48768) 2021-11-15T14:41:48.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6484b700 1 -- 172.21.2.135:0/2481167463 learned_addr learned my addr 172.21.2.135:0/2481167463 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:48.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140274996 0 0) 0x7f2a60145570 con 0x7f2a600b0050 2021-11-15T14:41:48.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a48003260 con 0x7f2a600b0050 2021-11-15T14:41:48.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 --2- 172.21.2.135:0/2481167463 >> v2:172.21.2.119:3300/0 conn(0x7f2a600b2280 0x7f2a600abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659987884 0 0) 0x7f2a48003260 con 0x7f2a600b0050 2021-11-15T14:41:48.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 >> v2:172.21.2.119:3300/0 conn(0x7f2a600b2280 msgr2=0x7f2a600abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 --2- 172.21.2.135:0/2481167463 >> v2:172.21.2.119:3300/0 conn(0x7f2a600b2280 0x7f2a600abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:48.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 >> v1:172.21.2.119:6789/0 conn(0x7f2a60141e30 legacy=0x7f2a6014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600b0560 con 0x7f2a600b0050 2021-11-15T14:41:48.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2a50001660 con 0x7f2a600b0050 2021-11-15T14:41:48.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 >> v1:172.21.2.135:6789/0 conn(0x7f2a600b0050 legacy=0x7f2a60141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 0x7f2a48003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a48004500 0x7f2a48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48004f70 0x7f2a4800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60141280 con 0x7f2a48004500 2021-11-15T14:41:48.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a48010260 con 0x7f2a48003820 2021-11-15T14:41:48.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a48010420 con 0x7f2a48004f70 2021-11-15T14:41:48.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 0x7f2a48003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 -- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48004f70 msgr2=0x7f2a4800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48004f70 0x7f2a4800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 -- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a48004500 msgr2=0x7f2a48004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:48.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a48004500 0x7f2a48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 -- 172.21.2.135:0/2481167463 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48003260 con 0x7f2a48003820 2021-11-15T14:41:48.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6584d700 1 -- 172.21.2.135:0/2481167463 reap_dead start 2021-11-15T14:41:48.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a6504c700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 0x7f2a48003c20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f2a5c00a000 tx=0x7f2a5c008040).ready entity=mon.1 client_cookie=9dc1991a2b513e86 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5c013670 con 0x7f2a48003820 2021-11-15T14:41:48.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0137d0 con 0x7f2a48003820 2021-11-15T14:41:48.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.692+0000 7f2a4ffff700 1 -- 172.21.2.135:0/2481167463 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5c013b30 con 0x7f2a48003820 2021-11-15T14:41:48.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 msgr2=0x7f2a48003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 0x7f2a48003c20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f2a5c00a000 tx=0x7f2a5c008040).stop 2021-11-15T14:41:48.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/2481167463 shutdown_connections 2021-11-15T14:41:48.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 --2- 172.21.2.135:0/2481167463 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a48003820 0x7f2a48003c20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:48.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/2481167463 >> 172.21.2.135:0/2481167463 conn(0x7f2a6005f730 msgr2=0x7f2a6005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:48.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/2481167463 shutdown_connections 2021-11-15T14:41:48.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/2481167463 wait complete. 2021-11-15T14:41:48.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 Processor -- start 2021-11-15T14:41:48.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- start start 2021-11-15T14:41:48.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48003820 0x7f2a600ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a600abb10 0x7f2a6014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600ad200 con 0x7f2a600abb10 2021-11-15T14:41:48.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600ac190 con 0x7f2a6013e760 2021-11-15T14:41:48.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600ac430 con 0x7f2a48003820 2021-11-15T14:41:48.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32960/0 (socket says 172.21.2.135:32960) 2021-11-15T14:41:48.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 -- 172.21.2.135:0/3744985924 learned_addr learned my addr 172.21.2.135:0/3744985924 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:48.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 -- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48003820 msgr2=0x7f2a600ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48003820 0x7f2a600ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 -- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a600abb10 msgr2=0x7f2a6014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:48.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a600abb10 0x7f2a6014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:48.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 -- 172.21.2.135:0/3744985924 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600acd60 con 0x7f2a6013e760 2021-11-15T14:41:48.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a6484b700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f2a600afd10 tx=0x7f2a50001ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a50007170 con 0x7f2a6013e760 2021-11-15T14:41:48.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500072d0 con 0x7f2a6013e760 2021-11-15T14:41:48.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a50004920 con 0x7f2a6013e760 2021-11-15T14:41:48.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6013da70 con 0x7f2a6013e760 2021-11-15T14:41:48.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a60151700 con 0x7f2a6013e760 2021-11-15T14:41:48.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600acef0 con 0x7f2a6013e760 2021-11-15T14:41:48.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a50004a80 con 0x7f2a6013e760 2021-11-15T14:41:48.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 0x7f2a40055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:48.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.696+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2a5006b910 con 0x7f2a6013e760 2021-11-15T14:41:48.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.700+0000 7f2a6504c700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 0x7f2a40055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:48.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.700+0000 7f2a6504c700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 0x7f2a40055b60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f2a5c00a000 tx=0x7f2a5c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:48.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.700+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a50042790 con 0x7f2a6013e760 2021-11-15T14:41:48.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.780+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2a600573d0 con 0x7f2a6013e760 2021-11-15T14:41:48.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a4e7fc700 1 -- 172.21.2.135:0/3744985924 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+34049 (secure 0 0 0) 0x7f2a50045db0 con 0x7f2a6013e760 2021-11-15T14:41:48.787 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:48.787 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:48.788 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 102, 2021-11-15T14:41:48.788 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:48.788 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:48.788 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:41:42.033690+0000", 2021-11-15T14:41:48.789 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:48.789 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:48.789 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:48.789 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:48.789 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:48.790 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:48.790 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:48.790 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:48.790 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:48.791 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:48.791 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:48.791 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:48.791 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:48.792 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:48.792 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:48.792 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 18, 2021-11-15T14:41:48.792 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:48.792 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:48.793 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:48.793 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:48.793 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:48.793 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.793 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:48.794 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:48.794 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:48.794 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:48.794 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:48.795 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:48.795 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:48.795 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:48.795 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:48.795 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:48.796 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:48.796 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:48.796 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:48.796 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:48.796 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:48.797 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:48.797 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:48.797 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:48.797 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:48.797 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:48.798 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:48.798 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:48.798 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:48.798 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.799 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:48.799 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:48.799 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:48.799 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:48.799 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:48.800 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:48.800 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:48.800 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:48.800 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:48.800 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:48.801 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:48.801 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:48.801 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:48.801 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:48.802 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:48.802 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:48.802 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:48.802 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:48.802 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:48.803 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:48.803 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:48.803 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:48.803 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:48.804 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:48.804 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:48.804 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:48.804 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:48.804 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.805 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:48.805 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:48.805 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:48.805 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:48.806 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:48.806 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:48.806 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:48.806 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:48.806 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:48.807 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:48.807 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:48.807 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:48.807 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:48.808 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.808 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:48.808 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:48.808 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.808 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.809 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.809 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:48.809 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:48.809 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:48.810 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:48.810 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:48.810 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:48.810 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:48.810 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:48.811 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:48.811 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:48.811 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:48.811 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:48.812 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:48.812 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:48.812 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:48.812 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:48.813 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:48.813 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:48.813 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:48.813 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:48.813 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:48.814 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:48.814 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:48.814 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.814 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:48.815 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:48.815 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:48.815 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:48.815 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:48.816 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:48.816 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:48.816 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:48.816 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:48.816 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:48.817 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:48.817 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:48.817 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:48.817 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:48.818 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:48.818 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:48.818 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:48.818 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:48.819 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:48.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:48.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:48.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:48.819 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:48.820 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:48.820 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:48.820 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:48.820 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:48.821 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.821 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:48.821 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:48.821 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:48.821 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:48.822 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:48.822 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:48.822 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:48.822 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:48.822 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:48.823 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:48.823 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:48.823 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:48.823 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:48.824 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:48.824 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.824 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.824 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.824 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 17, 2021-11-15T14:41:48.825 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:41:48.825 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:38.935483+0000", 2021-11-15T14:41:48.825 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:48.825 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:48.826 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:48.826 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:48.826 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:48.826 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:48.827 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:48.827 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:48.827 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:48.827 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:48.827 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:48.828 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:48.828 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:48.828 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:48.828 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:48.829 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:48.829 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:48.829 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:48.829 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:48.829 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:48.830 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.830 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "101", 2021-11-15T14:41:48.830 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:48.830 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:48.831 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:48.831 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:48.831 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:48.831 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:48.831 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:48.832 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:48.832 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:48.832 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:48.832 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:48.832 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:48.833 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:48.833 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:48.833 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:48.833 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:48.834 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:48.834 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:48.834 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:48.834 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:48.834 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:48.835 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:48.835 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:48.835 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:48.835 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:48.835 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:48.836 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.836 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:48.836 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:48.836 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:48.836 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:48.837 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:48.837 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:48.837 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:48.837 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:48.837 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:48.838 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:48.838 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:48.838 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:48.838 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:41:48.838 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:41:48.839 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:41:48.839 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.839 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:48.839 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:48.840 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:41:48.840 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.840 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.840 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.840 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.841 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 18, 2021-11-15T14:41:48.841 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:41:48.841 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:40.012670+0000", 2021-11-15T14:41:48.841 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:48.841 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:48.842 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:48.842 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:48.842 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:48.842 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:48.843 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:48.843 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:48.843 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:48.843 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:48.843 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:48.844 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:48.844 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:48.844 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:48.844 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:48.844 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:48.845 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:48.845 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:48.845 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:48.845 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:48.845 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.846 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "102", 2021-11-15T14:41:48.846 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:48.846 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:48.846 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:48.847 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:48.847 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:48.847 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:48.847 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:48.847 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:48.848 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:48.848 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:48.848 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:48.848 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:48.848 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:48.849 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:48.849 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:48.849 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:48.849 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:48.849 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:48.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:48.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:48.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:48.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:48.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:48.851 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:48.851 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:48.851 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:48.851 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.851 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:48.852 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:48.852 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:48.852 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:48.852 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:48.852 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:48.853 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:48.853 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:48.853 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:48.853 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:48.854 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:48.854 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:48.854 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:48.854 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:41:48.854 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:41:48.855 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.855 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.855 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.855 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:48.856 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:48.856 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.856 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:48.856 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:48.856 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.857 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.857 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.857 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.857 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.857 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.858 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.858 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.858 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.858 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.859 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.859 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.859 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.859 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.859 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:48.860 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.860 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.860 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.860 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.860 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:48.861 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.861 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.861 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.861 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.861 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.862 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.862 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.862 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.862 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:48.863 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.863 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.863 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.863 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.863 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:48.864 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.864 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.864 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.864 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.864 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.865 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.865 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.865 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.865 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:48.865 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.866 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.866 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.866 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.866 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:48.867 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.867 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.867 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.867 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.867 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.868 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.868 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.868 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.868 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:48.868 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.869 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.869 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.869 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.869 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:48.869 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:48.870 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.870 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.870 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.870 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:48.871 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:48.871 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:48.871 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:48.871 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.871 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.872 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.872 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.872 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.872 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.872 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:48.873 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:48.873 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.873 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.873 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.873 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.874 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.874 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.874 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.874 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 99, 2021-11-15T14:41:48.875 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.875 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.875 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.875 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.875 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.876 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.876 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:48.876 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.876 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.876 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.877 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.877 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:48.877 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.877 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.877 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.878 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.878 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.878 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.878 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.878 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.879 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:48.879 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.879 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.879 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.879 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.880 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:48.880 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.880 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.880 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.881 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.881 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.881 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.881 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.881 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.882 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:48.882 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.882 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.882 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.882 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.883 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:48.883 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.883 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.883 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.883 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.884 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.884 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.884 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.884 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.884 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:48.885 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.885 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.885 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.885 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.885 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:48.886 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:48.886 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.886 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.886 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.887 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:48.887 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:48.887 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:48.887 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:48.888 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.888 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.888 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.888 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.888 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.889 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.889 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:48.889 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:48.889 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.889 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.890 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.890 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.890 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.890 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.890 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.891 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.891 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.891 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.891 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.891 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.892 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.892 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.892 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:48.892 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.892 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.893 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.893 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.893 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:48.894 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.894 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.895 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.895 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.895 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.895 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.895 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.896 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.896 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:48.896 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.896 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.896 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.897 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.897 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:48.897 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.897 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.898 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.898 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.898 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.899 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.899 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.900 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.900 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:48.900 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.900 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.900 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.901 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.901 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:48.901 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.901 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.901 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.902 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.902 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.902 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.902 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.903 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.903 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:48.903 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.903 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.903 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.904 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.904 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:48.904 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:48.904 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.905 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.905 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.905 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:48.905 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:48.905 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:48.906 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:48.906 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.906 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.906 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.907 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.907 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.907 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.907 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:48.907 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:48.908 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.908 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.908 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.908 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.908 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.909 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.909 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.909 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:48.909 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.910 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.910 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.910 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.910 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.910 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.911 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:48.911 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.911 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.911 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.912 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.912 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:48.912 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.912 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.912 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.913 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.913 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.913 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.913 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.913 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.914 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:48.914 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.914 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.914 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.914 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.915 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:48.915 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.915 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.915 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.915 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.916 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.916 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.916 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.916 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.916 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:48.917 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.917 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.917 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.917 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.917 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:48.918 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.918 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.918 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.918 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.919 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.919 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.919 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.919 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.919 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:48.920 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.920 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.920 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.920 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.920 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:48.921 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:48.921 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.921 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.921 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.921 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:48.922 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:48.922 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:48.922 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:48.922 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.923 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.923 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.923 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.923 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.923 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.924 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:48.924 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:48.924 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.924 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.924 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.925 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.925 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.925 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.925 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.925 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.926 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.927 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.927 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:48.927 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.927 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.927 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.928 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.928 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:48.928 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.928 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.928 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.929 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.929 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.929 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.929 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.929 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.930 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:48.930 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.930 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.930 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.931 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.931 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:48.931 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.931 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.931 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.932 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.932 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.932 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.932 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.932 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.933 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:48.933 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.933 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.933 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.933 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.934 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:48.934 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.934 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.934 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.934 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.935 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.935 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.935 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.935 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.935 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:48.936 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.936 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.936 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.936 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.936 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:48.937 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:48.937 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.937 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.937 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.937 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:48.938 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:48.938 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:48.938 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:48.938 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.938 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.939 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.939 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.939 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.939 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.939 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:48.940 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:48.940 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.940 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.940 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.940 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.941 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.941 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.941 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.941 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.942 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.942 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.942 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.943 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.943 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.944 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.944 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:48.944 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.944 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.945 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.945 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.945 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:48.945 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.945 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.946 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.946 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.946 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.946 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.947 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.947 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.947 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:48.947 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.947 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.948 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.948 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.948 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:48.948 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.948 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.949 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.950 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:48.950 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.950 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.950 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.951 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.951 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:48.951 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.951 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.951 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.952 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.952 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.952 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.952 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.953 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.953 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:48.953 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.953 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.953 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.954 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.954 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:48.954 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:48.954 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.955 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.955 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.955 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:48.955 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:48.955 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:48.956 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:48.956 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.956 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.956 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.956 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.957 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.957 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.957 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:48.957 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:48.957 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.958 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.958 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.958 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.958 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.958 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.959 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.959 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.959 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.959 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.960 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.960 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.960 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.960 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.960 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:48.961 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.961 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.961 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.961 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.962 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:48.962 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.962 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.962 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.962 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.963 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.963 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.963 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.963 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.963 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:48.964 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.964 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.964 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.964 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.964 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:48.965 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.965 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.965 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.965 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.965 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.966 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.966 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.966 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.966 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:48.966 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.967 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.967 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.967 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.967 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:48.967 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.968 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.968 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.968 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.968 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.968 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.969 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.969 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.969 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:48.969 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.970 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.970 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.970 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.970 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:48.970 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:48.971 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.971 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.971 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.971 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:48.971 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:48.972 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:48.972 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:48.972 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.972 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.972 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.973 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.973 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.973 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.973 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:48.973 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:48.974 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:48.974 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:48.974 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:48.974 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:48.975 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:48.975 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:48.975 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:48.975 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:48.975 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:48.976 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:48.976 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:48.976 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.976 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.976 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.977 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:48.977 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.977 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.977 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.977 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.978 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:48.978 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.978 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.978 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.978 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.979 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:48.979 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.979 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.979 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.979 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:48.980 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.980 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.980 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.980 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.980 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:48.981 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.981 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.981 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.981 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.982 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:48.982 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.982 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.982 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.982 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:48.983 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.983 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.983 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.983 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.984 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:48.984 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.984 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.984 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.984 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.985 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:48.985 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:48.985 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.985 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:48.985 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:48.986 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.986 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.986 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.986 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:48.986 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:48.987 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:48.987 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.987 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.987 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.987 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:48.988 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:48.988 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:48.988 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:48.988 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:48.988 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:48.989 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:48.989 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:48.989 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:48.989 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:48.989 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:48.990 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.990 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:48.990 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:48.990 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:48.990 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:48.991 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:48.991 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:48.991 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:48.991 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:48.991 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.992 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.992 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:48.992 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:48.992 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:48.992 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:48.993 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:48.993 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:48.993 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:48.993 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:48.993 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.994 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.994 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:48.994 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:48.994 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:48.995 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:48.995 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:48.995 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:48.995 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:48.995 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:48.996 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.996 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.996 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:48.996 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:48.996 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:48.997 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:48.997 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:48.997 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:48.997 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:48.997 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:48.998 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:48.998 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:48.998 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:48.998 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:48.998 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:48.999 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:48.999 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:48.999 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:48.999 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:48.999 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:49.000 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:49.000 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:49.000 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:49.000 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:49.000 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:49.001 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:49.001 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:49.001 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:49.001 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:49.001 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:49.002 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:49.002 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:49.002 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:49.002 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:49.003 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:49.003 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:49.003 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:49.003 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:49.003 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:49.004 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:49.004 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:49.004 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:49.004 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:49.004 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:49.005 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:49.005 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:49.005 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:49.005 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:49.005 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:49.006 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:49.006 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:49.006 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:49.006 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:49.006 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:49.007 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:49.007 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:49.007 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:41:49.007 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:49.007 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:49.008 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:49.008 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:49.008 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:49.008 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:49.009 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:49.009 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:49.009 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:49.009 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:49.009 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:49.010 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:49.010 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:49.010 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:49.010 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:49.010 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:49.011 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:49.011 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:49.011 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:49.011 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:49.011 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:49.012 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:49.012 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:49.012 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:49.012 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:49.013 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:49.013 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:49.013 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:49.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 msgr2=0x7f2a40055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 0x7f2a40055b60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f2a5c00a000 tx=0x7f2a5c008040).stop 2021-11-15T14:41:49.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 msgr2=0x7f2a6014e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f2a600afd10 tx=0x7f2a50001ae0).stop 2021-11-15T14:41:49.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 shutdown_connections 2021-11-15T14:41:49.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a400536a0 0x7f2a40055b60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2a600abb10 0x7f2a6014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2a6013e760 0x7f2a6014e170 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 --2- 172.21.2.135:0/3744985924 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2a48003820 0x7f2a600ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 >> 172.21.2.135:0/3744985924 conn(0x7f2a6005f730 msgr2=0x7f2a60144580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 shutdown_connections 2021-11-15T14:41:49.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:48.784+0000 7f2a672b0700 1 -- 172.21.2.135:0/3744985924 wait complete. 2021-11-15T14:41:49.017 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:49.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.072+0000 7f0bcd5fc700 1 Processor -- start 2021-11-15T14:41:49.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.072+0000 7f0bcd5fc700 1 -- start start 2021-11-15T14:41:49.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.072+0000 7f0bcd5fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0bc80b1e30 0x7f0bc80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.072+0000 7f0bcd5fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0bc8148420 0x7f0bc80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc80b03d0 con 0x7f0bc80a7140 2021-11-15T14:41:49.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80a9140 con 0x7f0bc8148420 2021-11-15T14:41:49.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80b0670 con 0x7f0bc80b1e30 2021-11-15T14:41:49.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0bc80b1e30 0x7f0bc80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0bc80b1e30 0x7f0bc80b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32966/0 (socket says 172.21.2.135:32966) 2021-11-15T14:41:49.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/1132175995 learned_addr learned my addr 172.21.2.135:0/1132175995 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:49.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/1132175995 >> v2:172.21.2.119:3300/0 conn(0x7f0bc8148420 msgr2=0x7f0bc80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- 172.21.2.135:0/1132175995 >> v2:172.21.2.119:3300/0 conn(0x7f0bc8148420 0x7f0bc80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/1132175995 >> v1:172.21.2.119:6789/0 conn(0x7f0bc80a7140 legacy=0x7f0bc81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/1132175995 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80b0910 con 0x7f0bc80b1e30 2021-11-15T14:41:49.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- 172.21.2.135:0/1132175995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80b1e30 0x7f0bc80b1050 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f0bc80acee0 tx=0x7f0bb8006eb0).ready entity=mon.1 client_cookie=2337c533b80902cf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc5ffb700 1 -- 172.21.2.135:0/1132175995 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb800d5c0 con 0x7f0bc80b1e30 2021-11-15T14:41:49.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc5ffb700 1 -- 172.21.2.135:0/1132175995 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8000e90 con 0x7f0bc80b1e30 2021-11-15T14:41:49.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc5ffb700 1 -- 172.21.2.135:0/1132175995 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb800d950 con 0x7f0bc80b1e30 2021-11-15T14:41:49.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/1132175995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80b1e30 msgr2=0x7f0bc80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/1132175995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80b1e30 0x7f0bc80b1050 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f0bc80acee0 tx=0x7f0bb8006eb0).stop 2021-11-15T14:41:49.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/1132175995 shutdown_connections 2021-11-15T14:41:49.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/1132175995 >> v2:172.21.2.119:3300/0 conn(0x7f0bc8148420 0x7f0bc80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/1132175995 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80b1e30 0x7f0bc80b1050 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/1132175995 >> 172.21.2.135:0/1132175995 conn(0x7f0bc805f730 msgr2=0x7f0bc805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/1132175995 shutdown_connections 2021-11-15T14:41:49.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/1132175995 wait complete. 2021-11-15T14:41:49.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 Processor -- start 2021-11-15T14:41:49.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- start start 2021-11-15T14:41:49.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bc80b1e30 0x7f0bc80ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bc8148420 0x7f0bc80ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc814bda0 con 0x7f0bc8148420 2021-11-15T14:41:49.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc814b5c0 con 0x7f0bc80a7140 2021-11-15T14:41:49.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc814b860 con 0x7f0bc80b1e30 2021-11-15T14:41:49.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32972/0 (socket says 172.21.2.135:32972) 2021-11-15T14:41:49.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/2087883865 learned_addr learned my addr 172.21.2.135:0/2087883865 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:49.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bc80b1e30 msgr2=0x7f0bc80ab4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:49.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bc80b1e30 0x7f0bc80ab4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bc8148420 msgr2=0x7f0bc80ab9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:49.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bc8148420 0x7f0bc80ab9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 -- 172.21.2.135:0/2087883865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb800b1e0 con 0x7f0bc80a7140 2021-11-15T14:41:49.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bc6ffd700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f0bc80acee0 tx=0x7f0bb8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb8006be0 con 0x7f0bc80a7140 2021-11-15T14:41:49.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8002f70 con 0x7f0bc80a7140 2021-11-15T14:41:49.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb800de70 con 0x7f0bc80a7140 2021-11-15T14:41:49.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc814bb00 con 0x7f0bc80a7140 2021-11-15T14:41:49.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc80a9b30 con 0x7f0bc80a7140 2021-11-15T14:41:49.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.076+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc80ab1d0 con 0x7f0bc80a7140 2021-11-15T14:41:49.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0bb8025030 con 0x7f0bc80a7140 2021-11-15T14:41:49.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bbffff700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 0x7f0bac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0bb806ceb0 con 0x7f0bc80a7140 2021-11-15T14:41:49.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bc67fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 0x7f0bac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bc67fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 0x7f0bac055b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f0bb0002f70 tx=0x7f0bb0006970).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.080+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0bb8043db0 con 0x7f0bc80a7140 2021-11-15T14:41:49.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc80b0bb0 con 0x7f0bc80a7140 2021-11-15T14:41:49.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bbffff700 1 -- 172.21.2.135:0/2087883865 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f0bb80473d0 con 0x7f0bc80a7140 2021-11-15T14:41:49.193 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:49.193 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:42.032548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6934":{"gid":6934,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/4146626151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":4146626151},{"type":"v1","addr":"172.21.2.135:6835","nonce":4146626151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:49.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 msgr2=0x7f0bac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 0x7f0bac055b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f0bb0002f70 tx=0x7f0bb0006970).stop 2021-11-15T14:41:49.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 msgr2=0x7f0bc80aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f0bc80acee0 tx=0x7f0bb8015000).stop 2021-11-15T14:41:49.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 shutdown_connections 2021-11-15T14:41:49.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0bac053640 0x7f0bac055b00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0bc8148420 0x7f0bc80ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0bc80b1e30 0x7f0bc80ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 --2- 172.21.2.135:0/2087883865 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0bc80a7140 0x7f0bc80aec00 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 >> 172.21.2.135:0/2087883865 conn(0x7f0bc805f730 msgr2=0x7f0bc81477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 shutdown_connections 2021-11-15T14:41:49.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.188+0000 7f0bcd5fc700 1 -- 172.21.2.135:0/2087883865 wait complete. 2021-11-15T14:41:49.197 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 48 2021-11-15T14:41:49.200 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:41:49.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.244+0000 7fee8479e700 1 Processor -- start 2021-11-15T14:41:49.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.244+0000 7fee8479e700 1 -- start start 2021-11-15T14:41:49.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fee7c0b1e30 0x7fee7c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0a7140 0x7fee7c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c0b03d0 con 0x7fee7c148420 2021-11-15T14:41:49.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0a9140 con 0x7fee7c0b1e30 2021-11-15T14:41:49.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b0670 con 0x7fee7c0a7140 2021-11-15T14:41:49.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fee7c0b1e30 0x7fee7c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fee7c0b1e30 0x7fee7c0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32980/0 (socket says 172.21.2.135:32980) 2021-11-15T14:41:49.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 -- 172.21.2.135:0/2043492231 learned_addr learned my addr 172.21.2.135:0/2043492231 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:49.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 -- 172.21.2.135:0/2043492231 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0a7140 msgr2=0x7fee7c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 --2- 172.21.2.135:0/2043492231 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0a7140 0x7fee7c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 -- 172.21.2.135:0/2043492231 >> v1:172.21.2.119:6789/0 conn(0x7fee7c148420 legacy=0x7fee7c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 -- 172.21.2.135:0/2043492231 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0b0910 con 0x7fee7c0b1e30 2021-11-15T14:41:49.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8253a700 1 --2- 172.21.2.135:0/2043492231 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c0b1e30 0x7fee7c0b1050 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fee7c1477b0 tx=0x7fee78006eb0).ready entity=mon.1 client_cookie=6c8ebed46cec21e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee81538700 1 -- 172.21.2.135:0/2043492231 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7800d570 con 0x7fee7c0b1e30 2021-11-15T14:41:49.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee81538700 1 -- 172.21.2.135:0/2043492231 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78000e90 con 0x7fee7c0b1e30 2021-11-15T14:41:49.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee81538700 1 -- 172.21.2.135:0/2043492231 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7800d900 con 0x7fee7c0b1e30 2021-11-15T14:41:49.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- 172.21.2.135:0/2043492231 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c0b1e30 msgr2=0x7fee7c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- 172.21.2.135:0/2043492231 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c0b1e30 0x7fee7c0b1050 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fee7c1477b0 tx=0x7fee78006eb0).stop 2021-11-15T14:41:49.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- 172.21.2.135:0/2043492231 shutdown_connections 2021-11-15T14:41:49.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- 172.21.2.135:0/2043492231 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0a7140 0x7fee7c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- 172.21.2.135:0/2043492231 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c0b1e30 0x7fee7c0b1050 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- 172.21.2.135:0/2043492231 >> 172.21.2.135:0/2043492231 conn(0x7fee7c05f730 msgr2=0x7fee7c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- 172.21.2.135:0/2043492231 shutdown_connections 2021-11-15T14:41:49.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- 172.21.2.135:0/2043492231 wait complete. 2021-11-15T14:41:49.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 Processor -- start 2021-11-15T14:41:49.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- start start 2021-11-15T14:41:49.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fee7c0a7140 0x7fee7c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0b1e30 0x7fee7c13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c159fc0 con 0x7fee7c0a7140 2021-11-15T14:41:49.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c15a1f0 con 0x7fee7c148420 2021-11-15T14:41:49.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee8479e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c15a490 con 0x7fee7c0b1e30 2021-11-15T14:41:49.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:32986/0 (socket says 172.21.2.135:32986) 2021-11-15T14:41:49.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 -- 172.21.2.135:0/732262506 learned_addr learned my addr 172.21.2.135:0/732262506 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:49.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 -- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0b1e30 msgr2=0x7fee7c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0b1e30 0x7fee7c13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 -- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fee7c0a7140 msgr2=0x7fee7c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fee7c0a7140 0x7fee7c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 -- 172.21.2.135:0/732262506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7800b1e0 con 0x7fee7c148420 2021-11-15T14:41:49.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee82d3b700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fee740032f0 tx=0x7fee740091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.248+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7400d4a0 con 0x7fee7c148420 2021-11-15T14:41:49.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7400d600 con 0x7fee7c148420 2021-11-15T14:41:49.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c15a730 con 0x7fee7c148420 2021-11-15T14:41:49.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7400d960 con 0x7fee7c148420 2021-11-15T14:41:49.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c14a710 con 0x7fee7c148420 2021-11-15T14:41:49.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c15a8c0 con 0x7fee7c148420 2021-11-15T14:41:49.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee74018030 con 0x7fee7c148420 2021-11-15T14:41:49.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 0x7fee5c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fee7406b360 con 0x7fee7c148420 2021-11-15T14:41:49.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee8253a700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 0x7fee5c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee8253a700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 0x7fee5c055b90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fee7c1477b0 tx=0x7fee78015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.252+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee74042420 con 0x7fee7c148420 2021-11-15T14:41:49.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.360+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fee7c0573d0 con 0x7fee7c148420 2021-11-15T14:41:49.901 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:41:49.895+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:41:49.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee6f7fe700 1 -- 172.21.2.135:0/732262506 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7fee74045a40 con 0x7fee7c148420 2021-11-15T14:41:49.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 msgr2=0x7fee5c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 0x7fee5c055b90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fee7c1477b0 tx=0x7fee78015000).stop 2021-11-15T14:41:49.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 msgr2=0x7fee7c156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fee740032f0 tx=0x7fee740091a0).stop 2021-11-15T14:41:49.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 shutdown_connections 2021-11-15T14:41:49.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fee5c0536d0 0x7fee5c055b90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fee7c148420 0x7fee7c156a30 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:49.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fee7c0b1e30 0x7fee7c13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 --2- 172.21.2.135:0/732262506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fee7c0a7140 0x7fee7c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 >> 172.21.2.135:0/732262506 conn(0x7fee7c05f730 msgr2=0x7fee7c14cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 shutdown_connections 2021-11-15T14:41:49.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.912+0000 7fee8479e700 1 -- 172.21.2.135:0/732262506 wait complete. 2021-11-15T14:41:49.919 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:41:49.922 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:49.926 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:41:49.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 Processor -- start 2021-11-15T14:41:49.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 -- start start 2021-11-15T14:41:49.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 0x7fce280acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280b6d60 con 0x7fce280b6980 2021-11-15T14:41:49.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce28061260 con 0x7fce280aa650 2021-11-15T14:41:49.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2f5da700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce28061500 con 0x7fce28060990 2021-11-15T14:41:49.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2db77700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fce280aa650 0x7fce2813c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48824/0 (socket says 172.21.2.135:48824) 2021-11-15T14:41:49.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce2db77700 1 -- 172.21.2.135:0/2915682171 learned_addr learned my addr 172.21.2.135:0/2915682171 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:49.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216927136 0 0) 0x7fce28061260 con 0x7fce280aa650 2021-11-15T14:41:49.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.968+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce10004370 con 0x7fce280aa650 2021-11-15T14:41:49.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450005725 0 0) 0x7fce10004370 con 0x7fce280aa650 2021-11-15T14:41:49.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 msgr2=0x7fce280acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 0x7fce280acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 >> v1:172.21.2.119:6789/0 conn(0x7fce280b6980 legacy=0x7fce280a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280617a0 con 0x7fce280aa650 2021-11-15T14:41:49.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fce200019e0 con 0x7fce280aa650 2021-11-15T14:41:49.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 >> v1:172.21.2.135:6789/0 conn(0x7fce280aa650 legacy=0x7fce2813c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce10004860 0x7fce10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10005610 0x7fce10005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 0x7fce10006100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28061500 con 0x7fce10005610 2021-11-15T14:41:49.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1000ca50 con 0x7fce10004860 2021-11-15T14:41:49.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1000cc10 con 0x7fce28060990 2021-11-15T14:41:49.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce10004860 0x7fce10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 -- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 msgr2=0x7fce10006100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce28060990 0x7fce10006100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 -- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10005610 msgr2=0x7fce10005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:49.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10005610 0x7fce10005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 -- 172.21.2.135:0/2915682171 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10004370 con 0x7fce10004860 2021-11-15T14:41:49.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2d376700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce10004860 0x7fce10004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fce1c000f70 tx=0x7fce1c0079e0).ready entity=mon.1 client_cookie=746b4cbf0f4babdf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c007cf0 con 0x7fce10004860 2021-11-15T14:41:49.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c014410 con 0x7fce10004860 2021-11-15T14:41:49.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1bfff700 1 -- 172.21.2.135:0/2915682171 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c014770 con 0x7fce10004860 2021-11-15T14:41:49.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2915682171 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce10004860 msgr2=0x7fce10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2915682171 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce10004860 0x7fce10004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fce1c000f70 tx=0x7fce1c0079e0).stop 2021-11-15T14:41:49.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 -- 172.21.2.135:0/2915682171 reap_dead start 2021-11-15T14:41:49.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2915682171 shutdown_connections 2021-11-15T14:41:49.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2915682171 >> 172.21.2.135:0/2915682171 conn(0x7fce280b3500 msgr2=0x7fce280b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:49.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2915682171 shutdown_connections 2021-11-15T14:41:49.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2915682171 wait complete. 2021-11-15T14:41:49.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 Processor -- start 2021-11-15T14:41:49.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- start start 2021-11-15T14:41:49.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10004860 0x7fce281435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce280adcb0 0x7fce280b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b14f0 con 0x7fce10004860 2021-11-15T14:41:49.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b1c90 con 0x7fce28140b40 2021-11-15T14:41:49.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280ae490 con 0x7fce280adcb0 2021-11-15T14:41:49.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33020/0 (socket says 172.21.2.135:33020) 2021-11-15T14:41:49.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 -- 172.21.2.135:0/2463343739 learned_addr learned my addr 172.21.2.135:0/2463343739 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:49.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 -- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce280adcb0 msgr2=0x7fce280b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce280adcb0 0x7fce280b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 -- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10004860 msgr2=0x7fce281435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:49.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10004860 0x7fce281435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:49.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 -- 172.21.2.135:0/2463343739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280b2060 con 0x7fce28140b40 2021-11-15T14:41:49.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2db77700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fce280af440 tx=0x7fce280ac010).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce20004ab0 con 0x7fce28140b40 2021-11-15T14:41:49.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20004c10 con 0x7fce28140b40 2021-11-15T14:41:49.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce20007030 con 0x7fce28140b40 2021-11-15T14:41:49.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280affd0 con 0x7fce28140b40 2021-11-15T14:41:49.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28135150 con 0x7fce28140b40 2021-11-15T14:41:49.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280b1ec0 con 0x7fce28140b40 2021-11-15T14:41:49.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.972+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce20010070 con 0x7fce28140b40 2021-11-15T14:41:49.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.976+0000 7fce1a7fc700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:49.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.976+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fce2006b4c0 con 0x7fce28140b40 2021-11-15T14:41:49.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.976+0000 7fce2d376700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:49.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.976+0000 7fce2d376700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 0x7fce08055ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fce1c000f70 tx=0x7fce1c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:49.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:49.976+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce280b1ec0 con 0x7fce28140b40 2021-11-15T14:41:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce280b1ec0 con 0x7fce28140b40 2021-11-15T14:41:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce1a7fc700 1 -- 172.21.2.135:0/2463343739 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2130 (secure 0 0 0) 0x7fce280b1ec0 con 0x7fce28140b40 2021-11-15T14:41:50.091 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:50.092 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:41:41.027941+0000","modified":"2021-11-15T14:41:49.899929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-15T14:41:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 msgr2=0x7fce08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 0x7fce08055ad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fce1c000f70 tx=0x7fce1c015000).stop 2021-11-15T14:41:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 msgr2=0x7fce280afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fce280af440 tx=0x7fce280ac010).stop 2021-11-15T14:41:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 shutdown_connections 2021-11-15T14:41:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fce08053610 0x7fce08055ad0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fce28140b40 0x7fce280afae0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fce280adcb0 0x7fce280b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 --2- 172.21.2.135:0/2463343739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fce10004860 0x7fce281435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 >> 172.21.2.135:0/2463343739 conn(0x7fce280b3500 msgr2=0x7fce280b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 shutdown_connections 2021-11-15T14:41:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.088+0000 7fce2f5da700 1 -- 172.21.2.135:0/2463343739 wait complete. 2021-11-15T14:41:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 49 2021-11-15T14:41:50.099 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:41:50.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 Processor -- start 2021-11-15T14:41:50.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 -- start start 2021-11-15T14:41:50.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b2430 con 0x7f4dec060040 2021-11-15T14:41:50.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b26d0 con 0x7f4dec0b3950 2021-11-15T14:41:50.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df37c4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0b2970 con 0x7f4dec0654a0 2021-11-15T14:41:50.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df1d61700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f4dec0b3950 0x7f4dec1449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48844/0 (socket says 172.21.2.135:48844) 2021-11-15T14:41:50.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df1d61700 1 -- 172.21.2.135:0/3063285226 learned_addr learned my addr 172.21.2.135:0/3063285226 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:50.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df0d5f700 1 --2- 172.21.2.135:0/3063285226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519686099 0 0) 0x7f4dec0b26d0 con 0x7f4dec0b3950 2021-11-15T14:41:50.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd0003260 con 0x7f4dec0b3950 2021-11-15T14:41:50.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567689057 0 0) 0x7f4dec0b2430 con 0x7f4dec060040 2021-11-15T14:41:50.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec0b26d0 con 0x7f4dec060040 2021-11-15T14:41:50.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057411101 0 0) 0x7f4dd0003260 con 0x7f4dec0b3950 2021-11-15T14:41:50.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df0d5f700 1 -- 172.21.2.135:0/3063285226 >> v1:172.21.2.135:6789/0 conn(0x7f4dec0b3950 legacy=0x7f4dec1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df0d5f700 1 -- 172.21.2.135:0/3063285226 >> v1:172.21.2.119:6789/0 conn(0x7f4dec060040 legacy=0x7f4dec064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df0d5f700 1 -- 172.21.2.135:0/3063285226 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0648f0 con 0x7f4dec0654a0 2021-11-15T14:41:50.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4df0d5f700 1 --2- 172.21.2.135:0/3063285226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec1444c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4de4001b80 tx=0x7f4de8006df0).ready entity=mon.2 client_cookie=32e0a150277b489c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:50.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de40019e0 con 0x7f4dec0654a0 2021-11-15T14:41:50.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8000e90 con 0x7f4dec0654a0 2021-11-15T14:41:50.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.148+0000 7f4ddffff700 1 -- 172.21.2.135:0/3063285226 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de8012460 con 0x7f4dec0654a0 2021-11-15T14:41:50.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/3063285226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 msgr2=0x7f4dec1444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 --2- 172.21.2.135:0/3063285226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec1444c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4de4001b80 tx=0x7f4de8006df0).stop 2021-11-15T14:41:50.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/3063285226 shutdown_connections 2021-11-15T14:41:50.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 --2- 172.21.2.135:0/3063285226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec1444c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/3063285226 >> 172.21.2.135:0/3063285226 conn(0x7f4dec05cfe0 msgr2=0x7f4dec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:50.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/3063285226 shutdown_connections 2021-11-15T14:41:50.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/3063285226 wait complete. 2021-11-15T14:41:50.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 Processor -- start 2021-11-15T14:41:50.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- start start 2021-11-15T14:41:50.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4dec060040 0x7f4dec0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0afd00 con 0x7f4dec060040 2021-11-15T14:41:50.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec15ac90 con 0x7f4dec0b3950 2021-11-15T14:41:50.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec15af30 con 0x7f4dec0654a0 2021-11-15T14:41:50.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33034/0 (socket says 172.21.2.135:33034) 2021-11-15T14:41:50.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 -- 172.21.2.135:0/1263881460 learned_addr learned my addr 172.21.2.135:0/1263881460 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:50.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1560700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4dec060040 0x7f4dec0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df0d5f700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 -- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 msgr2=0x7f4dec0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec0b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 -- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4dec060040 msgr2=0x7f4dec0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4dec060040 0x7f4dec0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 -- 172.21.2.135:0/1263881460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de800b180 con 0x7f4dec0b3950 2021-11-15T14:41:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1d61700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f4de4001360 tx=0x7f4de4001ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de4004ab0 con 0x7f4dec0b3950 2021-11-15T14:41:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4004c10 con 0x7f4dec0b3950 2021-11-15T14:41:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec13b950 con 0x7f4dec0b3950 2021-11-15T14:41:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de4007170 con 0x7f4dec0b3950 2021-11-15T14:41:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec0b1700 con 0x7f4dec0b3950 2021-11-15T14:41:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec0674f0 con 0x7f4dec0b3950 2021-11-15T14:41:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4de40072d0 con 0x7f4dec0b3950 2021-11-15T14:41:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 0x7f4dd4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f4de406b720 con 0x7f4dec0b3950 2021-11-15T14:41:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.152+0000 7f4df1560700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 0x7f4dd4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.156+0000 7f4df1560700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 0x7f4dd4055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f4de000d000 tx=0x7f4de0007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:50.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.156+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4de40426d0 con 0x7f4dec0b3950 2021-11-15T14:41:50.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.264+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4dec0573d0 con 0x7f4dec0b3950 2021-11-15T14:41:50.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4dde7fc700 1 -- 172.21.2.135:0/1263881460 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4de4045cf0 con 0x7f4dec0b3950 2021-11-15T14:41:50.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 msgr2=0x7f4dd4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 0x7f4dd4055ad0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f4de000d000 tx=0x7f4de0007a20).stop 2021-11-15T14:41:50.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 msgr2=0x7f4dec0ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f4de4001360 tx=0x7f4de4001ae0).stop 2021-11-15T14:41:50.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 shutdown_connections 2021-11-15T14:41:50.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4dd4053610 0x7f4dd4055ad0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4dec0b3950 0x7f4dec0ae7a0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4dec0654a0 0x7f4dec0b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 --2- 172.21.2.135:0/1263881460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4dec060040 0x7f4dec0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 >> 172.21.2.135:0/1263881460 conn(0x7f4dec05cfe0 msgr2=0x7f4dec144d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:50.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 shutdown_connections 2021-11-15T14:41:50.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.924+0000 7f4df37c4700 1 -- 172.21.2.135:0/1263881460 wait complete. 2021-11-15T14:41:50.936 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:41:50.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 Processor -- start 2021-11-15T14:41:50.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 -- start start 2021-11-15T14:41:50.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3ef00b1e30 0x7f3ef00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3ef0148420 0x7f3ef00b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:50.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00a9140 con 0x7f3ef00b1e30 2021-11-15T14:41:50.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00b03d0 con 0x7f3ef0148420 2021-11-15T14:41:50.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.984+0000 7f3ef4bac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00b0670 con 0x7f3ef00a7140 2021-11-15T14:41:50.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3ef0148420 0x7f3ef00b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:50.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3ef0148420 0x7f3ef00b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33040/0 (socket says 172.21.2.135:33040) 2021-11-15T14:41:50.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 -- 172.21.2.135:0/2362138919 learned_addr learned my addr 172.21.2.135:0/2362138919 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:50.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 -- 172.21.2.135:0/2362138919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 msgr2=0x7f3ef01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:50.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 --2- 172.21.2.135:0/2362138919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 -- 172.21.2.135:0/2362138919 >> v2:172.21.2.119:3300/0 conn(0x7f3ef00b1e30 msgr2=0x7f3ef00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:50.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 --2- 172.21.2.135:0/2362138919 >> v2:172.21.2.119:3300/0 conn(0x7f3ef00b1e30 0x7f3ef00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 -- 172.21.2.135:0/2362138919 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00b0910 con 0x7f3ef0148420 2021-11-15T14:41:50.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eedd9b700 1 --2- 172.21.2.135:0/2362138919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00b2210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f3ef01477b0 tx=0x7f3ed8006eb0).ready entity=mon.1 client_cookie=7ee557a00a24404e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:50.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eed59a700 1 -- 172.21.2.135:0/2362138919 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed800d570 con 0x7f3ef0148420 2021-11-15T14:41:50.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eed59a700 1 -- 172.21.2.135:0/2362138919 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8000e90 con 0x7f3ef0148420 2021-11-15T14:41:50.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eed59a700 1 -- 172.21.2.135:0/2362138919 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed800d8c0 con 0x7f3ef0148420 2021-11-15T14:41:50.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/2362138919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 msgr2=0x7f3ef00b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:50.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/2362138919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00b2210 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f3ef01477b0 tx=0x7f3ed8006eb0).stop 2021-11-15T14:41:50.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/2362138919 shutdown_connections 2021-11-15T14:41:50.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/2362138919 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/2362138919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00b2210 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:50.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/2362138919 >> v2:172.21.2.119:3300/0 conn(0x7f3ef00b1e30 0x7f3ef00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:50.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/2362138919 >> 172.21.2.135:0/2362138919 conn(0x7f3ef005f730 msgr2=0x7f3ef005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:50.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/2362138919 shutdown_connections 2021-11-15T14:41:50.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/2362138919 wait complete. 2021-11-15T14:41:51.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 Processor -- start 2021-11-15T14:41:51.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- start start 2021-11-15T14:41:51.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:51.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ef00b1e30 0x7f3ef00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:51.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:51.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014a780 con 0x7f3ef00b1e30 2021-11-15T14:41:51.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00af6a0 con 0x7f3ef0148420 2021-11-15T14:41:51.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014b5b0 con 0x7f3ef00a7140 2021-11-15T14:41:51.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:51.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33048/0 (socket says 172.21.2.135:33048) 2021-11-15T14:41:51.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 -- 172.21.2.135:0/868376415 learned_addr learned my addr 172.21.2.135:0/868376415 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:51.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 -- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 msgr2=0x7f3ef00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:51.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:51.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 -- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ef00b1e30 msgr2=0x7f3ef00ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:51.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ef00b1e30 0x7f3ef00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:51.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 -- 172.21.2.135:0/868376415 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed800b1e0 con 0x7f3ef0148420 2021-11-15T14:41:51.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3eeed9d700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f3ee80032f0 tx=0x7f3ee8009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:51.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee800d580 con 0x7f3ef0148420 2021-11-15T14:41:51.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800d6e0 con 0x7f3ef0148420 2021-11-15T14:41:51.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee800da40 con 0x7f3ef0148420 2021-11-15T14:41:51.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef014a9b0 con 0x7f3ef0148420 2021-11-15T14:41:51.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.988+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef014ac50 con 0x7f3ef0148420 2021-11-15T14:41:51.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00b0bb0 con 0x7f3ef0148420 2021-11-15T14:41:51.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ee800dba0 con 0x7f3ef0148420 2021-11-15T14:41:51.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3ee77fe700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 0x7f3ed4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:51.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f3ee806be70 con 0x7f3ef0148420 2021-11-15T14:41:51.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3eee59c700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 0x7f3ed4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:51.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3eee59c700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 0x7f3ed4055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3ee0002f70 tx=0x7f3ee0006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:51.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:50.992+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ee8042e20 con 0x7f3ef0148420 2021-11-15T14:41:51.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.076+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ef00573d0 con 0x7f3ef0148420 2021-11-15T14:41:51.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ee77fe700 1 -- 172.21.2.135:0/868376415 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3ee8046440 con 0x7f3ef0148420 2021-11-15T14:41:51.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 msgr2=0x7f3ed4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:51.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 0x7f3ed4055b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3ee0002f70 tx=0x7f3ee0006a00).stop 2021-11-15T14:41:51.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 msgr2=0x7f3ef00ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:51.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f3ee80032f0 tx=0x7f3ee8009220).stop 2021-11-15T14:41:51.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 shutdown_connections 2021-11-15T14:41:51.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3ed40536a0 0x7f3ed4055b60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:51.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3ef0148420 0x7f3ef00ac750 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:51.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3ef00b1e30 0x7f3ef00ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:51.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 --2- 172.21.2.135:0/868376415 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3ef00a7140 0x7f3ef00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:51.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 >> 172.21.2.135:0/868376415 conn(0x7f3ef005f730 msgr2=0x7f3ef0144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:51.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 shutdown_connections 2021-11-15T14:41:51.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.932+0000 7f3ef4bac700 1 -- 172.21.2.135:0/868376415 wait complete. 2021-11-15T14:41:51.941 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:41:51.944 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:41:51.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 Processor -- start 2021-11-15T14:41:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- start start 2021-11-15T14:41:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7feddc0b1e30 0x7feddc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7feddc0a7140 0x7feddc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0b03d0 con 0x7feddc148420 2021-11-15T14:41:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0a9140 con 0x7feddc0a7140 2021-11-15T14:41:52.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0b0670 con 0x7feddc0b1e30 2021-11-15T14:41:52.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedd9d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feddc148420 0x7feddc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48876/0 (socket says 172.21.2.135:48876) 2021-11-15T14:41:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedd9d9b700 1 -- 172.21.2.135:0/1119231137 learned_addr learned my addr 172.21.2.135:0/1119231137 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 --2- 172.21.2.135:0/1119231137 >> v2:172.21.2.135:3300/0 conn(0x7feddc0b1e30 0x7feddc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:52.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 -- 172.21.2.135:0/1119231137 >> v2:172.21.2.119:3300/0 conn(0x7feddc0a7140 msgr2=0x7feddc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 --2- 172.21.2.135:0/1119231137 >> v2:172.21.2.119:3300/0 conn(0x7feddc0a7140 0x7feddc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 -- 172.21.2.135:0/1119231137 >> v1:172.21.2.135:6789/0 conn(0x7feddc148420 legacy=0x7feddc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 -- 172.21.2.135:0/1119231137 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0b0910 con 0x7feddc0b1e30 2021-11-15T14:41:52.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedda59c700 1 --2- 172.21.2.135:0/1119231137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0b1050 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7feddc1477b0 tx=0x7fedcc006df0).ready entity=mon.1 client_cookie=475b3b5b4fc00918 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedd959a700 1 -- 172.21.2.135:0/1119231137 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00d5c0 con 0x7feddc0b1e30 2021-11-15T14:41:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedd959a700 1 -- 172.21.2.135:0/1119231137 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc000e90 con 0x7feddc0b1e30 2021-11-15T14:41:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fedd959a700 1 -- 172.21.2.135:0/1119231137 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00d910 con 0x7feddc0b1e30 2021-11-15T14:41:52.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- 172.21.2.135:0/1119231137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 msgr2=0x7feddc0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 --2- 172.21.2.135:0/1119231137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0b1050 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7feddc1477b0 tx=0x7fedcc006df0).stop 2021-11-15T14:41:52.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- 172.21.2.135:0/1119231137 shutdown_connections 2021-11-15T14:41:52.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 --2- 172.21.2.135:0/1119231137 >> v2:172.21.2.119:3300/0 conn(0x7feddc0a7140 0x7feddc1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 --2- 172.21.2.135:0/1119231137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0b1050 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:52.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- 172.21.2.135:0/1119231137 >> 172.21.2.135:0/1119231137 conn(0x7feddc05f730 msgr2=0x7feddc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- 172.21.2.135:0/1119231137 shutdown_connections 2021-11-15T14:41:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- 172.21.2.135:0/1119231137 wait complete. 2021-11-15T14:41:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 Processor -- start 2021-11-15T14:41:52.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:51.996+0000 7fede0c27700 1 -- start start 2021-11-15T14:41:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feddc0a7140 0x7feddc0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feddc148420 0x7feddc0ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc14a2b0 con 0x7feddc0a7140 2021-11-15T14:41:52.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0ac370 con 0x7feddc0b1e30 2021-11-15T14:41:52.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0ac610 con 0x7feddc148420 2021-11-15T14:41:52.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:52.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33062/0 (socket says 172.21.2.135:33062) 2021-11-15T14:41:52.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 -- 172.21.2.135:0/178564286 learned_addr learned my addr 172.21.2.135:0/178564286 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:52.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 -- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feddc148420 msgr2=0x7feddc0ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feddc148420 0x7feddc0ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 -- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feddc0a7140 msgr2=0x7feddc0aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feddc0a7140 0x7feddc0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 -- 172.21.2.135:0/178564286 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc00b180 con 0x7feddc0b1e30 2021-11-15T14:41:52.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd9d9b700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7feddc0acee0 tx=0x7fedc4007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:52.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedc400ce30 con 0x7feddc0b1e30 2021-11-15T14:41:52.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40072e0 con 0x7feddc0b1e30 2021-11-15T14:41:52.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedc4005800 con 0x7feddc0b1e30 2021-11-15T14:41:52.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc149f20 con 0x7feddc0b1e30 2021-11-15T14:41:52.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc0a9f00 con 0x7feddc0b1e30 2021-11-15T14:41:52.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0b0bb0 con 0x7feddc0b1e30 2021-11-15T14:41:52.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fedc4010070 con 0x7feddc0b1e30 2021-11-15T14:41:52.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 0x7fedc0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:52.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fedc406af60 con 0x7feddc0b1e30 2021-11-15T14:41:52.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.000+0000 7fedda59c700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 0x7fedc0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:52.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.004+0000 7fedda59c700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 0x7fedc0055b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7feddc1477b0 tx=0x7fedcc012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:52.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.004+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fedc40420d0 con 0x7feddc0b1e30 2021-11-15T14:41:52.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.084+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feddc14b940 con 0x7feddc0b1e30 2021-11-15T14:41:52.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.952+0000 7fedd37fe700 1 -- 172.21.2.135:0/178564286 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 173+0+0 (secure 0 0 0) 0x7fedc4018070 con 0x7feddc0b1e30 2021-11-15T14:41:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 msgr2=0x7fedc0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 0x7fedc0055b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7feddc1477b0 tx=0x7fedcc012000).stop 2021-11-15T14:41:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 msgr2=0x7feddc0ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:52.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7feddc0acee0 tx=0x7fedc4007c70).stop 2021-11-15T14:41:52.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 shutdown_connections 2021-11-15T14:41:52.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fedc0053640 0x7fedc0055b00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:52.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feddc148420 0x7feddc0ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feddc0b1e30 0x7feddc0ab440 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:52.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 --2- 172.21.2.135:0/178564286 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feddc0a7140 0x7feddc0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:52.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 >> 172.21.2.135:0/178564286 conn(0x7feddc05f730 msgr2=0x7feddc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:52.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 shutdown_connections 2021-11-15T14:41:52.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:52.956+0000 7fede0c27700 1 -- 172.21.2.135:0/178564286 wait complete. 2021-11-15T14:41:52.962 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:41:52.965 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:41:53.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 Processor -- start 2021-11-15T14:41:53.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 -- start start 2021-11-15T14:41:53.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f699c0b1f40 0x7f699c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 0x7f699c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c0b04a0 con 0x7f699c0b0030 2021-11-15T14:41:53.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c0a7850 con 0x7f699c0b1f40 2021-11-15T14:41:53.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f69a1023700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b06d0 con 0x7f699c0b2320 2021-11-15T14:41:53.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f699a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f699c0b0030 0x7f699c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48888/0 (socket says 172.21.2.135:48888) 2021-11-15T14:41:53.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f699a59c700 1 -- 172.21.2.135:0/543130252 learned_addr learned my addr 172.21.2.135:0/543130252 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:53.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.012+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427572520 0 0) 0x7f699c0b04a0 con 0x7f699c0b0030 2021-11-15T14:41:53.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f697c003260 con 0x7f699c0b0030 2021-11-15T14:41:53.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- 172.21.2.135:0/543130252 >> v2:172.21.2.119:3300/0 conn(0x7f699c0b1f40 0x7f699c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699b59e700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 0x7f699c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969767178 0 0) 0x7f697c003260 con 0x7f699c0b0030 2021-11-15T14:41:53.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 msgr2=0x7f699c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 0x7f699c1412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 >> v2:172.21.2.119:3300/0 conn(0x7f699c0b1f40 msgr2=0x7f699c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 --2- 172.21.2.135:0/543130252 >> v2:172.21.2.119:3300/0 conn(0x7f699c0b1f40 0x7f699c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c0b0970 con 0x7f699c0b0030 2021-11-15T14:41:53.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6984001660 con 0x7f699c0b0030 2021-11-15T14:41:53.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- 172.21.2.135:0/543130252 >> v2:172.21.2.119:3300/0 conn(0x7f699c0b1f40 0x7f699c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:53.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 >> v1:172.21.2.135:6789/0 conn(0x7f699c0b0030 legacy=0x7f699c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 0x7f697c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f697c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f697c0049f0 0x7f697c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0a7850 con 0x7f697c0049f0 2021-11-15T14:41:53.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b06d0 con 0x7f697c003d50 2021-11-15T14:41:53.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c00b830 con 0x7f699c0b2320 2021-11-15T14:41:53.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f697c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 -- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 msgr2=0x7f697c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c0b2320 0x7f697c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 -- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f697c0049f0 msgr2=0x7f697c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f697c0049f0 0x7f697c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 -- 172.21.2.135:0/543130252 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c003260 con 0x7f697c003d50 2021-11-15T14:41:53.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f697c004500 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f6984001370 tx=0x7f699c0a7990).ready entity=mon.1 client_cookie=18525b0a2c650b23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69840070d0 con 0x7f697c003d50 2021-11-15T14:41:53.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984007230 con 0x7f697c003d50 2021-11-15T14:41:53.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6999d9b700 1 -- 172.21.2.135:0/543130252 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698400c8f0 con 0x7f697c003d50 2021-11-15T14:41:53.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- 172.21.2.135:0/543130252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 msgr2=0x7f697c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 --2- 172.21.2.135:0/543130252 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f697c004500 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f6984001370 tx=0x7f699c0a7990).stop 2021-11-15T14:41:53.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699b59e700 1 -- 172.21.2.135:0/543130252 reap_dead start 2021-11-15T14:41:53.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- 172.21.2.135:0/543130252 shutdown_connections 2021-11-15T14:41:53.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- 172.21.2.135:0/543130252 >> 172.21.2.135:0/543130252 conn(0x7f699c05f730 msgr2=0x7f699c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:53.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- 172.21.2.135:0/543130252 shutdown_connections 2021-11-15T14:41:53.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- 172.21.2.135:0/543130252 wait complete. 2021-11-15T14:41:53.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 Processor -- start 2021-11-15T14:41:53.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- start start 2021-11-15T14:41:53.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c14a770 0x7f699c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f699c15a5c0 0x7f699c148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b4de0 con 0x7f699c15a5c0 2021-11-15T14:41:53.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c15aa50 con 0x7f697c003d50 2021-11-15T14:41:53.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f69a1023700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c14ad80 con 0x7f699c14a770 2021-11-15T14:41:53.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33078/0 (socket says 172.21.2.135:33078) 2021-11-15T14:41:53.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 -- 172.21.2.135:0/597651098 learned_addr learned my addr 172.21.2.135:0/597651098 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:53.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699a59c700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c14a770 0x7f699c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 -- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c14a770 msgr2=0x7f699c15a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c14a770 0x7f699c15a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 -- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f699c15a5c0 msgr2=0x7f699c148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f699c15a5c0 0x7f699c148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 -- 172.21.2.135:0/597651098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c14b020 con 0x7f697c003d50 2021-11-15T14:41:53.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f699ad9d700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f698c006a80 tx=0x7f698c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698c016070 con 0x7f697c003d50 2021-11-15T14:41:53.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.016+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c000e90 con 0x7f697c003d50 2021-11-15T14:41:53.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698c011970 con 0x7f697c003d50 2021-11-15T14:41:53.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c14b2c0 con 0x7f697c003d50 2021-11-15T14:41:53.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c140c20 con 0x7f697c003d50 2021-11-15T14:41:53.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c0b0c10 con 0x7f697c003d50 2021-11-15T14:41:53.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f698c011ad0 con 0x7f697c003d50 2021-11-15T14:41:53.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f6993fff700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 0x7f6980055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f698c06b4f0 con 0x7f697c003d50 2021-11-15T14:41:53.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f699a59c700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 0x7f6980055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f699a59c700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 0x7f6980055b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6984014000 tx=0x7f6984013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.020+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f698c0427d0 con 0x7f697c003d50 2021-11-15T14:41:53.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.104+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f699c0573d0 con 0x7f697c003d50 2021-11-15T14:41:53.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f6993fff700 1 -- 172.21.2.135:0/597651098 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f698c045df0 con 0x7f697c003d50 2021-11-15T14:41:53.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 msgr2=0x7f6980055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 0x7f6980055b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6984014000 tx=0x7f6984013000).stop 2021-11-15T14:41:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 msgr2=0x7f699c140120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f698c006a80 tx=0x7f698c008040).stop 2021-11-15T14:41:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 shutdown_connections 2021-11-15T14:41:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6980053640 0x7f6980055b00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f699c15a5c0 0x7f699c148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f699c14a770 0x7f699c15a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 --2- 172.21.2.135:0/597651098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f697c003d50 0x7f699c140120 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 >> 172.21.2.135:0/597651098 conn(0x7f699c05f730 msgr2=0x7f699c0ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:53.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 shutdown_connections 2021-11-15T14:41:53.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.120+0000 7f69a1023700 1 -- 172.21.2.135:0/597651098 wait complete. 2021-11-15T14:41:53.130 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-15T14:41:53.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 Processor -- start 2021-11-15T14:41:53.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 -- start start 2021-11-15T14:41:53.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc5ac0ad150 0x7fc5ac13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc5ac0afca0 0x7fc5ac13f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0b04b0 con 0x7fc5ac0b0bb0 2021-11-15T14:41:53.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ad530 con 0x7fc5ac0ad150 2021-11-15T14:41:53.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5b2249700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0b57d0 con 0x7fc5ac0afca0 2021-11-15T14:41:53.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc5ac0afca0 0x7fc5ac13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc5ac0afca0 0x7fc5ac13f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33090/0 (socket says 172.21.2.135:33090) 2021-11-15T14:41:53.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 -- 172.21.2.135:0/1635835372 learned_addr learned my addr 172.21.2.135:0/1635835372 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:53.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 -- 172.21.2.135:0/1635835372 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac0ad150 msgr2=0x7fc5ac13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/1635835372 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac0ad150 0x7fc5ac13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 -- 172.21.2.135:0/1635835372 >> v1:172.21.2.119:6789/0 conn(0x7fc5ac0b0bb0 legacy=0x7fc5ac1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:53.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.176+0000 7fc5aaffd700 1 -- 172.21.2.135:0/1635835372 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0b06e0 con 0x7fc5ac0afca0 2021-11-15T14:41:53.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/1635835372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac13f640 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fc5ac0b00d0 tx=0x7fc594006f40).ready entity=mon.1 client_cookie=ec65d370f0a5b649 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1635835372 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc594010070 con 0x7fc5ac0afca0 2021-11-15T14:41:53.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1635835372 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc594000e90 con 0x7fc5ac0afca0 2021-11-15T14:41:53.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aa7fc700 1 -- 172.21.2.135:0/1635835372 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc594008860 con 0x7fc5ac0afca0 2021-11-15T14:41:53.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/1635835372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 msgr2=0x7fc5ac13f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- 172.21.2.135:0/1635835372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac13f640 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fc5ac0b00d0 tx=0x7fc594006f40).stop 2021-11-15T14:41:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/1635835372 shutdown_connections 2021-11-15T14:41:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- 172.21.2.135:0/1635835372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac13f640 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- 172.21.2.135:0/1635835372 >> v2:172.21.2.119:3300/0 conn(0x7fc5ac0ad150 0x7fc5ac13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/1635835372 >> 172.21.2.135:0/1635835372 conn(0x7fc5ac062cb0 msgr2=0x7fc5ac063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:53.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/1635835372 shutdown_connections 2021-11-15T14:41:53.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/1635835372 wait complete. 2021-11-15T14:41:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 Processor -- start 2021-11-15T14:41:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- start start 2021-11-15T14:41:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0ad150 0x7fc5ac13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 0x7fc5ac12fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac12e920 con 0x7fc5ac0b0bb0 2021-11-15T14:41:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac12eb50 con 0x7fc5ac0afca0 2021-11-15T14:41:53.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac12edf0 con 0x7fc5ac0ad150 2021-11-15T14:41:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33094/0 (socket says 172.21.2.135:33094) 2021-11-15T14:41:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 -- 172.21.2.135:0/3832098897 learned_addr learned my addr 172.21.2.135:0/3832098897 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:53.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 -- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0ad150 msgr2=0x7fc5ac13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0ad150 0x7fc5ac13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 -- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 msgr2=0x7fc5ac12fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5abfff700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 0x7fc5ac12fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 0x7fc5ac12fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 -- 172.21.2.135:0/3832098897 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594008240 con 0x7fc5ac0afca0 2021-11-15T14:41:53.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5abfff700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 0x7fc5ac12fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:53.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5aaffd700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fc5ac0b00d0 tx=0x7fc5ac0ae5c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc59400b3a0 con 0x7fc5ac0afca0 2021-11-15T14:41:53.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400b500 con 0x7fc5ac0afca0 2021-11-15T14:41:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc59400b860 con 0x7fc5ac0afca0 2021-11-15T14:41:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac12f090 con 0x7fc5ac0afca0 2021-11-15T14:41:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.180+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac130190 con 0x7fc5ac0afca0 2021-11-15T14:41:53.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0b5a30 con 0x7fc5ac0afca0 2021-11-15T14:41:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc594025030 con 0x7fc5ac0afca0 2021-11-15T14:41:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5a8ff9700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 0x7fc590055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc59406c640 con 0x7fc5ac0afca0 2021-11-15T14:41:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5ab7fe700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 0x7fc590055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:53.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5ab7fe700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 0x7fc590055a90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fc59c002f70 tx=0x7fc59c006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:53.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.184+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc594043810 con 0x7fc5ac0afca0 2021-11-15T14:41:53.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.300+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fc5ac0573d0 con 0x7fc5ac0afca0 2021-11-15T14:41:53.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.956+0000 7fc5a8ff9700 1 -- 172.21.2.135:0/3832098897 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v316) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc5940230d0 con 0x7fc5ac0afca0 2021-11-15T14:41:53.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 msgr2=0x7fc590055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 0x7fc590055a90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fc59c002f70 tx=0x7fc59c006a80).stop 2021-11-15T14:41:53.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 msgr2=0x7fc5ac12f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:53.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fc5ac0b00d0 tx=0x7fc5ac0ae5c0).stop 2021-11-15T14:41:53.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 shutdown_connections 2021-11-15T14:41:53.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc5900535d0 0x7fc590055a90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc5ac0b0bb0 0x7fc5ac12fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc5ac0afca0 0x7fc5ac12f7b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:53.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 --2- 172.21.2.135:0/3832098897 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc5ac0ad150 0x7fc5ac13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:53.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 >> 172.21.2.135:0/3832098897 conn(0x7fc5ac062cb0 msgr2=0x7fc5ac149160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:53.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 shutdown_connections 2021-11-15T14:41:53.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:53.960+0000 7fc5b2249700 1 -- 172.21.2.135:0/3832098897 wait complete. 2021-11-15T14:41:53.970 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:41:53.970 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:41:53.971 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-15T14:41:54.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 Processor -- start 2021-11-15T14:41:54.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- start start 2021-11-15T14:41:54.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe6440b1e30 0x7fe6440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:54.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440b03d0 con 0x7fe6440a7140 2021-11-15T14:41:54.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440b0670 con 0x7fe644148420 2021-11-15T14:41:54.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440a9140 con 0x7fe6440b1e30 2021-11-15T14:41:54.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe643fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe644148420 0x7fe6440b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48920/0 (socket says 172.21.2.135:48920) 2021-11-15T14:41:54.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe643fff700 1 -- 172.21.2.135:0/3776175655 learned_addr learned my addr 172.21.2.135:0/3776175655 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:54.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe648a8a700 1 --2- 172.21.2.135:0/3776175655 >> v2:172.21.2.135:3300/0 conn(0x7fe6440b1e30 0x7fe6440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:54.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe648a8a700 1 -- 172.21.2.135:0/3776175655 >> v1:172.21.2.135:6789/0 conn(0x7fe644148420 legacy=0x7fe6440b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:54.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe648a8a700 1 -- 172.21.2.135:0/3776175655 >> v1:172.21.2.119:6789/0 conn(0x7fe6440a7140 legacy=0x7fe6441447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:54.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe648a8a700 1 -- 172.21.2.135:0/3776175655 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440b0910 con 0x7fe6440b1e30 2021-11-15T14:41:54.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe648a8a700 1 --2- 172.21.2.135:0/3776175655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6440b1e30 0x7fe6440b1050 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fe6440acee0 tx=0x7fe634006df0).ready entity=mon.1 client_cookie=a0d712790ca1f426 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:54.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe6437fe700 1 -- 172.21.2.135:0/3776175655 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63400d5c0 con 0x7fe6440b1e30 2021-11-15T14:41:54.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe6437fe700 1 -- 172.21.2.135:0/3776175655 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe634000e90 con 0x7fe6440b1e30 2021-11-15T14:41:54.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe6437fe700 1 -- 172.21.2.135:0/3776175655 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63400d910 con 0x7fe6440b1e30 2021-11-15T14:41:54.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- 172.21.2.135:0/3776175655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6440b1e30 msgr2=0x7fe6440b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:54.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- 172.21.2.135:0/3776175655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6440b1e30 0x7fe6440b1050 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7fe6440acee0 tx=0x7fe634006df0).stop 2021-11-15T14:41:54.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- 172.21.2.135:0/3776175655 shutdown_connections 2021-11-15T14:41:54.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- 172.21.2.135:0/3776175655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe6440b1e30 0x7fe6440b1050 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:54.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- 172.21.2.135:0/3776175655 >> 172.21.2.135:0/3776175655 conn(0x7fe64405f730 msgr2=0x7fe64405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:54.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- 172.21.2.135:0/3776175655 shutdown_connections 2021-11-15T14:41:54.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- 172.21.2.135:0/3776175655 wait complete. 2021-11-15T14:41:54.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 Processor -- start 2021-11-15T14:41:54.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- start start 2021-11-15T14:41:54.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6440a7140 0x7fe6440b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:54.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6440b1e30 0x7fe64415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:54.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:54.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440aa2f0 con 0x7fe6440b1e30 2021-11-15T14:41:54.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440ac340 con 0x7fe644148420 2021-11-15T14:41:54.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64acee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440aa670 con 0x7fe6440a7140 2021-11-15T14:41:54.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64928b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:54.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64928b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33110/0 (socket says 172.21.2.135:33110) 2021-11-15T14:41:54.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.020+0000 7fe64928b700 1 -- 172.21.2.135:0/2800816389 learned_addr learned my addr 172.21.2.135:0/2800816389 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:54.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 -- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6440a7140 msgr2=0x7fe6440b35f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:54.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6440a7140 0x7fe6440b35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:54.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 -- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6440b1e30 msgr2=0x7fe64415a160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:54.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6440b1e30 0x7fe64415a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:54.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 -- 172.21.2.135:0/2800816389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63400b180 con 0x7fe644148420 2021-11-15T14:41:54.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64928b700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe63c003310 tx=0x7fe63c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:54.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c001500 con 0x7fe644148420 2021-11-15T14:41:54.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c001660 con 0x7fe644148420 2021-11-15T14:41:54.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c0019c0 con 0x7fe644148420 2021-11-15T14:41:54.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440aab10 con 0x7fe644148420 2021-11-15T14:41:54.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64415ab40 con 0x7fe644148420 2021-11-15T14:41:54.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6440a9d80 con 0x7fe644148420 2021-11-15T14:41:54.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe63c018030 con 0x7fe644148420 2021-11-15T14:41:54.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 0x7fe624055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:54.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe63c06b340 con 0x7fe644148420 2021-11-15T14:41:54.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe648a8a700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 0x7fe624055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:54.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe648a8a700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 0x7fe624055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fe6440acee0 tx=0x7fe634014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:54.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.024+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe63c042540 con 0x7fe644148420 2021-11-15T14:41:54.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.136+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fe6440ac510 con 0x7fe644148420 2021-11-15T14:41:54.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe641ffb700 1 -- 172.21.2.135:0/2800816389 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v317) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe63c045b60 con 0x7fe644148420 2021-11-15T14:41:54.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 msgr2=0x7fe624055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:54.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 0x7fe624055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fe6440acee0 tx=0x7fe634014000).stop 2021-11-15T14:41:54.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 msgr2=0x7fe64415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:54.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe63c003310 tx=0x7fe63c0091a0).stop 2021-11-15T14:41:54.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 shutdown_connections 2021-11-15T14:41:54.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe624053610 0x7fe624055ad0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:54.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe644148420 0x7fe64415a650 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:54.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe6440b1e30 0x7fe64415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:54.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 --2- 172.21.2.135:0/2800816389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe6440a7140 0x7fe6440b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:54.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 >> 172.21.2.135:0/2800816389 conn(0x7fe64405f730 msgr2=0x7fe644143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:54.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 shutdown_connections 2021-11-15T14:41:54.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:54.964+0000 7fe64acee700 1 -- 172.21.2.135:0/2800816389 wait complete. 2021-11-15T14:41:54.976 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:41:55.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 Processor -- start 2021-11-15T14:41:55.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 -- start start 2021-11-15T14:41:55.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95341469d0 0x7f95341402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f95340b4200 0x7f95341407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9534143be0 con 0x7f95340b4710 2021-11-15T14:41:55.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9534147590 con 0x7f95340b4200 2021-11-15T14:41:55.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953c480700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9534143e80 con 0x7f95341469d0 2021-11-15T14:41:55.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953a21c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95341469d0 0x7f95341402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953aa1d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f95340b4710 0x7f95340b4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48936/0 (socket says 172.21.2.135:48936) 2021-11-15T14:41:55.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.024+0000 7f953aa1d700 1 -- 172.21.2.135:0/1183747911 learned_addr learned my addr 172.21.2.135:0/1183747911 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:55.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 -- 172.21.2.135:0/1183747911 >> v2:172.21.2.119:3300/0 conn(0x7f95340b4200 msgr2=0x7f95341407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:55.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 --2- 172.21.2.135:0/1183747911 >> v2:172.21.2.119:3300/0 conn(0x7f95340b4200 0x7f95341407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 -- 172.21.2.135:0/1183747911 >> v1:172.21.2.135:6789/0 conn(0x7f95340b4710 legacy=0x7f95340b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 -- 172.21.2.135:0/1183747911 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340b0d10 con 0x7f95341469d0 2021-11-15T14:41:55.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 --2- 172.21.2.135:0/1183747911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f95341402b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f9530002f70 tx=0x7f9530006df0).ready entity=mon.1 client_cookie=5dd323472a173002 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953921a700 1 -- 172.21.2.135:0/1183747911 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953000d5c0 con 0x7f95341469d0 2021-11-15T14:41:55.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953921a700 1 -- 172.21.2.135:0/1183747911 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530000e90 con 0x7f95341469d0 2021-11-15T14:41:55.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953921a700 1 -- 172.21.2.135:0/1183747911 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953000d910 con 0x7f95341469d0 2021-11-15T14:41:55.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/1183747911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 msgr2=0x7f95341402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- 172.21.2.135:0/1183747911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f95341402b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f9530002f70 tx=0x7f9530006df0).stop 2021-11-15T14:41:55.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/1183747911 shutdown_connections 2021-11-15T14:41:55.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- 172.21.2.135:0/1183747911 >> v2:172.21.2.119:3300/0 conn(0x7f95340b4200 0x7f95341407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- 172.21.2.135:0/1183747911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f95341402b0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/1183747911 >> 172.21.2.135:0/1183747911 conn(0x7f953405c510 msgr2=0x7f953405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/1183747911 shutdown_connections 2021-11-15T14:41:55.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/1183747911 wait complete. 2021-11-15T14:41:55.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 Processor -- start 2021-11-15T14:41:55.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- start start 2021-11-15T14:41:55.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95340b4200 0x7f95340b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 0x7f953413dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534155d50 con 0x7f95340b4710 2021-11-15T14:41:55.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534155ff0 con 0x7f95341469d0 2021-11-15T14:41:55.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9534156290 con 0x7f95340b4200 2021-11-15T14:41:55.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33126/0 (socket says 172.21.2.135:33126) 2021-11-15T14:41:55.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 -- 172.21.2.135:0/2004133096 learned_addr learned my addr 172.21.2.135:0/2004133096 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953a21c700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95340b4200 0x7f95340b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 -- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95340b4200 msgr2=0x7f95340b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f9539a1b700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 0x7f953413dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95340b4200 0x7f95340b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 -- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 msgr2=0x7f953413dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 0x7f953413dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 -- 172.21.2.135:0/2004133096 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953000b180 con 0x7f95341469d0 2021-11-15T14:41:55.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f9539a1b700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 0x7f953413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:41:55.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953aa1d700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f9534060cd0 tx=0x7f952c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c005ba0 con 0x7f95341469d0 2021-11-15T14:41:55.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c005d00 con 0x7f95341469d0 2021-11-15T14:41:55.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c0072c0 con 0x7f95341469d0 2021-11-15T14:41:55.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9534156530 con 0x7f95341469d0 2021-11-15T14:41:55.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.028+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95340b7ee0 con 0x7f95341469d0 2021-11-15T14:41:55.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95341566c0 con 0x7f95341469d0 2021-11-15T14:41:55.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f952c01a060 con 0x7f95341469d0 2021-11-15T14:41:55.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f95277fe700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 0x7f9514055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f952c06b320 con 0x7f95341469d0 2021-11-15T14:41:55.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f953a21c700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 0x7f9514055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f953a21c700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 0x7f9514055bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f9530015000 tx=0x7f9530014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.032+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f952c042600 con 0x7f95341469d0 2021-11-15T14:41:55.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.116+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f95340573d0 con 0x7f95341469d0 2021-11-15T14:41:55.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f95277fe700 1 -- 172.21.2.135:0/2004133096 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f952c018020 con 0x7f95341469d0 2021-11-15T14:41:55.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 msgr2=0x7f9514055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 0x7f9514055bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f9530015000 tx=0x7f9530014000).stop 2021-11-15T14:41:55.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 msgr2=0x7f9534152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f9534060cd0 tx=0x7f952c007f40).stop 2021-11-15T14:41:55.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 shutdown_connections 2021-11-15T14:41:55.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95140536f0 0x7f9514055bb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95341469d0 0x7f9534152670 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95340b4710 0x7f953413dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 --2- 172.21.2.135:0/2004133096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95340b4200 0x7f95340b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 >> 172.21.2.135:0/2004133096 conn(0x7f953405c510 msgr2=0x7f953413b540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 shutdown_connections 2021-11-15T14:41:55.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.128+0000 7f953c480700 1 -- 172.21.2.135:0/2004133096 wait complete. 2021-11-15T14:41:55.139 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:41:55.140 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:55.148 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:55.160 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:55.168 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:41:55.182 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:41:55.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:55.183 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:55.183 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:41:55.229 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:41:55.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:55.231 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:41:55.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:41:55.232 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:41:55.232 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:41:55.238 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:41:55.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:41:55.239 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:41:55.240 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:41:55.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 Processor -- start 2021-11-15T14:41:55.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- start start 2021-11-15T14:41:55.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd24140d70 0x7fdd240ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdd240a8cf0 0x7fdd240aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd240af110 con 0x7fdd240b1300 2021-11-15T14:41:55.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd24140390 con 0x7fdd240a8cf0 2021-11-15T14:41:55.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd24140630 con 0x7fdd24140d70 2021-11-15T14:41:55.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fdd240b1300 0x7fdd240b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:48950/0 (socket says 172.21.2.135:48950) 2021-11-15T14:41:55.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2259c700 1 -- 172.21.2.135:0/419773844 learned_addr learned my addr 172.21.2.135:0/419773844 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:55.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/419773844 >> v2:172.21.2.135:3300/0 conn(0x7fdd24140d70 0x7fdd240ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/419773844 >> v2:172.21.2.119:3300/0 conn(0x7fdd240a8cf0 msgr2=0x7fdd240aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:55.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/419773844 >> v2:172.21.2.119:3300/0 conn(0x7fdd240a8cf0 0x7fdd240aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/419773844 >> v1:172.21.2.135:6789/0 conn(0x7fdd240b1300 legacy=0x7fdd240b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/419773844 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd241408d0 con 0x7fdd24140d70 2021-11-15T14:41:55.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/419773844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd24140d70 0x7fdd240ae730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fdd18002f70 tx=0x7fdd18006df0).ready entity=mon.1 client_cookie=25743f27cfec21a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2159a700 1 -- 172.21.2.135:0/419773844 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1800d5c0 con 0x7fdd24140d70 2021-11-15T14:41:55.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2159a700 1 -- 172.21.2.135:0/419773844 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18000e90 con 0x7fdd24140d70 2021-11-15T14:41:55.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2159a700 1 -- 172.21.2.135:0/419773844 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1800d910 con 0x7fdd24140d70 2021-11-15T14:41:55.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- 172.21.2.135:0/419773844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd24140d70 msgr2=0x7fdd240ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- 172.21.2.135:0/419773844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd24140d70 0x7fdd240ae730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fdd18002f70 tx=0x7fdd18006df0).stop 2021-11-15T14:41:55.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- 172.21.2.135:0/419773844 shutdown_connections 2021-11-15T14:41:55.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- 172.21.2.135:0/419773844 >> v2:172.21.2.119:3300/0 conn(0x7fdd240a8cf0 0x7fdd240aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- 172.21.2.135:0/419773844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd24140d70 0x7fdd240ae730 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- 172.21.2.135:0/419773844 >> 172.21.2.135:0/419773844 conn(0x7fdd2405f730 msgr2=0x7fdd2405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- 172.21.2.135:0/419773844 shutdown_connections 2021-11-15T14:41:55.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- 172.21.2.135:0/419773844 wait complete. 2021-11-15T14:41:55.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 Processor -- start 2021-11-15T14:41:55.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- start start 2021-11-15T14:41:55.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd240a8cf0 0x7fdd24066f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd24140d70 0x7fdd240ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd241427b0 con 0x7fdd240a8cf0 2021-11-15T14:41:55.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240ab6f0 con 0x7fdd240b1300 2021-11-15T14:41:55.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd2892e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240aba30 con 0x7fdd24140d70 2021-11-15T14:41:55.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33140/0 (socket says 172.21.2.135:33140) 2021-11-15T14:41:55.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/3311270968 learned_addr learned my addr 172.21.2.135:0/3311270968 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd24140d70 msgr2=0x7fdd240ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd24140d70 0x7fdd240ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd240a8cf0 msgr2=0x7fdd24066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd240a8cf0 0x7fdd24066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 -- 172.21.2.135:0/3311270968 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1800b180 con 0x7fdd240b1300 2021-11-15T14:41:55.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.296+0000 7fdd21d9b700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fdd241431d0 tx=0x7fdd18014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd18016070 con 0x7fdd240b1300 2021-11-15T14:41:55.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18013780 con 0x7fdd240b1300 2021-11-15T14:41:55.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd18013ae0 con 0x7fdd240b1300 2021-11-15T14:41:55.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd240abcd0 con 0x7fdd240b1300 2021-11-15T14:41:55.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd24141c10 con 0x7fdd240b1300 2021-11-15T14:41:55.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24140080 con 0x7fdd240b1300 2021-11-15T14:41:55.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd18025030 con 0x7fdd240b1300 2021-11-15T14:41:55.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 0x7fdd00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fdd1806c8e0 con 0x7fdd240b1300 2021-11-15T14:41:55.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd2259c700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 0x7fdd00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd2259c700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 0x7fdd00055ad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fdd240a9a20 tx=0x7fdd140077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.300+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd18043a30 con 0x7fdd240b1300 2021-11-15T14:41:55.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdd240573d0 con 0x7fdd240b1300 2021-11-15T14:41:55.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd137fe700 1 -- 172.21.2.135:0/3311270968 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+29227 (secure 0 0 0) 0x7fdd18023070 con 0x7fdd240b1300 2021-11-15T14:41:55.388 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:55.389 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:55.389 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 105, 2021-11-15T14:41:55.389 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:41:55.389 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:41:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:41:52.934897+0000", 2021-11-15T14:41:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:41:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:41:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:41:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:41:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:41:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:41:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:41:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:41:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:41:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:41:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:41:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:41:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:41:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 18, 2021-11-15T14:41:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:41:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:41:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:41:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:41:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:41:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:41:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:41:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:41:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:41:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:41:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:41:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:41:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:41:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:41:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:41:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:41:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:41:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:41:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:41:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:41:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:41:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:41:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:41:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:41:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:41:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:41:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:41:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:41:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:41:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:41:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:41:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:41:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:41:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:41:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:41:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:41:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:41:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:41:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:41:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:41:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:41:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:41:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:41:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:41:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:41:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:41:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:41:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:41:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:41:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:41:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:41:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:41:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:41:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:41:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:41:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:41:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:41:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:41:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:41:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:41:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:41:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:41:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:41:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:41:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:41:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:41:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:41:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:41:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:41:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:41:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:41:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:41:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:41:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:41:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:41:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:41:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:41:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:41:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:41:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:41:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:41:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:41:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:41:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:41:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:41:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:41:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:41:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:41:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:41:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:41:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:41:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:41:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:41:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:41:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:41:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:41:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:41:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 99, 2021-11-15T14:41:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:41:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:41:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:41:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:41:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:41:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:41:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:41:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:41:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:41:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:41:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:41:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:41:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:41:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:41:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:41:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:41:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:41:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:41:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:41:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:41:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:41:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:41:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:41:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:41:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:41:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:41:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:41:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:41:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 88, 2021-11-15T14:41:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:41:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:41:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:41:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:41:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:41:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:41:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:41:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:41:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:41:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:41:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:41:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:41:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:41:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:41:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:41:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:41:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:41:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:41:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:41:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:41:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:41:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:41:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:41:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:41:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:41:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:41:55.513 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:41:55.513 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.513 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.513 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.514 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.514 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.514 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.514 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:55.514 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:41:55.515 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.515 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.515 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.515 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.516 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.516 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.516 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.516 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.516 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.517 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.517 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.517 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.518 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:41:55.518 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.518 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:41:55.519 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.519 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.520 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.520 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.520 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.521 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.521 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:41:55.521 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.521 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.522 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.522 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:41:55.522 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.522 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.523 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.523 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.523 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.523 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.524 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.524 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.524 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:41:55.524 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.524 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.525 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.525 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.525 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:41:55.525 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.526 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.526 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.526 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.526 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.527 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.527 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:41:55.527 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.528 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.528 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.528 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.528 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:41:55.529 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:41:55.529 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.529 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.529 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.529 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:41:55.530 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:41:55.530 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:41:55.530 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:41:55.530 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.531 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.531 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.531 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.531 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.532 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.532 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:55.532 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:41:55.532 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.532 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.533 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.533 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.533 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.533 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.534 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.534 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.534 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.534 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.535 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.535 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.535 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:41:55.536 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.536 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.536 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.537 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:41:55.537 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.537 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.537 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.537 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.538 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.538 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.538 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.539 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:41:55.539 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.539 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.539 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.540 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.540 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:41:55.540 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.540 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.540 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.541 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.541 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.541 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.541 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.542 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.542 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:41:55.542 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.542 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.542 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.543 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.543 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:41:55.543 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.543 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.544 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.544 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.544 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.544 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.544 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.545 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.545 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:41:55.545 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.545 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.546 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.546 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:41:55.546 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:41:55.546 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.547 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.547 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:41:55.547 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:41:55.548 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:41:55.548 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:41:55.548 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.548 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.548 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.549 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.549 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.549 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.549 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:55.550 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:41:55.550 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:41:55.550 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:41:55.550 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:41:55.550 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:41:55.551 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:41:55.551 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:41:55.551 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:41:55.551 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 100, 2021-11-15T14:41:55.551 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:41:55.552 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:41:55.552 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:41:55.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.552 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.553 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.553 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:41:55.553 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.554 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.554 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.554 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:41:55.554 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.554 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.555 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.555 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.555 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:41:55.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.556 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.556 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.556 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:41:55.556 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.556 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.557 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.557 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.557 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:41:55.557 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.558 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.558 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.558 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.558 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:41:55.558 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.559 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.559 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.559 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:41:55.559 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.560 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.560 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.560 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.560 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:41:55.561 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.561 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.561 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.561 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.561 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:41:55.562 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:41:55.562 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.562 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:41:55.562 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:41:55.563 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.563 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.563 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.563 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:41:55.563 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:41:55.564 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:41:55.564 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.564 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.564 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.565 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:41:55.565 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:41:55.565 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:41:55.565 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:41:55.565 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:41:55.566 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:41:55.566 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:41:55.566 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:55.566 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.567 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:55.567 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:41:55.567 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.567 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:41:55.568 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.568 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.568 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.568 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.568 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.569 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:41:55.569 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.569 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.569 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.570 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:41:55.570 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.570 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.570 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.570 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.571 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.571 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:41:55.571 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.571 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.571 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.572 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:41:55.572 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.572 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.572 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.573 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.573 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.573 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:41:55.573 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.573 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.574 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.574 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:41:55.574 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.574 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.575 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.575 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.575 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.575 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:41:55.576 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.576 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.576 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.576 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:41:55.576 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.577 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.577 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.577 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.577 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.578 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:41:55.578 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.578 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.578 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.578 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:41:55.579 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.579 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.579 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.579 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.580 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.580 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:41:55.580 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.580 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.580 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.581 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:41:55.581 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.581 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.581 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.582 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.582 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.582 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:41:55.582 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.583 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.583 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:55.583 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:41:55.583 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:41:55.583 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:41:55.584 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:41:55.584 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:41:55.584 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:41:55.584 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:41:55.585 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:41:55.585 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.585 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:41:55.585 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:41:55.586 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:41:55.586 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:41:55.586 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:41:55.586 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:41:55.586 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/4146626151": "2021-11-16T14:41:49.366248+0000", 2021-11-15T14:41:55.587 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/4146626151": "2021-11-16T14:41:49.366248+0000" 2021-11-15T14:41:55.587 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.587 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:41:55.587 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:41:55.588 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:41:55.588 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:55.588 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:41:55.588 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:41:55.588 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:55.589 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:41:55.589 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:55.589 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:55.589 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:41:55.590 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:41:55.590 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.590 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:41:55.590 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:41:55.590 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:41:55.591 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:41:55.591 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:41:55.591 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:41:55.591 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:41:55.592 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:55.592 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:55.592 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:41:55.592 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:41:55.592 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:41:55.593 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:41:55.593 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:41:55.593 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 msgr2=0x7fdd00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 0x7fdd00055ad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fdd240a9a20 tx=0x7fdd140077f0).stop 2021-11-15T14:41:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 msgr2=0x7fdd24141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fdd241431d0 tx=0x7fdd18014000).stop 2021-11-15T14:41:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 shutdown_connections 2021-11-15T14:41:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdd00053610 0x7fdd00055ad0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd24140d70 0x7fdd240ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd240b1300 0x7fdd24141720 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 --2- 172.21.2.135:0/3311270968 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd240a8cf0 0x7fdd24066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 >> 172.21.2.135:0/3311270968 conn(0x7fdd2405f730 msgr2=0x7fdd240b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 shutdown_connections 2021-11-15T14:41:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.384+0000 7fdd2892e700 1 -- 172.21.2.135:0/3311270968 wait complete. 2021-11-15T14:41:55.598 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:55.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 Processor -- start 2021-11-15T14:41:55.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- start start 2021-11-15T14:41:55.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0b1e30 0x7f6efc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6efc148420 0x7f6efc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6efc0a7140 0x7f6efc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc0a9140 con 0x7f6efc148420 2021-11-15T14:41:55.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc0b03d0 con 0x7f6efc0a7140 2021-11-15T14:41:55.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0b0670 con 0x7f6efc0b1e30 2021-11-15T14:41:55.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6efc0a7140 0x7f6efc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6efc0a7140 0x7f6efc1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33146/0 (socket says 172.21.2.135:33146) 2021-11-15T14:41:55.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 -- 172.21.2.135:0/4156069595 learned_addr learned my addr 172.21.2.135:0/4156069595 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 -- 172.21.2.135:0/4156069595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0b1e30 msgr2=0x7f6efc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:55.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 --2- 172.21.2.135:0/4156069595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0b1e30 0x7f6efc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 -- 172.21.2.135:0/4156069595 >> v2:172.21.2.119:3300/0 conn(0x7f6efc148420 msgr2=0x7f6efc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:55.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 --2- 172.21.2.135:0/4156069595 >> v2:172.21.2.119:3300/0 conn(0x7f6efc148420 0x7f6efc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 -- 172.21.2.135:0/4156069595 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0b0910 con 0x7f6efc0a7140 2021-11-15T14:41:55.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f026a6700 1 --2- 172.21.2.135:0/4156069595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0a7140 0x7f6efc1447a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6ef40032f0 tx=0x7f6ef4009290).ready entity=mon.1 client_cookie=72e891a539c38874 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f00ea3700 1 -- 172.21.2.135:0/4156069595 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef400b870 con 0x7f6efc0a7140 2021-11-15T14:41:55.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f00ea3700 1 -- 172.21.2.135:0/4156069595 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400b9d0 con 0x7f6efc0a7140 2021-11-15T14:41:55.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f00ea3700 1 -- 172.21.2.135:0/4156069595 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef400bb40 con 0x7f6efc0a7140 2021-11-15T14:41:55.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- 172.21.2.135:0/4156069595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0a7140 msgr2=0x7f6efc1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- 172.21.2.135:0/4156069595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0a7140 0x7f6efc1447a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6ef40032f0 tx=0x7f6ef4009290).stop 2021-11-15T14:41:55.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- 172.21.2.135:0/4156069595 shutdown_connections 2021-11-15T14:41:55.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- 172.21.2.135:0/4156069595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0a7140 0x7f6efc1447a0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- 172.21.2.135:0/4156069595 >> v2:172.21.2.119:3300/0 conn(0x7f6efc148420 0x7f6efc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- 172.21.2.135:0/4156069595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0b1e30 0x7f6efc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- 172.21.2.135:0/4156069595 >> 172.21.2.135:0/4156069595 conn(0x7f6efc05f730 msgr2=0x7f6efc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- 172.21.2.135:0/4156069595 shutdown_connections 2021-11-15T14:41:55.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- 172.21.2.135:0/4156069595 wait complete. 2021-11-15T14:41:55.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 Processor -- start 2021-11-15T14:41:55.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- start start 2021-11-15T14:41:55.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0a7140 0x7f6efc142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6efc148420 0x7f6efc142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1433e0 con 0x7f6efc148420 2021-11-15T14:41:55.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc141e20 con 0x7f6efc0b1e30 2021-11-15T14:41:55.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.668+0000 7f6f04109700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1420c0 con 0x7f6efc0a7140 2021-11-15T14:41:55.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33152/0 (socket says 172.21.2.135:33152) 2021-11-15T14:41:55.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 -- 172.21.2.135:0/178880482 learned_addr learned my addr 172.21.2.135:0/178880482 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 -- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0a7140 msgr2=0x7f6efc142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0a7140 0x7f6efc142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 -- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6efc148420 msgr2=0x7f6efc142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6efc148420 0x7f6efc142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 -- 172.21.2.135:0/178880482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009530 con 0x7f6efc0b1e30 2021-11-15T14:41:55.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f016a4700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f6efc143520 tx=0x7f6eec006d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eec011400 con 0x7f6efc0b1e30 2021-11-15T14:41:55.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec011560 con 0x7f6efc0b1e30 2021-11-15T14:41:55.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eec0116d0 con 0x7f6efc0b1e30 2021-11-15T14:41:55.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc142360 con 0x7f6efc0b1e30 2021-11-15T14:41:55.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc14a590 con 0x7f6efc0b1e30 2021-11-15T14:41:55.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc1424f0 con 0x7f6efc0b1e30 2021-11-15T14:41:55.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6eec00f070 con 0x7f6efc0b1e30 2021-11-15T14:41:55.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 0x7f6edc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6eec06af30 con 0x7f6efc0b1e30 2021-11-15T14:41:55.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f01ea5700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 0x7f6edc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.672+0000 7f6f01ea5700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 0x7f6edc055b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f6ef8002f70 tx=0x7f6ef8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.676+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6eec042210 con 0x7f6efc0b1e30 2021-11-15T14:41:55.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.780+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6efc0b0bb0 con 0x7f6efc0b1e30 2021-11-15T14:41:55.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.780+0000 7f6eeaffd700 1 -- 172.21.2.135:0/178880482 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f6eec045830 con 0x7f6efc0b1e30 2021-11-15T14:41:55.786 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:55.786 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":7186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/825255187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":825255187},{"type":"v1","addr":"172.21.2.135:6835","nonce":825255187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[]} 2021-11-15T14:41:55.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 msgr2=0x7f6edc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 0x7f6edc055b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f6ef8002f70 tx=0x7f6ef8006a80).stop 2021-11-15T14:41:55.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 msgr2=0x7f6efc148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f6efc143520 tx=0x7f6eec006d80).stop 2021-11-15T14:41:55.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 shutdown_connections 2021-11-15T14:41:55.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6edc053640 0x7f6edc055b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6efc148420 0x7f6efc142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6efc0b1e30 0x7f6efc148ec0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 --2- 172.21.2.135:0/178880482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6efc0a7140 0x7f6efc142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 >> 172.21.2.135:0/178880482 conn(0x7f6efc05f730 msgr2=0x7f6efc0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 shutdown_connections 2021-11-15T14:41:55.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.784+0000 7f6f04109700 1 -- 172.21.2.135:0/178880482 wait complete. 2021-11-15T14:41:55.790 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 51 2021-11-15T14:41:55.793 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:41:55.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 Processor -- start 2021-11-15T14:41:55.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 -- start start 2021-11-15T14:41:55.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1ca4148420 0x7f1ca40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca40b03d0 con 0x7f1ca40a7140 2021-11-15T14:41:55.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca40a9140 con 0x7f1ca4148420 2021-11-15T14:41:55.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca9c56700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40b0670 con 0x7f1ca40b1e30 2021-11-15T14:41:55.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca37fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f1ca4148420 0x7f1ca40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca37fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:42934/0 (socket says 172.21.2.135:42934) 2021-11-15T14:41:55.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca37fe700 1 -- 172.21.2.135:0/3224480682 learned_addr learned my addr 172.21.2.135:0/3224480682 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 --2- 172.21.2.135:0/3224480682 >> v2:172.21.2.119:3300/0 conn(0x7f1ca4148420 0x7f1ca40b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:55208/0 (socket says 172.21.2.135:55208) 2021-11-15T14:41:55.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 -- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 msgr2=0x7f1ca40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:55.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 --2- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 -- 172.21.2.135:0/3224480682 >> v1:172.21.2.119:6789/0 conn(0x7f1ca40a7140 legacy=0x7f1ca41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.840+0000 7f1ca2ffd700 1 -- 172.21.2.135:0/3224480682 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40b0910 con 0x7f1ca4148420 2021-11-15T14:41:55.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca2ffd700 1 --2- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca4148420 0x7f1ca40b2210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1c94002f70 tx=0x7f1c94006df0).ready entity=mon.0 client_cookie=c5b5f37f4235bb00 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca27fc700 1 -- 172.21.2.135:0/3224480682 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9400d570 con 0x7f1ca4148420 2021-11-15T14:41:55.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca27fc700 1 -- 172.21.2.135:0/3224480682 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94000e90 con 0x7f1ca4148420 2021-11-15T14:41:55.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca27fc700 1 -- 172.21.2.135:0/3224480682 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9400d8c0 con 0x7f1ca4148420 2021-11-15T14:41:55.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca4148420 msgr2=0x7f1ca40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca4148420 0x7f1ca40b2210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1c94002f70 tx=0x7f1c94006df0).stop 2021-11-15T14:41:55.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/3224480682 shutdown_connections 2021-11-15T14:41:55.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca4148420 0x7f1ca40b2210 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/3224480682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/3224480682 >> 172.21.2.135:0/3224480682 conn(0x7f1ca405f730 msgr2=0x7f1ca405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/3224480682 shutdown_connections 2021-11-15T14:41:55.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/3224480682 wait complete. 2021-11-15T14:41:55.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 Processor -- start 2021-11-15T14:41:55.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- start start 2021-11-15T14:41:55.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca40a7140 0x7f1ca4063600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40a9bd0 con 0x7f1ca40a7140 2021-11-15T14:41:55.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40a9e70 con 0x7f1ca4148420 2021-11-15T14:41:55.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40aa110 con 0x7f1ca40b1e30 2021-11-15T14:41:55.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33164/0 (socket says 172.21.2.135:33164) 2021-11-15T14:41:55.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 -- 172.21.2.135:0/740953203 learned_addr learned my addr 172.21.2.135:0/740953203 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:55.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 -- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 msgr2=0x7f1ca40aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 -- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca40a7140 msgr2=0x7f1ca4063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca40a7140 0x7f1ca4063600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 -- 172.21.2.135:0/740953203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9400b180 con 0x7f1ca4148420 2021-11-15T14:41:55.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca3fff700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f1ca4061420 tx=0x7f1c9c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c00e4a0 con 0x7f1ca4148420 2021-11-15T14:41:55.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00e600 con 0x7f1ca4148420 2021-11-15T14:41:55.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca40aa3b0 con 0x7f1ca4148420 2021-11-15T14:41:55.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c00e960 con 0x7f1ca4148420 2021-11-15T14:41:55.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.844+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca40ab550 con 0x7f1ca4148420 2021-11-15T14:41:55.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca40aa540 con 0x7f1ca4148420 2021-11-15T14:41:55.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c9c019030 con 0x7f1ca4148420 2021-11-15T14:41:55.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca0ff9700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 0x7f1c88055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:55.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f1c9c06af40 con 0x7f1ca4148420 2021-11-15T14:41:55.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca37fe700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 0x7f1c88055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:55.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca37fe700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 0x7f1c88055b90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1c8c00c000 tx=0x7f1c8c006eb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:55.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.848+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c9c042220 con 0x7f1ca4148420 2021-11-15T14:41:55.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.956+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ca40b0bb0 con 0x7f1ca4148420 2021-11-15T14:41:55.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.956+0000 7f1ca0ff9700 1 -- 172.21.2.135:0/740953203 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f1c9c045840 con 0x7f1ca4148420 2021-11-15T14:41:55.962 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:55.963 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/688742909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":688742909},{"type":"v1","addr":"172.21.2.119:6835","nonce":688742909}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6931,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/4144119167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":4144119167},{"type":"v1","addr":"172.21.2.135:6833","nonce":4144119167}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":7186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/825255187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":825255187},{"type":"v1","addr":"172.21.2.135:6835","nonce":825255187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[]} 2021-11-15T14:41:55.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 msgr2=0x7f1c88055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 0x7f1c88055b90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1c8c00c000 tx=0x7f1c8c006eb0).stop 2021-11-15T14:41:55.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 msgr2=0x7f1ca40ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:55.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f1ca4061420 tx=0x7f1c9c007f40).stop 2021-11-15T14:41:55.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 shutdown_connections 2021-11-15T14:41:55.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f1c880536d0 0x7f1c88055b90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f1ca4148420 0x7f1ca40ab060 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:55.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1ca40b1e30 0x7f1ca40aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 --2- 172.21.2.135:0/740953203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1ca40a7140 0x7f1ca4063600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:55.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 >> 172.21.2.135:0/740953203 conn(0x7f1ca405f730 msgr2=0x7f1ca4143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:55.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 shutdown_connections 2021-11-15T14:41:55.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:55.960+0000 7f1ca9c56700 1 -- 172.21.2.135:0/740953203 wait complete. 2021-11-15T14:41:55.967 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 51 2021-11-15T14:41:55.969 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:41:55.970 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:41:55.970 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:41:55.970 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:55.971 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:41:55.971 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:41:55.971 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:41:55.972 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:55.972 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:41:55.972 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:41:55.973 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:41:55.973 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:41:55.976 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:41:55.976 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:41:55.978 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:41:55.978 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:41:55.979 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:41:55.980 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:55.981 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:41:55.981 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:55.982 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:41:55.982 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:41:55.985 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:41:55.986 DEBUG:teuthology.parallel:result is None 2021-11-15T14:41:55.986 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:41:56.011 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:41:56.012 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:41:56.023 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:41:56.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 Processor -- start 2021-11-15T14:41:56.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- start start 2021-11-15T14:41:56.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0f840b2470 0x7f0f84142970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 0x7f0f84142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840b0af0 con 0x7f0f8405f730 2021-11-15T14:41:56.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84143350 con 0x7f0f840ad6b0 2021-11-15T14:41:56.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840b2850 con 0x7f0f840b2470 2021-11-15T14:41:56.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0f840b2470 0x7f0f84142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a920700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0f8405f730 0x7f0f8405fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49018/0 (socket says 172.21.2.135:49018) 2021-11-15T14:41:56.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a920700 1 -- 172.21.2.135:0/580550649 learned_addr learned my addr 172.21.2.135:0/580550649 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:56.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8991e700 1 --2- 172.21.2.135:0/580550649 >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 0x7f0f84142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 -- 172.21.2.135:0/580550649 >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 msgr2=0x7f0f84142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:56.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 --2- 172.21.2.135:0/580550649 >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 0x7f0f84142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:56.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 -- 172.21.2.135:0/580550649 >> v1:172.21.2.135:6789/0 conn(0x7f0f8405f730 legacy=0x7f0f8405fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:56.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 -- 172.21.2.135:0/580550649 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840accd0 con 0x7f0f840b2470 2021-11-15T14:41:56.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8991e700 1 --2- 172.21.2.135:0/580550649 >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 0x7f0f84142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:56.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8a11f700 1 --2- 172.21.2.135:0/580550649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840b2470 0x7f0f84142970 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f0f80002f70 tx=0x7f0f80006e80).ready entity=mon.1 client_cookie=c35e0b1a18e0dc67 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:56.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8911d700 1 -- 172.21.2.135:0/580550649 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8000f730 con 0x7f0f840b2470 2021-11-15T14:41:56.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8911d700 1 -- 172.21.2.135:0/580550649 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80000e90 con 0x7f0f840b2470 2021-11-15T14:41:56.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8911d700 1 -- 172.21.2.135:0/580550649 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8000fa80 con 0x7f0f840b2470 2021-11-15T14:41:56.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- 172.21.2.135:0/580550649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840b2470 msgr2=0x7f0f84142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:56.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 --2- 172.21.2.135:0/580550649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840b2470 0x7f0f84142970 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f0f80002f70 tx=0x7f0f80006e80).stop 2021-11-15T14:41:56.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- 172.21.2.135:0/580550649 shutdown_connections 2021-11-15T14:41:56.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 --2- 172.21.2.135:0/580550649 >> v2:172.21.2.119:3300/0 conn(0x7f0f840ad6b0 0x7f0f84142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:56.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 --2- 172.21.2.135:0/580550649 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840b2470 0x7f0f84142970 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:56.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- 172.21.2.135:0/580550649 >> 172.21.2.135:0/580550649 conn(0x7f0f8405c510 msgr2=0x7f0f8405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:56.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- 172.21.2.135:0/580550649 shutdown_connections 2021-11-15T14:41:56.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.036+0000 7f0f8b121700 1 -- 172.21.2.135:0/580550649 wait complete. 2021-11-15T14:41:56.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 Processor -- start 2021-11-15T14:41:56.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- start start 2021-11-15T14:41:56.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 0x7f0f840b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f840b2470 0x7f0f84064140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840aaaa0 con 0x7f0f840b2470 2021-11-15T14:41:56.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840aacd0 con 0x7f0f840a9610 2021-11-15T14:41:56.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84067380 con 0x7f0f8405f730 2021-11-15T14:41:56.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33206/0 (socket says 172.21.2.135:33206) 2021-11-15T14:41:56.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a11f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 0x7f0f840b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 -- 172.21.2.135:0/4126099241 learned_addr learned my addr 172.21.2.135:0/4126099241 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:56.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8991e700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f840b2470 0x7f0f84064140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 -- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 msgr2=0x7f0f840b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:56.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 0x7f0f840b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:56.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 -- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f840b2470 msgr2=0x7f0f84064140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:56.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f840b2470 0x7f0f84064140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:56.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 -- 172.21.2.135:0/4126099241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8000c310 con 0x7f0f840a9610 2021-11-15T14:41:56.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a11f700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 0x7f0f840b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:41:56.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a920700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f0f8405d830 tx=0x7f0f7c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:56.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c005ba0 con 0x7f0f840a9610 2021-11-15T14:41:56.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c005d00 con 0x7f0f840a9610 2021-11-15T14:41:56.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8413d280 con 0x7f0f840a9610 2021-11-15T14:41:56.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c0072c0 con 0x7f0f840a9610 2021-11-15T14:41:56.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84064d40 con 0x7f0f840a9610 2021-11-15T14:41:56.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84067540 con 0x7f0f840a9610 2021-11-15T14:41:56.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f7c010070 con 0x7f0f840a9610 2021-11-15T14:41:56.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 0x7f0f64055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:56.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0f7c06b120 con 0x7f0f840a9610 2021-11-15T14:41:56.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a11f700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 0x7f0f64055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:56.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.040+0000 7f0f8a11f700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 0x7f0f64055a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f0f8001d000 tx=0x7f0f80017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:56.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.044+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f7c042360 con 0x7f0f840a9610 2021-11-15T14:41:56.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:56.136+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0f840acf70 con 0x7f0f840a9610 2021-11-15T14:41:57.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f737fe700 1 -- 172.21.2.135:0/4126099241 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0f7c045980 con 0x7f0f840a9610 2021-11-15T14:41:57.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 msgr2=0x7f0f64055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 0x7f0f64055a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f0f8001d000 tx=0x7f0f80017000).stop 2021-11-15T14:41:57.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 msgr2=0x7f0f84064630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f0f8405d830 tx=0x7f0f7c007f40).stop 2021-11-15T14:41:57.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 shutdown_connections 2021-11-15T14:41:57.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0f64053580 0x7f0f64055a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0f840a9610 0x7f0f84064630 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0f840b2470 0x7f0f84064140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 --2- 172.21.2.135:0/4126099241 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0f8405f730 0x7f0f840b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 >> 172.21.2.135:0/4126099241 conn(0x7f0f8405c510 msgr2=0x7f0f840af980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 shutdown_connections 2021-11-15T14:41:57.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.140+0000 7f0f8b121700 1 -- 172.21.2.135:0/4126099241 wait complete. 2021-11-15T14:41:57.147 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:41:57.151 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:41:57.151 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:41:57.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 Processor -- start 2021-11-15T14:41:57.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 -- start start 2021-11-15T14:41:57.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f83180b2280 0x7f83180abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 0x7f83180ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180ac860 con 0x7f8318141720 2021-11-15T14:41:57.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83181452d0 con 0x7f83180b2280 2021-11-15T14:41:57.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f83204fe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318145570 con 0x7f83180b0050 2021-11-15T14:41:57.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831ea9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8318141720 0x7f8318141b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49038/0 (socket says 172.21.2.135:49038) 2021-11-15T14:41:57.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831ea9b700 1 -- 172.21.2.135:0/1155316557 learned_addr learned my addr 172.21.2.135:0/1155316557 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:57.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136815289 0 0) 0x7f83180ac860 con 0x7f8318141720 2021-11-15T14:41:57.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8300003260 con 0x7f8318141720 2021-11-15T14:41:57.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831da99700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 0x7f83180ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831e29a700 1 --2- 172.21.2.135:0/1155316557 >> v2:172.21.2.119:3300/0 conn(0x7f83180b2280 0x7f83180abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640795662 0 0) 0x7f8300003260 con 0x7f8318141720 2021-11-15T14:41:57.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 msgr2=0x7f83180ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:57.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 0x7f83180ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 >> v2:172.21.2.119:3300/0 conn(0x7f83180b2280 msgr2=0x7f83180abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:57.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 --2- 172.21.2.135:0/1155316557 >> v2:172.21.2.119:3300/0 conn(0x7f83180b2280 0x7f83180abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318141280 con 0x7f8318141720 2021-11-15T14:41:57.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8314001680 con 0x7f8318141720 2021-11-15T14:41:57.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 >> v1:172.21.2.135:6789/0 conn(0x7f8318141720 legacy=0x7f8318141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300003750 0x7f8300003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8300004500 0x7f8300004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 0x7f8300004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83181452d0 con 0x7f8300003750 2021-11-15T14:41:57.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318145570 con 0x7f8300004500 2021-11-15T14:41:57.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830000b7a0 con 0x7f83180b0050 2021-11-15T14:41:57.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.244+0000 7f831da99700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8300004500 0x7f8300004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 -- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 msgr2=0x7f8300004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:57.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f83180b0050 0x7f8300004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 -- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300003750 msgr2=0x7f8300003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:57.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300003750 0x7f8300003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 -- 172.21.2.135:0/1155316557 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300003260 con 0x7f8300004500 2021-11-15T14:41:57.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831da99700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8300004500 0x7f8300004980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f831000a000 tx=0x7f8310008040).ready entity=mon.1 client_cookie=3b052b6934b648d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831000c070 con 0x7f8300004500 2021-11-15T14:41:57.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000e620 con 0x7f8300004500 2021-11-15T14:41:57.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831d298700 1 -- 172.21.2.135:0/1155316557 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831000e980 con 0x7f8300004500 2021-11-15T14:41:57.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/1155316557 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8300004500 msgr2=0x7f8300004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 --2- 172.21.2.135:0/1155316557 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8300004500 0x7f8300004980 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f831000a000 tx=0x7f8310008040).stop 2021-11-15T14:41:57.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 -- 172.21.2.135:0/1155316557 reap_dead start 2021-11-15T14:41:57.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/1155316557 shutdown_connections 2021-11-15T14:41:57.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/1155316557 >> 172.21.2.135:0/1155316557 conn(0x7f831805f730 msgr2=0x7f831805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/1155316557 shutdown_connections 2021-11-15T14:41:57.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/1155316557 wait complete. 2021-11-15T14:41:57.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 Processor -- start 2021-11-15T14:41:57.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- start start 2021-11-15T14:41:57.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300004500 0x7f831813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831813ce20 0x7f8318150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831813db20 con 0x7f8300004500 2021-11-15T14:41:57.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831813ddc0 con 0x7f8318150c60 2021-11-15T14:41:57.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831813e060 con 0x7f831813ce20 2021-11-15T14:41:57.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33230/0 (socket says 172.21.2.135:33230) 2021-11-15T14:41:57.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 -- 172.21.2.135:0/3770142779 learned_addr learned my addr 172.21.2.135:0/3770142779 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 -- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831813ce20 msgr2=0x7f8318150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831813ce20 0x7f8318150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 -- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300004500 msgr2=0x7f831813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300004500 0x7f831813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 -- 172.21.2.135:0/3770142779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831813e300 con 0x7f8318150c60 2021-11-15T14:41:57.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831ea9b700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f83140018e0 tx=0x7f83180b5640).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83140070d0 con 0x7f8318150c60 2021-11-15T14:41:57.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314007230 con 0x7f8318150c60 2021-11-15T14:41:57.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831813ff50 con 0x7f8318150c60 2021-11-15T14:41:57.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8314004710 con 0x7f8318150c60 2021-11-15T14:41:57.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8318151110 con 0x7f8318150c60 2021-11-15T14:41:57.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318151420 con 0x7f8318150c60 2021-11-15T14:41:57.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f831401b070 con 0x7f8318150c60 2021-11-15T14:41:57.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 0x7f82f8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f831406aae0 con 0x7f8318150c60 2021-11-15T14:41:57.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.248+0000 7f831e29a700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 0x7f82f8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.252+0000 7f831e29a700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 0x7f82f8055b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f830800a000 tx=0x7f8308008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.252+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8314041e20 con 0x7f8318150c60 2021-11-15T14:41:57.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.360+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f831813e490 con 0x7f8318150c60 2021-11-15T14:41:57.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83077fe700 1 -- 172.21.2.135:0/3770142779 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f8314019020 con 0x7f8318150c60 2021-11-15T14:41:57.367 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:57.367 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:41:57.367 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:41:57.368 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.368 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:41:57.368 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:41:57.368 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.368 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:57.369 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.369 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.369 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.369 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.370 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.370 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:41:57.370 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:41:57.370 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.371 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:57.371 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.371 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.371 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.372 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.372 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.372 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:41:57.372 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:41:57.373 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.373 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:57.373 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.373 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.374 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.374 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.374 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.375 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:41:57.375 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:41:57.375 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.375 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.376 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.376 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.376 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.376 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.376 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.377 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:41:57.377 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:41:57.377 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.377 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.378 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.378 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.378 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.379 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.379 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.379 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:41:57.379 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:41:57.379 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.380 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.380 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.380 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.380 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.381 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.381 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:41:57.381 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:41:57.382 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.382 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.382 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.382 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.383 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.383 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.383 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:41:57.383 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:41:57.384 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.384 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.384 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.384 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.384 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.385 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.385 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.385 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:41:57.385 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:41:57.386 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.386 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.386 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.386 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.386 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.387 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.387 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.387 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:41:57.387 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:41:57.388 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.388 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.388 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.388 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.388 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.389 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.389 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:41:57.389 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:41:57.390 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.390 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.391 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:41:57.391 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:41:57.392 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:57.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:57.392 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:57.393 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.393 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.393 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:41:57.393 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:41:57.394 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.394 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:41:57.394 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:41:57.394 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:41:57.395 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.395 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.395 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.395 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:41:57.395 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:41:57.396 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.396 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:57.396 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:41:57.396 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:41:57.397 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.397 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.398 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:41:57.398 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:41:57.398 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.398 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:57.398 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:57.399 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.399 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.399 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:57.399 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:57.399 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:41:57.400 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:41:57.400 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:41:57.400 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:41:57.400 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:41:57.401 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:41:57.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:57.401 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:41:57.401 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:41:57.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 msgr2=0x7f82f8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 0x7f82f8055b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f830800a000 tx=0x7f8308008040).stop 2021-11-15T14:41:57.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 msgr2=0x7f8318153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f83140018e0 tx=0x7f83180b5640).stop 2021-11-15T14:41:57.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 shutdown_connections 2021-11-15T14:41:57.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f82f80536d0 0x7f82f8055b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8318150c60 0x7f8318153d40 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f831813ce20 0x7f8318150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 --2- 172.21.2.135:0/3770142779 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8300004500 0x7f831813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 >> 172.21.2.135:0/3770142779 conn(0x7f831805f730 msgr2=0x7f83181409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 shutdown_connections 2021-11-15T14:41:57.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.364+0000 7f83204fe700 1 -- 172.21.2.135:0/3770142779 wait complete. 2021-11-15T14:41:57.406 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:41:57.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.472+0000 7f3a5e8fb700 1 Processor -- start 2021-11-15T14:41:57.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.472+0000 7f3a5e8fb700 1 -- start start 2021-11-15T14:41:57.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.472+0000 7f3a5e8fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5e8fb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 0x7f3a581447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5e8fb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a580b03d0 con 0x7f3a580b1e30 2021-11-15T14:41:57.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5e8fb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580a9140 con 0x7f3a580a7140 2021-11-15T14:41:57.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5e8fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b0670 con 0x7f3a58148420 2021-11-15T14:41:57.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5ce98700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 0x7f3a581447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a57fff700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f3a580b1e30 0x7f3a580b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:58470/0 (socket says 172.21.2.135:58470) 2021-11-15T14:41:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:43012/0 (socket says 172.21.2.135:43012) 2021-11-15T14:41:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a5ce98700 1 --2- 172.21.2.135:0/322848764 >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 0x7f3a581447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:55284/0 (socket says 172.21.2.135:55284) 2021-11-15T14:41:57.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a57fff700 1 -- 172.21.2.135:0/322848764 learned_addr learned my addr 172.21.2.135:0/322848764 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 -- 172.21.2.135:0/322848764 >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 msgr2=0x7f3a581447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 --2- 172.21.2.135:0/322848764 >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 0x7f3a581447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 -- 172.21.2.135:0/322848764 >> v1:172.21.2.119:6789/0 conn(0x7f3a580b1e30 legacy=0x7f3a580b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 -- 172.21.2.135:0/322848764 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580b0910 con 0x7f3a58148420 2021-11-15T14:41:57.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a577fe700 1 --2- 172.21.2.135:0/322848764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3a40002f70 tx=0x7f3a40006df0).ready entity=mon.2 client_cookie=76ba836dc32d09d4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a56ffd700 1 -- 172.21.2.135:0/322848764 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4000d570 con 0x7f3a58148420 2021-11-15T14:41:57.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a56ffd700 1 -- 172.21.2.135:0/322848764 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40000e90 con 0x7f3a58148420 2021-11-15T14:41:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.476+0000 7f3a56ffd700 1 -- 172.21.2.135:0/322848764 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4000d8c0 con 0x7f3a58148420 2021-11-15T14:41:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/322848764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 msgr2=0x7f3a580b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/322848764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3a40002f70 tx=0x7f3a40006df0).stop 2021-11-15T14:41:57.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/322848764 shutdown_connections 2021-11-15T14:41:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/322848764 >> v2:172.21.2.119:3300/0 conn(0x7f3a580a7140 0x7f3a581447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/322848764 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a580b1050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/322848764 >> 172.21.2.135:0/322848764 conn(0x7f3a5805f730 msgr2=0x7f3a5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/322848764 shutdown_connections 2021-11-15T14:41:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/322848764 wait complete. 2021-11-15T14:41:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 Processor -- start 2021-11-15T14:41:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- start start 2021-11-15T14:41:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3a580b1e30 0x7f3a58156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a58156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580a94c0 con 0x7f3a580b1e30 2021-11-15T14:41:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a58149d80 con 0x7f3a580a7140 2021-11-15T14:41:57.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a58149b20 con 0x7f3a58148420 2021-11-15T14:41:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33240/0 (socket says 172.21.2.135:33240) 2021-11-15T14:41:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 -- 172.21.2.135:0/1073552170 learned_addr learned my addr 172.21.2.135:0/1073552170 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5ce98700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a58156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a577fe700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3a580b1e30 0x7f3a58156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 -- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 msgr2=0x7f3a58156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a58156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 -- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3a580b1e30 msgr2=0x7f3a58156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3a580b1e30 0x7f3a58156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 -- 172.21.2.135:0/1073552170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4000b180 con 0x7f3a580a7140 2021-11-15T14:41:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5ce98700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a58156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:41:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a57fff700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f3a58061420 tx=0x7f3a48007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4800ce30 con 0x7f3a580a7140 2021-11-15T14:41:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a480072e0 con 0x7f3a580a7140 2021-11-15T14:41:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a580ac300 con 0x7f3a580a7140 2021-11-15T14:41:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580a96b0 con 0x7f3a580a7140 2021-11-15T14:41:57.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a48005800 con 0x7f3a580a7140 2021-11-15T14:41:57.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.480+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a580ac170 con 0x7f3a580a7140 2021-11-15T14:41:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a48010070 con 0x7f3a580a7140 2021-11-15T14:41:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a557fa700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 0x7f3a3c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f3a4806ae80 con 0x7f3a580a7140 2021-11-15T14:41:57.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a577fe700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 0x7f3a3c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a577fe700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 0x7f3a3c055a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f3a40018000 tx=0x7f3a40014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.484+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a480420b0 con 0x7f3a580a7140 2021-11-15T14:41:57.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a580573d0 con 0x7f3a580a7140 2021-11-15T14:41:57.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a557fa700 1 -- 172.21.2.135:0/1073552170 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+13422 (secure 0 0 0) 0x7f3a480456d0 con 0x7f3a580a7140 2021-11-15T14:41:57.572 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:57.572 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":109,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:41:57.128653+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:41:57.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 msgr2=0x7f3a3c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 0x7f3a3c055a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f3a40018000 tx=0x7f3a40014000).stop 2021-11-15T14:41:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 msgr2=0x7f3a580aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f3a58061420 tx=0x7f3a48007c00).stop 2021-11-15T14:41:57.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 shutdown_connections 2021-11-15T14:41:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3a3c0535b0 0x7f3a3c055a70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3a58148420 0x7f3a58156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3a580b1e30 0x7f3a58156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 --2- 172.21.2.135:0/1073552170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3a580a7140 0x7f3a580aae90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 >> 172.21.2.135:0/1073552170 conn(0x7f3a5805f730 msgr2=0x7f3a58147a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 shutdown_connections 2021-11-15T14:41:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.568+0000 7f3a5e8fb700 1 -- 172.21.2.135:0/1073552170 wait complete. 2021-11-15T14:41:57.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:41:57.580 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:41:57.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 Processor -- start 2021-11-15T14:41:57.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 -- start start 2021-11-15T14:41:57.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b1f40 0x7fe7800b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe7800b0030 0x7fe7800b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800b2810 con 0x7fe7800a7140 2021-11-15T14:41:57.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800b0470 con 0x7fe7800b0030 2021-11-15T14:41:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe788747700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800b06d0 con 0x7fe7800b1f40 2021-11-15T14:41:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe785ce2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe7800b0030 0x7fe7800b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe786ce4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe7800a7140 0x7fe7801412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49068/0 (socket says 172.21.2.135:49068) 2021-11-15T14:41:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.628+0000 7fe786ce4700 1 -- 172.21.2.135:0/2411982004 learned_addr learned my addr 172.21.2.135:0/2411982004 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:57.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe785ce2700 1 -- 172.21.2.135:0/2411982004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b1f40 msgr2=0x7fe7800b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe785ce2700 1 --2- 172.21.2.135:0/2411982004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b1f40 0x7fe7800b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe785ce2700 1 -- 172.21.2.135:0/2411982004 >> v1:172.21.2.135:6789/0 conn(0x7fe7800a7140 legacy=0x7fe7801412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe785ce2700 1 -- 172.21.2.135:0/2411982004 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800b0970 con 0x7fe7800b0030 2021-11-15T14:41:57.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe785ce2700 1 --2- 172.21.2.135:0/2411982004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800b0030 0x7fe7800b2320 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe778001490 tx=0x7fe77c006df0).ready entity=mon.1 client_cookie=a05af425653c335e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7854e1700 1 -- 172.21.2.135:0/2411982004 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77c00d570 con 0x7fe7800b0030 2021-11-15T14:41:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7854e1700 1 -- 172.21.2.135:0/2411982004 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c000e90 con 0x7fe7800b0030 2021-11-15T14:41:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7854e1700 1 -- 172.21.2.135:0/2411982004 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77c00d8c0 con 0x7fe7800b0030 2021-11-15T14:41:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/2411982004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800b0030 msgr2=0x7fe7800b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- 172.21.2.135:0/2411982004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800b0030 0x7fe7800b2320 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe778001490 tx=0x7fe77c006df0).stop 2021-11-15T14:41:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/2411982004 shutdown_connections 2021-11-15T14:41:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- 172.21.2.135:0/2411982004 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800b0030 0x7fe7800b2320 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- 172.21.2.135:0/2411982004 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b1f40 0x7fe7800b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/2411982004 >> 172.21.2.135:0/2411982004 conn(0x7fe78005f730 msgr2=0x7fe78005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/2411982004 shutdown_connections 2021-11-15T14:41:57.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/2411982004 wait complete. 2021-11-15T14:41:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 Processor -- start 2021-11-15T14:41:57.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- start start 2021-11-15T14:41:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b0030 0x7fe7801421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe7800b1f40 0x7fe780157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800af3f0 con 0x7fe7800b1f40 2021-11-15T14:41:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801426b0 con 0x7fe7800a7140 2021-11-15T14:41:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800ae120 con 0x7fe7800b0030 2021-11-15T14:41:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33254/0 (socket says 172.21.2.135:33254) 2021-11-15T14:41:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 -- 172.21.2.135:0/4186268942 learned_addr learned my addr 172.21.2.135:0/4186268942 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 -- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b0030 msgr2=0x7fe7801421c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b0030 0x7fe7801421c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 -- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe7800b1f40 msgr2=0x7fe780157620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:57.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe7800b1f40 0x7fe780157620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 -- 172.21.2.135:0/4186268942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c00b180 con 0x7fe7800a7140 2021-11-15T14:41:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe7864e3700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fe7800ae3f0 tx=0x7fe770006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe770012410 con 0x7fe7800a7140 2021-11-15T14:41:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770012570 con 0x7fe7800a7140 2021-11-15T14:41:57.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe780156c40 con 0x7fe7800a7140 2021-11-15T14:41:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe780157180 con 0x7fe7800a7140 2021-11-15T14:41:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7700128d0 con 0x7fe7800a7140 2021-11-15T14:41:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7800b0c10 con 0x7fe7800a7140 2021-11-15T14:41:57.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe77000f030 con 0x7fe7800a7140 2021-11-15T14:41:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 0x7fe760055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.632+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fe77006b420 con 0x7fe7800a7140 2021-11-15T14:41:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.636+0000 7fe785ce2700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 0x7fe760055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.636+0000 7fe785ce2700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 0x7fe760055a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe778001490 tx=0x7fe77c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.636+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe770042650 con 0x7fe7800a7140 2021-11-15T14:41:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe7800573d0 con 0x7fe7800a7140 2021-11-15T14:41:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe76f7fe700 1 -- 172.21.2.135:0/4186268942 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v109) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe770045c70 con 0x7fe7800a7140 2021-11-15T14:41:57.724 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:41:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 msgr2=0x7fe760055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 0x7fe760055a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe778001490 tx=0x7fe77c014000).stop 2021-11-15T14:41:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 msgr2=0x7fe780145230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fe7800ae3f0 tx=0x7fe770006d70).stop 2021-11-15T14:41:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 shutdown_connections 2021-11-15T14:41:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe7600535d0 0x7fe760055a90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe7800b1f40 0x7fe780157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe7800b0030 0x7fe7801421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 --2- 172.21.2.135:0/4186268942 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe7800a7140 0x7fe780145230 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 >> 172.21.2.135:0/4186268942 conn(0x7fe78005f730 msgr2=0x7fe78013cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 shutdown_connections 2021-11-15T14:41:57.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.720+0000 7fe788747700 1 -- 172.21.2.135:0/4186268942 wait complete. 2021-11-15T14:41:57.731 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:41:57.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 Processor -- start 2021-11-15T14:41:57.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- start start 2021-11-15T14:41:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0a7850 con 0x7f72bc0b1f40 2021-11-15T14:41:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0b06d0 con 0x7f72bc0b2320 2021-11-15T14:41:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0b17c0 con 0x7f72bc0b1350 2021-11-15T14:41:57.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72bb7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f72bc0b2320 0x7f72bc1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49084/0 (socket says 172.21.2.135:49084) 2021-11-15T14:41:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72bb7fe700 1 -- 172.21.2.135:0/2735328883 learned_addr learned my addr 172.21.2.135:0/2735328883 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72ba7fc700 1 --2- 172.21.2.135:0/2735328883 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092310050 0 0) 0x7f72bc0b06d0 con 0x7f72bc0b2320 2021-11-15T14:41:57.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f729c003260 con 0x7f72bc0b2320 2021-11-15T14:41:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449231241 0 0) 0x7f729c003260 con 0x7f72bc0b2320 2021-11-15T14:41:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72ba7fc700 1 -- 172.21.2.135:0/2735328883 >> v1:172.21.2.135:6789/0 conn(0x7f72bc0b2320 legacy=0x7f72bc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72ba7fc700 1 -- 172.21.2.135:0/2735328883 >> v1:172.21.2.119:6789/0 conn(0x7f72bc0b1f40 legacy=0x7f72bc0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72ba7fc700 1 -- 172.21.2.135:0/2735328883 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0b0970 con 0x7f72bc0b1350 2021-11-15T14:41:57.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72ba7fc700 1 --2- 172.21.2.135:0/2735328883 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0b0030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f72ac001110 tx=0x7f72a4006df0).ready entity=mon.2 client_cookie=a5628bb93c004f4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b40019e0 con 0x7f72bc0b1350 2021-11-15T14:41:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4000e90 con 0x7f72bc0b1350 2021-11-15T14:41:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72b9ffb700 1 -- 172.21.2.135:0/2735328883 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a4011400 con 0x7f72bc0b1350 2021-11-15T14:41:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- 172.21.2.135:0/2735328883 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 msgr2=0x7f72bc0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 --2- 172.21.2.135:0/2735328883 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0b0030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f72ac001110 tx=0x7f72a4006df0).stop 2021-11-15T14:41:57.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- 172.21.2.135:0/2735328883 shutdown_connections 2021-11-15T14:41:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 --2- 172.21.2.135:0/2735328883 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0b0030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.780+0000 7f72c1a12700 1 -- 172.21.2.135:0/2735328883 >> 172.21.2.135:0/2735328883 conn(0x7f72bc05f730 msgr2=0x7f72bc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- 172.21.2.135:0/2735328883 shutdown_connections 2021-11-15T14:41:57.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- 172.21.2.135:0/2735328883 wait complete. 2021-11-15T14:41:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 Processor -- start 2021-11-15T14:41:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- start start 2021-11-15T14:41:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72bc0b1f40 0x7f72bc15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc154880 con 0x7f72bc0b1f40 2021-11-15T14:41:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc15a120 con 0x7f72bc0b2320 2021-11-15T14:41:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc140550 con 0x7f72bc0b1350 2021-11-15T14:41:57.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33272/0 (socket says 172.21.2.135:33272) 2021-11-15T14:41:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 -- 172.21.2.135:0/1319662028 learned_addr learned my addr 172.21.2.135:0/1319662028 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72ba7fc700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72bc0b1f40 0x7f72bc15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72baffd700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 -- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 msgr2=0x7f72bc0aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 -- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72bc0b1f40 msgr2=0x7f72bc15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72bc0b1f40 0x7f72bc15a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 -- 172.21.2.135:0/1319662028 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a400b180 con 0x7f72bc0b2320 2021-11-15T14:41:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72bb7fe700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f72b4001bc0 tx=0x7f72b4001a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b4004ab0 con 0x7f72bc0b2320 2021-11-15T14:41:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4004c10 con 0x7f72bc0b2320 2021-11-15T14:41:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc1407f0 con 0x7f72bc0b2320 2021-11-15T14:41:57.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc14a6b0 con 0x7f72bc0b2320 2021-11-15T14:41:57.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b4007170 con 0x7f72bc0b2320 2021-11-15T14:41:57.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0573d0 con 0x7f72bc0b2320 2021-11-15T14:41:57.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72b401b070 con 0x7f72bc0b2320 2021-11-15T14:41:57.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 0x7f72a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f72b406b0d0 con 0x7f72bc0b2320 2021-11-15T14:41:57.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72baffd700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 0x7f72a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.784+0000 7f72baffd700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 0x7f72a0055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f72ac00d000 tx=0x7f72ac007b70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.788+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72b4042370 con 0x7f72bc0b2320 2021-11-15T14:41:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72bc0ac7e0 con 0x7f72bc0b2320 2021-11-15T14:41:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72b3fff700 1 -- 172.21.2.135:0/1319662028 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72b4045990 con 0x7f72bc0b2320 2021-11-15T14:41:57.876 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:41:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 msgr2=0x7f72a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 0x7f72a0055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f72ac00d000 tx=0x7f72ac007b70).stop 2021-11-15T14:41:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 msgr2=0x7f72bc0b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f72b4001bc0 tx=0x7f72b4001a80).stop 2021-11-15T14:41:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 shutdown_connections 2021-11-15T14:41:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a0053610 0x7f72a0055ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72bc0b2320 0x7f72bc0b4220 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72bc0b1f40 0x7f72bc15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 --2- 172.21.2.135:0/1319662028 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72bc0b1350 0x7f72bc0aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 >> 172.21.2.135:0/1319662028 conn(0x7f72bc05f730 msgr2=0x7f72bc13e520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 shutdown_connections 2021-11-15T14:41:57.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.872+0000 7f72c1a12700 1 -- 172.21.2.135:0/1319662028 wait complete. 2021-11-15T14:41:57.884 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:41:57.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 Processor -- start 2021-11-15T14:41:57.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- start start 2021-11-15T14:41:57.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6460067070 0x7f6460143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f64600b0760 0x7f64600b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6460067450 con 0x7f64600ad0b0 2021-11-15T14:41:57.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600b0050 con 0x7f64600b0760 2021-11-15T14:41:57.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600b02f0 con 0x7f6460067070 2021-11-15T14:41:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6460067070 0x7f6460143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6460067070 0x7f6460143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33280/0 (socket says 172.21.2.135:33280) 2021-11-15T14:41:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 -- 172.21.2.135:0/37422656 learned_addr learned my addr 172.21.2.135:0/37422656 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f64600ad0b0 0x7f6460143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49096/0 (socket says 172.21.2.135:49096) 2021-11-15T14:41:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 -- 172.21.2.135:0/37422656 >> v2:172.21.2.119:3300/0 conn(0x7f64600b0760 msgr2=0x7f64600b0f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 --2- 172.21.2.135:0/37422656 >> v2:172.21.2.119:3300/0 conn(0x7f64600b0760 0x7f64600b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 -- 172.21.2.135:0/37422656 >> v1:172.21.2.135:6789/0 conn(0x7f64600ad0b0 legacy=0x7f6460143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 -- 172.21.2.135:0/37422656 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600af420 con 0x7f6460067070 2021-11-15T14:41:57.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645ffff700 1 --2- 172.21.2.135:0/37422656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6460067070 0x7f6460143950 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6448002f70 tx=0x7f6448006eb0).ready entity=mon.1 client_cookie=b417e9254b3a5b43 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645effd700 1 -- 172.21.2.135:0/37422656 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644800d610 con 0x7f6460067070 2021-11-15T14:41:57.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645effd700 1 -- 172.21.2.135:0/37422656 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448000e90 con 0x7f6460067070 2021-11-15T14:41:57.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f645effd700 1 -- 172.21.2.135:0/37422656 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644800d9a0 con 0x7f6460067070 2021-11-15T14:41:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- 172.21.2.135:0/37422656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6460067070 msgr2=0x7f6460143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- 172.21.2.135:0/37422656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6460067070 0x7f6460143950 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6448002f70 tx=0x7f6448006eb0).stop 2021-11-15T14:41:57.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- 172.21.2.135:0/37422656 shutdown_connections 2021-11-15T14:41:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- 172.21.2.135:0/37422656 >> v2:172.21.2.119:3300/0 conn(0x7f64600b0760 0x7f64600b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- 172.21.2.135:0/37422656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6460067070 0x7f6460143950 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- 172.21.2.135:0/37422656 >> 172.21.2.135:0/37422656 conn(0x7f646005f730 msgr2=0x7f646005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:57.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- 172.21.2.135:0/37422656 shutdown_connections 2021-11-15T14:41:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- 172.21.2.135:0/37422656 wait complete. 2021-11-15T14:41:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 Processor -- start 2021-11-15T14:41:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 -- start start 2021-11-15T14:41:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.932+0000 7f64669e1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6460067070 0x7f6460146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64600b0760 0x7f64600a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600a4640 con 0x7f6460067070 2021-11-15T14:41:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460156d40 con 0x7f646009e930 2021-11-15T14:41:57.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600a4860 con 0x7f64600b0760 2021-11-15T14:41:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33286/0 (socket says 172.21.2.135:33286) 2021-11-15T14:41:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 -- 172.21.2.135:0/2622946644 learned_addr learned my addr 172.21.2.135:0/2622946644 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:57.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 -- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64600b0760 msgr2=0x7f64600a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64600b0760 0x7f64600a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 -- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6460067070 msgr2=0x7f6460146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6460067070 0x7f6460146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:57.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 -- 172.21.2.135:0/2622946644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644800b1e0 con 0x7f646009e930 2021-11-15T14:41:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f6464f7e700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f64600a4dd0 tx=0x7f64580090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645800d4a0 con 0x7f646009e930 2021-11-15T14:41:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645800d600 con 0x7f646009e930 2021-11-15T14:41:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600a4b00 con 0x7f646009e930 2021-11-15T14:41:57.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6460152b90 con 0x7f646009e930 2021-11-15T14:41:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645800d960 con 0x7f646009e930 2021-11-15T14:41:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6460152d50 con 0x7f646009e930 2021-11-15T14:41:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6458018030 con 0x7f646009e930 2021-11-15T14:41:57.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 0x7f6444055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f645806b0c0 con 0x7f646009e930 2021-11-15T14:41:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645ffff700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 0x7f6444055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.936+0000 7f645ffff700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 0x7f6444055ad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6448002f70 tx=0x7f6448015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:57.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:57.940+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64580423a0 con 0x7f646009e930 2021-11-15T14:41:58.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f64600573d0 con 0x7f646009e930 2021-11-15T14:41:58.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f645d7fa700 1 -- 172.21.2.135:0/2622946644 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+143 (secure 0 0 0) 0x7f64580459c0 con 0x7f646009e930 2021-11-15T14:41:58.028 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:41:58.029 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:41:58.029 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:58.029 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:41:58.029 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:41:58.030 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:41:58.030 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:41:58.030 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:41:58.030 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:41:58.031 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:41:58.031 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:41:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 msgr2=0x7f6444055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 0x7f6444055ad0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6448002f70 tx=0x7f6448015000).stop 2021-11-15T14:41:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 msgr2=0x7f6460156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f64600a4dd0 tx=0x7f64580090f0).stop 2021-11-15T14:41:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 shutdown_connections 2021-11-15T14:41:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6444053610 0x7f6444055ad0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f646009e930 0x7f6460156850 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64600b0760 0x7f64600a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 --2- 172.21.2.135:0/2622946644 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6460067070 0x7f6460146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 >> 172.21.2.135:0/2622946644 conn(0x7f646005f730 msgr2=0x7f6460142ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 shutdown_connections 2021-11-15T14:41:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.024+0000 7f64669e1700 1 -- 172.21.2.135:0/2622946644 wait complete. 2021-11-15T14:41:58.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:41:58.036 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:41:58.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 Processor -- start 2021-11-15T14:41:58.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 -- start start 2021-11-15T14:41:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f991c0b1f40 0x7f991c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0b04a0 con 0x7f991c0b0030 2021-11-15T14:41:58.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0a7850 con 0x7f991c0b2320 2021-11-15T14:41:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0b06d0 con 0x7f991c0b1f40 2021-11-15T14:41:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f991c0b2320 0x7f991c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49112/0 (socket says 172.21.2.135:49112) 2021-11-15T14:41:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991bfff700 1 -- 172.21.2.135:0/697772822 learned_addr learned my addr 172.21.2.135:0/697772822 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:58.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991b7fe700 1 --2- 172.21.2.135:0/697772822 >> v2:172.21.2.135:3300/0 conn(0x7f991c0b1f40 0x7f991c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991b7fe700 1 -- 172.21.2.135:0/697772822 >> v1:172.21.2.135:6789/0 conn(0x7f991c0b2320 legacy=0x7f991c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991b7fe700 1 -- 172.21.2.135:0/697772822 >> v1:172.21.2.119:6789/0 conn(0x7f991c0b0030 legacy=0x7f991c0a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:41:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991b7fe700 1 -- 172.21.2.135:0/697772822 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0b0970 con 0x7f991c0b1f40 2021-11-15T14:41:58.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991b7fe700 1 --2- 172.21.2.135:0/697772822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b1f40 0x7f991c0b1350 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f991c0ad350 tx=0x7f9904006df0).ready entity=mon.1 client_cookie=3e7c3ec9a40c47c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991a7fc700 1 -- 172.21.2.135:0/697772822 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990400d5c0 con 0x7f991c0b1f40 2021-11-15T14:41:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991a7fc700 1 -- 172.21.2.135:0/697772822 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904000e90 con 0x7f991c0b1f40 2021-11-15T14:41:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f991a7fc700 1 -- 172.21.2.135:0/697772822 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990400d910 con 0x7f991c0b1f40 2021-11-15T14:41:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 -- 172.21.2.135:0/697772822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b1f40 msgr2=0x7f991c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:58.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.084+0000 7f9921d89700 1 --2- 172.21.2.135:0/697772822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b1f40 0x7f991c0b1350 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f991c0ad350 tx=0x7f9904006df0).stop 2021-11-15T14:41:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/697772822 shutdown_connections 2021-11-15T14:41:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 --2- 172.21.2.135:0/697772822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b1f40 0x7f991c0b1350 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/697772822 >> 172.21.2.135:0/697772822 conn(0x7f991c05f730 msgr2=0x7f991c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:58.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/697772822 shutdown_connections 2021-11-15T14:41:58.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/697772822 wait complete. 2021-11-15T14:41:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 Processor -- start 2021-11-15T14:41:58.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- start start 2021-11-15T14:41:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f991c0b1f40 0x7f991c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f991c0b2320 0x7f991c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:58.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c154ad0 con 0x7f991c0b2320 2021-11-15T14:41:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c15a6d0 con 0x7f991c0b0030 2021-11-15T14:41:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c15a970 con 0x7f991c0b1f40 2021-11-15T14:41:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:58.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33296/0 (socket says 172.21.2.135:33296) 2021-11-15T14:41:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 -- 172.21.2.135:0/2498336059 learned_addr learned my addr 172.21.2.135:0/2498336059 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 -- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f991c0b1f40 msgr2=0x7f991c1540f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f991c0b1f40 0x7f991c1540f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 -- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f991c0b2320 msgr2=0x7f991c1545e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:41:58.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f991c0b2320 0x7f991c1545e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 -- 172.21.2.135:0/2498336059 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990400b180 con 0x7f991c0b0030 2021-11-15T14:41:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f991b7fe700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f991c0ad350 tx=0x7f9904012000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9904016070 con 0x7f991c0b0030 2021-11-15T14:41:58.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904002f50 con 0x7f991c0b0030 2021-11-15T14:41:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c15ac10 con 0x7f991c0b0030 2021-11-15T14:41:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c142300 con 0x7f991c0b0030 2021-11-15T14:41:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990401e450 con 0x7f991c0b0030 2021-11-15T14:41:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0b0c10 con 0x7f991c0b0030 2021-11-15T14:41:58.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9904025030 con 0x7f991c0b0030 2021-11-15T14:41:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 0x7f9900055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.088+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f990406cb50 con 0x7f991c0b0030 2021-11-15T14:41:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.092+0000 7f991affd700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 0x7f9900055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:58.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.092+0000 7f991affd700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 0x7f9900055a90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f990c002fb0 tx=0x7f990c006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:58.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.092+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9904043d80 con 0x7f991c0b0030 2021-11-15T14:41:58.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:58.176+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f991c0573d0 con 0x7f991c0b0030 2021-11-15T14:41:59.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.148+0000 7f9918ff9700 1 -- 172.21.2.135:0/2498336059 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v110) v1 ==== 133+0+0 (secure 0 0 0) 0x7f99040230a0 con 0x7f991c0b0030 2021-11-15T14:41:59.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 msgr2=0x7f9900055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 0x7f9900055a90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f990c002fb0 tx=0x7f990c006930).stop 2021-11-15T14:41:59.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 msgr2=0x7f991c140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f991c0ad350 tx=0x7f9904012000).stop 2021-11-15T14:41:59.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 shutdown_connections 2021-11-15T14:41:59.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99000535d0 0x7f9900055a90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f991c0b2320 0x7f991c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:59.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f991c0b1f40 0x7f991c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:59.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 --2- 172.21.2.135:0/2498336059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f991c0b0030 0x7f991c140310 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 >> 172.21.2.135:0/2498336059 conn(0x7f991c05f730 msgr2=0x7f991c0a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:59.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 shutdown_connections 2021-11-15T14:41:59.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.152+0000 7f9921d89700 1 -- 172.21.2.135:0/2498336059 wait complete. 2021-11-15T14:41:59.157 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:41:59.161 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:41:59.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 Processor -- start 2021-11-15T14:41:59.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 -- start start 2021-11-15T14:41:59.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f26600b1350 0x7f26600b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26601412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600a7850 con 0x7f26600b1f40 2021-11-15T14:41:59.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26600b17c0 con 0x7f26600b1350 2021-11-15T14:41:59.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f266725a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600b06d0 con 0x7f26600b2320 2021-11-15T14:41:59.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f2664ff6700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f26600b1f40 0x7f26600a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49126/0 (socket says 172.21.2.135:49126) 2021-11-15T14:41:59.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f2664ff6700 1 -- 172.21.2.135:0/994722416 learned_addr learned my addr 172.21.2.135:0/994722416 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:41:59.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26601412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289612824 0 0) 0x7f26600a7850 con 0x7f26600b1f40 2021-11-15T14:41:59.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265ffff700 1 --2- 172.21.2.135:0/994722416 >> v2:172.21.2.119:3300/0 conn(0x7f26600b1350 0x7f26600b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2640003260 con 0x7f26600b1f40 2021-11-15T14:41:59.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 235587570 0 0) 0x7f2640003260 con 0x7f26600b1f40 2021-11-15T14:41:59.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 msgr2=0x7f26601412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:59.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26601412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 >> v2:172.21.2.119:3300/0 conn(0x7f26600b1350 msgr2=0x7f26600b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:59.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 --2- 172.21.2.135:0/994722416 >> v2:172.21.2.119:3300/0 conn(0x7f26600b1350 0x7f26600b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600b0970 con 0x7f26600b1f40 2021-11-15T14:41:59.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2650001660 con 0x7f26600b1f40 2021-11-15T14:41:59.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 >> v1:172.21.2.135:6789/0 conn(0x7f26600b1f40 legacy=0x7f26600a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26400037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2640003d00 0x7f2640004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f2640004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600b17c0 con 0x7f2640003d00 2021-11-15T14:41:59.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600b06d0 con 0x7f26400049f0 2021-11-15T14:41:59.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264000b750 con 0x7f26600b2320 2021-11-15T14:41:59.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f2640004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f2664ff6700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26400037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265ffff700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2640003d00 0x7f2640004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 -- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 msgr2=0x7f26400037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:59.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600b2320 0x7f26400037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 -- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2640003d00 msgr2=0x7f2640004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:41:59.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2640003d00 0x7f2640004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:41:59.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 -- 172.21.2.135:0/994722416 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600b0970 con 0x7f26400049f0 2021-11-15T14:41:59.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f26657f7700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f2640004e70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f265800c000 tx=0x7f26580091d0).ready entity=mon.1 client_cookie=cfb99d1a070f1d14 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:59.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f265800e7e0 con 0x7f26400049f0 2021-11-15T14:41:59.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265800e940 con 0x7f26400049f0 2021-11-15T14:41:59.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.224+0000 7f265f7fe700 1 -- 172.21.2.135:0/994722416 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f265800eca0 con 0x7f26400049f0 2021-11-15T14:41:59.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/994722416 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 msgr2=0x7f2640004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 --2- 172.21.2.135:0/994722416 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f2640004e70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f265800c000 tx=0x7f26580091d0).stop 2021-11-15T14:41:59.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f26657f7700 1 -- 172.21.2.135:0/994722416 reap_dead start 2021-11-15T14:41:59.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/994722416 shutdown_connections 2021-11-15T14:41:59.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/994722416 >> 172.21.2.135:0/994722416 conn(0x7f266005f730 msgr2=0x7f266005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:41:59.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/994722416 shutdown_connections 2021-11-15T14:41:59.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/994722416 wait complete. 2021-11-15T14:41:59.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 Processor -- start 2021-11-15T14:41:59.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- start start 2021-11-15T14:41:59.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26600ab590 0x7f26600ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600abee0 0x7f266015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600aad10 con 0x7f26600ab590 2021-11-15T14:41:59.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600aa1f0 con 0x7f26400049f0 2021-11-15T14:41:59.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600aa490 con 0x7f26600abee0 2021-11-15T14:41:59.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33320/0 (socket says 172.21.2.135:33320) 2021-11-15T14:41:59.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 -- 172.21.2.135:0/2796500543 learned_addr learned my addr 172.21.2.135:0/2796500543 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:41:59.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 -- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600abee0 msgr2=0x7f266015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600abee0 0x7f266015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:59.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 -- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26600ab590 msgr2=0x7f26600ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:41:59.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26600ab590 0x7f26600ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:41:59.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 -- 172.21.2.135:0/2796500543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600ab0f0 con 0x7f26400049f0 2021-11-15T14:41:59.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f2664ff6700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f2650008000 tx=0x7f2650009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:59.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2650007170 con 0x7f26400049f0 2021-11-15T14:41:59.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26500072d0 con 0x7f26400049f0 2021-11-15T14:41:59.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2650004920 con 0x7f26400049f0 2021-11-15T14:41:59.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266014aab0 con 0x7f26400049f0 2021-11-15T14:41:59.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26600aa990 con 0x7f26400049f0 2021-11-15T14:41:59.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26600ab280 con 0x7f26400049f0 2021-11-15T14:41:59.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2650004a80 con 0x7f26400049f0 2021-11-15T14:41:59.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 0x7f2644055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:41:59.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.228+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f265006bf20 con 0x7f26400049f0 2021-11-15T14:41:59.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.232+0000 7f265ffff700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 0x7f2644055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:41:59.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.232+0000 7f265ffff700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 0x7f2644055b20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f264800b000 tx=0x7f2648008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:41:59.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.232+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2650042ff0 con 0x7f26400049f0 2021-11-15T14:41:59.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:41:59.316+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f26600573d0 con 0x7f26400049f0 2021-11-15T14:42:00.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.152+0000 7f265dffb700 1 -- 172.21.2.135:0/2796500543 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v111) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2650046610 con 0x7f26400049f0 2021-11-15T14:42:00.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 msgr2=0x7f2644055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 0x7f2644055b20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f264800b000 tx=0x7f2648008040).stop 2021-11-15T14:42:00.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 msgr2=0x7f266014b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f2650008000 tx=0x7f2650009040).stop 2021-11-15T14:42:00.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 shutdown_connections 2021-11-15T14:42:00.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2644053660 0x7f2644055b20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26600abee0 0x7f266015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26600ab590 0x7f26600ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 --2- 172.21.2.135:0/2796500543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26400049f0 0x7f266014b120 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 >> 172.21.2.135:0/2796500543 conn(0x7f266005f730 msgr2=0x7f2660146ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 shutdown_connections 2021-11-15T14:42:00.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.156+0000 7f266725a700 1 -- 172.21.2.135:0/2796500543 wait complete. 2021-11-15T14:42:00.164 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:42:00.166 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:42:00.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 Processor -- start 2021-11-15T14:42:00.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 -- start start 2021-11-15T14:42:00.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f61d0148420 0x7f61d00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00b03d0 con 0x7f61d00b1e30 2021-11-15T14:42:00.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00b0670 con 0x7f61d00a7140 2021-11-15T14:42:00.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d663a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00a9140 con 0x7f61d0148420 2021-11-15T14:42:00.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d4bd7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f61d00a7140 0x7f61d01447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49146/0 (socket says 172.21.2.135:49146) 2021-11-15T14:42:00.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d4bd7700 1 -- 172.21.2.135:0/2672606159 learned_addr learned my addr 172.21.2.135:0/2672606159 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:00.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797025315 0 0) 0x7f61d00b0670 con 0x7f61d00a7140 2021-11-15T14:42:00.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61bc003260 con 0x7f61d00a7140 2021-11-15T14:42:00.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237769770 0 0) 0x7f61bc003260 con 0x7f61d00a7140 2021-11-15T14:42:00.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 >> v2:172.21.2.119:3300/0 conn(0x7f61d0148420 msgr2=0x7f61d00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cf7fe700 1 --2- 172.21.2.135:0/2672606159 >> v2:172.21.2.119:3300/0 conn(0x7f61d0148420 0x7f61d00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 --2- 172.21.2.135:0/2672606159 >> v2:172.21.2.119:3300/0 conn(0x7f61d0148420 0x7f61d00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 >> v1:172.21.2.119:6789/0 conn(0x7f61d00b1e30 legacy=0x7f61d00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00b0910 con 0x7f61d00a7140 2021-11-15T14:42:00.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f61c80019e0 con 0x7f61d00a7140 2021-11-15T14:42:00.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 >> v1:172.21.2.135:6789/0 conn(0x7f61d00a7140 legacy=0x7f61d01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61bc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61bc004500 0x7f61bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61bc005050 0x7f61bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc00bf10 con 0x7f61bc005050 2021-11-15T14:42:00.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc00c080 con 0x7f61bc003820 2021-11-15T14:42:00.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc00c240 con 0x7f61bc004500 2021-11-15T14:42:00.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cf7fe700 1 --2- 172.21.2.135:0/2672606159 >> v2:172.21.2.119:3300/0 conn(0x7f61d0148420 0x7f61d00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:00.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61bc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 -- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61bc004500 msgr2=0x7f61bc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61bc004500 0x7f61bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 -- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61bc005050 msgr2=0x7f61bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d4bd7700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61bc005050 0x7f61bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61bc005050 0x7f61bc00b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61d4bd7700 1 -- 172.21.2.135:0/2672606159 reap_dead start 2021-11-15T14:42:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 -- 172.21.2.135:0/2672606159 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc003260 con 0x7f61bc003820 2021-11-15T14:42:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61cffff700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61bc003c20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f61c0001fa0 tx=0x7f61c0007a00).ready entity=mon.1 client_cookie=858ec4ada9ebf731 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c0007070 con 0x7f61bc003820 2021-11-15T14:42:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c00071d0 con 0x7f61bc003820 2021-11-15T14:42:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.216+0000 7f61ceffd700 1 -- 172.21.2.135:0/2672606159 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c0006510 con 0x7f61bc003820 2021-11-15T14:42:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 msgr2=0x7f61bc003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61bc003c20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f61c0001fa0 tx=0x7f61c0007a00).stop 2021-11-15T14:42:00.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/2672606159 shutdown_connections 2021-11-15T14:42:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 --2- 172.21.2.135:0/2672606159 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61bc003c20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/2672606159 >> 172.21.2.135:0/2672606159 conn(0x7f61d005f730 msgr2=0x7f61d005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/2672606159 shutdown_connections 2021-11-15T14:42:00.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/2672606159 wait complete. 2021-11-15T14:42:00.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 Processor -- start 2021-11-15T14:42:00.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- start start 2021-11-15T14:42:00.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d0157690 0x7f61d015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00acf20 0x7f61d01469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0157af0 con 0x7f61d00acf20 2021-11-15T14:42:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00ad830 con 0x7f61bc003820 2021-11-15T14:42:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0156f50 con 0x7f61d0157690 2021-11-15T14:42:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33336/0 (socket says 172.21.2.135:33336) 2021-11-15T14:42:00.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 -- 172.21.2.135:0/629536329 learned_addr learned my addr 172.21.2.135:0/629536329 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 -- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d0157690 msgr2=0x7f61d015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d0157690 0x7f61d015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 -- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00acf20 msgr2=0x7f61d01469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00acf20 0x7f61d01469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 -- 172.21.2.135:0/629536329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d01571f0 con 0x7f61bc003820 2021-11-15T14:42:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cffff700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f61c0001fa0 tx=0x7f61c0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c0014620 con 0x7f61bc003820 2021-11-15T14:42:00.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0000e90 con 0x7f61bc003820 2021-11-15T14:42:00.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0156c40 con 0x7f61bc003820 2021-11-15T14:42:00.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c0014970 con 0x7f61bc003820 2021-11-15T14:42:00.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d015a6c0 con 0x7f61bc003820 2021-11-15T14:42:00.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00b0bb0 con 0x7f61bc003820 2021-11-15T14:42:00.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61c001d070 con 0x7f61bc003820 2021-11-15T14:42:00.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 0x7f61b0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.220+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f61c006ccc0 con 0x7f61bc003820 2021-11-15T14:42:00.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.224+0000 7f61cf7fe700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 0x7f61b0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.224+0000 7f61cf7fe700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 0x7f61b0055bb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f61c4007000 tx=0x7f61c4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.224+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61c0043c30 con 0x7f61bc003820 2021-11-15T14:42:00.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.336+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f61d00573d0 con 0x7f61bc003820 2021-11-15T14:42:00.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.352+0000 7f61cd7fa700 1 -- 172.21.2.135:0/629536329 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v53) v1 ==== 189+0+0 (secure 0 0 0) 0x7f61c0047250 con 0x7f61bc003820 2021-11-15T14:42:00.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 msgr2=0x7f61b0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 0x7f61b0055bb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f61c4007000 tx=0x7f61c4008040).stop 2021-11-15T14:42:00.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 msgr2=0x7f61d014d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f61c0001fa0 tx=0x7f61c0015000).stop 2021-11-15T14:42:00.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 shutdown_connections 2021-11-15T14:42:00.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b00536f0 0x7f61b0055bb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00acf20 0x7f61d01469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d0157690 0x7f61d015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 --2- 172.21.2.135:0/629536329 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61bc003820 0x7f61d014d780 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 >> 172.21.2.135:0/629536329 conn(0x7f61d005f730 msgr2=0x7f61d00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 shutdown_connections 2021-11-15T14:42:00.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.356+0000 7f61d663a700 1 -- 172.21.2.135:0/629536329 wait complete. 2021-11-15T14:42:00.362 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 19 and data pool 20 2021-11-15T14:42:00.364 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:00.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 Processor -- start 2021-11-15T14:42:00.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- start start 2021-11-15T14:42:00.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080b1970 0x7f07080b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f07080a9c90 0x7f0708147d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080b3460 con 0x7f07080b3080 2021-11-15T14:42:00.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080b2870 con 0x7f07080a9c90 2021-11-15T14:42:00.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080b0cf0 con 0x7f07080b1970 2021-11-15T14:42:00.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f07080a9c90 0x7f0708147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f07080a9c90 0x7f0708147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33358/0 (socket says 172.21.2.135:33358) 2021-11-15T14:42:00.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 -- 172.21.2.135:0/3981986720 learned_addr learned my addr 172.21.2.135:0/3981986720 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 -- 172.21.2.135:0/3981986720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080b1970 msgr2=0x7f07080b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 --2- 172.21.2.135:0/3981986720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080b1970 0x7f07080b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 -- 172.21.2.135:0/3981986720 >> v1:172.21.2.119:6789/0 conn(0x7f07080b3080 legacy=0x7f0708065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 -- 172.21.2.135:0/3981986720 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080b0f90 con 0x7f07080a9c90 2021-11-15T14:42:00.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070d2f9700 1 --2- 172.21.2.135:0/3981986720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080a9c90 0x7f0708147d20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f07080b3e50 tx=0x7f0700009290).ready entity=mon.1 client_cookie=19cb9bdda59e0449 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f07077fe700 1 -- 172.21.2.135:0/3981986720 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070000b860 con 0x7f07080a9c90 2021-11-15T14:42:00.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f07077fe700 1 -- 172.21.2.135:0/3981986720 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070000b9c0 con 0x7f07080a9c90 2021-11-15T14:42:00.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f07077fe700 1 -- 172.21.2.135:0/3981986720 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070000bb70 con 0x7f07080a9c90 2021-11-15T14:42:00.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- 172.21.2.135:0/3981986720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080a9c90 msgr2=0x7f0708147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- 172.21.2.135:0/3981986720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080a9c90 0x7f0708147d20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f07080b3e50 tx=0x7f0700009290).stop 2021-11-15T14:42:00.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- 172.21.2.135:0/3981986720 shutdown_connections 2021-11-15T14:42:00.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- 172.21.2.135:0/3981986720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080a9c90 0x7f0708147d20 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- 172.21.2.135:0/3981986720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080b1970 0x7f07080b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- 172.21.2.135:0/3981986720 >> 172.21.2.135:0/3981986720 conn(0x7f0708063760 msgr2=0x7f0708063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- 172.21.2.135:0/3981986720 shutdown_connections 2021-11-15T14:42:00.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- 172.21.2.135:0/3981986720 wait complete. 2021-11-15T14:42:00.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 Processor -- start 2021-11-15T14:42:00.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 -- start start 2021-11-15T14:42:00.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.412+0000 7f070dafa700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080a9c90 0x7f0708149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07080b3080 0x7f0708145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708156890 con 0x7f07080b3080 2021-11-15T14:42:00.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708156b30 con 0x7f07080b1970 2021-11-15T14:42:00.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0708156dd0 con 0x7f07080a9c90 2021-11-15T14:42:00.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33362/0 (socket says 172.21.2.135:33362) 2021-11-15T14:42:00.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 -- 172.21.2.135:0/4264667038 learned_addr learned my addr 172.21.2.135:0/4264667038 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070caf8700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080a9c90 0x7f0708149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070d2f9700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07080b3080 0x7f0708145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 -- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080a9c90 msgr2=0x7f0708149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080a9c90 0x7f0708149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 -- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07080b3080 msgr2=0x7f0708145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07080b3080 0x7f0708145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 -- 172.21.2.135:0/4264667038 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009530 con 0x7f07080b1970 2021-11-15T14:42:00.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0707fff700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f06fc002f70 tx=0x7f06fc006e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06fc013460 con 0x7f07080b1970 2021-11-15T14:42:00.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc0135c0 con 0x7f07080b1970 2021-11-15T14:42:00.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708157070 con 0x7f07080b1970 2021-11-15T14:42:00.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07080b6040 con 0x7f07080b1970 2021-11-15T14:42:00.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06fc013920 con 0x7f07080b1970 2021-11-15T14:42:00.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080573d0 con 0x7f07080b1970 2021-11-15T14:42:00.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06fc01a060 con 0x7f07080b1970 2021-11-15T14:42:00.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f06fc06b510 con 0x7f07080b1970 2021-11-15T14:42:00.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.416+0000 7f070caf8700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.420+0000 7f070caf8700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f06f800d000 tx=0x7f06f8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.420+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06fc0423b0 con 0x7f07080b1970 2021-11-15T14:42:00.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0708069960 con 0x7f07080b1970 2021-11-15T14:42:00.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f0705ffb700 1 -- 172.21.2.135:0/4264667038 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f06fc0459d0 con 0x7f07080b1970 2021-11-15T14:42:00.508 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:00.509 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":112,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:00.342371+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:58.191691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:59.338547+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:00.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 msgr2=0x7f06e8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f06f800d000 tx=0x7f06f8009040).stop 2021-11-15T14:42:00.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 msgr2=0x7f07080b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f06fc002f70 tx=0x7f06fc006e90).stop 2021-11-15T14:42:00.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 shutdown_connections 2021-11-15T14:42:00.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06e80536f0 0x7f06e8055bb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07080b3080 0x7f0708145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07080b1970 0x7f07080b5b50 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 --2- 172.21.2.135:0/4264667038 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07080a9c90 0x7f0708149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 >> 172.21.2.135:0/4264667038 conn(0x7f0708063760 msgr2=0x7f070805fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 shutdown_connections 2021-11-15T14:42:00.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.504+0000 7f070dafa700 1 -- 172.21.2.135:0/4264667038 wait complete. 2021-11-15T14:42:00.516 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:00.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 Processor -- start 2021-11-15T14:42:00.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 -- start start 2021-11-15T14:42:00.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 0x7f8f080ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080b2b70 con 0x7f8f080b0900 2021-11-15T14:42:00.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080b27f0 con 0x7f8f080b0520 2021-11-15T14:42:00.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f0e1de700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b2da0 con 0x7f8f080aa1a0 2021-11-15T14:42:00.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f077fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8f080b0520 0x7f8f080addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49188/0 (socket says 172.21.2.135:49188) 2021-11-15T14:42:00.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f077fe700 1 -- 172.21.2.135:0/496250716 learned_addr learned my addr 172.21.2.135:0/496250716 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:00.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184803521 0 0) 0x7f8f080b27f0 con 0x7f8f080b0520 2021-11-15T14:42:00.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee8003260 con 0x7f8f080b0520 2021-11-15T14:42:00.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 0x7f8f080ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046922276 0 0) 0x7f8ee8003260 con 0x7f8f080b0520 2021-11-15T14:42:00.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 msgr2=0x7f8f080ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 0x7f8f080ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 >> v1:172.21.2.119:6789/0 conn(0x7f8f080b0900 legacy=0x7f8f08140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080a9bf0 con 0x7f8f080b0520 2021-11-15T14:42:00.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8ef0001660 con 0x7f8f080b0520 2021-11-15T14:42:00.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 >> v1:172.21.2.135:6789/0 conn(0x7f8f080b0520 legacy=0x7f8f080addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ee80037d0 0x7f8ee8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 0x7f8ee8004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b2da0 con 0x7f8ee80037d0 2021-11-15T14:42:00.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee800b8e0 con 0x7f8ee8004500 2021-11-15T14:42:00.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee800baa0 con 0x7f8f080aa1a0 2021-11-15T14:42:00.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 -- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 msgr2=0x7f8ee8004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8f080aa1a0 0x7f8ee8004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 -- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ee80037d0 msgr2=0x7f8ee8003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:00.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ee80037d0 0x7f8ee8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 -- 172.21.2.135:0/496250716 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8003260 con 0x7f8ee8004500 2021-11-15T14:42:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f8ee80054d0 tx=0x7f8ef8008040).ready entity=mon.1 client_cookie=75257b4e0af04ef4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef8013670 con 0x7f8ee8004500 2021-11-15T14:42:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef80137d0 con 0x7f8ee8004500 2021-11-15T14:42:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.564+0000 7f8f067fc700 1 -- 172.21.2.135:0/496250716 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef8013b30 con 0x7f8ee8004500 2021-11-15T14:42:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/496250716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ee8004500 msgr2=0x7f8ee8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/496250716 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f8ee80054d0 tx=0x7f8ef8008040).stop 2021-11-15T14:42:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 -- 172.21.2.135:0/496250716 reap_dead start 2021-11-15T14:42:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/496250716 shutdown_connections 2021-11-15T14:42:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/496250716 >> 172.21.2.135:0/496250716 conn(0x7f8f08060840 msgr2=0x7f8f08060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/496250716 shutdown_connections 2021-11-15T14:42:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/496250716 wait complete. 2021-11-15T14:42:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 Processor -- start 2021-11-15T14:42:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- start start 2021-11-15T14:42:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ee8004500 0x7f8f080b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 0x7f8f0813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0813f480 con 0x7f8f081425a0 2021-11-15T14:42:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08144490 con 0x7f8f08142eb0 2021-11-15T14:42:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08142b20 con 0x7f8ee8004500 2021-11-15T14:42:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33384/0 (socket says 172.21.2.135:33384) 2021-11-15T14:42:00.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 -- 172.21.2.135:0/804596243 learned_addr learned my addr 172.21.2.135:0/804596243 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 0x7f8f0813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f077fe700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ee8004500 0x7f8f080b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 -- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ee8004500 msgr2=0x7f8f080b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ee8004500 0x7f8f080b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 -- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 msgr2=0x7f8f0813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 0x7f8f0813eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 -- 172.21.2.135:0/804596243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f081446c0 con 0x7f8f08142eb0 2021-11-15T14:42:00.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f06ffd700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 0x7f8f0813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:00.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f07fff700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f8f081440d0 tx=0x7f8f00007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f00005a90 con 0x7f8f08142eb0 2021-11-15T14:42:00.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00005bf0 con 0x7f8f08142eb0 2021-11-15T14:42:00.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f08144960 con 0x7f8f08142eb0 2021-11-15T14:42:00.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f000070d0 con 0x7f8f08142eb0 2021-11-15T14:42:00.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08144e00 con 0x7f8f08142eb0 2021-11-15T14:42:00.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08144af0 con 0x7f8f08142eb0 2021-11-15T14:42:00.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8f00010070 con 0x7f8f08142eb0 2021-11-15T14:42:00.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 0x7f8eec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.568+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8f0006b1e0 con 0x7f8f08142eb0 2021-11-15T14:42:00.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.572+0000 7f8f077fe700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 0x7f8eec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.572+0000 7f8f077fe700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 0x7f8eec055b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8ef000b000 tx=0x7f8ef00016d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.572+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f000420e0 con 0x7f8f08142eb0 2021-11-15T14:42:00.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f080573d0 con 0x7f8f08142eb0 2021-11-15T14:42:00.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f04ff9700 1 -- 172.21.2.135:0/804596243 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f8f00045700 con 0x7f8f08142eb0 2021-11-15T14:42:00.660 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:00.660 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":112,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:00.342371+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:58.191691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:59.338547+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:00.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 msgr2=0x7f8eec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 0x7f8eec055b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8ef000b000 tx=0x7f8ef00016d0).stop 2021-11-15T14:42:00.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 msgr2=0x7f8f0813ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f8f081440d0 tx=0x7f8f00007dd0).stop 2021-11-15T14:42:00.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 shutdown_connections 2021-11-15T14:42:00.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8eec053660 0x7f8eec055b20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8f08142eb0 0x7f8f0813ef90 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8f081425a0 0x7f8f0813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 --2- 172.21.2.135:0/804596243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ee8004500 0x7f8f080b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 >> 172.21.2.135:0/804596243 conn(0x7f8f08060840 msgr2=0x7f8f080b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 shutdown_connections 2021-11-15T14:42:00.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.656+0000 7f8f0e1de700 1 -- 172.21.2.135:0/804596243 wait complete. 2021-11-15T14:42:00.668 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:42:00.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 Processor -- start 2021-11-15T14:42:00.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 -- start start 2021-11-15T14:42:00.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f19780ad0c0 0x7f19780b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780afb70 0x7f197813c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f197813c820 0x7f197813f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19780b5fc0 con 0x7f19780ad0c0 2021-11-15T14:42:00.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19780ad4a0 con 0x7f197813c820 2021-11-15T14:42:00.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f19806f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197813cc50 con 0x7f19780afb70 2021-11-15T14:42:00.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f197813c820 0x7f197813f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f197813c820 0x7f197813f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33390/0 (socket says 172.21.2.135:33390) 2021-11-15T14:42:00.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 -- 172.21.2.135:0/479646096 learned_addr learned my addr 172.21.2.135:0/479646096 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 -- 172.21.2.135:0/479646096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780afb70 msgr2=0x7f197813c330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:00.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 --2- 172.21.2.135:0/479646096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780afb70 0x7f197813c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 -- 172.21.2.135:0/479646096 >> v2:172.21.2.119:3300/0 conn(0x7f19780ad0c0 msgr2=0x7f19780b5ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:00.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 --2- 172.21.2.135:0/479646096 >> v2:172.21.2.119:3300/0 conn(0x7f19780ad0c0 0x7f19780b5ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.716+0000 7f197ec8d700 1 -- 172.21.2.135:0/479646096 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780aebe0 con 0x7f197813c820 2021-11-15T14:42:00.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197ec8d700 1 --2- 172.21.2.135:0/479646096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f197813c820 0x7f197813f0f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f19700032f0 tx=0x7f1970009b20).ready entity=mon.1 client_cookie=95881f44615b7c3a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197d48a700 1 -- 172.21.2.135:0/479646096 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f197000b920 con 0x7f197813c820 2021-11-15T14:42:00.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197d48a700 1 -- 172.21.2.135:0/479646096 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000ba80 con 0x7f197813c820 2021-11-15T14:42:00.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197d48a700 1 -- 172.21.2.135:0/479646096 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f197000be20 con 0x7f197813c820 2021-11-15T14:42:00.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/479646096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f197813c820 msgr2=0x7f197813f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- 172.21.2.135:0/479646096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f197813c820 0x7f197813f0f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f19700032f0 tx=0x7f1970009b20).stop 2021-11-15T14:42:00.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/479646096 shutdown_connections 2021-11-15T14:42:00.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- 172.21.2.135:0/479646096 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f197813c820 0x7f197813f0f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:00.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- 172.21.2.135:0/479646096 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780afb70 0x7f197813c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- 172.21.2.135:0/479646096 >> v2:172.21.2.119:3300/0 conn(0x7f19780ad0c0 0x7f19780b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/479646096 >> 172.21.2.135:0/479646096 conn(0x7f197805c510 msgr2=0x7f197805c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:00.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/479646096 shutdown_connections 2021-11-15T14:42:00.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/479646096 wait complete. 2021-11-15T14:42:00.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 Processor -- start 2021-11-15T14:42:00.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- start start 2021-11-15T14:42:00.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780ad0c0 0x7f1978145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f197813c820 0x7f1978141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978140c20 con 0x7f197813c820 2021-11-15T14:42:00.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978145400 con 0x7f19780afb70 2021-11-15T14:42:00.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19781456a0 con 0x7f19780ad0c0 2021-11-15T14:42:00.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33396/0 (socket says 172.21.2.135:33396) 2021-11-15T14:42:00.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 -- 172.21.2.135:0/478521368 learned_addr learned my addr 172.21.2.135:0/478521368 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:00.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 -- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780ad0c0 msgr2=0x7f1978145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780ad0c0 0x7f1978145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 -- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f197813c820 msgr2=0x7f1978141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:00.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f197813c820 0x7f1978141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:00.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 -- 172.21.2.135:0/478521368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970009dc0 con 0x7f19780afb70 2021-11-15T14:42:00.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f197dc8b700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f1978140d60 tx=0x7f1974006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1974012410 con 0x7f19780afb70 2021-11-15T14:42:00.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974012570 con 0x7f19780afb70 2021-11-15T14:42:00.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19740128d0 con 0x7f19780afb70 2021-11-15T14:42:00.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1978145940 con 0x7f19780afb70 2021-11-15T14:42:00.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1978141c80 con 0x7f19780afb70 2021-11-15T14:42:00.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1978145b00 con 0x7f19780afb70 2021-11-15T14:42:00.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f197400f030 con 0x7f19780afb70 2021-11-15T14:42:00.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 0x7f1958055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:00.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.720+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f197406b870 con 0x7f19780afb70 2021-11-15T14:42:00.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.724+0000 7f197e48c700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 0x7f1958055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:00.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.724+0000 7f197e48c700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 0x7f1958055bb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f1968002ef0 tx=0x7f1968006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:00.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.724+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1974042770 con 0x7f19780afb70 2021-11-15T14:42:00.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:00.832+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f19780aee80 con 0x7f19780afb70 2021-11-15T14:42:01.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19677fe700 1 -- 172.21.2.135:0/478521368 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1974045d90 con 0x7f19780afb70 2021-11-15T14:42:01.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 msgr2=0x7f1958055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 0x7f1958055bb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f1968002ef0 tx=0x7f1968006910).stop 2021-11-15T14:42:01.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 msgr2=0x7f1978140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f1978140d60 tx=0x7f1974006d50).stop 2021-11-15T14:42:01.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 shutdown_connections 2021-11-15T14:42:01.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f19580536f0 0x7f1958055bb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f197813c820 0x7f1978141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f19780afb70 0x7f1978140730 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 --2- 172.21.2.135:0/478521368 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f19780ad0c0 0x7f1978145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 >> 172.21.2.135:0/478521368 conn(0x7f197805c510 msgr2=0x7f19780b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 shutdown_connections 2021-11-15T14:42:01.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.360+0000 7f19806f0700 1 -- 172.21.2.135:0/478521368 wait complete. 2021-11-15T14:42:01.371 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:01.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 Processor -- start 2021-11-15T14:42:01.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 -- start start 2021-11-15T14:42:01.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c0b1e30 0x7fb26c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb26c148420 0x7fb26c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb26c0a7140 0x7fb26c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0a9140 con 0x7fb26c148420 2021-11-15T14:42:01.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0b03d0 con 0x7fb26c0a7140 2021-11-15T14:42:01.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0b0670 con 0x7fb26c0b1e30 2021-11-15T14:42:01.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb26c0a7140 0x7fb26c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb26c0a7140 0x7fb26c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33406/0 (socket says 172.21.2.135:33406) 2021-11-15T14:42:01.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 -- 172.21.2.135:0/1637575523 learned_addr learned my addr 172.21.2.135:0/1637575523 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:01.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 -- 172.21.2.135:0/1637575523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c0b1e30 msgr2=0x7fb26c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 --2- 172.21.2.135:0/1637575523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c0b1e30 0x7fb26c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 -- 172.21.2.135:0/1637575523 >> v2:172.21.2.119:3300/0 conn(0x7fb26c148420 msgr2=0x7fb26c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 --2- 172.21.2.135:0/1637575523 >> v2:172.21.2.119:3300/0 conn(0x7fb26c148420 0x7fb26c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 -- 172.21.2.135:0/1637575523 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0b0910 con 0x7fb26c0a7140 2021-11-15T14:42:01.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb271b6f700 1 --2- 172.21.2.135:0/1637575523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c1447a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fb2640032f0 tx=0x7fb264009290).ready entity=mon.1 client_cookie=9727ff0ba9154410 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb25bfff700 1 -- 172.21.2.135:0/1637575523 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb26400b870 con 0x7fb26c0a7140 2021-11-15T14:42:01.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb25bfff700 1 -- 172.21.2.135:0/1637575523 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26400b9d0 con 0x7fb26c0a7140 2021-11-15T14:42:01.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb25bfff700 1 -- 172.21.2.135:0/1637575523 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb26400bb40 con 0x7fb26c0a7140 2021-11-15T14:42:01.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 -- 172.21.2.135:0/1637575523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 msgr2=0x7fb26c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.428+0000 7fb2735d2700 1 --2- 172.21.2.135:0/1637575523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c1447a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fb2640032f0 tx=0x7fb264009290).stop 2021-11-15T14:42:01.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/1637575523 shutdown_connections 2021-11-15T14:42:01.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- 172.21.2.135:0/1637575523 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c1447a0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- 172.21.2.135:0/1637575523 >> v2:172.21.2.119:3300/0 conn(0x7fb26c148420 0x7fb26c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- 172.21.2.135:0/1637575523 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c0b1e30 0x7fb26c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/1637575523 >> 172.21.2.135:0/1637575523 conn(0x7fb26c05f730 msgr2=0x7fb26c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/1637575523 shutdown_connections 2021-11-15T14:42:01.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/1637575523 wait complete. 2021-11-15T14:42:01.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 Processor -- start 2021-11-15T14:42:01.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- start start 2021-11-15T14:42:01.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb26c0b1e30 0x7fb26c148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c148420 0x7fb26c142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c1433e0 con 0x7fb26c0b1e30 2021-11-15T14:42:01.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c141e20 con 0x7fb26c0a7140 2021-11-15T14:42:01.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c1420c0 con 0x7fb26c148420 2021-11-15T14:42:01.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33408/0 (socket says 172.21.2.135:33408) 2021-11-15T14:42:01.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 -- 172.21.2.135:0/2499465674 learned_addr learned my addr 172.21.2.135:0/2499465674 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:01.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 -- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c148420 msgr2=0x7fb26c142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c148420 0x7fb26c142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 -- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb26c0b1e30 msgr2=0x7fb26c148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb26c0b1e30 0x7fb26c148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 -- 172.21.2.135:0/2499465674 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264009530 con 0x7fb26c0a7140 2021-11-15T14:42:01.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb27136e700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fb26c143520 tx=0x7fb268006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb268013460 con 0x7fb26c0a7140 2021-11-15T14:42:01.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2680135c0 con 0x7fb26c0a7140 2021-11-15T14:42:01.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c142360 con 0x7fb26c0a7140 2021-11-15T14:42:01.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb268013920 con 0x7fb26c0a7140 2021-11-15T14:42:01.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c14a590 con 0x7fb26c0a7140 2021-11-15T14:42:01.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb26801a060 con 0x7fb26c0a7140 2021-11-15T14:42:01.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c1424f0 con 0x7fb26c0a7140 2021-11-15T14:42:01.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 0x7fb24c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.432+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb26806b4a0 con 0x7fb26c0a7140 2021-11-15T14:42:01.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.436+0000 7fb270b6d700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 0x7fb24c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.436+0000 7fb270b6d700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 0x7fb24c055b50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb25c002f70 tx=0x7fb25c006970).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.436+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2680424b0 con 0x7fb26c0a7140 2021-11-15T14:42:01.549 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb26c0b0bb0 con 0x7fb26c0a7140 2021-11-15T14:42:01.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb25a7fc700 1 -- 172.21.2.135:0/2499465674 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fb268018030 con 0x7fb26c0a7140 2021-11-15T14:42:01.550 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:01.551 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:01.348735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7270":{"gid":7270,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1824406336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1824406336},{"type":"v1","addr":"172.21.2.135:6835","nonce":1824406336}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:01.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 msgr2=0x7fb24c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 0x7fb24c055b50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fb25c002f70 tx=0x7fb25c006970).stop 2021-11-15T14:42:01.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 msgr2=0x7fb26c142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fb26c143520 tx=0x7fb268006ec0).stop 2021-11-15T14:42:01.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 shutdown_connections 2021-11-15T14:42:01.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb24c053690 0x7fb24c055b50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb26c148420 0x7fb26c142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb26c0b1e30 0x7fb26c148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 --2- 172.21.2.135:0/2499465674 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb26c0a7140 0x7fb26c142800 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 >> 172.21.2.135:0/2499465674 conn(0x7fb26c05f730 msgr2=0x7fb26c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 shutdown_connections 2021-11-15T14:42:01.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.548+0000 7fb2735d2700 1 -- 172.21.2.135:0/2499465674 wait complete. 2021-11-15T14:42:01.554 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 54 2021-11-15T14:42:01.558 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:01.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 Processor -- start 2021-11-15T14:42:01.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- start start 2021-11-15T14:42:01.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb7e00b1e30 0x7fb7e00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb7e00a7140 0x7fb7e01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e00b03d0 con 0x7fb7e0148420 2021-11-15T14:42:01.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00a9140 con 0x7fb7e00a7140 2021-11-15T14:42:01.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b0670 con 0x7fb7e00b1e30 2021-11-15T14:42:01.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7de59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb7e0148420 0x7fb7e00b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49238/0 (socket says 172.21.2.135:49238) 2021-11-15T14:42:01.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7de59c700 1 -- 172.21.2.135:0/3848420433 learned_addr learned my addr 172.21.2.135:0/3848420433 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:01.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 --2- 172.21.2.135:0/3848420433 >> v2:172.21.2.135:3300/0 conn(0x7fb7e00b1e30 0x7fb7e00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ddd9b700 1 -- 172.21.2.135:0/3848420433 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573134495 0 0) 0x7fb7e00b03d0 con 0x7fb7e0148420 2021-11-15T14:42:01.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ddd9b700 1 -- 172.21.2.135:0/3848420433 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c0003260 con 0x7fb7e0148420 2021-11-15T14:42:01.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 -- 172.21.2.135:0/3848420433 >> v2:172.21.2.119:3300/0 conn(0x7fb7e00a7140 msgr2=0x7fb7e01447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 --2- 172.21.2.135:0/3848420433 >> v2:172.21.2.119:3300/0 conn(0x7fb7e00a7140 0x7fb7e01447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 -- 172.21.2.135:0/3848420433 >> v1:172.21.2.135:6789/0 conn(0x7fb7e0148420 legacy=0x7fb7e00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 -- 172.21.2.135:0/3848420433 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00b0910 con 0x7fb7e00b1e30 2021-11-15T14:42:01.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ded9d700 1 --2- 172.21.2.135:0/3848420433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e00b1e30 0x7fb7e00b1050 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fb7e01477b0 tx=0x7fb7c8006df0).ready entity=mon.1 client_cookie=efa82395d0d3d353 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ddd9b700 1 -- 172.21.2.135:0/3848420433 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c800d5c0 con 0x7fb7e00b1e30 2021-11-15T14:42:01.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ddd9b700 1 -- 172.21.2.135:0/3848420433 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c8000e90 con 0x7fb7e00b1e30 2021-11-15T14:42:01.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7ddd9b700 1 -- 172.21.2.135:0/3848420433 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c800d910 con 0x7fb7e00b1e30 2021-11-15T14:42:01.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- 172.21.2.135:0/3848420433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e00b1e30 msgr2=0x7fb7e00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3848420433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e00b1e30 0x7fb7e00b1050 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fb7e01477b0 tx=0x7fb7c8006df0).stop 2021-11-15T14:42:01.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- 172.21.2.135:0/3848420433 shutdown_connections 2021-11-15T14:42:01.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3848420433 >> v2:172.21.2.119:3300/0 conn(0x7fb7e00a7140 0x7fb7e01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3848420433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e00b1e30 0x7fb7e00b1050 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- 172.21.2.135:0/3848420433 >> 172.21.2.135:0/3848420433 conn(0x7fb7e005f730 msgr2=0x7fb7e005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- 172.21.2.135:0/3848420433 shutdown_connections 2021-11-15T14:42:01.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.604+0000 7fb7e5199700 1 -- 172.21.2.135:0/3848420433 wait complete. 2021-11-15T14:42:01.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 Processor -- start 2021-11-15T14:42:01.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- start start 2021-11-15T14:42:01.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7e00a7140 0x7fb7e00ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7e00b1e30 0x7fb7e015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00abe90 con 0x7fb7e00b1e30 2021-11-15T14:42:01.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00ac0c0 con 0x7fb7e0148420 2021-11-15T14:42:01.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00ac360 con 0x7fb7e00a7140 2021-11-15T14:42:01.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33426/0 (socket says 172.21.2.135:33426) 2021-11-15T14:42:01.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 -- 172.21.2.135:0/3780824092 learned_addr learned my addr 172.21.2.135:0/3780824092 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:01.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 -- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7e00a7140 msgr2=0x7fb7e00ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7e00a7140 0x7fb7e00ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 -- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7e00b1e30 msgr2=0x7fb7e015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7e00b1e30 0x7fb7e015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 -- 172.21.2.135:0/3780824092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c800b180 con 0x7fb7e0148420 2021-11-15T14:42:01.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7df59e700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fb7e0149fd0 tx=0x7fb7d8009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d800d580 con 0x7fb7e0148420 2021-11-15T14:42:01.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800d6e0 con 0x7fb7e0148420 2021-11-15T14:42:01.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d800da40 con 0x7fb7e0148420 2021-11-15T14:42:01.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e015aa00 con 0x7fb7e0148420 2021-11-15T14:42:01.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e015a6b0 con 0x7fb7e0148420 2021-11-15T14:42:01.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e00aaf90 con 0x7fb7e0148420 2021-11-15T14:42:01.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb7d800dba0 con 0x7fb7e0148420 2021-11-15T14:42:01.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 0x7fb7c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb7d806bdd0 con 0x7fb7e0148420 2021-11-15T14:42:01.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.608+0000 7fb7ded9d700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 0x7fb7c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.612+0000 7fb7ded9d700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 0x7fb7c4055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb7e01477b0 tx=0x7fb7c8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.612+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7d8042de0 con 0x7fb7e0148420 2021-11-15T14:42:01.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.692+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7e00a9f80 con 0x7fb7e0148420 2021-11-15T14:42:01.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7d7fff700 1 -- 172.21.2.135:0/3780824092 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fb7d8046400 con 0x7fb7e0148420 2021-11-15T14:42:01.698 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:01.699 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":113,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:01.347236+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:58.191691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:59.338547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:01.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 msgr2=0x7fb7c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 0x7fb7c4055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb7e01477b0 tx=0x7fb7c8014000).stop 2021-11-15T14:42:01.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 msgr2=0x7fb7e00aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fb7e0149fd0 tx=0x7fb7d8009220).stop 2021-11-15T14:42:01.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 shutdown_connections 2021-11-15T14:42:01.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb7c40536a0 0x7fb7c4055b60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb7e0148420 0x7fb7e00aa900 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb7e00b1e30 0x7fb7e015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 --2- 172.21.2.135:0/3780824092 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb7e00a7140 0x7fb7e00ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 >> 172.21.2.135:0/3780824092 conn(0x7fb7e005f730 msgr2=0x7fb7e00b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 shutdown_connections 2021-11-15T14:42:01.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.696+0000 7fb7e5199700 1 -- 172.21.2.135:0/3780824092 wait complete. 2021-11-15T14:42:01.706 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:42:01.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 Processor -- start 2021-11-15T14:42:01.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 -- start start 2021-11-15T14:42:01.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f44a40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40b03d0 con 0x7f44a40a7140 2021-11-15T14:42:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40b0670 con 0x7f44a40b1e30 2021-11-15T14:42:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44ac294700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40a9140 con 0x7f44a4148420 2021-11-15T14:42:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44aa030700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f44a40b1e30 0x7f44a40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49250/0 (socket says 172.21.2.135:49250) 2021-11-15T14:42:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44aa030700 1 -- 172.21.2.135:0/4041555872 learned_addr learned my addr 172.21.2.135:0/4041555872 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334164580 0 0) 0x7f44a40b0670 con 0x7f44a40b1e30 2021-11-15T14:42:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f448c003260 con 0x7f44a40b1e30 2021-11-15T14:42:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a982f700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f44a40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671382500 0 0) 0x7f448c003260 con 0x7f44a40b1e30 2021-11-15T14:42:01.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 msgr2=0x7f44a40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f44a40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 >> v1:172.21.2.119:6789/0 conn(0x7f44a40a7140 legacy=0x7f44a41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40b0910 con 0x7f44a40b1e30 2021-11-15T14:42:01.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f44a0001660 con 0x7f44a40b1e30 2021-11-15T14:42:01.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a982f700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f44a40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:01.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 >> v1:172.21.2.135:6789/0 conn(0x7f44a40b1e30 legacy=0x7f44a40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f448c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c003ea0 0x7f448c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f448c004bf0 0x7f448c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c005270 con 0x7f448c003ea0 2021-11-15T14:42:01.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c00bc40 con 0x7f448c004bf0 2021-11-15T14:42:01.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.756+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c00bd80 con 0x7f44a4148420 2021-11-15T14:42:01.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f448c004bf0 0x7f448c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa030700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f448c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 msgr2=0x7f448c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f448c0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c003ea0 msgr2=0x7f448c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c003ea0 0x7f448c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/4041555872 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c003260 con 0x7f448c004bf0 2021-11-15T14:42:01.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa030700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a4148420 0x7f448c0037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:01.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f448c004bf0 0x7f448c00b750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f449c002320 tx=0x7f449c007d80).ready entity=mon.1 client_cookie=db4dfe7d4dc93a38 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c002510 con 0x7f448c004bf0 2021-11-15T14:42:01.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c006890 con 0x7f448c004bf0 2021-11-15T14:42:01.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44a902e700 1 -- 172.21.2.135:0/4041555872 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c006bf0 con 0x7f448c004bf0 2021-11-15T14:42:01.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/4041555872 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f448c004bf0 msgr2=0x7f448c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 --2- 172.21.2.135:0/4041555872 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f448c004bf0 0x7f448c00b750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f449c002320 tx=0x7f449c007d80).stop 2021-11-15T14:42:01.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/4041555872 reap_dead start 2021-11-15T14:42:01.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/4041555872 shutdown_connections 2021-11-15T14:42:01.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/4041555872 >> 172.21.2.135:0/4041555872 conn(0x7f44a405f730 msgr2=0x7f44a405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/4041555872 shutdown_connections 2021-11-15T14:42:01.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/4041555872 wait complete. 2021-11-15T14:42:01.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 Processor -- start 2021-11-15T14:42:01.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- start start 2021-11-15T14:42:01.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c004bf0 0x7f44a4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a41568d0 0x7f44a40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4147170 con 0x7f448c004bf0 2021-11-15T14:42:01.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4145d50 con 0x7f44a40ad5b0 2021-11-15T14:42:01.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a41463f0 con 0x7f44a41568d0 2021-11-15T14:42:01.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33446/0 (socket says 172.21.2.135:33446) 2021-11-15T14:42:01.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/1165119864 learned_addr learned my addr 172.21.2.135:0/1165119864 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:01.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a41568d0 msgr2=0x7f44a40ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a41568d0 0x7f44a40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c004bf0 msgr2=0x7f44a4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c004bf0 0x7f44a4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 -- 172.21.2.135:0/1165119864 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40afac0 con 0x7f44a40ad5b0 2021-11-15T14:42:01.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44aa831700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f44a40b31f0 tx=0x7f449c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c002510 con 0x7f44a40ad5b0 2021-11-15T14:42:01.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c006e40 con 0x7f44a40ad5b0 2021-11-15T14:42:01.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a4156d50 con 0x7f44a40ad5b0 2021-11-15T14:42:01.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c013810 con 0x7f44a40ad5b0 2021-11-15T14:42:01.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a40af8b0 con 0x7f44a40ad5b0 2021-11-15T14:42:01.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4146250 con 0x7f44a40ad5b0 2021-11-15T14:42:01.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.760+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f449c025030 con 0x7f44a40ad5b0 2021-11-15T14:42:01.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.764+0000 7f44937fe700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.764+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f449c06c780 con 0x7f44a40ad5b0 2021-11-15T14:42:01.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.764+0000 7f44aa030700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.764+0000 7f44aa030700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 0x7f4484055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f44a0008000 tx=0x7f44a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.764+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44a4146250 con 0x7f44a40ad5b0 2021-11-15T14:42:01.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.876+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f44a4146250 con 0x7f44a40ad5b0 2021-11-15T14:42:01.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.888+0000 7f44937fe700 1 -- 172.21.2.135:0/1165119864 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f44a4146250 con 0x7f44a40ad5b0 2021-11-15T14:42:01.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 msgr2=0x7f4484055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 0x7f4484055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f44a0008000 tx=0x7f44a0009040).stop 2021-11-15T14:42:01.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 msgr2=0x7f44a413f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f44a40b31f0 tx=0x7f449c016000).stop 2021-11-15T14:42:01.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 shutdown_connections 2021-11-15T14:42:01.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4484053640 0x7f4484055b00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f44a40ad5b0 0x7f44a413f8c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f44a41568d0 0x7f44a40ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 --2- 172.21.2.135:0/1165119864 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f448c004bf0 0x7f44a4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 >> 172.21.2.135:0/1165119864 conn(0x7f44a405f730 msgr2=0x7f44a4142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 shutdown_connections 2021-11-15T14:42:01.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.892+0000 7f44ac294700 1 -- 172.21.2.135:0/1165119864 wait complete. 2021-11-15T14:42:01.897 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:42:01.901 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:42:01.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 Processor -- start 2021-11-15T14:42:01.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 -- start start 2021-11-15T14:42:01.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa58c0b1e30 0x7fa58c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 0x7fa58c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0b03d0 con 0x7fa58c0a7140 2021-11-15T14:42:01.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c0a9140 con 0x7fa58c0b1e30 2021-11-15T14:42:01.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.952+0000 7fa593117700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0b0670 con 0x7fa58c148420 2021-11-15T14:42:01.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 0x7fa58c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa5916b4700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fa58c0a7140 0x7fa58c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:58686/0 (socket says 172.21.2.135:58686) 2021-11-15T14:42:01.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa5916b4700 1 -- 172.21.2.135:0/2064916761 learned_addr learned my addr 172.21.2.135:0/2064916761 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:01.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 --2- 172.21.2.135:0/2064916761 >> v2:172.21.2.119:3300/0 conn(0x7fa58c0b1e30 0x7fa58c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 -- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 msgr2=0x7fa58c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:01.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 0x7fa58c0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 -- 172.21.2.135:0/2064916761 >> v1:172.21.2.119:6789/0 conn(0x7fa58c0a7140 legacy=0x7fa58c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 -- 172.21.2.135:0/2064916761 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0b0910 con 0x7fa58c0b1e30 2021-11-15T14:42:01.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58bfff700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 0x7fa58c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:42:01.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa590eb3700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c0b1e30 0x7fa58c0b1050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fa580002f70 tx=0x7fa580006df0).ready entity=mon.0 client_cookie=4bcf84369aa56f9d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58b7fe700 1 -- 172.21.2.135:0/2064916761 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58000d570 con 0x7fa58c0b1e30 2021-11-15T14:42:01.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58b7fe700 1 -- 172.21.2.135:0/2064916761 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580000e90 con 0x7fa58c0b1e30 2021-11-15T14:42:01.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58b7fe700 1 -- 172.21.2.135:0/2064916761 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58000d8c0 con 0x7fa58c0b1e30 2021-11-15T14:42:01.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c0b1e30 msgr2=0x7fa58c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c0b1e30 0x7fa58c0b1050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fa580002f70 tx=0x7fa580006df0).stop 2021-11-15T14:42:01.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- 172.21.2.135:0/2064916761 shutdown_connections 2021-11-15T14:42:01.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c148420 0x7fa58c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- 172.21.2.135:0/2064916761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c0b1e30 0x7fa58c0b1050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- 172.21.2.135:0/2064916761 >> 172.21.2.135:0/2064916761 conn(0x7fa58c05f730 msgr2=0x7fa58c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:01.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- 172.21.2.135:0/2064916761 shutdown_connections 2021-11-15T14:42:01.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- 172.21.2.135:0/2064916761 wait complete. 2021-11-15T14:42:01.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 Processor -- start 2021-11-15T14:42:01.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- start start 2021-11-15T14:42:01.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c0a7140 0x7fa58c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c148420 0x7fa58c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0b4470 con 0x7fa58c148420 2021-11-15T14:42:01.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c15a070 con 0x7fa58c0b1e30 2021-11-15T14:42:01.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa593117700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c15a310 con 0x7fa58c0a7140 2021-11-15T14:42:01.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33458/0 (socket says 172.21.2.135:33458) 2021-11-15T14:42:01.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.956+0000 7fa58bfff700 1 -- 172.21.2.135:0/3534227191 learned_addr learned my addr 172.21.2.135:0/3534227191 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:01.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa590eb3700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c0a7140 0x7fa58c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 -- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c0a7140 msgr2=0x7fa58c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c0a7140 0x7fa58c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:01.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 -- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c148420 msgr2=0x7fa58c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:01.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c148420 0x7fa58c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:01.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 -- 172.21.2.135:0/3534227191 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c00b180 con 0x7fa58c0b1e30 2021-11-15T14:42:01.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa58bfff700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa57c00c000 tx=0x7fa57c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c00c850 con 0x7fa58c0b1e30 2021-11-15T14:42:01.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00c9b0 con 0x7fa58c0b1e30 2021-11-15T14:42:01.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c00cd10 con 0x7fa58c0b1e30 2021-11-15T14:42:01.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58000b180 con 0x7fa58c0b1e30 2021-11-15T14:42:01.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c147e80 con 0x7fa58c0b1e30 2021-11-15T14:42:01.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c0b0bb0 con 0x7fa58c0b1e30 2021-11-15T14:42:01.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa57c01c460 con 0x7fa58c0b1e30 2021-11-15T14:42:01.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 0x7fa56c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:01.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa57c06c0b0 con 0x7fa58c0b1e30 2021-11-15T14:42:01.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa590eb3700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 0x7fa56c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:01.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.960+0000 7fa590eb3700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 0x7fa56c055a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa580018000 tx=0x7fa580014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:01.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:01.964+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa57c043060 con 0x7fa58c0b1e30 2021-11-15T14:42:02.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.072+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa58c0573d0 con 0x7fa58c0b1e30 2021-11-15T14:42:02.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa589ffb700 1 -- 172.21.2.135:0/3534227191 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa57c046680 con 0x7fa58c0b1e30 2021-11-15T14:42:02.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 msgr2=0x7fa56c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 0x7fa56c055a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa580018000 tx=0x7fa580014000).stop 2021-11-15T14:42:02.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 msgr2=0x7fa58c147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fa57c00c000 tx=0x7fa57c006df0).stop 2021-11-15T14:42:02.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 shutdown_connections 2021-11-15T14:42:02.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa56c053580 0x7fa56c055a40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa58c148420 0x7fa58c156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa58c0b1e30 0x7fa58c147990 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 --2- 172.21.2.135:0/3534227191 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa58c0a7140 0x7fa58c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 >> 172.21.2.135:0/3534227191 conn(0x7fa58c05f730 msgr2=0x7fa58c140740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 shutdown_connections 2021-11-15T14:42:02.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.088+0000 7fa593117700 1 -- 172.21.2.135:0/3534227191 wait complete. 2021-11-15T14:42:02.093 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:42:02.096 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:02.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 Processor -- start 2021-11-15T14:42:02.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 -- start start 2021-11-15T14:42:02.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe97c0b0520 0x7fe97c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe97c0b0900 0x7fe97c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c0b2b70 con 0x7fe97c0aa1a0 2021-11-15T14:42:02.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c0b27f0 con 0x7fe97c0b0900 2021-11-15T14:42:02.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe984775700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c0b2da0 con 0x7fe97c0b0520 2021-11-15T14:42:02.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe981d10700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe97c0aa1a0 0x7fe97c0ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49288/0 (socket says 172.21.2.135:49288) 2021-11-15T14:42:02.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe981d10700 1 -- 172.21.2.135:0/229454817 learned_addr learned my addr 172.21.2.135:0/229454817 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:02.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 --2- 172.21.2.135:0/229454817 >> v2:172.21.2.135:3300/0 conn(0x7fe97c0b0520 0x7fe97c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe98150f700 1 -- 172.21.2.135:0/229454817 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21277031 0 0) 0x7fe97c0b2b70 con 0x7fe97c0aa1a0 2021-11-15T14:42:02.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe98150f700 1 -- 172.21.2.135:0/229454817 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe964003260 con 0x7fe97c0aa1a0 2021-11-15T14:42:02.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 -- 172.21.2.135:0/229454817 >> v2:172.21.2.119:3300/0 conn(0x7fe97c0b0900 msgr2=0x7fe97c140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:02.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 --2- 172.21.2.135:0/229454817 >> v2:172.21.2.119:3300/0 conn(0x7fe97c0b0900 0x7fe97c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 -- 172.21.2.135:0/229454817 >> v1:172.21.2.135:6789/0 conn(0x7fe97c0aa1a0 legacy=0x7fe97c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 -- 172.21.2.135:0/229454817 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c0a9bf0 con 0x7fe97c0b0520 2021-11-15T14:42:02.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe982511700 1 --2- 172.21.2.135:0/229454817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c0addb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe970002f70 tx=0x7fe970006df0).ready entity=mon.1 client_cookie=638c290aff862c89 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe98150f700 1 -- 172.21.2.135:0/229454817 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe970014070 con 0x7fe97c0b0520 2021-11-15T14:42:02.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe98150f700 1 -- 172.21.2.135:0/229454817 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970000e90 con 0x7fe97c0b0520 2021-11-15T14:42:02.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.144+0000 7fe98150f700 1 -- 172.21.2.135:0/229454817 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97000fba0 con 0x7fe97c0b0520 2021-11-15T14:42:02.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/229454817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 msgr2=0x7fe97c0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- 172.21.2.135:0/229454817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c0addb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe970002f70 tx=0x7fe970006df0).stop 2021-11-15T14:42:02.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/229454817 shutdown_connections 2021-11-15T14:42:02.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- 172.21.2.135:0/229454817 >> v2:172.21.2.119:3300/0 conn(0x7fe97c0b0900 0x7fe97c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- 172.21.2.135:0/229454817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c0addb0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/229454817 >> 172.21.2.135:0/229454817 conn(0x7fe97c060840 msgr2=0x7fe97c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/229454817 shutdown_connections 2021-11-15T14:42:02.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/229454817 wait complete. 2021-11-15T14:42:02.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 Processor -- start 2021-11-15T14:42:02.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- start start 2021-11-15T14:42:02.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe97c0aa1a0 0x7fe97c0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe97c0b0900 0x7fe97c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c066090 con 0x7fe97c0b0900 2021-11-15T14:42:02.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c0662c0 con 0x7fe97c0b0520 2021-11-15T14:42:02.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c066560 con 0x7fe97c0aa1a0 2021-11-15T14:42:02.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33470/0 (socket says 172.21.2.135:33470) 2021-11-15T14:42:02.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 -- 172.21.2.135:0/2518745065 learned_addr learned my addr 172.21.2.135:0/2518745065 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:02.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 -- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe97c0aa1a0 msgr2=0x7fe97c0abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe97c0aa1a0 0x7fe97c0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 -- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe97c0b0900 msgr2=0x7fe97c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe97c0b0900 0x7fe97c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 -- 172.21.2.135:0/2518745065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97000b180 con 0x7fe97c0b0520 2021-11-15T14:42:02.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe981d10700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe978001110 tx=0x7fe978007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97800ce00 con 0x7fe97c0b0520 2021-11-15T14:42:02.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9780072e0 con 0x7fe97c0b0520 2021-11-15T14:42:02.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c066800 con 0x7fe97c0b0520 2021-11-15T14:42:02.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c064f20 con 0x7fe97c0b0520 2021-11-15T14:42:02.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe978005800 con 0x7fe97c0b0520 2021-11-15T14:42:02.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c0573d0 con 0x7fe97c0b0520 2021-11-15T14:42:02.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe97801a060 con 0x7fe97c0b0520 2021-11-15T14:42:02.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 0x7fe95c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.148+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe97806afe0 con 0x7fe97c0b0520 2021-11-15T14:42:02.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.152+0000 7fe982511700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 0x7fe95c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.152+0000 7fe982511700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 0x7fe95c055b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fe970002f70 tx=0x7fe970016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.152+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe978041ee0 con 0x7fe97c0b0520 2021-11-15T14:42:02.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe97c0446d0 con 0x7fe97c0b0520 2021-11-15T14:42:02.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe96f7fe700 1 -- 172.21.2.135:0/2518745065 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe978018090 con 0x7fe97c0b0520 2021-11-15T14:42:02.264 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:02.265 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:01.348735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7270":{"gid":7270,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1824406336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1824406336},{"type":"v1","addr":"172.21.2.135:6835","nonce":1824406336}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:02.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 msgr2=0x7fe95c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 0x7fe95c055b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fe970002f70 tx=0x7fe970016000).stop 2021-11-15T14:42:02.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 msgr2=0x7fe97c15a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe978001110 tx=0x7fe978007aa0).stop 2021-11-15T14:42:02.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 shutdown_connections 2021-11-15T14:42:02.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe95c053690 0x7fe95c055b50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe97c0b0900 0x7fe97c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe97c0b0520 0x7fe97c15a230 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 --2- 172.21.2.135:0/2518745065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe97c0aa1a0 0x7fe97c0abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 >> 172.21.2.135:0/2518745065 conn(0x7fe97c060840 msgr2=0x7fe97c0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 shutdown_connections 2021-11-15T14:42:02.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.260+0000 7fe984775700 1 -- 172.21.2.135:0/2518745065 wait complete. 2021-11-15T14:42:02.269 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 54 2021-11-15T14:42:02.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:00.342899+0000', 'modified': '2021-11-15T14:42:01.348735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7270': {'gid': 7270, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/1824406336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 1824406336}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 1824406336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:02.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:02.574 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:02.648 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7270,"want_state":"up:active","state":"up:active","rank_uptime":2.294180688,"mdsmap_epoch":54,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":6.6308741199999996} 2021-11-15T14:42:02.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7270, "mdsmap_epoch": 54, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 2.294180688, "state": "up:active", "uptime": 6.63087412, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:02.650 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:02.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.704+0000 7ff40023c700 1 Processor -- start 2021-11-15T14:42:02.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.704+0000 7ff40023c700 1 -- start start 2021-11-15T14:42:02.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 0x7ff3f81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f80b03d0 con 0x7ff3f8148420 2021-11-15T14:42:02.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f80b0670 con 0x7ff3f80b1e30 2021-11-15T14:42:02.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80a9140 con 0x7ff3f80b1050 2021-11-15T14:42:02.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fdfd8700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff3f80b1e30 0x7ff3f80b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49298/0 (socket says 172.21.2.135:49298) 2021-11-15T14:42:02.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fdfd8700 1 -- 172.21.2.135:0/148121945 learned_addr learned my addr 172.21.2.135:0/148121945 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:02.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 0x7ff3f81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291925935 0 0) 0x7ff3f80b0670 con 0x7ff3f80b1e30 2021-11-15T14:42:02.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e0003260 con 0x7ff3f80b1e30 2021-11-15T14:42:02.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1654297203 0 0) 0x7ff3e0003260 con 0x7ff3f80b1e30 2021-11-15T14:42:02.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 msgr2=0x7ff3f81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:02.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 0x7ff3f81447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 >> v1:172.21.2.119:6789/0 conn(0x7ff3f8148420 legacy=0x7ff3f80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80b0910 con 0x7ff3f80b1e30 2021-11-15T14:42:02.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff3ec001660 con 0x7ff3f80b1e30 2021-11-15T14:42:02.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 >> v1:172.21.2.135:6789/0 conn(0x7ff3f80b1e30 legacy=0x7ff3f80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3e0003780 0x7ff3e0003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 0x7ff3e0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3e00049f0 0x7ff3e0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e000b750 con 0x7ff3e0003780 2021-11-15T14:42:02.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e000b8c0 con 0x7ff3e00049f0 2021-11-15T14:42:02.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e000ba80 con 0x7ff3f80b1050 2021-11-15T14:42:02.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3e00049f0 0x7ff3e0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 msgr2=0x7ff3e0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:02.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3f80b1050 0x7ff3e0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3e0003780 msgr2=0x7ff3e0003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:02.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3e0003780 0x7ff3e0003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/148121945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0003260 con 0x7ff3e00049f0 2021-11-15T14:42:02.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3e00049f0 0x7ff3e0004e70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7ff3f000c000 tx=0x7ff3f00091d0).ready entity=mon.1 client_cookie=f60904843beeea4f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f000e7e0 con 0x7ff3e00049f0 2021-11-15T14:42:02.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f000e940 con 0x7ff3e00049f0 2021-11-15T14:42:02.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fcfd6700 1 -- 172.21.2.135:0/148121945 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f000eca0 con 0x7ff3e00049f0 2021-11-15T14:42:02.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- 172.21.2.135:0/148121945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3e00049f0 msgr2=0x7ff3e0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 --2- 172.21.2.135:0/148121945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3e00049f0 0x7ff3e0004e70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7ff3f000c000 tx=0x7ff3f00091d0).stop 2021-11-15T14:42:02.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/148121945 reap_dead start 2021-11-15T14:42:02.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- 172.21.2.135:0/148121945 shutdown_connections 2021-11-15T14:42:02.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- 172.21.2.135:0/148121945 >> 172.21.2.135:0/148121945 conn(0x7ff3f805f730 msgr2=0x7ff3f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- 172.21.2.135:0/148121945 shutdown_connections 2021-11-15T14:42:02.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- 172.21.2.135:0/148121945 wait complete. 2021-11-15T14:42:02.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 Processor -- start 2021-11-15T14:42:02.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.708+0000 7ff40023c700 1 -- start start 2021-11-15T14:42:02.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3e00049f0 0x7ff3f80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3f81574d0 0x7ff3f80b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80b37a0 con 0x7ff3f81574d0 2021-11-15T14:42:02.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8157970 con 0x7ff3f80b3d70 2021-11-15T14:42:02.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80b5320 con 0x7ff3e00049f0 2021-11-15T14:42:02.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33494/0 (socket says 172.21.2.135:33494) 2021-11-15T14:42:02.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/2476071853 learned_addr learned my addr 172.21.2.135:0/2476071853 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:02.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3e00049f0 msgr2=0x7ff3f80b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3e00049f0 0x7ff3f80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3f81574d0 msgr2=0x7ff3f80b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3f81574d0 0x7ff3f80b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 -- 172.21.2.135:0/2476071853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80b55c0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fe7d9700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7ff3ec001110 tx=0x7ff3f001a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f000eed0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f001b450 con 0x7ff3f80b3d70 2021-11-15T14:42:02.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f001b7f0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f80b5860 con 0x7ff3f80b3d70 2021-11-15T14:42:02.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f80b61f0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80573d0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3f001b950 con 0x7ff3f80b3d70 2021-11-15T14:42:02.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 0x7ff3d8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff3f006d070 con 0x7ff3f80b3d70 2021-11-15T14:42:02.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fdfd8700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 0x7ff3d8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.712+0000 7ff3fdfd8700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 0x7ff3d8055bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7ff3ec001370 tx=0x7ff3f80b0560).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.716+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3f0047e60 con 0x7ff3f80b3d70 2021-11-15T14:42:02.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f80b59f0 con 0x7ff3f80b3d70 2021-11-15T14:42:02.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff3eaffd700 1 -- 172.21.2.135:0/2476071853 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16285 (secure 0 0 0) 0x7ff3f0016070 con 0x7ff3f80b3d70 2021-11-15T14:42:02.804 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:02.804 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":113,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:01.347236+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:58.191691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:59.338547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:02.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 msgr2=0x7ff3d8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 0x7ff3d8055bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7ff3ec001370 tx=0x7ff3f80b0560).stop 2021-11-15T14:42:02.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 msgr2=0x7ff3f80b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7ff3ec001110 tx=0x7ff3f001a000).stop 2021-11-15T14:42:02.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 shutdown_connections 2021-11-15T14:42:02.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff3d80536f0 0x7ff3d8055bb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3f80b3d70 0x7ff3f80b4220 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff3f81574d0 0x7ff3f80b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 --2- 172.21.2.135:0/2476071853 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff3e00049f0 0x7ff3f80b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 >> 172.21.2.135:0/2476071853 conn(0x7ff3f805f730 msgr2=0x7ff3f80a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 shutdown_connections 2021-11-15T14:42:02.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.800+0000 7ff40023c700 1 -- 172.21.2.135:0/2476071853 wait complete. 2021-11-15T14:42:02.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:58.191691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:59.338547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:42:02.812 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:02.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 Processor -- start 2021-11-15T14:42:02.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 -- start start 2021-11-15T14:42:02.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3fcc0b2320 0x7f3fcc1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc0a7850 con 0x7f3fcc0b0030 2021-11-15T14:42:02.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b0470 con 0x7f3fcc0b2320 2021-11-15T14:42:02.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd2957700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b06d0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fcbfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fcbfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:43274/0 (socket says 172.21.2.135:43274) 2021-11-15T14:42:02.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fcbfff700 1 -- 172.21.2.135:0/41769899 learned_addr learned my addr 172.21.2.135:0/41769899 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:02.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.872+0000 7f3fd0ef4700 1 --2- 172.21.2.135:0/41769899 >> v2:172.21.2.119:3300/0 conn(0x7f3fcc0b2320 0x7f3fcc1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcbfff700 1 -- 172.21.2.135:0/41769899 >> v2:172.21.2.119:3300/0 conn(0x7f3fcc0b2320 msgr2=0x7f3fcc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:02.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcbfff700 1 --2- 172.21.2.135:0/41769899 >> v2:172.21.2.119:3300/0 conn(0x7f3fcc0b2320 0x7f3fcc1412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcbfff700 1 -- 172.21.2.135:0/41769899 >> v1:172.21.2.119:6789/0 conn(0x7f3fcc0b0030 legacy=0x7f3fcc0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcbfff700 1 -- 172.21.2.135:0/41769899 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0b0970 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcbfff700 1 --2- 172.21.2.135:0/41769899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc006eb0).ready entity=mon.2 client_cookie=983b4a0a580a34e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcaffd700 1 -- 172.21.2.135:0/41769899 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fbc00d570 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcaffd700 1 -- 172.21.2.135:0/41769899 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc000e90 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcaffd700 1 -- 172.21.2.135:0/41769899 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fbc00d900 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- 172.21.2.135:0/41769899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 msgr2=0x7f3fcc0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- 172.21.2.135:0/41769899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc006eb0).stop 2021-11-15T14:42:02.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- 172.21.2.135:0/41769899 shutdown_connections 2021-11-15T14:42:02.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- 172.21.2.135:0/41769899 >> v2:172.21.2.119:3300/0 conn(0x7f3fcc0b2320 0x7f3fcc1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- 172.21.2.135:0/41769899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b1f40 0x7f3fcc0b1350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- 172.21.2.135:0/41769899 >> 172.21.2.135:0/41769899 conn(0x7f3fcc05f730 msgr2=0x7f3fcc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- 172.21.2.135:0/41769899 shutdown_connections 2021-11-15T14:42:02.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- 172.21.2.135:0/41769899 wait complete. 2021-11-15T14:42:02.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 Processor -- start 2021-11-15T14:42:02.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- start start 2021-11-15T14:42:02.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3fcc0b0030 0x7f3fcc0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b2320 0x7f3fcc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0abd90 con 0x7f3fcc0b0030 2021-11-15T14:42:02.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b4430 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fd2957700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc149460 con 0x7f3fcc0b2320 2021-11-15T14:42:02.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33508/0 (socket says 172.21.2.135:33508) 2021-11-15T14:42:02.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 -- 172.21.2.135:0/2500633239 learned_addr learned my addr 172.21.2.135:0/2500633239 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:02.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 -- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b2320 msgr2=0x7f3fcc15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b2320 0x7f3fcc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 -- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3fcc0b0030 msgr2=0x7f3fcc0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.876+0000 7f3fcb7fe700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3fcc0b0030 0x7f3fcc0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fcb7fe700 1 -- 172.21.2.135:0/2500633239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc00b1e0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fcb7fe700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f3fcc06a170 tx=0x7f3fb4007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb400ce30 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400f470 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb400f7d0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0ab650 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc146da0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0573d0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3fb4019030 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 0x7f3fb0055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:02.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3fb406b040 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fcbfff700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 0x7f3fb0055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:02.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.880+0000 7f3fcbfff700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 0x7f3fb0055a30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:02.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.884+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fb4041f40 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.964+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3fcc0ac7e0 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.964+0000 7f3fc97fa700 1 -- 172.21.2.135:0/2500633239 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3fb4045560 con 0x7f3fcc0b1f40 2021-11-15T14:42:02.969 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:02.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 msgr2=0x7f3fb0055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 0x7f3fb0055a30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3fbc002f70 tx=0x7f3fbc015000).stop 2021-11-15T14:42:02.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 msgr2=0x7f3fcc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:02.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f3fcc06a170 tx=0x7f3fb4007c50).stop 2021-11-15T14:42:02.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 shutdown_connections 2021-11-15T14:42:02.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3fb0053570 0x7f3fb0055a30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3fcc0b2320 0x7f3fcc15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3fcc0b1f40 0x7f3fcc15a360 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:02.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 --2- 172.21.2.135:0/2500633239 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3fcc0b0030 0x7f3fcc0b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:02.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 >> 172.21.2.135:0/2500633239 conn(0x7f3fcc05f730 msgr2=0x7f3fcc0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:02.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 shutdown_connections 2021-11-15T14:42:02.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:02.968+0000 7f3fd2957700 1 -- 172.21.2.135:0/2500633239 wait complete. 2021-11-15T14:42:02.977 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:03.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 Processor -- start 2021-11-15T14:42:03.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- start start 2021-11-15T14:42:03.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b1f40 0x7f59300b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f59300b0030 0x7f59300b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f59300a7140 0x7f59301412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300b2810 con 0x7f59300b0030 2021-11-15T14:42:03.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300b0470 con 0x7f59300a7140 2021-11-15T14:42:03.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b06d0 con 0x7f59300b1f40 2021-11-15T14:42:03.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f59300a7140 0x7f59301412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f59300a7140 0x7f59301412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33514/0 (socket says 172.21.2.135:33514) 2021-11-15T14:42:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 -- 172.21.2.135:0/145433236 learned_addr learned my addr 172.21.2.135:0/145433236 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 -- 172.21.2.135:0/145433236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b1f40 msgr2=0x7f59300b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 --2- 172.21.2.135:0/145433236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b1f40 0x7f59300b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 -- 172.21.2.135:0/145433236 >> v2:172.21.2.119:3300/0 conn(0x7f59300b0030 msgr2=0x7f59300b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:03.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 --2- 172.21.2.135:0/145433236 >> v2:172.21.2.119:3300/0 conn(0x7f59300b0030 0x7f59300b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 -- 172.21.2.135:0/145433236 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300b0970 con 0x7f59300a7140 2021-11-15T14:42:03.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f593498c700 1 --2- 172.21.2.135:0/145433236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f59301412d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f59280032f0 tx=0x7f5928009290).ready entity=mon.1 client_cookie=d592b791505bf01f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592effd700 1 -- 172.21.2.135:0/145433236 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592800b870 con 0x7f59300a7140 2021-11-15T14:42:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592effd700 1 -- 172.21.2.135:0/145433236 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592800b9d0 con 0x7f59300a7140 2021-11-15T14:42:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592effd700 1 -- 172.21.2.135:0/145433236 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592800bb80 con 0x7f59300a7140 2021-11-15T14:42:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- 172.21.2.135:0/145433236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 msgr2=0x7f59301412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- 172.21.2.135:0/145433236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f59301412d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f59280032f0 tx=0x7f5928009290).stop 2021-11-15T14:42:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- 172.21.2.135:0/145433236 shutdown_connections 2021-11-15T14:42:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- 172.21.2.135:0/145433236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f59301412d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- 172.21.2.135:0/145433236 >> v2:172.21.2.119:3300/0 conn(0x7f59300b0030 0x7f59300b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- 172.21.2.135:0/145433236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b1f40 0x7f59300b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- 172.21.2.135:0/145433236 >> 172.21.2.135:0/145433236 conn(0x7f593005f730 msgr2=0x7f593005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- 172.21.2.135:0/145433236 shutdown_connections 2021-11-15T14:42:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- 172.21.2.135:0/145433236 wait complete. 2021-11-15T14:42:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 Processor -- start 2021-11-15T14:42:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- start start 2021-11-15T14:42:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b0030 0x7f59300b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f59300b1f40 0x7f59300a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b4c90 con 0x7f59300b1f40 2021-11-15T14:42:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b3760 con 0x7f59300a7140 2021-11-15T14:42:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f59363ef700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b3b50 con 0x7f59300b0030 2021-11-15T14:42:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33522/0 (socket says 172.21.2.135:33522) 2021-11-15T14:42:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.080+0000 7f592ffff700 1 -- 172.21.2.135:0/2985090294 learned_addr learned my addr 172.21.2.135:0/2985090294 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 -- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b0030 msgr2=0x7f59300b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b0030 0x7f59300b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 -- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f59300b1f40 msgr2=0x7f59300a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f59300b1f40 0x7f59300a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 -- 172.21.2.135:0/2985090294 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009530 con 0x7f59300a7140 2021-11-15T14:42:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592ffff700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f5918000ed0 tx=0x7f5918006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5918012410 con 0x7f59300a7140 2021-11-15T14:42:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918012570 con 0x7f59300a7140 2021-11-15T14:42:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59180128d0 con 0x7f59300a7140 2021-11-15T14:42:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59300b49f0 con 0x7f59300a7140 2021-11-15T14:42:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930145740 con 0x7f59300a7140 2021-11-15T14:42:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59300b3d10 con 0x7f59300a7140 2021-11-15T14:42:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f591800f030 con 0x7f59300a7140 2021-11-15T14:42:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 0x7f5914055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f591806b6c0 con 0x7f59300a7140 2021-11-15T14:42:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592f7fe700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 0x7f5914055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592f7fe700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 0x7f5914055b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f5920002fb0 tx=0x7f59200069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.084+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5918042670 con 0x7f59300a7140 2021-11-15T14:42:03.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59300b0c10 con 0x7f59300a7140 2021-11-15T14:42:03.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f592d7fa700 1 -- 172.21.2.135:0/2985090294 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5918045c90 con 0x7f59300a7140 2021-11-15T14:42:03.175 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:03.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 msgr2=0x7f5914055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 0x7f5914055b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f5920002fb0 tx=0x7f59200069b0).stop 2021-11-15T14:42:03.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 msgr2=0x7f5930145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f5918000ed0 tx=0x7f5918006d70).stop 2021-11-15T14:42:03.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 shutdown_connections 2021-11-15T14:42:03.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5914053640 0x7f5914055b00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f59300b1f40 0x7f59300a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f59300b0030 0x7f59300b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 --2- 172.21.2.135:0/2985090294 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f59300a7140 0x7f5930145250 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 >> 172.21.2.135:0/2985090294 conn(0x7f593005f730 msgr2=0x7f593013e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 shutdown_connections 2021-11-15T14:42:03.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.172+0000 7f59363ef700 1 -- 172.21.2.135:0/2985090294 wait complete. 2021-11-15T14:42:03.182 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:42:03.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 Processor -- start 2021-11-15T14:42:03.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 -- start start 2021-11-15T14:42:03.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a34060040 0x7f0a34064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0a340b2ca0 0x7f0a34065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a340b2430 con 0x7f0a340b3950 2021-11-15T14:42:03.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a34065770 con 0x7f0a340b2ca0 2021-11-15T14:42:03.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a3a87c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340b26d0 con 0x7f0a34060040 2021-11-15T14:42:03.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a337fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0a340b3950 0x7f0a340b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49350/0 (socket says 172.21.2.135:49350) 2021-11-15T14:42:03.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a337fe700 1 -- 172.21.2.135:0/2900044027 learned_addr learned my addr 172.21.2.135:0/2900044027 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:03.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 --2- 172.21.2.135:0/2900044027 >> v2:172.21.2.135:3300/0 conn(0x7f0a340b2ca0 0x7f0a34065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 -- 172.21.2.135:0/2900044027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a34060040 msgr2=0x7f0a34064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 --2- 172.21.2.135:0/2900044027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a34060040 0x7f0a34064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 -- 172.21.2.135:0/2900044027 >> v1:172.21.2.135:6789/0 conn(0x7f0a340b3950 legacy=0x7f0a340b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 -- 172.21.2.135:0/2900044027 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340b2970 con 0x7f0a340b2ca0 2021-11-15T14:42:03.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a38e19700 1 --2- 172.21.2.135:0/2900044027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a34065280 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f0a2c0032f0 tx=0x7f0a2c0091d0).ready entity=mon.1 client_cookie=808814df4a0674d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a32ffd700 1 -- 172.21.2.135:0/2900044027 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2c009ea0 con 0x7f0a340b2ca0 2021-11-15T14:42:03.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a32ffd700 1 -- 172.21.2.135:0/2900044027 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00b8a0 con 0x7f0a340b2ca0 2021-11-15T14:42:03.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.240+0000 7f0a32ffd700 1 -- 172.21.2.135:0/2900044027 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2c00ba10 con 0x7f0a340b2ca0 2021-11-15T14:42:03.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/2900044027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 msgr2=0x7f0a34065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/2900044027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a34065280 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f0a2c0032f0 tx=0x7f0a2c0091d0).stop 2021-11-15T14:42:03.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/2900044027 shutdown_connections 2021-11-15T14:42:03.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/2900044027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a34065280 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/2900044027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a34060040 0x7f0a34064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/2900044027 >> 172.21.2.135:0/2900044027 conn(0x7f0a3405cfe0 msgr2=0x7f0a3405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/2900044027 shutdown_connections 2021-11-15T14:42:03.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/2900044027 wait complete. 2021-11-15T14:42:03.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 Processor -- start 2021-11-15T14:42:03.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- start start 2021-11-15T14:42:03.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a34060040 0x7f0a340b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a340b3950 0x7f0a3413c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3413d990 con 0x7f0a34060040 2021-11-15T14:42:03.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a34159f40 con 0x7f0a340b2ca0 2021-11-15T14:42:03.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340613c0 con 0x7f0a340b3950 2021-11-15T14:42:03.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33532/0 (socket says 172.21.2.135:33532) 2021-11-15T14:42:03.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 -- 172.21.2.135:0/1766610528 learned_addr learned my addr 172.21.2.135:0/1766610528 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 -- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a340b3950 msgr2=0x7f0a3413c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a340b3950 0x7f0a3413c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 -- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a34060040 msgr2=0x7f0a340b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a34060040 0x7f0a340b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 -- 172.21.2.135:0/1766610528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c009470 con 0x7f0a340b2ca0 2021-11-15T14:42:03.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a337fe700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f0a3413e0f0 tx=0x7f0a24007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2400ce20 con 0x7f0a340b2ca0 2021-11-15T14:42:03.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a240072e0 con 0x7f0a340b2ca0 2021-11-15T14:42:03.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a24005800 con 0x7f0a340b2ca0 2021-11-15T14:42:03.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a34061660 con 0x7f0a340b2ca0 2021-11-15T14:42:03.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a34061040 con 0x7f0a340b2ca0 2021-11-15T14:42:03.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a340648f0 con 0x7f0a340b2ca0 2021-11-15T14:42:03.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a2401a060 con 0x7f0a340b2ca0 2021-11-15T14:42:03.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 0x7f0a14055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.244+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0a2406ae10 con 0x7f0a340b2ca0 2021-11-15T14:42:03.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.248+0000 7f0a33fff700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 0x7f0a14055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.248+0000 7f0a33fff700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 0x7f0a14055a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0a28002f70 tx=0x7f0a28006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.248+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a24041e20 con 0x7f0a340b2ca0 2021-11-15T14:42:03.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a340573d0 con 0x7f0a340b2ca0 2021-11-15T14:42:03.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a317fa700 1 -- 172.21.2.135:0/1766610528 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0a24018020 con 0x7f0a340b2ca0 2021-11-15T14:42:03.335 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:03.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 msgr2=0x7f0a14055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 0x7f0a14055a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f0a28002f70 tx=0x7f0a28006a80).stop 2021-11-15T14:42:03.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 msgr2=0x7f0a3415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f0a3413e0f0 tx=0x7f0a24007c70).stop 2021-11-15T14:42:03.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 shutdown_connections 2021-11-15T14:42:03.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0a14053540 0x7f0a14055a00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0a340b3950 0x7f0a3413c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0a340b2ca0 0x7f0a3415a610 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 --2- 172.21.2.135:0/1766610528 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0a34060040 0x7f0a340b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 >> 172.21.2.135:0/1766610528 conn(0x7f0a3405cfe0 msgr2=0x7f0a34060840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 shutdown_connections 2021-11-15T14:42:03.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.332+0000 7f0a3a87c700 1 -- 172.21.2.135:0/1766610528 wait complete. 2021-11-15T14:42:03.342 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:42:03.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 Processor -- start 2021-11-15T14:42:03.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- start start 2021-11-15T14:42:03.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7effac0b1350 0x7effac0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0a7850 con 0x7effac0b1f40 2021-11-15T14:42:03.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0b17c0 con 0x7effac0b1350 2021-11-15T14:42:03.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0b06d0 con 0x7effac0b2320 2021-11-15T14:42:03.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7effac0b1350 0x7effac0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7effac0b1350 0x7effac0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33544/0 (socket says 172.21.2.135:33544) 2021-11-15T14:42:03.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 -- 172.21.2.135:0/544116561 learned_addr learned my addr 172.21.2.135:0/544116561 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 -- 172.21.2.135:0/544116561 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 msgr2=0x7effac1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 --2- 172.21.2.135:0/544116561 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 -- 172.21.2.135:0/544116561 >> v1:172.21.2.119:6789/0 conn(0x7effac0b1f40 legacy=0x7effac0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 -- 172.21.2.135:0/544116561 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0b0970 con 0x7effac0b1350 2021-11-15T14:42:03.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effabfff700 1 --2- 172.21.2.135:0/544116561 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1350 0x7effac0b0030 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7effac0b2fd0 tx=0x7eff94006eb0).ready entity=mon.1 client_cookie=204015c51daabe53 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effab7fe700 1 -- 172.21.2.135:0/544116561 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff9400d570 con 0x7effac0b1350 2021-11-15T14:42:03.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effab7fe700 1 -- 172.21.2.135:0/544116561 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94000e90 con 0x7effac0b1350 2021-11-15T14:42:03.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effab7fe700 1 -- 172.21.2.135:0/544116561 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff9400d8c0 con 0x7effac0b1350 2021-11-15T14:42:03.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- 172.21.2.135:0/544116561 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1350 msgr2=0x7effac0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 --2- 172.21.2.135:0/544116561 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1350 0x7effac0b0030 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7effac0b2fd0 tx=0x7eff94006eb0).stop 2021-11-15T14:42:03.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- 172.21.2.135:0/544116561 shutdown_connections 2021-11-15T14:42:03.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 --2- 172.21.2.135:0/544116561 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 --2- 172.21.2.135:0/544116561 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1350 0x7effac0b0030 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- 172.21.2.135:0/544116561 >> 172.21.2.135:0/544116561 conn(0x7effac05f730 msgr2=0x7effac05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- 172.21.2.135:0/544116561 shutdown_connections 2021-11-15T14:42:03.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.408+0000 7effb2f73700 1 -- 172.21.2.135:0/544116561 wait complete. 2021-11-15T14:42:03.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 Processor -- start 2021-11-15T14:42:03.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- start start 2021-11-15T14:42:03.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7effac0b1350 0x7effac0ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac0aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac13f760 con 0x7effac0b1350 2021-11-15T14:42:03.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ac2f0 con 0x7effac0b1f40 2021-11-15T14:42:03.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac148a70 con 0x7effac0b2320 2021-11-15T14:42:03.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33548/0 (socket says 172.21.2.135:33548) 2021-11-15T14:42:03.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 -- 172.21.2.135:0/2355405596 learned_addr learned my addr 172.21.2.135:0/2355405596 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 -- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 msgr2=0x7effac0aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac0aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 -- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7effac0b1350 msgr2=0x7effac0ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7effac0b1350 0x7effac0ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 -- 172.21.2.135:0/2355405596 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9400b1e0 con 0x7effac0b1f40 2021-11-15T14:42:03.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effabfff700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7effac0b2fd0 tx=0x7eff94015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff94002f70 con 0x7effac0b1f40 2021-11-15T14:42:03.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400d8f0 con 0x7effac0b1f40 2021-11-15T14:42:03.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac148d10 con 0x7effac0b1f40 2021-11-15T14:42:03.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff9401e460 con 0x7effac0b1f40 2021-11-15T14:42:03.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac14b2b0 con 0x7effac0b1f40 2021-11-15T14:42:03.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0573d0 con 0x7effac0b1f40 2021-11-15T14:42:03.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff9401a040 con 0x7effac0b1f40 2021-11-15T14:42:03.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 0x7eff90055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7eff9406cbd0 con 0x7effac0b1f40 2021-11-15T14:42:03.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.412+0000 7effb0d0f700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 0x7eff90055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.416+0000 7effb0d0f700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 0x7eff90055b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7eff9c002f90 tx=0x7eff9c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.416+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff94043b90 con 0x7effac0b1f40 2021-11-15T14:42:03.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effac0a7630 con 0x7effac0b1f40 2021-11-15T14:42:03.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effa9ffb700 1 -- 172.21.2.135:0/2355405596 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+10 (secure 0 0 0) 0x7eff940470f0 con 0x7effac0b1f40 2021-11-15T14:42:03.503 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:03.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 msgr2=0x7eff90055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 0x7eff90055b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7eff9c002f90 tx=0x7eff9c0069b0).stop 2021-11-15T14:42:03.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 msgr2=0x7effac0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7effac0b2fd0 tx=0x7eff94015000).stop 2021-11-15T14:42:03.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 shutdown_connections 2021-11-15T14:42:03.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7eff90053640 0x7eff90055b00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7effac0b2320 0x7effac0aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7effac0b1f40 0x7effac0aa8b0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 --2- 172.21.2.135:0/2355405596 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7effac0b1350 0x7effac0ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 >> 172.21.2.135:0/2355405596 conn(0x7effac05f730 msgr2=0x7effac13f900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 shutdown_connections 2021-11-15T14:42:03.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.500+0000 7effb2f73700 1 -- 172.21.2.135:0/2355405596 wait complete. 2021-11-15T14:42:03.511 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:42:03.511 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:03.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 Processor -- start 2021-11-15T14:42:03.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 -- start start 2021-11-15T14:42:03.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 0x7f02c00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f02c00aa1a0 0x7f02c00ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c00b2b70 con 0x7f02c00b0900 2021-11-15T14:42:03.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00b27f0 con 0x7f02c00aa1a0 2021-11-15T14:42:03.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c693c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00b2da0 con 0x7f02c00b0520 2021-11-15T14:42:03.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c4ed9700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f02c00b0900 0x7f02c0143790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49378/0 (socket says 172.21.2.135:49378) 2021-11-15T14:42:03.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2275109002 learned_addr learned my addr 172.21.2.135:0/2275109002 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:03.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540158206 0 0) 0x7f02c00b2b70 con 0x7f02c00b0900 2021-11-15T14:42:03.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0003260 con 0x7f02c00b0900 2021-11-15T14:42:03.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02bffff700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 0x7f02c00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392617458 0 0) 0x7f02a0003260 con 0x7f02c00b0900 2021-11-15T14:42:03.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02bf7fe700 1 --2- 172.21.2.135:0/2275109002 >> v2:172.21.2.119:3300/0 conn(0x7f02c00aa1a0 0x7f02c00ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 msgr2=0x7f02c00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 0x7f02c00addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 >> v2:172.21.2.119:3300/0 conn(0x7f02c00aa1a0 msgr2=0x7f02c00ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 --2- 172.21.2.135:0/2275109002 >> v2:172.21.2.119:3300/0 conn(0x7f02c00aa1a0 0x7f02c00ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00a9bf0 con 0x7f02c00b0900 2021-11-15T14:42:03.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f02b80019e0 con 0x7f02c00b0900 2021-11-15T14:42:03.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 >> v1:172.21.2.135:6789/0 conn(0x7f02c00b0900 legacy=0x7f02c0143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02a0003750 0x7f02a0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 0x7f02a0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02a00049f0 0x7f02a0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00b27f0 con 0x7f02a0003750 2021-11-15T14:42:03.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00b2da0 con 0x7f02a00049f0 2021-11-15T14:42:03.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a000fc90 con 0x7f02c00b0520 2021-11-15T14:42:03.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.568+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02a00049f0 0x7f02a0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 msgr2=0x7f02a0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02c00b0520 0x7f02a0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02a0003750 msgr2=0x7f02a0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:03.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02a0003750 0x7f02a0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2275109002 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0003260 con 0x7f02a00049f0 2021-11-15T14:42:03.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02a00049f0 0x7f02a0004e70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f02b80016f0 tx=0x7f02b80021d0).ready entity=mon.1 client_cookie=fa20176ab94658a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b800cc80 con 0x7f02a00049f0 2021-11-15T14:42:03.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800cde0 con 0x7f02a00049f0 2021-11-15T14:42:03.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02beffd700 1 -- 172.21.2.135:0/2275109002 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b8005b80 con 0x7f02a00049f0 2021-11-15T14:42:03.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2275109002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02a00049f0 msgr2=0x7f02a0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 --2- 172.21.2.135:0/2275109002 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02a00049f0 0x7f02a0004e70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f02b80016f0 tx=0x7f02b80021d0).stop 2021-11-15T14:42:03.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2275109002 reap_dead start 2021-11-15T14:42:03.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2275109002 shutdown_connections 2021-11-15T14:42:03.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2275109002 >> 172.21.2.135:0/2275109002 conn(0x7f02c0060840 msgr2=0x7f02c0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2275109002 shutdown_connections 2021-11-15T14:42:03.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2275109002 wait complete. 2021-11-15T14:42:03.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 Processor -- start 2021-11-15T14:42:03.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- start start 2021-11-15T14:42:03.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02a00049f0 0x7f02c0141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02c013e0d0 0x7f02c013e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01441f0 con 0x7f02c013e0d0 2021-11-15T14:42:03.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0063950 con 0x7f02c0142280 2021-11-15T14:42:03.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0144420 con 0x7f02a00049f0 2021-11-15T14:42:03.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33570/0 (socket says 172.21.2.135:33570) 2021-11-15T14:42:03.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2043112863 learned_addr learned my addr 172.21.2.135:0/2043112863 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:03.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02a00049f0 msgr2=0x7f02c0141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02a00049f0 0x7f02c0141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02c013e0d0 msgr2=0x7f02c013e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02c013e0d0 0x7f02c013e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 -- 172.21.2.135:0/2043112863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0063bb0 con 0x7f02c0142280 2021-11-15T14:42:03.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c4ed9700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f02c00b00c0 tx=0x7f02b8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b80072c0 con 0x7f02c0142280 2021-11-15T14:42:03.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8007420 con 0x7f02c0142280 2021-11-15T14:42:03.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b8007780 con 0x7f02c0142280 2021-11-15T14:42:03.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c0063e50 con 0x7f02c0142280 2021-11-15T14:42:03.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c013dc60 con 0x7f02c0142280 2021-11-15T14:42:03.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.572+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c013df40 con 0x7f02c0142280 2021-11-15T14:42:03.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f02b8010070 con 0x7f02c0142280 2021-11-15T14:42:03.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bd7fa700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 0x7f02a4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:03.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f02b806cab0 con 0x7f02c0142280 2021-11-15T14:42:03.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bffff700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 0x7f02a4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:03.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bffff700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 0x7f02a4055b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f02b000a000 tx=0x7f02b0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:03.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.576+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02b80439b0 con 0x7f02c0142280 2021-11-15T14:42:03.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.684+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02c00573d0 con 0x7f02c0142280 2021-11-15T14:42:03.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02bd7fa700 1 -- 172.21.2.135:0/2043112863 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f02b8046fd0 con 0x7f02c0142280 2021-11-15T14:42:03.691 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:03.691 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:01.348735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7270":{"gid":7270,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1824406336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1824406336},{"type":"v1","addr":"172.21.2.135:6835","nonce":1824406336}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:03.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 msgr2=0x7f02a4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 0x7f02a4055b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f02b000a000 tx=0x7f02b0008040).stop 2021-11-15T14:42:03.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 msgr2=0x7f02c013ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:03.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f02c00b00c0 tx=0x7f02b8015000).stop 2021-11-15T14:42:03.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 shutdown_connections 2021-11-15T14:42:03.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f02a4053690 0x7f02a4055b50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f02c0142280 0x7f02c013ad40 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:03.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f02c013e0d0 0x7f02c013e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 --2- 172.21.2.135:0/2043112863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f02a00049f0 0x7f02c0141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:03.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 >> 172.21.2.135:0/2043112863 conn(0x7f02c0060840 msgr2=0x7f02c00b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:03.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 shutdown_connections 2021-11-15T14:42:03.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:03.688+0000 7f02c693c700 1 -- 172.21.2.135:0/2043112863 wait complete. 2021-11-15T14:42:03.695 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 54 2021-11-15T14:42:04.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:00.342899+0000', 'modified': '2021-11-15T14:42:01.348735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7270': {'gid': 7270, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/1824406336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 1824406336}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 1824406336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:04.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:04.001 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:04.069 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7270,"want_state":"up:active","state":"up:active","rank_uptime":3.714653824,"mdsmap_epoch":54,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":8.0513467890000001} 2021-11-15T14:42:04.069 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7270, "mdsmap_epoch": 54, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 3.714653824, "state": "up:active", "uptime": 8.051346789, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:04.070 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:42:04.070 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:42:04.071 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:42:04.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.072 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:04.086 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:42:04.142 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:04.144 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:04.153 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:04.154 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:04.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.156 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:42:04.165 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:42:04.166 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:04.210 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:42:04.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:04.225 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:04.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14940]: starting ceph client 2021-11-15T14:42:04.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:42:04.254+0000 7fe1019e8080 -1 init, newargv = 0x559967935f30 newargc=9 2021-11-15T14:42:04.256 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:04.257 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:04.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.259 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:42:04.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14940]: starting fuse 2021-11-15T14:42:04.311 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:42:04.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:42:04.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.312 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:42:04.313 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:42:04.313 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:42:04.314 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:42:04.314 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:42:04.314 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:04.315 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:42:04.315 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:42:04.316 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:42:04.316 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:04.317 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:42:04.317 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:42:04.317 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:42:04.318 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:42:04.318 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:04.319 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:42:04.319 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:42:04.320 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:42:04.320 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:42:04.320 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:42:04.321 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:04.321 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:42:04.322 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:42:04.359 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.14940.asok 2021-11-15T14:42:04.361 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14940.asok 2021-11-15T14:42:04.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.363 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14940.asok status 2021-11-15T14:42:04.412 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:42:04.412 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:42:04.412 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:42:04.412 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:42:04.413 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:42:04.413 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:42:04.413 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:42:04.413 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14940", 2021-11-15T14:42:04.414 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:42:04.414 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:04.414 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:42:04.414 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:42:04.415 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5091, 2021-11-15T14:42:04.415 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:42:04.415 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:42:04.415 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:42:04.416 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5091 2021-11-15T14:42:04.416 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:04.416 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:42:04.416 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:42:04.417 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:42:04.417 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1966619531 2021-11-15T14:42:04.417 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:42:04.418 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:04.418 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:42:04.418 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:42:04.418 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:42:04.419 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1966619531 2021-11-15T14:42:04.419 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:04.419 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5091 172.21.2.138:0/1966619531", 2021-11-15T14:42:04.419 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1966619531", 2021-11-15T14:42:04.419 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:42:04.420 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 54, 2021-11-15T14:42:04.420 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 113, 2021-11-15T14:42:04.420 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:42:04.420 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:42:04.421 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:42:04.421 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:42:04.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.422 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:04.423 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:04.428 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:42:04.429 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:04.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:04.430 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:04.438 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:04.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 Processor -- start 2021-11-15T14:42:04.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- start start 2021-11-15T14:42:04.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd2e80b0520 0x7fd2e80addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80b2b70 con 0x7fd2e80b0900 2021-11-15T14:42:04.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80b27f0 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e80b2da0 con 0x7fd2e80b0520 2021-11-15T14:42:04.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ed4f0700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd2e80aa1a0 0x7fd2e80ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49396/0 (socket says 172.21.2.135:49396) 2021-11-15T14:42:04.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ed4f0700 1 -- 172.21.2.135:0/3944988007 learned_addr learned my addr 172.21.2.135:0/3944988007 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:04.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000161961 0 0) 0x7fd2e80b27f0 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d0003260 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2edcf1700 1 --2- 172.21.2.135:0/3944988007 >> v2:172.21.2.119:3300/0 conn(0x7fd2e80b0520 0x7fd2e80addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694527467 0 0) 0x7fd2d0003260 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 >> v2:172.21.2.119:3300/0 conn(0x7fd2e80b0520 msgr2=0x7fd2e80addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 --2- 172.21.2.135:0/3944988007 >> v2:172.21.2.119:3300/0 conn(0x7fd2e80b0520 0x7fd2e80addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 >> v1:172.21.2.119:6789/0 conn(0x7fd2e80b0900 legacy=0x7fd2e8140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80a9bf0 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd2d8001660 con 0x7fd2e80aa1a0 2021-11-15T14:42:04.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 >> v1:172.21.2.135:6789/0 conn(0x7fd2e80aa1a0 legacy=0x7fd2e80ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2d0003820 0x7fd2d0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2d0004500 0x7fd2d0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2d000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b2da0 con 0x7fd2d0003820 2021-11-15T14:42:04.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d000be50 con 0x7fd2d0004f70 2021-11-15T14:42:04.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d000c010 con 0x7fd2d0004500 2021-11-15T14:42:04.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2d000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2edcf1700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2d0003820 0x7fd2d0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ed4f0700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2d0004500 0x7fd2d0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 -- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2d0004500 msgr2=0x7fd2d0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2d0004500 0x7fd2d0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 -- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2d0003820 msgr2=0x7fd2d0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2d0003820 0x7fd2d0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 -- 172.21.2.135:0/3944988007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0003260 con 0x7fd2d0004f70 2021-11-15T14:42:04.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ed4f0700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2d0004500 0x7fd2d0004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:04.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 -- 172.21.2.135:0/3944988007 reap_dead start 2021-11-15T14:42:04.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2ee4f2700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2d000b750 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fd2e0002320 tx=0x7fd2e0007d80).ready entity=mon.1 client_cookie=7ac0ab5e13646954 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e0002530 con 0x7fd2d0004f70 2021-11-15T14:42:04.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0006890 con 0x7fd2d0004f70 2021-11-15T14:42:04.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eccef700 1 -- 172.21.2.135:0/3944988007 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e0006bf0 con 0x7fd2d0004f70 2021-11-15T14:42:04.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 msgr2=0x7fd2d000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2d000b750 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fd2e0002320 tx=0x7fd2e0007d80).stop 2021-11-15T14:42:04.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- 172.21.2.135:0/3944988007 shutdown_connections 2021-11-15T14:42:04.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 --2- 172.21.2.135:0/3944988007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2d000b750 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- 172.21.2.135:0/3944988007 >> 172.21.2.135:0/3944988007 conn(0x7fd2e8060840 msgr2=0x7fd2e8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- 172.21.2.135:0/3944988007 shutdown_connections 2021-11-15T14:42:04.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.496+0000 7fd2eff55700 1 -- 172.21.2.135:0/3944988007 wait complete. 2021-11-15T14:42:04.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 Processor -- start 2021-11-15T14:42:04.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- start start 2021-11-15T14:42:04.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2e813fc20 0x7fd2e813d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2e813dd00 0x7fd2e813aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8066920 con 0x7fd2e813fc20 2021-11-15T14:42:04.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80671c0 con 0x7fd2d0004f70 2021-11-15T14:42:04.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8067760 con 0x7fd2e813dd00 2021-11-15T14:42:04.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33588/0 (socket says 172.21.2.135:33588) 2021-11-15T14:42:04.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 -- 172.21.2.135:0/1660259243 learned_addr learned my addr 172.21.2.135:0/1660259243 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:04.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 -- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2e813dd00 msgr2=0x7fd2e813aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2e813dd00 0x7fd2e813aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 -- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2e813fc20 msgr2=0x7fd2e813d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2e813fc20 0x7fd2e813d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 -- 172.21.2.135:0/1660259243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8065c40 con 0x7fd2d0004f70 2021-11-15T14:42:04.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2edcf1700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fd2e80646b0 tx=0x7fd2e4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e40135f0 con 0x7fd2d0004f70 2021-11-15T14:42:04.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e4000e90 con 0x7fd2d0004f70 2021-11-15T14:42:04.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80673f0 con 0x7fd2d0004f70 2021-11-15T14:42:04.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e4013940 con 0x7fd2d0004f70 2021-11-15T14:42:04.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8063e60 con 0x7fd2d0004f70 2021-11-15T14:42:04.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8152750 con 0x7fd2d0004f70 2021-11-15T14:42:04.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd2e4013aa0 con 0x7fd2d0004f70 2021-11-15T14:42:04.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 0x7fd2c8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd2e406b990 con 0x7fd2d0004f70 2021-11-15T14:42:04.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.500+0000 7fd2ed4f0700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 0x7fd2c8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.504+0000 7fd2ed4f0700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 0x7fd2c8055b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fd2d8008000 tx=0x7fd2d8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.504+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2e40429a0 con 0x7fd2d0004f70 2021-11-15T14:42:04.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.584+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e80573d0 con 0x7fd2d0004f70 2021-11-15T14:42:04.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2d6ffd700 1 -- 172.21.2.135:0/1660259243 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fd2e4017020 con 0x7fd2d0004f70 2021-11-15T14:42:04.591 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:04.591 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":113,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:01.347236+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:41:58.191691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-15T14:41:59.338547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:04.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 msgr2=0x7fd2c8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 0x7fd2c8055b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fd2d8008000 tx=0x7fd2d8009040).stop 2021-11-15T14:42:04.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 msgr2=0x7fd2e80ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fd2e80646b0 tx=0x7fd2e4008040).stop 2021-11-15T14:42:04.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 shutdown_connections 2021-11-15T14:42:04.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd2c8053640 0x7fd2c8055b00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2e813dd00 0x7fd2e813aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2e813fc20 0x7fd2e813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 --2- 172.21.2.135:0/1660259243 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2d0004f70 0x7fd2e80ae3e0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 >> 172.21.2.135:0/1660259243 conn(0x7fd2e8060840 msgr2=0x7fd2e80aa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 shutdown_connections 2021-11-15T14:42:04.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.588+0000 7fd2eff55700 1 -- 172.21.2.135:0/1660259243 wait complete. 2021-11-15T14:42:04.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:41:58.191691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:41:59.338547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:42:04.599 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:04.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 Processor -- start 2021-11-15T14:42:04.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 -- start start 2021-11-15T14:42:04.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 0x7f2eb81402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2eb80b4710 0x7f2eb80b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb8143be0 con 0x7f2eb80b4200 2021-11-15T14:42:04.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8147590 con 0x7f2eb80b4710 2021-11-15T14:42:04.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebe41f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8143e80 con 0x7f2eb81469d0 2021-11-15T14:42:04.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2eb80b4200 0x7f2eb81407a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49416/0 (socket says 172.21.2.135:49416) 2021-11-15T14:42:04.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 -- 172.21.2.135:0/3882011648 learned_addr learned my addr 172.21.2.135:0/3882011648 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:04.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926159585 0 0) 0x7f2eb8143be0 con 0x7f2eb80b4200 2021-11-15T14:42:04.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e98003260 con 0x7f2eb80b4200 2021-11-15T14:42:04.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb7fff700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 0x7f2eb81402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2ebc9bc700 1 --2- 172.21.2.135:0/3882011648 >> v2:172.21.2.119:3300/0 conn(0x7f2eb80b4710 0x7f2eb80b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1271565443 0 0) 0x7f2e98003260 con 0x7f2eb80b4200 2021-11-15T14:42:04.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 msgr2=0x7f2eb81402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 0x7f2eb81402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 >> v2:172.21.2.119:3300/0 conn(0x7f2eb80b4710 msgr2=0x7f2eb80b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 --2- 172.21.2.135:0/3882011648 >> v2:172.21.2.119:3300/0 conn(0x7f2eb80b4710 0x7f2eb80b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80b0d10 con 0x7f2eb80b4200 2021-11-15T14:42:04.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f2ea0001660 con 0x7f2eb80b4200 2021-11-15T14:42:04.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 >> v1:172.21.2.135:6789/0 conn(0x7f2eb80b4200 legacy=0x7f2eb81407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e980037d0 0x7f2e98003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e98004500 0x7f2e98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 0x7f2e98004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8147590 con 0x7f2e980037d0 2021-11-15T14:42:04.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8143e80 con 0x7f2e98004500 2021-11-15T14:42:04.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9800b8d0 con 0x7f2eb81469d0 2021-11-15T14:42:04.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e98004500 0x7f2e98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 -- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 msgr2=0x7f2e98004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb81469d0 0x7f2e98004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 -- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e980037d0 msgr2=0x7f2e98003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e980037d0 0x7f2e98003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.648+0000 7f2eb77fe700 1 -- 172.21.2.135:0/3882011648 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98003260 con 0x7f2e98004500 2021-11-15T14:42:04.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb77fe700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e98004500 0x7f2e98004980 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f2ea0001370 tx=0x7f2eb81430c0).ready entity=mon.1 client_cookie=2663e52c37266d65 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea00070d0 con 0x7f2e98004500 2021-11-15T14:42:04.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0007230 con 0x7f2e98004500 2021-11-15T14:42:04.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb6ffd700 1 -- 172.21.2.135:0/3882011648 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea000c8f0 con 0x7f2e98004500 2021-11-15T14:42:04.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3882011648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e98004500 msgr2=0x7f2e98004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3882011648 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e98004500 0x7f2e98004980 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f2ea0001370 tx=0x7f2eb81430c0).stop 2021-11-15T14:42:04.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 -- 172.21.2.135:0/3882011648 reap_dead start 2021-11-15T14:42:04.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3882011648 shutdown_connections 2021-11-15T14:42:04.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3882011648 >> 172.21.2.135:0/3882011648 conn(0x7f2eb805c510 msgr2=0x7f2eb805c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3882011648 shutdown_connections 2021-11-15T14:42:04.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3882011648 wait complete. 2021-11-15T14:42:04.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 Processor -- start 2021-11-15T14:42:04.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- start start 2021-11-15T14:42:04.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e98004500 0x7f2eb8142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8143300 0x7f2eb80af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80b92a0 con 0x7f2e98004500 2021-11-15T14:42:04.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8141a70 con 0x7f2eb8142400 2021-11-15T14:42:04.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80ad7f0 con 0x7f2eb8143300 2021-11-15T14:42:04.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33608/0 (socket says 172.21.2.135:33608) 2021-11-15T14:42:04.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 -- 172.21.2.135:0/3387551581 learned_addr learned my addr 172.21.2.135:0/3387551581 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:04.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 -- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8143300 msgr2=0x7f2eb80af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8143300 0x7f2eb80af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 -- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e98004500 msgr2=0x7f2eb8142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e98004500 0x7f2eb8142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 -- 172.21.2.135:0/3387551581 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80b0560 con 0x7f2eb8142400 2021-11-15T14:42:04.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebc9bc700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f2eb813f050 tx=0x7f2eb0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb000c070 con 0x7f2eb8142400 2021-11-15T14:42:04.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00135e0 con 0x7f2eb8142400 2021-11-15T14:42:04.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb0013940 con 0x7f2eb8142400 2021-11-15T14:42:04.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb8141560 con 0x7f2eb8142400 2021-11-15T14:42:04.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb80af820 con 0x7f2eb8142400 2021-11-15T14:42:04.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8141c30 con 0x7f2eb8142400 2021-11-15T14:42:04.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2eb001b030 con 0x7f2eb8142400 2021-11-15T14:42:04.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 0x7f2e9c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.652+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2eb006af90 con 0x7f2eb8142400 2021-11-15T14:42:04.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.656+0000 7f2eb7fff700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 0x7f2e9c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.656+0000 7f2eb7fff700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 0x7f2e9c055b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f2ea800a000 tx=0x7f2ea8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.656+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2eb0041fa0 con 0x7f2eb8142400 2021-11-15T14:42:04.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2eb80ad9b0 con 0x7f2eb8142400 2021-11-15T14:42:04.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2eb57fa700 1 -- 172.21.2.135:0/3387551581 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2eb00455c0 con 0x7f2eb8142400 2021-11-15T14:42:04.743 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:04.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 msgr2=0x7f2e9c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 0x7f2e9c055b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f2ea800a000 tx=0x7f2ea8008040).stop 2021-11-15T14:42:04.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 msgr2=0x7f2eb813e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f2eb813f050 tx=0x7f2eb0008040).stop 2021-11-15T14:42:04.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 shutdown_connections 2021-11-15T14:42:04.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e9c0536d0 0x7f2e9c055b90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2eb8142400 0x7f2eb813e160 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2eb8143300 0x7f2eb80af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 --2- 172.21.2.135:0/3387551581 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e98004500 0x7f2eb8142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 >> 172.21.2.135:0/3387551581 conn(0x7f2eb805c510 msgr2=0x7f2eb80b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 shutdown_connections 2021-11-15T14:42:04.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.740+0000 7f2ebe41f700 1 -- 172.21.2.135:0/3387551581 wait complete. 2021-11-15T14:42:04.750 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:04.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 Processor -- start 2021-11-15T14:42:04.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- start start 2021-11-15T14:42:04.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc0b04a0 con 0x7fa9cc0a7140 2021-11-15T14:42:04.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0b2810 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0b06d0 con 0x7fa9cc0b0030 2021-11-15T14:42:04.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33618/0 (socket says 172.21.2.135:33618) 2021-11-15T14:42:04.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 -- 172.21.2.135:0/2192276353 learned_addr learned my addr 172.21.2.135:0/2192276353 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:04.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 -- 172.21.2.135:0/2192276353 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 msgr2=0x7fa9cc0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 --2- 172.21.2.135:0/2192276353 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 -- 172.21.2.135:0/2192276353 >> v1:172.21.2.119:6789/0 conn(0x7fa9cc0a7140 legacy=0x7fa9cc1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:04.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 -- 172.21.2.135:0/2192276353 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0b0970 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d15d2700 1 --2- 172.21.2.135:0/2192276353 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa9cc06a170 tx=0x7fa9c8006eb0).ready entity=mon.1 client_cookie=c014b5f59f1c8efb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9bbfff700 1 -- 172.21.2.135:0/2192276353 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c800d570 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9bbfff700 1 -- 172.21.2.135:0/2192276353 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8000e90 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9bbfff700 1 -- 172.21.2.135:0/2192276353 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c800d8c0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- 172.21.2.135:0/2192276353 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 msgr2=0x7fa9cc0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- 172.21.2.135:0/2192276353 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa9cc06a170 tx=0x7fa9c8006eb0).stop 2021-11-15T14:42:04.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- 172.21.2.135:0/2192276353 shutdown_connections 2021-11-15T14:42:04.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- 172.21.2.135:0/2192276353 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- 172.21.2.135:0/2192276353 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc0b1350 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- 172.21.2.135:0/2192276353 >> 172.21.2.135:0/2192276353 conn(0x7fa9cc05f730 msgr2=0x7fa9cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- 172.21.2.135:0/2192276353 shutdown_connections 2021-11-15T14:42:04.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- 172.21.2.135:0/2192276353 wait complete. 2021-11-15T14:42:04.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 Processor -- start 2021-11-15T14:42:04.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- start start 2021-11-15T14:42:04.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9cc0a7140 0x7fa9cc0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0a9970 con 0x7fa9cc0a7140 2021-11-15T14:42:04.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0b3290 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d3836700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0a94a0 con 0x7fa9cc0b0030 2021-11-15T14:42:04.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d1dd3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d1dd3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33622/0 (socket says 172.21.2.135:33622) 2021-11-15T14:42:04.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.840+0000 7fa9d1dd3700 1 -- 172.21.2.135:0/3226518666 learned_addr learned my addr 172.21.2.135:0/3226518666 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:04.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 -- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 msgr2=0x7fa9cc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 -- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9cc0a7140 msgr2=0x7fa9cc0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9cc0a7140 0x7fa9cc0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 -- 172.21.2.135:0/3226518666 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c800b1e0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d1dd3700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa9cc140570 tx=0x7fa9c40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c4001500 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4001660 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc0a96d0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc0b3930 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c40019c0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc0b0c10 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9c4018030 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 0x7fa9ac055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:04.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa9c406b520 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d15d2700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 0x7fa9ac055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:04.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.844+0000 7fa9d15d2700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 0x7fa9ac055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa9cc06a170 tx=0x7fa9c8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:04.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.848+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9c40424d0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.928+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9cc0573d0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.928+0000 7fa9ba7fc700 1 -- 172.21.2.135:0/3226518666 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9c4045af0 con 0x7fa9cc0b1f40 2021-11-15T14:42:04.934 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:04.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 msgr2=0x7fa9ac055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 0x7fa9ac055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa9cc06a170 tx=0x7fa9c8015000).stop 2021-11-15T14:42:04.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 msgr2=0x7fa9cc156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:04.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa9cc140570 tx=0x7fa9c40091a0).stop 2021-11-15T14:42:04.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 shutdown_connections 2021-11-15T14:42:04.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa9ac053660 0x7fa9ac055b20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa9cc0b1f40 0x7fa9cc156cf0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:04.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa9cc0b0030 0x7fa9cc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 --2- 172.21.2.135:0/3226518666 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa9cc0a7140 0x7fa9cc0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:04.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 >> 172.21.2.135:0/3226518666 conn(0x7fa9cc05f730 msgr2=0x7fa9cc1410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:04.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 shutdown_connections 2021-11-15T14:42:04.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.932+0000 7fa9d3836700 1 -- 172.21.2.135:0/3226518666 wait complete. 2021-11-15T14:42:04.941 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:42:04.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.992+0000 7fd2a7cbd700 1 Processor -- start 2021-11-15T14:42:04.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.992+0000 7fd2a7cbd700 1 -- start start 2021-11-15T14:42:05.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd2a00b1470 0x7fd2a00b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a0147340 0x7fd2a0143630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a00ae6d0 con 0x7fd2a00b1de0 2021-11-15T14:42:05.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00b1850 con 0x7fd2a00b1470 2021-11-15T14:42:05.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00b2360 con 0x7fd2a0147340 2021-11-15T14:42:05.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd2a00b1470 0x7fd2a00b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd2a00b1470 0x7fd2a00b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33628/0 (socket says 172.21.2.135:33628) 2021-11-15T14:42:05.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 -- 172.21.2.135:0/1756899993 learned_addr learned my addr 172.21.2.135:0/1756899993 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:05.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 -- 172.21.2.135:0/1756899993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a0147340 msgr2=0x7fd2a0143630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:05.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 --2- 172.21.2.135:0/1756899993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a0147340 0x7fd2a0143630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 -- 172.21.2.135:0/1756899993 >> v1:172.21.2.119:6789/0 conn(0x7fd2a00b1de0 legacy=0x7fd2a0146c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:05.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 -- 172.21.2.135:0/1756899993 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00b2600 con 0x7fd2a00b1470 2021-11-15T14:42:05.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a5a59700 1 --2- 172.21.2.135:0/1756899993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a00b1470 0x7fd2a00b3100 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd2a0146b10 tx=0x7fd290006eb0).ready entity=mon.1 client_cookie=9e17ebd5f09b1b91 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a4a57700 1 -- 172.21.2.135:0/1756899993 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29000d570 con 0x7fd2a00b1470 2021-11-15T14:42:05.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a4a57700 1 -- 172.21.2.135:0/1756899993 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290000e90 con 0x7fd2a00b1470 2021-11-15T14:42:05.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a4a57700 1 -- 172.21.2.135:0/1756899993 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29000d8c0 con 0x7fd2a00b1470 2021-11-15T14:42:05.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1756899993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a00b1470 msgr2=0x7fd2a00b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1756899993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a00b1470 0x7fd2a00b3100 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fd2a0146b10 tx=0x7fd290006eb0).stop 2021-11-15T14:42:05.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1756899993 shutdown_connections 2021-11-15T14:42:05.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1756899993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a0147340 0x7fd2a0143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1756899993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a00b1470 0x7fd2a00b3100 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1756899993 >> 172.21.2.135:0/1756899993 conn(0x7fd2a0060840 msgr2=0x7fd2a0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1756899993 shutdown_connections 2021-11-15T14:42:05.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1756899993 wait complete. 2021-11-15T14:42:05.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 Processor -- start 2021-11-15T14:42:05.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- start start 2021-11-15T14:42:05.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a00b1470 0x7fd2a0148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2a00b1de0 0x7fd2a0156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00ad270 con 0x7fd2a00b1de0 2021-11-15T14:42:05.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00ad4a0 con 0x7fd2a0147340 2021-11-15T14:42:05.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0155d60 con 0x7fd2a00b1470 2021-11-15T14:42:05.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33636/0 (socket says 172.21.2.135:33636) 2021-11-15T14:42:05.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 -- 172.21.2.135:0/1640690355 learned_addr learned my addr 172.21.2.135:0/1640690355 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:05.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 -- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a00b1470 msgr2=0x7fd2a0148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a00b1470 0x7fd2a0148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 -- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2a00b1de0 msgr2=0x7fd2a0156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2a00b1de0 0x7fd2a0156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 -- 172.21.2.135:0/1640690355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29000b1e0 con 0x7fd2a0147340 2021-11-15T14:42:05.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a625a700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd29c000ed0 tx=0x7fd29c006cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c012410 con 0x7fd2a0147340 2021-11-15T14:42:05.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c012570 con 0x7fd2a0147340 2021-11-15T14:42:05.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0156000 con 0x7fd2a0147340 2021-11-15T14:42:05.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c0128d0 con 0x7fd2a0147340 2021-11-15T14:42:05.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:04.996+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00ac790 con 0x7fd2a0147340 2021-11-15T14:42:05.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a01564a0 con 0x7fd2a0147340 2021-11-15T14:42:05.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd29c00f030 con 0x7fd2a0147340 2021-11-15T14:42:05.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd28effd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 0x7fd280055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd29c06b770 con 0x7fd2a0147340 2021-11-15T14:42:05.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd2a5a59700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 0x7fd280055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd2a5a59700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 0x7fd280055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd2a0146b10 tx=0x7fd290015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.000+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd2a01564a0 con 0x7fd2a0147340 2021-11-15T14:42:05.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2a01564a0 con 0x7fd2a0147340 2021-11-15T14:42:05.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd28effd700 1 -- 172.21.2.135:0/1640690355 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd2a01564a0 con 0x7fd2a0147340 2021-11-15T14:42:05.089 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:05.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 msgr2=0x7fd280055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 0x7fd280055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd2a0146b10 tx=0x7fd290015000).stop 2021-11-15T14:42:05.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 msgr2=0x7fd2a0152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.084+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd29c000ed0 tx=0x7fd29c006cf0).stop 2021-11-15T14:42:05.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 shutdown_connections 2021-11-15T14:42:05.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd280053610 0x7fd280055ad0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd2a0147340 0x7fd2a0152810 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd2a00b1de0 0x7fd2a0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 --2- 172.21.2.135:0/1640690355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd2a00b1470 0x7fd2a0148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 >> 172.21.2.135:0/1640690355 conn(0x7fd2a0060840 msgr2=0x7fd2a0147db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 shutdown_connections 2021-11-15T14:42:05.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.088+0000 7fd2a7cbd700 1 -- 172.21.2.135:0/1640690355 wait complete. 2021-11-15T14:42:05.096 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:42:05.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 Processor -- start 2021-11-15T14:42:05.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 -- start start 2021-11-15T14:42:05.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40b1f40 0x7f8ae40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8ae40b0030 0x7f8ae40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40b2810 con 0x7f8ae40a7140 2021-11-15T14:42:05.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40b0470 con 0x7f8ae40b0030 2021-11-15T14:42:05.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8aebb10700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b06d0 con 0x7f8ae40b1f40 2021-11-15T14:42:05.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8ae40b0030 0x7f8ae40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8ae40b0030 0x7f8ae40b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33644/0 (socket says 172.21.2.135:33644) 2021-11-15T14:42:05.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 -- 172.21.2.135:0/3326220426 learned_addr learned my addr 172.21.2.135:0/3326220426 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:05.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 -- 172.21.2.135:0/3326220426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40b1f40 msgr2=0x7f8ae40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 --2- 172.21.2.135:0/3326220426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40b1f40 0x7f8ae40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 -- 172.21.2.135:0/3326220426 >> v1:172.21.2.119:6789/0 conn(0x7f8ae40a7140 legacy=0x7f8ae41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 -- 172.21.2.135:0/3326220426 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40b0970 con 0x7f8ae40b0030 2021-11-15T14:42:05.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae90ab700 1 --2- 172.21.2.135:0/3326220426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae40b2320 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f8ae406a170 tx=0x7f8ae0006eb0).ready entity=mon.1 client_cookie=3b0c71be6fce1c6f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae88aa700 1 -- 172.21.2.135:0/3326220426 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae000d570 con 0x7f8ae40b0030 2021-11-15T14:42:05.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae88aa700 1 -- 172.21.2.135:0/3326220426 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0000e90 con 0x7f8ae40b0030 2021-11-15T14:42:05.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.144+0000 7f8ae88aa700 1 -- 172.21.2.135:0/3326220426 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae000d8c0 con 0x7f8ae40b0030 2021-11-15T14:42:05.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/3326220426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 msgr2=0x7f8ae40b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- 172.21.2.135:0/3326220426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae40b2320 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f8ae406a170 tx=0x7f8ae0006eb0).stop 2021-11-15T14:42:05.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/3326220426 shutdown_connections 2021-11-15T14:42:05.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- 172.21.2.135:0/3326220426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae40b2320 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- 172.21.2.135:0/3326220426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40b1f40 0x7f8ae40b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/3326220426 >> 172.21.2.135:0/3326220426 conn(0x7f8ae405f730 msgr2=0x7f8ae405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/3326220426 shutdown_connections 2021-11-15T14:42:05.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/3326220426 wait complete. 2021-11-15T14:42:05.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 Processor -- start 2021-11-15T14:42:05.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- start start 2021-11-15T14:42:05.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40a7140 0x7f8ae40ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ae40b1f40 0x7f8ae415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4149050 con 0x7f8ae40b1f40 2021-11-15T14:42:05.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41492f0 con 0x7f8ae40b0030 2021-11-15T14:42:05.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae415a460 con 0x7f8ae40a7140 2021-11-15T14:42:05.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33646/0 (socket says 172.21.2.135:33646) 2021-11-15T14:42:05.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 -- 172.21.2.135:0/2673232101 learned_addr learned my addr 172.21.2.135:0/2673232101 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:05.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 -- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40a7140 msgr2=0x7f8ae40ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40a7140 0x7f8ae40ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 -- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ae40b1f40 msgr2=0x7f8ae415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ae40b1f40 0x7f8ae415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 -- 172.21.2.135:0/2673232101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae000b1e0 con 0x7f8ae40b0030 2021-11-15T14:42:05.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae90ab700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f8ae406a170 tx=0x7f8ae0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae0002f70 con 0x7f8ae40b0030 2021-11-15T14:42:05.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000d8f0 con 0x7f8ae40b0030 2021-11-15T14:42:05.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae40aa5d0 con 0x7f8ae40b0030 2021-11-15T14:42:05.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae001e460 con 0x7f8ae40b0030 2021-11-15T14:42:05.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae40aefd0 con 0x7f8ae40b0030 2021-11-15T14:42:05.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40b0c10 con 0x7f8ae40b0030 2021-11-15T14:42:05.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ae0025030 con 0x7f8ae40b0030 2021-11-15T14:42:05.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 0x7f8ac4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8ae006cfa0 con 0x7f8ae40b0030 2021-11-15T14:42:05.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.148+0000 7f8ae98ac700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 0x7f8ac4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.152+0000 7f8ae98ac700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 0x7f8ac4055b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8ad8002f70 tx=0x7f8ad80069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.152+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ae0043ea0 con 0x7f8ae40b0030 2021-11-15T14:42:05.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ae40573d0 con 0x7f8ae40b0030 2021-11-15T14:42:05.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8ad6ffd700 1 -- 172.21.2.135:0/2673232101 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8ae00474c0 con 0x7f8ae40b0030 2021-11-15T14:42:05.240 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:05.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 msgr2=0x7f8ac4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 0x7f8ac4055b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8ad8002f70 tx=0x7f8ad80069e0).stop 2021-11-15T14:42:05.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 msgr2=0x7f8ae415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f8ae406a170 tx=0x7f8ae0015000).stop 2021-11-15T14:42:05.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 shutdown_connections 2021-11-15T14:42:05.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ac40536a0 0x7f8ac4055b60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8ae40b1f40 0x7f8ae415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8ae40b0030 0x7f8ae415a900 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 --2- 172.21.2.135:0/2673232101 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8ae40a7140 0x7f8ae40ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 >> 172.21.2.135:0/2673232101 conn(0x7f8ae405f730 msgr2=0x7f8ae4140840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 shutdown_connections 2021-11-15T14:42:05.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.236+0000 7f8aebb10700 1 -- 172.21.2.135:0/2673232101 wait complete. 2021-11-15T14:42:05.247 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:42:05.248 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:05.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.292+0000 7f303adb8700 1 Processor -- start 2021-11-15T14:42:05.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.292+0000 7f303adb8700 1 -- start start 2021-11-15T14:42:05.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 0x7f30340b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f30340a7140 0x7f30341447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340b03d0 con 0x7f30340b1e30 2021-11-15T14:42:05.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340a9140 con 0x7f30340a7140 2021-11-15T14:42:05.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b0670 con 0x7f3034148420 2021-11-15T14:42:05.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3038b54700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f30340b1e30 0x7f30340b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49474/0 (socket says 172.21.2.135:49474) 2021-11-15T14:42:05.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3038b54700 1 -- 172.21.2.135:0/1736791843 learned_addr learned my addr 172.21.2.135:0/1736791843 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:05.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672698392 0 0) 0x7f30340b03d0 con 0x7f30340b1e30 2021-11-15T14:42:05.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3014003260 con 0x7f30340b1e30 2021-11-15T14:42:05.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910232630 0 0) 0x7f3014003260 con 0x7f30340b1e30 2021-11-15T14:42:05.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 msgr2=0x7f30340b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 0x7f30340b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 >> v2:172.21.2.119:3300/0 conn(0x7f30340a7140 msgr2=0x7f30341447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 --2- 172.21.2.135:0/1736791843 >> v2:172.21.2.119:3300/0 conn(0x7f30340a7140 0x7f30341447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340b0910 con 0x7f30340b1e30 2021-11-15T14:42:05.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f302c001660 con 0x7f30340b1e30 2021-11-15T14:42:05.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 >> v1:172.21.2.135:6789/0 conn(0x7f30340b1e30 legacy=0x7f30340b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 0x7f30140037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3014003ee0 0x7f3014004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f301400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b0670 con 0x7f3014003ee0 2021-11-15T14:42:05.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3014005320 con 0x7f3014004bf0 2021-11-15T14:42:05.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301400bc40 con 0x7f3034148420 2021-11-15T14:42:05.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f301400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 -- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 msgr2=0x7f30140037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148420 0x7f30140037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 -- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3014003ee0 msgr2=0x7f3014004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:05.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3014003ee0 0x7f3014004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 -- 172.21.2.135:0/1736791843 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014003260 con 0x7f3014004bf0 2021-11-15T14:42:05.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f301400b750 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f30240032f0 tx=0x7f3024006f90).ready entity=mon.1 client_cookie=bbd0325a53f5ab80 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400b460 con 0x7f3014004bf0 2021-11-15T14:42:05.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400b5c0 con 0x7f3014004bf0 2021-11-15T14:42:05.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f30337fe700 1 -- 172.21.2.135:0/1736791843 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400b730 con 0x7f3014004bf0 2021-11-15T14:42:05.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- 172.21.2.135:0/1736791843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 msgr2=0x7f301400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- 172.21.2.135:0/1736791843 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f301400b750 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f30240032f0 tx=0x7f3024006f90).stop 2021-11-15T14:42:05.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3039355700 1 -- 172.21.2.135:0/1736791843 reap_dead start 2021-11-15T14:42:05.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- 172.21.2.135:0/1736791843 shutdown_connections 2021-11-15T14:42:05.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- 172.21.2.135:0/1736791843 >> 172.21.2.135:0/1736791843 conn(0x7f303405f730 msgr2=0x7f303405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- 172.21.2.135:0/1736791843 shutdown_connections 2021-11-15T14:42:05.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- 172.21.2.135:0/1736791843 wait complete. 2021-11-15T14:42:05.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 Processor -- start 2021-11-15T14:42:05.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- start start 2021-11-15T14:42:05.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f30340a94c0 0x7f303415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148b80 0x7f303414b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034149000 con 0x7f30340a94c0 2021-11-15T14:42:05.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340aea20 con 0x7f3014004bf0 2021-11-15T14:42:05.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f303adb8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303414ab40 con 0x7f3034148b80 2021-11-15T14:42:05.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3038b54700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3038b54700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33666/0 (socket says 172.21.2.135:33666) 2021-11-15T14:42:05.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.296+0000 7f3038b54700 1 -- 172.21.2.135:0/3445658822 learned_addr learned my addr 172.21.2.135:0/3445658822 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:05.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 -- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148b80 msgr2=0x7f303414b520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:05.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148b80 0x7f303414b520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 -- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f30340a94c0 msgr2=0x7f303415a810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:05.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f30340a94c0 0x7f303415a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 -- 172.21.2.135:0/3445658822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303414ade0 con 0x7f3014004bf0 2021-11-15T14:42:05.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3038b54700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f302c001370 tx=0x7f30340b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c007170 con 0x7f3014004bf0 2021-11-15T14:42:05.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0072d0 con 0x7f3014004bf0 2021-11-15T14:42:05.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303414b080 con 0x7f3014004bf0 2021-11-15T14:42:05.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c004920 con 0x7f3014004bf0 2021-11-15T14:42:05.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034143560 con 0x7f3014004bf0 2021-11-15T14:42:05.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f302c01b070 con 0x7f3014004bf0 2021-11-15T14:42:05.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303414b210 con 0x7f3014004bf0 2021-11-15T14:42:05.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 0x7f3018055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:05.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f302c06b2f0 con 0x7f3014004bf0 2021-11-15T14:42:05.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3033fff700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 0x7f3018055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:05.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.300+0000 7f3033fff700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 0x7f3018055b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f301c002f70 tx=0x7f301c006980).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:05.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.304+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f302c0422a0 con 0x7f3014004bf0 2021-11-15T14:42:05.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.408+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30340573d0 con 0x7f3014004bf0 2021-11-15T14:42:05.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.408+0000 7f3031ffb700 1 -- 172.21.2.135:0/3445658822 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f302c019020 con 0x7f3014004bf0 2021-11-15T14:42:05.414 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:05.414 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:01.348735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7270":{"gid":7270,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1824406336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1824406336},{"type":"v1","addr":"172.21.2.135:6835","nonce":1824406336}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:05.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 msgr2=0x7f3018055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 0x7f3018055b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f301c002f70 tx=0x7f301c006980).stop 2021-11-15T14:42:05.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 msgr2=0x7f30340ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:05.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f302c001370 tx=0x7f30340b0aa0).stop 2021-11-15T14:42:05.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 shutdown_connections 2021-11-15T14:42:05.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f30180536d0 0x7f3018055b90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3034148b80 0x7f303414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f30340a94c0 0x7f303415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:05.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 --2- 172.21.2.135:0/3445658822 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3014004bf0 0x7f30340ae1f0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:05.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 >> 172.21.2.135:0/3445658822 conn(0x7f303405f730 msgr2=0x7f30340b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:05.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 shutdown_connections 2021-11-15T14:42:05.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:05.412+0000 7f303adb8700 1 -- 172.21.2.135:0/3445658822 wait complete. 2021-11-15T14:42:05.418 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 54 2021-11-15T14:42:05.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:00.342899+0000', 'modified': '2021-11-15T14:42:01.348735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7270': {'gid': 7270, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/1824406336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 1824406336}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 1824406336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:05.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:05.725 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:05.790 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7270,"want_state":"up:active","state":"up:active","rank_uptime":5.4362459249999997,"mdsmap_epoch":54,"osdmap_epoch":113,"osdmap_epoch_barrier":113,"uptime":9.7729390649999992} 2021-11-15T14:42:05.791 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7270, "mdsmap_epoch": 54, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "rank_uptime": 5.436245925, "state": "up:active", "uptime": 9.772939065, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:05.792 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:42:05.792 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:42:05.792 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:42:05.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:05.793 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:05.805 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:05.859 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:05.860 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:05.866 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:05.867 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:05.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:05.868 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:05.872 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:42:05.873 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:05.918 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:05.927 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:05.927 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:05.932 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:05.933 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:05.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:05.934 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:05.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:42:05.949+0000 7f15157d9080 -1 init, newargv = 0x558a9a181fd0 newargc=9 2021-11-15T14:42:05.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14446]: starting ceph client 2021-11-15T14:42:05.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14446]: starting fuse 2021-11-15T14:42:07.039 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:07.051 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:07.051 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:07.098 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:07.099 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:07.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.100 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:07.105 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:42:07.105 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:42:07.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.106 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:42:07.107 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:42:07.107 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:42:07.108 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:42:07.108 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:42:07.108 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:07.109 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:42:07.109 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:42:07.110 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:42:07.110 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:07.111 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:42:07.111 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:42:07.111 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:42:07.112 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:42:07.112 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:07.113 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:42:07.113 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:42:07.114 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:42:07.114 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:42:07.114 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:42:07.115 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:07.115 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:42:07.116 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:42:07.142 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14446.asok 2021-11-15T14:42:07.144 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14446.asok 2021-11-15T14:42:07.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.145 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14446.asok status 2021-11-15T14:42:07.251 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:42:07.251 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:42:07.252 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:42:07.252 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:42:07.252 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:42:07.252 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:42:07.252 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:42:07.253 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14446", 2021-11-15T14:42:07.253 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:42:07.253 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:07.253 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:42:07.254 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:42:07.254 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 4907, 2021-11-15T14:42:07.254 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:42:07.254 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:42:07.255 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:42:07.255 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 4907 2021-11-15T14:42:07.255 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:07.255 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:42:07.256 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:42:07.256 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:42:07.256 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 2902206214 2021-11-15T14:42:07.256 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:42:07.256 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:07.257 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:42:07.257 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:42:07.257 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:42:07.258 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 2902206214 2021-11-15T14:42:07.258 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:07.258 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.4907 172.21.2.132:0/2902206214", 2021-11-15T14:42:07.258 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/2902206214", 2021-11-15T14:42:07.258 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:42:07.259 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 54, 2021-11-15T14:42:07.259 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 113, 2021-11-15T14:42:07.259 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:42:07.259 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:42:07.260 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:42:07.260 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:42:07.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.262 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:07.262 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:07.267 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:42:07.268 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:07.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.268 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:07.321 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T14:42:07.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 Processor -- start 2021-11-15T14:42:07.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 -- start start 2021-11-15T14:42:07.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f941c0b1e30 0x7f941c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c148420 0x7f941c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0b03d0 con 0x7f941c0a7140 2021-11-15T14:42:07.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0a9140 con 0x7f941c0b1e30 2021-11-15T14:42:07.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f942309a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0b0670 con 0x7f941c148420 2021-11-15T14:42:07.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9421637700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f941c0a7140 0x7f941c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49494/0 (socket says 172.21.2.135:49494) 2021-11-15T14:42:07.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9421637700 1 -- 172.21.2.135:0/1969446688 learned_addr learned my addr 172.21.2.135:0/1969446688 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:07.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 --2- 172.21.2.135:0/1969446688 >> v2:172.21.2.135:3300/0 conn(0x7f941c0b1e30 0x7f941c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f941b7fe700 1 -- 172.21.2.135:0/1969446688 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155041095 0 0) 0x7f941c0b03d0 con 0x7f941c0a7140 2021-11-15T14:42:07.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f941b7fe700 1 -- 172.21.2.135:0/1969446688 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003260 con 0x7f941c0a7140 2021-11-15T14:42:07.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 -- 172.21.2.135:0/1969446688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c148420 msgr2=0x7f941c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:07.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 --2- 172.21.2.135:0/1969446688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c148420 0x7f941c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:07.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 -- 172.21.2.135:0/1969446688 >> v1:172.21.2.135:6789/0 conn(0x7f941c0a7140 legacy=0x7f941c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 -- 172.21.2.135:0/1969446688 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0b0910 con 0x7f941c0b1e30 2021-11-15T14:42:07.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.372+0000 7f9420e36700 1 --2- 172.21.2.135:0/1969446688 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0b1e30 0x7f941c0b1050 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f940c002f70 tx=0x7f940c006df0).ready entity=mon.1 client_cookie=25adad6fc3f4daad server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f941b7fe700 1 -- 172.21.2.135:0/1969446688 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c00d570 con 0x7f941c0b1e30 2021-11-15T14:42:07.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f941b7fe700 1 -- 172.21.2.135:0/1969446688 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c000e90 con 0x7f941c0b1e30 2021-11-15T14:42:07.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f941b7fe700 1 -- 172.21.2.135:0/1969446688 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c00d8c0 con 0x7f941c0b1e30 2021-11-15T14:42:07.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/1969446688 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0b1e30 msgr2=0x7f941c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- 172.21.2.135:0/1969446688 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0b1e30 0x7f941c0b1050 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f940c002f70 tx=0x7f940c006df0).stop 2021-11-15T14:42:07.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/1969446688 shutdown_connections 2021-11-15T14:42:07.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- 172.21.2.135:0/1969446688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c148420 0x7f941c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:07.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- 172.21.2.135:0/1969446688 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0b1e30 0x7f941c0b1050 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/1969446688 >> 172.21.2.135:0/1969446688 conn(0x7f941c05f730 msgr2=0x7f941c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:07.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/1969446688 shutdown_connections 2021-11-15T14:42:07.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/1969446688 wait complete. 2021-11-15T14:42:07.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 Processor -- start 2021-11-15T14:42:07.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- start start 2021-11-15T14:42:07.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c0b1e30 0x7f941c140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f941c148420 0x7f941c140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15a900 con 0x7f941c148420 2021-11-15T14:42:07.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c148d40 con 0x7f941c0a7140 2021-11-15T14:42:07.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15ab30 con 0x7f941c0b1e30 2021-11-15T14:42:07.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33682/0 (socket says 172.21.2.135:33682) 2021-11-15T14:42:07.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 -- 172.21.2.135:0/3695755869 learned_addr learned my addr 172.21.2.135:0/3695755869 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:07.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9421637700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f941c148420 0x7f941c140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 -- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c0b1e30 msgr2=0x7f941c140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c0b1e30 0x7f941c140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:07.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 -- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f941c148420 msgr2=0x7f941c140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f941c148420 0x7f941c140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 -- 172.21.2.135:0/3695755869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c00b180 con 0x7f941c0a7140 2021-11-15T14:42:07.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9420e36700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f940c002f70 tx=0x7f940c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c016070 con 0x7f941c0a7140 2021-11-15T14:42:07.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c013780 con 0x7f941c0a7140 2021-11-15T14:42:07.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c148fe0 con 0x7f941c0a7140 2021-11-15T14:42:07.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c142ef0 con 0x7f941c0a7140 2021-11-15T14:42:07.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c013ae0 con 0x7f941c0a7140 2021-11-15T14:42:07.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.376+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c15acf0 con 0x7f941c0a7140 2021-11-15T14:42:07.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f940c025030 con 0x7f941c0a7140 2021-11-15T14:42:07.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f9419ffb700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 0x7f9400055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f940c06cb40 con 0x7f941c0a7140 2021-11-15T14:42:07.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f941bfff700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 0x7f9400055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f941bfff700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 0x7f9400055a00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9404002f70 tx=0x7f94040069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.380+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f940c043a40 con 0x7f941c0a7140 2021-11-15T14:42:07.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.488+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f941c0b0bb0 con 0x7f941c0a7140 2021-11-15T14:42:07.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f9419ffb700 1 -- 172.21.2.135:0/3695755869 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7f940c023090 con 0x7f941c0a7140 2021-11-15T14:42:07.494 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:07.495 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:07.495 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:07.495 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:07.495 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764492783616, 2021-11-15T14:42:07.496 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 11395072, 2021-11-15T14:42:07.496 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8601329664, 2021-11-15T14:42:07.496 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011125850491225719, 2021-11-15T14:42:07.496 INFO:teuthology.orchestra.run.gibba035.stdout: "num_osds": 8, 2021-11-15T14:42:07.497 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_osds": 8, 2021-11-15T14:42:07.497 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_omap_osds": 8 2021-11-15T14:42:07.497 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:07.497 INFO:teuthology.orchestra.run.gibba035.stdout: "stats_by_class": { 2021-11-15T14:42:07.497 INFO:teuthology.orchestra.run.gibba035.stdout: "ssd": { 2021-11-15T14:42:07.498 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:07.498 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764492783616, 2021-11-15T14:42:07.498 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 11395072, 2021-11-15T14:42:07.498 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8601329664, 2021-11-15T14:42:07.499 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011125850491225719 2021-11-15T14:42:07.499 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:07.499 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:07.500 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:07.500 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "device_health_metrics", 2021-11-15T14:42:07.500 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 1, 2021-11-15T14:42:07.500 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:07.500 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:07.501 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 2, 2021-11-15T14:42:07.501 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:07.501 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:07.501 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:07.502 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918969344 2021-11-15T14:42:07.502 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:07.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:07.503 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "rbd", 2021-11-15T14:42:07.503 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 2, 2021-11-15T14:42:07.503 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:07.503 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:07.503 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:07.504 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:07.504 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:07.504 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:07.504 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918969344 2021-11-15T14:42:07.505 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:07.505 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:07.505 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "cephfs_metadata", 2021-11-15T14:42:07.505 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 19, 2021-11-15T14:42:07.506 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:07.506 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 2740, 2021-11-15T14:42:07.506 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 21, 2021-11-15T14:42:07.506 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 64, 2021-11-15T14:42:07.507 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 65536, 2021-11-15T14:42:07.507 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 9.0290122045644239e-08, 2021-11-15T14:42:07.507 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918969344 2021-11-15T14:42:07.507 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:07.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:07.508 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "cephfs_data", 2021-11-15T14:42:07.508 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 20, 2021-11-15T14:42:07.508 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:07.509 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:07.509 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:07.509 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:07.509 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:07.510 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:07.510 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918969344 2021-11-15T14:42:07.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:07.511 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:07.511 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:07.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 msgr2=0x7f9400055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 0x7f9400055a00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9404002f70 tx=0x7f94040069e0).stop 2021-11-15T14:42:07.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 msgr2=0x7f941c0b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f940c002f70 tx=0x7f940c014000).stop 2021-11-15T14:42:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 shutdown_connections 2021-11-15T14:42:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9400053540 0x7f9400055a00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f941c148420 0x7f941c140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f941c0b1e30 0x7f941c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:07.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 --2- 172.21.2.135:0/3695755869 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f941c0a7140 0x7f941c0b4380 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 >> 172.21.2.135:0/3695755869 conn(0x7f941c05f730 msgr2=0x7f941c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:07.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 shutdown_connections 2021-11-15T14:42:07.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.492+0000 7f942309a700 1 -- 172.21.2.135:0/3695755869 wait complete. 2021-11-15T14:42:07.516 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-11-15T14:42:07.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 Processor -- start 2021-11-15T14:42:07.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 -- start start 2021-11-15T14:42:07.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f58200b1350 0x7f58200b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b2320 0x7f58201412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58200a7850 con 0x7f58200b1f40 2021-11-15T14:42:07.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58200b17c0 con 0x7f58200b1350 2021-11-15T14:42:07.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f5826d81700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200b06d0 con 0x7f58200b2320 2021-11-15T14:42:07.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f581ffff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f58200b1350 0x7f58200b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f582531e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b2320 0x7f58201412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f581ffff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f58200b1350 0x7f58200b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:55736/0 (socket says 172.21.2.135:55736) 2021-11-15T14:42:07.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.564+0000 7f581ffff700 1 -- 172.21.2.135:0/1552000446 learned_addr learned my addr 172.21.2.135:0/1552000446 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:07.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 -- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b2320 msgr2=0x7f58201412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:07.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 --2- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b2320 0x7f58201412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 -- 172.21.2.135:0/1552000446 >> v1:172.21.2.119:6789/0 conn(0x7f58200b1f40 legacy=0x7f58200a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 -- 172.21.2.135:0/1552000446 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200b0970 con 0x7f58200b1350 2021-11-15T14:42:07.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 --2- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b1350 0x7f58200b0030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f5810002f70 tx=0x7f5810006eb0).ready entity=mon.0 client_cookie=9c693b998fed7480 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581f7fe700 1 -- 172.21.2.135:0/1552000446 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581000d570 con 0x7f58200b1350 2021-11-15T14:42:07.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581f7fe700 1 -- 172.21.2.135:0/1552000446 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5810000e90 con 0x7f58200b1350 2021-11-15T14:42:07.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581f7fe700 1 -- 172.21.2.135:0/1552000446 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581000d900 con 0x7f58200b1350 2021-11-15T14:42:07.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b1350 msgr2=0x7f58200b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b1350 0x7f58200b0030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f5810002f70 tx=0x7f5810006eb0).stop 2021-11-15T14:42:07.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- 172.21.2.135:0/1552000446 shutdown_connections 2021-11-15T14:42:07.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b2320 0x7f58201412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- 172.21.2.135:0/1552000446 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b1350 0x7f58200b0030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- 172.21.2.135:0/1552000446 >> 172.21.2.135:0/1552000446 conn(0x7f582005f730 msgr2=0x7f582005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:07.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- 172.21.2.135:0/1552000446 shutdown_connections 2021-11-15T14:42:07.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- 172.21.2.135:0/1552000446 wait complete. 2021-11-15T14:42:07.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 Processor -- start 2021-11-15T14:42:07.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- start start 2021-11-15T14:42:07.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b1f40 0x7f582014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 0x7f582014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200b3b10 con 0x7f58200b2320 2021-11-15T14:42:07.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582014a740 con 0x7f58200b1350 2021-11-15T14:42:07.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5826d81700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582014a2d0 con 0x7f58200b1f40 2021-11-15T14:42:07.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33694/0 (socket says 172.21.2.135:33694) 2021-11-15T14:42:07.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 -- 172.21.2.135:0/2628082070 learned_addr learned my addr 172.21.2.135:0/2628082070 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:07.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f582531e700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 0x7f582014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f581ffff700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b1f40 0x7f582014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 -- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b1f40 msgr2=0x7f582014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b1f40 0x7f582014adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 -- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 msgr2=0x7f582014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 0x7f582014b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f5824b1d700 1 -- 172.21.2.135:0/2628082070 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581000b1e0 con 0x7f58200b1350 2021-11-15T14:42:07.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.568+0000 7f582531e700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 0x7f582014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:07.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f5824b1d700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f5820148c50 tx=0x7f5808007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580800ce20 con 0x7f58200b1350 2021-11-15T14:42:07.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580800f470 con 0x7f58200b1350 2021-11-15T14:42:07.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5820149910 con 0x7f58200b1350 2021-11-15T14:42:07.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200b0040 con 0x7f58200b1350 2021-11-15T14:42:07.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f580800f7d0 con 0x7f58200b1350 2021-11-15T14:42:07.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820149550 con 0x7f58200b1350 2021-11-15T14:42:07.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5808019030 con 0x7f58200b1350 2021-11-15T14:42:07.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 0x7f5804055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:07.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f580806b080 con 0x7f58200b1350 2021-11-15T14:42:07.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581ffff700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 0x7f5804055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:07.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.572+0000 7f581ffff700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 0x7f5804055b20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5810017000 tx=0x7f5810015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:07.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.576+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5808041f80 con 0x7f58200b1350 2021-11-15T14:42:07.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7f58200573d0 con 0x7f58200b1350 2021-11-15T14:42:07.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f581dffb700 1 -- 172.21.2.135:0/2628082070 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v113) v1 ==== 123+0+64 (secure 0 0 0) 0x7f58080455a0 con 0x7f58200b1350 2021-11-15T14:42:07.660 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:07.660 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:07.661 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": "cephfs_data", 2021-11-15T14:42:07.661 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_id": 20, 2021-11-15T14:42:07.661 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2 2021-11-15T14:42:07.661 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:07.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 msgr2=0x7f5804055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 0x7f5804055b20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5810017000 tx=0x7f5810015000).stop 2021-11-15T14:42:07.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 msgr2=0x7f58200b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:07.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f5820148c50 tx=0x7f5808007c50).stop 2021-11-15T14:42:07.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 shutdown_connections 2021-11-15T14:42:07.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5804053660 0x7f5804055b20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58200b2320 0x7f582014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58200b1f40 0x7f582014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 --2- 172.21.2.135:0/2628082070 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58200b1350 0x7f58200b4770 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:07.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 >> 172.21.2.135:0/2628082070 conn(0x7f582005f730 msgr2=0x7f58200aa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:07.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 shutdown_connections 2021-11-15T14:42:07.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:07.656+0000 7f5826d81700 1 -- 172.21.2.135:0/2628082070 wait complete. 2021-11-15T14:42:07.667 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T14:42:07.667 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-11-15T14:42:07.718 INFO:teuthology.orchestra.run.gibba038.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-11-15T14:42:07.719 INFO:teuthology.orchestra.run.gibba038.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:07.719 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:42:07.720 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:07.734 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:07.748 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:07.758 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:07.779 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:42:07.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.780 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:07.780 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:07.791 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:42:07.792 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:07.792 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:42:07.793 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:42:07.793 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:07.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[14940]: fuse finished with error 0 and tester_r 0 2021-11-15T14:42:07.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:07.849 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:07.849 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:07.853 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:42:07.854 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:42:07.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:07.965 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:08.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:08.010 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:08.010 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:08.021 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:42:08.022 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:08.023 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:42:08.023 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:42:08.024 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:08.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14446]: fuse finished with error 0 and tester_r 0 2021-11-15T14:42:08.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:08.079 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:08.079 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:08.084 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:42:08.084 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:42:08.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:08.159 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:08.163 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:42:08.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 Processor -- start 2021-11-15T14:42:08.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- start start 2021-11-15T14:42:08.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1258148420 0x7f12580b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12580a7140 0x7f12581447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580b03d0 con 0x7f12580b1e30 2021-11-15T14:42:08.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12580a9140 con 0x7f12580a7140 2021-11-15T14:42:08.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b0670 con 0x7f1258148420 2021-11-15T14:42:08.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12580a7140 0x7f12581447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12580a7140 0x7f12581447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33706/0 (socket says 172.21.2.135:33706) 2021-11-15T14:42:08.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 -- 172.21.2.135:0/2645280240 learned_addr learned my addr 172.21.2.135:0/2645280240 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:08.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 -- 172.21.2.135:0/2645280240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1258148420 msgr2=0x7f12580b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:08.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 --2- 172.21.2.135:0/2645280240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1258148420 0x7f12580b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 -- 172.21.2.135:0/2645280240 >> v1:172.21.2.119:6789/0 conn(0x7f12580b1e30 legacy=0x7f12580b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:08.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 -- 172.21.2.135:0/2645280240 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580b0910 con 0x7f12580a7140 2021-11-15T14:42:08.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f1256d9d700 1 --2- 172.21.2.135:0/2645280240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580a7140 0x7f12581447a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f1258061420 tx=0x7f1250009290).ready entity=mon.1 client_cookie=1da5a293d4131ad8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125559a700 1 -- 172.21.2.135:0/2645280240 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f125000b860 con 0x7f12580a7140 2021-11-15T14:42:08.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125559a700 1 -- 172.21.2.135:0/2645280240 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000b9c0 con 0x7f12580a7140 2021-11-15T14:42:08.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125559a700 1 -- 172.21.2.135:0/2645280240 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f125000bb70 con 0x7f12580a7140 2021-11-15T14:42:08.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- 172.21.2.135:0/2645280240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580a7140 msgr2=0x7f12581447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 --2- 172.21.2.135:0/2645280240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580a7140 0x7f12581447a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f1258061420 tx=0x7f1250009290).stop 2021-11-15T14:42:08.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- 172.21.2.135:0/2645280240 shutdown_connections 2021-11-15T14:42:08.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 --2- 172.21.2.135:0/2645280240 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580a7140 0x7f12581447a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 --2- 172.21.2.135:0/2645280240 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f1258148420 0x7f12580b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- 172.21.2.135:0/2645280240 >> 172.21.2.135:0/2645280240 conn(0x7f125805f730 msgr2=0x7f125805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:08.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- 172.21.2.135:0/2645280240 shutdown_connections 2021-11-15T14:42:08.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- 172.21.2.135:0/2645280240 wait complete. 2021-11-15T14:42:08.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 Processor -- start 2021-11-15T14:42:08.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.216+0000 7f125c82e700 1 -- start start 2021-11-15T14:42:08.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12580a7140 0x7f125814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1258148420 0x7f12580abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1258149120 con 0x7f1258148420 2021-11-15T14:42:08.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580aad00 con 0x7f12580b1e30 2021-11-15T14:42:08.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1258148be0 con 0x7f12580a7140 2021-11-15T14:42:08.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33708/0 (socket says 172.21.2.135:33708) 2021-11-15T14:42:08.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 -- 172.21.2.135:0/3810793181 learned_addr learned my addr 172.21.2.135:0/3810793181 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:08.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 -- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12580a7140 msgr2=0x7f125814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12580a7140 0x7f125814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 -- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1258148420 msgr2=0x7f12580abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1258148420 0x7f12580abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 -- 172.21.2.135:0/3810793181 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009530 con 0x7f12580b1e30 2021-11-15T14:42:08.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f1255d9b700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1258149cb0 tx=0x7f1240006e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124000e470 con 0x7f12580b1e30 2021-11-15T14:42:08.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124000e5d0 con 0x7f12580b1e30 2021-11-15T14:42:08.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1258148e80 con 0x7f12580b1e30 2021-11-15T14:42:08.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12580ac090 con 0x7f12580b1e30 2021-11-15T14:42:08.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124000e930 con 0x7f12580b1e30 2021-11-15T14:42:08.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12580573d0 con 0x7f12580b1e30 2021-11-15T14:42:08.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1240018030 con 0x7f12580b1e30 2021-11-15T14:42:08.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 0x7f123c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f124006ae70 con 0x7f12580b1e30 2021-11-15T14:42:08.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.220+0000 7f125659c700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 0x7f123c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.224+0000 7f125659c700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 0x7f123c055b00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f1248002f90 tx=0x7f12480069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.224+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1240041f30 con 0x7f12580b1e30 2021-11-15T14:42:08.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.304+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f12580aae50 con 0x7f12580b1e30 2021-11-15T14:42:08.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f124f7fe700 1 -- 172.21.2.135:0/3810793181 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f1240028520 con 0x7f12580b1e30 2021-11-15T14:42:08.311 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:08.311 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:08.311 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 113, 2021-11-15T14:42:08.312 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:42:08.312 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:42:08.312 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:42:01.347236+0000", 2021-11-15T14:42:08.312 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:08.313 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:08.313 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:42:08.313 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:42:08.313 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:42:08.314 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:42:08.314 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:42:08.314 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:42:08.314 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:42:08.315 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:08.315 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:42:08.315 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:42:08.315 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:42:08.316 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:42:08.316 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:42:08.316 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 20, 2021-11-15T14:42:08.316 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:42:08.317 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:42:08.317 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:42:08.317 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:42:08.317 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:08.318 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.318 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:42:08.318 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:42:08.318 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:42:08.318 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:08.319 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:08.319 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:08.319 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:08.319 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:08.320 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:08.320 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:08.320 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:08.320 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:42:08.321 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:42:08.321 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:42:08.321 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:42:08.321 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:42:08.321 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:08.322 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:08.322 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:08.322 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:08.322 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:08.323 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:08.323 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:08.323 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.323 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:42:08.324 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:08.324 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:08.324 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:08.324 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:08.325 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:08.325 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:08.325 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:08.325 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:08.325 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:08.326 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:08.326 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:08.326 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:08.326 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:08.327 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:08.327 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:08.327 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:08.327 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:08.328 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:08.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:08.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:08.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:08.328 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:08.329 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:08.329 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:08.329 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:08.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:08.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.330 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:08.330 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:08.330 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:08.331 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:08.331 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:08.331 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:08.331 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:08.332 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:08.332 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:08.332 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:08.332 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:08.332 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:08.333 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:42:08.333 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.333 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:08.333 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:42:08.334 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.334 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:42:08.335 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:42:08.335 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:42:08.335 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:08.335 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:08.336 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:08.336 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:08.336 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:08.336 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:08.336 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:08.337 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:08.337 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:08.337 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:08.337 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:08.338 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:08.338 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:08.338 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:08.338 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:08.339 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:08.339 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:08.339 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:08.339 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:08.340 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:08.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.340 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:42:08.340 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:08.341 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:08.341 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:08.341 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:08.341 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:08.341 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:08.342 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:08.342 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:08.342 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:08.342 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:08.343 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:08.343 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:08.343 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:08.343 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:08.344 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:08.344 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:08.344 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:08.344 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:08.344 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:08.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:08.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:08.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:08.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:08.346 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:08.346 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:08.346 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:08.347 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.347 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:08.347 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:08.347 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:08.347 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:08.348 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:08.348 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:08.348 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:08.348 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:08.349 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:08.349 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:08.349 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:08.349 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:08.350 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:08.350 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:42:08.350 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.350 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.350 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.351 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 19, 2021-11-15T14:42:08.351 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:42:08.351 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:58.191691+0000", 2021-11-15T14:42:08.351 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:08.352 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:08.352 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:08.352 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:08.352 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:08.353 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:08.353 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:08.353 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:08.353 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:08.354 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:08.354 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:08.354 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:08.355 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:08.355 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:08.355 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:08.355 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:08.356 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:08.356 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:08.356 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:08.356 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:08.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.357 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "112", 2021-11-15T14:42:08.357 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:08.357 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:08.357 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:08.358 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:08.358 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:08.358 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:08.358 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:08.359 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:08.359 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:08.359 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:08.359 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:08.360 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:08.360 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:08.360 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:08.360 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:08.360 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:08.361 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:08.361 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:08.361 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:08.361 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:08.362 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:08.362 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:08.362 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:08.363 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:08.363 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:08.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:08.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.364 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:08.364 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:08.364 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:08.364 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:08.365 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:08.365 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:08.365 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:08.365 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:08.366 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:08.366 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:08.366 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:08.366 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:08.366 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:42:08.367 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:42:08.367 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:42:08.367 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.367 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:08.368 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:42:08.368 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:42:08.368 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.368 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.369 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.369 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.369 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 20, 2021-11-15T14:42:08.369 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:42:08.370 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:41:59.338547+0000", 2021-11-15T14:42:08.370 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:08.370 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:08.370 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:08.370 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:08.371 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:08.371 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:08.371 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:08.372 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:08.372 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:08.372 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:08.372 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:08.373 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:08.373 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:08.373 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:08.373 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:08.374 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:08.374 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:08.374 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:08.374 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:08.375 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:08.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.375 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "113", 2021-11-15T14:42:08.375 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:08.376 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:08.376 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:08.376 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:08.376 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:08.377 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:08.377 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:08.377 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:08.377 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:08.377 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:08.378 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:08.378 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:08.378 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:08.378 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:08.379 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:08.379 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:08.379 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:08.379 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:08.380 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:08.380 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:08.380 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:08.380 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:08.380 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:08.381 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:08.381 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:08.381 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:08.381 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.382 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:08.382 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:08.382 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:08.382 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:08.383 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:08.383 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:08.383 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:08.383 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:08.384 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:08.384 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:08.384 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:08.384 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:08.384 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:08.385 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:42:08.385 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:42:08.385 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.385 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.386 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.386 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:08.386 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:42:08.386 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.387 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:08.387 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:42:08.387 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.387 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.387 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.388 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.388 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.388 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.388 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.389 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.389 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.389 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.389 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.390 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.390 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.390 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.390 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:42:08.391 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.391 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.391 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:42:08.392 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.392 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.392 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.393 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.393 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.393 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.394 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:42:08.394 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.394 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.394 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.395 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:42:08.395 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.395 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.395 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.396 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.396 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.396 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.397 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:42:08.397 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.398 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:42:08.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.398 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.399 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.399 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.399 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.400 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:42:08.400 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.401 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.401 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.401 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:42:08.401 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:08.402 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.402 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.402 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.402 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:42:08.403 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:42:08.403 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:42:08.403 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:42:08.403 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.403 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.404 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.404 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.404 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.405 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:08.405 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:42:08.405 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.405 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.406 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.406 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.406 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.406 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.406 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.407 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 110, 2021-11-15T14:42:08.407 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.407 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.407 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.408 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.408 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.408 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:42:08.409 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.409 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.409 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.409 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.409 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:42:08.410 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.410 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.410 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.410 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.411 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.411 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.411 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.412 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:42:08.412 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.412 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.412 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.412 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.413 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:42:08.413 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.413 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.413 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.414 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.414 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.414 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.415 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:42:08.415 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.415 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.416 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.416 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:42:08.416 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.416 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.417 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.417 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.417 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.418 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.418 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:42:08.418 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.418 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.419 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.419 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.419 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:42:08.419 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:08.420 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.420 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.420 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:42:08.420 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:42:08.421 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:42:08.421 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:42:08.421 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.421 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.422 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.422 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.422 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.423 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:08.423 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:42:08.423 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.423 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.423 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.424 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.424 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.425 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.425 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.425 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.425 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.426 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.426 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.426 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:42:08.426 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.427 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.427 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.427 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.427 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:42:08.428 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.428 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.428 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.429 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.429 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.429 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.429 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:42:08.430 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.430 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.430 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.430 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.431 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:42:08.431 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.431 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.431 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.432 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.432 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.432 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.432 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.433 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:42:08.433 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.433 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.434 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:42:08.434 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.435 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.435 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.436 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.436 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:42:08.436 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.437 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.437 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.437 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:42:08.437 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:08.438 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.438 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.438 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.438 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:42:08.439 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:42:08.439 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:42:08.439 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:42:08.439 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.439 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.440 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.440 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.440 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.441 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:08.441 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:42:08.441 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.441 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.441 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.442 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.442 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.442 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.442 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.443 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.443 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.443 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.443 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.444 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:42:08.444 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.445 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.445 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.445 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.445 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:42:08.446 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.446 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.446 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.446 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.447 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.447 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.447 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.447 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.448 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:42:08.448 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.448 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.448 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.448 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.449 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:42:08.449 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.449 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.449 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.450 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.450 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.450 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.450 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:42:08.451 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.451 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:42:08.452 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.452 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.453 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.453 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.453 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.453 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.454 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:42:08.454 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.454 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.455 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.455 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.455 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:42:08.455 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:08.456 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.456 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.456 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:42:08.457 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:42:08.457 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:42:08.457 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:42:08.457 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.457 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.458 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.459 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:08.459 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:42:08.459 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.459 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.460 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.460 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.460 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.460 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.460 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.461 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 110, 2021-11-15T14:42:08.461 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.461 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.461 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:42:08.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.463 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:42:08.464 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.464 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.465 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.466 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:42:08.466 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.467 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:42:08.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.467 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.467 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.468 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.468 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:42:08.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.470 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:42:08.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.471 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.471 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.472 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.472 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:42:08.472 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.473 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.473 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.473 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:42:08.473 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:08.474 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.474 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.474 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:42:08.475 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:42:08.475 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:42:08.475 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:42:08.475 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.475 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.476 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.476 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.476 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.476 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.477 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:08.477 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:42:08.477 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.477 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.478 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.478 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.478 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.479 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.479 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.479 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.479 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.480 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:42:08.481 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.481 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.481 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:42:08.482 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.482 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.482 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.482 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.483 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.484 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:42:08.484 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.484 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.485 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:42:08.485 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.485 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.485 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.486 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.487 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.487 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:42:08.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.487 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.488 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.488 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:42:08.488 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.488 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.489 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.489 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.489 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.490 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.490 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.490 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:42:08.490 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.491 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.491 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:42:08.491 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:08.492 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.492 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.492 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.492 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:42:08.493 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:42:08.493 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:42:08.493 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:42:08.493 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.494 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.494 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.494 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.494 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.495 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:08.495 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:42:08.495 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.495 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.496 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.496 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.496 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.496 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.497 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.497 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.497 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.497 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.497 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.498 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:42:08.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.499 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:42:08.500 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.500 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.500 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.501 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.501 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:42:08.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.502 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:42:08.503 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.503 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.504 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.504 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.504 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.504 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.505 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.505 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:42:08.505 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.505 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.506 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.506 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.506 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:42:08.506 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.507 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.507 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.507 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.507 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.507 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.508 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.508 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:42:08.508 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.509 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.509 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.509 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:42:08.510 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:08.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.510 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.510 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.510 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:42:08.511 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:42:08.511 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:42:08.511 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:42:08.511 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.512 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.512 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.512 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.513 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.513 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:08.513 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:42:08.513 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:08.513 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:08.514 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:08.514 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:08.514 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:08.514 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:08.515 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:08.515 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:08.515 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:08.515 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:08.516 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:08.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.516 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.516 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:42:08.517 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.517 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.517 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.517 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:42:08.518 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.518 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.518 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.519 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.519 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:08.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.519 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:42:08.520 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.520 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.521 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.521 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:42:08.521 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.521 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.522 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.522 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.522 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:08.522 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.523 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.523 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.523 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:42:08.523 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.523 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.524 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.524 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.524 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:42:08.524 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.525 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.525 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.525 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.525 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:08.525 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:08.526 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.526 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:08.526 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:42:08.526 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.527 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.527 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.527 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:08.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:42:08.528 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:08.528 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.528 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.528 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.528 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:42:08.529 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:42:08.529 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:42:08.529 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:42:08.529 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:08.530 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:08.530 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:08.530 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:08.530 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.531 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:08.531 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:42:08.531 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.531 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:08.532 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.532 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.532 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.532 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.532 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.533 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:42:08.533 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.533 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.533 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.534 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:08.534 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.534 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.534 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.535 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.535 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.535 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:42:08.535 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.535 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.536 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.536 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:08.536 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.536 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.537 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.537 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.537 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.537 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:42:08.537 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.538 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.538 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:08.538 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.539 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.539 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.539 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.539 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.540 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:42:08.540 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.540 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.540 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.540 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:08.541 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.541 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.541 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.541 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.542 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.542 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:42:08.542 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.542 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.543 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.543 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:08.543 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.543 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.543 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.544 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.544 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.544 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:42:08.544 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.545 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.545 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.545 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:08.545 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.546 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.546 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.546 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.546 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.547 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:42:08.547 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.547 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:08.547 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:08.548 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:08.548 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:08.548 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:08.548 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:08.549 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:08.549 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:42:08.549 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:08.549 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.550 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:08.550 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:42:08.550 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:42:08.550 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:42:08.550 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:42:08.551 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:42:08.551 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:42:08.551 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:42:08.551 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:42:08.552 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:08.552 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:42:08.552 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:42:08.552 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:08.552 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:42:08.553 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:08.553 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:08.553 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:42:08.553 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:42:08.554 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.554 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:42:08.554 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:08.554 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:08.555 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:42:08.555 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:08.555 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:08.555 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:42:08.555 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:08.556 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:08.556 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:42:08.556 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:42:08.556 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:42:08.557 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:42:08.557 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:42:08.557 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:08.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 msgr2=0x7f123c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 0x7f123c055b00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f1248002f90 tx=0x7f12480069b0).stop 2021-11-15T14:42:08.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 msgr2=0x7f12580ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f1258149cb0 tx=0x7f1240006e00).stop 2021-11-15T14:42:08.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 shutdown_connections 2021-11-15T14:42:08.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f123c053640 0x7f123c055b00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f1258148420 0x7f12580abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12580b1e30 0x7f12580ab6b0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 --2- 172.21.2.135:0/3810793181 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12580a7140 0x7f125814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 >> 172.21.2.135:0/3810793181 conn(0x7f125805f730 msgr2=0x7f12580b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:08.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 shutdown_connections 2021-11-15T14:42:08.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.308+0000 7f125c82e700 1 -- 172.21.2.135:0/3810793181 wait complete. 2021-11-15T14:42:08.562 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:08.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 Processor -- start 2021-11-15T14:42:08.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- start start 2021-11-15T14:42:08.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd17c0a7140 0x7fd17c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c0b03d0 con 0x7fd17c148420 2021-11-15T14:42:08.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c0a9140 con 0x7fd17c0a7140 2021-11-15T14:42:08.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0b0670 con 0x7fd17c0b1e30 2021-11-15T14:42:08.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd179d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd17c148420 0x7fd17c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49540/0 (socket says 172.21.2.135:49540) 2021-11-15T14:42:08.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd179d9b700 1 -- 172.21.2.135:0/3738069474 learned_addr learned my addr 172.21.2.135:0/3738069474 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:08.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 --2- 172.21.2.135:0/3738069474 >> v2:172.21.2.135:3300/0 conn(0x7fd17c0a7140 0x7fd17c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 -- 172.21.2.135:0/3738069474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 msgr2=0x7fd17c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:08.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 --2- 172.21.2.135:0/3738069474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 -- 172.21.2.135:0/3738069474 >> v1:172.21.2.135:6789/0 conn(0x7fd17c148420 legacy=0x7fd17c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 -- 172.21.2.135:0/3738069474 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0b0910 con 0x7fd17c0a7140 2021-11-15T14:42:08.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17ad9d700 1 --2- 172.21.2.135:0/3738069474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c1447a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fd1740032f0 tx=0x7fd1740091d0).ready entity=mon.1 client_cookie=902705d323450766 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17959a700 1 -- 172.21.2.135:0/3738069474 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd174009ea0 con 0x7fd17c0a7140 2021-11-15T14:42:08.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17959a700 1 -- 172.21.2.135:0/3738069474 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17400b8a0 con 0x7fd17c0a7140 2021-11-15T14:42:08.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd17959a700 1 -- 172.21.2.135:0/3738069474 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17400ba10 con 0x7fd17c0a7140 2021-11-15T14:42:08.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- 172.21.2.135:0/3738069474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 msgr2=0x7fd17c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3738069474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c1447a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fd1740032f0 tx=0x7fd1740091d0).stop 2021-11-15T14:42:08.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- 172.21.2.135:0/3738069474 shutdown_connections 2021-11-15T14:42:08.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3738069474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c1447a0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3738069474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- 172.21.2.135:0/3738069474 >> 172.21.2.135:0/3738069474 conn(0x7fd17c05f730 msgr2=0x7fd17c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:08.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- 172.21.2.135:0/3738069474 shutdown_connections 2021-11-15T14:42:08.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- 172.21.2.135:0/3738069474 wait complete. 2021-11-15T14:42:08.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 Processor -- start 2021-11-15T14:42:08.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.632+0000 7fd1808ce700 1 -- start start 2021-11-15T14:42:08.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 0x7fd17c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c14b370 con 0x7fd17c148420 2021-11-15T14:42:08.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c14b590 con 0x7fd17c0a7140 2021-11-15T14:42:08.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15a010 con 0x7fd17c0b1e30 2021-11-15T14:42:08.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33722/0 (socket says 172.21.2.135:33722) 2021-11-15T14:42:08.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 -- 172.21.2.135:0/3408084287 learned_addr learned my addr 172.21.2.135:0/3408084287 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:08.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 -- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 msgr2=0x7fd17c15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd179d9b700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17ad9d700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 0x7fd17c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c15a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 -- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 msgr2=0x7fd17c14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 0x7fd17c14ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 -- 172.21.2.135:0/3408084287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009470 con 0x7fd17c0a7140 2021-11-15T14:42:08.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17ad9d700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 0x7fd17c14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:08.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd17a59c700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fd17c14b4b0 tx=0x7fd16c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16c013460 con 0x7fd17c0a7140 2021-11-15T14:42:08.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c0135c0 con 0x7fd17c0a7140 2021-11-15T14:42:08.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c15a2b0 con 0x7fd17c0a7140 2021-11-15T14:42:08.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c140f40 con 0x7fd17c0a7140 2021-11-15T14:42:08.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16c013920 con 0x7fd17c0a7140 2021-11-15T14:42:08.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c0573d0 con 0x7fd17c0a7140 2021-11-15T14:42:08.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd16c01a060 con 0x7fd17c0a7140 2021-11-15T14:42:08.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 0x7fd158055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd16c06b4d0 con 0x7fd17c0a7140 2021-11-15T14:42:08.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.636+0000 7fd179d9b700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 0x7fd158055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.640+0000 7fd179d9b700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 0x7fd158055a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd170008000 tx=0x7fd170009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.640+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd16c0424e0 con 0x7fd17c0a7140 2021-11-15T14:42:08.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.748+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd17c0446d0 con 0x7fd17c0a7140 2021-11-15T14:42:08.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.748+0000 7fd16b7fe700 1 -- 172.21.2.135:0/3408084287 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd16c045b00 con 0x7fd17c0a7140 2021-11-15T14:42:08.753 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:08.754 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:01.348735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7270":{"gid":7270,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/1824406336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":1824406336},{"type":"v1","addr":"172.21.2.135:6835","nonce":1824406336}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:08.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 msgr2=0x7fd158055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 0x7fd158055a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd170008000 tx=0x7fd170009040).stop 2021-11-15T14:42:08.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 msgr2=0x7fd17c140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fd17c14b4b0 tx=0x7fd16c006ec0).stop 2021-11-15T14:42:08.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 shutdown_connections 2021-11-15T14:42:08.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd158053580 0x7fd158055a40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd17c148420 0x7fd17c14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd17c0b1e30 0x7fd17c15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 --2- 172.21.2.135:0/3408084287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd17c0a7140 0x7fd17c140230 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 >> 172.21.2.135:0/3408084287 conn(0x7fd17c05f730 msgr2=0x7fd17c0ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:08.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 shutdown_connections 2021-11-15T14:42:08.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.752+0000 7fd1808ce700 1 -- 172.21.2.135:0/3408084287 wait complete. 2021-11-15T14:42:08.758 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 54 2021-11-15T14:42:08.761 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:42:08.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 Processor -- start 2021-11-15T14:42:08.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 -- start start 2021-11-15T14:42:08.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95c40b1e30 0x7f95c40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c40a7140 0x7f95c41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40b03d0 con 0x7f95c4148420 2021-11-15T14:42:08.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40a9140 con 0x7f95c40b1e30 2021-11-15T14:42:08.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95cc7cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40b0670 con 0x7f95c40a7140 2021-11-15T14:42:08.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95c40b1e30 0x7f95c40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95c40b1e30 0x7f95c40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33730/0 (socket says 172.21.2.135:33730) 2021-11-15T14:42:08.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 -- 172.21.2.135:0/148090296 learned_addr learned my addr 172.21.2.135:0/148090296 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:08.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 -- 172.21.2.135:0/148090296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c40a7140 msgr2=0x7f95c41447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:08.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 --2- 172.21.2.135:0/148090296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c40a7140 0x7f95c41447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 -- 172.21.2.135:0/148090296 >> v1:172.21.2.119:6789/0 conn(0x7f95c4148420 legacy=0x7f95c40b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:08.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 -- 172.21.2.135:0/148090296 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40b0910 con 0x7f95c40b1e30 2021-11-15T14:42:08.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95ca56b700 1 --2- 172.21.2.135:0/148090296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40b1e30 0x7f95c40b1050 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f95c41477b0 tx=0x7f95c0006eb0).ready entity=mon.1 client_cookie=939a5a3226c80b66 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95c9569700 1 -- 172.21.2.135:0/148090296 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c000d570 con 0x7f95c40b1e30 2021-11-15T14:42:08.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95c9569700 1 -- 172.21.2.135:0/148090296 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0000e90 con 0x7f95c40b1e30 2021-11-15T14:42:08.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.808+0000 7f95c9569700 1 -- 172.21.2.135:0/148090296 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c000d900 con 0x7f95c40b1e30 2021-11-15T14:42:08.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/148090296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40b1e30 msgr2=0x7f95c40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/148090296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40b1e30 0x7f95c40b1050 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f95c41477b0 tx=0x7f95c0006eb0).stop 2021-11-15T14:42:08.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/148090296 shutdown_connections 2021-11-15T14:42:08.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/148090296 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c40a7140 0x7f95c41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/148090296 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40b1e30 0x7f95c40b1050 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:08.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/148090296 >> 172.21.2.135:0/148090296 conn(0x7f95c405f730 msgr2=0x7f95c405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:08.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/148090296 shutdown_connections 2021-11-15T14:42:08.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/148090296 wait complete. 2021-11-15T14:42:08.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 Processor -- start 2021-11-15T14:42:08.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- start start 2021-11-15T14:42:08.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95c40b1e30 0x7f95c4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c4148420 0x7f95c40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40b4050 con 0x7f95c40b1e30 2021-11-15T14:42:08.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40b4270 con 0x7f95c40a7140 2021-11-15T14:42:08.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4156c30 con 0x7f95c4148420 2021-11-15T14:42:08.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33738/0 (socket says 172.21.2.135:33738) 2021-11-15T14:42:08.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 -- 172.21.2.135:0/525195757 learned_addr learned my addr 172.21.2.135:0/525195757 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:08.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 -- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c4148420 msgr2=0x7f95c40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c4148420 0x7f95c40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 -- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95c40b1e30 msgr2=0x7f95c4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:08.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95c40b1e30 0x7f95c4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:08.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 -- 172.21.2.135:0/525195757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c000b1e0 con 0x7f95c40a7140 2021-11-15T14:42:08.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95ca56b700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f95c40aa710 tx=0x7f95c0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c000dea0 con 0x7f95c40a7140 2021-11-15T14:42:08.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0002f70 con 0x7f95c40a7140 2021-11-15T14:42:08.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4156ed0 con 0x7f95c40a7140 2021-11-15T14:42:08.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c40ab1b0 con 0x7f95c40a7140 2021-11-15T14:42:08.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c0011e90 con 0x7f95c40a7140 2021-11-15T14:42:08.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c40573d0 con 0x7f95c40a7140 2021-11-15T14:42:08.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f95c0025030 con 0x7f95c40a7140 2021-11-15T14:42:08.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 0x7f95a4055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:08.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.812+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f95c006d030 con 0x7f95c40a7140 2021-11-15T14:42:08.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.816+0000 7f95c9d6a700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 0x7f95a4055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:08.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.816+0000 7f95c9d6a700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 0x7f95a4055a00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f95b8002fb0 tx=0x7f95b80069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:08.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.816+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95c0043f30 con 0x7f95c40a7140 2021-11-15T14:42:08.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:08.924+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f95c40446d0 con 0x7f95c40a7140 2021-11-15T14:42:09.793 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:42:09.788+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:42:09.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95b77fe700 1 -- 172.21.2.135:0/525195757 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f95c0023020 con 0x7f95c40a7140 2021-11-15T14:42:09.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 msgr2=0x7f95a4055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 0x7f95a4055a00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f95b8002fb0 tx=0x7f95b80069f0).stop 2021-11-15T14:42:09.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 msgr2=0x7f95c4143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f95c40aa710 tx=0x7f95c0015000).stop 2021-11-15T14:42:09.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 shutdown_connections 2021-11-15T14:42:09.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95a4053540 0x7f95a4055a00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:09.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95c4148420 0x7f95c40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95c40b1e30 0x7f95c4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 --2- 172.21.2.135:0/525195757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95c40a7140 0x7f95c4143830 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:09.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 >> 172.21.2.135:0/525195757 conn(0x7f95c405f730 msgr2=0x7f95c40ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:09.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 shutdown_connections 2021-11-15T14:42:09.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.804+0000 7f95cc7cf700 1 -- 172.21.2.135:0/525195757 wait complete. 2021-11-15T14:42:09.811 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:42:09.815 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:09.819 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:42:09.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 Processor -- start 2021-11-15T14:42:09.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- start start 2021-11-15T14:42:09.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac060180 0x7f8bac0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8bac0b4cc0 0x7f8bac14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac0aac30 con 0x7f8bac067380 2021-11-15T14:42:09.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac060560 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac066f20 con 0x7f8bac060180 2021-11-15T14:42:09.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8bac0b4cc0 0x7f8bac14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:09.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8baa7fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8bac067380 0x7f8bac143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49578/0 (socket says 172.21.2.135:49578) 2021-11-15T14:42:09.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8baa7fc700 1 -- 172.21.2.135:0/1091887785 learned_addr learned my addr 172.21.2.135:0/1091887785 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:09.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 -- 172.21.2.135:0/1091887785 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac060180 msgr2=0x7f8bac0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:09.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 --2- 172.21.2.135:0/1091887785 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac060180 0x7f8bac0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 -- 172.21.2.135:0/1091887785 >> v1:172.21.2.135:6789/0 conn(0x7f8bac067380 legacy=0x7f8bac143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 -- 172.21.2.135:0/1091887785 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0b3430 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bab7fe700 1 --2- 172.21.2.135:0/1091887785 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac14b8d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f8ba40032f0 tx=0x7f8ba40091d0).ready entity=mon.1 client_cookie=79b51f8add824c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:09.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8ba9ffb700 1 -- 172.21.2.135:0/1091887785 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ba4009ea0 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8ba9ffb700 1 -- 172.21.2.135:0/1091887785 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400b8a0 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8ba9ffb700 1 -- 172.21.2.135:0/1091887785 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ba400ba10 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- 172.21.2.135:0/1091887785 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac0b4cc0 msgr2=0x7f8bac14b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 --2- 172.21.2.135:0/1091887785 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac14b8d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f8ba40032f0 tx=0x7f8ba40091d0).stop 2021-11-15T14:42:09.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- 172.21.2.135:0/1091887785 shutdown_connections 2021-11-15T14:42:09.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 --2- 172.21.2.135:0/1091887785 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac14b8d0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:09.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 --2- 172.21.2.135:0/1091887785 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac060180 0x7f8bac0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- 172.21.2.135:0/1091887785 >> 172.21.2.135:0/1091887785 conn(0x7f8bac05cfb0 msgr2=0x7f8bac05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:09.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- 172.21.2.135:0/1091887785 shutdown_connections 2021-11-15T14:42:09.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.864+0000 7f8bb171c700 1 -- 172.21.2.135:0/1091887785 wait complete. 2021-11-15T14:42:09.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 Processor -- start 2021-11-15T14:42:09.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- start start 2021-11-15T14:42:09.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac067380 0x7f8bac0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac13f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac15ac70 con 0x7f8bac0b4cc0 2021-11-15T14:42:09.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac15aed0 con 0x7f8bac060180 2021-11-15T14:42:09.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac09e930 con 0x7f8bac067380 2021-11-15T14:42:09.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:09.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33764/0 (socket says 172.21.2.135:33764) 2021-11-15T14:42:09.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 -- 172.21.2.135:0/15615780 learned_addr learned my addr 172.21.2.135:0/15615780 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:09.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 -- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac067380 msgr2=0x7f8bac0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac067380 0x7f8bac0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 -- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8bac0b4cc0 msgr2=0x7f8bac13f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac13f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 -- 172.21.2.135:0/15615780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009470 con 0x7f8bac060180 2021-11-15T14:42:09.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baaffd700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f8b9c002f70 tx=0x7f8b9c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:09.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9c013460 con 0x7f8bac060180 2021-11-15T14:42:09.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c0135c0 con 0x7f8bac060180 2021-11-15T14:42:09.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9c013920 con 0x7f8bac060180 2021-11-15T14:42:09.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac09ebd0 con 0x7f8bac060180 2021-11-15T14:42:09.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac1408f0 con 0x7f8bac060180 2021-11-15T14:42:09.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac09ed60 con 0x7f8bac060180 2021-11-15T14:42:09.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b9c01a060 con 0x7f8bac060180 2021-11-15T14:42:09.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 0x7f8b90055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:09.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f8b9c06b6c0 con 0x7f8bac060180 2021-11-15T14:42:09.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baa7fc700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 0x7f8b90055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:09.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.868+0000 7f8baa7fc700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 0x7f8b90055b20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8bac067260 tx=0x7f8b94007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:09.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.872+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b9c042560 con 0x7f8bac060180 2021-11-15T14:42:09.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.980+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bac0573d0 con 0x7f8bac060180 2021-11-15T14:42:09.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.980+0000 7f8ba3fff700 1 -- 172.21.2.135:0/15615780 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f8b9c018020 con 0x7f8bac060180 2021-11-15T14:42:09.986 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:09.986 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":55,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:00.342899+0000","modified":"2021-11-15T14:42:09.792774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-15T14:42:09.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 msgr2=0x7f8b90055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 0x7f8b90055b20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8bac067260 tx=0x7f8b94007800).stop 2021-11-15T14:42:09.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 msgr2=0x7f8bac143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:09.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f8b9c002f70 tx=0x7f8b9c006ec0).stop 2021-11-15T14:42:09.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 shutdown_connections 2021-11-15T14:42:09.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8b90053660 0x7f8b90055b20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:09.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8bac0b4cc0 0x7f8bac13f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8bac067380 0x7f8bac0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:09.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 --2- 172.21.2.135:0/15615780 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8bac060180 0x7f8bac143090 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:09.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 >> 172.21.2.135:0/15615780 conn(0x7f8bac05cfb0 msgr2=0x7f8bac060840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:09.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 shutdown_connections 2021-11-15T14:42:09.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:09.984+0000 7f8bb171c700 1 -- 172.21.2.135:0/15615780 wait complete. 2021-11-15T14:42:09.990 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 55 2021-11-15T14:42:09.993 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:42:10.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.040+0000 7efc16742700 1 Processor -- start 2021-11-15T14:42:10.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.040+0000 7efc16742700 1 -- start start 2021-11-15T14:42:10.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efc100ac580 0x7efc10140830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1005ff00 con 0x7efc1005fb20 2021-11-15T14:42:10.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc100acce0 con 0x7efc10060850 2021-11-15T14:42:10.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc101432c0 con 0x7efc100ac580 2021-11-15T14:42:10.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7efc10060850 0x7efc10140120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49594/0 (socket says 172.21.2.135:49594) 2021-11-15T14:42:10.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0f7fe700 1 -- 172.21.2.135:0/1355059482 learned_addr learned my addr 172.21.2.135:0/1355059482 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:10.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- 172.21.2.135:0/1355059482 >> v2:172.21.2.135:3300/0 conn(0x7efc100ac580 0x7efc10140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/1355059482 >> v1:172.21.2.135:6789/0 conn(0x7efc10060850 legacy=0x7efc10140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/1355059482 >> v1:172.21.2.119:6789/0 conn(0x7efc1005fb20 legacy=0x7efc10143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:10.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/1355059482 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100acf80 con 0x7efc100ac580 2021-11-15T14:42:10.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- 172.21.2.135:0/1355059482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10140830 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7efc100b6f70 tx=0x7efc080091d0).ready entity=mon.1 client_cookie=8823be01a492081f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0effd700 1 -- 172.21.2.135:0/1355059482 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc08009ea0 con 0x7efc100ac580 2021-11-15T14:42:10.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0effd700 1 -- 172.21.2.135:0/1355059482 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800b860 con 0x7efc100ac580 2021-11-15T14:42:10.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0effd700 1 -- 172.21.2.135:0/1355059482 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0800b9d0 con 0x7efc100ac580 2021-11-15T14:42:10.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/1355059482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 msgr2=0x7efc10140830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- 172.21.2.135:0/1355059482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10140830 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7efc100b6f70 tx=0x7efc080091d0).stop 2021-11-15T14:42:10.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/1355059482 shutdown_connections 2021-11-15T14:42:10.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- 172.21.2.135:0/1355059482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10140830 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:10.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/1355059482 >> 172.21.2.135:0/1355059482 conn(0x7efc100b29f0 msgr2=0x7efc100b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:10.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/1355059482 shutdown_connections 2021-11-15T14:42:10.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/1355059482 wait complete. 2021-11-15T14:42:10.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 Processor -- start 2021-11-15T14:42:10.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- start start 2021-11-15T14:42:10.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc1005fb20 0x7efc100afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc10060850 0x7efc10146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100630b0 con 0x7efc10060850 2021-11-15T14:42:10.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10146e60 con 0x7efc100ac580 2021-11-15T14:42:10.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc10145bf0 con 0x7efc1005fb20 2021-11-15T14:42:10.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33780/0 (socket says 172.21.2.135:33780) 2021-11-15T14:42:10.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/2578714632 learned_addr learned my addr 172.21.2.135:0/2578714632 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:10.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc1005fb20 msgr2=0x7efc100afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc1005fb20 0x7efc100afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc10060850 msgr2=0x7efc10146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc10060850 0x7efc10146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 -- 172.21.2.135:0/2578714632 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009470 con 0x7efc100ac580 2021-11-15T14:42:10.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc14cdf700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7efc100b6f70 tx=0x7efc08016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc08009ea0 con 0x7efc100ac580 2021-11-15T14:42:10.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0801f5e0 con 0x7efc100ac580 2021-11-15T14:42:10.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc100632e0 con 0x7efc100ac580 2021-11-15T14:42:10.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0801f940 con 0x7efc100ac580 2021-11-15T14:42:10.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.044+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc101460f0 con 0x7efc100ac580 2021-11-15T14:42:10.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc100573d0 con 0x7efc100ac580 2021-11-15T14:42:10.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc08026030 con 0x7efc100ac580 2021-11-15T14:42:10.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0d7fa700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 0x7efbf4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6502+0+0 (secure 0 0 0) 0x7efc0806c950 con 0x7efc100ac580 2021-11-15T14:42:10.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0ffff700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 0x7efbf4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0ffff700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 0x7efbf4055b90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7efc00002ef0 tx=0x7efc00006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.048+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc080437f0 con 0x7efc100ac580 2021-11-15T14:42:10.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.156+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc100b6d50 con 0x7efc100ac580 2021-11-15T14:42:10.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.808+0000 7efc0d7fa700 1 -- 172.21.2.135:0/2578714632 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc080032d0 con 0x7efc100ac580 2021-11-15T14:42:10.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.808+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 msgr2=0x7efbf4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.808+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 0x7efbf4055b90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7efc00002ef0 tx=0x7efc00006910).stop 2021-11-15T14:42:10.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 msgr2=0x7efc10066980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7efc100b6f70 tx=0x7efc08016000).stop 2021-11-15T14:42:10.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 shutdown_connections 2021-11-15T14:42:10.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efbf40536d0 0x7efbf4055b90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:10.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efc100ac580 0x7efc10066980 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:10.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efc10060850 0x7efc10146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 --2- 172.21.2.135:0/2578714632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efc1005fb20 0x7efc100afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 >> 172.21.2.135:0/2578714632 conn(0x7efc100b29f0 msgr2=0x7efc101408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:10.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 shutdown_connections 2021-11-15T14:42:10.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.812+0000 7efc16742700 1 -- 172.21.2.135:0/2578714632 wait complete. 2021-11-15T14:42:10.820 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:42:10.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 Processor -- start 2021-11-15T14:42:10.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- start start 2021-11-15T14:42:10.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f85f40b1e30 0x7f85f40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85f4148420 0x7f85f40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40a7140 0x7f85f41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f40a9140 con 0x7f85f40b1e30 2021-11-15T14:42:10.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f40b03d0 con 0x7f85f4148420 2021-11-15T14:42:10.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40b0670 con 0x7f85f40a7140 2021-11-15T14:42:10.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85f4148420 0x7f85f40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85f4148420 0x7f85f40b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33790/0 (socket says 172.21.2.135:33790) 2021-11-15T14:42:10.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 -- 172.21.2.135:0/2023906965 learned_addr learned my addr 172.21.2.135:0/2023906965 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:10.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 -- 172.21.2.135:0/2023906965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40a7140 msgr2=0x7f85f41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:10.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 --2- 172.21.2.135:0/2023906965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40a7140 0x7f85f41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 -- 172.21.2.135:0/2023906965 >> v2:172.21.2.119:3300/0 conn(0x7f85f40b1e30 msgr2=0x7f85f40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:10.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 --2- 172.21.2.135:0/2023906965 >> v2:172.21.2.119:3300/0 conn(0x7f85f40b1e30 0x7f85f40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 -- 172.21.2.135:0/2023906965 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40b0910 con 0x7f85f4148420 2021-11-15T14:42:10.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f8896700 1 --2- 172.21.2.135:0/2023906965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f4148420 0x7f85f40b2210 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f85f41477b0 tx=0x7f85f0006eb0).ready entity=mon.1 client_cookie=abc66e1631b3d1bf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85e7fff700 1 -- 172.21.2.135:0/2023906965 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f000d570 con 0x7f85f4148420 2021-11-15T14:42:10.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85e7fff700 1 -- 172.21.2.135:0/2023906965 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0000e90 con 0x7f85f4148420 2021-11-15T14:42:10.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85e7fff700 1 -- 172.21.2.135:0/2023906965 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f000d8c0 con 0x7f85f4148420 2021-11-15T14:42:10.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2023906965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f4148420 msgr2=0x7f85f40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2023906965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f4148420 0x7f85f40b2210 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f85f41477b0 tx=0x7f85f0006eb0).stop 2021-11-15T14:42:10.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2023906965 shutdown_connections 2021-11-15T14:42:10.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2023906965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40a7140 0x7f85f41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2023906965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f4148420 0x7f85f40b2210 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:10.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2023906965 >> v2:172.21.2.119:3300/0 conn(0x7f85f40b1e30 0x7f85f40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2023906965 >> 172.21.2.135:0/2023906965 conn(0x7f85f405f730 msgr2=0x7f85f405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:10.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2023906965 shutdown_connections 2021-11-15T14:42:10.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2023906965 wait complete. 2021-11-15T14:42:10.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 Processor -- start 2021-11-15T14:42:10.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- start start 2021-11-15T14:42:10.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40b1e30 0x7f85f415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85f4148420 0x7f85f415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414a400 con 0x7f85f4148420 2021-11-15T14:42:10.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414a6a0 con 0x7f85f40a7140 2021-11-15T14:42:10.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85fb2fb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414a940 con 0x7f85f40b1e30 2021-11-15T14:42:10.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f9097700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f9097700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33794/0 (socket says 172.21.2.135:33794) 2021-11-15T14:42:10.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.872+0000 7f85f9097700 1 -- 172.21.2.135:0/2249525642 learned_addr learned my addr 172.21.2.135:0/2249525642 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:10.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 -- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40b1e30 msgr2=0x7f85f415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40b1e30 0x7f85f415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 -- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85f4148420 msgr2=0x7f85f415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:10.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85f4148420 0x7f85f415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:10.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 -- 172.21.2.135:0/2249525642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f000b1e0 con 0x7f85f40a7140 2021-11-15T14:42:10.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f9097700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f85e8002f70 tx=0x7f85e8006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e8013460 con 0x7f85f40a7140 2021-11-15T14:42:10.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e80135c0 con 0x7f85f40a7140 2021-11-15T14:42:10.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f414abe0 con 0x7f85f40a7140 2021-11-15T14:42:10.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f40a9e80 con 0x7f85f40a7140 2021-11-15T14:42:10.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e8013920 con 0x7f85f40a7140 2021-11-15T14:42:10.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0003410 con 0x7f85f40a7140 2021-11-15T14:42:10.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85e801a060 con 0x7f85f40a7140 2021-11-15T14:42:10.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 0x7f85d4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:10.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f85e806b640 con 0x7f85f40a7140 2021-11-15T14:42:10.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f8896700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 0x7f85d4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:10.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.876+0000 7f85f8896700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 0x7f85d4055bb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f85f41477b0 tx=0x7f85f0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:10.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.880+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85e80424e0 con 0x7f85f40a7140 2021-11-15T14:42:10.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:10.960+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85d00036c0 con 0x7f85f40a7140 2021-11-15T14:42:11.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.816+0000 7f85e67fc700 1 -- 172.21.2.135:0/2249525642 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 185+0+0 (secure 0 0 0) 0x7f85e8045b00 con 0x7f85f40a7140 2021-11-15T14:42:11.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 msgr2=0x7f85d4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 0x7f85d4055bb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f85f41477b0 tx=0x7f85f0015000).stop 2021-11-15T14:42:11.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 msgr2=0x7f85f40aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f85e8002f70 tx=0x7f85e8006e40).stop 2021-11-15T14:42:11.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 shutdown_connections 2021-11-15T14:42:11.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85d40536f0 0x7f85d4055bb0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85f4148420 0x7f85f415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:11.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85f40b1e30 0x7f85f415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:11.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 --2- 172.21.2.135:0/2249525642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85f40a7140 0x7f85f40aea30 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 >> 172.21.2.135:0/2249525642 conn(0x7f85f405f730 msgr2=0x7f85f4146fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:11.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 shutdown_connections 2021-11-15T14:42:11.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.820+0000 7f85fb2fb700 1 -- 172.21.2.135:0/2249525642 wait complete. 2021-11-15T14:42:11.825 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:42:11.828 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:42:11.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 Processor -- start 2021-11-15T14:42:11.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 -- start start 2021-11-15T14:42:11.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd378060180 0x7fd3780b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd378067380 0x7fd378143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3780aac30 con 0x7fd3780b4cc0 2021-11-15T14:42:11.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd378060560 con 0x7fd378060180 2021-11-15T14:42:11.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37ed32700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd378066f20 con 0x7fd378067380 2021-11-15T14:42:11.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37d2cf700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fd3780b4cc0 0x7fd378144590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:59036/0 (socket says 172.21.2.135:59036) 2021-11-15T14:42:11.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37cace700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd378060180 0x7fd3780b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd377fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd378067380 0x7fd378143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37d2cf700 1 -- 172.21.2.135:0/1750462978 learned_addr learned my addr 172.21.2.135:0/1750462978 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:11.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37cace700 1 -- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd378067380 msgr2=0x7fd378143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:11.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37cace700 1 --2- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd378067380 0x7fd378143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37cace700 1 -- 172.21.2.135:0/1750462978 >> v1:172.21.2.119:6789/0 conn(0x7fd3780b4cc0 legacy=0x7fd378144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.880+0000 7fd37cace700 1 -- 172.21.2.135:0/1750462978 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780b3430 con 0x7fd378060180 2021-11-15T14:42:11.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378060180 0x7fd3780b47d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360006df0).ready entity=mon.0 client_cookie=bcc76d5a9e9dfc23 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:11.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd3777fe700 1 -- 172.21.2.135:0/1750462978 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d570 con 0x7fd378060180 2021-11-15T14:42:11.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd3777fe700 1 -- 172.21.2.135:0/1750462978 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360000e90 con 0x7fd378060180 2021-11-15T14:42:11.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd3777fe700 1 -- 172.21.2.135:0/1750462978 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d8c0 con 0x7fd378060180 2021-11-15T14:42:11.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378060180 msgr2=0x7fd3780b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378060180 0x7fd3780b47d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360006df0).stop 2021-11-15T14:42:11.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/1750462978 shutdown_connections 2021-11-15T14:42:11.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd378067380 0x7fd378143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- 172.21.2.135:0/1750462978 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378060180 0x7fd3780b47d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/1750462978 >> 172.21.2.135:0/1750462978 conn(0x7fd37805cfb0 msgr2=0x7fd37805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:11.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/1750462978 shutdown_connections 2021-11-15T14:42:11.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/1750462978 wait complete. 2021-11-15T14:42:11.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 Processor -- start 2021-11-15T14:42:11.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- start start 2021-11-15T14:42:11.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378067380 0x7fd378150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3780b4cc0 0x7fd378150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37809f420 con 0x7fd378067380 2021-11-15T14:42:11.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ad820 con 0x7fd378060180 2021-11-15T14:42:11.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780acf10 con 0x7fd3780b4cc0 2021-11-15T14:42:11.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33810/0 (socket says 172.21.2.135:33810) 2021-11-15T14:42:11.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 -- 172.21.2.135:0/366164899 learned_addr learned my addr 172.21.2.135:0/366164899 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:11.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd377fff700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378067380 0x7fd378150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37d2cf700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3780b4cc0 0x7fd378150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 -- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3780b4cc0 msgr2=0x7fd378150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3780b4cc0 0x7fd378150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 -- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378067380 msgr2=0x7fd378150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:11.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378067380 0x7fd378150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:11.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 -- 172.21.2.135:0/366164899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36000b180 con 0x7fd378060180 2021-11-15T14:42:11.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37cace700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:11.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd360016070 con 0x7fd378060180 2021-11-15T14:42:11.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000de30 con 0x7fd378060180 2021-11-15T14:42:11.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3780ad1b0 con 0x7fd378060180 2021-11-15T14:42:11.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36001e450 con 0x7fd378060180 2021-11-15T14:42:11.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3780ada10 con 0x7fd378060180 2021-11-15T14:42:11.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3780573d0 con 0x7fd378060180 2021-11-15T14:42:11.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.884+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd360025030 con 0x7fd378060180 2021-11-15T14:42:11.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.888+0000 7fd375ffb700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 0x7fd35c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:11.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.888+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fd36006c910 con 0x7fd378060180 2021-11-15T14:42:11.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.888+0000 7fd377fff700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 0x7fd35c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:11.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.888+0000 7fd377fff700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 0x7fd35c055a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fd36800b000 tx=0x7fd368008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:11.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.888+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd360043a80 con 0x7fd378060180 2021-11-15T14:42:11.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:11.972+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3780b4a10 con 0x7fd378060180 2021-11-15T14:42:12.549 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:12.552 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:12.556 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:12.559 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:12.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd375ffb700 1 -- 172.21.2.135:0/366164899 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd360023020 con 0x7fd378060180 2021-11-15T14:42:12.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 msgr2=0x7fd35c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 0x7fd35c055a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fd36800b000 tx=0x7fd368008040).stop 2021-11-15T14:42:12.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 msgr2=0x7fd3780b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fd360002f70 tx=0x7fd360014000).stop 2021-11-15T14:42:12.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 shutdown_connections 2021-11-15T14:42:12.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd35c053580 0x7fd35c055a40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:12.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3780b4cc0 0x7fd378150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:12.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd378067380 0x7fd378150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:12.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 --2- 172.21.2.135:0/366164899 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd378060180 0x7fd3780b0670 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:12.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 >> 172.21.2.135:0/366164899 conn(0x7fd37805cfb0 msgr2=0x7fd3780b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:12.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 shutdown_connections 2021-11-15T14:42:12.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.832+0000 7fd37ed32700 1 -- 172.21.2.135:0/366164899 wait complete. 2021-11-15T14:42:12.840 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:42:12.843 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:42:12.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 Processor -- start 2021-11-15T14:42:12.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 -- start start 2021-11-15T14:42:12.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f96e41419e0 0x7f96e40b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:12.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e40a7850 con 0x7f96e40b1350 2021-11-15T14:42:12.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e40b06d0 con 0x7f96e40b1f40 2021-11-15T14:42:12.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e965b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e40b17c0 con 0x7f96e41419e0 2021-11-15T14:42:12.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e2ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f96e40b1f40 0x7f96e40a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49634/0 (socket says 172.21.2.135:49634) 2021-11-15T14:42:12.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e2ffd700 1 -- 172.21.2.135:0/1863175730 learned_addr learned my addr 172.21.2.135:0/1863175730 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:12.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e37fe700 1 --2- 172.21.2.135:0/1863175730 >> v2:172.21.2.135:3300/0 conn(0x7f96e41419e0 0x7f96e40b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:12.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e37fe700 1 -- 172.21.2.135:0/1863175730 >> v1:172.21.2.135:6789/0 conn(0x7f96e40b1f40 legacy=0x7f96e40a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e37fe700 1 -- 172.21.2.135:0/1863175730 >> v1:172.21.2.119:6789/0 conn(0x7f96e40b1350 legacy=0x7f96e41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:12.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e37fe700 1 -- 172.21.2.135:0/1863175730 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40b0970 con 0x7f96e41419e0 2021-11-15T14:42:12.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.892+0000 7f96e37fe700 1 --2- 172.21.2.135:0/1863175730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e40b0030 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f96e40ad350 tx=0x7f96dc0091d0).ready entity=mon.1 client_cookie=cfa08a782b46d426 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:12.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e1ffb700 1 -- 172.21.2.135:0/1863175730 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96dc009ea0 con 0x7f96e41419e0 2021-11-15T14:42:12.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e1ffb700 1 -- 172.21.2.135:0/1863175730 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc00b860 con 0x7f96e41419e0 2021-11-15T14:42:12.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e1ffb700 1 -- 172.21.2.135:0/1863175730 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96dc00b9d0 con 0x7f96e41419e0 2021-11-15T14:42:12.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/1863175730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 msgr2=0x7f96e40b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 --2- 172.21.2.135:0/1863175730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e40b0030 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f96e40ad350 tx=0x7f96dc0091d0).stop 2021-11-15T14:42:12.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/1863175730 shutdown_connections 2021-11-15T14:42:12.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 --2- 172.21.2.135:0/1863175730 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e40b0030 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:12.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/1863175730 >> 172.21.2.135:0/1863175730 conn(0x7f96e405f730 msgr2=0x7f96e405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:12.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/1863175730 shutdown_connections 2021-11-15T14:42:12.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/1863175730 wait complete. 2021-11-15T14:42:12.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 Processor -- start 2021-11-15T14:42:12.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- start start 2021-11-15T14:42:12.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96e40b1350 0x7f96e40ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:12.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96e40b1f40 0x7f96e415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:12.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:12.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40aa6c0 con 0x7f96e40b1f40 2021-11-15T14:42:12.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40aa960 con 0x7f96e41419e0 2021-11-15T14:42:12.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40aac00 con 0x7f96e40b1350 2021-11-15T14:42:12.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:12.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33824/0 (socket says 172.21.2.135:33824) 2021-11-15T14:42:12.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 -- 172.21.2.135:0/2564399830 learned_addr learned my addr 172.21.2.135:0/2564399830 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:12.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 -- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96e40b1350 msgr2=0x7f96e40ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96e40b1350 0x7f96e40ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:12.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 -- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96e40b1f40 msgr2=0x7f96e415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:12.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96e40b1f40 0x7f96e415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:12.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 -- 172.21.2.135:0/2564399830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009470 con 0x7f96e41419e0 2021-11-15T14:42:12.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e37fe700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f96e40ad350 tx=0x7f96dc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:12.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96dc009ea0 con 0x7f96e41419e0 2021-11-15T14:42:12.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc01f5e0 con 0x7f96e41419e0 2021-11-15T14:42:12.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96dc01f940 con 0x7f96e41419e0 2021-11-15T14:42:12.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e40aaea0 con 0x7f96e41419e0 2021-11-15T14:42:12.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e4142ef0 con 0x7f96e41419e0 2021-11-15T14:42:12.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e40ab030 con 0x7f96e41419e0 2021-11-15T14:42:12.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96dc026030 con 0x7f96e41419e0 2021-11-15T14:42:12.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 0x7f96c8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:12.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.896+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f96dc06c5c0 con 0x7f96e41419e0 2021-11-15T14:42:12.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.900+0000 7f96e2ffd700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 0x7f96c8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:12.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.900+0000 7f96e2ffd700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 0x7f96c8055a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f96e40b2fd0 tx=0x7f96cc007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:12.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.900+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96dc043820 con 0x7f96e41419e0 2021-11-15T14:42:12.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.984+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f96e40573d0 con 0x7f96e41419e0 2021-11-15T14:42:13.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96dbfff700 1 -- 172.21.2.135:0/2564399830 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96dc046e40 con 0x7f96e41419e0 2021-11-15T14:42:13.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 msgr2=0x7f96c8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 0x7f96c8055a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f96e40b2fd0 tx=0x7f96cc007800).stop 2021-11-15T14:42:13.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 msgr2=0x7f96e415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f96e40ad350 tx=0x7f96dc016000).stop 2021-11-15T14:42:13.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 shutdown_connections 2021-11-15T14:42:13.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96c8053580 0x7f96c8055a40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96e41419e0 0x7f96e415a850 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96e40b1f40 0x7f96e415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 --2- 172.21.2.135:0/2564399830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96e40b1350 0x7f96e40ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:12.996+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 >> 172.21.2.135:0/2564399830 conn(0x7f96e405f730 msgr2=0x7f96e4145770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:13.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.000+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 shutdown_connections 2021-11-15T14:42:13.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.000+0000 7f96e965b700 1 -- 172.21.2.135:0/2564399830 wait complete. 2021-11-15T14:42:13.008 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-15T14:42:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 Processor -- start 2021-11-15T14:42:13.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- start start 2021-11-15T14:42:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 0x7fef3014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300b6d60 con 0x7fef300b6980 2021-11-15T14:42:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef30061260 con 0x7fef30060990 2021-11-15T14:42:13.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30061500 con 0x7fef300acdd0 2021-11-15T14:42:13.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fef30060990 0x7fef300aa650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49650/0 (socket says 172.21.2.135:49650) 2021-11-15T14:42:13.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 -- 172.21.2.135:0/803360193 learned_addr learned my addr 172.21.2.135:0/803360193 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112263359 0 0) 0x7fef30061260 con 0x7fef30060990 2021-11-15T14:42:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18003260 con 0x7fef30060990 2021-11-15T14:42:13.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef35b51700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 0x7fef3014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938474048 0 0) 0x7fef18003260 con 0x7fef30060990 2021-11-15T14:42:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 msgr2=0x7fef3014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 0x7fef3014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 >> v1:172.21.2.119:6789/0 conn(0x7fef300b6980 legacy=0x7fef300a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300617a0 con 0x7fef30060990 2021-11-15T14:42:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fef24001660 con 0x7fef30060990 2021-11-15T14:42:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 >> v1:172.21.2.135:6789/0 conn(0x7fef30060990 legacy=0x7fef300aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 0x7fef180037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef18003e00 0x7fef18004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef18004b10 0x7fef18004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30061500 con 0x7fef18004b10 2021-11-15T14:42:13.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1800db70 con 0x7fef18003e00 2021-11-15T14:42:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1800dd30 con 0x7fef300acdd0 2021-11-15T14:42:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef18003e00 0x7fef18004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 -- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 msgr2=0x7fef180037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef300acdd0 0x7fef180037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 -- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef18004b10 msgr2=0x7fef18004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef18004b10 0x7fef18004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 -- 172.21.2.135:0/803360193 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18003260 con 0x7fef18003e00 2021-11-15T14:42:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef34b4f700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef18003e00 0x7fef18004500 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fef30060380 tx=0x7fef3005fe30).ready entity=mon.1 client_cookie=134cf2c27478092c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef240072c0 con 0x7fef18003e00 2021-11-15T14:42:13.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24007420 con 0x7fef18003e00 2021-11-15T14:42:13.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef23fff700 1 -- 172.21.2.135:0/803360193 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2400cae0 con 0x7fef18003e00 2021-11-15T14:42:13.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- 172.21.2.135:0/803360193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef18003e00 msgr2=0x7fef18004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 --2- 172.21.2.135:0/803360193 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef18003e00 0x7fef18004500 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fef30060380 tx=0x7fef3005fe30).stop 2021-11-15T14:42:13.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef35b51700 1 -- 172.21.2.135:0/803360193 reap_dead start 2021-11-15T14:42:13.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- 172.21.2.135:0/803360193 shutdown_connections 2021-11-15T14:42:13.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- 172.21.2.135:0/803360193 >> 172.21.2.135:0/803360193 conn(0x7fef300b3500 msgr2=0x7fef300b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:13.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- 172.21.2.135:0/803360193 shutdown_connections 2021-11-15T14:42:13.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.056+0000 7fef375b4700 1 -- 172.21.2.135:0/803360193 wait complete. 2021-11-15T14:42:13.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 Processor -- start 2021-11-15T14:42:13.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- start start 2021-11-15T14:42:13.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 0x7fef3014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef3013caf0 0x7fef30134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30151fd0 con 0x7fef3013caf0 2021-11-15T14:42:13.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3013a3f0 con 0x7fef300af070 2021-11-15T14:42:13.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300aed00 con 0x7fef18003e00 2021-11-15T14:42:13.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33842/0 (socket says 172.21.2.135:33842) 2021-11-15T14:42:13.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 -- 172.21.2.135:0/1915457847 learned_addr learned my addr 172.21.2.135:0/1915457847 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:13.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef35b51700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef3013caf0 0x7fef30134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef35350700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 0x7fef3014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 -- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 msgr2=0x7fef3014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 0x7fef3014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 -- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef3013caf0 msgr2=0x7fef30134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef3013caf0 0x7fef30134cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 -- 172.21.2.135:0/1915457847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300aeec0 con 0x7fef300af070 2021-11-15T14:42:13.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef35350700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 0x7fef3014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:13.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef34b4f700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7fef30060380 tx=0x7fef24014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef24001b60 con 0x7fef300af070 2021-11-15T14:42:13.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24011960 con 0x7fef300af070 2021-11-15T14:42:13.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300af850 con 0x7fef300af070 2021-11-15T14:42:13.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3013d110 con 0x7fef300af070 2021-11-15T14:42:13.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef24011cc0 con 0x7fef300af070 2021-11-15T14:42:13.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30061a40 con 0x7fef300af070 2021-11-15T14:42:13.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef24004520 con 0x7fef300af070 2021-11-15T14:42:13.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 0x7fef10055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fef240706d0 con 0x7fef300af070 2021-11-15T14:42:13.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.060+0000 7fef35350700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 0x7fef10055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.064+0000 7fef35350700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 0x7fef10055a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fef2c008000 tx=0x7fef2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.064+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef24047840 con 0x7fef300af070 2021-11-15T14:42:13.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.176+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fef300573d0 con 0x7fef300af070 2021-11-15T14:42:13.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.840+0000 7fef227fc700 1 -- 172.21.2.135:0/1915457847 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v335) v1 ==== 127+0+0 (secure 0 0 0) 0x7fef2404ae60 con 0x7fef300af070 2021-11-15T14:42:13.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 msgr2=0x7fef10055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 0x7fef10055a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fef2c008000 tx=0x7fef2c009040).stop 2021-11-15T14:42:13.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 msgr2=0x7fef30139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7fef30060380 tx=0x7fef24014000).stop 2021-11-15T14:42:13.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 shutdown_connections 2021-11-15T14:42:13.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef100535d0 0x7fef10055a90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef3013caf0 0x7fef30134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef300af070 0x7fef30139960 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 --2- 172.21.2.135:0/1915457847 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef18003e00 0x7fef3014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 >> 172.21.2.135:0/1915457847 conn(0x7fef300b3500 msgr2=0x7fef300aa860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:13.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 shutdown_connections 2021-11-15T14:42:13.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.844+0000 7fef375b4700 1 -- 172.21.2.135:0/1915457847 wait complete. 2021-11-15T14:42:13.853 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:42:13.853 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:42:13.854 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-15T14:42:13.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 Processor -- start 2021-11-15T14:42:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 -- start start 2021-11-15T14:42:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbb3c148420 0x7fbb3c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0a7140 0x7fbb3c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c0b03d0 con 0x7fbb3c0b1e30 2021-11-15T14:42:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0a9140 con 0x7fbb3c148420 2021-11-15T14:42:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb44640700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0b0670 con 0x7fbb3c0a7140 2021-11-15T14:42:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb41bdb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbb3c148420 0x7fbb3c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb423dc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fbb3c0b1e30 0x7fbb3c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49668/0 (socket says 172.21.2.135:49668) 2021-11-15T14:42:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.900+0000 7fbb423dc700 1 -- 172.21.2.135:0/2647422456 learned_addr learned my addr 172.21.2.135:0/2647422456 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb41bdb700 1 -- 172.21.2.135:0/2647422456 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0a7140 msgr2=0x7fbb3c1447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb41bdb700 1 --2- 172.21.2.135:0/2647422456 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0a7140 0x7fbb3c1447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb41bdb700 1 -- 172.21.2.135:0/2647422456 >> v1:172.21.2.135:6789/0 conn(0x7fbb3c0b1e30 legacy=0x7fbb3c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb41bdb700 1 -- 172.21.2.135:0/2647422456 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0b0910 con 0x7fbb3c148420 2021-11-15T14:42:13.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb41bdb700 1 --2- 172.21.2.135:0/2647422456 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c148420 0x7fbb3c0b1050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fbb3c1477b0 tx=0x7fbb30006df0).ready entity=mon.1 client_cookie=c347a1f89a9a5421 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb413da700 1 -- 172.21.2.135:0/2647422456 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3000d570 con 0x7fbb3c148420 2021-11-15T14:42:13.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb413da700 1 -- 172.21.2.135:0/2647422456 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb30000e90 con 0x7fbb3c148420 2021-11-15T14:42:13.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb413da700 1 -- 172.21.2.135:0/2647422456 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3000d8c0 con 0x7fbb3c148420 2021-11-15T14:42:13.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/2647422456 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c148420 msgr2=0x7fbb3c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- 172.21.2.135:0/2647422456 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c148420 0x7fbb3c0b1050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fbb3c1477b0 tx=0x7fbb30006df0).stop 2021-11-15T14:42:13.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/2647422456 shutdown_connections 2021-11-15T14:42:13.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- 172.21.2.135:0/2647422456 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c148420 0x7fbb3c0b1050 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:13.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- 172.21.2.135:0/2647422456 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0a7140 0x7fbb3c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/2647422456 >> 172.21.2.135:0/2647422456 conn(0x7fbb3c05f730 msgr2=0x7fbb3c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:13.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/2647422456 shutdown_connections 2021-11-15T14:42:13.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/2647422456 wait complete. 2021-11-15T14:42:13.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 Processor -- start 2021-11-15T14:42:13.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- start start 2021-11-15T14:42:13.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0b1e30 0x7fbb3c0ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbb3c148420 0x7fbb3c063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0630c0 con 0x7fbb3c148420 2021-11-15T14:42:13.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c1579e0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c157740 con 0x7fbb3c0b1e30 2021-11-15T14:42:13.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33854/0 (socket says 172.21.2.135:33854) 2021-11-15T14:42:13.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 -- 172.21.2.135:0/3404685458 learned_addr learned my addr 172.21.2.135:0/3404685458 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:13.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 -- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0b1e30 msgr2=0x7fbb3c0ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0b1e30 0x7fbb3c0ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 -- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbb3c148420 msgr2=0x7fbb3c063a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:13.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbb3c148420 0x7fbb3c063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:13.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 -- 172.21.2.135:0/3404685458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3000b180 con 0x7fbb3c0a7140 2021-11-15T14:42:13.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb423dc700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fbb3c0b31f0 tx=0x7fbb38007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3800ce30 con 0x7fbb3c0a7140 2021-11-15T14:42:13.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380072e0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb38005800 con 0x7fbb3c0a7140 2021-11-15T14:42:13.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0a9df0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c14b5a0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.904+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c0573d0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb38010070 con 0x7fbb3c0a7140 2021-11-15T14:42:13.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb2f7fe700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 0x7fbb1c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:13.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fbb3806aed0 con 0x7fbb3c0a7140 2021-11-15T14:42:13.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb41bdb700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 0x7fbb1c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:13.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb41bdb700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 0x7fbb1c0559e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fbb3c1477b0 tx=0x7fbb30015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:13.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:13.908+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb380420a0 con 0x7fbb3c0a7140 2021-11-15T14:42:14.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.020+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fbb3c0446d0 con 0x7fbb3c0a7140 2021-11-15T14:42:14.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.844+0000 7fbb2f7fe700 1 -- 172.21.2.135:0/3404685458 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v336) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbb38018030 con 0x7fbb3c0a7140 2021-11-15T14:42:14.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.844+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 msgr2=0x7fbb1c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:14.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.844+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 0x7fbb1c0559e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fbb3c1477b0 tx=0x7fbb30015000).stop 2021-11-15T14:42:14.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.844+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 msgr2=0x7fbb3c0ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:14.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.844+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fbb3c0b31f0 tx=0x7fbb38007c00).stop 2021-11-15T14:42:14.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 shutdown_connections 2021-11-15T14:42:14.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb1c053520 0x7fbb1c0559e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:14.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbb3c148420 0x7fbb3c063a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbb3c0b1e30 0x7fbb3c0ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 --2- 172.21.2.135:0/3404685458 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbb3c0a7140 0x7fbb3c0ab040 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:14.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 >> 172.21.2.135:0/3404685458 conn(0x7fbb3c05f730 msgr2=0x7fbb3c1449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:14.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 shutdown_connections 2021-11-15T14:42:14.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.848+0000 7fbb44640700 1 -- 172.21.2.135:0/3404685458 wait complete. 2021-11-15T14:42:14.856 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:42:14.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.904+0000 7fc10072b700 1 Processor -- start 2021-11-15T14:42:14.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.904+0000 7fc10072b700 1 -- start start 2021-11-15T14:42:14.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b1350 0x7fc0f80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc0f80b2320 0x7fc0f81412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80a7850 con 0x7fc0f80b1f40 2021-11-15T14:42:14.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80b17c0 con 0x7fc0f80b2320 2021-11-15T14:42:14.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b06d0 con 0x7fc0f80b1350 2021-11-15T14:42:14.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc0f80b1f40 0x7fc0f80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49682/0 (socket says 172.21.2.135:49682) 2021-11-15T14:42:14.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 -- 172.21.2.135:0/651667717 learned_addr learned my addr 172.21.2.135:0/651667717 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:14.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 --2- 172.21.2.135:0/651667717 >> v2:172.21.2.135:3300/0 conn(0x7fc0f80b2320 0x7fc0f81412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:14.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fd4c5700 1 -- 172.21.2.135:0/651667717 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673309300 0 0) 0x7fc0f80a7850 con 0x7fc0f80b1f40 2021-11-15T14:42:14.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fd4c5700 1 -- 172.21.2.135:0/651667717 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e0003260 con 0x7fc0f80b1f40 2021-11-15T14:42:14.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 -- 172.21.2.135:0/651667717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b1350 msgr2=0x7fc0f80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:14.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 --2- 172.21.2.135:0/651667717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b1350 0x7fc0f80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 -- 172.21.2.135:0/651667717 >> v1:172.21.2.135:6789/0 conn(0x7fc0f80b1f40 legacy=0x7fc0f80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:14.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 -- 172.21.2.135:0/651667717 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80b0970 con 0x7fc0f80b2320 2021-11-15T14:42:14.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fecc8700 1 --2- 172.21.2.135:0/651667717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b2320 0x7fc0f81412d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fc0f00032f0 tx=0x7fc0f00091d0).ready entity=mon.1 client_cookie=fa380c3102746bf6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:14.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fd4c5700 1 -- 172.21.2.135:0/651667717 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f000b6c0 con 0x7fc0f80b2320 2021-11-15T14:42:14.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fd4c5700 1 -- 172.21.2.135:0/651667717 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000b820 con 0x7fc0f80b2320 2021-11-15T14:42:14.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fd4c5700 1 -- 172.21.2.135:0/651667717 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f000b990 con 0x7fc0f80b2320 2021-11-15T14:42:14.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- 172.21.2.135:0/651667717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b2320 msgr2=0x7fc0f81412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:14.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- 172.21.2.135:0/651667717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b2320 0x7fc0f81412d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fc0f00032f0 tx=0x7fc0f00091d0).stop 2021-11-15T14:42:14.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- 172.21.2.135:0/651667717 shutdown_connections 2021-11-15T14:42:14.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- 172.21.2.135:0/651667717 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b2320 0x7fc0f81412d0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:14.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- 172.21.2.135:0/651667717 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b1350 0x7fc0f80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- 172.21.2.135:0/651667717 >> 172.21.2.135:0/651667717 conn(0x7fc0f805f730 msgr2=0x7fc0f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:14.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- 172.21.2.135:0/651667717 shutdown_connections 2021-11-15T14:42:14.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- 172.21.2.135:0/651667717 wait complete. 2021-11-15T14:42:14.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 Processor -- start 2021-11-15T14:42:14.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- start start 2021-11-15T14:42:14.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0f80b1f40 0x7fc0f80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b2320 0x7fc0f80ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814a410 con 0x7fc0f80b1f40 2021-11-15T14:42:14.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8149b50 con 0x7fc0f80b1350 2021-11-15T14:42:14.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc10072b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814b000 con 0x7fc0f80b2320 2021-11-15T14:42:14.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:14.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33868/0 (socket says 172.21.2.135:33868) 2021-11-15T14:42:14.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 -- 172.21.2.135:0/1528650825 learned_addr learned my addr 172.21.2.135:0/1528650825 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:14.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 -- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b2320 msgr2=0x7fc0f80ab440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:14.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b2320 0x7fc0f80ab440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 -- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0f80b1f40 msgr2=0x7fc0f80b4e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:14.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0f80b1f40 0x7fc0f80b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:14.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.908+0000 7fc0fe4c7700 1 -- 172.21.2.135:0/1528650825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009470 con 0x7fc0f80b1350 2021-11-15T14:42:14.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0fe4c7700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc0f4001110 tx=0x7fc0f4007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:14.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f40070d0 con 0x7fc0f80b1350 2021-11-15T14:42:14.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4007230 con 0x7fc0f80b1350 2021-11-15T14:42:14.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0f4005610 con 0x7fc0f80b1350 2021-11-15T14:42:14.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80b4a80 con 0x7fc0f80b1350 2021-11-15T14:42:14.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f80b5520 con 0x7fc0f80b1350 2021-11-15T14:42:14.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f814b1c0 con 0x7fc0f80b1350 2021-11-15T14:42:14.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0f4010070 con 0x7fc0f80b1350 2021-11-15T14:42:14.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 0x7fc0d8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:14.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc0f406af80 con 0x7fc0f80b1350 2021-11-15T14:42:14.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0fdcc6700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 0x7fc0d8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:14.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0fdcc6700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 0x7fc0d8055be0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc0e8002f70 tx=0x7fc0e8006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:14.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.912+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0f4042150 con 0x7fc0f80b1350 2021-11-15T14:42:15.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:14.996+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc0f80573d0 con 0x7fc0f80b1350 2021-11-15T14:42:15.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.008+0000 7fc0e77fe700 1 -- 172.21.2.135:0/1528650825 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0f4045770 con 0x7fc0f80b1350 2021-11-15T14:42:15.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 msgr2=0x7fc0d8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 0x7fc0d8055be0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fc0e8002f70 tx=0x7fc0e8006a00).stop 2021-11-15T14:42:15.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 msgr2=0x7fc0f814ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fc0f4001110 tx=0x7fc0f4007aa0).stop 2021-11-15T14:42:15.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 shutdown_connections 2021-11-15T14:42:15.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc0d8053720 0x7fc0d8055be0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc0f80b2320 0x7fc0f80ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc0f80b1f40 0x7fc0f80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 --2- 172.21.2.135:0/1528650825 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc0f80b1350 0x7fc0f814ab10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 >> 172.21.2.135:0/1528650825 conn(0x7fc0f805f730 msgr2=0x7fc0f813cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 shutdown_connections 2021-11-15T14:42:15.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.012+0000 7fc10072b700 1 -- 172.21.2.135:0/1528650825 wait complete. 2021-11-15T14:42:15.043 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:42:15.043 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:15.069 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:15.092 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:15.119 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:15.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:42:15.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:15.139 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:15.140 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:15.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:15.192 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:42:15.193 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:15.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:15.198 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:15.198 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:15.234 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:42:15.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:15.237 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:15.237 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:42:15.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.312+0000 7ff1faf95700 1 Processor -- start 2021-11-15T14:42:15.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.312+0000 7ff1faf95700 1 -- start start 2021-11-15T14:42:15.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff1f40b1050 0x7ff1f41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b03d0 con 0x7ff1f4148420 2021-11-15T14:42:15.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b0670 con 0x7ff1f40b1e30 2021-11-15T14:42:15.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40a9140 con 0x7ff1f40b1050 2021-11-15T14:42:15.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff1f40b1e30 0x7ff1f40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49696/0 (socket says 172.21.2.135:49696) 2021-11-15T14:42:15.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 -- 172.21.2.135:0/3031177311 learned_addr learned my addr 172.21.2.135:0/3031177311 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:15.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109366766 0 0) 0x7ff1f40b0670 con 0x7ff1f40b1e30 2021-11-15T14:42:15.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e0003260 con 0x7ff1f40b1e30 2021-11-15T14:42:15.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f9532700 1 --2- 172.21.2.135:0/3031177311 >> v2:172.21.2.119:3300/0 conn(0x7ff1f40b1050 0x7ff1f41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321032134 0 0) 0x7ff1e0003260 con 0x7ff1f40b1e30 2021-11-15T14:42:15.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 >> v2:172.21.2.119:3300/0 conn(0x7ff1f40b1050 msgr2=0x7ff1f41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 --2- 172.21.2.135:0/3031177311 >> v2:172.21.2.119:3300/0 conn(0x7ff1f40b1050 0x7ff1f41447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 >> v1:172.21.2.119:6789/0 conn(0x7ff1f4148420 legacy=0x7ff1f40a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40b0910 con 0x7ff1f40b1e30 2021-11-15T14:42:15.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff1e4001660 con 0x7ff1f40b1e30 2021-11-15T14:42:15.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 >> v1:172.21.2.135:6789/0 conn(0x7ff1f40b1e30 legacy=0x7ff1f40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 0x7ff1e0003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1e0004500 0x7ff1e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0004f90 0x7ff1e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e000be50 con 0x7ff1e0004f90 2021-11-15T14:42:15.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e000bfc0 con 0x7ff1e0003820 2021-11-15T14:42:15.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e000c180 con 0x7ff1e0004500 2021-11-15T14:42:15.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 0x7ff1e0003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 -- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1e0004500 msgr2=0x7ff1e0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1e0004500 0x7ff1e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 -- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0004f90 msgr2=0x7ff1e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0004f90 0x7ff1e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f9532700 1 -- 172.21.2.135:0/3031177311 reap_dead start 2021-11-15T14:42:15.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 -- 172.21.2.135:0/3031177311 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0003260 con 0x7ff1e0003820 2021-11-15T14:42:15.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 0x7ff1e0003c40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7ff1f41477b0 tx=0x7ff1f40b0800).ready entity=mon.1 client_cookie=ed15ecf4c09b6180 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e40070d0 con 0x7ff1e0003820 2021-11-15T14:42:15.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4007230 con 0x7ff1e0003820 2021-11-15T14:42:15.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1f37fe700 1 -- 172.21.2.135:0/3031177311 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e400c8f0 con 0x7ff1e0003820 2021-11-15T14:42:15.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 msgr2=0x7ff1e0003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 0x7ff1e0003c40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7ff1f41477b0 tx=0x7ff1f40b0800).stop 2021-11-15T14:42:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- 172.21.2.135:0/3031177311 shutdown_connections 2021-11-15T14:42:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 --2- 172.21.2.135:0/3031177311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1e0003820 0x7ff1e0003c40 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- 172.21.2.135:0/3031177311 >> 172.21.2.135:0/3031177311 conn(0x7ff1f405f730 msgr2=0x7ff1f405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- 172.21.2.135:0/3031177311 shutdown_connections 2021-11-15T14:42:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- 172.21.2.135:0/3031177311 wait complete. 2021-11-15T14:42:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 Processor -- start 2021-11-15T14:42:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.316+0000 7ff1faf95700 1 -- start start 2021-11-15T14:42:15.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0003820 0x7ff1f40ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1f414a630 0x7ff1f414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40aeb30 con 0x7ff1e0003820 2021-11-15T14:42:15.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40ab850 con 0x7ff1f40aad20 2021-11-15T14:42:15.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40aa6d0 con 0x7ff1f414a630 2021-11-15T14:42:15.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33892/0 (socket says 172.21.2.135:33892) 2021-11-15T14:42:15.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 -- 172.21.2.135:0/375374784 learned_addr learned my addr 172.21.2.135:0/375374784 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:15.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f3fff700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1f414a630 0x7ff1f414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 -- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1f414a630 msgr2=0x7ff1f414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1f414a630 0x7ff1f414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 -- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0003820 msgr2=0x7ff1f40ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0003820 0x7ff1f40ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0003820 0x7ff1f40ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 -- 172.21.2.135:0/375374784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40abab0 con 0x7ff1f40aad20 2021-11-15T14:42:15.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f9532700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7ff1e4001110 tx=0x7ff1ec008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec00c070 con 0x7ff1f40aad20 2021-11-15T14:42:15.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0135e0 con 0x7ff1f40aad20 2021-11-15T14:42:15.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40abd50 con 0x7ff1f40aad20 2021-11-15T14:42:15.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec013940 con 0x7ff1f40aad20 2021-11-15T14:42:15.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f40aa920 con 0x7ff1f40aad20 2021-11-15T14:42:15.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f40b0bb0 con 0x7ff1f40aad20 2021-11-15T14:42:15.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1ec01b030 con 0x7ff1f40aad20 2021-11-15T14:42:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 0x7ff1d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff1ec06ac70 con 0x7ff1f40aad20 2021-11-15T14:42:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 0x7ff1d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.320+0000 7ff1f8d31700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 0x7ff1d4055b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff1e4005000 tx=0x7ff1e4013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.324+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1ec041f50 con 0x7ff1f40aad20 2021-11-15T14:42:15.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff1f40573d0 con 0x7ff1f40aad20 2021-11-15T14:42:15.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1f1ffb700 1 -- 172.21.2.135:0/375374784 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+29229 (secure 0 0 0) 0x7ff1ec045570 con 0x7ff1f40aad20 2021-11-15T14:42:15.412 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:15.412 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:15.412 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 116, 2021-11-15T14:42:15.413 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:42:15.413 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:42:15.413 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:42:12.819392+0000", 2021-11-15T14:42:15.413 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:15.413 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:15.414 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:42:15.414 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:42:15.414 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:42:15.414 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:42:15.415 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:42:15.415 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:42:15.415 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:42:15.415 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:15.416 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:42:15.416 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:42:15.416 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:42:15.416 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:42:15.417 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:42:15.417 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 20, 2021-11-15T14:42:15.417 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:42:15.417 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:42:15.417 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:42:15.418 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:42:15.418 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:15.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.418 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:42:15.419 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:42:15.419 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:42:15.419 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:15.419 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:15.420 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:15.420 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:15.420 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:15.420 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:15.420 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:15.421 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:15.421 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:42:15.421 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:42:15.421 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:42:15.422 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:42:15.422 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:42:15.422 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:15.422 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:15.423 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:15.423 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:15.423 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:15.423 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:15.423 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:15.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:42:15.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:15.424 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:15.425 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:15.425 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:15.425 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:15.425 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:15.426 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:15.426 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:15.426 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:15.426 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:15.426 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:15.427 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:15.427 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:15.427 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:15.427 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:15.428 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:15.428 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:15.428 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:15.428 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:15.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:15.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:15.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:15.429 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:15.430 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:15.430 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:15.430 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:15.430 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.431 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:15.431 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:15.431 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:15.431 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:15.431 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:15.432 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:15.432 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:15.432 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:15.432 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:15.433 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:15.433 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:15.433 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:15.433 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:42:15.434 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.434 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:15.434 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:42:15.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.434 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.435 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:42:15.435 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:42:15.435 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:42:15.436 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:15.436 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:15.436 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:15.436 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:15.437 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:15.437 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:15.437 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:15.437 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:15.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:15.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:15.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:15.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:15.438 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:15.439 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:15.439 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:15.439 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:15.439 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:15.440 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:15.440 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:15.440 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:15.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.440 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:42:15.441 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:15.441 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:15.441 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:15.441 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:15.442 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:15.442 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:15.442 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:15.442 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:15.443 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:15.443 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:15.443 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:15.443 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:15.444 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:15.444 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:15.444 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:15.444 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:15.444 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:15.445 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:15.445 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:15.445 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:15.445 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:15.446 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:15.446 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:15.446 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:15.446 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:15.447 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:15.447 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.447 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:15.447 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:15.447 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:15.448 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:15.448 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:15.448 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:15.448 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:15.449 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:15.449 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:15.449 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:15.449 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:15.449 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:15.450 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:15.450 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:42:15.450 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.450 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.451 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:15.451 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:42:15.451 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.451 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:15.451 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:42:15.452 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.452 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.452 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.452 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.453 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:42:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:42:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.456 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:42:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:42:15.459 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.460 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:42:15.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:42:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.463 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:42:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:42:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:42:15.467 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:42:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:42:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:42:15.471 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:42:15.473 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 110, 2021-11-15T14:42:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.475 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.476 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:42:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:42:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.478 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:42:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.480 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:42:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.481 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:42:15.483 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:42:15.484 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.485 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:42:15.486 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.487 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:42:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.488 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:42:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:42:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:42:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:42:15.489 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.490 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:42:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.491 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.492 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.493 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:42:15.494 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:42:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.497 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:42:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:42:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:42:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.501 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:42:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:42:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.504 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:42:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.505 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:42:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:42:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:42:15.506 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:42:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.507 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:42:15.508 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.509 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.510 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.511 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:42:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.512 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:42:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.513 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.514 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:42:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.515 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:42:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.516 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.517 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:42:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.518 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:42:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.519 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:42:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.521 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:42:15.522 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:42:15.523 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:42:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:42:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:42:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.524 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.525 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:42:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.526 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.527 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 110, 2021-11-15T14:42:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.528 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:42:15.529 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:42:15.530 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.531 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:42:15.532 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.533 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:42:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.534 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:42:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.536 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:42:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.537 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.538 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:42:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.539 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:42:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.540 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:42:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:42:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:42:15.541 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:42:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.542 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:42:15.543 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.544 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.545 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.546 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:42:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.547 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:42:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.548 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.549 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:42:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.550 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:42:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.551 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.552 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:42:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:42:15.554 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:42:15.556 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:42:15.557 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.558 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:42:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:42:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:42:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:42:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.559 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.560 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:42:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.561 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.562 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.563 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:42:15.564 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.565 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:42:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.566 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:42:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.568 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:42:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.569 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.570 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:42:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.571 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:42:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.572 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.573 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:42:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.574 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:42:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.575 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:42:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:42:15.576 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:42:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:42:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.577 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:15.578 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:42:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:15.579 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:15.580 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.581 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:42:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.582 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:42:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.583 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.584 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:42:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.585 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:42:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.586 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.587 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:42:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.588 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:42:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.589 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:15.590 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:42:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.591 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:42:15.592 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.593 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:42:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:42:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:42:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:42:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:15.594 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.595 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:42:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:15.596 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.597 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:42:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.598 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.599 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:42:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.600 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.601 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:42:15.602 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.603 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.604 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:42:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:15.605 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:42:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:15.607 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.608 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:42:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.609 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.610 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:42:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.611 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:15.612 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:42:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:15.613 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:42:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:42:15.614 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:42:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:42:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:42:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/1824406336": "2021-11-16T14:42:08.930219+0000", 2021-11-15T14:42:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/1824406336": "2021-11-16T14:42:08.930219+0000" 2021-11-15T14:42:15.615 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:42:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:42:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:42:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:15.616 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:42:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:42:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:42:15.617 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:42:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:42:15.618 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:42:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:42:15.619 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:42:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:15.620 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:42:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:42:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:42:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:42:15.621 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:42:15.622 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:15.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 msgr2=0x7ff1d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 0x7ff1d4055b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff1e4005000 tx=0x7ff1e4013000).stop 2021-11-15T14:42:15.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 msgr2=0x7ff1f414b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7ff1e4001110 tx=0x7ff1ec008040).stop 2021-11-15T14:42:15.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 shutdown_connections 2021-11-15T14:42:15.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff1d40536a0 0x7ff1d4055b60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff1f40aad20 0x7ff1f414b900 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff1f414a630 0x7ff1f414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 --2- 172.21.2.135:0/375374784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff1e0003820 0x7ff1f40ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 >> 172.21.2.135:0/375374784 conn(0x7ff1f405f730 msgr2=0x7ff1f40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 shutdown_connections 2021-11-15T14:42:15.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.408+0000 7ff1faf95700 1 -- 172.21.2.135:0/375374784 wait complete. 2021-11-15T14:42:15.627 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:15.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.676+0000 7f5e420d5700 1 Processor -- start 2021-11-15T14:42:15.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- start start 2021-11-15T14:42:15.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5e3c05d7e0 0x7f5e3c0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 0x7f5e3c13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0b04b0 con 0x7f5e3c0afca0 2021-11-15T14:42:15.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b57d0 con 0x7f5e3c05d7e0 2021-11-15T14:42:15.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b06e0 con 0x7f5e3c0b0bb0 2021-11-15T14:42:15.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3affd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5e3c0afca0 0x7f5e3c13f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49716/0 (socket says 172.21.2.135:49716) 2021-11-15T14:42:15.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3affd700 1 -- 172.21.2.135:0/65822317 learned_addr learned my addr 172.21.2.135:0/65822317 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:15.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808454970 0 0) 0x7f5e3c0b04b0 con 0x7f5e3c0afca0 2021-11-15T14:42:15.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e28003260 con 0x7f5e3c0afca0 2021-11-15T14:42:15.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/65822317 >> v2:172.21.2.119:3300/0 conn(0x7f5e3c05d7e0 0x7f5e3c0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3bfff700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 0x7f5e3c13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1651623703 0 0) 0x7f5e28003260 con 0x7f5e3c0afca0 2021-11-15T14:42:15.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 msgr2=0x7f5e3c13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 0x7f5e3c13f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 >> v2:172.21.2.119:3300/0 conn(0x7f5e3c05d7e0 msgr2=0x7f5e3c0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 --2- 172.21.2.135:0/65822317 >> v2:172.21.2.119:3300/0 conn(0x7f5e3c05d7e0 0x7f5e3c0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0b5a30 con 0x7f5e3c0afca0 2021-11-15T14:42:15.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5e30001660 con 0x7f5e3c0afca0 2021-11-15T14:42:15.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 >> v1:172.21.2.135:6789/0 conn(0x7f5e3c0afca0 legacy=0x7f5e3c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e280037d0 0x7f5e28003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e28004500 0x7f5e28004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 0x7f5e28004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b57d0 con 0x7f5e28004500 2021-11-15T14:42:15.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b06e0 con 0x7f5e280037d0 2021-11-15T14:42:15.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2800b7d0 con 0x7f5e3c0b0bb0 2021-11-15T14:42:15.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e280037d0 0x7f5e28003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 -- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 msgr2=0x7f5e28004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e3c0b0bb0 0x7f5e28004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 -- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e28004500 msgr2=0x7f5e28004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:15.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e28004500 0x7f5e28004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:15.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 -- 172.21.2.135:0/65822317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28003260 con 0x7f5e280037d0 2021-11-15T14:42:15.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e280037d0 0x7f5e28003bf0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f5e28004470 tx=0x7f5e2c008040).ready entity=mon.1 client_cookie=c1ecc424b6d2b775 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e2c013670 con 0x7f5e280037d0 2021-11-15T14:42:15.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c0137d0 con 0x7f5e280037d0 2021-11-15T14:42:15.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3a7fc700 1 -- 172.21.2.135:0/65822317 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e2c013b30 con 0x7f5e280037d0 2021-11-15T14:42:15.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- 172.21.2.135:0/65822317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e280037d0 msgr2=0x7f5e28003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 --2- 172.21.2.135:0/65822317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e280037d0 0x7f5e28003bf0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f5e28004470 tx=0x7f5e2c008040).stop 2021-11-15T14:42:15.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e3bfff700 1 -- 172.21.2.135:0/65822317 reap_dead start 2021-11-15T14:42:15.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- 172.21.2.135:0/65822317 shutdown_connections 2021-11-15T14:42:15.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- 172.21.2.135:0/65822317 >> 172.21.2.135:0/65822317 conn(0x7f5e3c062cb0 msgr2=0x7f5e3c063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- 172.21.2.135:0/65822317 shutdown_connections 2021-11-15T14:42:15.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- 172.21.2.135:0/65822317 wait complete. 2021-11-15T14:42:15.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 Processor -- start 2021-11-15T14:42:15.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.680+0000 7f5e420d5700 1 -- start start 2021-11-15T14:42:15.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 0x7f5e3c064ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 0x7f5e3c063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c137890 con 0x7f5e3c1381e0 2021-11-15T14:42:15.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c142860 con 0x7f5e3c067520 2021-11-15T14:42:15.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c142b00 con 0x7f5e280037d0 2021-11-15T14:42:15.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33912/0 (socket says 172.21.2.135:33912) 2021-11-15T14:42:15.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 -- 172.21.2.135:0/572051007 learned_addr learned my addr 172.21.2.135:0/572051007 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:15.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3bfff700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 0x7f5e3c063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 0x7f5e3c064ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 -- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 msgr2=0x7f5e3c064ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 0x7f5e3c064ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 -- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 msgr2=0x7f5e3c063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 0x7f5e3c063f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 -- 172.21.2.135:0/572051007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c138640 con 0x7f5e3c067520 2021-11-15T14:42:15.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3bfff700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 0x7f5e3c063f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:15.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 0x7f5e3c064ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:15.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3affd700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f5e30001370 tx=0x7f5e3c0ae980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e30007170 con 0x7f5e3c067520 2021-11-15T14:42:15.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300072d0 con 0x7f5e3c067520 2021-11-15T14:42:15.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c142da0 con 0x7f5e3c067520 2021-11-15T14:42:15.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e30004920 con 0x7f5e3c067520 2021-11-15T14:42:15.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c067090 con 0x7f5e3c067520 2021-11-15T14:42:15.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c137a00 con 0x7f5e3c067520 2021-11-15T14:42:15.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5e30004a80 con 0x7f5e3c067520 2021-11-15T14:42:15.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 0x7f5e1c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5e3006b390 con 0x7f5e3c067520 2021-11-15T14:42:15.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 0x7f5e1c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.684+0000 7f5e3b7fe700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 0x7f5e1c0559e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f5e2c002000 tx=0x7f5e2c018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.688+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e30042670 con 0x7f5e3c067520 2021-11-15T14:42:15.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e3c0b5cd0 con 0x7f5e3c067520 2021-11-15T14:42:15.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e38ff9700 1 -- 172.21.2.135:0/572051007 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f5e30045c90 con 0x7f5e3c067520 2021-11-15T14:42:15.799 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:15.799 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3013323628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3013323628},{"type":"v1","addr":"172.21.2.135:6835","nonce":3013323628}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[]} 2021-11-15T14:42:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 msgr2=0x7f5e1c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 0x7f5e1c0559e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f5e2c002000 tx=0x7f5e2c018000).stop 2021-11-15T14:42:15.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 msgr2=0x7f5e3c137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f5e30001370 tx=0x7f5e3c0ae980).stop 2021-11-15T14:42:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 shutdown_connections 2021-11-15T14:42:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5e1c053520 0x7f5e1c0559e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5e3c1381e0 0x7f5e3c063f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5e3c067520 0x7f5e3c137cf0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 --2- 172.21.2.135:0/572051007 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5e280037d0 0x7f5e3c064ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 >> 172.21.2.135:0/572051007 conn(0x7f5e3c062cb0 msgr2=0x7f5e3c0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 shutdown_connections 2021-11-15T14:42:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.796+0000 7f5e420d5700 1 -- 172.21.2.135:0/572051007 wait complete. 2021-11-15T14:42:15.803 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 56 2021-11-15T14:42:15.806 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:15.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.852+0000 7fad64268700 1 Processor -- start 2021-11-15T14:42:15.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.852+0000 7fad64268700 1 -- start start 2021-11-15T14:42:15.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 0x7fad5c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0b03d0 con 0x7fad5c0b1e30 2021-11-15T14:42:15.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0b0670 con 0x7fad5c148420 2021-11-15T14:42:15.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0a9140 con 0x7fad5c0b1050 2021-11-15T14:42:15.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61803700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fad5c148420 0x7fad5c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49738/0 (socket says 172.21.2.135:49738) 2021-11-15T14:42:15.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61803700 1 -- 172.21.2.135:0/891550404 learned_addr learned my addr 172.21.2.135:0/891550404 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:15.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 --2- 172.21.2.135:0/891550404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 0x7fad5c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600919146 0 0) 0x7fad5c0b03d0 con 0x7fad5c0b1e30 2021-11-15T14:42:15.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad44003260 con 0x7fad5c0b1e30 2021-11-15T14:42:15.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987512155 0 0) 0x7fad5c0b0670 con 0x7fad5c148420 2021-11-15T14:42:15.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c0b03d0 con 0x7fad5c148420 2021-11-15T14:42:15.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.0 v1:172.21.2.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223866726 0 0) 0x7fad44003260 con 0x7fad5c0b1e30 2021-11-15T14:42:15.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 -- 172.21.2.135:0/891550404 >> v1:172.21.2.135:6789/0 conn(0x7fad5c148420 legacy=0x7fad5c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 -- 172.21.2.135:0/891550404 >> v1:172.21.2.119:6789/0 conn(0x7fad5c0b1e30 legacy=0x7fad5c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 -- 172.21.2.135:0/891550404 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0b0910 con 0x7fad5c0b1050 2021-11-15T14:42:15.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 --2- 172.21.2.135:0/891550404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 0x7fad5c1447a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fad58001110 tx=0x7fad540091d0).ready entity=mon.2 client_cookie=19a2b7d3ad1afb3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad58001660 con 0x7fad5c0b1050 2021-11-15T14:42:15.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400f510 con 0x7fad5c0b1050 2021-11-15T14:42:15.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61002700 1 -- 172.21.2.135:0/891550404 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5400f680 con 0x7fad5c0b1050 2021-11-15T14:42:15.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/891550404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 msgr2=0x7fad5c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- 172.21.2.135:0/891550404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 0x7fad5c1447a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fad58001110 tx=0x7fad540091d0).stop 2021-11-15T14:42:15.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/891550404 shutdown_connections 2021-11-15T14:42:15.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- 172.21.2.135:0/891550404 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c0b1050 0x7fad5c1447a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/891550404 >> 172.21.2.135:0/891550404 conn(0x7fad5c05f730 msgr2=0x7fad5c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/891550404 shutdown_connections 2021-11-15T14:42:15.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/891550404 wait complete. 2021-11-15T14:42:15.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 Processor -- start 2021-11-15T14:42:15.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- start start 2021-11-15T14:42:15.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fad5c0b1e30 0x7fad5c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 0x7fad5c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0a9e90 con 0x7fad5c0b1e30 2021-11-15T14:42:15.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14e1b0 con 0x7fad5c0b1050 2021-11-15T14:42:15.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14e450 con 0x7fad5c148420 2021-11-15T14:42:15.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33922/0 (socket says 172.21.2.135:33922) 2021-11-15T14:42:15.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 -- 172.21.2.135:0/3723522129 learned_addr learned my addr 172.21.2.135:0/3723522129 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:15.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad61803700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fad5c0b1e30 0x7fad5c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 0x7fad5c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 -- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 msgr2=0x7fad5c0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 0x7fad5c0ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 -- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fad5c0b1e30 msgr2=0x7fad5c149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fad5c0b1e30 0x7fad5c149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 -- 172.21.2.135:0/3723522129 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009470 con 0x7fad5c0b1050 2021-11-15T14:42:15.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62805700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 0x7fad5c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:42:15.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad62004700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad58000fe0 tx=0x7fad58009250).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad58001b80 con 0x7fad5c0b1050 2021-11-15T14:42:15.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58001ce0 con 0x7fad5c0b1050 2021-11-15T14:42:15.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c14e6f0 con 0x7fad5c0b1050 2021-11-15T14:42:15.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad58003300 con 0x7fad5c0b1050 2021-11-15T14:42:15.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.856+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c0ab820 con 0x7fad5c0b1050 2021-11-15T14:42:15.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c0abad0 con 0x7fad5c0b1050 2021-11-15T14:42:15.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad5800f030 con 0x7fad5c0b1050 2021-11-15T14:42:15.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad4f7fe700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 0x7fad3c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:15.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fad5806b7b0 con 0x7fad5c0b1050 2021-11-15T14:42:15.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad61803700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 0x7fad3c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:15.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad61803700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 0x7fad3c055ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fad5000d000 tx=0x7fad50009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:15.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.860+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad580429f0 con 0x7fad5c0b1050 2021-11-15T14:42:15.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.968+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad5c14ba70 con 0x7fad5c0b1050 2021-11-15T14:42:15.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad4f7fe700 1 -- 172.21.2.135:0/3723522129 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fad5c14ba70 con 0x7fad5c0b1050 2021-11-15T14:42:15.974 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:15.974 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/3021172773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":3021172773},{"type":"v1","addr":"172.21.2.119:6835","nonce":3021172773}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/3803969477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":3803969477},{"type":"v1","addr":"172.21.2.135:6833","nonce":3803969477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3013323628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3013323628},{"type":"v1","addr":"172.21.2.135:6835","nonce":3013323628}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[]} 2021-11-15T14:42:15.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 msgr2=0x7fad3c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 0x7fad3c055ad0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fad5000d000 tx=0x7fad50009040).stop 2021-11-15T14:42:15.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 msgr2=0x7fad5c148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:15.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad58000fe0 tx=0x7fad58009250).stop 2021-11-15T14:42:15.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 shutdown_connections 2021-11-15T14:42:15.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fad3c053610 0x7fad3c055ad0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fad5c148420 0x7fad5c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fad5c0b1e30 0x7fad5c149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 --2- 172.21.2.135:0/3723522129 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fad5c0b1050 0x7fad5c148b40 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:15.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 >> 172.21.2.135:0/3723522129 conn(0x7fad5c05f730 msgr2=0x7fad5c146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:15.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 shutdown_connections 2021-11-15T14:42:15.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:15.972+0000 7fad64268700 1 -- 172.21.2.135:0/3723522129 wait complete. 2021-11-15T14:42:15.978 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 56 2021-11-15T14:42:15.981 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:42:15.982 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:42:15.982 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:42:15.982 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:15.983 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:42:15.983 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:42:15.983 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:42:15.984 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:15.984 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:42:15.984 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:42:15.985 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:42:15.985 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:15.988 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:42:15.988 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:42:15.990 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:42:15.990 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:42:15.991 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:42:15.991 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:15.992 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:42:15.993 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:15.996 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:42:15.997 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:42:15.999 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:42:15.999 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:16.000 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:42:16.022 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:42:16.024 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:42:16.032 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:42:16.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 Processor -- start 2021-11-15T14:42:16.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- start start 2021-11-15T14:42:16.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fabd00b0420 0x7fabd00b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:16.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00b0800 con 0x7fabd00b1130 2021-11-15T14:42:16.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00b1e60 con 0x7fabd00ae830 2021-11-15T14:42:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00af6b0 con 0x7fabd00b0420 2021-11-15T14:42:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd529b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fabd00ae830 0x7fabd00aec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49778/0 (socket says 172.21.2.135:49778) 2021-11-15T14:42:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd529b700 1 -- 172.21.2.135:0/702604750 learned_addr learned my addr 172.21.2.135:0/702604750 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:16.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd4a9a700 1 --2- 172.21.2.135:0/702604750 >> v2:172.21.2.119:3300/0 conn(0x7fabd00b0420 0x7fabd00b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabcf7fe700 1 -- 172.21.2.135:0/702604750 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472996055 0 0) 0x7fabd00b1e60 con 0x7fabd00ae830 2021-11-15T14:42:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabcf7fe700 1 -- 172.21.2.135:0/702604750 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc003260 con 0x7fabd00ae830 2021-11-15T14:42:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd4a9a700 1 -- 172.21.2.135:0/702604750 >> v1:172.21.2.135:6789/0 conn(0x7fabd00ae830 legacy=0x7fabd00aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:16.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd4a9a700 1 -- 172.21.2.135:0/702604750 >> v1:172.21.2.119:6789/0 conn(0x7fabd00b1130 legacy=0x7fabd0142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd4a9a700 1 -- 172.21.2.135:0/702604750 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00af950 con 0x7fabd00b0420 2021-11-15T14:42:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd4a9a700 1 --2- 172.21.2.135:0/702604750 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b0420 0x7fabd00b1550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fabc0001780 tx=0x7fabc4006e80).ready entity=mon.0 client_cookie=4adfebf1ba781bb5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabcf7fe700 1 -- 172.21.2.135:0/702604750 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc4010070 con 0x7fabd00b0420 2021-11-15T14:42:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabcf7fe700 1 -- 172.21.2.135:0/702604750 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4000e90 con 0x7fabd00b0420 2021-11-15T14:42:16.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabcf7fe700 1 -- 172.21.2.135:0/702604750 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc00015e0 con 0x7fabd00b0420 2021-11-15T14:42:16.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/702604750 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b0420 msgr2=0x7fabd00b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:16.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/702604750 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b0420 0x7fabd00b1550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fabc0001780 tx=0x7fabc4006e80).stop 2021-11-15T14:42:16.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/702604750 shutdown_connections 2021-11-15T14:42:16.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/702604750 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b0420 0x7fabd00b1550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:16.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/702604750 >> 172.21.2.135:0/702604750 conn(0x7fabd005c510 msgr2=0x7fabd005c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:16.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/702604750 shutdown_connections 2021-11-15T14:42:16.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/702604750 wait complete. 2021-11-15T14:42:16.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 Processor -- start 2021-11-15T14:42:16.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- start start 2021-11-15T14:42:16.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:16.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabd00b0420 0x7fabd0065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:16.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b1130 0x7fabd00676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:16.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00a8bc0 con 0x7fabd00b1130 2021-11-15T14:42:16.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0066290 con 0x7fabd00ae830 2021-11-15T14:42:16.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd009eab0 con 0x7fabd00b0420 2021-11-15T14:42:16.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:16.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33960/0 (socket says 172.21.2.135:33960) 2021-11-15T14:42:16.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 -- 172.21.2.135:0/403409592 learned_addr learned my addr 172.21.2.135:0/403409592 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:16.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 -- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabd00b0420 msgr2=0x7fabd0065910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:16.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabd00b0420 0x7fabd0065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:16.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 -- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b1130 msgr2=0x7fabd00676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:16.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b1130 0x7fabd00676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:16.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 -- 172.21.2.135:0/403409592 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4008170 con 0x7fabd00ae830 2021-11-15T14:42:16.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd4a9a700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fabc0001780 tx=0x7fabc4018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:16.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc4015d10 con 0x7fabd00ae830 2021-11-15T14:42:16.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4015e70 con 0x7fabd00ae830 2021-11-15T14:42:16.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd00a8920 con 0x7fabd00ae830 2021-11-15T14:42:16.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0065f80 con 0x7fabd00ae830 2021-11-15T14:42:16.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc401e600 con 0x7fabd00ae830 2021-11-15T14:42:16.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd00b2080 con 0x7fabd00ae830 2021-11-15T14:42:16.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fabc401c040 con 0x7fabd00ae830 2021-11-15T14:42:16.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 0x7fabb0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:16.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fabc406ee00 con 0x7fabd00ae830 2021-11-15T14:42:16.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcffff700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 0x7fabb0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:16.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.056+0000 7fabcffff700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 0x7fabb0055bb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fabc8001490 tx=0x7fabc8007b50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:16.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.060+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabc4045fd0 con 0x7fabd00ae830 2021-11-15T14:42:16.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:16.152+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fabd00b2080 con 0x7fabd00ae830 2021-11-15T14:42:17.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.048+0000 7fabcdffb700 1 -- 172.21.2.135:0/403409592 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7fabc40495f0 con 0x7fabd00ae830 2021-11-15T14:42:17.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.048+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 msgr2=0x7fabb0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.048+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 0x7fabb0055bb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fabc8001490 tx=0x7fabc8007b50).stop 2021-11-15T14:42:17.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.048+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 msgr2=0x7fabd0143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.048+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fabc0001780 tx=0x7fabc4018000).stop 2021-11-15T14:42:17.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 shutdown_connections 2021-11-15T14:42:17.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fabb00536f0 0x7fabb0055bb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabd00b1130 0x7fabd00676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabd00b0420 0x7fabd0065910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 --2- 172.21.2.135:0/403409592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabd00ae830 0x7fabd0143bf0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 >> 172.21.2.135:0/403409592 conn(0x7fabd005c510 msgr2=0x7fabd01449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 shutdown_connections 2021-11-15T14:42:17.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.052+0000 7fabd5a9c700 1 -- 172.21.2.135:0/403409592 wait complete. 2021-11-15T14:42:17.057 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:42:17.062 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:42:17.062 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:42:17.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.180+0000 7f43d3402700 1 Processor -- start 2021-11-15T14:42:17.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.180+0000 7f43d3402700 1 -- start start 2021-11-15T14:42:17.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f43cc0b2280 0x7f43cc0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b0050 0x7f43cc0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f43cc141720 0x7f43cc141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0ac860 con 0x7f43cc141720 2021-11-15T14:42:17.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc1452d0 con 0x7f43cc0b2280 2021-11-15T14:42:17.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc145570 con 0x7f43cc0b0050 2021-11-15T14:42:17.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f43cc0b2280 0x7f43cc0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f43cc0b2280 0x7f43cc0abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33972/0 (socket says 172.21.2.135:33972) 2021-11-15T14:42:17.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/2211460462 learned_addr learned my addr 172.21.2.135:0/2211460462 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/2211460462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b0050 msgr2=0x7f43cc0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:17.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/2211460462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b0050 0x7f43cc0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/2211460462 >> v2:172.21.2.119:3300/0 conn(0x7f43cc141720 msgr2=0x7f43cc141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:17.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/2211460462 >> v2:172.21.2.119:3300/0 conn(0x7f43cc141720 0x7f43cc141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/2211460462 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc141280 con 0x7f43cc0b2280 2021-11-15T14:42:17.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/2211460462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b2280 0x7f43cc0abe80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f43bc002f70 tx=0x7f43bc006eb0).ready entity=mon.1 client_cookie=1efc5076921c88d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43bbfff700 1 -- 172.21.2.135:0/2211460462 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc00d570 con 0x7f43cc0b2280 2021-11-15T14:42:17.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43bbfff700 1 -- 172.21.2.135:0/2211460462 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc000e90 con 0x7f43cc0b2280 2021-11-15T14:42:17.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43bbfff700 1 -- 172.21.2.135:0/2211460462 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc00d900 con 0x7f43cc0b2280 2021-11-15T14:42:17.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/2211460462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b2280 msgr2=0x7f43cc0abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- 172.21.2.135:0/2211460462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b2280 0x7f43cc0abe80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f43bc002f70 tx=0x7f43bc006eb0).stop 2021-11-15T14:42:17.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/2211460462 shutdown_connections 2021-11-15T14:42:17.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- 172.21.2.135:0/2211460462 >> v2:172.21.2.119:3300/0 conn(0x7f43cc141720 0x7f43cc141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- 172.21.2.135:0/2211460462 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b0050 0x7f43cc0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- 172.21.2.135:0/2211460462 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b2280 0x7f43cc0abe80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/2211460462 >> 172.21.2.135:0/2211460462 conn(0x7f43cc05f730 msgr2=0x7f43cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/2211460462 shutdown_connections 2021-11-15T14:42:17.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/2211460462 wait complete. 2021-11-15T14:42:17.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 Processor -- start 2021-11-15T14:42:17.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- start start 2021-11-15T14:42:17.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b2280 0x7f43cc13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43cc141720 0x7f43cc13fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc140e60 con 0x7f43cc141720 2021-11-15T14:42:17.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc142b70 con 0x7f43cc0b0050 2021-11-15T14:42:17.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc13ae00 con 0x7f43cc0b2280 2021-11-15T14:42:17.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33976/0 (socket says 172.21.2.135:33976) 2021-11-15T14:42:17.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/714279962 learned_addr learned my addr 172.21.2.135:0/714279962 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b2280 msgr2=0x7f43cc13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b2280 0x7f43cc13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43cc141720 msgr2=0x7f43cc13fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43cc141720 0x7f43cc13fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 -- 172.21.2.135:0/714279962 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc00b1e0 con 0x7f43cc0b0050 2021-11-15T14:42:17.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d119e700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f43bc002f70 tx=0x7f43bc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc011990 con 0x7f43cc0b0050 2021-11-15T14:42:17.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc011af0 con 0x7f43cc0b0050 2021-11-15T14:42:17.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc13b0a0 con 0x7f43cc0b0050 2021-11-15T14:42:17.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc011e50 con 0x7f43cc0b0050 2021-11-15T14:42:17.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.184+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1338c0 con 0x7f43cc0b0050 2021-11-15T14:42:17.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc133a50 con 0x7f43cc0b0050 2021-11-15T14:42:17.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43bc025030 con 0x7f43cc0b0050 2021-11-15T14:42:17.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43ba7fc700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 0x7f43ac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f43bc06cc80 con 0x7f43cc0b0050 2021-11-15T14:42:17.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43d099d700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 0x7f43ac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43d099d700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 0x7f43ac055b60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f43c8002f70 tx=0x7f43c8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.188+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43bc073080 con 0x7f43cc0b0050 2021-11-15T14:42:17.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43cc0573d0 con 0x7f43cc0b0050 2021-11-15T14:42:17.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43ba7fc700 1 -- 172.21.2.135:0/714279962 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f43bc023020 con 0x7f43cc0b0050 2021-11-15T14:42:17.308 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:17.308 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:17.308 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:42:17.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.309 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:42:17.309 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:42:17.309 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.309 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:17.310 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.310 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.310 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.311 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.311 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.311 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:42:17.311 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:42:17.311 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.312 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:17.312 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.312 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.312 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.313 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.313 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.313 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.313 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:42:17.314 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:42:17.314 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.314 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:17.314 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.315 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.315 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.315 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.316 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:42:17.316 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:42:17.316 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.316 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.317 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.317 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.317 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.317 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.318 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.318 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:42:17.318 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:42:17.318 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.319 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.319 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.319 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.319 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.320 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.320 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:42:17.321 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:42:17.321 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.321 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.321 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.322 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.322 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.322 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:42:17.323 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:42:17.323 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.323 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.323 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.324 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.324 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.324 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:42:17.325 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:42:17.325 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.325 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.325 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.326 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.326 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.326 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.327 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.327 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:42:17.327 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:42:17.327 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.327 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.328 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.328 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.328 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.329 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.329 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:42:17.329 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:42:17.329 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.330 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.330 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.330 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.330 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.331 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.331 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:42:17.331 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:42:17.332 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.332 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.332 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.332 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.333 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.333 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.333 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:42:17.334 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:42:17.334 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.334 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:17.334 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:42:17.335 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:42:17.335 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.335 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.335 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:42:17.336 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:42:17.336 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.336 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:17.336 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:42:17.337 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:42:17.337 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.338 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:42:17.338 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:42:17.339 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.339 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:17.339 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:17.340 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:17.340 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.340 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.340 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.341 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:42:17.341 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:42:17.341 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.341 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:17.342 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:42:17.342 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.342 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.343 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.343 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:42:17.343 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:42:17.343 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:17.344 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:17.344 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:42:17.344 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:17.344 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.344 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.345 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:17.345 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:17.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 msgr2=0x7f43ac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 0x7f43ac055b60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f43c8002f70 tx=0x7f43c8006a80).stop 2021-11-15T14:42:17.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 msgr2=0x7f43cc1347f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f43bc002f70 tx=0x7f43bc015000).stop 2021-11-15T14:42:17.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 shutdown_connections 2021-11-15T14:42:17.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43ac0536a0 0x7f43ac055b60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43cc141720 0x7f43cc13fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43cc0b2280 0x7f43cc13f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 --2- 172.21.2.135:0/714279962 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43cc0b0050 0x7f43cc1347f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 >> 172.21.2.135:0/714279962 conn(0x7f43cc05f730 msgr2=0x7f43cc0b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 shutdown_connections 2021-11-15T14:42:17.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.304+0000 7f43d3402700 1 -- 172.21.2.135:0/714279962 wait complete. 2021-11-15T14:42:17.350 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:17.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 Processor -- start 2021-11-15T14:42:17.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 -- start start 2021-11-15T14:42:17.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f609c0b0900 0x7f609c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0b2b70 con 0x7f609c0b0520 2021-11-15T14:42:17.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0b27f0 con 0x7f609c0b0900 2021-11-15T14:42:17.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.404+0000 7f60a3465700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0b2da0 con 0x7f609c0aa1a0 2021-11-15T14:42:17.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a0a00700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f609c0b0900 0x7f609c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a0a00700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:43762/0 (socket says 172.21.2.135:43762) 2021-11-15T14:42:17.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a0a00700 1 -- 172.21.2.135:0/1677758930 learned_addr learned my addr 172.21.2.135:0/1677758930 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 -- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 msgr2=0x7f609c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:17.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 -- 172.21.2.135:0/1677758930 >> v1:172.21.2.119:6789/0 conn(0x7f609c0b0520 legacy=0x7f609c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 -- 172.21.2.135:0/1677758930 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0a9bf0 con 0x7f609c0b0900 2021-11-15T14:42:17.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a0a00700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:42:17.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a1a02700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0900 0x7f609c140620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6098002f70 tx=0x7f6098006df0).ready entity=mon.0 client_cookie=7629b11a7daf829c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f608bfff700 1 -- 172.21.2.135:0/1677758930 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609800d570 con 0x7f609c0b0900 2021-11-15T14:42:17.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f608bfff700 1 -- 172.21.2.135:0/1677758930 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098000e90 con 0x7f609c0b0900 2021-11-15T14:42:17.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f608bfff700 1 -- 172.21.2.135:0/1677758930 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609800d8c0 con 0x7f609c0b0900 2021-11-15T14:42:17.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 -- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0900 msgr2=0x7f609c140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0900 0x7f609c140620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6098002f70 tx=0x7f6098006df0).stop 2021-11-15T14:42:17.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 -- 172.21.2.135:0/1677758930 shutdown_connections 2021-11-15T14:42:17.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0900 0x7f609c140620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 --2- 172.21.2.135:0/1677758930 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0aa1a0 0x7f609c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 -- 172.21.2.135:0/1677758930 >> 172.21.2.135:0/1677758930 conn(0x7f609c060840 msgr2=0x7f609c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 -- 172.21.2.135:0/1677758930 shutdown_connections 2021-11-15T14:42:17.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.408+0000 7f60a3465700 1 -- 172.21.2.135:0/1677758930 wait complete. 2021-11-15T14:42:17.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 Processor -- start 2021-11-15T14:42:17.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- start start 2021-11-15T14:42:17.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0520 0x7f609c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0b0900 0x7f609c0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0b1290 con 0x7f609c0b0520 2021-11-15T14:42:17.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0abc50 con 0x7f609c0aa1a0 2021-11-15T14:42:17.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0abef0 con 0x7f609c0b0900 2021-11-15T14:42:17.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:33992/0 (socket says 172.21.2.135:33992) 2021-11-15T14:42:17.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 -- 172.21.2.135:0/1147109246 learned_addr learned my addr 172.21.2.135:0/1147109246 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 -- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0b0900 msgr2=0x7f609c0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0b0900 0x7f609c0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 -- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0520 msgr2=0x7f609c149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0520 0x7f609c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 -- 172.21.2.135:0/1147109246 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c00b1e0 con 0x7f609c0aa1a0 2021-11-15T14:42:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a1201700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f609c0ad450 tx=0x7f60940014a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094010510 con 0x7f609c0aa1a0 2021-11-15T14:42:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094010670 con 0x7f609c0aa1a0 2021-11-15T14:42:17.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609800b180 con 0x7f609c0aa1a0 2021-11-15T14:42:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60940107e0 con 0x7f609c0aa1a0 2021-11-15T14:42:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c155d50 con 0x7f609c0aa1a0 2021-11-15T14:42:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c0b1400 con 0x7f609c0aa1a0 2021-11-15T14:42:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6094010070 con 0x7f609c0aa1a0 2021-11-15T14:42:17.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 0x7f607c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f609406b3d0 con 0x7f609c0aa1a0 2021-11-15T14:42:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.412+0000 7f60a0a00700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 0x7f607c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.416+0000 7f60a0a00700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 0x7f607c055b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f608c00c000 tx=0x7f608c006eb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.416+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f609c0b1400 con 0x7f609c0aa1a0 2021-11-15T14:42:17.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f609c0b1400 con 0x7f609c0aa1a0 2021-11-15T14:42:17.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f608a7fc700 1 -- 172.21.2.135:0/1147109246 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f609c0b1400 con 0x7f609c0aa1a0 2021-11-15T14:42:17.504 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:17.504 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":120,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:17.045624+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:17.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 msgr2=0x7f607c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 0x7f607c055b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f608c00c000 tx=0x7f608c006eb0).stop 2021-11-15T14:42:17.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 msgr2=0x7f609c156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f609c0ad450 tx=0x7f60940014a0).stop 2021-11-15T14:42:17.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 shutdown_connections 2021-11-15T14:42:17.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f607c0536a0 0x7f607c055b60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f609c0b0900 0x7f609c0b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f609c0b0520 0x7f609c149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 --2- 172.21.2.135:0/1147109246 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f609c0aa1a0 0x7f609c156590 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 >> 172.21.2.135:0/1147109246 conn(0x7f609c060840 msgr2=0x7f609c0b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 shutdown_connections 2021-11-15T14:42:17.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.500+0000 7f60a3465700 1 -- 172.21.2.135:0/1147109246 wait complete. 2021-11-15T14:42:17.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:42:17.512 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:17.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 Processor -- start 2021-11-15T14:42:17.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 -- start start 2021-11-15T14:42:17.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26bc0a9c90 0x7f26bc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc1439a0 con 0x7f26bc0b0630 2021-11-15T14:42:17.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc143c40 con 0x7f26bc0a9c90 2021-11-15T14:42:17.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c45ba700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc143ee0 con 0x7f26bc0b3790 2021-11-15T14:42:17.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26bc0a9c90 0x7f26bc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26bc0a9c90 0x7f26bc0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34002/0 (socket says 172.21.2.135:34002) 2021-11-15T14:42:17.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 -- 172.21.2.135:0/1576309802 learned_addr learned my addr 172.21.2.135:0/1576309802 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 -- 172.21.2.135:0/1576309802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 msgr2=0x7f26bc0b0a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:17.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 --2- 172.21.2.135:0/1576309802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc0b0a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 -- 172.21.2.135:0/1576309802 >> v1:172.21.2.119:6789/0 conn(0x7f26bc0b0630 legacy=0x7f26bc13d5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:17.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 -- 172.21.2.135:0/1576309802 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc144180 con 0x7f26bc0a9c90 2021-11-15T14:42:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.560+0000 7f26c2b57700 1 --2- 172.21.2.135:0/1576309802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0a9c90 0x7f26bc0b1130 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f26bc0b3df0 tx=0x7f26b4009290).ready entity=mon.1 client_cookie=e8f55306606a1479 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1354700 1 -- 172.21.2.135:0/1576309802 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b400b860 con 0x7f26bc0a9c90 2021-11-15T14:42:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1354700 1 -- 172.21.2.135:0/1576309802 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b400b9c0 con 0x7f26bc0a9c90 2021-11-15T14:42:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1354700 1 -- 172.21.2.135:0/1576309802 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b400bb70 con 0x7f26bc0a9c90 2021-11-15T14:42:17.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/1576309802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0a9c90 msgr2=0x7f26bc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- 172.21.2.135:0/1576309802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0a9c90 0x7f26bc0b1130 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f26bc0b3df0 tx=0x7f26b4009290).stop 2021-11-15T14:42:17.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/1576309802 shutdown_connections 2021-11-15T14:42:17.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- 172.21.2.135:0/1576309802 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0a9c90 0x7f26bc0b1130 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- 172.21.2.135:0/1576309802 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/1576309802 >> 172.21.2.135:0/1576309802 conn(0x7f26bc060840 msgr2=0x7f26bc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/1576309802 shutdown_connections 2021-11-15T14:42:17.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/1576309802 wait complete. 2021-11-15T14:42:17.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 Processor -- start 2021-11-15T14:42:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- start start 2021-11-15T14:42:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26bc0a9c90 0x7f26bc147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13e3d0 con 0x7f26bc0a9c90 2021-11-15T14:42:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13e670 con 0x7f26bc0b0630 2021-11-15T14:42:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0a8e20 con 0x7f26bc0b3790 2021-11-15T14:42:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34004/0 (socket says 172.21.2.135:34004) 2021-11-15T14:42:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 -- 172.21.2.135:0/2236330258 learned_addr learned my addr 172.21.2.135:0/2236330258 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 -- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 msgr2=0x7f26bc140090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc140090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 -- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26bc0a9c90 msgr2=0x7f26bc147e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:17.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26bc0a9c90 0x7f26bc147e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 -- 172.21.2.135:0/2236330258 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009530 con 0x7f26bc0b0630 2021-11-15T14:42:17.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c1b55700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f26b8000ed0 tx=0x7f26b8006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b8009e00 con 0x7f26bc0b0630 2021-11-15T14:42:17.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8012410 con 0x7f26bc0b0630 2021-11-15T14:42:17.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b8012770 con 0x7f26bc0b0630 2021-11-15T14:42:17.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc0a90c0 con 0x7f26bc0b0630 2021-11-15T14:42:17.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc13df30 con 0x7f26bc0b0630 2021-11-15T14:42:17.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc13dce0 con 0x7f26bc0b0630 2021-11-15T14:42:17.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26b800f030 con 0x7f26bc0b0630 2021-11-15T14:42:17.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 0x7f269c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.564+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f26b806b380 con 0x7f26bc0b0630 2021-11-15T14:42:17.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.568+0000 7f26c2356700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 0x7f269c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.568+0000 7f26c2356700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 0x7f269c055b20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f26ac002fb0 tx=0x7f26ac006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.568+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26b80426c0 con 0x7f26bc0b0630 2021-11-15T14:42:17.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f26bc0573d0 con 0x7f26bc0b0630 2021-11-15T14:42:17.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26ab7fe700 1 -- 172.21.2.135:0/2236330258 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7f26b8045ce0 con 0x7f26bc0b0630 2021-11-15T14:42:17.656 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:17.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 msgr2=0x7f269c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 0x7f269c055b20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f26ac002fb0 tx=0x7f26ac006930).stop 2021-11-15T14:42:17.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 msgr2=0x7f26bc13fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f26b8000ed0 tx=0x7f26b8006d60).stop 2021-11-15T14:42:17.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 shutdown_connections 2021-11-15T14:42:17.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f269c053660 0x7f269c055b20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26bc0b3790 0x7f26bc140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26bc0b0630 0x7f26bc13fba0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 --2- 172.21.2.135:0/2236330258 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26bc0a9c90 0x7f26bc147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 >> 172.21.2.135:0/2236330258 conn(0x7f26bc060840 msgr2=0x7f26bc0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 shutdown_connections 2021-11-15T14:42:17.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.652+0000 7f26c45ba700 1 -- 172.21.2.135:0/2236330258 wait complete. 2021-11-15T14:42:17.663 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:17.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 Processor -- start 2021-11-15T14:42:17.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- start start 2021-11-15T14:42:17.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa7100b1350 0x7fa7100b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100a7850 con 0x7fa7100b1f40 2021-11-15T14:42:17.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100b06d0 con 0x7fa7100b2320 2021-11-15T14:42:17.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100b17c0 con 0x7fa7100b1350 2021-11-15T14:42:17.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70ed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa7100b2320 0x7fa7101412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49836/0 (socket says 172.21.2.135:49836) 2021-11-15T14:42:17.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70ed9d700 1 -- 172.21.2.135:0/2700769601 learned_addr learned my addr 172.21.2.135:0/2700769601 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:17.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70dd9b700 1 --2- 172.21.2.135:0/2700769601 >> v2:172.21.2.135:3300/0 conn(0x7fa7100b1350 0x7fa7100b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70dd9b700 1 -- 172.21.2.135:0/2700769601 >> v1:172.21.2.135:6789/0 conn(0x7fa7100b2320 legacy=0x7fa7101412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70dd9b700 1 -- 172.21.2.135:0/2700769601 >> v1:172.21.2.119:6789/0 conn(0x7fa7100b1f40 legacy=0x7fa7100a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:17.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70d59a700 1 -- 172.21.2.135:0/2700769601 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453173863 0 0) 0x7fa7100b06d0 con 0x7fa7100b2320 2021-11-15T14:42:17.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70dd9b700 1 -- 172.21.2.135:0/2700769601 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100b0970 con 0x7fa7100b1350 2021-11-15T14:42:17.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70dd9b700 1 --2- 172.21.2.135:0/2700769601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b1350 0x7fa7100b0030 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa7100ad350 tx=0x7fa6f8006df0).ready entity=mon.1 client_cookie=79046db63f6ddea2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70d59a700 1 -- 172.21.2.135:0/2700769601 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6f800d5c0 con 0x7fa7100b1350 2021-11-15T14:42:17.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70d59a700 1 -- 172.21.2.135:0/2700769601 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8000e90 con 0x7fa7100b1350 2021-11-15T14:42:17.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa70d59a700 1 -- 172.21.2.135:0/2700769601 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6f800d910 con 0x7fa7100b1350 2021-11-15T14:42:17.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- 172.21.2.135:0/2700769601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b1350 msgr2=0x7fa7100b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 --2- 172.21.2.135:0/2700769601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b1350 0x7fa7100b0030 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa7100ad350 tx=0x7fa6f8006df0).stop 2021-11-15T14:42:17.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- 172.21.2.135:0/2700769601 shutdown_connections 2021-11-15T14:42:17.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 --2- 172.21.2.135:0/2700769601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b1350 0x7fa7100b0030 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- 172.21.2.135:0/2700769601 >> 172.21.2.135:0/2700769601 conn(0x7fa71005f730 msgr2=0x7fa71005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- 172.21.2.135:0/2700769601 shutdown_connections 2021-11-15T14:42:17.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 -- 172.21.2.135:0/2700769601 wait complete. 2021-11-15T14:42:17.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.712+0000 7fa714abb700 1 Processor -- start 2021-11-15T14:42:17.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- start start 2021-11-15T14:42:17.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7100b1350 0x7fa7101497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7100b1f40 0x7fa7100b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71015afe0 con 0x7fa7100b1f40 2021-11-15T14:42:17.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71015ad40 con 0x7fa7100b2320 2021-11-15T14:42:17.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710156cb0 con 0x7fa7100b1350 2021-11-15T14:42:17.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34020/0 (socket says 172.21.2.135:34020) 2021-11-15T14:42:17.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 -- 172.21.2.135:0/3255016236 learned_addr learned my addr 172.21.2.135:0/3255016236 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 -- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7100b1350 msgr2=0x7fa7101497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7100b1350 0x7fa7101497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 -- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7100b1f40 msgr2=0x7fa7100b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7100b1f40 0x7fa7100b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 -- 172.21.2.135:0/3255016236 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f800b180 con 0x7fa7100b2320 2021-11-15T14:42:17.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70ed9d700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fa710062d00 tx=0x7fa708001380).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa708005ba0 con 0x7fa7100b2320 2021-11-15T14:42:17.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708005d00 con 0x7fa7100b2320 2021-11-15T14:42:17.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa708004a90 con 0x7fa7100b2320 2021-11-15T14:42:17.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710156f50 con 0x7fa7100b2320 2021-11-15T14:42:17.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100b0170 con 0x7fa7100b2320 2021-11-15T14:42:17.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa710157a80 con 0x7fa7100b2320 2021-11-15T14:42:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa708004bf0 con 0x7fa7100b2320 2021-11-15T14:42:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 0x7fa6f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa70806b3c0 con 0x7fa7100b2320 2021-11-15T14:42:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.716+0000 7fa70e59c700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 0x7fa6f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.720+0000 7fa70e59c700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 0x7fa6f4055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa700002f90 tx=0x7fa7000069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.720+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa708042700 con 0x7fa7100b2320 2021-11-15T14:42:17.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7101570e0 con 0x7fa7100b2320 2021-11-15T14:42:17.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa7077fe700 1 -- 172.21.2.135:0/3255016236 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa708045d20 con 0x7fa7100b2320 2021-11-15T14:42:17.807 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 msgr2=0x7fa6f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 0x7fa6f4055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa700002f90 tx=0x7fa7000069b0).stop 2021-11-15T14:42:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 msgr2=0x7fa7101573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fa710062d00 tx=0x7fa708001380).stop 2021-11-15T14:42:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 shutdown_connections 2021-11-15T14:42:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa6f4053610 0x7fa6f4055ad0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa7100b2320 0x7fa7101573f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7100b1f40 0x7fa7100b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 --2- 172.21.2.135:0/3255016236 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7100b1350 0x7fa7101497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 >> 172.21.2.135:0/3255016236 conn(0x7fa71005f730 msgr2=0x7fa7100b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 shutdown_connections 2021-11-15T14:42:17.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.804+0000 7fa714abb700 1 -- 172.21.2.135:0/3255016236 wait complete. 2021-11-15T14:42:17.815 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:42:17.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.860+0000 7f032aced700 1 Processor -- start 2021-11-15T14:42:17.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 -- start start 2021-11-15T14:42:17.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0324148420 0x7f03240b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f03241447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03240b03d0 con 0x7f03240b1e30 2021-11-15T14:42:17.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240a9140 con 0x7f0324148420 2021-11-15T14:42:17.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032aced700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03240b0670 con 0x7f03240a7140 2021-11-15T14:42:17.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0324148420 0x7f03240b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032928a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f03241447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0328a89700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f03240b1e30 0x7f03240b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:59262/0 (socket says 172.21.2.135:59262) 2021-11-15T14:42:17.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0328a89700 1 -- 172.21.2.135:0/432391552 learned_addr learned my addr 172.21.2.135:0/432391552 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:17.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 -- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 msgr2=0x7f03241447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:17.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f03241447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 -- 172.21.2.135:0/432391552 >> v1:172.21.2.119:6789/0 conn(0x7f03240b1e30 legacy=0x7f03240b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 -- 172.21.2.135:0/432391552 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240b0910 con 0x7f0324148420 2021-11-15T14:42:17.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f032928a700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f03241447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:42:17.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.864+0000 7f0323fff700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f03240b1050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f03241477b0 tx=0x7f0314006df0).ready entity=mon.0 client_cookie=57871fd17258c770 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f03237fe700 1 -- 172.21.2.135:0/432391552 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f031400d570 con 0x7f0324148420 2021-11-15T14:42:17.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f03237fe700 1 -- 172.21.2.135:0/432391552 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314000e90 con 0x7f0324148420 2021-11-15T14:42:17.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f03237fe700 1 -- 172.21.2.135:0/432391552 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f031400d8c0 con 0x7f0324148420 2021-11-15T14:42:17.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 msgr2=0x7f03240b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f03240b1050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f03241477b0 tx=0x7f0314006df0).stop 2021-11-15T14:42:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/432391552 shutdown_connections 2021-11-15T14:42:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f03241447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- 172.21.2.135:0/432391552 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f03240b1050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/432391552 >> 172.21.2.135:0/432391552 conn(0x7f032405f730 msgr2=0x7f032405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/432391552 shutdown_connections 2021-11-15T14:42:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/432391552 wait complete. 2021-11-15T14:42:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 Processor -- start 2021-11-15T14:42:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- start start 2021-11-15T14:42:17.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f0324147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f0324157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324157b40 con 0x7f0324148420 2021-11-15T14:42:17.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03240aa4e0 con 0x7f03240b1e30 2021-11-15T14:42:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03240aa780 con 0x7f03240a7140 2021-11-15T14:42:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34036/0 (socket says 172.21.2.135:34036) 2021-11-15T14:42:17.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 -- 172.21.2.135:0/3022190770 learned_addr learned my addr 172.21.2.135:0/3022190770 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 -- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 msgr2=0x7f0324147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f0324147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 -- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 msgr2=0x7f0324157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f0324157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 -- 172.21.2.135:0/3022190770 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c009470 con 0x7f03240b1e30 2021-11-15T14:42:17.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0323fff700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f03241477b0 tx=0x7f0314014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0314016070 con 0x7f03240b1e30 2021-11-15T14:42:17.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314002f50 con 0x7f03240b1e30 2021-11-15T14:42:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f031400de20 con 0x7f03240b1e30 2021-11-15T14:42:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031400b180 con 0x7f03240b1e30 2021-11-15T14:42:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032415a150 con 0x7f03240b1e30 2021-11-15T14:42:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032415a2e0 con 0x7f03240b1e30 2021-11-15T14:42:17.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.868+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f031400f030 con 0x7f03240b1e30 2021-11-15T14:42:17.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.872+0000 7f0321ffb700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 0x7f0308055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:17.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.872+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f031406c440 con 0x7f03240b1e30 2021-11-15T14:42:17.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.872+0000 7f0328a89700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 0x7f0308055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:17.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.872+0000 7f0328a89700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 0x7f0308055b90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f03240b31f0 tx=0x7f030c007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:17.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.872+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0314043670 con 0x7f03240b1e30 2021-11-15T14:42:17.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f03240573d0 con 0x7f03240b1e30 2021-11-15T14:42:17.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f0321ffb700 1 -- 172.21.2.135:0/3022190770 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0314023090 con 0x7f03240b1e30 2021-11-15T14:42:17.960 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:17.960 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:42:17.960 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.960 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:42:17.961 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:42:17.961 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:17.961 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:17.961 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:42:17.961 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:42:17.962 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:17.962 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:42:17.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 msgr2=0x7f0308055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 0x7f0308055b90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f03240b31f0 tx=0x7f030c007800).stop 2021-11-15T14:42:17.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 msgr2=0x7f0324157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:17.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f03241477b0 tx=0x7f0314014000).stop 2021-11-15T14:42:17.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 shutdown_connections 2021-11-15T14:42:17.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03080536d0 0x7f0308055b90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0324148420 0x7f0324157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03240b1e30 0x7f0324157160 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:17.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 --2- 172.21.2.135:0/3022190770 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f03240a7140 0x7f0324147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:17.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 >> 172.21.2.135:0/3022190770 conn(0x7f032405f730 msgr2=0x7f03240b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:17.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 shutdown_connections 2021-11-15T14:42:17.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:17.956+0000 7f032aced700 1 -- 172.21.2.135:0/3022190770 wait complete. 2021-11-15T14:42:17.967 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:42:17.967 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:42:18.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 Processor -- start 2021-11-15T14:42:18.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- start start 2021-11-15T14:42:18.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f11e00b1f40 0x7f11e00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e00b04a0 con 0x7f11e00b0030 2021-11-15T14:42:18.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00a7850 con 0x7f11e00b1f40 2021-11-15T14:42:18.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00b06d0 con 0x7f11e00b2320 2021-11-15T14:42:18.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e55b5700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f11e00b0030 0x7f11e00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49864/0 (socket says 172.21.2.135:49864) 2021-11-15T14:42:18.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e55b5700 1 -- 172.21.2.135:0/1923126828 learned_addr learned my addr 172.21.2.135:0/1923126828 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:18.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 --2- 172.21.2.135:0/1923126828 >> v2:172.21.2.135:3300/0 conn(0x7f11e00b1f40 0x7f11e00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e65b7700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 -- 172.21.2.135:0/1923126828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 msgr2=0x7f11e01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:18.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e01412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:18.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 -- 172.21.2.135:0/1923126828 >> v1:172.21.2.135:6789/0 conn(0x7f11e00b0030 legacy=0x7f11e00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:18.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 -- 172.21.2.135:0/1923126828 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00b0970 con 0x7f11e00b1f40 2021-11-15T14:42:18.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e65b7700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e01412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:18.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e5db6700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b1f40 0x7f11e00b1350 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f11d80032f0 tx=0x7f11d80091d0).ready entity=mon.1 client_cookie=ea0a705ffe895df4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:18.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e4db4700 1 -- 172.21.2.135:0/1923126828 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d8009ea0 con 0x7f11e00b1f40 2021-11-15T14:42:18.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e4db4700 1 -- 172.21.2.135:0/1923126828 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800b8a0 con 0x7f11e00b1f40 2021-11-15T14:42:18.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e4db4700 1 -- 172.21.2.135:0/1923126828 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d800ba10 con 0x7f11e00b1f40 2021-11-15T14:42:18.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- 172.21.2.135:0/1923126828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b1f40 msgr2=0x7f11e00b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:18.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b1f40 0x7f11e00b1350 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f11d80032f0 tx=0x7f11d80091d0).stop 2021-11-15T14:42:18.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- 172.21.2.135:0/1923126828 shutdown_connections 2021-11-15T14:42:18.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e01412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:18.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 --2- 172.21.2.135:0/1923126828 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b1f40 0x7f11e00b1350 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:18.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- 172.21.2.135:0/1923126828 >> 172.21.2.135:0/1923126828 conn(0x7f11e005f730 msgr2=0x7f11e005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:18.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- 172.21.2.135:0/1923126828 shutdown_connections 2021-11-15T14:42:18.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.016+0000 7f11e801a700 1 -- 172.21.2.135:0/1923126828 wait complete. 2021-11-15T14:42:18.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 Processor -- start 2021-11-15T14:42:18.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- start start 2021-11-15T14:42:18.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11e00b1f40 0x7f11e0140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e0142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00a9820 con 0x7f11e00b1f40 2021-11-15T14:42:18.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00a9ac0 con 0x7f11e00b0030 2021-11-15T14:42:18.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00a9d60 con 0x7f11e00b2320 2021-11-15T14:42:18.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34050/0 (socket says 172.21.2.135:34050) 2021-11-15T14:42:18.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 -- 172.21.2.135:0/4255542940 learned_addr learned my addr 172.21.2.135:0/4255542940 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e65b7700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e0142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e55b5700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11e00b1f40 0x7f11e0140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 -- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 msgr2=0x7f11e0142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e0142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 -- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11e00b1f40 msgr2=0x7f11e0140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11e00b1f40 0x7f11e0140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 -- 172.21.2.135:0/4255542940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8009470 con 0x7f11e00b0030 2021-11-15T14:42:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e5db6700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f11d80032f0 tx=0x7f11d8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d801f3f0 con 0x7f11e00b0030 2021-11-15T14:42:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d801f550 con 0x7f11e00b0030 2021-11-15T14:42:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e00aa000 con 0x7f11e00b0030 2021-11-15T14:42:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d801f8b0 con 0x7f11e00b0030 2021-11-15T14:42:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e00ab4f0 con 0x7f11e00b0030 2021-11-15T14:42:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e00aa190 con 0x7f11e00b0030 2021-11-15T14:42:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f11d8026030 con 0x7f11e00b0030 2021-11-15T14:42:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 0x7f11c00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:18.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f11d806c610 con 0x7f11e00b0030 2021-11-15T14:42:18.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e55b5700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 0x7f11c00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:18.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.020+0000 7f11e55b5700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 0x7f11c00559e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f11d000b000 tx=0x7f11d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:18.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.024+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11d8043950 con 0x7f11e00b0030 2021-11-15T14:42:18.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:18.108+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f11e00b0c10 con 0x7f11e00b0030 2021-11-15T14:42:19.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.060+0000 7f11ceffd700 1 -- 172.21.2.135:0/4255542940 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f11d8046f70 con 0x7f11e00b0030 2021-11-15T14:42:19.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 msgr2=0x7f11c00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:19.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 0x7f11c00559e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f11d000b000 tx=0x7f11d0009040).stop 2021-11-15T14:42:19.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 msgr2=0x7f11e00aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:19.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f11d80032f0 tx=0x7f11d8016000).stop 2021-11-15T14:42:19.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 shutdown_connections 2021-11-15T14:42:19.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f11c0053520 0x7f11c00559e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f11e00b2320 0x7f11e0142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f11e00b1f40 0x7f11e0140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 --2- 172.21.2.135:0/4255542940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f11e00b0030 0x7f11e00aa430 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 >> 172.21.2.135:0/4255542940 conn(0x7f11e005f730 msgr2=0x7f11e00af810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:19.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 shutdown_connections 2021-11-15T14:42:19.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.064+0000 7f11e801a700 1 -- 172.21.2.135:0/4255542940 wait complete. 2021-11-15T14:42:19.069 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:42:19.073 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:42:19.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 Processor -- start 2021-11-15T14:42:19.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 -- start start 2021-11-15T14:42:19.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f27d80b0630 0x7f27d80b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b3790 0x7f27d813d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d81439a0 con 0x7f27d813dac0 2021-11-15T14:42:19.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d8143c40 con 0x7f27d80b0630 2021-11-15T14:42:19.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27e0775700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8143ee0 con 0x7f27d80b3790 2021-11-15T14:42:19.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.132+0000 7f27de511700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f27d80b0630 0x7f27d80b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:19.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f27d80b0630 0x7f27d80b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34054/0 (socket says 172.21.2.135:34054) 2021-11-15T14:42:19.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 -- 172.21.2.135:0/2437870475 learned_addr learned my addr 172.21.2.135:0/2437870475 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:19.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 -- 172.21.2.135:0/2437870475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b3790 msgr2=0x7f27d813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:19.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 --2- 172.21.2.135:0/2437870475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b3790 0x7f27d813d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:19.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 -- 172.21.2.135:0/2437870475 >> v1:172.21.2.119:6789/0 conn(0x7f27d813dac0 legacy=0x7f27d80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:19.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 -- 172.21.2.135:0/2437870475 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8144180 con 0x7f27d80b0630 2021-11-15T14:42:19.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 --2- 172.21.2.135:0/2437870475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d80b0630 0x7f27d80b0a10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f27d80b3df0 tx=0x7f27d4006eb0).ready entity=mon.1 client_cookie=1d5b1bc31b8b70c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:19.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27dd50f700 1 -- 172.21.2.135:0/2437870475 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d400d570 con 0x7f27d80b0630 2021-11-15T14:42:19.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27dd50f700 1 -- 172.21.2.135:0/2437870475 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4000e90 con 0x7f27d80b0630 2021-11-15T14:42:19.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27dd50f700 1 -- 172.21.2.135:0/2437870475 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d400d8c0 con 0x7f27d80b0630 2021-11-15T14:42:19.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/2437870475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d80b0630 msgr2=0x7f27d80b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:19.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- 172.21.2.135:0/2437870475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d80b0630 0x7f27d80b0a10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f27d80b3df0 tx=0x7f27d4006eb0).stop 2021-11-15T14:42:19.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/2437870475 shutdown_connections 2021-11-15T14:42:19.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- 172.21.2.135:0/2437870475 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b3790 0x7f27d813d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:19.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- 172.21.2.135:0/2437870475 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d80b0630 0x7f27d80b0a10 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/2437870475 >> 172.21.2.135:0/2437870475 conn(0x7f27d8060840 msgr2=0x7f27d8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:19.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/2437870475 shutdown_connections 2021-11-15T14:42:19.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/2437870475 wait complete. 2021-11-15T14:42:19.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 Processor -- start 2021-11-15T14:42:19.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- start start 2021-11-15T14:42:19.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 0x7f27d813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 0x7f27d8064780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d813e970 con 0x7f27d80b3790 2021-11-15T14:42:19.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80ae790 con 0x7f27d813dac0 2021-11-15T14:42:19.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81406e0 con 0x7f27d80b0630 2021-11-15T14:42:19.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:19.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34064/0 (socket says 172.21.2.135:34064) 2021-11-15T14:42:19.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 -- 172.21.2.135:0/854814168 learned_addr learned my addr 172.21.2.135:0/854814168 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:19.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 0x7f27d813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:19.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ddd10700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 0x7f27d8064780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:19.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 -- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 msgr2=0x7f27d813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:19.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 0x7f27d813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 -- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 msgr2=0x7f27d8064780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:19.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 0x7f27d8064780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:19.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 -- 172.21.2.135:0/854814168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d400b1e0 con 0x7f27d813dac0 2021-11-15T14:42:19.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27de511700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 0x7f27d813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:19.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ddd10700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 0x7f27d8064780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:19.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27ded12700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f27d80ae6b0 tx=0x7f27d00090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:19.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d000f510 con 0x7f27d813dac0 2021-11-15T14:42:19.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000f670 con 0x7f27d813dac0 2021-11-15T14:42:19.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d8140440 con 0x7f27d813dac0 2021-11-15T14:42:19.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d000f7e0 con 0x7f27d813dac0 2021-11-15T14:42:19.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.136+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d813eba0 con 0x7f27d813dac0 2021-11-15T14:42:19.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d80ae900 con 0x7f27d813dac0 2021-11-15T14:42:19.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27d000f070 con 0x7f27d813dac0 2021-11-15T14:42:19.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27c77fe700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 0x7f27b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:19.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f27d006b450 con 0x7f27d813dac0 2021-11-15T14:42:19.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27de511700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 0x7f27b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:19.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27de511700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 0x7f27b8055ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f27d4017000 tx=0x7f27d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:19.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.140+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27d0042630 con 0x7f27d813dac0 2021-11-15T14:42:19.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:19.224+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f27d8143620 con 0x7f27d813dac0 2021-11-15T14:42:20.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27c77fe700 1 -- 172.21.2.135:0/854814168 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v122) v1 ==== 125+0+0 (secure 0 0 0) 0x7f27d0045c50 con 0x7f27d813dac0 2021-11-15T14:42:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 msgr2=0x7f27b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 0x7f27b8055ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f27d4017000 tx=0x7f27d4015000).stop 2021-11-15T14:42:20.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 msgr2=0x7f27d815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f27d80ae6b0 tx=0x7f27d00090f0).stop 2021-11-15T14:42:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 shutdown_connections 2021-11-15T14:42:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f27b8053610 0x7f27b8055ad0 secure :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0x7f27d4017000 tx=0x7f27d4015000).stop 2021-11-15T14:42:20.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f27d813dac0 0x7f27d815a0e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f27d80b3790 0x7f27d8064780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 --2- 172.21.2.135:0/854814168 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f27d80b0630 0x7f27d813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.060+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 >> 172.21.2.135:0/854814168 conn(0x7f27d8060840 msgr2=0x7f27d80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.068+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 shutdown_connections 2021-11-15T14:42:20.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.068+0000 7f27e0775700 1 -- 172.21.2.135:0/854814168 wait complete. 2021-11-15T14:42:20.071 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:42:20.078 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:42:20.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 Processor -- start 2021-11-15T14:42:20.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- start start 2021-11-15T14:42:20.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 0x7f52dc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f52dc0a7140 0x7f52dc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0b03d0 con 0x7f52dc148420 2021-11-15T14:42:20.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc0a9140 con 0x7f52dc0a7140 2021-11-15T14:42:20.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0b0670 con 0x7f52dc0b1e30 2021-11-15T14:42:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d9d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f52dc148420 0x7f52dc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49888/0 (socket says 172.21.2.135:49888) 2021-11-15T14:42:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d9d9b700 1 -- 172.21.2.135:0/3335691734 learned_addr learned my addr 172.21.2.135:0/3335691734 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:20.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581301616 0 0) 0x7f52dc0b03d0 con 0x7f52dc148420 2021-11-15T14:42:20.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c0003260 con 0x7f52dc148420 2021-11-15T14:42:20.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52da59c700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 0x7f52dc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 --2- 172.21.2.135:0/3335691734 >> v2:172.21.2.119:3300/0 conn(0x7f52dc0a7140 0x7f52dc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734662969 0 0) 0x7f52c0003260 con 0x7f52dc148420 2021-11-15T14:42:20.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 msgr2=0x7f52dc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 0x7f52dc0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 >> v2:172.21.2.119:3300/0 conn(0x7f52dc0a7140 msgr2=0x7f52dc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 --2- 172.21.2.135:0/3335691734 >> v2:172.21.2.119:3300/0 conn(0x7f52dc0a7140 0x7f52dc1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0b0910 con 0x7f52dc148420 2021-11-15T14:42:20.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f52d0001660 con 0x7f52dc148420 2021-11-15T14:42:20.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 >> v1:172.21.2.135:6789/0 conn(0x7f52dc148420 legacy=0x7f52dc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 0x7f52c00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0003e00 0x7f52c0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52c0004b10 0x7f52c0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0b0670 con 0x7f52c0003e00 2021-11-15T14:42:20.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c000b960 con 0x7f52c0004b10 2021-11-15T14:42:20.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c000bb20 con 0x7f52dc0b1e30 2021-11-15T14:42:20.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52c0004b10 0x7f52c0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 -- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 msgr2=0x7f52c00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc0b1e30 0x7f52c00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 -- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0003e00 msgr2=0x7f52c0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0003e00 0x7f52c0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 -- 172.21.2.135:0/3335691734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0003260 con 0x7f52c0004b10 2021-11-15T14:42:20.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52c0004b10 0x7f52c0004f90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f52d4007000 tx=0x7f52d4008040).ready entity=mon.1 client_cookie=8e1c605d998610d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d400c640 con 0x7f52c0004b10 2021-11-15T14:42:20.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400c7a0 con 0x7f52c0004b10 2021-11-15T14:42:20.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52d959a700 1 -- 172.21.2.135:0/3335691734 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d400cb00 con 0x7f52c0004b10 2021-11-15T14:42:20.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- 172.21.2.135:0/3335691734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52c0004b10 msgr2=0x7f52c0004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 --2- 172.21.2.135:0/3335691734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52c0004b10 0x7f52c0004f90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f52d4007000 tx=0x7f52d4008040).stop 2021-11-15T14:42:20.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52dad9d700 1 -- 172.21.2.135:0/3335691734 reap_dead start 2021-11-15T14:42:20.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- 172.21.2.135:0/3335691734 shutdown_connections 2021-11-15T14:42:20.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- 172.21.2.135:0/3335691734 >> 172.21.2.135:0/3335691734 conn(0x7f52dc05f730 msgr2=0x7f52dc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- 172.21.2.135:0/3335691734 shutdown_connections 2021-11-15T14:42:20.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.152+0000 7f52e0d51700 1 -- 172.21.2.135:0/3335691734 wait complete. 2021-11-15T14:42:20.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 Processor -- start 2021-11-15T14:42:20.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- start start 2021-11-15T14:42:20.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0004b10 0x7f52dc0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc157340 0x7f52dc15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1496e0 con 0x7f52c0004b10 2021-11-15T14:42:20.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc159ea0 con 0x7f52dc145a00 2021-11-15T14:42:20.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc148f00 con 0x7f52dc157340 2021-11-15T14:42:20.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34080/0 (socket says 172.21.2.135:34080) 2021-11-15T14:42:20.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 -- 172.21.2.135:0/168146345 learned_addr learned my addr 172.21.2.135:0/168146345 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 -- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc157340 msgr2=0x7f52dc15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc157340 0x7f52dc15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 -- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0004b10 msgr2=0x7f52dc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0004b10 0x7f52dc0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 -- 172.21.2.135:0/168146345 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc1491a0 con 0x7f52dc145a00 2021-11-15T14:42:20.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52d9d9b700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f52dc0aed80 tx=0x7f52dc0b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0007170 con 0x7f52dc145a00 2021-11-15T14:42:20.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d00072d0 con 0x7f52dc145a00 2021-11-15T14:42:20.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc149440 con 0x7f52dc145a00 2021-11-15T14:42:20.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0004920 con 0x7f52dc145a00 2021-11-15T14:42:20.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc148b80 con 0x7f52dc145a00 2021-11-15T14:42:20.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc1457c0 con 0x7f52dc145a00 2021-11-15T14:42:20.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52d001b070 con 0x7f52dc145a00 2021-11-15T14:42:20.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 0x7f52b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f52d006b2b0 con 0x7f52dc145a00 2021-11-15T14:42:20.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52da59c700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 0x7f52b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.156+0000 7f52da59c700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 0x7f52b8055ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f52cc00a000 tx=0x7f52cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.160+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52d00422d0 con 0x7f52dc145a00 2021-11-15T14:42:20.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.268+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f52dc0573d0 con 0x7f52dc145a00 2021-11-15T14:42:20.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52cb7fe700 1 -- 172.21.2.135:0/168146345 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f52d00458f0 con 0x7f52dc145a00 2021-11-15T14:42:20.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 msgr2=0x7f52b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 0x7f52b8055ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f52cc00a000 tx=0x7f52cc008040).stop 2021-11-15T14:42:20.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 msgr2=0x7f52dc156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f52dc0aed80 tx=0x7f52dc0b0aa0).stop 2021-11-15T14:42:20.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 shutdown_connections 2021-11-15T14:42:20.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f52b8053610 0x7f52b8055ad0 secure :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0x7f52cc00a000 tx=0x7f52cc008040).stop 2021-11-15T14:42:20.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f52dc157340 0x7f52dc15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f52dc145a00 0x7f52dc156e50 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 --2- 172.21.2.135:0/168146345 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f52c0004b10 0x7f52dc0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 >> 172.21.2.135:0/168146345 conn(0x7f52dc05f730 msgr2=0x7f52dc0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 shutdown_connections 2021-11-15T14:42:20.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.284+0000 7f52e0d51700 1 -- 172.21.2.135:0/168146345 wait complete. 2021-11-15T14:42:20.291 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 21 and data pool 22 2021-11-15T14:42:20.295 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:20.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 Processor -- start 2021-11-15T14:42:20.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 -- start start 2021-11-15T14:42:20.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe3cc0b0520 0x7fe3cc0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0aa1a0 0x7fe3cc0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc0b2b70 con 0x7fe3cc0b0900 2021-11-15T14:42:20.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0b27f0 con 0x7fe3cc0b0520 2021-11-15T14:42:20.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3d28e7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0b2da0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe3cc0b0520 0x7fe3cc0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cb7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0aa1a0 0x7fe3cc0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe3cc0b0520 0x7fe3cc0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:56140/0 (socket says 172.21.2.135:56140) 2021-11-15T14:42:20.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 -- 172.21.2.135:0/1233425409 learned_addr learned my addr 172.21.2.135:0/1233425409 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 -- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0aa1a0 msgr2=0x7fe3cc0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 --2- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0aa1a0 0x7fe3cc0ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 -- 172.21.2.135:0/1233425409 >> v1:172.21.2.119:6789/0 conn(0x7fe3cc0b0900 legacy=0x7fe3cc143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.344+0000 7fe3cbfff700 1 -- 172.21.2.135:0/1233425409 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc0a9bf0 con 0x7fe3cc0b0520 2021-11-15T14:42:20.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0addb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe3bc002f70 tx=0x7fe3bc006eb0).ready entity=mon.0 client_cookie=525dc845cc99116 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3caffd700 1 -- 172.21.2.135:0/1233425409 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc00d570 con 0x7fe3cc0b0520 2021-11-15T14:42:20.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3caffd700 1 -- 172.21.2.135:0/1233425409 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc000e90 con 0x7fe3cc0b0520 2021-11-15T14:42:20.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3caffd700 1 -- 172.21.2.135:0/1233425409 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc00d900 con 0x7fe3cc0b0520 2021-11-15T14:42:20.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 msgr2=0x7fe3cc0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0addb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe3bc002f70 tx=0x7fe3bc006eb0).stop 2021-11-15T14:42:20.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/1233425409 shutdown_connections 2021-11-15T14:42:20.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0aa1a0 0x7fe3cc0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/1233425409 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0addb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/1233425409 >> 172.21.2.135:0/1233425409 conn(0x7fe3cc060840 msgr2=0x7fe3cc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/1233425409 shutdown_connections 2021-11-15T14:42:20.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/1233425409 wait complete. 2021-11-15T14:42:20.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 Processor -- start 2021-11-15T14:42:20.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- start start 2021-11-15T14:42:20.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 0x7fe3cc0639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc139070 con 0x7fe3cc0b0520 2021-11-15T14:42:20.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0b4e20 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0ae880 con 0x7fe3cc0b0900 2021-11-15T14:42:20.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34100/0 (socket says 172.21.2.135:34100) 2021-11-15T14:42:20.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 -- 172.21.2.135:0/2275849474 learned_addr learned my addr 172.21.2.135:0/2275849474 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d0e84700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 0x7fe3cc0639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 -- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 msgr2=0x7fe3cc0639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cb7fe700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 0x7fe3cc0639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 -- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 msgr2=0x7fe3cc0aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 -- 172.21.2.135:0/2275849474 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc00b1e0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d0e84700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 0x7fe3cc0639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:20.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cbfff700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe3bc002f70 tx=0x7fe3bc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3cb7fe700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:20.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc0117e0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc011940 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc011ca0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc0644b0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc064750 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc0ac710 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3bc01a040 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 0x7fe3b00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.348+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe3bc06c910 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.352+0000 7fe3cb7fe700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 0x7fe3b00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.352+0000 7fe3cb7fe700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 0x7fe3b00559b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fe3b400b000 tx=0x7fe3b4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.352+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3bc043930 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3cc0573d0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3c97fa700 1 -- 172.21.2.135:0/2275849474 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fe3bc02ffc0 con 0x7fe3cc0aa1a0 2021-11-15T14:42:20.444 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:20.444 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":123,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:20.273155+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:18.125358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:19.266983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:20.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 msgr2=0x7fe3b00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 0x7fe3b00559b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fe3b400b000 tx=0x7fe3b4008040).stop 2021-11-15T14:42:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 msgr2=0x7fe3cc1350d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe3bc002f70 tx=0x7fe3bc015000).stop 2021-11-15T14:42:20.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 shutdown_connections 2021-11-15T14:42:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b00534f0 0x7fe3b00559b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3cc0b0900 0x7fe3cc0639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3cc0b0520 0x7fe3cc0aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 --2- 172.21.2.135:0/2275849474 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3cc0aa1a0 0x7fe3cc1350d0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 >> 172.21.2.135:0/2275849474 conn(0x7fe3cc060840 msgr2=0x7fe3cc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 shutdown_connections 2021-11-15T14:42:20.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.440+0000 7fe3d28e7700 1 -- 172.21.2.135:0/2275849474 wait complete. 2021-11-15T14:42:20.452 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:20.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 Processor -- start 2021-11-15T14:42:20.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- start start 2021-11-15T14:42:20.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5040b1e30 0x7fe5040b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe5040b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5040b03d0 con 0x7fe5040a7140 2021-11-15T14:42:20.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5040a9140 con 0x7fe5040b1e30 2021-11-15T14:42:20.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040b0670 con 0x7fe504148420 2021-11-15T14:42:20.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5040b1e30 0x7fe5040b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5040b1e30 0x7fe5040b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34108/0 (socket says 172.21.2.135:34108) 2021-11-15T14:42:20.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 -- 172.21.2.135:0/1818936334 learned_addr learned my addr 172.21.2.135:0/1818936334 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 -- 172.21.2.135:0/1818936334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 msgr2=0x7fe5040b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 --2- 172.21.2.135:0/1818936334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe5040b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 -- 172.21.2.135:0/1818936334 >> v1:172.21.2.119:6789/0 conn(0x7fe5040a7140 legacy=0x7fe5041447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 -- 172.21.2.135:0/1818936334 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040b0910 con 0x7fe5040b1e30 2021-11-15T14:42:20.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5037fe700 1 --2- 172.21.2.135:0/1818936334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040b1050 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe504061420 tx=0x7fe4f4006eb0).ready entity=mon.1 client_cookie=88d94fd542ad6a7c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5027fc700 1 -- 172.21.2.135:0/1818936334 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4f400d570 con 0x7fe5040b1e30 2021-11-15T14:42:20.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5027fc700 1 -- 172.21.2.135:0/1818936334 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f4000e90 con 0x7fe5040b1e30 2021-11-15T14:42:20.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe5027fc700 1 -- 172.21.2.135:0/1818936334 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4f400d8c0 con 0x7fe5040b1e30 2021-11-15T14:42:20.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- 172.21.2.135:0/1818936334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 msgr2=0x7fe5040b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 --2- 172.21.2.135:0/1818936334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040b1050 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe504061420 tx=0x7fe4f4006eb0).stop 2021-11-15T14:42:20.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- 172.21.2.135:0/1818936334 shutdown_connections 2021-11-15T14:42:20.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 --2- 172.21.2.135:0/1818936334 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe5040b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 --2- 172.21.2.135:0/1818936334 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040b1050 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- 172.21.2.135:0/1818936334 >> 172.21.2.135:0/1818936334 conn(0x7fe50405f730 msgr2=0x7fe50405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- 172.21.2.135:0/1818936334 shutdown_connections 2021-11-15T14:42:20.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.500+0000 7fe509e72700 1 -- 172.21.2.135:0/1818936334 wait complete. 2021-11-15T14:42:20.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 Processor -- start 2021-11-15T14:42:20.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- start start 2021-11-15T14:42:20.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5040a7140 0x7fe504148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe50413f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040b4280 con 0x7fe5040a7140 2021-11-15T14:42:20.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5040ac910 con 0x7fe5040b1e30 2021-11-15T14:42:20.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50413fe90 con 0x7fe504148420 2021-11-15T14:42:20.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34116/0 (socket says 172.21.2.135:34116) 2021-11-15T14:42:20.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 -- 172.21.2.135:0/3087021940 learned_addr learned my addr 172.21.2.135:0/3087021940 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 -- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 msgr2=0x7fe50413f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe50413f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 -- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5040a7140 msgr2=0x7fe504148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5040a7140 0x7fe504148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 -- 172.21.2.135:0/3087021940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f400b1e0 con 0x7fe5040b1e30 2021-11-15T14:42:20.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe502ffd700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fe5040b43c0 tx=0x7fe4ec006e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00e470 con 0x7fe5040b1e30 2021-11-15T14:42:20.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00e5d0 con 0x7fe5040b1e30 2021-11-15T14:42:20.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4ec00e930 con 0x7fe5040b1e30 2021-11-15T14:42:20.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe504140130 con 0x7fe5040b1e30 2021-11-15T14:42:20.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5040af130 con 0x7fe5040b1e30 2021-11-15T14:42:20.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5040b0bb0 con 0x7fe5040b1e30 2021-11-15T14:42:20.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4ec018030 con 0x7fe5040b1e30 2021-11-15T14:42:20.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 0x7fe4e8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe4ec06aec0 con 0x7fe5040b1e30 2021-11-15T14:42:20.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.504+0000 7fe5037fe700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 0x7fe4e8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.508+0000 7fe5037fe700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 0x7fe4e8055b00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe504061420 tx=0x7fe4f4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.508+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4ec041f80 con 0x7fe5040b1e30 2021-11-15T14:42:20.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.588+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5040573d0 con 0x7fe5040b1e30 2021-11-15T14:42:20.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe500ff9700 1 -- 172.21.2.135:0/3087021940 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fe4ec023fc0 con 0x7fe5040b1e30 2021-11-15T14:42:20.595 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:20.595 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":123,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:20.273155+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:18.125358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:19.266983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:20.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 msgr2=0x7fe4e8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 0x7fe4e8055b00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe504061420 tx=0x7fe4f4015000).stop 2021-11-15T14:42:20.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 msgr2=0x7fe5040aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7fe5040b43c0 tx=0x7fe4ec006e00).stop 2021-11-15T14:42:20.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 shutdown_connections 2021-11-15T14:42:20.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe4e8053640 0x7fe4e8055b00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe504148420 0x7fe50413f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5040b1e30 0x7fe5040aea60 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 --2- 172.21.2.135:0/3087021940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5040a7140 0x7fe504148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 >> 172.21.2.135:0/3087021940 conn(0x7fe50405f730 msgr2=0x7fe50414d480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 shutdown_connections 2021-11-15T14:42:20.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.592+0000 7fe509e72700 1 -- 172.21.2.135:0/3087021940 wait complete. 2021-11-15T14:42:20.602 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:42:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 Processor -- start 2021-11-15T14:42:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- start start 2021-11-15T14:42:20.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f038c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0a7850 con 0x7f038c0b2320 2021-11-15T14:42:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0b0470 con 0x7f038c0b0030 2021-11-15T14:42:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b06d0 con 0x7f038c0b1f40 2021-11-15T14:42:20.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039132a700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f038c0b0030 0x7f038c0a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49944/0 (socket says 172.21.2.135:49944) 2021-11-15T14:42:20.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039132a700 1 -- 172.21.2.135:0/2310830140 learned_addr learned my addr 172.21.2.135:0/2310830140 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:20.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037328876 0 0) 0x7f038c0b0470 con 0x7f038c0b0030 2021-11-15T14:42:20.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0374003260 con 0x7f038c0b0030 2021-11-15T14:42:20.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0391b2b700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f038c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22343902 0 0) 0x7f0374003260 con 0x7f038c0b0030 2021-11-15T14:42:20.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 msgr2=0x7f038c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f038c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 >> v1:172.21.2.119:6789/0 conn(0x7f038c0b2320 legacy=0x7f038c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0b0970 con 0x7f038c0b0030 2021-11-15T14:42:20.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0388001660 con 0x7f038c0b0030 2021-11-15T14:42:20.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 >> v1:172.21.2.135:6789/0 conn(0x7f038c0b0030 legacy=0x7f038c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0374003750 0x7f0374003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f0374004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03740049f0 0x7f0374004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b06d0 con 0x7f0374003750 2021-11-15T14:42:20.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037400b800 con 0x7f03740049f0 2021-11-15T14:42:20.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037400b9c0 con 0x7f038c0b1f40 2021-11-15T14:42:20.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03740049f0 0x7f0374004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0391b2b700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0374003750 0x7f0374003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039132a700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f0374004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 -- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 msgr2=0x7f0374004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0b1f40 0x7f0374004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 -- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0374003750 msgr2=0x7f0374003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:20.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0374003750 0x7f0374003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 -- 172.21.2.135:0/2310830140 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374003260 con 0x7f03740049f0 2021-11-15T14:42:20.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03740049f0 0x7f0374004e70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f0374004470 tx=0x7f0384007d80).ready entity=mon.1 client_cookie=690b7135383e8c50 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0384006890 con 0x7f03740049f0 2021-11-15T14:42:20.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840069f0 con 0x7f03740049f0 2021-11-15T14:42:20.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0390b29700 1 -- 172.21.2.135:0/2310830140 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0384006d50 con 0x7f03740049f0 2021-11-15T14:42:20.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- 172.21.2.135:0/2310830140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03740049f0 msgr2=0x7f0374004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 --2- 172.21.2.135:0/2310830140 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f03740049f0 0x7f0374004e70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f0374004470 tx=0x7f0384007d80).stop 2021-11-15T14:42:20.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f039232c700 1 -- 172.21.2.135:0/2310830140 reap_dead start 2021-11-15T14:42:20.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- 172.21.2.135:0/2310830140 shutdown_connections 2021-11-15T14:42:20.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- 172.21.2.135:0/2310830140 >> 172.21.2.135:0/2310830140 conn(0x7f038c05f730 msgr2=0x7f038c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:20.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- 172.21.2.135:0/2310830140 shutdown_connections 2021-11-15T14:42:20.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.652+0000 7f0393d8f700 1 -- 172.21.2.135:0/2310830140 wait complete. 2021-11-15T14:42:20.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 Processor -- start 2021-11-15T14:42:20.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- start start 2021-11-15T14:42:20.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f038c13f0c0 0x7f038c0ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0aa9c0 0x7f038c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0abe90 con 0x7f038c13f0c0 2021-11-15T14:42:20.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0ab2a0 con 0x7f038c15a4c0 2021-11-15T14:42:20.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c13f4a0 con 0x7f038c0aa9c0 2021-11-15T14:42:20.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34136/0 (socket says 172.21.2.135:34136) 2021-11-15T14:42:20.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 -- 172.21.2.135:0/4067804833 learned_addr learned my addr 172.21.2.135:0/4067804833 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:20.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039132a700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0aa9c0 0x7f038c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0391b2b700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f038c13f0c0 0x7f038c0ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 -- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0aa9c0 msgr2=0x7f038c0ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0aa9c0 0x7f038c0ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 -- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f038c13f0c0 msgr2=0x7f038c0ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:20.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f038c13f0c0 0x7f038c0ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:20.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 -- 172.21.2.135:0/4067804833 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c14af40 con 0x7f038c15a4c0 2021-11-15T14:42:20.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f039232c700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f038c156fa0 tx=0x7f0384016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0384006890 con 0x7f038c15a4c0 2021-11-15T14:42:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840127b0 con 0x7f038c15a4c0 2021-11-15T14:42:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c14b1e0 con 0x7f038c15a4c0 2021-11-15T14:42:20.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c0aaf20 con 0x7f038c15a4c0 2021-11-15T14:42:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0384012b10 con 0x7f038c15a4c0 2021-11-15T14:42:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c0b0c10 con 0x7f038c15a4c0 2021-11-15T14:42:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f038401b070 con 0x7f038c15a4c0 2021-11-15T14:42:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 0x7f036c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:20.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f038406ca70 con 0x7f038c15a4c0 2021-11-15T14:42:20.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.656+0000 7f0391b2b700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 0x7f036c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:20.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.660+0000 7f0391b2b700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 0x7f036c055b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f0380009000 tx=0x7f0380008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:20.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.660+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0384043970 con 0x7f038c15a4c0 2021-11-15T14:42:20.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:20.768+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f038c0573d0 con 0x7f038c15a4c0 2021-11-15T14:42:21.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f037effd700 1 -- 172.21.2.135:0/4067804833 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0384024030 con 0x7f038c15a4c0 2021-11-15T14:42:21.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 msgr2=0x7f036c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 0x7f036c055b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f0380009000 tx=0x7f0380008040).stop 2021-11-15T14:42:21.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 msgr2=0x7f038c15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f038c156fa0 tx=0x7f0384016000).stop 2021-11-15T14:42:21.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 shutdown_connections 2021-11-15T14:42:21.293 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f036c053660 0x7f036c055b20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f038c15a4c0 0x7f038c15a970 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f038c0aa9c0 0x7f038c0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 --2- 172.21.2.135:0/4067804833 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f038c13f0c0 0x7f038c0ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.294 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 >> 172.21.2.135:0/4067804833 conn(0x7f038c05f730 msgr2=0x7f038c1464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 shutdown_connections 2021-11-15T14:42:21.295 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.288+0000 7f0393d8f700 1 -- 172.21.2.135:0/4067804833 wait complete. 2021-11-15T14:42:21.299 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:21.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 Processor -- start 2021-11-15T14:42:21.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- start start 2021-11-15T14:42:21.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f971c0b1e30 0x7f971c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f971c148420 0x7f971c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0b03d0 con 0x7f971c0a7140 2021-11-15T14:42:21.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0a9140 con 0x7f971c0b1e30 2021-11-15T14:42:21.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0b0670 con 0x7f971c148420 2021-11-15T14:42:21.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f9720983700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f971c0a7140 0x7f971c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:49960/0 (socket says 172.21.2.135:49960) 2021-11-15T14:42:21.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f9720983700 1 -- 172.21.2.135:0/2948377731 learned_addr learned my addr 172.21.2.135:0/2948377731 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:21.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- 172.21.2.135:0/2948377731 >> v2:172.21.2.135:3300/0 conn(0x7f971c148420 0x7f971c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971affd700 1 -- 172.21.2.135:0/2948377731 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965382333 0 0) 0x7f971c0b03d0 con 0x7f971c0a7140 2021-11-15T14:42:21.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971affd700 1 -- 172.21.2.135:0/2948377731 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96fc003260 con 0x7f971c0a7140 2021-11-15T14:42:21.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/2948377731 >> v2:172.21.2.119:3300/0 conn(0x7f971c0b1e30 msgr2=0x7f971c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:21.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- 172.21.2.135:0/2948377731 >> v2:172.21.2.119:3300/0 conn(0x7f971c0b1e30 0x7f971c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/2948377731 >> v1:172.21.2.135:6789/0 conn(0x7f971c0a7140 legacy=0x7f971c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/2948377731 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0b0910 con 0x7f971c148420 2021-11-15T14:42:21.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- 172.21.2.135:0/2948377731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c148420 0x7f971c0b2210 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f971c1477b0 tx=0x7f970c006df0).ready entity=mon.1 client_cookie=2830db691e66d3e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971affd700 1 -- 172.21.2.135:0/2948377731 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c00d5c0 con 0x7f971c148420 2021-11-15T14:42:21.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971affd700 1 -- 172.21.2.135:0/2948377731 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c000e90 con 0x7f971c148420 2021-11-15T14:42:21.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971affd700 1 -- 172.21.2.135:0/2948377731 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c00d910 con 0x7f971c148420 2021-11-15T14:42:21.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- 172.21.2.135:0/2948377731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c148420 msgr2=0x7f971c0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- 172.21.2.135:0/2948377731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c148420 0x7f971c0b2210 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f971c1477b0 tx=0x7f970c006df0).stop 2021-11-15T14:42:21.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- 172.21.2.135:0/2948377731 shutdown_connections 2021-11-15T14:42:21.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- 172.21.2.135:0/2948377731 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c148420 0x7f971c0b2210 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- 172.21.2.135:0/2948377731 >> v2:172.21.2.119:3300/0 conn(0x7f971c0b1e30 0x7f971c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- 172.21.2.135:0/2948377731 >> 172.21.2.135:0/2948377731 conn(0x7f971c05f730 msgr2=0x7f971c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- 172.21.2.135:0/2948377731 shutdown_connections 2021-11-15T14:42:21.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- 172.21.2.135:0/2948377731 wait complete. 2021-11-15T14:42:21.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 Processor -- start 2021-11-15T14:42:21.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- start start 2021-11-15T14:42:21.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f971c0a7140 0x7f971c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f971c148420 0x7f971c143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0ab050 con 0x7f971c148420 2021-11-15T14:42:21.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0ab2f0 con 0x7f971c0b1e30 2021-11-15T14:42:21.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f97223e6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0ab590 con 0x7f971c0a7140 2021-11-15T14:42:21.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34146/0 (socket says 172.21.2.135:34146) 2021-11-15T14:42:21.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/3879303577 learned_addr learned my addr 172.21.2.135:0/3879303577 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f971c0a7140 msgr2=0x7f971c0a9800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:21.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f971c0a7140 0x7f971c0a9800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f971c148420 msgr2=0x7f971c143db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:21.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f971c148420 0x7f971c143db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.348+0000 7f971b7fe700 1 -- 172.21.2.135:0/3879303577 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c00b180 con 0x7f971c0b1e30 2021-11-15T14:42:21.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f971b7fe700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f971c1477b0 tx=0x7f970c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c002f70 con 0x7f971c0b1e30 2021-11-15T14:42:21.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c01e400 con 0x7f971c0b1e30 2021-11-15T14:42:21.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f970c01e760 con 0x7f971c0b1e30 2021-11-15T14:42:21.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c0ab830 con 0x7f971c0b1e30 2021-11-15T14:42:21.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c1442a0 con 0x7f971c0b1e30 2021-11-15T14:42:21.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c0ab9c0 con 0x7f971c0b1e30 2021-11-15T14:42:21.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f970c025030 con 0x7f971c0b1e30 2021-11-15T14:42:21.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 0x7f9700055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f970c06ca90 con 0x7f971c0b1e30 2021-11-15T14:42:21.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f971bfff700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 0x7f9700055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f971bfff700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 0x7f9700055bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f9704002f70 tx=0x7f9704006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.352+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f970c043990 con 0x7f971c0b1e30 2021-11-15T14:42:21.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f971c0b0bb0 con 0x7f971c0b1e30 2021-11-15T14:42:21.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97197fa700 1 -- 172.21.2.135:0/3879303577 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f970c046fb0 con 0x7f971c0b1e30 2021-11-15T14:42:21.468 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:21.469 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/2937977451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2937977451},{"type":"v1","addr":"172.21.2.119:6835","nonce":2937977451}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7594,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1819495861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1819495861},{"type":"v1","addr":"172.21.2.135:6833","nonce":1819495861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:20.273702+0000","modified":"2021-11-15T14:42:21.278545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7597":{"gid":7597,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2122454907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2122454907},{"type":"v1","addr":"172.21.2.135:6835","nonce":2122454907}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T14:42:21.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 msgr2=0x7f9700055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 0x7f9700055bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f9704002f70 tx=0x7f9704006a00).stop 2021-11-15T14:42:21.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 msgr2=0x7f971c1438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f971c1477b0 tx=0x7f970c014000).stop 2021-11-15T14:42:21.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 shutdown_connections 2021-11-15T14:42:21.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f97000536f0 0x7f9700055bb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f971c148420 0x7f971c143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f971c0b1e30 0x7f971c1438c0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 --2- 172.21.2.135:0/3879303577 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f971c0a7140 0x7f971c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 >> 172.21.2.135:0/3879303577 conn(0x7f971c05f730 msgr2=0x7f971c1449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 shutdown_connections 2021-11-15T14:42:21.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.464+0000 7f97223e6700 1 -- 172.21.2.135:0/3879303577 wait complete. 2021-11-15T14:42:21.472 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 59 2021-11-15T14:42:21.475 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:21.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 Processor -- start 2021-11-15T14:42:21.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 -- start start 2021-11-15T14:42:21.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf44148420 0x7fdf440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdf440a7140 0x7fdf441447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440b03d0 con 0x7fdf440b1e30 2021-11-15T14:42:21.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440a9140 con 0x7fdf440a7140 2021-11-15T14:42:21.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.520+0000 7fdf490f9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440b0670 con 0x7fdf44148420 2021-11-15T14:42:21.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf44148420 0x7fdf440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdf44148420 0x7fdf440b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34156/0 (socket says 172.21.2.135:34156) 2021-11-15T14:42:21.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/403980485 learned_addr learned my addr 172.21.2.135:0/403980485 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/403980485 >> v2:172.21.2.119:3300/0 conn(0x7fdf440a7140 msgr2=0x7fdf441447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:21.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- 172.21.2.135:0/403980485 >> v2:172.21.2.119:3300/0 conn(0x7fdf440a7140 0x7fdf441447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/403980485 >> v1:172.21.2.119:6789/0 conn(0x7fdf440b1e30 legacy=0x7fdf440b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:21.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/403980485 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440b0910 con 0x7fdf44148420 2021-11-15T14:42:21.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- 172.21.2.135:0/403980485 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf44148420 0x7fdf440b1050 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fdf440acee0 tx=0x7fdf34006eb0).ready entity=mon.1 client_cookie=b401d1e4f6f1a107 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf41d9b700 1 -- 172.21.2.135:0/403980485 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3400d5c0 con 0x7fdf44148420 2021-11-15T14:42:21.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf41d9b700 1 -- 172.21.2.135:0/403980485 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34000e90 con 0x7fdf44148420 2021-11-15T14:42:21.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf41d9b700 1 -- 172.21.2.135:0/403980485 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf3400d950 con 0x7fdf44148420 2021-11-15T14:42:21.533 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/403980485 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf44148420 msgr2=0x7fdf440b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- 172.21.2.135:0/403980485 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf44148420 0x7fdf440b1050 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fdf440acee0 tx=0x7fdf34006eb0).stop 2021-11-15T14:42:21.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/403980485 shutdown_connections 2021-11-15T14:42:21.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- 172.21.2.135:0/403980485 >> v2:172.21.2.119:3300/0 conn(0x7fdf440a7140 0x7fdf441447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.534 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- 172.21.2.135:0/403980485 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf44148420 0x7fdf440b1050 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/403980485 >> 172.21.2.135:0/403980485 conn(0x7fdf4405f730 msgr2=0x7fdf4405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/403980485 shutdown_connections 2021-11-15T14:42:21.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/403980485 wait complete. 2021-11-15T14:42:21.535 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 Processor -- start 2021-11-15T14:42:21.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- start start 2021-11-15T14:42:21.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf440a7140 0x7fdf4414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf44148420 0x7fdf4414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.536 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4414ab90 con 0x7fdf440a7140 2021-11-15T14:42:21.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440aa500 con 0x7fdf440b1e30 2021-11-15T14:42:21.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4414adc0 con 0x7fdf44148420 2021-11-15T14:42:21.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34164/0 (socket says 172.21.2.135:34164) 2021-11-15T14:42:21.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/1564405091 learned_addr learned my addr 172.21.2.135:0/1564405091 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf44148420 msgr2=0x7fdf4414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf44148420 0x7fdf4414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf440a7140 msgr2=0x7fdf4414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf440a7140 0x7fdf4414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 -- 172.21.2.135:0/1564405091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3400b1e0 con 0x7fdf440b1e30 2021-11-15T14:42:21.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf4259c700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fdf440aa420 tx=0x7fdf34015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34002f70 con 0x7fdf440b1e30 2021-11-15T14:42:21.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400de70 con 0x7fdf440b1e30 2021-11-15T14:42:21.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44148d00 con 0x7fdf440b1e30 2021-11-15T14:42:21.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34011e90 con 0x7fdf440b1e30 2021-11-15T14:42:21.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440a7b00 con 0x7fdf440b1e30 2021-11-15T14:42:21.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.524+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440aa670 con 0x7fdf440b1e30 2021-11-15T14:42:21.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf34025030 con 0x7fdf440b1e30 2021-11-15T14:42:21.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf3bfff700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 0x7fdf28055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fdf3406cf00 con 0x7fdf440b1e30 2021-11-15T14:42:21.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf42d9d700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 0x7fdf28055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf42d9d700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 0x7fdf28055b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdf2c002fb0 tx=0x7fdf2c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.528+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf34043e00 con 0x7fdf440b1e30 2021-11-15T14:42:21.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf440a7cc0 con 0x7fdf440b1e30 2021-11-15T14:42:21.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf3bfff700 1 -- 172.21.2.135:0/1564405091 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fdf34023020 con 0x7fdf440b1e30 2021-11-15T14:42:21.616 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:21.616 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":124,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:21.279627+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:18.125358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:19.266983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 msgr2=0x7fdf28055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 0x7fdf28055b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdf2c002fb0 tx=0x7fdf2c0069b0).stop 2021-11-15T14:42:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 msgr2=0x7fdf4414b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fdf440aa420 tx=0x7fdf34015000).stop 2021-11-15T14:42:21.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 shutdown_connections 2021-11-15T14:42:21.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdf280536a0 0x7fdf28055b60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdf44148420 0x7fdf4414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdf440b1e30 0x7fdf4414b040 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 --2- 172.21.2.135:0/1564405091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdf440a7140 0x7fdf4414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 >> 172.21.2.135:0/1564405091 conn(0x7fdf4405f730 msgr2=0x7fdf440b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 shutdown_connections 2021-11-15T14:42:21.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.612+0000 7fdf490f9700 1 -- 172.21.2.135:0/1564405091 wait complete. 2021-11-15T14:42:21.624 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:42:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.672+0000 7f496d939700 1 Processor -- start 2021-11-15T14:42:21.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.672+0000 7f496d939700 1 -- start start 2021-11-15T14:42:21.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680b1e30 0x7f49680b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f49680a7140 0x7f49681447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680b03d0 con 0x7f4968148420 2021-11-15T14:42:21.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680a9140 con 0x7f49680a7140 2021-11-15T14:42:21.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b0670 con 0x7f49680b1e30 2021-11-15T14:42:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f49680a7140 0x7f49681447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f49680a7140 0x7f49681447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34168/0 (socket says 172.21.2.135:34168) 2021-11-15T14:42:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 -- 172.21.2.135:0/925473151 learned_addr learned my addr 172.21.2.135:0/925473151 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 -- 172.21.2.135:0/925473151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680b1e30 msgr2=0x7f49680b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:21.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 --2- 172.21.2.135:0/925473151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680b1e30 0x7f49680b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 -- 172.21.2.135:0/925473151 >> v1:172.21.2.119:6789/0 conn(0x7f4968148420 legacy=0x7f49680b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 -- 172.21.2.135:0/925473151 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680b0910 con 0x7f49680a7140 2021-11-15T14:42:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49677fe700 1 --2- 172.21.2.135:0/925473151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680a7140 0x7f49681447a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4968061420 tx=0x7f4960009290).ready entity=mon.1 client_cookie=2cb53f81abe45117 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f4965ffb700 1 -- 172.21.2.135:0/925473151 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f496000b860 con 0x7f49680a7140 2021-11-15T14:42:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f4965ffb700 1 -- 172.21.2.135:0/925473151 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000b9c0 con 0x7f49680a7140 2021-11-15T14:42:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f4965ffb700 1 -- 172.21.2.135:0/925473151 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f496000bb70 con 0x7f49680a7140 2021-11-15T14:42:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- 172.21.2.135:0/925473151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680a7140 msgr2=0x7f49681447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- 172.21.2.135:0/925473151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680a7140 0x7f49681447a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4968061420 tx=0x7f4960009290).stop 2021-11-15T14:42:21.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- 172.21.2.135:0/925473151 shutdown_connections 2021-11-15T14:42:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- 172.21.2.135:0/925473151 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680a7140 0x7f49681447a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- 172.21.2.135:0/925473151 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680b1e30 0x7f49680b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- 172.21.2.135:0/925473151 >> 172.21.2.135:0/925473151 conn(0x7f496805f730 msgr2=0x7f496805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- 172.21.2.135:0/925473151 shutdown_connections 2021-11-15T14:42:21.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- 172.21.2.135:0/925473151 wait complete. 2021-11-15T14:42:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 Processor -- start 2021-11-15T14:42:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- start start 2021-11-15T14:42:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680a7140 0x7f4968144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4968148420 0x7f4968149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496814a2e0 con 0x7f4968148420 2021-11-15T14:42:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680ac920 con 0x7f49680b1e30 2021-11-15T14:42:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f496d939700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b38a0 con 0x7f49680a7140 2021-11-15T14:42:21.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34176/0 (socket says 172.21.2.135:34176) 2021-11-15T14:42:21.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 -- 172.21.2.135:0/380945723 learned_addr learned my addr 172.21.2.135:0/380945723 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 -- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680a7140 msgr2=0x7f4968144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680a7140 0x7f4968144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 -- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4968148420 msgr2=0x7f4968149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4968148420 0x7f4968149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 -- 172.21.2.135:0/380945723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009530 con 0x7f49680b1e30 2021-11-15T14:42:21.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.676+0000 7f49667fc700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f4958002f10 tx=0x7f4958006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4958009e00 con 0x7f49680b1e30 2021-11-15T14:42:21.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800f510 con 0x7f49680b1e30 2021-11-15T14:42:21.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f495800f680 con 0x7f49680b1e30 2021-11-15T14:42:21.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49680b3b40 con 0x7f49680b1e30 2021-11-15T14:42:21.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496813f0b0 con 0x7f49680b1e30 2021-11-15T14:42:21.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680b36e0 con 0x7f49680b1e30 2021-11-15T14:42:21.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f495800f070 con 0x7f49680b1e30 2021-11-15T14:42:21.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 0x7f494c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f495806b400 con 0x7f49680b1e30 2021-11-15T14:42:21.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f4966ffd700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 0x7f494c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f4966ffd700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 0x7f494c055a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f4950002f70 tx=0x7f4950006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.680+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4958042300 con 0x7f49680b1e30 2021-11-15T14:42:21.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.792+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f49680b3cd0 con 0x7f49680b1e30 2021-11-15T14:42:21.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.804+0000 7f495ffff700 1 -- 172.21.2.135:0/380945723 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4958045920 con 0x7f49680b1e30 2021-11-15T14:42:21.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.804+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 msgr2=0x7f494c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.804+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 0x7f494c055a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f4950002f70 tx=0x7f4950006a80).stop 2021-11-15T14:42:21.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 msgr2=0x7f4968148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f4958002f10 tx=0x7f4958006d60).stop 2021-11-15T14:42:21.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 shutdown_connections 2021-11-15T14:42:21.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f494c053580 0x7f494c055a40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4968148420 0x7f4968149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f49680b1e30 0x7f4968148b80 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 --2- 172.21.2.135:0/380945723 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49680a7140 0x7f4968144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:21.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 >> 172.21.2.135:0/380945723 conn(0x7f496805f730 msgr2=0x7f49680ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 shutdown_connections 2021-11-15T14:42:21.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.808+0000 7f496d939700 1 -- 172.21.2.135:0/380945723 wait complete. 2021-11-15T14:42:21.813 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:42:21.816 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:42:21.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 Processor -- start 2021-11-15T14:42:21.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 -- start start 2021-11-15T14:42:21.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 0x7f96080b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f96080a7140 0x7f96081447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96080b03d0 con 0x7f96080b1e30 2021-11-15T14:42:21.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96080a9140 con 0x7f96080a7140 2021-11-15T14:42:21.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f960cec9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96080b0670 con 0x7f9608148420 2021-11-15T14:42:21.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f96080a7140 0x7f96081447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9605d9b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 0x7f96080b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9605d9b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 0x7f96080b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:43958/0 (socket says 172.21.2.135:43958) 2021-11-15T14:42:21.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f96080a7140 0x7f96081447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:56228/0 (socket says 172.21.2.135:56228) 2021-11-15T14:42:21.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9605d9b700 1 -- 172.21.2.135:0/89466263 learned_addr learned my addr 172.21.2.135:0/89466263 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 -- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 msgr2=0x7f96080b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:21.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 --2- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 0x7f96080b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 -- 172.21.2.135:0/89466263 >> v1:172.21.2.119:6789/0 conn(0x7f96080b1e30 legacy=0x7f96080b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 -- 172.21.2.135:0/89466263 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080b0910 con 0x7f96080a7140 2021-11-15T14:42:21.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.868+0000 7f9606d9d700 1 --2- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96080a7140 0x7f96081447a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f96000032f0 tx=0x7f96000091d0).ready entity=mon.0 client_cookie=b0041f36fd2ceca3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960559a700 1 -- 172.21.2.135:0/89466263 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960000b6c0 con 0x7f96080a7140 2021-11-15T14:42:21.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960559a700 1 -- 172.21.2.135:0/89466263 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000b820 con 0x7f96080a7140 2021-11-15T14:42:21.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960559a700 1 -- 172.21.2.135:0/89466263 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960000b990 con 0x7f96080a7140 2021-11-15T14:42:21.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96080a7140 msgr2=0x7f96081447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96080a7140 0x7f96081447a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f96000032f0 tx=0x7f96000091d0).stop 2021-11-15T14:42:21.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/89466263 shutdown_connections 2021-11-15T14:42:21.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96080a7140 0x7f96081447a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- 172.21.2.135:0/89466263 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9608148420 0x7f96080b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/89466263 >> 172.21.2.135:0/89466263 conn(0x7f960805f730 msgr2=0x7f960805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:21.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/89466263 shutdown_connections 2021-11-15T14:42:21.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/89466263 wait complete. 2021-11-15T14:42:21.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 Processor -- start 2021-11-15T14:42:21.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- start start 2021-11-15T14:42:21.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96080b1e30 0x7f9608156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9608148420 0x7f9608157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080aabd0 con 0x7f9608148420 2021-11-15T14:42:21.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080aa930 con 0x7f96080a7140 2021-11-15T14:42:21.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96080aa110 con 0x7f96080b1e30 2021-11-15T14:42:21.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34186/0 (socket says 172.21.2.135:34186) 2021-11-15T14:42:21.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 -- 172.21.2.135:0/3558018333 learned_addr learned my addr 172.21.2.135:0/3558018333 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:21.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f9605d9b700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96080b1e30 0x7f9608156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f9606d9d700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9608148420 0x7f9608157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 -- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96080b1e30 msgr2=0x7f9608156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96080b1e30 0x7f9608156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 -- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9608148420 msgr2=0x7f9608157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:21.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9608148420 0x7f9608157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 -- 172.21.2.135:0/3558018333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009470 con 0x7f96080a7140 2021-11-15T14:42:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960659c700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f9608061420 tx=0x7f95f8007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f800ce30 con 0x7f96080a7140 2021-11-15T14:42:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8007240 con 0x7f96080a7140 2021-11-15T14:42:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96080aa3d0 con 0x7f96080a7140 2021-11-15T14:42:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96080a9d70 con 0x7f96080a7140 2021-11-15T14:42:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f8006700 con 0x7f96080a7140 2021-11-15T14:42:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96081577b0 con 0x7f96080a7140 2021-11-15T14:42:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.872+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f95f8010030 con 0x7f96080a7140 2021-11-15T14:42:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.876+0000 7f95ff7fe700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 0x7f95ec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.876+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f95f806b730 con 0x7f96080a7140 2021-11-15T14:42:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.876+0000 7f9605d9b700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 0x7f95ec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:21.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.876+0000 7f9605d9b700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 0x7f95ec055ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f95f0008000 tx=0x7f95f0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:21.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.876+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95f8042740 con 0x7f96080a7140 2021-11-15T14:42:21.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:21.988+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f96080573d0 con 0x7f96080a7140 2021-11-15T14:42:22.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.000+0000 7f95ff7fe700 1 -- 172.21.2.135:0/3558018333 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f95f8045d60 con 0x7f96080a7140 2021-11-15T14:42:22.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 msgr2=0x7f95ec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 0x7f95ec055ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f95f0008000 tx=0x7f95f0008040).stop 2021-11-15T14:42:22.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 msgr2=0x7f96080ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f9608061420 tx=0x7f95f8007c10).stop 2021-11-15T14:42:22.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 shutdown_connections 2021-11-15T14:42:22.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95ec053610 0x7f95ec055ad0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9608148420 0x7f9608157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96080b1e30 0x7f9608156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 --2- 172.21.2.135:0/3558018333 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96080a7140 0x7f96080ad860 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 >> 172.21.2.135:0/3558018333 conn(0x7f960805f730 msgr2=0x7f9608144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 shutdown_connections 2021-11-15T14:42:22.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.004+0000 7f960cec9700 1 -- 172.21.2.135:0/3558018333 wait complete. 2021-11-15T14:42:22.009 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:42:22.012 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:22.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 Processor -- start 2021-11-15T14:42:22.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 -- start start 2021-11-15T14:42:22.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc04c148420 0x7fc04c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c0b03d0 con 0x7fc04c0a7140 2021-11-15T14:42:22.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c0b0670 con 0x7fc04c0b1e30 2021-11-15T14:42:22.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0a9140 con 0x7fc04c148420 2021-11-15T14:42:22.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc05142f700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc04c0b1e30 0x7fc04c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50014/0 (socket says 172.21.2.135:50014) 2021-11-15T14:42:22.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc05142f700 1 -- 172.21.2.135:0/732436721 learned_addr learned my addr 172.21.2.135:0/732436721 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:22.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937187766 0 0) 0x7fc04c0b0670 con 0x7fc04c0b1e30 2021-11-15T14:42:22.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034003260 con 0x7fc04c0b1e30 2021-11-15T14:42:22.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 --2- 172.21.2.135:0/732436721 >> v2:172.21.2.119:3300/0 conn(0x7fc04c148420 0x7fc04c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216717026 0 0) 0x7fc034003260 con 0x7fc04c0b1e30 2021-11-15T14:42:22.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 >> v2:172.21.2.119:3300/0 conn(0x7fc04c148420 msgr2=0x7fc04c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 --2- 172.21.2.135:0/732436721 >> v2:172.21.2.119:3300/0 conn(0x7fc04c148420 0x7fc04c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 >> v1:172.21.2.119:6789/0 conn(0x7fc04c0a7140 legacy=0x7fc04c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c0b0910 con 0x7fc04c0b1e30 2021-11-15T14:42:22.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fc048001660 con 0x7fc04c0b1e30 2021-11-15T14:42:22.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 >> v1:172.21.2.135:6789/0 conn(0x7fc04c0b1e30 legacy=0x7fc04c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc034003820 0x7fc034003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 0x7fc034004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004f70 0x7fc03400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400be20 con 0x7fc034003820 2021-11-15T14:42:22.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400bf90 con 0x7fc034004500 2021-11-15T14:42:22.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400c150 con 0x7fc034004f70 2021-11-15T14:42:22.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 0x7fc034004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc05142f700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc034003820 0x7fc034003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc051c30700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004f70 0x7fc03400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 -- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004f70 msgr2=0x7fc03400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004f70 0x7fc03400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 -- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc034003820 msgr2=0x7fc034003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc034003820 0x7fc034003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 -- 172.21.2.135:0/732436721 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034003260 con 0x7fc034004500 2021-11-15T14:42:22.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc051c30700 1 -- 172.21.2.135:0/732436721 reap_dead start 2021-11-15T14:42:22.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc050c2e700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 0x7fc034004980 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fc04000a000 tx=0x7fc040008040).ready entity=mon.1 client_cookie=8a08dad5ee8d1cfe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc040013670 con 0x7fc034004500 2021-11-15T14:42:22.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0400137d0 con 0x7fc034004500 2021-11-15T14:42:22.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc03ffff700 1 -- 172.21.2.135:0/732436721 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc040013b30 con 0x7fc034004500 2021-11-15T14:42:22.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 -- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 msgr2=0x7fc034004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.060+0000 7fc053693700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 0x7fc034004980 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fc04000a000 tx=0x7fc040008040).stop 2021-11-15T14:42:22.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/732436721 shutdown_connections 2021-11-15T14:42:22.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 --2- 172.21.2.135:0/732436721 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc034004500 0x7fc034004980 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/732436721 >> 172.21.2.135:0/732436721 conn(0x7fc04c05f730 msgr2=0x7fc04c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/732436721 shutdown_connections 2021-11-15T14:42:22.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/732436721 wait complete. 2021-11-15T14:42:22.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 Processor -- start 2021-11-15T14:42:22.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- start start 2021-11-15T14:42:22.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004500 0x7fc04c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc04c147280 0x7fc04c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c0adac0 con 0x7fc04c147280 2021-11-15T14:42:22.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c140630 con 0x7fc04c13ded0 2021-11-15T14:42:22.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c145de0 con 0x7fc034004500 2021-11-15T14:42:22.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34208/0 (socket says 172.21.2.135:34208) 2021-11-15T14:42:22.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 -- 172.21.2.135:0/3872070514 learned_addr learned my addr 172.21.2.135:0/3872070514 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:22.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 -- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004500 msgr2=0x7fc04c0ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004500 0x7fc04c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 -- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc04c147280 msgr2=0x7fc04c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc04c147280 0x7fc04c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 -- 172.21.2.135:0/3872070514 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c0ac700 con 0x7fc04c13ded0 2021-11-15T14:42:22.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc051c30700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc04c05f180 tx=0x7fc044009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc044014670 con 0x7fc04c13ded0 2021-11-15T14:42:22.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0440147d0 con 0x7fc04c13ded0 2021-11-15T14:42:22.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc044014b30 con 0x7fc04c13ded0 2021-11-15T14:42:22.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c0af7d0 con 0x7fc04c13ded0 2021-11-15T14:42:22.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c0afac0 con 0x7fc04c13ded0 2021-11-15T14:42:22.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c0ac560 con 0x7fc04c13ded0 2021-11-15T14:42:22.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc04401b030 con 0x7fc04c13ded0 2021-11-15T14:42:22.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 0x7fc02c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc04406ba50 con 0x7fc04c13ded0 2021-11-15T14:42:22.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.064+0000 7fc05142f700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 0x7fc02c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.068+0000 7fc05142f700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 0x7fc02c055a40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc04800d000 tx=0x7fc04c0b0aa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.068+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc04c0ac560 con 0x7fc04c13ded0 2021-11-15T14:42:22.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc04c0ac560 con 0x7fc04c13ded0 2021-11-15T14:42:22.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc03e7fc700 1 -- 172.21.2.135:0/3872070514 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fc04c0ac560 con 0x7fc04c13ded0 2021-11-15T14:42:22.178 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:22.179 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/2937977451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2937977451},{"type":"v1","addr":"172.21.2.119:6835","nonce":2937977451}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7594,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1819495861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1819495861},{"type":"v1","addr":"172.21.2.135:6833","nonce":1819495861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:20.273702+0000","modified":"2021-11-15T14:42:21.278545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7597":{"gid":7597,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2122454907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2122454907},{"type":"v1","addr":"172.21.2.135:6835","nonce":2122454907}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T14:42:22.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 msgr2=0x7fc02c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 0x7fc02c055a40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc04800d000 tx=0x7fc04c0b0aa0).stop 2021-11-15T14:42:22.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 msgr2=0x7fc04c146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc04c05f180 tx=0x7fc044009040).stop 2021-11-15T14:42:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 shutdown_connections 2021-11-15T14:42:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc02c053580 0x7fc02c055a40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc04c13ded0 0x7fc04c146510 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc04c147280 0x7fc04c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 --2- 172.21.2.135:0/3872070514 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc034004500 0x7fc04c0ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 >> 172.21.2.135:0/3872070514 conn(0x7fc04c05f730 msgr2=0x7fc04c142df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 shutdown_connections 2021-11-15T14:42:22.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.176+0000 7fc053693700 1 -- 172.21.2.135:0/3872070514 wait complete. 2021-11-15T14:42:22.183 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 59 2021-11-15T14:42:22.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:20.273702+0000', 'modified': '2021-11-15T14:42:21.278545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7597': {'gid': 7597, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2122454907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2122454907}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2122454907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:22.489 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:22.489 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:22.569 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7597,"want_state":"up:active","state":"up:active","rank_uptime":2.2845163500000001,"mdsmap_epoch":59,"osdmap_epoch":125,"osdmap_epoch_barrier":123,"uptime":6.5393364859999998} 2021-11-15T14:42:22.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7597, "mdsmap_epoch": 59, "osdmap_epoch": 125, "osdmap_epoch_barrier": 123, "rank_uptime": 2.28451635, "state": "up:active", "uptime": 6.539336486, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:22.570 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:22.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 Processor -- start 2021-11-15T14:42:22.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 -- start start 2021-11-15T14:42:22.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5db4060180 0x7f5db4066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40669f0 0x7f5db414b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db4060560 con 0x7f5db40b37c0 2021-11-15T14:42:22.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4065b20 con 0x7f5db4060180 2021-11-15T14:42:22.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5dbc40e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4065dc0 con 0x7f5db40669f0 2021-11-15T14:42:22.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5db99a9700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5db40b37c0 0x7f5db414ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50038/0 (socket says 172.21.2.135:50038) 2021-11-15T14:42:22.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5db99a9700 1 -- 172.21.2.135:0/3463357684 learned_addr learned my addr 172.21.2.135:0/3463357684 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:22.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648239977 0 0) 0x7f5db4060560 con 0x7f5db40b37c0 2021-11-15T14:42:22.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.616+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c003260 con 0x7f5db40b37c0 2021-11-15T14:42:22.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba9ab700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40669f0 0x7f5db414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107419189 0 0) 0x7f5d9c003260 con 0x7f5db40b37c0 2021-11-15T14:42:22.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40669f0 msgr2=0x7f5db414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- 172.21.2.135:0/3463357684 >> v2:172.21.2.119:3300/0 conn(0x7f5db4060180 0x7f5db4066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40669f0 0x7f5db414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 >> v2:172.21.2.119:3300/0 conn(0x7f5db4060180 msgr2=0x7f5db4066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 --2- 172.21.2.135:0/3463357684 >> v2:172.21.2.119:3300/0 conn(0x7f5db4060180 0x7f5db4066500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db4066060 con 0x7f5db40b37c0 2021-11-15T14:42:22.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5dac001a00 con 0x7f5db40b37c0 2021-11-15T14:42:22.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 >> v1:172.21.2.135:6789/0 conn(0x7f5db40b37c0 legacy=0x7f5db414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d9c0037d0 0x7f5d9c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5d9c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d9c004f90 0x7f5d9c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4065b20 con 0x7f5d9c004f90 2021-11-15T14:42:22.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4065dc0 con 0x7f5d9c004500 2021-11-15T14:42:22.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c00bed0 con 0x7f5d9c0037d0 2021-11-15T14:42:22.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba9ab700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40669f0 0x7f5db414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:22.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5d9c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d9c0037d0 0x7f5d9c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 -- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d9c0037d0 msgr2=0x7f5d9c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5d9c0037d0 0x7f5d9c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 -- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d9c004f90 msgr2=0x7f5d9c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5d9c004f90 0x7f5d9c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 -- 172.21.2.135:0/3463357684 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db4066060 con 0x7f5d9c004500 2021-11-15T14:42:22.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db99a9700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5d9c004980 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f5dac001710 tx=0x7f5dac0079b0).ready entity=mon.1 client_cookie=838e0165b1c5aa53 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac007c60 con 0x7f5d9c004500 2021-11-15T14:42:22.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00ccb0 con 0x7f5d9c004500 2021-11-15T14:42:22.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5db91a8700 1 -- 172.21.2.135:0/3463357684 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac004b50 con 0x7f5d9c004500 2021-11-15T14:42:22.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/3463357684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 msgr2=0x7f5d9c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/3463357684 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5d9c004980 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f5dac001710 tx=0x7f5dac0079b0).stop 2021-11-15T14:42:22.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba9ab700 1 -- 172.21.2.135:0/3463357684 reap_dead start 2021-11-15T14:42:22.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/3463357684 shutdown_connections 2021-11-15T14:42:22.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/3463357684 >> 172.21.2.135:0/3463357684 conn(0x7f5db405cfb0 msgr2=0x7f5db405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/3463357684 shutdown_connections 2021-11-15T14:42:22.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/3463357684 wait complete. 2021-11-15T14:42:22.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 Processor -- start 2021-11-15T14:42:22.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- start start 2021-11-15T14:42:22.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5db40b1140 0x7f5db40a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40aa2e0 0x7f5db409e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40a1960 con 0x7f5db40b1140 2021-11-15T14:42:22.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db415a330 con 0x7f5d9c004500 2021-11-15T14:42:22.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db415a5d0 con 0x7f5db40aa2e0 2021-11-15T14:42:22.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34230/0 (socket says 172.21.2.135:34230) 2021-11-15T14:42:22.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 -- 172.21.2.135:0/2446866178 learned_addr learned my addr 172.21.2.135:0/2446866178 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:22.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 -- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40aa2e0 msgr2=0x7f5db409e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40aa2e0 0x7f5db409e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 -- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5db40b1140 msgr2=0x7f5db40a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5db40b1140 0x7f5db40a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 -- 172.21.2.135:0/2446866178 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db415a870 con 0x7f5d9c004500 2021-11-15T14:42:22.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dba1aa700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f5db40b02b0 tx=0x7f5da4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da40127f0 con 0x7f5d9c004500 2021-11-15T14:42:22.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4000e90 con 0x7f5d9c004500 2021-11-15T14:42:22.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db415ab10 con 0x7f5d9c004500 2021-11-15T14:42:22.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da4012b40 con 0x7f5d9c004500 2021-11-15T14:42:22.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.620+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40af930 con 0x7f5d9c004500 2021-11-15T14:42:22.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db40573d0 con 0x7f5d9c004500 2021-11-15T14:42:22.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5da4012ca0 con 0x7f5d9c004500 2021-11-15T14:42:22.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5da37fe700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 0x7f5d94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5da406bd60 con 0x7f5d9c004500 2021-11-15T14:42:22.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5db99a9700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 0x7f5d94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5db99a9700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 0x7f5d94055ad0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5dac001710 tx=0x7f5dac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.624+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5da4042d10 con 0x7f5d9c004500 2021-11-15T14:42:22.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.708+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5db405f730 con 0x7f5d9c004500 2021-11-15T14:42:22.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.708+0000 7f5da37fe700 1 -- 172.21.2.135:0/2446866178 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f5da4016070 con 0x7f5d9c004500 2021-11-15T14:42:22.713 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:22.714 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":125,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:22.294172+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:18.125358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:19.266983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:22.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 msgr2=0x7f5d94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 0x7f5d94055ad0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f5dac001710 tx=0x7f5dac015000).stop 2021-11-15T14:42:22.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 msgr2=0x7f5db40b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f5db40b02b0 tx=0x7f5da4008040).stop 2021-11-15T14:42:22.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 shutdown_connections 2021-11-15T14:42:22.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5d94053610 0x7f5d94055ad0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5db40aa2e0 0x7f5db409e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5db40b1140 0x7f5db40a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 --2- 172.21.2.135:0/2446866178 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5d9c004500 0x7f5db40b0690 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 >> 172.21.2.135:0/2446866178 conn(0x7f5db405cfb0 msgr2=0x7f5db40b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 shutdown_connections 2021-11-15T14:42:22.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.712+0000 7f5dbc40e700 1 -- 172.21.2.135:0/2446866178 wait complete. 2021-11-15T14:42:22.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:42:18.125358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:42:19.266983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:42:22.722 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:22.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 Processor -- start 2021-11-15T14:42:22.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- start start 2021-11-15T14:42:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8d080b1f40 0x7f8d080b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8d080b2320 0x7f8d081412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080b04a0 con 0x7f8d080b0030 2021-11-15T14:42:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080a7850 con 0x7f8d080b1f40 2021-11-15T14:42:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080b06d0 con 0x7f8d080b2320 2021-11-15T14:42:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0d639700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8d080b0030 0x7f8d080a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50054/0 (socket says 172.21.2.135:50054) 2021-11-15T14:42:22.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0d639700 1 -- 172.21.2.135:0/2065065887 learned_addr learned my addr 172.21.2.135:0/2065065887 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/2065065887 >> v2:172.21.2.135:3300/0 conn(0x7f8d080b2320 0x7f8d081412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0de3a700 1 --2- 172.21.2.135:0/2065065887 >> v2:172.21.2.119:3300/0 conn(0x7f8d080b1f40 0x7f8d080b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 -- 172.21.2.135:0/2065065887 >> v2:172.21.2.119:3300/0 conn(0x7f8d080b1f40 msgr2=0x7f8d080b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/2065065887 >> v2:172.21.2.119:3300/0 conn(0x7f8d080b1f40 0x7f8d080b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 -- 172.21.2.135:0/2065065887 >> v1:172.21.2.135:6789/0 conn(0x7f8d080b0030 legacy=0x7f8d080a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 -- 172.21.2.135:0/2065065887 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080b0970 con 0x7f8d080b2320 2021-11-15T14:42:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/2065065887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081412d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f8d000032f0 tx=0x7f8d000091d0).ready entity=mon.1 client_cookie=4106495583593c83 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0ce38700 1 -- 172.21.2.135:0/2065065887 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d00009ea0 con 0x7f8d080b2320 2021-11-15T14:42:22.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0ce38700 1 -- 172.21.2.135:0/2065065887 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000b870 con 0x7f8d080b2320 2021-11-15T14:42:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d0ce38700 1 -- 172.21.2.135:0/2065065887 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0000b9e0 con 0x7f8d080b2320 2021-11-15T14:42:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- 172.21.2.135:0/2065065887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 msgr2=0x7f8d081412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 --2- 172.21.2.135:0/2065065887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081412d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f8d000032f0 tx=0x7f8d000091d0).stop 2021-11-15T14:42:22.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- 172.21.2.135:0/2065065887 shutdown_connections 2021-11-15T14:42:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 --2- 172.21.2.135:0/2065065887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081412d0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 --2- 172.21.2.135:0/2065065887 >> v2:172.21.2.119:3300/0 conn(0x7f8d080b1f40 0x7f8d080b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- 172.21.2.135:0/2065065887 >> 172.21.2.135:0/2065065887 conn(0x7f8d0805f730 msgr2=0x7f8d0805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- 172.21.2.135:0/2065065887 shutdown_connections 2021-11-15T14:42:22.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- 172.21.2.135:0/2065065887 wait complete. 2021-11-15T14:42:22.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 Processor -- start 2021-11-15T14:42:22.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.772+0000 7f8d1009e700 1 -- start start 2021-11-15T14:42:22.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d080b0030 0x7f8d0815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d080b1f40 0x7f8d08062920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0814a490 con 0x7f8d080b0030 2021-11-15T14:42:22.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080b6060 con 0x7f8d080b2320 2021-11-15T14:42:22.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0815aac0 con 0x7f8d080b1f40 2021-11-15T14:42:22.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34242/0 (socket says 172.21.2.135:34242) 2021-11-15T14:42:22.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 -- 172.21.2.135:0/1264757352 learned_addr learned my addr 172.21.2.135:0/1264757352 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:22.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0d639700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d080b1f40 0x7f8d08062920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 -- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d080b1f40 msgr2=0x7f8d08062920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d080b1f40 0x7f8d08062920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 -- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d080b0030 msgr2=0x7f8d0815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d080b0030 0x7f8d0815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 -- 172.21.2.135:0/1264757352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00009470 con 0x7f8d080b2320 2021-11-15T14:42:22.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0e63b700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f8d000032f0 tx=0x7f8d00016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d00009ea0 con 0x7f8d080b2320 2021-11-15T14:42:22.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0001f5e0 con 0x7f8d080b2320 2021-11-15T14:42:22.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08062e10 con 0x7f8d080b2320 2021-11-15T14:42:22.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0815af90 con 0x7f8d080b2320 2021-11-15T14:42:22.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0001f940 con 0x7f8d080b2320 2021-11-15T14:42:22.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0815b150 con 0x7f8d080b2320 2021-11-15T14:42:22.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d00026030 con 0x7f8d080b2320 2021-11-15T14:42:22.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 0x7f8ce8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8d0006c810 con 0x7f8d080b2320 2021-11-15T14:42:22.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0de3a700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 0x7f8ce8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.776+0000 7f8d0de3a700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 0x7f8ce8055b20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8cfc00a000 tx=0x7f8cfc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.780+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d00043710 con 0x7f8d080b2320 2021-11-15T14:42:22.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.860+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d080b6430 con 0x7f8d080b2320 2021-11-15T14:42:22.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.860+0000 7f8cfaffd700 1 -- 172.21.2.135:0/1264757352 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v125) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d00046d30 con 0x7f8d080b2320 2021-11-15T14:42:22.865 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:22.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 msgr2=0x7f8ce8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 0x7f8ce8055b20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8cfc00a000 tx=0x7f8cfc008040).stop 2021-11-15T14:42:22.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 msgr2=0x7f8d081462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f8d000032f0 tx=0x7f8d00016000).stop 2021-11-15T14:42:22.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 shutdown_connections 2021-11-15T14:42:22.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ce8053660 0x7f8ce8055b20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8d080b2320 0x7f8d081462b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8d080b1f40 0x7f8d08062920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 --2- 172.21.2.135:0/1264757352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8d080b0030 0x7f8d0815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 >> 172.21.2.135:0/1264757352 conn(0x7f8d0805f730 msgr2=0x7f8d080af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 shutdown_connections 2021-11-15T14:42:22.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.864+0000 7f8d1009e700 1 -- 172.21.2.135:0/1264757352 wait complete. 2021-11-15T14:42:22.872 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.920+0000 7f72c5e5d700 1 Processor -- start 2021-11-15T14:42:22.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.920+0000 7f72c5e5d700 1 -- start start 2021-11-15T14:42:22.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 0x7f72c01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00b2430 con 0x7f72c00b3950 2021-11-15T14:42:22.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00b26d0 con 0x7f72c0060040 2021-11-15T14:42:22.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00b2970 con 0x7f72c00654a0 2021-11-15T14:42:22.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f72c0060040 0x7f72c0064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50066/0 (socket says 172.21.2.135:50066) 2021-11-15T14:42:22.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 -- 172.21.2.135:0/3683737722 learned_addr learned my addr 172.21.2.135:0/3683737722 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:22.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315450188 0 0) 0x7f72c00b26d0 con 0x7f72c0060040 2021-11-15T14:42:22.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003260 con 0x7f72c0060040 2021-11-15T14:42:22.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088948471 0 0) 0x7f72a0003260 con 0x7f72c0060040 2021-11-15T14:42:22.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 msgr2=0x7f72c01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 0x7f72c01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 >> v1:172.21.2.119:6789/0 conn(0x7f72c00b3950 legacy=0x7f72c01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00648f0 con 0x7f72c0060040 2021-11-15T14:42:22.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f72a8001660 con 0x7f72c0060040 2021-11-15T14:42:22.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 >> v1:172.21.2.135:6789/0 conn(0x7f72c0060040 legacy=0x7f72c0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72a00037d0 0x7f72a0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72a0004500 0x7f72a0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 0x7f72a000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00b2970 con 0x7f72a00037d0 2021-11-15T14:42:22.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00052e0 con 0x7f72a0004500 2021-11-15T14:42:22.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a000bc40 con 0x7f72c00654a0 2021-11-15T14:42:22.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72a0004500 0x7f72a0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72a00037d0 0x7f72a0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 -- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 msgr2=0x7f72a000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00654a0 0x7f72a000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 -- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72a00037d0 msgr2=0x7f72a0003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:22.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72a00037d0 0x7f72a0003bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:22.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 -- 172.21.2.135:0/3683737722 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0003260 con 0x7f72a0004500 2021-11-15T14:42:22.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72beffd700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72a0004500 0x7f72a0004980 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f72b0002f70 tx=0x7f72b0006ca0).ready entity=mon.1 client_cookie=9b2028324bdfe0c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b0012410 con 0x7f72a0004500 2021-11-15T14:42:22.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0012570 con 0x7f72a0004500 2021-11-15T14:42:22.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72be7fc700 1 -- 172.21.2.135:0/3683737722 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b00128d0 con 0x7f72a0004500 2021-11-15T14:42:22.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/3683737722 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72a0004500 msgr2=0x7f72a0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/3683737722 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72a0004500 0x7f72a0004980 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f72b0002f70 tx=0x7f72b0006ca0).stop 2021-11-15T14:42:22.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bffff700 1 -- 172.21.2.135:0/3683737722 reap_dead start 2021-11-15T14:42:22.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/3683737722 shutdown_connections 2021-11-15T14:42:22.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/3683737722 >> 172.21.2.135:0/3683737722 conn(0x7f72c005cfe0 msgr2=0x7f72c005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:22.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/3683737722 shutdown_connections 2021-11-15T14:42:22.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/3683737722 wait complete. 2021-11-15T14:42:22.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 Processor -- start 2021-11-15T14:42:22.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- start start 2021-11-15T14:42:22.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00b1430 0x7f72c0156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72c0156fa0 0x7f72c00afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01578b0 con 0x7f72c0156fa0 2021-11-15T14:42:22.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00af010 con 0x7f72c013c950 2021-11-15T14:42:22.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00af2b0 con 0x7f72c00b1430 2021-11-15T14:42:22.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34258/0 (socket says 172.21.2.135:34258) 2021-11-15T14:42:22.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 -- 172.21.2.135:0/2773231289 learned_addr learned my addr 172.21.2.135:0/2773231289 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:22.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 -- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00b1430 msgr2=0x7f72c0156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00b1430 0x7f72c0156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 -- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72c0156fa0 msgr2=0x7f72c00afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:22.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72c0156fa0 0x7f72c00afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:22.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 -- 172.21.2.135:0/2773231289 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c013d2a0 con 0x7f72c013c950 2021-11-15T14:42:22.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bf7fe700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f72a8008000 tx=0x7f72a8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a8007170 con 0x7f72c013c950 2021-11-15T14:42:22.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a80072d0 con 0x7f72c013c950 2021-11-15T14:42:22.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a80049e0 con 0x7f72c013c950 2021-11-15T14:42:22.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0157420 con 0x7f72c013c950 2021-11-15T14:42:22.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.924+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00b03c0 con 0x7f72c013c950 2021-11-15T14:42:22.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c0157a20 con 0x7f72c013c950 2021-11-15T14:42:22.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72a8004b40 con 0x7f72c013c950 2021-11-15T14:42:22.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72bcff9700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 0x7f72a4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:22.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f72a806be80 con 0x7f72c013c950 2021-11-15T14:42:22.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72beffd700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 0x7f72a4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:22.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72beffd700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 0x7f72a4055a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f72b0002f70 tx=0x7f72b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:22.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:22.928+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72c0157a20 con 0x7f72c013c950 2021-11-15T14:42:23.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.012+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72c013d490 con 0x7f72c013c950 2021-11-15T14:42:23.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.012+0000 7f72bcff9700 1 -- 172.21.2.135:0/2773231289 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72c013d490 con 0x7f72c013c950 2021-11-15T14:42:23.018 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:23.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 msgr2=0x7f72a4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 0x7f72a4055a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f72b0002f70 tx=0x7f72b0015000).stop 2021-11-15T14:42:23.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 msgr2=0x7f72c013cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f72a8008000 tx=0x7f72a8009040).stop 2021-11-15T14:42:23.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 shutdown_connections 2021-11-15T14:42:23.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f72a40535b0 0x7f72a4055a70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f72c0156fa0 0x7f72c00afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f72c00b1430 0x7f72c0156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 --2- 172.21.2.135:0/2773231289 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f72c013c950 0x7f72c013cd30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 >> 172.21.2.135:0/2773231289 conn(0x7f72c005cfe0 msgr2=0x7f72c014dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 shutdown_connections 2021-11-15T14:42:23.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.016+0000 7f72c5e5d700 1 -- 172.21.2.135:0/2773231289 wait complete. 2021-11-15T14:42:23.025 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:42:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 Processor -- start 2021-11-15T14:42:23.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 -- start start 2021-11-15T14:42:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc35c0b3950 0x7fc35c144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0b2430 con 0x7fc35c060040 2021-11-15T14:42:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0b26d0 con 0x7fc35c0654a0 2021-11-15T14:42:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.072+0000 7fc3622b5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0b2970 con 0x7fc35c0b3950 2021-11-15T14:42:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc35c0b3950 0x7fc35c144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc35b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc35c0654a0 0x7fc35c1444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50090/0 (socket says 172.21.2.135:50090) 2021-11-15T14:42:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc35b7fe700 1 -- 172.21.2.135:0/2657137268 learned_addr learned my addr 172.21.2.135:0/2657137268 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2657137268 >> v1:172.21.2.135:6789/0 conn(0x7fc35c0654a0 legacy=0x7fc35c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2657137268 >> v1:172.21.2.119:6789/0 conn(0x7fc35c060040 legacy=0x7fc35c064d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:23.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2657137268 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0648f0 con 0x7fc35c0b3950 2021-11-15T14:42:23.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- 172.21.2.135:0/2657137268 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c144bd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc35c13b870 tx=0x7fc3540091d0).ready entity=mon.1 client_cookie=defdd09957204e18 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc35affd700 1 -- 172.21.2.135:0/2657137268 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc354009ea0 con 0x7fc35c0b3950 2021-11-15T14:42:23.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc35affd700 1 -- 172.21.2.135:0/2657137268 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400b860 con 0x7fc35c0b3950 2021-11-15T14:42:23.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc35affd700 1 -- 172.21.2.135:0/2657137268 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35400b9d0 con 0x7fc35c0b3950 2021-11-15T14:42:23.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2657137268 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 msgr2=0x7fc35c144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2657137268 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c144bd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fc35c13b870 tx=0x7fc3540091d0).stop 2021-11-15T14:42:23.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2657137268 shutdown_connections 2021-11-15T14:42:23.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2657137268 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c144bd0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2657137268 >> 172.21.2.135:0/2657137268 conn(0x7fc35c05cfe0 msgr2=0x7fc35c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2657137268 shutdown_connections 2021-11-15T14:42:23.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2657137268 wait complete. 2021-11-15T14:42:23.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 Processor -- start 2021-11-15T14:42:23.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- start start 2021-11-15T14:42:23.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc35c060040 0x7fc35c0aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc35c0654a0 0x7fc35c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0ab3f0 con 0x7fc35c0654a0 2021-11-15T14:42:23.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0abfa0 con 0x7fc35c0b3950 2021-11-15T14:42:23.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0ace70 con 0x7fc35c060040 2021-11-15T14:42:23.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34274/0 (socket says 172.21.2.135:34274) 2021-11-15T14:42:23.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2131076259 learned_addr learned my addr 172.21.2.135:0/2131076259 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:23.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc35c060040 msgr2=0x7fc35c0aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc35c060040 0x7fc35c0aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc35c0654a0 msgr2=0x7fc35c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc35c0654a0 0x7fc35c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 -- 172.21.2.135:0/2131076259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009470 con 0x7fc35c0b3950 2021-11-15T14:42:23.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc360852700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fc35c13b870 tx=0x7fc354016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc354009ea0 con 0x7fc35c0b3950 2021-11-15T14:42:23.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35401f5e0 con 0x7fc35c0b3950 2021-11-15T14:42:23.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35401f940 con 0x7fc35c0b3950 2021-11-15T14:42:23.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0aad80 con 0x7fc35c0b3950 2021-11-15T14:42:23.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0620b0 con 0x7fc35c0b3950 2021-11-15T14:42:23.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.076+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c0ab560 con 0x7fc35c0b3950 2021-11-15T14:42:23.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc354026030 con 0x7fc35c0b3950 2021-11-15T14:42:23.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc3597fa700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 0x7fc340055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc35406c950 con 0x7fc35c0b3950 2021-11-15T14:42:23.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc35bfff700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 0x7fc340055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc35bfff700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 0x7fc340055ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc344002fb0 tx=0x7fc3440069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.080+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc35c0ab560 con 0x7fc35c0b3950 2021-11-15T14:42:23.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc35c0ab560 con 0x7fc35c0b3950 2021-11-15T14:42:23.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3597fa700 1 -- 172.21.2.135:0/2131076259 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc35c0ab560 con 0x7fc35c0b3950 2021-11-15T14:42:23.169 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:23.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 msgr2=0x7fc340055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 0x7fc340055ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc344002fb0 tx=0x7fc3440069b0).stop 2021-11-15T14:42:23.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 msgr2=0x7fc35c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fc35c13b870 tx=0x7fc354016000).stop 2021-11-15T14:42:23.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 shutdown_connections 2021-11-15T14:42:23.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc340053610 0x7fc340055ad0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc35c0b3950 0x7fc35c152300 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc35c0654a0 0x7fc35c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 --2- 172.21.2.135:0/2131076259 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc35c060040 0x7fc35c0aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 >> 172.21.2.135:0/2131076259 conn(0x7fc35c05cfe0 msgr2=0x7fc35c0b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 shutdown_connections 2021-11-15T14:42:23.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.164+0000 7fc3622b5700 1 -- 172.21.2.135:0/2131076259 wait complete. 2021-11-15T14:42:23.176 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:42:23.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 Processor -- start 2021-11-15T14:42:23.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- start start 2021-11-15T14:42:23.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9d28060040 0x7f9d28064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f9d280b2ca0 0x7f9d28065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d280b2430 con 0x7f9d280b3950 2021-11-15T14:42:23.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d28065770 con 0x7f9d280b2ca0 2021-11-15T14:42:23.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280b26d0 con 0x7f9d28060040 2021-11-15T14:42:23.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d277fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9d280b3950 0x7f9d280b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50104/0 (socket says 172.21.2.135:50104) 2021-11-15T14:42:23.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d277fe700 1 -- 172.21.2.135:0/3685048363 learned_addr learned my addr 172.21.2.135:0/3685048363 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:23.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 --2- 172.21.2.135:0/3685048363 >> v2:172.21.2.135:3300/0 conn(0x7f9d28060040 0x7f9d28064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 -- 172.21.2.135:0/3685048363 >> v2:172.21.2.119:3300/0 conn(0x7f9d280b2ca0 msgr2=0x7f9d28065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:23.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 --2- 172.21.2.135:0/3685048363 >> v2:172.21.2.119:3300/0 conn(0x7f9d280b2ca0 0x7f9d28065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 -- 172.21.2.135:0/3685048363 >> v1:172.21.2.135:6789/0 conn(0x7f9d280b3950 legacy=0x7f9d280b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 -- 172.21.2.135:0/3685048363 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280b2970 con 0x7f9d28060040 2021-11-15T14:42:23.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d27fff700 1 --2- 172.21.2.135:0/3685048363 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d28060040 0x7f9d28064d90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f9d18002f70 tx=0x7f9d18006df0).ready entity=mon.1 client_cookie=10d7307e7c0512fe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d26ffd700 1 -- 172.21.2.135:0/3685048363 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1800d5c0 con 0x7f9d28060040 2021-11-15T14:42:23.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d26ffd700 1 -- 172.21.2.135:0/3685048363 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18000e90 con 0x7f9d28060040 2021-11-15T14:42:23.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d26ffd700 1 -- 172.21.2.135:0/3685048363 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1800d910 con 0x7f9d28060040 2021-11-15T14:42:23.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/3685048363 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d28060040 msgr2=0x7f9d28064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/3685048363 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d28060040 0x7f9d28064d90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f9d18002f70 tx=0x7f9d18006df0).stop 2021-11-15T14:42:23.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/3685048363 shutdown_connections 2021-11-15T14:42:23.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/3685048363 >> v2:172.21.2.119:3300/0 conn(0x7f9d280b2ca0 0x7f9d28065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/3685048363 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d28060040 0x7f9d28064d90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/3685048363 >> 172.21.2.135:0/3685048363 conn(0x7f9d2805cfe0 msgr2=0x7f9d2805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/3685048363 shutdown_connections 2021-11-15T14:42:23.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.236+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/3685048363 wait complete. 2021-11-15T14:42:23.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 Processor -- start 2021-11-15T14:42:23.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- start start 2021-11-15T14:42:23.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9d28060040 0x7f9d280aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9d280b2ca0 0x7f9d2814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280af290 con 0x7f9d280b2ca0 2021-11-15T14:42:23.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2814be70 con 0x7f9d280b3950 2021-11-15T14:42:23.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280b6fa0 con 0x7f9d28060040 2021-11-15T14:42:23.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34290/0 (socket says 172.21.2.135:34290) 2021-11-15T14:42:23.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 -- 172.21.2.135:0/729408944 learned_addr learned my addr 172.21.2.135:0/729408944 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:23.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 -- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9d28060040 msgr2=0x7f9d280aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9d28060040 0x7f9d280aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 -- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9d280b2ca0 msgr2=0x7f9d2814e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9d280b2ca0 0x7f9d2814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 -- 172.21.2.135:0/729408944 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1800b180 con 0x7f9d280b3950 2021-11-15T14:42:23.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2ce69700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f9d200032f0 tx=0x7f9d20009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2000d580 con 0x7f9d280b3950 2021-11-15T14:42:23.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000d6e0 con 0x7f9d280b3950 2021-11-15T14:42:23.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2000da40 con 0x7f9d280b3950 2021-11-15T14:42:23.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d281518a0 con 0x7f9d280b3950 2021-11-15T14:42:23.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2814e640 con 0x7f9d280b3950 2021-11-15T14:42:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d280648f0 con 0x7f9d280b3950 2021-11-15T14:42:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d2000dba0 con 0x7f9d280b3950 2021-11-15T14:42:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 0x7f9d0c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9d2006bf50 con 0x7f9d280b3950 2021-11-15T14:42:23.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.240+0000 7f9d27fff700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 0x7f9d0c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.244+0000 7f9d27fff700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 0x7f9d0c055a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9d18002f70 tx=0x7f9d18014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.244+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d20042e50 con 0x7f9d280b3950 2021-11-15T14:42:23.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.324+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d280573d0 con 0x7f9d280b3950 2021-11-15T14:42:23.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d257fa700 1 -- 172.21.2.135:0/729408944 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9d20046470 con 0x7f9d280b3950 2021-11-15T14:42:23.331 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:23.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 msgr2=0x7f9d0c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 0x7f9d0c055a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9d18002f70 tx=0x7f9d18014000).stop 2021-11-15T14:42:23.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 msgr2=0x7f9d28151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f9d200032f0 tx=0x7f9d20009220).stop 2021-11-15T14:42:23.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 shutdown_connections 2021-11-15T14:42:23.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9d0c0535d0 0x7f9d0c055a90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9d280b3950 0x7f9d28151fe0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9d280b2ca0 0x7f9d2814e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 --2- 172.21.2.135:0/729408944 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9d28060040 0x7f9d280aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 >> 172.21.2.135:0/729408944 conn(0x7f9d2805cfe0 msgr2=0x7f9d2813ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 shutdown_connections 2021-11-15T14:42:23.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.328+0000 7f9d2e8cc700 1 -- 172.21.2.135:0/729408944 wait complete. 2021-11-15T14:42:23.337 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:42:23.338 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:23.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 Processor -- start 2021-11-15T14:42:23.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- start start 2021-11-15T14:42:23.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa5000aa1a0 0x7fa5000ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5000b0900 0x7fa500140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5000b2b70 con 0x7fa5000b0520 2021-11-15T14:42:23.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5000b27f0 con 0x7fa5000aa1a0 2021-11-15T14:42:23.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000b2da0 con 0x7fa5000b0900 2021-11-15T14:42:23.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4ff7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa5000b0520 0x7fa5000addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50116/0 (socket says 172.21.2.135:50116) 2021-11-15T14:42:23.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4ff7fe700 1 -- 172.21.2.135:0/121518708 learned_addr learned my addr 172.21.2.135:0/121518708 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:23.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878561940 0 0) 0x7fa5000b2b70 con 0x7fa5000b0520 2021-11-15T14:42:23.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ec003260 con 0x7fa5000b0520 2021-11-15T14:42:23.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716427216 0 0) 0x7fa4ec003260 con 0x7fa5000b0520 2021-11-15T14:42:23.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5000b0900 msgr2=0x7fa500140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:23.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa5000b0900 0x7fa500140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 >> v2:172.21.2.119:3300/0 conn(0x7fa5000aa1a0 msgr2=0x7fa5000ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:23.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 --2- 172.21.2.135:0/121518708 >> v2:172.21.2.119:3300/0 conn(0x7fa5000aa1a0 0x7fa5000ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000a9bf0 con 0x7fa5000b0520 2021-11-15T14:42:23.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa4f4001660 con 0x7fa5000b0520 2021-11-15T14:42:23.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 >> v1:172.21.2.135:6789/0 conn(0x7fa5000b0520 legacy=0x7fa5000addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0037d0 0x7fa4ec003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec004500 0x7fa4ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec004e70 0x7fa4ec00fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000b27f0 con 0x7fa4ec004e70 2021-11-15T14:42:23.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000b2da0 con 0x7fa4ec004500 2021-11-15T14:42:23.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec010330 con 0x7fa4ec0037d0 2021-11-15T14:42:23.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec004500 0x7fa4ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 -- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0037d0 msgr2=0x7fa4ec003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:23.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa4ec0037d0 0x7fa4ec003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 -- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec004e70 msgr2=0x7fa4ec00fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:23.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa4ec004e70 0x7fa4ec00fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 -- 172.21.2.135:0/121518708 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec003260 con 0x7fa4ec004500 2021-11-15T14:42:23.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4feffd700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec004500 0x7fa4ec004980 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0006ca0).ready entity=mon.1 client_cookie=586c2d4dea7563d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f0012410 con 0x7fa4ec004500 2021-11-15T14:42:23.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0012570 con 0x7fa4ec004500 2021-11-15T14:42:23.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fe7fc700 1 -- 172.21.2.135:0/121518708 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f00128d0 con 0x7fa4ec004500 2021-11-15T14:42:23.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- 172.21.2.135:0/121518708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec004500 msgr2=0x7fa4ec004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 --2- 172.21.2.135:0/121518708 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa4ec004500 0x7fa4ec004980 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0006ca0).stop 2021-11-15T14:42:23.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa4fffff700 1 -- 172.21.2.135:0/121518708 reap_dead start 2021-11-15T14:42:23.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- 172.21.2.135:0/121518708 shutdown_connections 2021-11-15T14:42:23.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- 172.21.2.135:0/121518708 >> 172.21.2.135:0/121518708 conn(0x7fa500060840 msgr2=0x7fa500060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- 172.21.2.135:0/121518708 shutdown_connections 2021-11-15T14:42:23.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.388+0000 7fa505dd8700 1 -- 172.21.2.135:0/121518708 wait complete. 2021-11-15T14:42:23.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 Processor -- start 2021-11-15T14:42:23.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- start start 2021-11-15T14:42:23.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa500144270 0x7fa500063c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa50014ea40 0x7fa50013bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50013db00 con 0x7fa50014ea40 2021-11-15T14:42:23.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500144650 con 0x7fa50013eba0 2021-11-15T14:42:23.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa500141fb0 con 0x7fa500144270 2021-11-15T14:42:23.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34308/0 (socket says 172.21.2.135:34308) 2021-11-15T14:42:23.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 -- 172.21.2.135:0/1477887461 learned_addr learned my addr 172.21.2.135:0/1477887461 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:23.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 -- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa500144270 msgr2=0x7fa500063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa500144270 0x7fa500063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 -- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa50014ea40 msgr2=0x7fa50013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fffff700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa50014ea40 0x7fa50013bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa50014ea40 0x7fa50013bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 -- 172.21.2.135:0/1477887461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500141810 con 0x7fa50013eba0 2021-11-15T14:42:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4feffd700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa50013dc40 tx=0x7fa4f0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f0012410 con 0x7fa50013eba0 2021-11-15T14:42:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0011e00 con 0x7fa50013eba0 2021-11-15T14:42:23.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f001d5e0 con 0x7fa50013eba0 2021-11-15T14:42:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa500141d10 con 0x7fa50013eba0 2021-11-15T14:42:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa500067840 con 0x7fa50013eba0 2021-11-15T14:42:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5000573d0 con 0x7fa50013eba0 2021-11-15T14:42:23.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4f001a030 con 0x7fa50013eba0 2021-11-15T14:42:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 0x7fa4e0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa4f006cb80 con 0x7fa50013eba0 2021-11-15T14:42:23.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.392+0000 7fa4ff7fe700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 0x7fa4e0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:23.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.396+0000 7fa4ff7fe700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 0x7fa4e0055a90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa4f4001370 tx=0x7fa4f4001500).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:23.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.396+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4f0043a20 con 0x7fa50013eba0 2021-11-15T14:42:23.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.504+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5000ad6b0 con 0x7fa50013eba0 2021-11-15T14:42:23.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.504+0000 7fa4fcff9700 1 -- 172.21.2.135:0/1477887461 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fa4f0047040 con 0x7fa50013eba0 2021-11-15T14:42:23.510 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:23.510 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/2937977451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2937977451},{"type":"v1","addr":"172.21.2.119:6835","nonce":2937977451}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7594,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1819495861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1819495861},{"type":"v1","addr":"172.21.2.135:6833","nonce":1819495861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:20.273702+0000","modified":"2021-11-15T14:42:21.278545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7597":{"gid":7597,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2122454907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2122454907},{"type":"v1","addr":"172.21.2.135:6835","nonce":2122454907}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T14:42:23.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 msgr2=0x7fa4e0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 0x7fa4e0055a90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa4f4001370 tx=0x7fa4f4001500).stop 2021-11-15T14:42:23.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 msgr2=0x7fa50014e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:23.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa50013dc40 tx=0x7fa4f0015000).stop 2021-11-15T14:42:23.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 shutdown_connections 2021-11-15T14:42:23.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa4e00535d0 0x7fa4e0055a90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa50014ea40 0x7fa50013bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa50013eba0 0x7fa50014e550 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:23.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 --2- 172.21.2.135:0/1477887461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa500144270 0x7fa500063c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:23.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 >> 172.21.2.135:0/1477887461 conn(0x7fa500060840 msgr2=0x7fa5000b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:23.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 shutdown_connections 2021-11-15T14:42:23.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:23.508+0000 7fa505dd8700 1 -- 172.21.2.135:0/1477887461 wait complete. 2021-11-15T14:42:23.515 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 59 2021-11-15T14:42:23.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:20.273702+0000', 'modified': '2021-11-15T14:42:21.278545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7597': {'gid': 7597, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2122454907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2122454907}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2122454907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:23.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:23.822 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:23.888 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7597,"want_state":"up:active","state":"up:active","rank_uptime":3.6023426120000002,"mdsmap_epoch":59,"osdmap_epoch":125,"osdmap_epoch_barrier":123,"uptime":7.8571623349999999} 2021-11-15T14:42:23.888 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7597, "mdsmap_epoch": 59, "osdmap_epoch": 125, "osdmap_epoch_barrier": 123, "rank_uptime": 3.602342612, "state": "up:active", "uptime": 7.857162335, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:23.889 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:42:23.890 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:42:23.891 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:42:23.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:23.892 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:23.904 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:42:23.956 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:23.957 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:23.964 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:23.964 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:23.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:23.966 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:42:24.014 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:42:24.014 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:24.017 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:42:24.027 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:24.027 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:24.032 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:24.033 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:24.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:24.034 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:42:24.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15026]: starting ceph client 2021-11-15T14:42:24.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:42:24.058+0000 7f2fbe7c8080 -1 init, newargv = 0x55de96338040 newargc=9 2021-11-15T14:42:24.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15026]: starting fuse 2021-11-15T14:42:25.161 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:42:25.173 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:25.174 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:25.223 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:25.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:25.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:25.225 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:42:25.230 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:42:25.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:42:25.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:25.231 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:42:25.232 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:42:25.232 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:42:25.233 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:42:25.233 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:42:25.234 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:25.234 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:42:25.234 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:42:25.235 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:42:25.235 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:25.236 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:42:25.236 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:42:25.237 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:42:25.237 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:42:25.237 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:25.238 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:42:25.238 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:42:25.239 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:42:25.239 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:42:25.240 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:42:25.240 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:42:25.240 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:42:25.241 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:42:25.267 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.15026.asok 2021-11-15T14:42:25.269 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15026.asok 2021-11-15T14:42:25.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:25.270 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15026.asok status 2021-11-15T14:42:25.377 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:42:25.377 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:42:25.378 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:42:25.378 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:42:25.378 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:42:25.378 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:42:25.379 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:42:25.379 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "15026", 2021-11-15T14:42:25.379 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:42:25.380 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:25.380 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:42:25.380 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:42:25.380 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5196, 2021-11-15T14:42:25.380 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:42:25.381 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:42:25.381 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:42:25.381 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5196 2021-11-15T14:42:25.381 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:25.382 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:42:25.382 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:42:25.382 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:42:25.382 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 518452340 2021-11-15T14:42:25.382 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:42:25.383 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:25.383 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:42:25.383 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:42:25.383 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:42:25.384 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 518452340 2021-11-15T14:42:25.384 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:42:25.384 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5196 172.21.2.138:0/518452340", 2021-11-15T14:42:25.384 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/518452340", 2021-11-15T14:42:25.384 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:42:25.385 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 59, 2021-11-15T14:42:25.385 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 125, 2021-11-15T14:42:25.385 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:42:25.385 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:42:25.386 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:42:25.386 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:42:25.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:25.388 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:25.388 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:25.394 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:42:25.394 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:25.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:25.395 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:25.403 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:25.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 Processor -- start 2021-11-15T14:42:25.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 -- start start 2021-11-15T14:42:25.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71c80b1300 0x7f71c80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c8140390 con 0x7f71c8140d70 2021-11-15T14:42:25.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c8140630 con 0x7f71c80aee40 2021-11-15T14:42:25.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ced7b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c81408d0 con 0x7f71c80b1300 2021-11-15T14:42:25.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71cd318700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f71c80aee40 0x7f71c814a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50134/0 (socket says 172.21.2.135:50134) 2021-11-15T14:42:25.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71cd318700 1 -- 172.21.2.135:0/1071004844 learned_addr learned my addr 172.21.2.135:0/1071004844 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:25.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704939921 0 0) 0x7f71c8140630 con 0x7f71c80aee40 2021-11-15T14:42:25.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a8003260 con 0x7f71c80aee40 2021-11-15T14:42:25.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 --2- 172.21.2.135:0/1071004844 >> v2:172.21.2.119:3300/0 conn(0x7f71c80b1300 0x7f71c80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 955569639 0 0) 0x7f71a8003260 con 0x7f71c80aee40 2021-11-15T14:42:25.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 >> v2:172.21.2.119:3300/0 conn(0x7f71c80b1300 msgr2=0x7f71c80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 --2- 172.21.2.135:0/1071004844 >> v2:172.21.2.119:3300/0 conn(0x7f71c80b1300 0x7f71c80b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 >> v1:172.21.2.119:6789/0 conn(0x7f71c8140d70 legacy=0x7f71c80ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8140080 con 0x7f71c80aee40 2021-11-15T14:42:25.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f71c00019e0 con 0x7f71c80aee40 2021-11-15T14:42:25.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 >> v1:172.21.2.135:6789/0 conn(0x7f71c80aee40 legacy=0x7f71c814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 0x7f71a8003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71a8004500 0x7f71a8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8005070 0x7f71a800d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81408d0 con 0x7f71a8005070 2021-11-15T14:42:25.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800e210 con 0x7f71a8003820 2021-11-15T14:42:25.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800e3d0 con 0x7f71a8004500 2021-11-15T14:42:25.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 0x7f71a8003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 -- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71a8004500 msgr2=0x7f71a8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71a8004500 0x7f71a8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 -- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8005070 msgr2=0x7f71a800d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8005070 0x7f71a800d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71cd318700 1 -- 172.21.2.135:0/1071004844 reap_dead start 2021-11-15T14:42:25.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 -- 172.21.2.135:0/1071004844 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8003260 con 0x7f71a8003820 2021-11-15T14:42:25.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.456+0000 7f71ccb17700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 0x7f71a8003c40 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f71b0007000 tx=0x7f71b0008040).ready entity=mon.1 client_cookie=4aa96b6a46f19dd2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b0012470 con 0x7f71a8003820 2021-11-15T14:42:25.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000c030 con 0x7f71a8003820 2021-11-15T14:42:25.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c77fe700 1 -- 172.21.2.135:0/1071004844 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b00127c0 con 0x7f71a8003820 2021-11-15T14:42:25.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 msgr2=0x7f71a8003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 0x7f71a8003c40 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f71b0007000 tx=0x7f71b0008040).stop 2021-11-15T14:42:25.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/1071004844 shutdown_connections 2021-11-15T14:42:25.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 --2- 172.21.2.135:0/1071004844 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71a8003820 0x7f71a8003c40 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/1071004844 >> 172.21.2.135:0/1071004844 conn(0x7f71c805f730 msgr2=0x7f71c805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/1071004844 shutdown_connections 2021-11-15T14:42:25.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/1071004844 wait complete. 2021-11-15T14:42:25.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 Processor -- start 2021-11-15T14:42:25.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- start start 2021-11-15T14:42:25.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8003820 0x7f71c80b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71c80b22f0 0x7f71c80ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81516f0 con 0x7f71a8003820 2021-11-15T14:42:25.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8151990 con 0x7f71c80ac570 2021-11-15T14:42:25.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8151c30 con 0x7f71c80b22f0 2021-11-15T14:42:25.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34330/0 (socket says 172.21.2.135:34330) 2021-11-15T14:42:25.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 -- 172.21.2.135:0/3628021952 learned_addr learned my addr 172.21.2.135:0/3628021952 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 -- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71c80b22f0 msgr2=0x7f71c80ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71c80b22f0 0x7f71c80ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 -- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8003820 msgr2=0x7f71c80b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8003820 0x7f71c80b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 -- 172.21.2.135:0/3628021952 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8151ed0 con 0x7f71c80ac570 2021-11-15T14:42:25.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71cd318700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f71c806ace0 tx=0x7f71c8140520).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0004ab0 con 0x7f71c80ac570 2021-11-15T14:42:25.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0004c10 con 0x7f71c80ac570 2021-11-15T14:42:25.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c80b2d80 con 0x7f71c80ac570 2021-11-15T14:42:25.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c00070d0 con 0x7f71c80ac570 2021-11-15T14:42:25.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c8152370 con 0x7f71c80ac570 2021-11-15T14:42:25.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.460+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c8136b10 con 0x7f71c80ac570 2021-11-15T14:42:25.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71c001c070 con 0x7f71c80ac570 2021-11-15T14:42:25.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71c5ffb700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 0x7f71ac0559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f71c006af50 con 0x7f71c80ac570 2021-11-15T14:42:25.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71ccb17700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 0x7f71ac0559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71ccb17700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 0x7f71ac0559f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f71b0007000 tx=0x7f71b0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.464+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71c8136b10 con 0x7f71c80ac570 2021-11-15T14:42:25.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.544+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71c8136b10 con 0x7f71c80ac570 2021-11-15T14:42:25.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71c5ffb700 1 -- 172.21.2.135:0/3628021952 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f71c8136b10 con 0x7f71c80ac570 2021-11-15T14:42:25.553 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:25.553 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":125,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:22.294172+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:18.125358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:19.266983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:25.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 msgr2=0x7f71ac0559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 0x7f71ac0559f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f71b0007000 tx=0x7f71b0008040).stop 2021-11-15T14:42:25.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 msgr2=0x7f71c814e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f71c806ace0 tx=0x7f71c8140520).stop 2021-11-15T14:42:25.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 shutdown_connections 2021-11-15T14:42:25.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71ac053530 0x7f71ac0559f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71c80ac570 0x7f71c814e080 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71c80b22f0 0x7f71c80ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 --2- 172.21.2.135:0/3628021952 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71a8003820 0x7f71c80b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 >> 172.21.2.135:0/3628021952 conn(0x7f71c805f730 msgr2=0x7f71c80b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 shutdown_connections 2021-11-15T14:42:25.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.548+0000 7f71ced7b700 1 -- 172.21.2.135:0/3628021952 wait complete. 2021-11-15T14:42:25.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:42:18.125358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:42:19.266983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:42:25.559 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:25.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 Processor -- start 2021-11-15T14:42:25.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 -- start start 2021-11-15T14:42:25.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3000060040 0x7f3000064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f30000b2ca0 0x7f3000065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000b2430 con 0x7f30000b3950 2021-11-15T14:42:25.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3000065770 con 0x7f3000060040 2021-11-15T14:42:25.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f300671c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000b26d0 con 0x7f30000b2ca0 2021-11-15T14:42:25.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2fff7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f30000b3950 0x7f30000b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50158/0 (socket says 172.21.2.135:50158) 2021-11-15T14:42:25.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2fff7fe700 1 -- 172.21.2.135:0/4034906473 learned_addr learned my addr 172.21.2.135:0/4034906473 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:25.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 --2- 172.21.2.135:0/4034906473 >> v2:172.21.2.135:3300/0 conn(0x7f30000b2ca0 0x7f3000065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2ffeffd700 1 -- 172.21.2.135:0/4034906473 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289018295 0 0) 0x7f30000b2430 con 0x7f30000b3950 2021-11-15T14:42:25.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2ffeffd700 1 -- 172.21.2.135:0/4034906473 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003260 con 0x7f30000b3950 2021-11-15T14:42:25.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 -- 172.21.2.135:0/4034906473 >> v2:172.21.2.119:3300/0 conn(0x7f3000060040 msgr2=0x7f3000064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 --2- 172.21.2.135:0/4034906473 >> v2:172.21.2.119:3300/0 conn(0x7f3000060040 0x7f3000064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 -- 172.21.2.135:0/4034906473 >> v1:172.21.2.135:6789/0 conn(0x7f30000b3950 legacy=0x7f30000b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 -- 172.21.2.135:0/4034906473 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000b2970 con 0x7f30000b2ca0 2021-11-15T14:42:25.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f3004cb9700 1 --2- 172.21.2.135:0/4034906473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b2ca0 0x7f3000065280 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f2ff80032f0 tx=0x7f2ff80091d0).ready entity=mon.1 client_cookie=dcee09e82be449d1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2ffeffd700 1 -- 172.21.2.135:0/4034906473 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ff800b680 con 0x7f30000b2ca0 2021-11-15T14:42:25.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2ffeffd700 1 -- 172.21.2.135:0/4034906473 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800b7e0 con 0x7f30000b2ca0 2021-11-15T14:42:25.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.608+0000 7f2ffeffd700 1 -- 172.21.2.135:0/4034906473 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ff800b950 con 0x7f30000b2ca0 2021-11-15T14:42:25.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/4034906473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b2ca0 msgr2=0x7f3000065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- 172.21.2.135:0/4034906473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b2ca0 0x7f3000065280 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f2ff80032f0 tx=0x7f2ff80091d0).stop 2021-11-15T14:42:25.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/4034906473 shutdown_connections 2021-11-15T14:42:25.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- 172.21.2.135:0/4034906473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b2ca0 0x7f3000065280 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- 172.21.2.135:0/4034906473 >> v2:172.21.2.119:3300/0 conn(0x7f3000060040 0x7f3000064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/4034906473 >> 172.21.2.135:0/4034906473 conn(0x7f300005cfe0 msgr2=0x7f300005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/4034906473 shutdown_connections 2021-11-15T14:42:25.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/4034906473 wait complete. 2021-11-15T14:42:25.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 Processor -- start 2021-11-15T14:42:25.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- start start 2021-11-15T14:42:25.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3000060040 0x7f3000147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30000b2ca0 0x7f30000aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b6b10 con 0x7f3000060040 2021-11-15T14:42:25.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b6db0 con 0x7f30000b3950 2021-11-15T14:42:25.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b7050 con 0x7f30000b2ca0 2021-11-15T14:42:25.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34344/0 (socket says 172.21.2.135:34344) 2021-11-15T14:42:25.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 -- 172.21.2.135:0/3153160939 learned_addr learned my addr 172.21.2.135:0/3153160939 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 -- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30000b2ca0 msgr2=0x7f30000aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30000b2ca0 0x7f30000aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 -- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3000060040 msgr2=0x7f3000147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3000060040 0x7f3000147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 -- 172.21.2.135:0/3153160939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009470 con 0x7f30000b3950 2021-11-15T14:42:25.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f3004cb9700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f2ff80032f0 tx=0x7f2ff8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ff8006ea0 con 0x7f30000b3950 2021-11-15T14:42:25.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8021480 con 0x7f30000b3950 2021-11-15T14:42:25.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30000af0b0 con 0x7f30000b3950 2021-11-15T14:42:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ff80217e0 con 0x7f30000b3950 2021-11-15T14:42:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30000adef0 con 0x7f30000b3950 2021-11-15T14:42:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30000648f0 con 0x7f30000b3950 2021-11-15T14:42:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ff800f070 con 0x7f30000b3950 2021-11-15T14:42:25.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 0x7f2fe0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.612+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2ff806cbc0 con 0x7f30000b3950 2021-11-15T14:42:25.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.616+0000 7f2ffffff700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 0x7f2fe0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.616+0000 7f2ffffff700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 0x7f2fe0055b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2ff4002f70 tx=0x7f2ff4006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.616+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ff8043c80 con 0x7f30000b3950 2021-11-15T14:42:25.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f30000adef0 con 0x7f30000b3950 2021-11-15T14:42:25.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f2ffd7fa700 1 -- 172.21.2.135:0/3153160939 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v125) v1 ==== 110+0+10 (secure 0 0 0) 0x7f30000adef0 con 0x7f30000b3950 2021-11-15T14:42:25.704 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:25.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 msgr2=0x7f2fe0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 0x7f2fe0055b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2ff4002f70 tx=0x7f2ff4006a80).stop 2021-11-15T14:42:25.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 msgr2=0x7f30001397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f2ff80032f0 tx=0x7f2ff8016000).stop 2021-11-15T14:42:25.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 shutdown_connections 2021-11-15T14:42:25.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2fe00536a0 0x7f2fe0055b60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f30000b3950 0x7f30001397b0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f30000b2ca0 0x7f30000aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 --2- 172.21.2.135:0/3153160939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3000060040 0x7f3000147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 >> 172.21.2.135:0/3153160939 conn(0x7f300005cfe0 msgr2=0x7f3000140f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.707 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 shutdown_connections 2021-11-15T14:42:25.708 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.700+0000 7f300671c700 1 -- 172.21.2.135:0/3153160939 wait complete. 2021-11-15T14:42:25.711 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:25.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 Processor -- start 2021-11-15T14:42:25.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 -- start start 2021-11-15T14:42:25.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec0b1140 0x7f26ec0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26ec0acbf0 0x7f26ec140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f26ec13d4e0 0x7f26ec13d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec13de40 con 0x7f26ec13d4e0 2021-11-15T14:42:25.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec141110 con 0x7f26ec0acbf0 2021-11-15T14:42:25.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26f2836700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0ac840 con 0x7f26ec0b1140 2021-11-15T14:42:25.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26ec0acbf0 0x7f26ec140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f26ec0acbf0 0x7f26ec140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34350/0 (socket says 172.21.2.135:34350) 2021-11-15T14:42:25.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 -- 172.21.2.135:0/763136277 learned_addr learned my addr 172.21.2.135:0/763136277 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 -- 172.21.2.135:0/763136277 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec0b1140 msgr2=0x7f26ec0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/763136277 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec0b1140 0x7f26ec0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 -- 172.21.2.135:0/763136277 >> v2:172.21.2.119:3300/0 conn(0x7f26ec13d4e0 msgr2=0x7f26ec13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:25.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/763136277 >> v2:172.21.2.119:3300/0 conn(0x7f26ec13d4e0 0x7f26ec13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 -- 172.21.2.135:0/763136277 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0ac0a0 con 0x7f26ec0acbf0 2021-11-15T14:42:25.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/763136277 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0acbf0 0x7f26ec140c20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f26d4002f70 tx=0x7f26d4006eb0).ready entity=mon.1 client_cookie=7bad65adfb293567 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eaffd700 1 -- 172.21.2.135:0/763136277 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d400d570 con 0x7f26ec0acbf0 2021-11-15T14:42:25.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eaffd700 1 -- 172.21.2.135:0/763136277 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d4000e90 con 0x7f26ec0acbf0 2021-11-15T14:42:25.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.764+0000 7f26eaffd700 1 -- 172.21.2.135:0/763136277 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d400d900 con 0x7f26ec0acbf0 2021-11-15T14:42:25.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/763136277 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0acbf0 msgr2=0x7f26ec140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- 172.21.2.135:0/763136277 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0acbf0 0x7f26ec140c20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f26d4002f70 tx=0x7f26d4006eb0).stop 2021-11-15T14:42:25.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/763136277 shutdown_connections 2021-11-15T14:42:25.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- 172.21.2.135:0/763136277 >> v2:172.21.2.119:3300/0 conn(0x7f26ec13d4e0 0x7f26ec13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- 172.21.2.135:0/763136277 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0acbf0 0x7f26ec140c20 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- 172.21.2.135:0/763136277 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec0b1140 0x7f26ec0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/763136277 >> 172.21.2.135:0/763136277 conn(0x7f26ec05f730 msgr2=0x7f26ec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/763136277 shutdown_connections 2021-11-15T14:42:25.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/763136277 wait complete. 2021-11-15T14:42:25.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 Processor -- start 2021-11-15T14:42:25.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- start start 2021-11-15T14:42:25.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26ec0acbf0 0x7f26ec130eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec13d4e0 0x7f26ec13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec13ff00 con 0x7f26ec0acbf0 2021-11-15T14:42:25.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec142580 con 0x7f26ec0b1140 2021-11-15T14:42:25.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec142820 con 0x7f26ec13d4e0 2021-11-15T14:42:25.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34356/0 (socket says 172.21.2.135:34356) 2021-11-15T14:42:25.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 -- 172.21.2.135:0/2425975618 learned_addr learned my addr 172.21.2.135:0/2425975618 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 -- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec13d4e0 msgr2=0x7f26ec13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec13d4e0 0x7f26ec13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 -- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26ec0acbf0 msgr2=0x7f26ec130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26ec0acbf0 0x7f26ec130eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 -- 172.21.2.135:0/2425975618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d400b1e0 con 0x7f26ec0b1140 2021-11-15T14:42:25.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26eb7fe700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f26d4002f70 tx=0x7f26d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d4011990 con 0x7f26ec0b1140 2021-11-15T14:42:25.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d4011af0 con 0x7f26ec0b1140 2021-11-15T14:42:25.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec142ac0 con 0x7f26ec0b1140 2021-11-15T14:42:25.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec1313a0 con 0x7f26ec0b1140 2021-11-15T14:42:25.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26d4011e50 con 0x7f26ec0b1140 2021-11-15T14:42:25.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec0ac300 con 0x7f26ec0b1140 2021-11-15T14:42:25.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26d4025030 con 0x7f26ec0b1140 2021-11-15T14:42:25.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 0x7f26d0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.768+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f26d406cfe0 con 0x7f26ec0b1140 2021-11-15T14:42:25.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.772+0000 7f26ebfff700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 0x7f26d0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.772+0000 7f26ebfff700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 0x7f26d0055a00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f26dc002f70 tx=0x7f26dc006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.772+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26d4043ee0 con 0x7f26ec0b1140 2021-11-15T14:42:25.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f26ec0573d0 con 0x7f26ec0b1140 2021-11-15T14:42:25.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26e97fa700 1 -- 172.21.2.135:0/2425975618 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f26d4023020 con 0x7f26ec0b1140 2021-11-15T14:42:25.860 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:25.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 msgr2=0x7f26d0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 0x7f26d0055a00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f26dc002f70 tx=0x7f26dc006a80).stop 2021-11-15T14:42:25.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 msgr2=0x7f26ec13f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f26d4002f70 tx=0x7f26d4015000).stop 2021-11-15T14:42:25.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 shutdown_connections 2021-11-15T14:42:25.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f26d0053540 0x7f26d0055a00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f26ec13d4e0 0x7f26ec13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f26ec0b1140 0x7f26ec13f520 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 --2- 172.21.2.135:0/2425975618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f26ec0acbf0 0x7f26ec130eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 >> 172.21.2.135:0/2425975618 conn(0x7f26ec05f730 msgr2=0x7f26ec0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 shutdown_connections 2021-11-15T14:42:25.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.856+0000 7f26f2836700 1 -- 172.21.2.135:0/2425975618 wait complete. 2021-11-15T14:42:25.867 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:42:25.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 Processor -- start 2021-11-15T14:42:25.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- start start 2021-11-15T14:42:25.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f257c060040 0x7f257c064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c0b2ca0 0x7f257c065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0b2430 con 0x7f257c0b3950 2021-11-15T14:42:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c065770 con 0x7f257c060040 2021-11-15T14:42:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b26d0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f257c060040 0x7f257c064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f257c060040 0x7f257c064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34366/0 (socket says 172.21.2.135:34366) 2021-11-15T14:42:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 -- 172.21.2.135:0/3607548925 learned_addr learned my addr 172.21.2.135:0/3607548925 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 -- 172.21.2.135:0/3607548925 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c0b2ca0 msgr2=0x7f257c065280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 --2- 172.21.2.135:0/3607548925 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c0b2ca0 0x7f257c065280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 -- 172.21.2.135:0/3607548925 >> v1:172.21.2.119:6789/0 conn(0x7f257c0b3950 legacy=0x7f257c0b4090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 -- 172.21.2.135:0/3607548925 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0b2970 con 0x7f257c060040 2021-11-15T14:42:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257a59c700 1 --2- 172.21.2.135:0/3607548925 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c060040 0x7f257c064d90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f257c05d4e0 tx=0x7f2564006eb0).ready entity=mon.1 client_cookie=609e5ef2f85f34f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257959a700 1 -- 172.21.2.135:0/3607548925 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400d570 con 0x7f257c060040 2021-11-15T14:42:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257959a700 1 -- 172.21.2.135:0/3607548925 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564000e90 con 0x7f257c060040 2021-11-15T14:42:25.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f257959a700 1 -- 172.21.2.135:0/3607548925 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400d8c0 con 0x7f257c060040 2021-11-15T14:42:25.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- 172.21.2.135:0/3607548925 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c060040 msgr2=0x7f257c064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 --2- 172.21.2.135:0/3607548925 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c060040 0x7f257c064d90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f257c05d4e0 tx=0x7f2564006eb0).stop 2021-11-15T14:42:25.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- 172.21.2.135:0/3607548925 shutdown_connections 2021-11-15T14:42:25.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 --2- 172.21.2.135:0/3607548925 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c0b2ca0 0x7f257c065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 --2- 172.21.2.135:0/3607548925 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c060040 0x7f257c064d90 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:25.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- 172.21.2.135:0/3607548925 >> 172.21.2.135:0/3607548925 conn(0x7f257c05cfe0 msgr2=0x7f257c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:25.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- 172.21.2.135:0/3607548925 shutdown_connections 2021-11-15T14:42:25.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.916+0000 7f2580900700 1 -- 172.21.2.135:0/3607548925 wait complete. 2021-11-15T14:42:25.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 Processor -- start 2021-11-15T14:42:25.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- start start 2021-11-15T14:42:25.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c060040 0x7f257c13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f257c0b3950 0x7f257c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c13c890 con 0x7f257c0b3950 2021-11-15T14:42:25.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b17e0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c13ea50 con 0x7f257c060040 2021-11-15T14:42:25.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34372/0 (socket says 172.21.2.135:34372) 2021-11-15T14:42:25.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 -- 172.21.2.135:0/3311752200 learned_addr learned my addr 172.21.2.135:0/3311752200 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:25.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 -- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c060040 msgr2=0x7f257c13dbd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:25.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c060040 0x7f257c13dbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 -- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f257c0b3950 msgr2=0x7f257c0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:25.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f257c0b3950 0x7f257c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:25.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 -- 172.21.2.135:0/3311752200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256400b1e0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2579d9b700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f257c13c9d0 tx=0x7f256c006d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c010960 con 0x7f257c0b2ca0 2021-11-15T14:42:25.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c014070 con 0x7f257c0b2ca0 2021-11-15T14:42:25.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c010cb0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c13ecf0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0b04a0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c13c650 con 0x7f257c0b2ca0 2021-11-15T14:42:25.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f256c020070 con 0x7f257c0b2ca0 2021-11-15T14:42:25.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 0x7f2560055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:25.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f256c06f1f0 con 0x7f257c0b2ca0 2021-11-15T14:42:25.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.920+0000 7f257a59c700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 0x7f2560055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:25.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.924+0000 7f257a59c700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 0x7f2560055be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f257c05d4e0 tx=0x7f2564015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:25.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:25.924+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f257c13c650 con 0x7f257c0b2ca0 2021-11-15T14:42:26.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f257c13e8b0 con 0x7f257c0b2ca0 2021-11-15T14:42:26.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f25737fe700 1 -- 172.21.2.135:0/3311752200 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+10 (secure 0 0 0) 0x7f257c13e8b0 con 0x7f257c0b2ca0 2021-11-15T14:42:26.011 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:26.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 msgr2=0x7f2560055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 0x7f2560055be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f257c05d4e0 tx=0x7f2564015000).stop 2021-11-15T14:42:26.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 msgr2=0x7f257c0ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f257c13c9d0 tx=0x7f256c006d70).stop 2021-11-15T14:42:26.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 shutdown_connections 2021-11-15T14:42:26.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2560053720 0x7f2560055be0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f257c0b3950 0x7f257c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f257c0b2ca0 0x7f257c0ad8c0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 --2- 172.21.2.135:0/3311752200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f257c060040 0x7f257c13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 >> 172.21.2.135:0/3311752200 conn(0x7f257c05cfe0 msgr2=0x7f257c142d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:26.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 shutdown_connections 2021-11-15T14:42:26.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.008+0000 7f2580900700 1 -- 172.21.2.135:0/3311752200 wait complete. 2021-11-15T14:42:26.018 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:42:26.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 Processor -- start 2021-11-15T14:42:26.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 -- start start 2021-11-15T14:42:26.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f61d00b1f40 0x7f61d00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d00b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00b04a0 con 0x7f61d00a7140 2021-11-15T14:42:26.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00b2810 con 0x7f61d00b1f40 2021-11-15T14:42:26.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d8363700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b06d0 con 0x7f61d00b0030 2021-11-15T14:42:26.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d6900700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f61d00a7140 0x7f61d01412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:59616/0 (socket says 172.21.2.135:59616) 2021-11-15T14:42:26.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d60ff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f61d00b1f40 0x7f61d00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d6900700 1 -- 172.21.2.135:0/786808970 learned_addr learned my addr 172.21.2.135:0/786808970 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:26.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.068+0000 7f61d58fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d00b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d60ff700 1 -- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 msgr2=0x7f61d00b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:26.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d60ff700 1 --2- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d00b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d60ff700 1 -- 172.21.2.135:0/786808970 >> v1:172.21.2.119:6789/0 conn(0x7f61d00a7140 legacy=0x7f61d01412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d60ff700 1 -- 172.21.2.135:0/786808970 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00b0970 con 0x7f61d00b1f40 2021-11-15T14:42:26.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d60ff700 1 --2- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00b1f40 0x7f61d00b1350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f61cc002f70 tx=0x7f61cc006df0).ready entity=mon.0 client_cookie=4109c2214b2a49d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d50fd700 1 -- 172.21.2.135:0/786808970 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61cc00d570 con 0x7f61d00b1f40 2021-11-15T14:42:26.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d50fd700 1 -- 172.21.2.135:0/786808970 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc000e90 con 0x7f61d00b1f40 2021-11-15T14:42:26.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d50fd700 1 -- 172.21.2.135:0/786808970 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61cc00d8c0 con 0x7f61d00b1f40 2021-11-15T14:42:26.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00b1f40 msgr2=0x7f61d00b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00b1f40 0x7f61d00b1350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f61cc002f70 tx=0x7f61cc006df0).stop 2021-11-15T14:42:26.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- 172.21.2.135:0/786808970 shutdown_connections 2021-11-15T14:42:26.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d00b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- 172.21.2.135:0/786808970 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00b1f40 0x7f61d00b1350 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- 172.21.2.135:0/786808970 >> 172.21.2.135:0/786808970 conn(0x7f61d005f730 msgr2=0x7f61d005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:26.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- 172.21.2.135:0/786808970 shutdown_connections 2021-11-15T14:42:26.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- 172.21.2.135:0/786808970 wait complete. 2021-11-15T14:42:26.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 Processor -- start 2021-11-15T14:42:26.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- start start 2021-11-15T14:42:26.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00a7140 0x7f61d00a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d0144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0142890 con 0x7f61d00a7140 2021-11-15T14:42:26.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d015ae50 con 0x7f61d00b1f40 2021-11-15T14:42:26.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d8363700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0142b00 con 0x7f61d00b0030 2021-11-15T14:42:26.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34382/0 (socket says 172.21.2.135:34382) 2021-11-15T14:42:26.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 -- 172.21.2.135:0/3708143799 learned_addr learned my addr 172.21.2.135:0/3708143799 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:26.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 -- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 msgr2=0x7f61d0144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d0144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 -- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00a7140 msgr2=0x7f61d00a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00a7140 0x7f61d00a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 -- 172.21.2.135:0/3708143799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc00b180 con 0x7f61d00b1f40 2021-11-15T14:42:26.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61d6900700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f61d006a170 tx=0x7f61c8007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.072+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c8005ba0 con 0x7f61d00b1f40 2021-11-15T14:42:26.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8005d00 con 0x7f61d00b1f40 2021-11-15T14:42:26.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0142da0 con 0x7f61d00b1f40 2021-11-15T14:42:26.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c80072c0 con 0x7f61d00b1f40 2021-11-15T14:42:26.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d0143730 con 0x7f61d00b1f40 2021-11-15T14:42:26.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61c8010070 con 0x7f61d00b1f40 2021-11-15T14:42:26.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00b0c10 con 0x7f61d00b1f40 2021-11-15T14:42:26.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 0x7f61b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f61c806b350 con 0x7f61d00b1f40 2021-11-15T14:42:26.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61d60ff700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 0x7f61b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61d60ff700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 0x7f61b0055ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f61cc002f70 tx=0x7f61cc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.076+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61c8042360 con 0x7f61d00b1f40 2021-11-15T14:42:26.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61d00573d0 con 0x7f61d00b1f40 2021-11-15T14:42:26.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61bf7fe700 1 -- 172.21.2.135:0/3708143799 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+10 (secure 0 0 0) 0x7f61c8045980 con 0x7f61d00b1f40 2021-11-15T14:42:26.165 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:26.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 msgr2=0x7f61b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 0x7f61b0055ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f61cc002f70 tx=0x7f61cc014000).stop 2021-11-15T14:42:26.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 msgr2=0x7f61d0143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f61d006a170 tx=0x7f61c8007f00).stop 2021-11-15T14:42:26.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 shutdown_connections 2021-11-15T14:42:26.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61b0053610 0x7f61b0055ad0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61d00b1f40 0x7f61d0143240 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61d00b0030 0x7f61d0144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 --2- 172.21.2.135:0/3708143799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61d00a7140 0x7f61d00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 >> 172.21.2.135:0/3708143799 conn(0x7f61d005f730 msgr2=0x7f61d013cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:26.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 shutdown_connections 2021-11-15T14:42:26.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.160+0000 7f61d8363700 1 -- 172.21.2.135:0/3708143799 wait complete. 2021-11-15T14:42:26.171 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:42:26.172 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:26.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 Processor -- start 2021-11-15T14:42:26.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- start start 2021-11-15T14:42:26.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f05f80b1e30 0x7f05f80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f8148420 0x7f05f80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05f80a7140 0x7f05f81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80a9140 con 0x7f05f80b1e30 2021-11-15T14:42:26.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80b03d0 con 0x7f05f80a7140 2021-11-15T14:42:26.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80b0670 con 0x7f05f8148420 2021-11-15T14:42:26.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05f80a7140 0x7f05f81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05f80a7140 0x7f05f81447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34394/0 (socket says 172.21.2.135:34394) 2021-11-15T14:42:26.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/607011824 learned_addr learned my addr 172.21.2.135:0/607011824 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:26.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/607011824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f8148420 msgr2=0x7f05f80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:26.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- 172.21.2.135:0/607011824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f8148420 0x7f05f80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/607011824 >> v2:172.21.2.119:3300/0 conn(0x7f05f80b1e30 msgr2=0x7f05f80b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:26.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- 172.21.2.135:0/607011824 >> v2:172.21.2.119:3300/0 conn(0x7f05f80b1e30 0x7f05f80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/607011824 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80b0910 con 0x7f05f80a7140 2021-11-15T14:42:26.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- 172.21.2.135:0/607011824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f80a7140 0x7f05f81447a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f05f00032f0 tx=0x7f05f0009290).ready entity=mon.1 client_cookie=f8db6b76b76ec6cd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f5ffb700 1 -- 172.21.2.135:0/607011824 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f000b870 con 0x7f05f80a7140 2021-11-15T14:42:26.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f5ffb700 1 -- 172.21.2.135:0/607011824 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000b9d0 con 0x7f05f80a7140 2021-11-15T14:42:26.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f5ffb700 1 -- 172.21.2.135:0/607011824 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f000bb40 con 0x7f05f80a7140 2021-11-15T14:42:26.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- 172.21.2.135:0/607011824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f80a7140 msgr2=0x7f05f81447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/607011824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f80a7140 0x7f05f81447a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f05f00032f0 tx=0x7f05f0009290).stop 2021-11-15T14:42:26.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- 172.21.2.135:0/607011824 shutdown_connections 2021-11-15T14:42:26.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/607011824 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f80a7140 0x7f05f81447a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/607011824 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f8148420 0x7f05f80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/607011824 >> v2:172.21.2.119:3300/0 conn(0x7f05f80b1e30 0x7f05f80b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- 172.21.2.135:0/607011824 >> 172.21.2.135:0/607011824 conn(0x7f05f805f730 msgr2=0x7f05f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:26.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- 172.21.2.135:0/607011824 shutdown_connections 2021-11-15T14:42:26.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- 172.21.2.135:0/607011824 wait complete. 2021-11-15T14:42:26.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 Processor -- start 2021-11-15T14:42:26.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- start start 2021-11-15T14:42:26.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05f80a7140 0x7f05f80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f80b1e30 0x7f05f80abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80ac9d0 con 0x7f05f80a7140 2021-11-15T14:42:26.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8149c70 con 0x7f05f8148420 2021-11-15T14:42:26.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05fd8cf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814a9e0 con 0x7f05f80b1e30 2021-11-15T14:42:26.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34396/0 (socket says 172.21.2.135:34396) 2021-11-15T14:42:26.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/678782800 learned_addr learned my addr 172.21.2.135:0/678782800 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:26.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f80b1e30 msgr2=0x7f05f80abff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:26.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f80b1e30 0x7f05f80abff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05f80a7140 msgr2=0x7f05f80ae220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:26.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05f80a7140 0x7f05f80ae220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.220+0000 7f05f77fe700 1 -- 172.21.2.135:0/678782800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009530 con 0x7f05f8148420 2021-11-15T14:42:26.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05f77fe700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f05f80acb10 tx=0x7f05f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f000b870 con 0x7f05f8148420 2021-11-15T14:42:26.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0020620 con 0x7f05f8148420 2021-11-15T14:42:26.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0020980 con 0x7f05f8148420 2021-11-15T14:42:26.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f8149ea0 con 0x7f05f8148420 2021-11-15T14:42:26.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80ab210 con 0x7f05f8148420 2021-11-15T14:42:26.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80b0bb0 con 0x7f05f8148420 2021-11-15T14:42:26.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f05f0026020 con 0x7f05f8148420 2021-11-15T14:42:26.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 0x7f05dc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:26.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f05f006c9f0 con 0x7f05f8148420 2021-11-15T14:42:26.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05f6ffd700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 0x7f05dc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:26.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05f6ffd700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 0x7f05dc055be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f05e0002f70 tx=0x7f05e0006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:26.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.224+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05f00438f0 con 0x7f05f8148420 2021-11-15T14:42:26.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05f80573d0 con 0x7f05f8148420 2021-11-15T14:42:26.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05effff700 1 -- 172.21.2.135:0/678782800 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f05f0015090 con 0x7f05f8148420 2021-11-15T14:42:26.340 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:26.341 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/2937977451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2937977451},{"type":"v1","addr":"172.21.2.119:6835","nonce":2937977451}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7594,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/1819495861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1819495861},{"type":"v1","addr":"172.21.2.135:6833","nonce":1819495861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:20.273702+0000","modified":"2021-11-15T14:42:21.278545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7597":{"gid":7597,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/2122454907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2122454907},{"type":"v1","addr":"172.21.2.135:6835","nonce":2122454907}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-15T14:42:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 msgr2=0x7f05dc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 0x7f05dc055be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f05e0002f70 tx=0x7f05e0006a00).stop 2021-11-15T14:42:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 msgr2=0x7f05f80ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:26.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f05f80acb10 tx=0x7f05f0016000).stop 2021-11-15T14:42:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 shutdown_connections 2021-11-15T14:42:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f05dc053720 0x7f05dc055be0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05f8148420 0x7f05f80ac4e0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05f80b1e30 0x7f05f80abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 --2- 172.21.2.135:0/678782800 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05f80a7140 0x7f05f80ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 >> 172.21.2.135:0/678782800 conn(0x7f05f805f730 msgr2=0x7f05f8144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 shutdown_connections 2021-11-15T14:42:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:26.336+0000 7f05fd8cf700 1 -- 172.21.2.135:0/678782800 wait complete. 2021-11-15T14:42:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 59 2021-11-15T14:42:26.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:42:20.273702+0000', 'modified': '2021-11-15T14:42:21.278545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7597': {'gid': 7597, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/2122454907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 2122454907}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 2122454907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:42:26.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:42:26.651 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:42:26.721 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":7597,"want_state":"up:active","state":"up:active","rank_uptime":6.4360445850000003,"mdsmap_epoch":59,"osdmap_epoch":125,"osdmap_epoch_barrier":123,"uptime":10.690863885000001} 2021-11-15T14:42:26.722 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 7597, "mdsmap_epoch": 59, "osdmap_epoch": 125, "osdmap_epoch_barrier": 123, "rank_uptime": 6.436044585, "state": "up:active", "uptime": 10.690863885, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:42:26.722 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:42:26.723 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:42:26.723 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:42:26.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:26.724 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:26.735 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:26.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:26.788 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:26.793 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:26.794 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:26.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:26.796 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:26.800 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:42:26.800 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:26.846 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:26.855 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:26.856 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:26.861 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:26.862 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:26.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:26.863 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:26.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:42:26.873+0000 7f2b85428080 -1 init, newargv = 0x55b7c88ab0f0 newargc=9 2021-11-15T14:42:26.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14542]: starting ceph client 2021-11-15T14:42:26.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14542]: starting fuse 2021-11-15T14:42:27.969 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:42:27.982 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:42:27.983 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:42:28.031 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:42:28.032 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:42:28.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.034 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:42:28.039 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:42:28.040 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:42:28.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.041 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:42:28.041 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:42:28.042 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:42:28.042 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:42:28.043 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:42:28.043 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:28.044 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:42:28.044 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:42:28.044 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:42:28.045 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:28.045 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:42:28.046 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:42:28.046 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:42:28.046 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:42:28.047 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:28.047 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:42:28.048 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:42:28.048 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:42:28.049 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:42:28.049 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:42:28.050 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:42:28.050 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:42:28.051 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:42:28.075 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14542.asok 2021-11-15T14:42:28.077 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14542.asok 2021-11-15T14:42:28.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.078 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14542.asok status 2021-11-15T14:42:28.170 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:42:28.171 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:42:28.171 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:42:28.171 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:42:28.171 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:42:28.172 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:42:28.172 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:42:28.172 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14542", 2021-11-15T14:42:28.172 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:42:28.172 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:28.173 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:42:28.173 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:42:28.173 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 7795, 2021-11-15T14:42:28.173 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:42:28.174 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:42:28.174 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:42:28.174 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 7795 2021-11-15T14:42:28.174 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:28.174 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:42:28.175 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:42:28.175 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:42:28.175 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3394308240 2021-11-15T14:42:28.175 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:42:28.176 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:28.176 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:42:28.176 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:42:28.176 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:42:28.176 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3394308240 2021-11-15T14:42:28.177 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:42:28.177 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.7795 172.21.2.132:0/3394308240", 2021-11-15T14:42:28.177 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3394308240", 2021-11-15T14:42:28.177 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:42:28.177 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 59, 2021-11-15T14:42:28.178 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 125, 2021-11-15T14:42:28.178 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:42:28.178 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:42:28.178 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:42:28.179 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:42:28.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.180 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.181 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.187 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:42:28.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:28.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.188 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.197 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.197 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:28.208 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:42:28.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:28.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.211 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.211 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:28.223 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:42:28.224 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:28.224 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:42:28.225 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:42:28.225 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:28.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15026]: fuse finished with error 0 and tester_r 0 2021-11-15T14:42:28.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.240 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.241 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:28.308 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:42:28.308 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:42:28.309 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:42:28.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:28.310 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:28.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.315 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.315 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.327 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:42:28.328 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:28.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.329 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.329 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.340 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:42:28.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:28.342 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:42:28.342 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:42:28.343 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.362 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14542]: fuse finished with error 0 and tester_r 0 2021-11-15T14:42:28.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:28.365 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:28.366 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:28.375 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:42:28.376 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:42:28.376 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:42:34.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:34.480 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:34.490 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:42:34.490 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:34.491 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:42:34.491 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:34.491 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:42:34.492 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:42:34.500 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:42:34.501 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:34.501 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:42:34.502 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:34.504 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:42:34.504 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:34.505 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-11-15T14:42:34.505 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2021-11-15T14:42:34.506 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-11-15T14:42:34.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.592+0000 7f9f724a9700 1 Processor -- start 2021-11-15T14:42:34.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.592+0000 7f9f724a9700 1 -- start start 2021-11-15T14:42:34.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9f6c0671a0 0x7f9f6c0b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0b9c50 con 0x7f9f6c143a30 2021-11-15T14:42:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c067580 con 0x7f9f6c140070 2021-11-15T14:42:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c143100 con 0x7f9f6c0671a0 2021-11-15T14:42:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9f6c0671a0 0x7f9f6c0b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9f6c0671a0 0x7f9f6c0b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34404/0 (socket says 172.21.2.135:34404) 2021-11-15T14:42:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 -- 172.21.2.135:0/2910612030 learned_addr learned my addr 172.21.2.135:0/2910612030 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 -- 172.21.2.135:0/2910612030 >> v1:172.21.2.135:6789/0 conn(0x7f9f6c140070 legacy=0x7f9f6c140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 -- 172.21.2.135:0/2910612030 >> v1:172.21.2.119:6789/0 conn(0x7f9f6c143a30 legacy=0x7f9f6c0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 -- 172.21.2.135:0/2910612030 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0af550 con 0x7f9f6c0671a0 2021-11-15T14:42:34.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6bfff700 1 --2- 172.21.2.135:0/2910612030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0b9760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f9f6c060300 tx=0x7f9f54006eb0).ready entity=mon.1 client_cookie=64a39a5dcf4a2700 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6affd700 1 -- 172.21.2.135:0/2910612030 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5400d5c0 con 0x7f9f6c0671a0 2021-11-15T14:42:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6affd700 1 -- 172.21.2.135:0/2910612030 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54000e90 con 0x7f9f6c0671a0 2021-11-15T14:42:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f6affd700 1 -- 172.21.2.135:0/2910612030 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5400d950 con 0x7f9f6c0671a0 2021-11-15T14:42:34.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- 172.21.2.135:0/2910612030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 msgr2=0x7f9f6c0b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 --2- 172.21.2.135:0/2910612030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0b9760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f9f6c060300 tx=0x7f9f54006eb0).stop 2021-11-15T14:42:34.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- 172.21.2.135:0/2910612030 shutdown_connections 2021-11-15T14:42:34.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 --2- 172.21.2.135:0/2910612030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0b9760 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- 172.21.2.135:0/2910612030 >> 172.21.2.135:0/2910612030 conn(0x7f9f6c05fa70 msgr2=0x7f9f6c061720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- 172.21.2.135:0/2910612030 shutdown_connections 2021-11-15T14:42:34.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- 172.21.2.135:0/2910612030 wait complete. 2021-11-15T14:42:34.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 Processor -- start 2021-11-15T14:42:34.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 -- start start 2021-11-15T14:42:34.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.596+0000 7f9f724a9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f6c140070 0x7f9f6c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f6c143a30 0x7f9f6c142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0b0e40 con 0x7f9f6c143a30 2021-11-15T14:42:34.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c152720 con 0x7f9f6c0671a0 2021-11-15T14:42:34.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0b1f40 con 0x7f9f6c140070 2021-11-15T14:42:34.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34412/0 (socket says 172.21.2.135:34412) 2021-11-15T14:42:34.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 -- 172.21.2.135:0/1443871670 learned_addr learned my addr 172.21.2.135:0/1443871670 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 -- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f6c140070 msgr2=0x7f9f6c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f6c140070 0x7f9f6c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 -- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f6c143a30 msgr2=0x7f9f6c142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f6c143a30 0x7f9f6c142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 -- 172.21.2.135:0/1443871670 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5400b1e0 con 0x7f9f6c0671a0 2021-11-15T14:42:34.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6bfff700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f9f6c0b0f80 tx=0x7f9f54015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f54002f70 con 0x7f9f6c0671a0 2021-11-15T14:42:34.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54011ca0 con 0x7f9f6c0671a0 2021-11-15T14:42:34.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5401e460 con 0x7f9f6c0671a0 2021-11-15T14:42:34.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c0b1ca0 con 0x7f9f6c0671a0 2021-11-15T14:42:34.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c114300 con 0x7f9f6c0671a0 2021-11-15T14:42:34.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c152b80 con 0x7f9f6c0671a0 2021-11-15T14:42:34.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f54025030 con 0x7f9f6c0671a0 2021-11-15T14:42:34.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 0x7f9f50055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9f5406ce90 con 0x7f9f6c0671a0 2021-11-15T14:42:34.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.600+0000 7f9f6b7fe700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 0x7f9f50055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.604+0000 7f9f6b7fe700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 0x7f9f50055b20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9f5c002f10 tx=0x7f9f5c006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.604+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f6c152b80 con 0x7f9f6c0671a0 2021-11-15T14:42:34.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.612+0000 7fd51541c700 1 Processor -- start 2021-11-15T14:42:34.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.612+0000 7f065acbf700 1 Processor -- start 2021-11-15T14:42:34.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.612+0000 7fd51541c700 1 -- start start 2021-11-15T14:42:34.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.612+0000 7f065acbf700 1 -- start start 2021-11-15T14:42:34.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100aae00 0x7fd510067380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd5100ab1e0 0x7fd510064880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f0654146780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5100659e0 con 0x7fd510064d70 2021-11-15T14:42:34.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0654144d90 0x7f06540b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06541433a0 con 0x7f06540671e0 2021-11-15T14:42:34.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06541431b0 con 0x7f0654144d90 2021-11-15T14:42:34.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100b3d60 con 0x7fd5100ab1e0 2021-11-15T14:42:34.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd510066ee0 con 0x7fd5100aae00 2021-11-15T14:42:34.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0654143640 con 0x7f0654066e00 2021-11-15T14:42:34.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0654144d90 0x7f06540b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd5100ab1e0 0x7fd510064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd514c1b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd510064d70 0x7fd5100b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50250/0 (socket says 172.21.2.135:50250) 2021-11-15T14:42:34.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd514c1b700 1 -- 172.21.2.135:0/605478345 learned_addr learned my addr 172.21.2.135:0/605478345 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:34.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0654144d90 0x7f06540b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34424/0 (socket says 172.21.2.135:34424) 2021-11-15T14:42:34.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 -- 172.21.2.135:0/1830097018 learned_addr learned my addr 172.21.2.135:0/1830097018 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 -- 172.21.2.135:0/1830097018 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 msgr2=0x7f0654146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 --2- 172.21.2.135:0/1830097018 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f0654146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 -- 172.21.2.135:0/1830097018 >> v1:172.21.2.119:6789/0 conn(0x7f06540671e0 legacy=0x7f0654144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:34.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 -- 172.21.2.135:0/1830097018 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06541438e0 con 0x7f0654144d90 2021-11-15T14:42:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/605478345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100aae00 msgr2=0x7fd510067380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- 172.21.2.135:0/605478345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100aae00 0x7fd510067380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/605478345 >> v1:172.21.2.135:6789/0 conn(0x7fd510064d70 legacy=0x7fd5100b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/605478345 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100b7cb0 con 0x7fd5100ab1e0 2021-11-15T14:42:34.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065925c700 1 --2- 172.21.2.135:0/1830097018 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0654144d90 0x7f06540b4500 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f065405d190 tx=0x7f064c009290).ready entity=mon.1 client_cookie=23ba32cc9bd1fc8f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- 172.21.2.135:0/605478345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5100ab1e0 0x7fd510064880 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8006d90).ready entity=mon.1 client_cookie=3736fbbb18b630fd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f06537fe700 1 -- 172.21.2.135:0/1830097018 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00b860 con 0x7f0654144d90 2021-11-15T14:42:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f06537fe700 1 -- 172.21.2.135:0/1830097018 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c00b9c0 con 0x7f0654144d90 2021-11-15T14:42:34.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f06537fe700 1 -- 172.21.2.135:0/1830097018 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00bb70 con 0x7f0654144d90 2021-11-15T14:42:34.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50f7fe700 1 -- 172.21.2.135:0/605478345 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f800d4a0 con 0x7fd5100ab1e0 2021-11-15T14:42:34.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50f7fe700 1 -- 172.21.2.135:0/605478345 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8000e90 con 0x7fd5100ab1e0 2021-11-15T14:42:34.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50f7fe700 1 -- 172.21.2.135:0/605478345 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f800d830 con 0x7fd5100ab1e0 2021-11-15T14:42:34.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/1830097018 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0654144d90 msgr2=0x7f06540b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- 172.21.2.135:0/1830097018 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0654144d90 0x7f06540b4500 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f065405d190 tx=0x7f064c009290).stop 2021-11-15T14:42:34.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/1830097018 shutdown_connections 2021-11-15T14:42:34.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/605478345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5100ab1e0 msgr2=0x7fd510064880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- 172.21.2.135:0/605478345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5100ab1e0 0x7fd510064880 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8006d90).stop 2021-11-15T14:42:34.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- 172.21.2.135:0/1830097018 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0654144d90 0x7f06540b4500 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- 172.21.2.135:0/1830097018 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f0654146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/1830097018 >> 172.21.2.135:0/1830097018 conn(0x7f065405c510 msgr2=0x7f065405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/1830097018 shutdown_connections 2021-11-15T14:42:34.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/1830097018 wait complete. 2021-11-15T14:42:34.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/605478345 shutdown_connections 2021-11-15T14:42:34.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- 172.21.2.135:0/605478345 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd5100ab1e0 0x7fd510064880 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- 172.21.2.135:0/605478345 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100aae00 0x7fd510067380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/605478345 >> 172.21.2.135:0/605478345 conn(0x7fd510062c60 msgr2=0x7fd51005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/605478345 shutdown_connections 2021-11-15T14:42:34.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/605478345 wait complete. 2021-11-15T14:42:34.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 Processor -- start 2021-11-15T14:42:34.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- start start 2021-11-15T14:42:34.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 Processor -- start 2021-11-15T14:42:34.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- start start 2021-11-15T14:42:34.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5100aae00 0x7fd510150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100adbd0 0x7fd51013ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100ad390 con 0x7fd5100aae00 2021-11-15T14:42:34.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510153810 con 0x7fd510154490 2021-11-15T14:42:34.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd510153ab0 con 0x7fd5100adbd0 2021-11-15T14:42:34.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f06540ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34436/0 (socket says 172.21.2.135:34436) 2021-11-15T14:42:34.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0654144d90 0x7f0654062070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/430001748 learned_addr learned my addr 172.21.2.135:0/430001748 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540ab520 con 0x7f0654144d90 2021-11-15T14:42:34.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540adbf0 con 0x7f06540671e0 2021-11-15T14:42:34.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540af610 con 0x7f0654066e00 2021-11-15T14:42:34.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34440/0 (socket says 172.21.2.135:34440) 2021-11-15T14:42:34.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 -- 172.21.2.135:0/881701929 learned_addr learned my addr 172.21.2.135:0/881701929 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100adbd0 msgr2=0x7fd51013ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100adbd0 0x7fd51013ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5100aae00 msgr2=0x7fd510150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5100aae00 0x7fd510150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 -- 172.21.2.135:0/430001748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f800b120 con 0x7fd510154490 2021-11-15T14:42:34.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd5077fe700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 -- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 msgr2=0x7f06540ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f06540ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 -- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0654144d90 msgr2=0x7f0654062070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0654144d90 0x7f0654062070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 -- 172.21.2.135:0/881701929 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009530 con 0x7f06540671e0 2021-11-15T14:42:34.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0653fff700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f0648002f90 tx=0x7f0648006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f80118a0 con 0x7fd510154490 2021-11-15T14:42:34.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8011a00 con 0x7fd510154490 2021-11-15T14:42:34.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd510153d50 con 0x7fd510154490 2021-11-15T14:42:34.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f8011d60 con 0x7fd510154490 2021-11-15T14:42:34.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5101425a0 con 0x7fd510154490 2021-11-15T14:42:34.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0648013460 con 0x7f06540671e0 2021-11-15T14:42:34.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06480135c0 con 0x7f06540671e0 2021-11-15T14:42:34.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0648013920 con 0x7f06540671e0 2021-11-15T14:42:34.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06540af8b0 con 0x7f06540671e0 2021-11-15T14:42:34.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.616+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06540ade90 con 0x7f06540671e0 2021-11-15T14:42:34.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5100573d0 con 0x7fd510154490 2021-11-15T14:42:34.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06540afa40 con 0x7f06540671e0 2021-11-15T14:42:34.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4f800f070 con 0x7fd510154490 2021-11-15T14:42:34.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f064800f070 con 0x7f06540671e0 2021-11-15T14:42:34.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50dffb700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 0x7fd4f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd4f806d060 con 0x7fd510154490 2021-11-15T14:42:34.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f0651ffb700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 0x7f0634055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f064806b330 con 0x7f06540671e0 2021-11-15T14:42:34.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50ffff700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 0x7fd4f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f0658a5b700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 0x7f0634055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50ffff700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 0x7fd4f4055b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fd500002f70 tx=0x7fd5000069e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7f0658a5b700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 0x7f0634055ad0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f0644002f70 tx=0x7f0644006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.620+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4f8043fa0 con 0x7fd510154490 2021-11-15T14:42:34.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.624+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0648042340 con 0x7f06540671e0 2021-11-15T14:42:34.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.720+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f9f6c0b9c50 con 0x7f9f6c0671a0 2021-11-15T14:42:34.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.736+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fd5101541f0 con 0x7fd510154490 2021-11-15T14:42:34.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.740+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f0654143b80 con 0x7f06540671e0 2021-11-15T14:42:34.787 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:42:34.784+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:42:34.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.788+0000 7f0651ffb700 1 -- 172.21.2.135:0/881701929 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7597 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0648045960 con 0x7f06540671e0 2021-11-15T14:42:34.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.788+0000 7fd50dffb700 1 -- 172.21.2.135:0/430001748 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 4946 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd4f8047580 con 0x7fd510154490 2021-11-15T14:42:34.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.788+0000 7f9f697fa700 1 -- 172.21.2.135:0/1443871670 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7594 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9f6c0b9c50 con 0x7f9f6c0671a0 2021-11-15T14:42:34.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 msgr2=0x7f0634055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 0x7f0634055ad0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f0644002f70 tx=0x7f0644006a80).stop 2021-11-15T14:42:34.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 msgr2=0x7f06540afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f0648002f90 tx=0x7f0648006df0).stop 2021-11-15T14:42:34.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 msgr2=0x7f9f50055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 0x7f9f50055b20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9f5c002f10 tx=0x7f9f5c006930).stop 2021-11-15T14:42:34.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 msgr2=0x7f9f6c0af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f9f6c0b0f80 tx=0x7f9f54015000).stop 2021-11-15T14:42:34.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 msgr2=0x7fd4f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 0x7fd4f4055b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fd500002f70 tx=0x7fd5000069e0).stop 2021-11-15T14:42:34.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 msgr2=0x7fd510150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8013000).stop 2021-11-15T14:42:34.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 shutdown_connections 2021-11-15T14:42:34.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 shutdown_connections 2021-11-15T14:42:34.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f50053660 0x7f9f50055b20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f6c143a30 0x7f9f6c142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f6c140070 0x7f9f6c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0634053610 0x7f0634055ad0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0654144d90 0x7f0654062070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06540671e0 0x7f06540afd50 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 --2- 172.21.2.135:0/881701929 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0654066e00 0x7f06540ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 --2- 172.21.2.135:0/1443871670 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f6c0671a0 0x7f9f6c0af980 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 >> 172.21.2.135:0/1443871670 conn(0x7f9f6c05fa70 msgr2=0x7f9f6c140500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 >> 172.21.2.135:0/881701929 conn(0x7f065405c510 msgr2=0x7f06540b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 shutdown_connections 2021-11-15T14:42:34.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 shutdown_connections 2021-11-15T14:42:34.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd4f4053660 0x7fd4f4055b20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd5100adbd0 0x7fd51013ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd510154490 0x7fd510150730 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 --2- 172.21.2.135:0/430001748 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd5100aae00 0x7fd510150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 shutdown_connections 2021-11-15T14:42:34.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f065acbf700 1 -- 172.21.2.135:0/881701929 wait complete. 2021-11-15T14:42:34.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 >> 172.21.2.135:0/430001748 conn(0x7fd510062c60 msgr2=0x7fd51005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 shutdown_connections 2021-11-15T14:42:34.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7fd51541c700 1 -- 172.21.2.135:0/430001748 wait complete. 2021-11-15T14:42:34.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.792+0000 7f9f724a9700 1 -- 172.21.2.135:0/1443871670 wait complete. 2021-11-15T14:42:34.809 INFO:teuthology.orchestra.run.gibba035.stderr:failed mds gid 7597 2021-11-15T14:42:34.809 INFO:teuthology.orchestra.run.gibba035.stderr:failed mds gid 4946 2021-11-15T14:42:34.810 INFO:teuthology.orchestra.run.gibba035.stderr:failed mds gid 7594 2021-11-15T14:42:34.811 DEBUG:teuthology.parallel:result is '' 2021-11-15T14:42:34.813 DEBUG:teuthology.parallel:result is '' 2021-11-15T14:42:34.813 DEBUG:teuthology.parallel:result is '' 2021-11-15T14:42:34.814 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:42:34.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.888+0000 7ff433ab7700 1 Processor -- start 2021-11-15T14:42:34.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.888+0000 7ff433ab7700 1 -- start start 2021-11-15T14:42:34.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff42c1419e0 0x7ff42c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0a7850 con 0x7ff42c0b1f40 2021-11-15T14:42:34.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b06d0 con 0x7ff42c0b1350 2021-11-15T14:42:34.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0b17c0 con 0x7ff42c1419e0 2021-11-15T14:42:34.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff431052700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff42c0b1350 0x7ff42c1412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50270/0 (socket says 172.21.2.135:50270) 2021-11-15T14:42:34.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff431052700 1 -- 172.21.2.135:0/3210820380 learned_addr learned my addr 172.21.2.135:0/3210820380 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:34.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- 172.21.2.135:0/3210820380 >> v2:172.21.2.135:3300/0 conn(0x7ff42c1419e0 0x7ff42c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/3210820380 >> v1:172.21.2.135:6789/0 conn(0x7ff42c0b1350 legacy=0x7ff42c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/3210820380 >> v1:172.21.2.119:6789/0 conn(0x7ff42c0b1f40 legacy=0x7ff42c0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:34.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/3210820380 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0b0970 con 0x7ff42c1419e0 2021-11-15T14:42:34.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- 172.21.2.135:0/3210820380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c0b0030 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7ff42c0ad350 tx=0x7ff4240091d0).ready entity=mon.1 client_cookie=aeaf2f0fa3bb495a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff430851700 1 -- 172.21.2.135:0/3210820380 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42400b600 con 0x7ff42c1419e0 2021-11-15T14:42:34.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff430851700 1 -- 172.21.2.135:0/3210820380 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400b760 con 0x7ff42c1419e0 2021-11-15T14:42:34.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff430851700 1 -- 172.21.2.135:0/3210820380 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42400b8d0 con 0x7ff42c1419e0 2021-11-15T14:42:34.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/3210820380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 msgr2=0x7ff42c0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- 172.21.2.135:0/3210820380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c0b0030 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7ff42c0ad350 tx=0x7ff4240091d0).stop 2021-11-15T14:42:34.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/3210820380 shutdown_connections 2021-11-15T14:42:34.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- 172.21.2.135:0/3210820380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c0b0030 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:34.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/3210820380 >> 172.21.2.135:0/3210820380 conn(0x7ff42c05f730 msgr2=0x7ff42c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:34.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/3210820380 shutdown_connections 2021-11-15T14:42:34.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/3210820380 wait complete. 2021-11-15T14:42:34.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 Processor -- start 2021-11-15T14:42:34.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- start start 2021-11-15T14:42:34.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff42c0b1350 0x7ff42c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff42c0b1f40 0x7ff42c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0a94a0 con 0x7ff42c0b1350 2021-11-15T14:42:34.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c148d30 con 0x7ff42c1419e0 2021-11-15T14:42:34.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c148fd0 con 0x7ff42c0b1f40 2021-11-15T14:42:34.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34458/0 (socket says 172.21.2.135:34458) 2021-11-15T14:42:34.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/920455479 learned_addr learned my addr 172.21.2.135:0/920455479 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:34.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff42c0b1f40 msgr2=0x7ff42c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff42c0b1f40 0x7ff42c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff42c0b1350 msgr2=0x7ff42c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:34.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff42c0b1350 0x7ff42c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:34.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 -- 172.21.2.135:0/920455479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424009470 con 0x7ff42c1419e0 2021-11-15T14:42:34.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff432054700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7ff42c0ad350 tx=0x7ff424016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff424020400 con 0x7ff42c1419e0 2021-11-15T14:42:34.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424020560 con 0x7ff42c1419e0 2021-11-15T14:42:34.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c14b070 con 0x7ff42c1419e0 2021-11-15T14:42:34.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0b4520 con 0x7ff42c1419e0 2021-11-15T14:42:34.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4240208c0 con 0x7ff42c1419e0 2021-11-15T14:42:34.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.892+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c149190 con 0x7ff42c1419e0 2021-11-15T14:42:34.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff424027030 con 0x7ff42c1419e0 2021-11-15T14:42:34.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff41effd700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 0x7ff40c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:34.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6502+0+0 (secure 0 0 0) 0x7ff42406cbe0 con 0x7ff42c1419e0 2021-11-15T14:42:34.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff431853700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 0x7ff40c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:34.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff431853700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 0x7ff40c055ac0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ff428002f90 tx=0x7ff4280069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:34.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:34.896+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff424043b90 con 0x7ff42c1419e0 2021-11-15T14:42:35.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.008+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff42c14b4e0 con 0x7ff42c1419e0 2021-11-15T14:42:35.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff41effd700 1 -- 172.21.2.135:0/920455479 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff4240150a0 con 0x7ff42c1419e0 2021-11-15T14:42:35.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 msgr2=0x7ff40c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 0x7ff40c055ac0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ff428002f90 tx=0x7ff4280069b0).stop 2021-11-15T14:42:35.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 msgr2=0x7ff42c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7ff42c0ad350 tx=0x7ff424016000).stop 2021-11-15T14:42:35.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 shutdown_connections 2021-11-15T14:42:35.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff40c053600 0x7ff40c055ac0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:35.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff42c1419e0 0x7ff42c15acc0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:35.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff42c0b1f40 0x7ff42c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 --2- 172.21.2.135:0/920455479 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff42c0b1350 0x7ff42c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 >> 172.21.2.135:0/920455479 conn(0x7ff42c05f730 msgr2=0x7ff42c13f870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:35.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 shutdown_connections 2021-11-15T14:42:35.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.808+0000 7ff433ab7700 1 -- 172.21.2.135:0/920455479 wait complete. 2021-11-15T14:42:35.819 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:42:35.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.868+0000 7f0e8dd0f700 1 Processor -- start 2021-11-15T14:42:35.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.868+0000 7f0e8dd0f700 1 -- start start 2021-11-15T14:42:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0e880afca0 0x7f0e8813f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e880b0bb0 0x7f0e8813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880b04b0 con 0x7f0e880ad150 2021-11-15T14:42:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880ad530 con 0x7f0e880afca0 2021-11-15T14:42:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880b57d0 con 0x7f0e880b0bb0 2021-11-15T14:42:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e880b0bb0 0x7f0e8813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:35.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e880b0bb0 0x7f0e8813bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34466/0 (socket says 172.21.2.135:34466) 2021-11-15T14:42:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 -- 172.21.2.135:0/2006849966 learned_addr learned my addr 172.21.2.135:0/2006849966 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 -- 172.21.2.135:0/2006849966 >> v2:172.21.2.119:3300/0 conn(0x7f0e880afca0 msgr2=0x7f0e8813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 --2- 172.21.2.135:0/2006849966 >> v2:172.21.2.119:3300/0 conn(0x7f0e880afca0 0x7f0e8813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 -- 172.21.2.135:0/2006849966 >> v1:172.21.2.135:6789/0 conn(0x7f0e880ad150 legacy=0x7f0e8813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 -- 172.21.2.135:0/2006849966 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880b06e0 con 0x7f0e880b0bb0 2021-11-15T14:42:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e87fff700 1 --2- 172.21.2.135:0/2006849966 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880b0bb0 0x7f0e8813bf70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f0e800032f0 tx=0x7f0e80009b20).ready entity=mon.1 client_cookie=d9978f29f4154fd3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e867fc700 1 -- 172.21.2.135:0/2006849966 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e8000cb70 con 0x7f0e880b0bb0 2021-11-15T14:42:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e867fc700 1 -- 172.21.2.135:0/2006849966 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000ccd0 con 0x7f0e880b0bb0 2021-11-15T14:42:35.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e867fc700 1 -- 172.21.2.135:0/2006849966 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e80010600 con 0x7f0e880b0bb0 2021-11-15T14:42:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/2006849966 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880b0bb0 msgr2=0x7f0e8813bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/2006849966 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880b0bb0 0x7f0e8813bf70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f0e800032f0 tx=0x7f0e80009b20).stop 2021-11-15T14:42:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/2006849966 shutdown_connections 2021-11-15T14:42:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/2006849966 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880b0bb0 0x7f0e8813bf70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:35.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/2006849966 >> v2:172.21.2.119:3300/0 conn(0x7f0e880afca0 0x7f0e8813f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/2006849966 >> 172.21.2.135:0/2006849966 conn(0x7f0e88062cb0 msgr2=0x7f0e88063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/2006849966 shutdown_connections 2021-11-15T14:42:35.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/2006849966 wait complete. 2021-11-15T14:42:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 Processor -- start 2021-11-15T14:42:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- start start 2021-11-15T14:42:35.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e880afca0 0x7f0e88150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e880b0bb0 0x7f0e88150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88150230 con 0x7f0e880afca0 2021-11-15T14:42:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88151070 con 0x7f0e880ad150 2021-11-15T14:42:35.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880656f0 con 0x7f0e880b0bb0 2021-11-15T14:42:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34468/0 (socket says 172.21.2.135:34468) 2021-11-15T14:42:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 -- 172.21.2.135:0/3388830067 learned_addr learned my addr 172.21.2.135:0/3388830067 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:35.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 -- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e880b0bb0 msgr2=0x7f0e88150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e880b0bb0 0x7f0e88150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 -- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e880afca0 msgr2=0x7f0e88150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e880afca0 0x7f0e88150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:35.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 -- 172.21.2.135:0/3388830067 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009dc0 con 0x7f0e880ad150 2021-11-15T14:42:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e877fe700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0e880b00d0 tx=0x7f0e70007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7000ce30 con 0x7f0e880ad150 2021-11-15T14:42:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7000f470 con 0x7f0e880ad150 2021-11-15T14:42:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88065990 con 0x7f0e880ad150 2021-11-15T14:42:35.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7000f7d0 con 0x7f0e880ad150 2021-11-15T14:42:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.872+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e881417f0 con 0x7f0e880ad150 2021-11-15T14:42:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e88064cd0 con 0x7f0e880ad150 2021-11-15T14:42:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e70019030 con 0x7f0e880ad150 2021-11-15T14:42:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e84ff9700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 0x7f0e6c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:35.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f0e7006afb0 con 0x7f0e880ad150 2021-11-15T14:42:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e86ffd700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 0x7f0e6c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e86ffd700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 0x7f0e6c055bb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:35.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.876+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e70041f60 con 0x7f0e880ad150 2021-11-15T14:42:35.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:35.960+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0e881503a0 con 0x7f0e880ad150 2021-11-15T14:42:36.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.812+0000 7f0e84ff9700 1 -- 172.21.2.135:0/3388830067 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0e70045580 con 0x7f0e880ad150 2021-11-15T14:42:36.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 msgr2=0x7f0e6c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 0x7f0e6c055bb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78006a80).stop 2021-11-15T14:42:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 msgr2=0x7f0e8813f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0e880b00d0 tx=0x7f0e70007c50).stop 2021-11-15T14:42:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 shutdown_connections 2021-11-15T14:42:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e6c0536f0 0x7f0e6c055bb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e880b0bb0 0x7f0e88150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e880afca0 0x7f0e88150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 --2- 172.21.2.135:0/3388830067 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e880ad150 0x7f0e8813f2f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 >> 172.21.2.135:0/3388830067 conn(0x7f0e88062cb0 msgr2=0x7f0e8813bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 shutdown_connections 2021-11-15T14:42:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.816+0000 7f0e8dd0f700 1 -- 172.21.2.135:0/3388830067 wait complete. 2021-11-15T14:42:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:42:36.826 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:42:36.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 Processor -- start 2021-11-15T14:42:36.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 -- start start 2021-11-15T14:42:36.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f09280b1f40 0x7f09280b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 0x7f09280b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09280b04a0 con 0x7f09280a7140 2021-11-15T14:42:36.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09280b2810 con 0x7f09280b1f40 2021-11-15T14:42:36.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f092d3a9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280b06d0 con 0x7f09280b0030 2021-11-15T14:42:36.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f09267fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 0x7f09280b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:36.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f09280b1f40 0x7f09280b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:36.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f09267fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 0x7f09280b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:44256/0 (socket says 172.21.2.135:44256) 2021-11-15T14:42:36.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f09267fc700 1 -- 172.21.2.135:0/811765078 learned_addr learned my addr 172.21.2.135:0/811765078 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:36.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 -- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 msgr2=0x7f09280b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:36.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 --2- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 0x7f09280b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 -- 172.21.2.135:0/811765078 >> v1:172.21.2.119:6789/0 conn(0x7f09280a7140 legacy=0x7f09281412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 -- 172.21.2.135:0/811765078 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280b0970 con 0x7f09280b1f40 2021-11-15T14:42:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.896+0000 7f0926ffd700 1 --2- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f09280b1350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0910002f70 tx=0x7f0910006df0).ready entity=mon.0 client_cookie=5e78b2ef1275af3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f0925ffb700 1 -- 172.21.2.135:0/811765078 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091000d570 con 0x7f09280b1f40 2021-11-15T14:42:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f0925ffb700 1 -- 172.21.2.135:0/811765078 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910000e90 con 0x7f09280b1f40 2021-11-15T14:42:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f0925ffb700 1 -- 172.21.2.135:0/811765078 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091000d8c0 con 0x7f09280b1f40 2021-11-15T14:42:36.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 msgr2=0x7f09280b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f09280b1350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0910002f70 tx=0x7f0910006df0).stop 2021-11-15T14:42:36.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/811765078 shutdown_connections 2021-11-15T14:42:36.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280b0030 0x7f09280b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:36.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- 172.21.2.135:0/811765078 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f09280b1350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:36.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/811765078 >> 172.21.2.135:0/811765078 conn(0x7f092805f730 msgr2=0x7f092805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:36.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/811765078 shutdown_connections 2021-11-15T14:42:36.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/811765078 wait complete. 2021-11-15T14:42:36.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 Processor -- start 2021-11-15T14:42:36.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- start start 2021-11-15T14:42:36.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280a7140 0x7f09280abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f092815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092814ba40 con 0x7f09280b1f40 2021-11-15T14:42:36.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092814abd0 con 0x7f09280b0030 2021-11-15T14:42:36.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092814ae70 con 0x7f09280a7140 2021-11-15T14:42:36.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:36.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34486/0 (socket says 172.21.2.135:34486) 2021-11-15T14:42:36.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 -- 172.21.2.135:0/3239303816 learned_addr learned my addr 172.21.2.135:0/3239303816 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:36.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 -- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280a7140 msgr2=0x7f09280abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280a7140 0x7f09280abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:36.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 -- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 msgr2=0x7f092815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:36.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f092815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:36.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 -- 172.21.2.135:0/3239303816 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091000b180 con 0x7f09280b0030 2021-11-15T14:42:36.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f09267fc700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f091800c000 tx=0x7f0918008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:36.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0918013610 con 0x7f09280b0030 2021-11-15T14:42:36.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0918013770 con 0x7f09280b0030 2021-11-15T14:42:36.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0918013ad0 con 0x7f09280b0030 2021-11-15T14:42:36.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928062840 con 0x7f09280b0030 2021-11-15T14:42:36.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.900+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0928149e90 con 0x7f09280b0030 2021-11-15T14:42:36.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092814bc40 con 0x7f09280b0030 2021-11-15T14:42:36.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0918023070 con 0x7f09280b0030 2021-11-15T14:42:36.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f091ffff700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 0x7f090c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:36.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f091806bcc0 con 0x7f09280b0030 2021-11-15T14:42:36.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f0926ffd700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 0x7f090c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:36.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f0926ffd700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 0x7f090c055b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0910002f70 tx=0x7f0910014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:36.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.904+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0918042d20 con 0x7f09280b0030 2021-11-15T14:42:36.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:36.988+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f092814b030 con 0x7f09280b0030 2021-11-15T14:42:37.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f091ffff700 1 -- 172.21.2.135:0/3239303816 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v130) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0918046340 con 0x7f09280b0030 2021-11-15T14:42:37.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 msgr2=0x7f090c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:37.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 0x7f090c055b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0910002f70 tx=0x7f0910014000).stop 2021-11-15T14:42:37.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 msgr2=0x7f092815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:37.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f091800c000 tx=0x7f0918008040).stop 2021-11-15T14:42:37.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 shutdown_connections 2021-11-15T14:42:37.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f090c053690 0x7f090c055b50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:37.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f09280b1f40 0x7f092815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f09280b0030 0x7f092815a290 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:37.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 --2- 172.21.2.135:0/3239303816 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f09280a7140 0x7f09280abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 >> 172.21.2.135:0/3239303816 conn(0x7f092805f730 msgr2=0x7f092813cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:37.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 shutdown_connections 2021-11-15T14:42:37.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:37.820+0000 7f092d3a9700 1 -- 172.21.2.135:0/3239303816 wait complete. 2021-11-15T14:42:37.829 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:42:37.834 DEBUG:teuthology.orchestra.run.gibba038:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-11-15T14:42:37.871 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- 172.21.2.138:0/653961596 wait complete. 2021-11-15T14:42:37.871 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 Processor -- start 2021-11-15T14:42:37.871 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- start start 2021-11-15T14:42:37.872 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.872 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160c010 0x563291619930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.872 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 0x563291619e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.872 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329150d210 con 0x56329160c010 2021-11-15T14:42:37.873 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632914fd460 con 0x56329160b450 2021-11-15T14:42:37.873 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x563291620c40 con 0x563291611740 2021-11-15T14:42:37.873 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:37.873 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.138:32870/0 (socket says 172.21.2.138:32870) 2021-11-15T14:42:37.874 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 -- 172.21.2.138:0/3587868672 learned_addr learned my addr 172.21.2.138:0/3587868672 (peer_addr_for_me v2:172.21.2.138:0/0) 2021-11-15T14:42:37.874 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 -- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 msgr2=0x563291619e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:37.874 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 0x563291619e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.874 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 -- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160c010 msgr2=0x563291619930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:37.875 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160c010 0x563291619930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.875 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 -- 172.21.2.138:0/3587868672 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c005d90 con 0x56329160b450 2021-11-15T14:42:37.875 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20ab052700 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x56329160b410 tx=0x7f209c015000).ready entity=mon.1 client_cookie=1ce0c905dfd88d02 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:37.875 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20a984f700 1 -- 172.21.2.138:0/3587868672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209c008950 con 0x56329160b450 2021-11-15T14:42:37.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20a984f700 1 -- 172.21.2.138:0/3587868672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c008ab0 con 0x56329160b450 2021-11-15T14:42:37.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20a984f700 1 -- 172.21.2.138:0/3587868672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209c008e10 con 0x56329160b450 2021-11-15T14:42:37.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 -- 172.21.2.138:0/3587868672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 msgr2=0x563291619440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:37.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.862+0000 7f20acc14b80 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x56329160b410 tx=0x7f209c015000).stop 2021-11-15T14:42:37.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/3587868672 shutdown_connections 2021-11-15T14:42:37.877 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 0x563291619e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.877 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160c010 0x563291619930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.877 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- 172.21.2.138:0/3587868672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160b450 0x563291619440 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:37.877 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/3587868672 >> 172.21.2.138:0/3587868672 conn(0x563291607040 msgr2=0x56329160d230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:37.878 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/3587868672 shutdown_connections 2021-11-15T14:42:37.878 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/3587868672 wait complete. 2021-11-15T14:42:37.878 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 Processor -- start 2021-11-15T14:42:37.878 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- start start 2021-11-15T14:42:37.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160b450 0x563291618b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 0x563291612320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 0x563291612810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x563291608850 con 0x56329160b450 2021-11-15T14:42:37.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563291612df0 con 0x56329160c010 2021-11-15T14:42:37.880 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x563291612fb0 con 0x563291611740 2021-11-15T14:42:37.880 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 0x563291612320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:37.880 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 0x563291612320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.138:32880/0 (socket says 172.21.2.138:32880) 2021-11-15T14:42:37.880 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 -- 172.21.2.138:0/1836492395 learned_addr learned my addr 172.21.2.138:0/1836492395 (peer_addr_for_me v2:172.21.2.138:0/0) 2021-11-15T14:42:37.881 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 -- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 msgr2=0x563291612810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:37.881 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x563291611740 0x563291612810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.881 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 -- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160b450 msgr2=0x563291618b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:37.881 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x56329160b450 0x563291618b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:37.882 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 -- 172.21.2.138:0/1836492395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c016040 con 0x56329160c010 2021-11-15T14:42:37.882 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a3fff700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 0x563291612320 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f2094001fa0 tx=0x7f2094002830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:37.882 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2094013070 con 0x56329160c010 2021-11-15T14:42:37.882 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094000e90 con 0x56329160c010 2021-11-15T14:42:37.883 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632914f5fe0 con 0x56329160c010 2021-11-15T14:42:37.883 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209400f5f0 con 0x56329160c010 2021-11-15T14:42:37.883 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563291616770 con 0x56329160c010 2021-11-15T14:42:37.883 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f209400f750 con 0x56329160c010 2021-11-15T14:42:37.883 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f208c0521e0 0x7f208c0546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.884 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f209406a410 con 0x56329160c010 2021-11-15T14:42:37.884 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x56329162fa70 0x563291631e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:37.884 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 --> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e130) v8 -- 0x563291632350 con 0x56329162fa70 2021-11-15T14:42:37.884 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20ab052700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f208c0521e0 0x7f208c0546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:37.885 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.866+0000 7f20ab853700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x56329162fa70 0x563291631e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:37.885 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.870+0000 7f20ab052700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f208c0521e0 0x7f208c0546a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x56329160b410 tx=0x7f209c01c000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:37.885 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:37.870+0000 7f20ab853700 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x56329162fa70 0x563291631e60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:38.838 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20a904e700 1 -- 172.21.2.138:0/1836492395 <== osd.6 v2:172.21.2.119:6802/15092 1 ==== osd_map(131..131 src has 1..131) v4 ==== 320+0+0 (crc 0 0 0) 0x7f20a4001740 con 0x56329162fa70 2021-11-15T14:42:38.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20ab853700 1 -- 172.21.2.138:0/1836492395 <== osd.6 v2:172.21.2.119:6802/15092 2 ==== osd_op_reply(1 key [writefull 0~617] v131'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f20a4001900 con 0x56329162fa70 2021-11-15T14:42:38.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x56329162fa70 msgr2=0x563291631e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x56329162fa70 0x563291631e60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:38.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f208c0521e0 msgr2=0x7f208c0546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f208c0521e0 0x7f208c0546a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x56329160b410 tx=0x7f209c01c000).stop 2021-11-15T14:42:38.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 msgr2=0x563291612320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 --2- 172.21.2.138:0/1836492395 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x56329160c010 0x563291612320 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f2094001fa0 tx=0x7f2094002830).stop 2021-11-15T14:42:38.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20ab853700 1 -- 172.21.2.138:0/1836492395 reap_dead start 2021-11-15T14:42:38.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 shutdown_connections 2021-11-15T14:42:38.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 >> 172.21.2.138:0/1836492395 conn(0x563291607040 msgr2=0x563291619650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:38.843 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 shutdown_connections 2021-11-15T14:42:38.843 INFO:teuthology.orchestra.run.gibba038.stderr:2021-11-15T14:42:38.842+0000 7f20acc14b80 1 -- 172.21.2.138:0/1836492395 wait complete. 2021-11-15T14:42:38.848 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T14:42:38.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 Processor -- start 2021-11-15T14:42:38.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 -- start start 2021-11-15T14:42:38.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 0x7f90a80acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a80b6d60 con 0x7f90a80aa650 2021-11-15T14:42:38.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a8061260 con 0x7f90a80b6980 2021-11-15T14:42:38.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90add7f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8061500 con 0x7f90a8060990 2021-11-15T14:42:38.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f90a80b6980 0x7f90a80a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50310/0 (socket says 172.21.2.135:50310) 2021-11-15T14:42:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a77fe700 1 -- 172.21.2.135:0/1481523866 learned_addr learned my addr 172.21.2.135:0/1481523866 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417290622 0 0) 0x7f90a8061260 con 0x7f90a80b6980 2021-11-15T14:42:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9088003260 con 0x7f90a80b6980 2021-11-15T14:42:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1583224058 0 0) 0x7f9088003260 con 0x7f90a80b6980 2021-11-15T14:42:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 msgr2=0x7f90a80acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 0x7f90a80acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 >> v1:172.21.2.119:6789/0 conn(0x7f90a80aa650 legacy=0x7f90a813c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80617a0 con 0x7f90a80b6980 2021-11-15T14:42:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9098001660 con 0x7f90a80b6980 2021-11-15T14:42:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 >> v1:172.21.2.135:6789/0 conn(0x7f90a80b6980 legacy=0x7f90a80a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90880037d0 0x7f9088003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 0x7f9088004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f908800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8061500 con 0x7f90880037d0 2021-11-15T14:42:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90880052b0 con 0x7f9088004bf0 2021-11-15T14:42:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908800bc40 con 0x7f90a8060990 2021-11-15T14:42:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.896+0000 7f90a7fff700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f908800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:38.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 -- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 msgr2=0x7f9088004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:38.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a8060990 0x7f9088004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:38.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 -- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90880037d0 msgr2=0x7f9088003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:38.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90880037d0 0x7f9088003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:38.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 -- 172.21.2.135:0/1481523866 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088003260 con 0x7f9088004bf0 2021-11-15T14:42:38.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f908800b750 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f90a00012f0 tx=0x7f90a0007d60).ready entity=mon.1 client_cookie=f62b5f3fda4b1725 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:38.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a00014c0 con 0x7f9088004bf0 2021-11-15T14:42:38.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0006a60 con 0x7f9088004bf0 2021-11-15T14:42:38.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a67fc700 1 -- 172.21.2.135:0/1481523866 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a0006dc0 con 0x7f9088004bf0 2021-11-15T14:42:38.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/1481523866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 msgr2=0x7f908800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 --2- 172.21.2.135:0/1481523866 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f908800b750 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f90a00012f0 tx=0x7f90a0007d60).stop 2021-11-15T14:42:38.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a7fff700 1 -- 172.21.2.135:0/1481523866 reap_dead start 2021-11-15T14:42:38.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/1481523866 shutdown_connections 2021-11-15T14:42:38.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/1481523866 >> 172.21.2.135:0/1481523866 conn(0x7f90a80b3500 msgr2=0x7f90a80b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:38.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/1481523866 shutdown_connections 2021-11-15T14:42:38.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/1481523866 wait complete. 2021-11-15T14:42:38.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 Processor -- start 2021-11-15T14:42:38.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- start start 2021-11-15T14:42:38.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a80af880 0x7f90a80ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80ae9f0 0x7f90a8153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81538f0 con 0x7f90a80af880 2021-11-15T14:42:38.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8064b60 con 0x7f9088004bf0 2021-11-15T14:42:38.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8064e00 con 0x7f90a80ae9f0 2021-11-15T14:42:38.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:38.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34500/0 (socket says 172.21.2.135:34500) 2021-11-15T14:42:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 -- 172.21.2.135:0/3122680984 learned_addr learned my addr 172.21.2.135:0/3122680984 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 -- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80ae9f0 msgr2=0x7f90a8153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80ae9f0 0x7f90a8153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 -- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a80af880 msgr2=0x7f90a80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:38.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a80af880 0x7f90a80ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:38.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 -- 172.21.2.135:0/3122680984 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80650a0 con 0x7f9088004bf0 2021-11-15T14:42:38.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a77fe700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f90a80b5e80 tx=0x7f90a80ac010).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:38.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9098007170 con 0x7f9088004bf0 2021-11-15T14:42:38.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980072d0 con 0x7f9088004bf0 2021-11-15T14:42:38.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9098004920 con 0x7f9088004bf0 2021-11-15T14:42:38.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8065340 con 0x7f9088004bf0 2021-11-15T14:42:38.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a80aee70 con 0x7f9088004bf0 2021-11-15T14:42:38.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a80654d0 con 0x7f9088004bf0 2021-11-15T14:42:38.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f909801b070 con 0x7f9088004bf0 2021-11-15T14:42:38.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 0x7f908c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:38.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.900+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f909806b4a0 con 0x7f9088004bf0 2021-11-15T14:42:38.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.904+0000 7f90a6ffd700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 0x7f908c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:38.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.904+0000 7f90a6ffd700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 0x7f908c055a30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9090002f70 tx=0x7f9090006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:38.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:38.904+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9098042390 con 0x7f9088004bf0 2021-11-15T14:42:39.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f90a8061a40 con 0x7f9088004bf0 2021-11-15T14:42:39.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90a4ff9700 1 -- 172.21.2.135:0/3122680984 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1588 (secure 0 0 0) 0x7f90980459b0 con 0x7f9088004bf0 2021-11-15T14:42:39.024 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:39.024 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:39.024 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:39.025 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:39.025 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764491452416, 2021-11-15T14:42:39.025 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 12726272, 2021-11-15T14:42:39.025 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8602660864, 2021-11-15T14:42:39.026 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011127572506666183, 2021-11-15T14:42:39.026 INFO:teuthology.orchestra.run.gibba035.stdout: "num_osds": 8, 2021-11-15T14:42:39.026 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_osds": 8, 2021-11-15T14:42:39.026 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_omap_osds": 8 2021-11-15T14:42:39.027 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:39.027 INFO:teuthology.orchestra.run.gibba035.stdout: "stats_by_class": { 2021-11-15T14:42:39.027 INFO:teuthology.orchestra.run.gibba035.stdout: "ssd": { 2021-11-15T14:42:39.027 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:39.027 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764491452416, 2021-11-15T14:42:39.028 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 12726272, 2021-11-15T14:42:39.028 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8602660864, 2021-11-15T14:42:39.028 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011127572506666183 2021-11-15T14:42:39.028 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:39.029 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:39.029 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:39.029 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:39.029 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "device_health_metrics", 2021-11-15T14:42:39.030 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 1, 2021-11-15T14:42:39.030 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:39.030 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:39.030 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 2, 2021-11-15T14:42:39.030 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:39.031 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:39.031 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:39.031 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918248448 2021-11-15T14:42:39.031 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:39.032 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:39.032 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:39.032 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "rbd", 2021-11-15T14:42:39.032 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 2, 2021-11-15T14:42:39.032 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:39.033 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:39.033 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:39.033 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:39.033 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:39.034 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:39.034 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918248448 2021-11-15T14:42:39.034 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:39.034 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:39.034 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:39.035 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "cephfs_data", 2021-11-15T14:42:39.035 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 22, 2021-11-15T14:42:39.035 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:39.035 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:39.036 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:39.036 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:39.036 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:39.036 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:39.036 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918248448 2021-11-15T14:42:39.037 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:39.037 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:39.037 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:39.037 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:39.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 msgr2=0x7f908c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:39.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 0x7f908c055a30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9090002f70 tx=0x7f9090006a10).stop 2021-11-15T14:42:39.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 msgr2=0x7f90a8143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:39.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f90a80b5e80 tx=0x7f90a80ac010).stop 2021-11-15T14:42:39.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 shutdown_connections 2021-11-15T14:42:39.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f908c053570 0x7f908c055a30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:39.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f90a80ae9f0 0x7f90a8153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:39.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f90a80af880 0x7f90a80ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:39.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 --2- 172.21.2.135:0/3122680984 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9088004bf0 0x7f90a8143090 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:39.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 >> 172.21.2.135:0/3122680984 conn(0x7f90a80b3500 msgr2=0x7f90a81394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:39.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 shutdown_connections 2021-11-15T14:42:39.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:39.020+0000 7f90add7f700 1 -- 172.21.2.135:0/3122680984 wait complete. 2021-11-15T14:42:39.042 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-11-15T14:42:42.616 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:42.619 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:42.623 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:42.626 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:42:44.043 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-15T14:42:44.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 Processor -- start 2021-11-15T14:42:44.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- start start 2021-11-15T14:42:44.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd140b1e30 0x7fdd140b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd140a7140 0x7fdd141447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd140b03d0 con 0x7fdd14148420 2021-11-15T14:42:44.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140a9140 con 0x7fdd140b1e30 2021-11-15T14:42:44.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140b0670 con 0x7fdd140a7140 2021-11-15T14:42:44.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd140b1e30 0x7fdd140b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fdd140b1e30 0x7fdd140b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34508/0 (socket says 172.21.2.135:34508) 2021-11-15T14:42:44.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 -- 172.21.2.135:0/3289611443 learned_addr learned my addr 172.21.2.135:0/3289611443 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd189e0700 1 --1- 172.21.2.135:0/3289611443 >> v1:172.21.2.135:6789/0 conn(0x7fdd14148420 0x7fdd140b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50330/0 (socket says 172.21.2.135:50330) 2021-11-15T14:42:44.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 -- 172.21.2.135:0/3289611443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd140a7140 msgr2=0x7fdd141447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 --2- 172.21.2.135:0/3289611443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd140a7140 0x7fdd141447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 -- 172.21.2.135:0/3289611443 >> v1:172.21.2.135:6789/0 conn(0x7fdd14148420 legacy=0x7fdd140b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd03fff700 1 -- 172.21.2.135:0/3289611443 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186474609 0 0) 0x7fdd140b03d0 con 0x7fdd14148420 2021-11-15T14:42:44.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 -- 172.21.2.135:0/3289611443 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140b0910 con 0x7fdd140b1e30 2021-11-15T14:42:44.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd191e1700 1 --2- 172.21.2.135:0/3289611443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd140b1050 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fdd141477b0 tx=0x7fdd10006eb0).ready entity=mon.1 client_cookie=53531f659f195fe8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd03fff700 1 -- 172.21.2.135:0/3289611443 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1000d5c0 con 0x7fdd140b1e30 2021-11-15T14:42:44.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd03fff700 1 -- 172.21.2.135:0/3289611443 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10000e90 con 0x7fdd140b1e30 2021-11-15T14:42:44.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd03fff700 1 -- 172.21.2.135:0/3289611443 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1000d910 con 0x7fdd140b1e30 2021-11-15T14:42:44.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- 172.21.2.135:0/3289611443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 msgr2=0x7fdd140b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- 172.21.2.135:0/3289611443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd140b1050 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fdd141477b0 tx=0x7fdd10006eb0).stop 2021-11-15T14:42:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- 172.21.2.135:0/3289611443 shutdown_connections 2021-11-15T14:42:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- 172.21.2.135:0/3289611443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd140a7140 0x7fdd141447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- 172.21.2.135:0/3289611443 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd140b1050 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- 172.21.2.135:0/3289611443 >> 172.21.2.135:0/3289611443 conn(0x7fdd1405f730 msgr2=0x7fdd1405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- 172.21.2.135:0/3289611443 shutdown_connections 2021-11-15T14:42:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- 172.21.2.135:0/3289611443 wait complete. 2021-11-15T14:42:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 Processor -- start 2021-11-15T14:42:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 -- start start 2021-11-15T14:42:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.096+0000 7fdd1b445700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd140a7140 0x7fdd140ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd14148420 0x7fdd140a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14146ba0 con 0x7fdd140a7140 2021-11-15T14:42:44.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1414b780 con 0x7fdd140b1e30 2021-11-15T14:42:44.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1414a230 con 0x7fdd14148420 2021-11-15T14:42:44.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34516/0 (socket says 172.21.2.135:34516) 2021-11-15T14:42:44.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 -- 172.21.2.135:0/2613958583 learned_addr learned my addr 172.21.2.135:0/2613958583 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 -- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd14148420 msgr2=0x7fdd140a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd14148420 0x7fdd140a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 -- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd140a7140 msgr2=0x7fdd140ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd140a7140 0x7fdd140ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 -- 172.21.2.135:0/2613958583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1000b1e0 con 0x7fdd140b1e30 2021-11-15T14:42:44.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd189e0700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fdd140ab240 tx=0x7fdd04007ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd040072e0 con 0x7fdd140b1e30 2021-11-15T14:42:44.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd04005550 con 0x7fdd140b1e30 2021-11-15T14:42:44.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd040058b0 con 0x7fdd140b1e30 2021-11-15T14:42:44.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1414a4d0 con 0x7fdd140b1e30 2021-11-15T14:42:44.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1414b470 con 0x7fdd140b1e30 2021-11-15T14:42:44.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd140573d0 con 0x7fdd140b1e30 2021-11-15T14:42:44.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd04010070 con 0x7fdd140b1e30 2021-11-15T14:42:44.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 0x7fdcf4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fdd0406b390 con 0x7fdd140b1e30 2021-11-15T14:42:44.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.100+0000 7fdd191e1700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 0x7fdcf4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.104+0000 7fdd191e1700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 0x7fdcf4055b60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fdd141477b0 tx=0x7fdd10015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.104+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd04042390 con 0x7fdd140b1e30 2021-11-15T14:42:44.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fdd140446d0 con 0x7fdd140b1e30 2021-11-15T14:42:44.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd027fc700 1 -- 172.21.2.135:0/2613958583 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7fdd040459b0 con 0x7fdd140b1e30 2021-11-15T14:42:44.217 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:44.217 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:44.218 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:44.218 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:44.218 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764490973184, 2021-11-15T14:42:44.218 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 13205504, 2021-11-15T14:42:44.219 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8603140096, 2021-11-15T14:42:44.219 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011128192767500877, 2021-11-15T14:42:44.219 INFO:teuthology.orchestra.run.gibba035.stdout: "num_osds": 8, 2021-11-15T14:42:44.220 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_osds": 8, 2021-11-15T14:42:44.220 INFO:teuthology.orchestra.run.gibba035.stdout: "num_per_pool_omap_osds": 8 2021-11-15T14:42:44.220 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:44.220 INFO:teuthology.orchestra.run.gibba035.stdout: "stats_by_class": { 2021-11-15T14:42:44.221 INFO:teuthology.orchestra.run.gibba035.stdout: "ssd": { 2021-11-15T14:42:44.221 INFO:teuthology.orchestra.run.gibba035.stdout: "total_bytes": 773094113280, 2021-11-15T14:42:44.221 INFO:teuthology.orchestra.run.gibba035.stdout: "total_avail_bytes": 764490973184, 2021-11-15T14:42:44.221 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_bytes": 13205504, 2021-11-15T14:42:44.222 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_bytes": 8603140096, 2021-11-15T14:42:44.222 INFO:teuthology.orchestra.run.gibba035.stdout: "total_used_raw_ratio": 0.011128192767500877 2021-11-15T14:42:44.222 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.222 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:44.223 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:44.223 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:44.223 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "device_health_metrics", 2021-11-15T14:42:44.223 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 1, 2021-11-15T14:42:44.223 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:44.224 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:44.224 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 2, 2021-11-15T14:42:44.224 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:44.224 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:44.225 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:44.225 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918117376 2021-11-15T14:42:44.225 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.225 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:44.225 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:44.226 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "rbd", 2021-11-15T14:42:44.226 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 2, 2021-11-15T14:42:44.226 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:44.226 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:44.227 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:44.227 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:44.227 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:44.227 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:44.228 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918117376 2021-11-15T14:42:44.228 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.228 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:44.228 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:44.228 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "cephfs_data", 2021-11-15T14:42:44.229 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 22, 2021-11-15T14:42:44.229 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:44.229 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 0, 2021-11-15T14:42:44.229 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 0, 2021-11-15T14:42:44.230 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 0, 2021-11-15T14:42:44.230 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 0, 2021-11-15T14:42:44.230 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 0, 2021-11-15T14:42:44.230 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918117376 2021-11-15T14:42:44.231 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.231 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:44.231 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:44.231 INFO:teuthology.orchestra.run.gibba035.stdout: "name": "cephfs_metadata", 2021-11-15T14:42:44.231 INFO:teuthology.orchestra.run.gibba035.stdout: "id": 23, 2021-11-15T14:42:44.232 INFO:teuthology.orchestra.run.gibba035.stdout: "stats": { 2021-11-15T14:42:44.232 INFO:teuthology.orchestra.run.gibba035.stdout: "stored": 617, 2021-11-15T14:42:44.232 INFO:teuthology.orchestra.run.gibba035.stdout: "objects": 1, 2021-11-15T14:42:44.232 INFO:teuthology.orchestra.run.gibba035.stdout: "kb_used": 8, 2021-11-15T14:42:44.233 INFO:teuthology.orchestra.run.gibba035.stdout: "bytes_used": 8192, 2021-11-15T14:42:44.233 INFO:teuthology.orchestra.run.gibba035.stdout: "percent_used": 1.1286292789236541e-08, 2021-11-15T14:42:44.233 INFO:teuthology.orchestra.run.gibba035.stdout: "max_avail": 362918117376 2021-11-15T14:42:44.233 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.233 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:44.234 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:44.234 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:44.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 msgr2=0x7fdcf4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 0x7fdcf4055b60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fdd141477b0 tx=0x7fdd10015000).stop 2021-11-15T14:42:44.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 msgr2=0x7fdd1414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fdd140ab240 tx=0x7fdd04007ab0).stop 2021-11-15T14:42:44.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 shutdown_connections 2021-11-15T14:42:44.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf40536a0 0x7fdcf4055b60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd14148420 0x7fdd140a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdd140b1e30 0x7fdd1414e2e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 --2- 172.21.2.135:0/2613958583 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd140a7140 0x7fdd140ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.212+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 >> 172.21.2.135:0/2613958583 conn(0x7fdd1405f730 msgr2=0x7fdd140b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.216+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 shutdown_connections 2021-11-15T14:42:44.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.216+0000 7fdd1b445700 1 -- 172.21.2.135:0/2613958583 wait complete. 2021-11-15T14:42:44.239 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-11-15T14:42:44.239 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-15T14:42:44.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 Processor -- start 2021-11-15T14:42:44.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 -- start start 2021-11-15T14:42:44.296 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f68640b2930 0x7f68640b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 0x7f686413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6864062180 con 0x7f6864061da0 2021-11-15T14:42:44.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640b21d0 con 0x7f68640b2930 2021-11-15T14:42:44.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f686a185700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640b23f0 con 0x7f68640afec0 2021-11-15T14:42:44.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f6864061da0 0x7f68640af7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50342/0 (socket says 172.21.2.135:50342) 2021-11-15T14:42:44.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 -- 172.21.2.135:0/3661192126 learned_addr learned my addr 172.21.2.135:0/3661192126 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:44.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798499629 0 0) 0x7f6864062180 con 0x7f6864061da0 2021-11-15T14:42:44.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6850003260 con 0x7f6864061da0 2021-11-15T14:42:44.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f6863fff700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 0x7f686413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f6862ffd700 1 --2- 172.21.2.135:0/3661192126 >> v2:172.21.2.119:3300/0 conn(0x7f68640b2930 0x7f68640b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3666290734 0 0) 0x7f6850003260 con 0x7f6864061da0 2021-11-15T14:42:44.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 msgr2=0x7f686413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 0x7f686413cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 >> v2:172.21.2.119:3300/0 conn(0x7f68640b2930 msgr2=0x7f68640b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 --2- 172.21.2.135:0/3661192126 >> v2:172.21.2.119:3300/0 conn(0x7f68640b2930 0x7f68640b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640b2690 con 0x7f6864061da0 2021-11-15T14:42:44.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6858001680 con 0x7f6864061da0 2021-11-15T14:42:44.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 >> v1:172.21.2.135:6789/0 conn(0x7f6864061da0 legacy=0x7f68640af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6850003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6850004500 0x7f6850004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 0x7f6850004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640b21d0 con 0x7f6850004500 2021-11-15T14:42:44.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640b23f0 con 0x7f68500037d0 2021-11-15T14:42:44.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685000b900 con 0x7f68640afec0 2021-11-15T14:42:44.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6850003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 -- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 msgr2=0x7f6850004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68640afec0 0x7f6850004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 -- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6850004500 msgr2=0x7f6850004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6850004500 0x7f6850004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.288+0000 7f68637fe700 1 -- 172.21.2.135:0/3661192126 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850003260 con 0x7f68500037d0 2021-11-15T14:42:44.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6850003bf0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f6858001390 tx=0x7f68640b3e50).ready entity=mon.1 client_cookie=aaab85c89b0d01b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6858007360 con 0x7f68500037d0 2021-11-15T14:42:44.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580074c0 con 0x7f68500037d0 2021-11-15T14:42:44.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68627fc700 1 -- 172.21.2.135:0/3661192126 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685800cbb0 con 0x7f68500037d0 2021-11-15T14:42:44.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/3661192126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 msgr2=0x7f6850003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 --2- 172.21.2.135:0/3661192126 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6850003bf0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f6858001390 tx=0x7f68640b3e50).stop 2021-11-15T14:42:44.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6863fff700 1 -- 172.21.2.135:0/3661192126 reap_dead start 2021-11-15T14:42:44.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/3661192126 shutdown_connections 2021-11-15T14:42:44.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/3661192126 >> 172.21.2.135:0/3661192126 conn(0x7f6864063a30 msgr2=0x7f6864063e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/3661192126 shutdown_connections 2021-11-15T14:42:44.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/3661192126 wait complete. 2021-11-15T14:42:44.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 Processor -- start 2021-11-15T14:42:44.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- start start 2021-11-15T14:42:44.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6864143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6864065970 0x7f686414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f686413bfa0 0x7f686413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641464c0 con 0x7f6864065970 2021-11-15T14:42:44.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640670f0 con 0x7f68500037d0 2021-11-15T14:42:44.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6864067350 con 0x7f686413bfa0 2021-11-15T14:42:44.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6864143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6864143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34534/0 (socket says 172.21.2.135:34534) 2021-11-15T14:42:44.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 -- 172.21.2.135:0/2600602093 learned_addr learned my addr 172.21.2.135:0/2600602093 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 -- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f686413bfa0 msgr2=0x7f686413c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f686413bfa0 0x7f686413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 -- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6864065970 msgr2=0x7f686414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6864065970 0x7f686414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 -- 172.21.2.135:0/2600602093 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640675f0 con 0x7f68500037d0 2021-11-15T14:42:44.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f68637fe700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68500037d0 0x7f6864143570 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f6858001390 tx=0x7f6858015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6858004730 con 0x7f68500037d0 2021-11-15T14:42:44.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858004890 con 0x7f68500037d0 2021-11-15T14:42:44.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/2600602093 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6864067890 con 0x7f68500037d0 2021-11-15T14:42:44.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6858004bf0 con 0x7f68500037d0 2021-11-15T14:42:44.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/2600602093 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864064710 con 0x7f68500037d0 2021-11-15T14:42:44.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f686a185700 1 -- 172.21.2.135:0/2600602093 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864067a20 con 0x7f68500037d0 2021-11-15T14:42:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6858004d50 con 0x7f68500037d0 2021-11-15T14:42:44.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6844053610 0x7f6844055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.292+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f685806ee00 con 0x7f68500037d0 2021-11-15T14:42:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.296+0000 7f6862ffd700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6844053610 0x7f6844055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.296+0000 7f6862ffd700 1 --2- 172.21.2.135:0/2600602093 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6844053610 0x7f6844055ad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f685c00a000 tx=0x7f685c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.296+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6858045cf0 con 0x7f68500037d0 2021-11-15T14:42:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.404+0000 7f686a185700 1 -- 172.21.2.135:0/2600602093 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68640af070 con 0x7f68500037d0 2021-11-15T14:42:44.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.408+0000 7f6860ff9700 1 -- 172.21.2.135:0/2600602093 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v61) v1 ==== 209+0+0 (secure 0 0 0) 0x7f6858017070 con 0x7f68500037d0 2021-11-15T14:42:44.411 INFO:teuthology.orchestra.run.gibba035.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-11-15T14:42:44.413 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-11-15T14:42:44.414 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:42:44.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 Processor -- start 2021-11-15T14:42:44.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- start start 2021-11-15T14:42:44.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffabc0b1e30 0x7ffabc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0b03d0 con 0x7ffabc148420 2021-11-15T14:42:44.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0b0670 con 0x7ffabc0a7140 2021-11-15T14:42:44.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0a9140 con 0x7ffabc0b1e30 2021-11-15T14:42:44.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffabc0b1e30 0x7ffabc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffabc0b1e30 0x7ffabc0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34542/0 (socket says 172.21.2.135:34542) 2021-11-15T14:42:44.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 -- 172.21.2.135:0/441981158 learned_addr learned my addr 172.21.2.135:0/441981158 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 -- 172.21.2.135:0/441981158 >> v1:172.21.2.135:6789/0 conn(0x7ffabc0a7140 legacy=0x7ffabc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 -- 172.21.2.135:0/441981158 >> v1:172.21.2.119:6789/0 conn(0x7ffabc148420 legacy=0x7ffabc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 -- 172.21.2.135:0/441981158 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0b0910 con 0x7ffabc0b1e30 2021-11-15T14:42:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffabaffd700 1 --2- 172.21.2.135:0/441981158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0b1e30 0x7ffabc0b1050 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7ffabc1477b0 tx=0x7ffaac006eb0).ready entity=mon.1 client_cookie=fb93e4456695f15 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffab9ffb700 1 -- 172.21.2.135:0/441981158 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac00d5c0 con 0x7ffabc0b1e30 2021-11-15T14:42:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffab9ffb700 1 -- 172.21.2.135:0/441981158 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac000e90 con 0x7ffabc0b1e30 2021-11-15T14:42:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffab9ffb700 1 -- 172.21.2.135:0/441981158 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac00d950 con 0x7ffabc0b1e30 2021-11-15T14:42:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- 172.21.2.135:0/441981158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0b1e30 msgr2=0x7ffabc0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 --2- 172.21.2.135:0/441981158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0b1e30 0x7ffabc0b1050 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7ffabc1477b0 tx=0x7ffaac006eb0).stop 2021-11-15T14:42:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- 172.21.2.135:0/441981158 shutdown_connections 2021-11-15T14:42:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 --2- 172.21.2.135:0/441981158 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0b1e30 0x7ffabc0b1050 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- 172.21.2.135:0/441981158 >> 172.21.2.135:0/441981158 conn(0x7ffabc05f730 msgr2=0x7ffabc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- 172.21.2.135:0/441981158 shutdown_connections 2021-11-15T14:42:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.464+0000 7ffac1647700 1 -- 172.21.2.135:0/441981158 wait complete. 2021-11-15T14:42:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 Processor -- start 2021-11-15T14:42:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- start start 2021-11-15T14:42:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffabc0b1e30 0x7ffabc066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffabc148420 0x7ffabc066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc067450 con 0x7ffabc148420 2021-11-15T14:42:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0676a0 con 0x7ffabc0a7140 2021-11-15T14:42:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc156ac0 con 0x7ffabc0b1e30 2021-11-15T14:42:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34548/0 (socket says 172.21.2.135:34548) 2021-11-15T14:42:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 -- 172.21.2.135:0/3305231961 learned_addr learned my addr 172.21.2.135:0/3305231961 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 -- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffabc0b1e30 msgr2=0x7ffabc066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffabc0b1e30 0x7ffabc066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 -- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffabc148420 msgr2=0x7ffabc066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffabc148420 0x7ffabc066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 -- 172.21.2.135:0/3305231961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac00b1e0 con 0x7ffabc0a7140 2021-11-15T14:42:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffabaffd700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7ffabc1477b0 tx=0x7ffaac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac002f50 con 0x7ffabc0a7140 2021-11-15T14:42:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00de10 con 0x7ffabc0a7140 2021-11-15T14:42:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc156d60 con 0x7ffabc0a7140 2021-11-15T14:42:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaac01e460 con 0x7ffabc0a7140 2021-11-15T14:42:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc0ac300 con 0x7ffabc0a7140 2021-11-15T14:42:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc156ef0 con 0x7ffabc0a7140 2021-11-15T14:42:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffaac025030 con 0x7ffabc0a7140 2021-11-15T14:42:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 0x7ffa98055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6418+0+0 (secure 0 0 0) 0x7ffaac06cd50 con 0x7ffabc0a7140 2021-11-15T14:42:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.468+0000 7ffaba7fc700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 0x7ffa98055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.472+0000 7ffaba7fc700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 0x7ffa98055b90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ffab0002ef0 tx=0x7ffab0006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.472+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffaac043d90 con 0x7ffabc0a7140 2021-11-15T14:42:44.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.580+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ffabc0b0bb0 con 0x7ffabc0a7140 2021-11-15T14:42:44.585 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:42:44.580+0000 7f4710af5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:42:44.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.592+0000 7ffaabfff700 1 -- 172.21.2.135:0/3305231961 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v62) v1 ==== 189+0+0 (secure 0 0 0) 0x7ffaac023070 con 0x7ffabc0a7140 2021-11-15T14:42:44.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 msgr2=0x7ffa98055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 0x7ffa98055b90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ffab0002ef0 tx=0x7ffab0006910).stop 2021-11-15T14:42:44.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 msgr2=0x7ffabc157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7ffabc1477b0 tx=0x7ffaac015000).stop 2021-11-15T14:42:44.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 shutdown_connections 2021-11-15T14:42:44.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffa980536d0 0x7ffa98055b90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffabc148420 0x7ffabc066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffabc0b1e30 0x7ffabc066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 --2- 172.21.2.135:0/3305231961 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffabc0a7140 0x7ffabc157200 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 >> 172.21.2.135:0/3305231961 conn(0x7ffabc05f730 msgr2=0x7ffabc144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 shutdown_connections 2021-11-15T14:42:44.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.596+0000 7ffac1647700 1 -- 172.21.2.135:0/3305231961 wait complete. 2021-11-15T14:42:44.602 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 23 and data pool 22 2021-11-15T14:42:44.605 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:42:44.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 Processor -- start 2021-11-15T14:42:44.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 -- start start 2021-11-15T14:42:44.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5f58060040 0x7f5f58064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580b4eb0 con 0x7f5f580b3950 2021-11-15T14:42:44.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580b2430 con 0x7f5f580b2ca0 2021-11-15T14:42:44.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5e9d0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580b26d0 con 0x7f5f58060040 2021-11-15T14:42:44.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f57fff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5f58060040 0x7f5f58064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5cf6d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5f580b2ca0 0x7f5f580b47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50380/0 (socket says 172.21.2.135:50380) 2021-11-15T14:42:44.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.652+0000 7f5f5cf6d700 1 -- 172.21.2.135:0/1279098729 learned_addr learned my addr 172.21.2.135:0/1279098729 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:44.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f57fff700 1 -- 172.21.2.135:0/1279098729 >> v1:172.21.2.135:6789/0 conn(0x7f5f580b2ca0 legacy=0x7f5f580b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f57fff700 1 -- 172.21.2.135:0/1279098729 >> v1:172.21.2.119:6789/0 conn(0x7f5f580b3950 legacy=0x7f5f580b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:44.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f57fff700 1 -- 172.21.2.135:0/1279098729 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580b2970 con 0x7f5f58060040 2021-11-15T14:42:44.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f57fff700 1 --2- 172.21.2.135:0/1279098729 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f58060040 0x7f5f58064d90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f5f5813b870 tx=0x7f5f48006df0).ready entity=mon.1 client_cookie=f6927773b97ab297 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f56ffd700 1 -- 172.21.2.135:0/1279098729 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f4800d5c0 con 0x7f5f58060040 2021-11-15T14:42:44.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f56ffd700 1 -- 172.21.2.135:0/1279098729 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48000e90 con 0x7f5f58060040 2021-11-15T14:42:44.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f56ffd700 1 -- 172.21.2.135:0/1279098729 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f4800d910 con 0x7f5f58060040 2021-11-15T14:42:44.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/1279098729 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f58060040 msgr2=0x7f5f58064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/1279098729 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f58060040 0x7f5f58064d90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f5f5813b870 tx=0x7f5f48006df0).stop 2021-11-15T14:42:44.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/1279098729 shutdown_connections 2021-11-15T14:42:44.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/1279098729 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f58060040 0x7f5f58064d90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:44.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/1279098729 >> 172.21.2.135:0/1279098729 conn(0x7f5f5805cfe0 msgr2=0x7f5f5805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:44.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/1279098729 shutdown_connections 2021-11-15T14:42:44.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/1279098729 wait complete. 2021-11-15T14:42:44.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 Processor -- start 2021-11-15T14:42:44.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- start start 2021-11-15T14:42:44.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f58060040 0x7f5f580b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f580b2ca0 0x7f5f5813a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5813d970 con 0x7f5f580b2ca0 2021-11-15T14:42:44.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580b1350 con 0x7f5f580b3950 2021-11-15T14:42:44.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580b0830 con 0x7f5f58060040 2021-11-15T14:42:44.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34566/0 (socket says 172.21.2.135:34566) 2021-11-15T14:42:44.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 -- 172.21.2.135:0/2004985123 learned_addr learned my addr 172.21.2.135:0/2004985123 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:44.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 -- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f58060040 msgr2=0x7f5f580b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f58060040 0x7f5f580b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 -- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f580b2ca0 msgr2=0x7f5f5813a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:44.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f580b2ca0 0x7f5f5813a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:44.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 -- 172.21.2.135:0/2004985123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4800b180 con 0x7f5f580b3950 2021-11-15T14:42:44.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5cf6d700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f5f5805d4e0 tx=0x7f5f50007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f50005ba0 con 0x7f5f580b3950 2021-11-15T14:42:44.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50005d00 con 0x7f5f580b3950 2021-11-15T14:42:44.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f500072c0 con 0x7f5f580b3950 2021-11-15T14:42:44.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5813af50 con 0x7f5f580b3950 2021-11-15T14:42:44.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.656+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f580b0a90 con 0x7f5f580b3950 2021-11-15T14:42:44.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f580648f0 con 0x7f5f580b3950 2021-11-15T14:42:44.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f50010070 con 0x7f5f580b3950 2021-11-15T14:42:44.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f557fa700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 0x7f5f3c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:44.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f5f5006b430 con 0x7f5f580b3950 2021-11-15T14:42:44.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f57fff700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 0x7f5f3c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:44.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f57fff700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 0x7f5f3c055a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f5f5813b870 tx=0x7f5f48012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:44.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.660+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f50042380 con 0x7f5f580b3950 2021-11-15T14:42:44.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:44.772+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5f580573d0 con 0x7f5f580b3950 2021-11-15T14:42:45.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.596+0000 7f5f557fa700 1 -- 172.21.2.135:0/2004985123 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f50018020 con 0x7f5f580b3950 2021-11-15T14:42:45.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 msgr2=0x7f5f3c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 0x7f5f3c055a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f5f5813b870 tx=0x7f5f48012000).stop 2021-11-15T14:42:45.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 msgr2=0x7f5f5813aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f5f5805d4e0 tx=0x7f5f50007f00).stop 2021-11-15T14:42:45.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 shutdown_connections 2021-11-15T14:42:45.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f3c053580 0x7f5f3c055a40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:45.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f580b3950 0x7f5f5813aa60 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:45.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f580b2ca0 0x7f5f5813a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:45.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 --2- 172.21.2.135:0/2004985123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f58060040 0x7f5f580b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:45.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 >> 172.21.2.135:0/2004985123 conn(0x7f5f5805cfe0 msgr2=0x7f5f58141f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:45.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 shutdown_connections 2021-11-15T14:42:45.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.600+0000 7f5f5e9d0700 1 -- 172.21.2.135:0/2004985123 wait complete. 2021-11-15T14:42:45.609 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:42:45.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 Processor -- start 2021-11-15T14:42:45.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- start start 2021-11-15T14:42:45.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c060180 0x7f760c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:45.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0aac30 con 0x7f760c067380 2021-11-15T14:42:45.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c060560 con 0x7f760c0b4cc0 2021-11-15T14:42:45.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c066f20 con 0x7f760c060180 2021-11-15T14:42:45.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c060180 0x7f760c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:45.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c060180 0x7f760c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34570/0 (socket says 172.21.2.135:34570) 2021-11-15T14:42:45.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 -- 172.21.2.135:0/3562958069 learned_addr learned my addr 172.21.2.135:0/3562958069 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:45.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760b59e700 1 --1- 172.21.2.135:0/3562958069 >> v1:172.21.2.135:6789/0 conn(0x7f760c0b4cc0 0x7f760c14b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50394/0 (socket says 172.21.2.135:50394) 2021-11-15T14:42:45.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 -- 172.21.2.135:0/3562958069 >> v1:172.21.2.135:6789/0 conn(0x7f760c0b4cc0 legacy=0x7f760c14b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 -- 172.21.2.135:0/3562958069 >> v1:172.21.2.119:6789/0 conn(0x7f760c067380 legacy=0x7f760c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:45.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 -- 172.21.2.135:0/3562958069 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0b3430 con 0x7f760c060180 2021-11-15T14:42:45.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f760ad9d700 1 --2- 172.21.2.135:0/3562958069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c060180 0x7f760c0b47d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f760c05f260 tx=0x7f75fc006eb0).ready entity=mon.1 client_cookie=c7da94861f32de39 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:45.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7609d9b700 1 -- 172.21.2.135:0/3562958069 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d610 con 0x7f760c060180 2021-11-15T14:42:45.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7609d9b700 1 -- 172.21.2.135:0/3562958069 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc000e90 con 0x7f760c060180 2021-11-15T14:42:45.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7609d9b700 1 -- 172.21.2.135:0/3562958069 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d960 con 0x7f760c060180 2021-11-15T14:42:45.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- 172.21.2.135:0/3562958069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c060180 msgr2=0x7f760c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 --2- 172.21.2.135:0/3562958069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c060180 0x7f760c0b47d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f760c05f260 tx=0x7f75fc006eb0).stop 2021-11-15T14:42:45.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- 172.21.2.135:0/3562958069 shutdown_connections 2021-11-15T14:42:45.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 --2- 172.21.2.135:0/3562958069 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c060180 0x7f760c0b47d0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:45.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- 172.21.2.135:0/3562958069 >> 172.21.2.135:0/3562958069 conn(0x7f760c05cfb0 msgr2=0x7f760c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:45.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- 172.21.2.135:0/3562958069 shutdown_connections 2021-11-15T14:42:45.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- 172.21.2.135:0/3562958069 wait complete. 2021-11-15T14:42:45.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 Processor -- start 2021-11-15T14:42:45.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.660+0000 7f7611040700 1 -- start start 2021-11-15T14:42:45.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 0x7f760c0a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:45.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c067380 0x7f760c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:45.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:45.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09f340 con 0x7f760c060180 2021-11-15T14:42:45.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09f7d0 con 0x7f760c0b4cc0 2021-11-15T14:42:45.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09f530 con 0x7f760c067380 2021-11-15T14:42:45.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:45.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34578/0 (socket says 172.21.2.135:34578) 2021-11-15T14:42:45.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 -- 172.21.2.135:0/2920703605 learned_addr learned my addr 172.21.2.135:0/2920703605 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:45.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 -- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c067380 msgr2=0x7f760c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c067380 0x7f760c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:45.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 -- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 msgr2=0x7f760c0a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:45.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760ad9d700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 0x7f760c0a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:45.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 0x7f760c0a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:45.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 -- 172.21.2.135:0/2920703605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc00b1e0 con 0x7f760c0b4cc0 2021-11-15T14:42:45.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760ad9d700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 0x7f760c0a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:45.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760b59e700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f760c05f2a0 tx=0x7f7604007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:45.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604005ae0 con 0x7f760c0b4cc0 2021-11-15T14:42:45.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604005c40 con 0x7f760c0b4cc0 2021-11-15T14:42:45.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76040070d0 con 0x7f760c0b4cc0 2021-11-15T14:42:45.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0ad4d0 con 0x7f760c0b4cc0 2021-11-15T14:42:45.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0ad970 con 0x7f760c0b4cc0 2021-11-15T14:42:45.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0ad660 con 0x7f760c0b4cc0 2021-11-15T14:42:45.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7604010070 con 0x7f760c0b4cc0 2021-11-15T14:42:45.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 0x7f75f0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:45.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f760406b390 con 0x7f760c0b4cc0 2021-11-15T14:42:45.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760ad9d700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 0x7f75f0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:45.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.664+0000 7f760ad9d700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 0x7f75f0055a70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f75fc017000 tx=0x7f75fc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:45.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.668+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7604042340 con 0x7f760c0b4cc0 2021-11-15T14:42:45.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:45.748+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f760c0573d0 con 0x7f760c0b4cc0 2021-11-15T14:42:46.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.604+0000 7f7603fff700 1 -- 172.21.2.135:0/2920703605 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7604018070 con 0x7f760c0b4cc0 2021-11-15T14:42:46.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 msgr2=0x7f75f0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:46.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 0x7f75f0055a70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f75fc017000 tx=0x7f75fc015000).stop 2021-11-15T14:42:46.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 msgr2=0x7f760c150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:46.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f760c05f2a0 tx=0x7f7604007f00).stop 2021-11-15T14:42:46.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 shutdown_connections 2021-11-15T14:42:46.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75f00535b0 0x7f75f0055a70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:46.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b4cc0 0x7f760c150be0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:46.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c067380 0x7f760c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:46.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 --2- 172.21.2.135:0/2920703605 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c060180 0x7f760c0a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:46.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 >> 172.21.2.135:0/2920703605 conn(0x7f760c05cfb0 msgr2=0x7f760c0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:46.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 shutdown_connections 2021-11-15T14:42:46.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.608+0000 7f7611040700 1 -- 172.21.2.135:0/2920703605 wait complete. 2021-11-15T14:42:46.616 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:42:46.625 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:42:46.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 Processor -- start 2021-11-15T14:42:46.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- start start 2021-11-15T14:42:46.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f57100b1350 0x7f57100b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57100b2320 0x7f57101412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57100a7850 con 0x7f57100b1f40 2021-11-15T14:42:46.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57100b17c0 con 0x7f57100b1350 2021-11-15T14:42:46.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57100b06d0 con 0x7f57100b2320 2021-11-15T14:42:46.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57100b2320 0x7f57101412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:46.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57100b2320 0x7f57101412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34586/0 (socket says 172.21.2.135:34586) 2021-11-15T14:42:46.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 -- 172.21.2.135:0/1560368818 learned_addr learned my addr 172.21.2.135:0/1560368818 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:46.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 -- 172.21.2.135:0/1560368818 >> v2:172.21.2.119:3300/0 conn(0x7f57100b1350 msgr2=0x7f57100b0030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:46.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 --2- 172.21.2.135:0/1560368818 >> v2:172.21.2.119:3300/0 conn(0x7f57100b1350 0x7f57100b0030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:46.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 -- 172.21.2.135:0/1560368818 >> v1:172.21.2.135:6789/0 conn(0x7f57100b1f40 legacy=0x7f57100a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:46.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 -- 172.21.2.135:0/1560368818 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100b0970 con 0x7f57100b2320 2021-11-15T14:42:46.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570ed9d700 1 --2- 172.21.2.135:0/1560368818 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b2320 0x7f57101412d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f57080032f0 tx=0x7f5708009290).ready entity=mon.1 client_cookie=f5ef53198eb7e046 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:46.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570d59a700 1 -- 172.21.2.135:0/1560368818 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570800b870 con 0x7f57100b2320 2021-11-15T14:42:46.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570d59a700 1 -- 172.21.2.135:0/1560368818 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800b9d0 con 0x7f57100b2320 2021-11-15T14:42:46.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570d59a700 1 -- 172.21.2.135:0/1560368818 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570800bb80 con 0x7f57100b2320 2021-11-15T14:42:46.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- 172.21.2.135:0/1560368818 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b2320 msgr2=0x7f57101412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:46.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- 172.21.2.135:0/1560368818 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b2320 0x7f57101412d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f57080032f0 tx=0x7f5708009290).stop 2021-11-15T14:42:46.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- 172.21.2.135:0/1560368818 shutdown_connections 2021-11-15T14:42:46.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- 172.21.2.135:0/1560368818 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b2320 0x7f57101412d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:46.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- 172.21.2.135:0/1560368818 >> v2:172.21.2.119:3300/0 conn(0x7f57100b1350 0x7f57100b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:46.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- 172.21.2.135:0/1560368818 >> 172.21.2.135:0/1560368818 conn(0x7f571005f730 msgr2=0x7f571005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:46.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- 172.21.2.135:0/1560368818 shutdown_connections 2021-11-15T14:42:46.696 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- 172.21.2.135:0/1560368818 wait complete. 2021-11-15T14:42:46.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 Processor -- start 2021-11-15T14:42:46.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- start start 2021-11-15T14:42:46.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57100b1f40 0x7f571015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57100b2320 0x7f571015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100b0320 con 0x7f57100b2320 2021-11-15T14:42:46.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100afc50 con 0x7f57100b1350 2021-11-15T14:42:46.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f5714a21700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57100ada40 con 0x7f57100b1f40 2021-11-15T14:42:46.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:46.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34592/0 (socket says 172.21.2.135:34592) 2021-11-15T14:42:46.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 -- 172.21.2.135:0/1958333162 learned_addr learned my addr 172.21.2.135:0/1958333162 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:46.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 -- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57100b1f40 msgr2=0x7f571015a4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:46.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57100b1f40 0x7f571015a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:46.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 -- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57100b2320 msgr2=0x7f571015a9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:46.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57100b2320 0x7f571015a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:46.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.676+0000 7f570e59c700 1 -- 172.21.2.135:0/1958333162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5708009530 con 0x7f57100b1350 2021-11-15T14:42:46.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f570e59c700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f57100aee00 tx=0x7f5700007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:46.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570000ce20 con 0x7f57100b1350 2021-11-15T14:42:46.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570000f470 con 0x7f57100b1350 2021-11-15T14:42:46.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57100ad4c0 con 0x7f57100b1350 2021-11-15T14:42:46.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570000f7d0 con 0x7f57100b1350 2021-11-15T14:42:46.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571015aea0 con 0x7f57100b1350 2021-11-15T14:42:46.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57100573d0 con 0x7f57100b1350 2021-11-15T14:42:46.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5700019030 con 0x7f57100b1350 2021-11-15T14:42:46.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 0x7f56ec0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:46.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f570006ad90 con 0x7f57100b1350 2021-11-15T14:42:46.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f570dd9b700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 0x7f56ec0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:46.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f570dd9b700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 0x7f56ec0559b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f5704002fb0 tx=0x7f5704006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:46.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.680+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5700041f00 con 0x7f57100b1350 2021-11-15T14:42:46.768 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:46.764+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f57100ac7e0 con 0x7f57100b1350 2021-11-15T14:42:47.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.608+0000 7f56ff7fe700 1 -- 172.21.2.135:0/1958333162 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v135) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5700045520 con 0x7f57100b1350 2021-11-15T14:42:47.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 msgr2=0x7f56ec0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 0x7f56ec0559b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f5704002fb0 tx=0x7f5704006930).stop 2021-11-15T14:42:47.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 msgr2=0x7f57100b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f57100aee00 tx=0x7f5700007c50).stop 2021-11-15T14:42:47.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 shutdown_connections 2021-11-15T14:42:47.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ec0534f0 0x7f56ec0559b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:47.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57100b2320 0x7f571015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57100b1f40 0x7f571015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 --2- 172.21.2.135:0/1958333162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57100b1350 0x7f57100b4e10 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 >> 172.21.2.135:0/1958333162 conn(0x7f571005f730 msgr2=0x7f571013ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 shutdown_connections 2021-11-15T14:42:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.612+0000 7f5714a21700 1 -- 172.21.2.135:0/1958333162 wait complete. 2021-11-15T14:42:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:42:47.621 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-15T14:42:47.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 Processor -- start 2021-11-15T14:42:47.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- start start 2021-11-15T14:42:47.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fac30144420 0x7fac300648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:47.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac30065420 con 0x7fac300b3920 2021-11-15T14:42:47.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300b3150 con 0x7fac3013e4e0 2021-11-15T14:42:47.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac30066050 con 0x7fac30144420 2021-11-15T14:42:47.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fac3013e4e0 0x7fac300b75b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50418/0 (socket says 172.21.2.135:50418) 2021-11-15T14:42:47.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 -- 172.21.2.135:0/3589476643 learned_addr learned my addr 172.21.2.135:0/3589476643 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:47.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2f7fe700 1 --2- 172.21.2.135:0/3589476643 >> v2:172.21.2.135:3300/0 conn(0x7fac30144420 0x7fac300648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:47.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592115191 0 0) 0x7fac300b3150 con 0x7fac3013e4e0 2021-11-15T14:42:47.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac10003260 con 0x7fac3013e4e0 2021-11-15T14:42:47.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2f7fe700 1 -- 172.21.2.135:0/3589476643 >> v1:172.21.2.135:6789/0 conn(0x7fac3013e4e0 legacy=0x7fac300b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2f7fe700 1 -- 172.21.2.135:0/3589476643 >> v1:172.21.2.119:6789/0 conn(0x7fac300b3920 legacy=0x7fac30066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:47.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006664733 0 0) 0x7fac10003260 con 0x7fac3013e4e0 2021-11-15T14:42:47.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2f7fe700 1 -- 172.21.2.135:0/3589476643 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300b7cc0 con 0x7fac30144420 2021-11-15T14:42:47.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2f7fe700 1 --2- 172.21.2.135:0/3589476643 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac30144420 0x7fac300648f0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fac30067820 tx=0x7fac280091d0).ready entity=mon.1 client_cookie=56feeaed97e912b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:47.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac18001660 con 0x7fac30144420 2021-11-15T14:42:47.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800b580 con 0x7fac30144420 2021-11-15T14:42:47.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2dffb700 1 -- 172.21.2.135:0/3589476643 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2800b6f0 con 0x7fac30144420 2021-11-15T14:42:47.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- 172.21.2.135:0/3589476643 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac30144420 msgr2=0x7fac300648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- 172.21.2.135:0/3589476643 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac30144420 0x7fac300648f0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fac30067820 tx=0x7fac280091d0).stop 2021-11-15T14:42:47.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- 172.21.2.135:0/3589476643 shutdown_connections 2021-11-15T14:42:47.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- 172.21.2.135:0/3589476643 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac30144420 0x7fac300648f0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:47.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- 172.21.2.135:0/3589476643 >> 172.21.2.135:0/3589476643 conn(0x7fac30062a50 msgr2=0x7fac30062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:47.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- 172.21.2.135:0/3589476643 shutdown_connections 2021-11-15T14:42:47.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- 172.21.2.135:0/3589476643 wait complete. 2021-11-15T14:42:47.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 Processor -- start 2021-11-15T14:42:47.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- start start 2021-11-15T14:42:47.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:47.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac3013e4e0 0x7fac3013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:47.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac30144420 0x7fac300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:47.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300aeda0 con 0x7fac3013e4e0 2021-11-15T14:42:47.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300b5e20 con 0x7fac300b3920 2021-11-15T14:42:47.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac35279700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300b5b80 con 0x7fac30144420 2021-11-15T14:42:47.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34604/0 (socket says 172.21.2.135:34604) 2021-11-15T14:42:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 -- 172.21.2.135:0/169104235 learned_addr learned my addr 172.21.2.135:0/169104235 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 -- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac30144420 msgr2=0x7fac300b0510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:47.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac30144420 0x7fac300b0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 -- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac3013e4e0 msgr2=0x7fac3013db50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac3013e4e0 0x7fac3013db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.672+0000 7fac2effd700 1 -- 172.21.2.135:0/169104235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009470 con 0x7fac300b3920 2021-11-15T14:42:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac2effd700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fac300b0120 tx=0x7fac180011a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:47.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac18007170 con 0x7fac300b3920 2021-11-15T14:42:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180072d0 con 0x7fac300b3920 2021-11-15T14:42:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac300aeb00 con 0x7fac300b3920 2021-11-15T14:42:47.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300b76b0 con 0x7fac300b3920 2021-11-15T14:42:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac18004920 con 0x7fac300b3920 2021-11-15T14:42:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac08003410 con 0x7fac300b3920 2021-11-15T14:42:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac1801b070 con 0x7fac300b3920 2021-11-15T14:42:47.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 0x7fac14055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fac1806b520 con 0x7fac300b3920 2021-11-15T14:42:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac2e7fc700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 0x7fac14055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac2e7fc700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 0x7fac14055b20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fac20002f90 tx=0x7fac20006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:47.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.676+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac18042410 con 0x7fac300b3920 2021-11-15T14:42:47.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.788+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac08003c40 con 0x7fac300b3920 2021-11-15T14:42:47.793 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:42:47.788+0000 7f4710af5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:42:47.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.800+0000 7fac27fff700 1 -- 172.21.2.135:0/169104235 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7fac18045a30 con 0x7fac300b3920 2021-11-15T14:42:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 msgr2=0x7fac14055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 0x7fac14055b20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fac20002f90 tx=0x7fac20006930).stop 2021-11-15T14:42:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 msgr2=0x7fac300b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:47.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fac300b0120 tx=0x7fac180011a0).stop 2021-11-15T14:42:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 shutdown_connections 2021-11-15T14:42:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fac14053660 0x7fac14055b20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fac30144420 0x7fac300b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fac3013e4e0 0x7fac3013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 --2- 172.21.2.135:0/169104235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fac300b3920 0x7fac300b71c0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 >> 172.21.2.135:0/169104235 conn(0x7fac30062a50 msgr2=0x7fac3013f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 shutdown_connections 2021-11-15T14:42:47.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:47.804+0000 7fac35279700 1 -- 172.21.2.135:0/169104235 wait complete. 2021-11-15T14:42:47.810 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 24 and data pool 22 2021-11-15T14:42:47.813 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:42:47.814 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:47.821 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:47.835 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:47.844 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:47.857 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:42:47.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:47.858 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:47.858 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:47.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:47.862 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:42:47.863 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:47.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:47.864 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:47.913 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:42:47.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:47.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:47.915 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:47.915 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:47.924 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:42:47.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:47.926 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:47.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:42:47.927 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:47.976 INFO:teuthology.orchestra.run.gibba032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:42:47.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:47.978 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:42:48.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 Processor -- start 2021-11-15T14:42:48.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 -- start start 2021-11-15T14:42:48.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd3800b1e30 0x7fd3800b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd380148420 0x7fd3800b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3800b03d0 con 0x7fd3800a7140 2021-11-15T14:42:48.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800a9140 con 0x7fd3800b1e30 2021-11-15T14:42:48.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd387256700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3800b0670 con 0x7fd380148420 2021-11-15T14:42:48.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd380148420 0x7fd3800b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd380148420 0x7fd3800b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34614/0 (socket says 172.21.2.135:34614) 2021-11-15T14:42:48.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 -- 172.21.2.135:0/531171595 learned_addr learned my addr 172.21.2.135:0/531171595 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 -- 172.21.2.135:0/531171595 >> v2:172.21.2.119:3300/0 conn(0x7fd3800b1e30 msgr2=0x7fd3800b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:48.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 --2- 172.21.2.135:0/531171595 >> v2:172.21.2.119:3300/0 conn(0x7fd3800b1e30 0x7fd3800b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 -- 172.21.2.135:0/531171595 >> v1:172.21.2.135:6789/0 conn(0x7fd3800a7140 legacy=0x7fd3801447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 -- 172.21.2.135:0/531171595 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800b0910 con 0x7fd380148420 2021-11-15T14:42:48.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37ffff700 1 --2- 172.21.2.135:0/531171595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd380148420 0x7fd3800b2210 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fd3801477b0 tx=0x7fd370006eb0).ready entity=mon.1 client_cookie=9a92c752ca6f8117 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37f7fe700 1 -- 172.21.2.135:0/531171595 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37000d610 con 0x7fd380148420 2021-11-15T14:42:48.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37f7fe700 1 -- 172.21.2.135:0/531171595 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370000e90 con 0x7fd380148420 2021-11-15T14:42:48.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.028+0000 7fd37f7fe700 1 -- 172.21.2.135:0/531171595 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37000d960 con 0x7fd380148420 2021-11-15T14:42:48.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/531171595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd380148420 msgr2=0x7fd3800b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- 172.21.2.135:0/531171595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd380148420 0x7fd3800b2210 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fd3801477b0 tx=0x7fd370006eb0).stop 2021-11-15T14:42:48.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/531171595 shutdown_connections 2021-11-15T14:42:48.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- 172.21.2.135:0/531171595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd380148420 0x7fd3800b2210 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- 172.21.2.135:0/531171595 >> v2:172.21.2.119:3300/0 conn(0x7fd3800b1e30 0x7fd3800b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/531171595 >> 172.21.2.135:0/531171595 conn(0x7fd38005f730 msgr2=0x7fd38005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:48.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/531171595 shutdown_connections 2021-11-15T14:42:48.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/531171595 wait complete. 2021-11-15T14:42:48.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 Processor -- start 2021-11-15T14:42:48.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- start start 2021-11-15T14:42:48.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3800a7140 0x7fd3800aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd380148420 0x7fd38014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800a9930 con 0x7fd3800a7140 2021-11-15T14:42:48.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800ab630 con 0x7fd3800b1e30 2021-11-15T14:42:48.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd380157d40 con 0x7fd380148420 2021-11-15T14:42:48.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34622/0 (socket says 172.21.2.135:34622) 2021-11-15T14:42:48.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 -- 172.21.2.135:0/865002316 learned_addr learned my addr 172.21.2.135:0/865002316 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 -- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd380148420 msgr2=0x7fd38014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd380148420 0x7fd38014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 -- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3800a7140 msgr2=0x7fd3800aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3800a7140 0x7fd3800aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 -- 172.21.2.135:0/865002316 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37000b1e0 con 0x7fd3800b1e30 2021-11-15T14:42:48.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37ffff700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fd3801477b0 tx=0x7fd370015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd370011930 con 0x7fd3800b1e30 2021-11-15T14:42:48.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370011a90 con 0x7fd3800b1e30 2021-11-15T14:42:48.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3800ab860 con 0x7fd3800b1e30 2021-11-15T14:42:48.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3800abfa0 con 0x7fd3800b1e30 2021-11-15T14:42:48.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd370011df0 con 0x7fd3800b1e30 2021-11-15T14:42:48.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800b0bb0 con 0x7fd3800b1e30 2021-11-15T14:42:48.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd370025030 con 0x7fd3800b1e30 2021-11-15T14:42:48.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 0x7fd364055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd37006cd60 con 0x7fd3800b1e30 2021-11-15T14:42:48.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.032+0000 7fd384ff2700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 0x7fd364055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.036+0000 7fd384ff2700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 0x7fd364055b90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fd368002fb0 tx=0x7fd3680069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.036+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd370043d10 con 0x7fd3800b1e30 2021-11-15T14:42:48.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd3800573d0 con 0x7fd3800b1e30 2021-11-15T14:42:48.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd37dffb700 1 -- 172.21.2.135:0/865002316 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+34218 (secure 0 0 0) 0x7fd370023020 con 0x7fd3800b1e30 2021-11-15T14:42:48.124 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:48.124 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:48.125 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 136, 2021-11-15T14:42:48.125 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:42:48.125 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:42:48.125 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:42:47.791876+0000", 2021-11-15T14:42:48.126 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:48.126 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:48.126 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:42:48.126 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:42:48.127 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:42:48.127 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:42:48.127 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:42:48.127 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:42:48.128 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:42:48.128 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:48.128 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:42:48.128 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:42:48.129 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:42:48.129 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:42:48.129 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:42:48.129 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 24, 2021-11-15T14:42:48.129 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:42:48.130 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:42:48.130 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:42:48.130 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:42:48.130 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:48.131 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.131 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:42:48.131 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:42:48.131 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:42:48.132 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:48.132 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:48.132 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:48.132 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:48.133 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:48.133 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:48.133 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:48.133 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:48.133 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:42:48.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:42:48.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:42:48.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:42:48.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:42:48.135 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:48.135 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:48.135 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:48.135 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:48.136 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:48.136 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:48.136 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:48.136 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.136 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:42:48.137 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:48.137 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:48.137 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:48.137 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:48.138 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:48.138 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:48.138 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:48.138 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:48.139 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:48.139 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:48.139 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:48.139 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:48.140 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:48.140 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:48.140 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:48.140 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:48.140 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:48.141 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:48.141 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:48.141 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:48.141 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:48.142 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:48.142 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:48.142 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:48.142 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:48.143 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:48.143 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.143 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:48.143 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:48.144 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:48.144 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:48.144 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:48.144 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:48.144 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:48.145 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:48.145 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:48.145 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:48.145 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:48.146 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:48.146 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:42:48.146 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.146 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:48.147 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:42:48.147 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.147 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.147 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.148 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:42:48.148 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:42:48.148 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:42:48.148 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:48.148 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:48.149 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:48.149 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:48.149 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:48.149 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:48.150 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:48.150 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:48.150 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:48.150 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:48.151 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:48.151 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:48.151 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:48.151 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:48.151 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:48.152 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:48.152 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:48.152 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:48.152 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:48.153 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:48.153 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.153 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:42:48.153 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:48.154 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:48.154 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:48.154 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:48.154 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:48.154 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:48.155 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:48.155 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:48.155 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:48.155 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:48.156 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:48.156 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:48.156 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:48.156 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:48.157 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:48.157 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:48.157 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:48.157 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:48.158 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:48.158 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:48.158 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:48.158 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:48.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:48.159 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:48.159 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:48.159 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:48.159 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.160 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:48.160 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:48.160 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:48.160 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:48.161 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:48.161 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:48.161 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:48.161 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:48.162 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:48.162 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:48.162 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:48.162 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:48.162 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:48.163 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:42:48.163 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.163 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.163 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.164 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 22, 2021-11-15T14:42:48.164 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:42:48.164 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:42:19.266983+0000", 2021-11-15T14:42:48.164 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:48.165 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:48.165 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:48.165 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:48.165 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:48.165 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:48.166 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:48.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:48.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:48.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:48.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:48.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:48.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:48.167 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:48.168 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:48.168 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:48.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:48.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:48.169 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:48.169 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:48.169 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "136", 2021-11-15T14:42:48.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:48.170 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:48.170 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:48.170 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:48.170 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:48.171 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:48.171 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:48.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:48.171 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:48.172 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:48.172 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:48.172 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:48.172 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:48.172 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:48.173 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:48.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:48.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:48.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:48.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:48.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:48.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:48.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:48.175 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:48.175 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:48.175 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:48.175 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:48.175 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:48.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:48.176 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:48.176 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:48.177 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:48.177 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:48.177 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:48.177 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:48.178 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:48.178 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:48.178 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:48.178 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:48.179 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:48.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:42:48.179 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:42:48.179 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.179 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.180 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.180 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.180 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 24, 2021-11-15T14:42:48.180 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:42:48.181 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:42:46.785366+0000", 2021-11-15T14:42:48.181 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 32769, 2021-11-15T14:42:48.181 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool,creating", 2021-11-15T14:42:48.181 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:48.182 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:48.182 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:48.182 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:48.182 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:48.182 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:48.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:48.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:48.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:48.183 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:48.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:48.184 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:48.184 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:48.184 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:48.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:48.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:48.185 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:48.185 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:48.186 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "136", 2021-11-15T14:42:48.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:48.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:48.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:48.187 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:48.187 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:48.187 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:48.187 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:48.188 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:48.188 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:48.188 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:48.188 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:48.189 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:48.189 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:48.189 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:48.189 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:48.189 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:48.190 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:48.190 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:48.190 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:48.190 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:48.191 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:48.191 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:48.191 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:48.191 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:48.192 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:48.192 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:48.192 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.192 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:48.193 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:48.193 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:48.193 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:48.193 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:48.193 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:48.194 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:48.194 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:48.194 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:48.194 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:48.195 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:48.195 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:48.195 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:42:48.195 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:42:48.196 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:42:48.196 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.196 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:48.196 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:42:48.197 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:42:48.197 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.197 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.197 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.197 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:48.198 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:42:48.198 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.198 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:48.198 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:42:48.199 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.199 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.199 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.199 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.200 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.200 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.200 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:48.201 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.201 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.201 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.201 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.201 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.202 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.202 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:42:48.202 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.202 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.203 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.203 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.203 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:42:48.203 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.204 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.204 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.204 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.204 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.205 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.205 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.205 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.205 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:42:48.205 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.206 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.206 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.206 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.206 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:42:48.207 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.207 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.207 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.207 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.208 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.208 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.208 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.208 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.209 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:42:48.209 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.209 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.209 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.209 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.210 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:42:48.210 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.210 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.210 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.211 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.211 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.211 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.211 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.212 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.212 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:42:48.212 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.212 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.212 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.213 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.213 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:42:48.213 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:48.213 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.214 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.214 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.214 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:42:48.214 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:42:48.215 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:42:48.215 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:42:48.215 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.215 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.216 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.216 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.216 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.216 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.216 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:48.217 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:42:48.217 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.217 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.217 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.218 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.218 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.218 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.218 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.219 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:48.219 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.219 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.219 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.219 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.220 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.220 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.220 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:42:48.220 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.221 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.221 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.221 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.221 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:42:48.222 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.222 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.222 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.222 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.223 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.223 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.223 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.223 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.223 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:42:48.224 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.224 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.224 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.224 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.225 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:42:48.225 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.225 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.225 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.226 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.226 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.226 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.226 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.226 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.227 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:42:48.227 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.227 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.227 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.228 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.228 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:42:48.228 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.228 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.229 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.229 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.229 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.229 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.229 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.230 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.230 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:42:48.230 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.230 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.231 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.231 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.231 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:42:48.231 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:48.232 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.232 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.232 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.232 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:42:48.233 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:42:48.233 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:42:48.233 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:42:48.233 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.234 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.234 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.234 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.234 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.235 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:48.235 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:42:48.235 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.236 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.236 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.236 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.236 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.237 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.237 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.237 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:42:48.237 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.237 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.238 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.238 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.238 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.238 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:42:48.239 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.239 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.239 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.240 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.240 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:42:48.240 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.240 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.241 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.241 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.241 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.241 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.242 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.242 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.242 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:42:48.242 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.242 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.243 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.243 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.243 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:42:48.243 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.244 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.244 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.244 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.245 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.245 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.245 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.245 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:42:48.245 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.246 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.246 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.246 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.246 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:42:48.247 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.247 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.247 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.247 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.248 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.248 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.248 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.248 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.249 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:42:48.249 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.249 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.250 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.250 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:42:48.250 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:48.250 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.250 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.251 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.251 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:42:48.251 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:42:48.251 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:42:48.252 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:42:48.252 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.252 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.252 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.253 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.253 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.253 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.253 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:48.254 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:42:48.254 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.254 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.254 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.255 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.255 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.255 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.255 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.255 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:48.256 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.256 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.256 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.256 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.257 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.257 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.257 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:42:48.257 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.257 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.259 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.259 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.259 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:42:48.259 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.260 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.260 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.260 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.261 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.261 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.261 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.261 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:42:48.262 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.262 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.262 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.262 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.263 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:42:48.263 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.263 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.263 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.264 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.264 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.264 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.264 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.264 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.265 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:42:48.265 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.265 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.265 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.266 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.266 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:42:48.266 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.266 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.267 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.267 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.267 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.267 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.268 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:42:48.268 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.269 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.269 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.269 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.269 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:42:48.269 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:48.270 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.270 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.270 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.270 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:42:48.271 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:42:48.271 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:42:48.271 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:42:48.271 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.272 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.272 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.272 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.272 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.272 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.273 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:48.273 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:42:48.273 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.273 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.274 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.274 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.274 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.274 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.275 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.275 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:48.275 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.275 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.276 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.276 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.276 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.276 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.276 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:42:48.277 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.277 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.277 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.277 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.278 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:42:48.278 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.278 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.278 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.279 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.279 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.279 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.279 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.280 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.280 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:42:48.280 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.280 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.280 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.281 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.281 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:42:48.281 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.281 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.282 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.282 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.282 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.282 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.283 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.283 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.283 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:42:48.283 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.284 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.284 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.284 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.284 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:42:48.284 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.285 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.285 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.285 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.285 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.286 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.286 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:42:48.287 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.287 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.287 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.287 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:42:48.288 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:48.288 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.288 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.288 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.289 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:42:48.289 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:42:48.289 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:42:48.289 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:42:48.290 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.290 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.290 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.290 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.291 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.291 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.291 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:48.291 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:42:48.292 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.292 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.292 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.292 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.292 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.293 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.293 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.293 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:48.293 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.294 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.294 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.294 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.294 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.295 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.295 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:42:48.295 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.295 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.296 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.296 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.296 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:42:48.296 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.296 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.297 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.297 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.297 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.297 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.298 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.298 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.298 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:42:48.298 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.299 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.299 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.299 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.299 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:42:48.300 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.300 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.300 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.300 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.301 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.301 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.301 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.301 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:42:48.302 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.302 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.302 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.302 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.303 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:42:48.303 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.303 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.303 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.304 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.304 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.304 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.304 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.305 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:42:48.305 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.305 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:42:48.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:48.306 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.307 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:42:48.307 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:42:48.308 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:42:48.308 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:42:48.308 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.308 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.309 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.309 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.309 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.310 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:48.310 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:42:48.310 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.310 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.310 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.311 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.311 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.311 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.311 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.312 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:42:48.312 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.312 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.312 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.313 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.313 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.313 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.313 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:42:48.314 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.314 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.314 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.314 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.314 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:42:48.315 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.315 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.315 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.316 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.316 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.316 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.317 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:42:48.317 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.317 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.317 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.318 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.318 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:42:48.318 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.318 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.319 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.319 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.319 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.319 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.320 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.320 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.320 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:42:48.320 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.320 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.321 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.321 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:42:48.321 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.322 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.322 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.322 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:42:48.324 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.324 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:42:48.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:48.325 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.325 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.326 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:42:48.326 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:42:48.326 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:42:48.326 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:42:48.327 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.327 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.327 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.328 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:48.328 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:42:48.329 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:48.329 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:48.329 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:48.329 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:48.330 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:48.330 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:48.330 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:48.330 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:48.331 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:48.331 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:48.331 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:48.331 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.331 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.332 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.332 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:42:48.332 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.332 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.333 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.333 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:42:48.333 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.334 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.334 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.334 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:48.334 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.335 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.335 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:42:48.335 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.336 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.336 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.336 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.336 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:42:48.337 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.337 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.337 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.338 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:48.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.338 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:42:48.339 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.339 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.339 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:42:48.340 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.340 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.340 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.341 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.341 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:48.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:48.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:48.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:42:48.342 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.343 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:48.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:42:48.343 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:48.343 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.344 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.344 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.344 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:42:48.344 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:42:48.344 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:42:48.345 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:42:48.345 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:48.345 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:48.345 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:48.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:48.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.346 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:48.346 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:42:48.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.347 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:48.347 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.347 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.348 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.348 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.348 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.348 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:42:48.348 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.349 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.349 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.349 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:48.349 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.350 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.350 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.350 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.350 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.351 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:42:48.351 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.351 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.351 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.352 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:48.352 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.352 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.352 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.352 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.353 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:42:48.353 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.353 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.354 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.354 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:48.354 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.354 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.355 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.355 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.355 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.355 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:42:48.355 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.356 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:48.356 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.357 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.357 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.357 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.357 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.358 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:42:48.358 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.358 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.358 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.359 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:48.359 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.359 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.359 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.359 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.360 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.360 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:42:48.360 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.361 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.361 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:48.361 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.361 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.362 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.362 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.362 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.362 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:42:48.363 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:48.363 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:48.364 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:48.364 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:48.364 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:48.364 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:48.364 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:48.365 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:42:48.365 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:48.365 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.365 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:48.366 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:42:48.366 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:42:48.366 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:42:48.366 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:42:48.367 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:42:48.367 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/2122454907": "2021-11-16T14:42:34.744826+0000", 2021-11-15T14:42:48.367 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/2122454907": "2021-11-16T14:42:34.744826+0000" 2021-11-15T14:42:48.367 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.368 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:42:48.368 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:42:48.368 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:42:48.368 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:48.368 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:42:48.369 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:42:48.369 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:48.369 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:42:48.369 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:48.370 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:48.370 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:42:48.370 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:42:48.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.371 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:42:48.371 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:48.371 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:48.371 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:42:48.371 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:48.372 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:48.372 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:42:48.372 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:48.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:48.373 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:42:48.373 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:42:48.373 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:42:48.373 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:42:48.374 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:42:48.374 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:48.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 msgr2=0x7fd364055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 0x7fd364055b90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fd368002fb0 tx=0x7fd3680069b0).stop 2021-11-15T14:42:48.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 msgr2=0x7fd380149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fd3801477b0 tx=0x7fd370015000).stop 2021-11-15T14:42:48.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 shutdown_connections 2021-11-15T14:42:48.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd3640536d0 0x7fd364055b90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd380148420 0x7fd38014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3800b1e30 0x7fd380149bd0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 --2- 172.21.2.135:0/865002316 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3800a7140 0x7fd3800aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 >> 172.21.2.135:0/865002316 conn(0x7fd38005f730 msgr2=0x7fd380143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:48.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 shutdown_connections 2021-11-15T14:42:48.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.120+0000 7fd387256700 1 -- 172.21.2.135:0/865002316 wait complete. 2021-11-15T14:42:48.379 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 Processor -- start 2021-11-15T14:42:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- start start 2021-11-15T14:42:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcb580b1050 0x7fcb581447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb580b03d0 con 0x7fcb580b1e30 2021-11-15T14:42:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb580b0670 con 0x7fcb58148420 2021-11-15T14:42:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580a9140 con 0x7fcb580b1050 2021-11-15T14:42:48.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcb580b1050 0x7fcb581447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcb580b1050 0x7fcb581447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34630/0 (socket says 172.21.2.135:34630) 2021-11-15T14:42:48.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 -- 172.21.2.135:0/2900009207 learned_addr learned my addr 172.21.2.135:0/2900009207 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5dc2a700 1 --1- 172.21.2.135:0/2900009207 >> v1:172.21.2.135:6789/0 conn(0x7fcb58148420 0x7fcb580a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50448/0 (socket says 172.21.2.135:50448) 2021-11-15T14:42:48.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 -- 172.21.2.135:0/2900009207 >> v1:172.21.2.135:6789/0 conn(0x7fcb58148420 legacy=0x7fcb580a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 -- 172.21.2.135:0/2900009207 >> v1:172.21.2.119:6789/0 conn(0x7fcb580b1e30 legacy=0x7fcb580b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:48.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 -- 172.21.2.135:0/2900009207 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580b0910 con 0x7fcb580b1050 2021-11-15T14:42:48.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5ec2c700 1 --2- 172.21.2.135:0/2900009207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb581447a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fcb580acee0 tx=0x7fcb50009290).ready entity=mon.1 client_cookie=31bf9a13ed3b7c1c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5d429700 1 -- 172.21.2.135:0/2900009207 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb5000b820 con 0x7fcb580b1050 2021-11-15T14:42:48.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5d429700 1 -- 172.21.2.135:0/2900009207 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5000b980 con 0x7fcb580b1050 2021-11-15T14:42:48.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb5d429700 1 -- 172.21.2.135:0/2900009207 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb5000baf0 con 0x7fcb580b1050 2021-11-15T14:42:48.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- 172.21.2.135:0/2900009207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 msgr2=0x7fcb581447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2900009207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb581447a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fcb580acee0 tx=0x7fcb50009290).stop 2021-11-15T14:42:48.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- 172.21.2.135:0/2900009207 shutdown_connections 2021-11-15T14:42:48.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2900009207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb581447a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- 172.21.2.135:0/2900009207 >> 172.21.2.135:0/2900009207 conn(0x7fcb5805f730 msgr2=0x7fcb5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:48.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- 172.21.2.135:0/2900009207 shutdown_connections 2021-11-15T14:42:48.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.432+0000 7fcb6068f700 1 -- 172.21.2.135:0/2900009207 wait complete. 2021-11-15T14:42:48.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 Processor -- start 2021-11-15T14:42:48.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- start start 2021-11-15T14:42:48.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb580b1e30 0x7fcb580abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb58148420 0x7fcb580ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5814b970 con 0x7fcb580b1e30 2021-11-15T14:42:48.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5814aec0 con 0x7fcb580b1050 2021-11-15T14:42:48.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5814b160 con 0x7fcb58148420 2021-11-15T14:42:48.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34632/0 (socket says 172.21.2.135:34632) 2021-11-15T14:42:48.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 -- 172.21.2.135:0/2048430819 learned_addr learned my addr 172.21.2.135:0/2048430819 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 -- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb58148420 msgr2=0x7fcb580ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb58148420 0x7fcb580ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 -- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb580b1e30 msgr2=0x7fcb580abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb580b1e30 0x7fcb580abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 -- 172.21.2.135:0/2048430819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009530 con 0x7fcb580b1050 2021-11-15T14:42:48.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5e42b700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fcb54002f90 tx=0x7fcb54006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb54013460 con 0x7fcb580b1050 2021-11-15T14:42:48.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb540135c0 con 0x7fcb580b1050 2021-11-15T14:42:48.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb54013920 con 0x7fcb580b1050 2021-11-15T14:42:48.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5814b6b0 con 0x7fcb580b1050 2021-11-15T14:42:48.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb58148f70 con 0x7fcb580b1050 2021-11-15T14:42:48.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5814b320 con 0x7fcb580b1050 2021-11-15T14:42:48.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb5400f070 con 0x7fcb580b1050 2021-11-15T14:42:48.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 0x7fcb38055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fcb5406b4b0 con 0x7fcb580b1050 2021-11-15T14:42:48.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.436+0000 7fcb5dc2a700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 0x7fcb38055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.440+0000 7fcb5dc2a700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 0x7fcb38055ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fcb580b31f0 tx=0x7fcb48007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.440+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb54042350 con 0x7fcb580b1050 2021-11-15T14:42:48.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb580b0bb0 con 0x7fcb580b1050 2021-11-15T14:42:48.552 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb477fe700 1 -- 172.21.2.135:0/2048430819 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fcb54045970 con 0x7fcb580b1050 2021-11-15T14:42:48.553 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:48.553 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":64,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:47.792372+0000","modified":"2021-11-15T14:42:47.792539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-15T14:42:48.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 msgr2=0x7fcb38055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 0x7fcb38055ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fcb580b31f0 tx=0x7fcb48007800).stop 2021-11-15T14:42:48.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 msgr2=0x7fcb580a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fcb54002f90 tx=0x7fcb54006df0).stop 2021-11-15T14:42:48.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 shutdown_connections 2021-11-15T14:42:48.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcb38053610 0x7fcb38055ad0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcb58148420 0x7fcb580ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcb580b1e30 0x7fcb580abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:48.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 --2- 172.21.2.135:0/2048430819 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcb580b1050 0x7fcb580a9800 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 >> 172.21.2.135:0/2048430819 conn(0x7fcb5805f730 msgr2=0x7fcb580b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:48.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 shutdown_connections 2021-11-15T14:42:48.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.548+0000 7fcb6068f700 1 -- 172.21.2.135:0/2048430819 wait complete. 2021-11-15T14:42:48.557 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 64 2021-11-15T14:42:48.560 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:42:48.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 Processor -- start 2021-11-15T14:42:48.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- start start 2021-11-15T14:42:48.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f62cc0b6980 0x7f62cc144840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc0aa100 0x7f62cc144d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc0b6d60 con 0x7f62cc05fe50 2021-11-15T14:42:48.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc0ac5d0 con 0x7f62cc0b6980 2021-11-15T14:42:48.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0ac870 con 0x7f62cc0aa100 2021-11-15T14:42:48.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f62cc0b6980 0x7f62cc144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f62cc0b6980 0x7f62cc144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34640/0 (socket says 172.21.2.135:34640) 2021-11-15T14:42:48.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 -- 172.21.2.135:0/2081358630 learned_addr learned my addr 172.21.2.135:0/2081358630 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d082a700 1 --1- 172.21.2.135:0/2081358630 >> v1:172.21.2.135:6789/0 conn(0x7f62cc05fe50 0x7f62cc14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50460/0 (socket says 172.21.2.135:50460) 2021-11-15T14:42:48.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62c37fe700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc0aa100 0x7f62cc144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 -- 172.21.2.135:0/2081358630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc0aa100 msgr2=0x7f62cc144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:48.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc0aa100 0x7f62cc144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 -- 172.21.2.135:0/2081358630 >> v1:172.21.2.135:6789/0 conn(0x7f62cc05fe50 legacy=0x7f62cc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 -- 172.21.2.135:0/2081358630 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0acb10 con 0x7f62cc0b6980 2021-11-15T14:42:48.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cbfff700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0b6980 0x7f62cc144840 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f62bc002f70 tx=0x7f62bc006eb0).ready entity=mon.1 client_cookie=c5eba292ca51515a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cb7fe700 1 -- 172.21.2.135:0/2081358630 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62bc00d5c0 con 0x7f62cc0b6980 2021-11-15T14:42:48.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cb7fe700 1 -- 172.21.2.135:0/2081358630 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc000e90 con 0x7f62cc0b6980 2021-11-15T14:42:48.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62cb7fe700 1 -- 172.21.2.135:0/2081358630 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62bc00d950 con 0x7f62cc0b6980 2021-11-15T14:42:48.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- 172.21.2.135:0/2081358630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0b6980 msgr2=0x7f62cc144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0b6980 0x7f62cc144840 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f62bc002f70 tx=0x7f62bc006eb0).stop 2021-11-15T14:42:48.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- 172.21.2.135:0/2081358630 shutdown_connections 2021-11-15T14:42:48.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc0aa100 0x7f62cc144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 --2- 172.21.2.135:0/2081358630 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0b6980 0x7f62cc144840 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- 172.21.2.135:0/2081358630 >> 172.21.2.135:0/2081358630 conn(0x7f62cc0b3500 msgr2=0x7f62cc0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:48.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- 172.21.2.135:0/2081358630 shutdown_connections 2021-11-15T14:42:48.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- 172.21.2.135:0/2081358630 wait complete. 2021-11-15T14:42:48.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 Processor -- start 2021-11-15T14:42:48.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.608+0000 7f62d228d700 1 -- start start 2021-11-15T14:42:48.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc05fe50 0x7f62cc157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f62cc0b6980 0x7f62cc0642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc065830 con 0x7f62cc0b6980 2021-11-15T14:42:48.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc156990 con 0x7f62cc0aa100 2021-11-15T14:42:48.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc156c30 con 0x7f62cc05fe50 2021-11-15T14:42:48.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34648/0 (socket says 172.21.2.135:34648) 2021-11-15T14:42:48.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 -- 172.21.2.135:0/3583097360 learned_addr learned my addr 172.21.2.135:0/3583097360 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:48.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d082a700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f62cc0b6980 0x7f62cc0642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62cbfff700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc05fe50 0x7f62cc157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 -- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc05fe50 msgr2=0x7f62cc157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc05fe50 0x7f62cc157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 -- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f62cc0b6980 msgr2=0x7f62cc0642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:48.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f62cc0b6980 0x7f62cc0642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:48.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 -- 172.21.2.135:0/3583097360 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc00b1e0 con 0x7f62cc0aa100 2021-11-15T14:42:48.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c37fe700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f62b400a000 tx=0x7f62b4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b4011780 con 0x7f62cc0aa100 2021-11-15T14:42:48.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40118e0 con 0x7f62cc0aa100 2021-11-15T14:42:48.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc156ed0 con 0x7f62cc0aa100 2021-11-15T14:42:48.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b4011c40 con 0x7f62cc0aa100 2021-11-15T14:42:48.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc0664c0 con 0x7f62cc0aa100 2021-11-15T14:42:48.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc157060 con 0x7f62cc0aa100 2021-11-15T14:42:48.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f62b401c460 con 0x7f62cc0aa100 2021-11-15T14:42:48.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 0x7f62b00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:48.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f62b406bff0 con 0x7f62cc0aa100 2021-11-15T14:42:48.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62cbfff700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 0x7f62b00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:48.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.612+0000 7f62cbfff700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 0x7f62b00559b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f62bc01a000 tx=0x7f62bc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:48.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.616+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f62b4042e90 con 0x7f62cc0aa100 2021-11-15T14:42:48.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:48.724+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62cc0acdb0 con 0x7f62cc0aa100 2021-11-15T14:42:49.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62c9ffb700 1 -- 172.21.2.135:0/3583097360 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f62b40464b0 con 0x7f62cc0aa100 2021-11-15T14:42:49.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 msgr2=0x7f62b00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 0x7f62b00559b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f62bc01a000 tx=0x7f62bc015000).stop 2021-11-15T14:42:49.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 msgr2=0x7f62cc065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f62b400a000 tx=0x7f62b4008040).stop 2021-11-15T14:42:49.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 shutdown_connections 2021-11-15T14:42:49.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f62b00534f0 0x7f62b00559b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f62cc0b6980 0x7f62cc0642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62cc0aa100 0x7f62cc065fd0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 --2- 172.21.2.135:0/3583097360 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62cc05fe50 0x7f62cc157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 >> 172.21.2.135:0/3583097360 conn(0x7f62cc0b3500 msgr2=0x7f62cc149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:49.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 shutdown_connections 2021-11-15T14:42:49.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.616+0000 7f62d228d700 1 -- 172.21.2.135:0/3583097360 wait complete. 2021-11-15T14:42:49.624 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:42:49.627 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:49.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 Processor -- start 2021-11-15T14:42:49.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- start start 2021-11-15T14:42:49.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0a00b1300 0x7fa0a00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa0a0140d70 0x7fa0a00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a0140390 con 0x7fa0a00a8cf0 2021-11-15T14:42:49.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a0140630 con 0x7fa0a0140d70 2021-11-15T14:42:49.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a01408d0 con 0x7fa0a00b1300 2021-11-15T14:42:49.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0a00b1300 0x7fa0a00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fa0a00b1300 0x7fa0a00b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34652/0 (socket says 172.21.2.135:34652) 2021-11-15T14:42:49.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 -- 172.21.2.135:0/636545313 learned_addr learned my addr 172.21.2.135:0/636545313 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:49.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 -- 172.21.2.135:0/636545313 >> v2:172.21.2.119:3300/0 conn(0x7fa0a0140d70 msgr2=0x7fa0a00b21e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:49.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 --2- 172.21.2.135:0/636545313 >> v2:172.21.2.119:3300/0 conn(0x7fa0a0140d70 0x7fa0a00b21e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 -- 172.21.2.135:0/636545313 >> v1:172.21.2.135:6789/0 conn(0x7fa0a00a8cf0 legacy=0x7fa0a00ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 -- 172.21.2.135:0/636545313 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0140080 con 0x7fa0a00b1300 2021-11-15T14:42:49.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a613a700 1 --2- 172.21.2.135:0/636545313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a00b1cf0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fa09c002f70 tx=0x7fa09c006f40).ready entity=mon.1 client_cookie=57512bcb46e12b7d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a5138700 1 -- 172.21.2.135:0/636545313 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa09c00dc70 con 0x7fa0a00b1300 2021-11-15T14:42:49.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a5138700 1 -- 172.21.2.135:0/636545313 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c000e90 con 0x7fa0a00b1300 2021-11-15T14:42:49.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a5138700 1 -- 172.21.2.135:0/636545313 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa09c00be90 con 0x7fa0a00b1300 2021-11-15T14:42:49.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- 172.21.2.135:0/636545313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 msgr2=0x7fa0a00b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 --2- 172.21.2.135:0/636545313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a00b1cf0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7fa09c002f70 tx=0x7fa09c006f40).stop 2021-11-15T14:42:49.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- 172.21.2.135:0/636545313 shutdown_connections 2021-11-15T14:42:49.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 --2- 172.21.2.135:0/636545313 >> v2:172.21.2.119:3300/0 conn(0x7fa0a0140d70 0x7fa0a00b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 --2- 172.21.2.135:0/636545313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a00b1cf0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- 172.21.2.135:0/636545313 >> 172.21.2.135:0/636545313 conn(0x7fa0a005f730 msgr2=0x7fa0a005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:49.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- 172.21.2.135:0/636545313 shutdown_connections 2021-11-15T14:42:49.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.676+0000 7fa0a839e700 1 -- 172.21.2.135:0/636545313 wait complete. 2021-11-15T14:42:49.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 Processor -- start 2021-11-15T14:42:49.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- start start 2021-11-15T14:42:49.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0a00a8cf0 0x7fa0a00b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0a0140d70 0x7fa0a015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00ac6b0 con 0x7fa0a00a8cf0 2021-11-15T14:42:49.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00ab210 con 0x7fa0a00b1300 2021-11-15T14:42:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0143f00 con 0x7fa0a0140d70 2021-11-15T14:42:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34660/0 (socket says 172.21.2.135:34660) 2021-11-15T14:42:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 -- 172.21.2.135:0/1691081838 learned_addr learned my addr 172.21.2.135:0/1691081838 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 -- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0a0140d70 msgr2=0x7fa0a015aab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0a0140d70 0x7fa0a015aab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 -- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0a00a8cf0 msgr2=0x7fa0a00b4600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0a00a8cf0 0x7fa0a00b4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 -- 172.21.2.135:0/1691081838 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c00b460 con 0x7fa0a00b1300 2021-11-15T14:42:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a5939700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fa094002ef0 tx=0x7fa094006d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa094009ea0 con 0x7fa0a00b1300 2021-11-15T14:42:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094002320 con 0x7fa0a00b1300 2021-11-15T14:42:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa094002680 con 0x7fa0a00b1300 2021-11-15T14:42:49.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a01441a0 con 0x7fa0a00b1300 2021-11-15T14:42:49.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a015afa0 con 0x7fa0a00b1300 2021-11-15T14:42:49.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a0144330 con 0x7fa0a00b1300 2021-11-15T14:42:49.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa09400f030 con 0x7fa0a00b1300 2021-11-15T14:42:49.694 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 0x7fa080055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa09406b7c0 con 0x7fa0a00b1300 2021-11-15T14:42:49.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.680+0000 7fa0a613a700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 0x7fa080055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.684+0000 7fa0a613a700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 0x7fa080055b90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fa09c002f70 tx=0x7fa0a0140520).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.695 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.684+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa094042770 con 0x7fa0a00b1300 2021-11-15T14:42:49.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a00aa410 con 0x7fa0a00b1300 2021-11-15T14:42:49.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0937fe700 1 -- 172.21.2.135:0/1691081838 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fa094045d90 con 0x7fa0a00b1300 2021-11-15T14:42:49.795 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:49.796 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":65,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":65,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:42:47.792372+0000","modified":"2021-11-15T14:42:49.607641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-15T14:42:49.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 msgr2=0x7fa080055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 0x7fa080055b90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fa09c002f70 tx=0x7fa0a0140520).stop 2021-11-15T14:42:49.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 msgr2=0x7fa0a015a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7fa094002ef0 tx=0x7fa094006d50).stop 2021-11-15T14:42:49.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 shutdown_connections 2021-11-15T14:42:49.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa0800536d0 0x7fa080055b90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa0a0140d70 0x7fa0a015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa0a00b1300 0x7fa0a015a5c0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 --2- 172.21.2.135:0/1691081838 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa0a00a8cf0 0x7fa0a00b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:49.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 >> 172.21.2.135:0/1691081838 conn(0x7fa0a005f730 msgr2=0x7fa0a0134910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:49.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 shutdown_connections 2021-11-15T14:42:49.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.792+0000 7fa0a839e700 1 -- 172.21.2.135:0/1691081838 wait complete. 2021-11-15T14:42:49.799 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 65 2021-11-15T14:42:49.803 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:42:49.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.848+0000 7fb8de1de700 1 Processor -- start 2021-11-15T14:42:49.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.848+0000 7fb8de1de700 1 -- start start 2021-11-15T14:42:49.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb8d80a9c90 0x7fb8d80b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d81439a0 con 0x7fb8d80b3790 2021-11-15T14:42:49.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d8143c40 con 0x7fb8d80b0630 2021-11-15T14:42:49.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d8143ee0 con 0x7fb8d80a9c90 2021-11-15T14:42:49.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb8d80b0630 0x7fb8d813d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50486/0 (socket says 172.21.2.135:50486) 2021-11-15T14:42:49.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d77fe700 1 -- 172.21.2.135:0/2759022032 learned_addr learned my addr 172.21.2.135:0/2759022032 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:49.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429583598 0 0) 0x7fb8d8143c40 con 0x7fb8d80b0630 2021-11-15T14:42:49.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b8003260 con 0x7fb8d80b0630 2021-11-15T14:42:49.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 --2- 172.21.2.135:0/2759022032 >> v2:172.21.2.119:3300/0 conn(0x7fb8d80a9c90 0x7fb8d80b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477965259 0 0) 0x7fb8b8003260 con 0x7fb8d80b0630 2021-11-15T14:42:49.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 >> v2:172.21.2.119:3300/0 conn(0x7fb8d80a9c90 msgr2=0x7fb8d80b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:49.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 --2- 172.21.2.135:0/2759022032 >> v2:172.21.2.119:3300/0 conn(0x7fb8d80a9c90 0x7fb8d80b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 >> v1:172.21.2.119:6789/0 conn(0x7fb8d80b3790 legacy=0x7fb8d80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d8144180 con 0x7fb8d80b0630 2021-11-15T14:42:49.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb8c0001660 con 0x7fb8d80b0630 2021-11-15T14:42:49.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 >> v1:172.21.2.135:6789/0 conn(0x7fb8d80b0630 legacy=0x7fb8d813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8b80037a0 0x7fb8b8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004500 0x7fb8b8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 0x7fb8b800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8143ee0 con 0x7fb8b8004500 2021-11-15T14:42:49.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800be50 con 0x7fb8b8004e70 2021-11-15T14:42:49.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800c010 con 0x7fb8b80037a0 2021-11-15T14:42:49.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 0x7fb8b800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d6ffd700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004500 0x7fb8b8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d77fe700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8b80037a0 0x7fb8b8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 -- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8b80037a0 msgr2=0x7fb8b8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:49.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8b80037a0 0x7fb8b8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 -- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004500 msgr2=0x7fb8b8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:49.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004500 0x7fb8b8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 -- 172.21.2.135:0/2759022032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8003260 con 0x7fb8b8004e70 2021-11-15T14:42:49.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 -- 172.21.2.135:0/2759022032 reap_dead start 2021-11-15T14:42:49.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d7fff700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 0x7fb8b800b750 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb8d000c000 tx=0x7fb8d00091d0).ready entity=mon.1 client_cookie=d89091dd9471f128 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d000e7e0 con 0x7fb8b8004e70 2021-11-15T14:42:49.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000e940 con 0x7fb8b8004e70 2021-11-15T14:42:49.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8d67fc700 1 -- 172.21.2.135:0/2759022032 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d000eca0 con 0x7fb8b8004e70 2021-11-15T14:42:49.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 msgr2=0x7fb8b800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 0x7fb8b800b750 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb8d000c000 tx=0x7fb8d00091d0).stop 2021-11-15T14:42:49.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- 172.21.2.135:0/2759022032 shutdown_connections 2021-11-15T14:42:49.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2759022032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8b8004e70 0x7fb8b800b750 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- 172.21.2.135:0/2759022032 >> 172.21.2.135:0/2759022032 conn(0x7fb8d8060840 msgr2=0x7fb8d8060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:49.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- 172.21.2.135:0/2759022032 shutdown_connections 2021-11-15T14:42:49.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- 172.21.2.135:0/2759022032 wait complete. 2021-11-15T14:42:49.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 Processor -- start 2021-11-15T14:42:49.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- start start 2021-11-15T14:42:49.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 0x7fb8d8130970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8d813e6c0 0x7fb8d813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 0x7fb8d812d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80641e0 con 0x7fb8b8004e70 2021-11-15T14:42:49.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d813d520 con 0x7fb8d813de90 2021-11-15T14:42:49.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.852+0000 7fb8de1de700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d813f4c0 con 0x7fb8d813e6c0 2021-11-15T14:42:49.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 0x7fb8d812d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 0x7fb8d8130970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 0x7fb8d812d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34682/0 (socket says 172.21.2.135:34682) 2021-11-15T14:42:49.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d7fff700 1 -- 172.21.2.135:0/2358958059 learned_addr learned my addr 172.21.2.135:0/2358958059 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:49.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d6ffd700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8d813e6c0 0x7fb8d813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 -- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8d813e6c0 msgr2=0x7fb8d813efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8d813e6c0 0x7fb8d813efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 -- 172.21.2.135:0/2358958059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 msgr2=0x7fb8d812d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:49.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 0x7fb8d812d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:49.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 -- 172.21.2.135:0/2358958059 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d813ec40 con 0x7fb8b8004e70 2021-11-15T14:42:49.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d77fe700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 0x7fb8d8130970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb8d8131660 tx=0x7fb8d8143dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8c0015630 con 0x7fb8b8004e70 2021-11-15T14:42:49.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0010040 con 0x7fb8b8004e70 2021-11-15T14:42:49.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d813d750 con 0x7fb8b8004e70 2021-11-15T14:42:49.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d8065660 con 0x7fb8b8004e70 2021-11-15T14:42:49.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8c0015980 con 0x7fb8b8004e70 2021-11-15T14:42:49.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d8140e90 con 0x7fb8b8004e70 2021-11-15T14:42:49.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8c0015ae0 con 0x7fb8b8004e70 2021-11-15T14:42:49.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 0x7fb8bc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:49.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fb8c006ba90 con 0x7fb8b8004e70 2021-11-15T14:42:49.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d6ffd700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 0x7fb8bc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:49.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.856+0000 7fb8d6ffd700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 0x7fb8bc055b90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fb8c800d000 tx=0x7fb8c800c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:49.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.860+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8c0042930 con 0x7fb8b8004e70 2021-11-15T14:42:49.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:49.968+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8d8143620 con 0x7fb8b8004e70 2021-11-15T14:42:50.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.812+0000 7fb8d4ff9700 1 -- 172.21.2.135:0/2358958059 <== mon.0 v2:172.21.2.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8c0045f50 con 0x7fb8b8004e70 2021-11-15T14:42:50.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 msgr2=0x7fb8bc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 0x7fb8bc055b90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fb8c800d000 tx=0x7fb8c800c040).stop 2021-11-15T14:42:50.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 msgr2=0x7fb8d8130970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 0x7fb8d8130970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb8d8131660 tx=0x7fb8d8143dd0).stop 2021-11-15T14:42:50.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 shutdown_connections 2021-11-15T14:42:50.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb8bc0536d0 0x7fb8bc055b90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8d813de90 0x7fb8d812d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8d813e6c0 0x7fb8d813efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 --2- 172.21.2.135:0/2358958059 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb8b8004e70 0x7fb8d8130970 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 >> 172.21.2.135:0/2358958059 conn(0x7fb8d8060840 msgr2=0x7fb8d80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:50.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 shutdown_connections 2021-11-15T14:42:50.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.816+0000 7fb8de1de700 1 -- 172.21.2.135:0/2358958059 wait complete. 2021-11-15T14:42:50.826 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:42:50.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 Processor -- start 2021-11-15T14:42:50.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 -- start start 2021-11-15T14:42:50.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb840b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840b03d0 con 0x7feb840a7140 2021-11-15T14:42:50.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840b0670 con 0x7feb84148420 2021-11-15T14:42:50.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8b38d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840a9140 con 0x7feb840b1e30 2021-11-15T14:42:50.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb88928700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feb84148420 0x7feb840b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50508/0 (socket says 172.21.2.135:50508) 2021-11-15T14:42:50.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb88928700 1 -- 172.21.2.135:0/2846763102 learned_addr learned my addr 172.21.2.135:0/2846763102 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:50.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040322280 0 0) 0x7feb840b0670 con 0x7feb84148420 2021-11-15T14:42:50.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb6c003260 con 0x7feb84148420 2021-11-15T14:42:50.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb840b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243737403 0 0) 0x7feb6c003260 con 0x7feb84148420 2021-11-15T14:42:50.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 msgr2=0x7feb840b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:50.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb840b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 >> v1:172.21.2.119:6789/0 conn(0x7feb840a7140 legacy=0x7feb841447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:50.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840b0910 con 0x7feb84148420 2021-11-15T14:42:50.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7feb78001660 con 0x7feb84148420 2021-11-15T14:42:50.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 >> v1:172.21.2.135:6789/0 conn(0x7feb84148420 legacy=0x7feb840b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb6c0037d0 0x7feb6c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c004500 0x7feb6c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb6c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00b8e0 con 0x7feb6c004500 2021-11-15T14:42:50.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00ba20 con 0x7feb6c0037d0 2021-11-15T14:42:50.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c00bbe0 con 0x7feb840b1e30 2021-11-15T14:42:50.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb6c0037d0 0x7feb6c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb8992a700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb6c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb88928700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c004500 0x7feb6c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 -- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 msgr2=0x7feb6c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:50.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb840b1e30 0x7feb6c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 -- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c004500 msgr2=0x7feb6c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:50.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c004500 0x7feb6c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.876+0000 7feb89129700 1 -- 172.21.2.135:0/2846763102 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c003260 con 0x7feb6c0037d0 2021-11-15T14:42:50.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb89129700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb6c0037d0 0x7feb6c003bd0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7feb8000a000 tx=0x7feb80008040).ready entity=mon.1 client_cookie=6f6ff94982f0664c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:50.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb80013670 con 0x7feb6c0037d0 2021-11-15T14:42:50.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800137d0 con 0x7feb6c0037d0 2021-11-15T14:42:50.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb77fff700 1 -- 172.21.2.135:0/2846763102 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb80013b30 con 0x7feb6c0037d0 2021-11-15T14:42:50.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/2846763102 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb6c0037d0 msgr2=0x7feb6c003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 --2- 172.21.2.135:0/2846763102 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb6c0037d0 0x7feb6c003bd0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7feb8000a000 tx=0x7feb80008040).stop 2021-11-15T14:42:50.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 -- 172.21.2.135:0/2846763102 reap_dead start 2021-11-15T14:42:50.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/2846763102 shutdown_connections 2021-11-15T14:42:50.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/2846763102 >> 172.21.2.135:0/2846763102 conn(0x7feb8405f730 msgr2=0x7feb8405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:50.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/2846763102 shutdown_connections 2021-11-15T14:42:50.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/2846763102 wait complete. 2021-11-15T14:42:50.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 Processor -- start 2021-11-15T14:42:50.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- start start 2021-11-15T14:42:50.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c0037d0 0x7feb84062840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb841567b0 0x7feb840af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840ab8f0 con 0x7feb6c0037d0 2021-11-15T14:42:50.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840ab3b0 con 0x7feb840ac230 2021-11-15T14:42:50.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840ab650 con 0x7feb841567b0 2021-11-15T14:42:50.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34702/0 (socket says 172.21.2.135:34702) 2021-11-15T14:42:50.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 -- 172.21.2.135:0/834150507 learned_addr learned my addr 172.21.2.135:0/834150507 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:50.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb88928700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb841567b0 0x7feb840af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb89129700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c0037d0 0x7feb84062840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 -- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb841567b0 msgr2=0x7feb840af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb841567b0 0x7feb840af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 -- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c0037d0 msgr2=0x7feb84062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:50.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c0037d0 0x7feb84062840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:50.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 -- 172.21.2.135:0/834150507 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840af530 con 0x7feb840ac230 2021-11-15T14:42:50.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8992a700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7feb84063bb0 tx=0x7feb7c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:50.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7c002470 con 0x7feb840ac230 2021-11-15T14:42:50.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0025d0 con 0x7feb840ac230 2021-11-15T14:42:50.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840aa710 con 0x7feb840ac230 2021-11-15T14:42:50.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7c002930 con 0x7feb840ac230 2021-11-15T14:42:50.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840aac10 con 0x7feb840ac230 2021-11-15T14:42:50.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb840573d0 con 0x7feb840ac230 2021-11-15T14:42:50.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb7c002a90 con 0x7feb840ac230 2021-11-15T14:42:50.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 0x7feb64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:50.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.880+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7feb7c06b960 con 0x7feb840ac230 2021-11-15T14:42:50.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.884+0000 7feb89129700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 0x7feb64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:50.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.884+0000 7feb89129700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 0x7feb64055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7feb80019000 tx=0x7feb80008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:50.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.884+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb7c042800 con 0x7feb840ac230 2021-11-15T14:42:50.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:50.968+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb840446d0 con 0x7feb840ac230 2021-11-15T14:42:51.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.820+0000 7feb767fc700 1 -- 172.21.2.135:0/834150507 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) v1 ==== 185+0+0 (secure 0 0 0) 0x7feb7c045e20 con 0x7feb840ac230 2021-11-15T14:42:51.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 msgr2=0x7feb64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:51.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 0x7feb64055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7feb80019000 tx=0x7feb80008040).stop 2021-11-15T14:42:51.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 msgr2=0x7feb840ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:51.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7feb84063bb0 tx=0x7feb7c009040).stop 2021-11-15T14:42:51.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 shutdown_connections 2021-11-15T14:42:51.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feb64053610 0x7feb64055ad0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:51.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feb840ac230 0x7feb840ac6e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:51.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feb841567b0 0x7feb840af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:51.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 --2- 172.21.2.135:0/834150507 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feb6c0037d0 0x7feb84062840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:51.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 >> 172.21.2.135:0/834150507 conn(0x7feb8405f730 msgr2=0x7feb8414ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:51.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 shutdown_connections 2021-11-15T14:42:51.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.824+0000 7feb8b38d700 1 -- 172.21.2.135:0/834150507 wait complete. 2021-11-15T14:42:51.830 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:42:51.834 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:42:51.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 Processor -- start 2021-11-15T14:42:51.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- start start 2021-11-15T14:42:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe050148420 0x7fe0500b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe0500a7140 0x7fe0501447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500b03d0 con 0x7fe0500b1e30 2021-11-15T14:42:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500a9140 con 0x7fe0500a7140 2021-11-15T14:42:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500b0670 con 0x7fe050148420 2021-11-15T14:42:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe050148420 0x7fe0500b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:51.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe050148420 0x7fe0500b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34708/0 (socket says 172.21.2.135:34708) 2021-11-15T14:42:51.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 -- 172.21.2.135:0/2616944276 learned_addr learned my addr 172.21.2.135:0/2616944276 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:51.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 -- 172.21.2.135:0/2616944276 >> v2:172.21.2.119:3300/0 conn(0x7fe0500a7140 msgr2=0x7fe0501447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:51.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 --2- 172.21.2.135:0/2616944276 >> v2:172.21.2.119:3300/0 conn(0x7fe0500a7140 0x7fe0501447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:51.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 -- 172.21.2.135:0/2616944276 >> v1:172.21.2.119:6789/0 conn(0x7fe0500b1e30 legacy=0x7fe0500b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:51.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 -- 172.21.2.135:0/2616944276 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500b0910 con 0x7fe050148420 2021-11-15T14:42:51.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe054cc9700 1 --2- 172.21.2.135:0/2616944276 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe0500b1050 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fe0500acee0 tx=0x7fe04c006eb0).ready entity=mon.1 client_cookie=c3ae0a261f83ba31 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:51.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe03ffff700 1 -- 172.21.2.135:0/2616944276 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04c00d5c0 con 0x7fe050148420 2021-11-15T14:42:51.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe03ffff700 1 -- 172.21.2.135:0/2616944276 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c000e90 con 0x7fe050148420 2021-11-15T14:42:51.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe03ffff700 1 -- 172.21.2.135:0/2616944276 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04c00d950 con 0x7fe050148420 2021-11-15T14:42:51.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- 172.21.2.135:0/2616944276 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 msgr2=0x7fe0500b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:51.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 --2- 172.21.2.135:0/2616944276 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe0500b1050 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fe0500acee0 tx=0x7fe04c006eb0).stop 2021-11-15T14:42:51.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- 172.21.2.135:0/2616944276 shutdown_connections 2021-11-15T14:42:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 --2- 172.21.2.135:0/2616944276 >> v2:172.21.2.119:3300/0 conn(0x7fe0500a7140 0x7fe0501447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 --2- 172.21.2.135:0/2616944276 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe0500b1050 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- 172.21.2.135:0/2616944276 >> 172.21.2.135:0/2616944276 conn(0x7fe05005f730 msgr2=0x7fe05005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:51.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- 172.21.2.135:0/2616944276 shutdown_connections 2021-11-15T14:42:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- 172.21.2.135:0/2616944276 wait complete. 2021-11-15T14:42:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 Processor -- start 2021-11-15T14:42:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.888+0000 7fe05772e700 1 -- start start 2021-11-15T14:42:51.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0500a7140 0x7fe0500aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0500b1e30 0x7fe05014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05014b880 con 0x7fe0500a7140 2021-11-15T14:42:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05014bae0 con 0x7fe050148420 2021-11-15T14:42:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe050148b40 con 0x7fe0500b1e30 2021-11-15T14:42:51.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34716/0 (socket says 172.21.2.135:34716) 2021-11-15T14:42:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 -- 172.21.2.135:0/643807065 learned_addr learned my addr 172.21.2.135:0/643807065 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:51.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 -- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0500b1e30 msgr2=0x7fe05014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0500b1e30 0x7fe05014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:51.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 -- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0500a7140 msgr2=0x7fe0500aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0500a7140 0x7fe0500aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:51.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 -- 172.21.2.135:0/643807065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c00b1e0 con 0x7fe050148420 2021-11-15T14:42:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe055ccb700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe0480032f0 tx=0x7fe048009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04800d580 con 0x7fe050148420 2021-11-15T14:42:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800d6e0 con 0x7fe050148420 2021-11-15T14:42:51.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe050148de0 con 0x7fe050148420 2021-11-15T14:42:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04800da40 con 0x7fe050148420 2021-11-15T14:42:51.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500a94c0 con 0x7fe050148420 2021-11-15T14:42:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0500b0bb0 con 0x7fe050148420 2021-11-15T14:42:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe04800dba0 con 0x7fe050148420 2021-11-15T14:42:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 0x7fe030055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:51.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fe04806bcc0 con 0x7fe050148420 2021-11-15T14:42:51.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.892+0000 7fe0554ca700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 0x7fe030055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:51.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.896+0000 7fe0554ca700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 0x7fe030055b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe040002f90 tx=0x7fe0400069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:51.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.896+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe048042e30 con 0x7fe050148420 2021-11-15T14:42:51.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:51.976+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0500573d0 con 0x7fe050148420 2021-11-15T14:42:52.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe03e7fc700 1 -- 172.21.2.135:0/643807065 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe048046450 con 0x7fe050148420 2021-11-15T14:42:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 msgr2=0x7fe030055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 0x7fe030055b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe040002f90 tx=0x7fe0400069b0).stop 2021-11-15T14:42:52.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 msgr2=0x7fe050142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe0480032f0 tx=0x7fe048009220).stop 2021-11-15T14:42:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 shutdown_connections 2021-11-15T14:42:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe0300536a0 0x7fe030055b60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe050148420 0x7fe050142670 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:52.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe0500b1e30 0x7fe05014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 --2- 172.21.2.135:0/643807065 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe0500a7140 0x7fe0500aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.832+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 >> 172.21.2.135:0/643807065 conn(0x7fe05005f730 msgr2=0x7fe0500b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.836+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 shutdown_connections 2021-11-15T14:42:52.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.836+0000 7fe05772e700 1 -- 172.21.2.135:0/643807065 wait complete. 2021-11-15T14:42:52.841 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:42:52.845 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:42:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.892+0000 7f58ccbf6700 1 Processor -- start 2021-11-15T14:42:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.892+0000 7f58ccbf6700 1 -- start start 2021-11-15T14:42:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f58c80a99e0 0x7f58c80b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80ac2e0 0x7f58c80ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80b1ce0 con 0x7f58c80b0740 2021-11-15T14:42:52.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80a9dc0 con 0x7f58c80a99e0 2021-11-15T14:42:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80b29c0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f58c80a99e0 0x7f58c80b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c6d9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f58c80b0740 0x7f58c80aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50540/0 (socket says 172.21.2.135:50540) 2021-11-15T14:42:52.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c6d9d700 1 -- 172.21.2.135:0/2507522185 learned_addr learned my addr 172.21.2.135:0/2507522185 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:52.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c559a700 1 -- 172.21.2.135:0/2507522185 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791362580 0 0) 0x7f58c0001490 con 0x7f58c80b0740 2021-11-15T14:42:52.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c559a700 1 -- 172.21.2.135:0/2507522185 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a8003260 con 0x7f58c80b0740 2021-11-15T14:42:52.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 -- 172.21.2.135:0/2507522185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80ac2e0 msgr2=0x7f58c80ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:52.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 --2- 172.21.2.135:0/2507522185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80ac2e0 0x7f58c80ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 -- 172.21.2.135:0/2507522185 >> v1:172.21.2.135:6789/0 conn(0x7f58c80b0740 legacy=0x7f58c80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 -- 172.21.2.135:0/2507522185 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80b0140 con 0x7f58c80a99e0 2021-11-15T14:42:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c659c700 1 --2- 172.21.2.135:0/2507522185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80a99e0 0x7f58c80b17f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8006df0).ready entity=mon.1 client_cookie=12bfd1e993dd7ee1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c559a700 1 -- 172.21.2.135:0/2507522185 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800d570 con 0x7f58c80a99e0 2021-11-15T14:42:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c559a700 1 -- 172.21.2.135:0/2507522185 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8000e90 con 0x7f58c80a99e0 2021-11-15T14:42:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c559a700 1 -- 172.21.2.135:0/2507522185 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800d8c0 con 0x7f58c80a99e0 2021-11-15T14:42:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/2507522185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80a99e0 msgr2=0x7f58c80b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/2507522185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80a99e0 0x7f58c80b17f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8006df0).stop 2021-11-15T14:42:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/2507522185 shutdown_connections 2021-11-15T14:42:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/2507522185 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80ac2e0 0x7f58c80ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/2507522185 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80a99e0 0x7f58c80b17f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/2507522185 >> 172.21.2.135:0/2507522185 conn(0x7f58c805f730 msgr2=0x7f58c805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/2507522185 shutdown_connections 2021-11-15T14:42:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/2507522185 wait complete. 2021-11-15T14:42:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 Processor -- start 2021-11-15T14:42:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- start start 2021-11-15T14:42:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80a99e0 0x7f58c8145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58c80b0740 0x7f58c8062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8063de0 con 0x7f58c80b0740 2021-11-15T14:42:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80a8ae0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8144f40 con 0x7f58c80a99e0 2021-11-15T14:42:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34728/0 (socket says 172.21.2.135:34728) 2021-11-15T14:42:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 -- 172.21.2.135:0/4143879387 learned_addr learned my addr 172.21.2.135:0/4143879387 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 -- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80a99e0 msgr2=0x7f58c8145370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80a99e0 0x7f58c8145370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 -- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58c80b0740 msgr2=0x7f58c8062bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58c80b0740 0x7f58c8062bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 -- 172.21.2.135:0/4143879387 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b800b180 con 0x7f58c80ac2e0 2021-11-15T14:42:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58c5d9b700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f58b0002f70 tx=0x7f58b0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b0013460 con 0x7f58c80ac2e0 2021-11-15T14:42:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b00135c0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c8065be0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b0013920 con 0x7f58c80ac2e0 2021-11-15T14:42:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.896+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c80630c0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c80b2fe0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58b001a060 con 0x7f58c80ac2e0 2021-11-15T14:42:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58bf7fe700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 0x7f58ac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f58b006b2e0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58c659c700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 0x7f58ac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58c659c700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 0x7f58ac055b60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.900+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58b00424b0 con 0x7f58c80ac2e0 2021-11-15T14:42:52.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:52.988+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58c8145080 con 0x7f58c80ac2e0 2021-11-15T14:42:53.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58bf7fe700 1 -- 172.21.2.135:0/4143879387 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58b0045ad0 con 0x7f58c80ac2e0 2021-11-15T14:42:53.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 msgr2=0x7f58ac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 0x7f58ac055b60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f58b8002f70 tx=0x7f58b8014000).stop 2021-11-15T14:42:53.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 msgr2=0x7f58c813cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f58b0002f70 tx=0x7f58b0006ec0).stop 2021-11-15T14:42:53.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 shutdown_connections 2021-11-15T14:42:53.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58ac0536a0 0x7f58ac055b60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58c80b0740 0x7f58c8062bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f58c80ac2e0 0x7f58c813cf60 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 --2- 172.21.2.135:0/4143879387 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58c80a99e0 0x7f58c8145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 >> 172.21.2.135:0/4143879387 conn(0x7f58c805f730 msgr2=0x7f58c8142700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:53.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 shutdown_connections 2021-11-15T14:42:53.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.000+0000 7f58ccbf6700 1 -- 172.21.2.135:0/4143879387 wait complete. 2021-11-15T14:42:53.011 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-15T14:42:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 Processor -- start 2021-11-15T14:42:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- start start 2021-11-15T14:42:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 0x7fb888066650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb888060560 con 0x7fb888060180 2021-11-15T14:42:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb888060cf0 con 0x7fb888066b40 2021-11-15T14:42:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb888060f90 con 0x7fb8880616d0 2021-11-15T14:42:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88cdef700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb888066b40 0x7fb88814da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50552/0 (socket says 172.21.2.135:50552) 2021-11-15T14:42:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88cdef700 1 -- 172.21.2.135:0/844590050 learned_addr learned my addr 172.21.2.135:0/844590050 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb8877fe700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 0x7fb888066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107012584 0 0) 0x7fb888060cf0 con 0x7fb888066b40 2021-11-15T14:42:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb874003260 con 0x7fb888066b40 2021-11-15T14:42:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3418256859 0 0) 0x7fb874003260 con 0x7fb888066b40 2021-11-15T14:42:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 msgr2=0x7fb888066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 0x7fb888066650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 >> v1:172.21.2.119:6789/0 conn(0x7fb888060180 legacy=0x7fb8880659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888061230 con 0x7fb888066b40 2021-11-15T14:42:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb8800019e0 con 0x7fb888066b40 2021-11-15T14:42:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 >> v1:172.21.2.135:6789/0 conn(0x7fb888066b40 legacy=0x7fb88814da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb874003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb874004500 0x7fb874004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 0x7fb874004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb888060f90 con 0x7fb874004500 2021-11-15T14:42:53.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87400b7b0 con 0x7fb874003750 2021-11-15T14:42:53.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87400b970 con 0x7fb8880616d0 2021-11-15T14:42:53.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb874003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 -- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 msgr2=0x7fb874004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:53.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8880616d0 0x7fb874004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 -- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb874004500 msgr2=0x7fb874004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:53.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb874004500 0x7fb874004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 -- 172.21.2.135:0/844590050 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874003260 con 0x7fb874003750 2021-11-15T14:42:53.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb887fff700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb874003b70 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fb8880615b0 tx=0x7fb8780079e0).ready entity=mon.1 client_cookie=adab9cb384cde5b8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb878001ea0 con 0x7fb874003750 2021-11-15T14:42:53.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878014410 con 0x7fb874003750 2021-11-15T14:42:53.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb886ffd700 1 -- 172.21.2.135:0/844590050 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb878014770 con 0x7fb874003750 2021-11-15T14:42:53.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- 172.21.2.135:0/844590050 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 msgr2=0x7fb874003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 --2- 172.21.2.135:0/844590050 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb874003b70 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fb8880615b0 tx=0x7fb8780079e0).stop 2021-11-15T14:42:53.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88cdef700 1 -- 172.21.2.135:0/844590050 reap_dead start 2021-11-15T14:42:53.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- 172.21.2.135:0/844590050 shutdown_connections 2021-11-15T14:42:53.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- 172.21.2.135:0/844590050 >> 172.21.2.135:0/844590050 conn(0x7fb88805cfb0 msgr2=0x7fb88805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:53.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- 172.21.2.135:0/844590050 shutdown_connections 2021-11-15T14:42:53.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.060+0000 7fb88e852700 1 -- 172.21.2.135:0/844590050 wait complete. 2021-11-15T14:42:53.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 Processor -- start 2021-11-15T14:42:53.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- start start 2021-11-15T14:42:53.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb888145b80 0x7fb888145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb888152870 0x7fb888152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb888155ee0 con 0x7fb888152870 2021-11-15T14:42:53.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb888156180 con 0x7fb874003750 2021-11-15T14:42:53.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb888156420 con 0x7fb888145b80 2021-11-15T14:42:53.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34744/0 (socket says 172.21.2.135:34744) 2021-11-15T14:42:53.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 -- 172.21.2.135:0/2833255270 learned_addr learned my addr 172.21.2.135:0/2833255270 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:53.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88cdef700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb888152870 0x7fb888152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 -- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb888145b80 msgr2=0x7fb888145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb888145b80 0x7fb888145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 -- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb888152870 msgr2=0x7fb888152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb888152870 0x7fb888152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 -- 172.21.2.135:0/2833255270 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8881566c0 con 0x7fb874003750 2021-11-15T14:42:53.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb887fff700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fb8880615b0 tx=0x7fb878015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8780137c0 con 0x7fb874003750 2021-11-15T14:42:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878013920 con 0x7fb874003750 2021-11-15T14:42:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8880a82c0 con 0x7fb874003750 2021-11-15T14:42:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb878013c80 con 0x7fb874003750 2021-11-15T14:42:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8880ac300 con 0x7fb874003750 2021-11-15T14:42:53.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8881560e0 con 0x7fb874003750 2021-11-15T14:42:53.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb878022470 con 0x7fb874003750 2021-11-15T14:42:53.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 0x7fb868055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb87801c040 con 0x7fb874003750 2021-11-15T14:42:53.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.064+0000 7fb8877fe700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 0x7fb868055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.068+0000 7fb8877fe700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 0x7fb868055ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb87c00c000 tx=0x7fb87c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.068+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb878043e30 con 0x7fb874003750 2021-11-15T14:42:53.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.180+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fb888156850 con 0x7fb874003750 2021-11-15T14:42:53.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb8857fa700 1 -- 172.21.2.135:0/2833255270 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v368) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb8780473d0 con 0x7fb874003750 2021-11-15T14:42:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 msgr2=0x7fb868055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 0x7fb868055ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb87c00c000 tx=0x7fb87c006df0).stop 2021-11-15T14:42:53.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 msgr2=0x7fb8880a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fb8880615b0 tx=0x7fb878015000).stop 2021-11-15T14:42:53.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 shutdown_connections 2021-11-15T14:42:53.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb868053610 0x7fb868055ad0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb888152870 0x7fb888152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb888145b80 0x7fb888145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 --2- 172.21.2.135:0/2833255270 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb874003750 0x7fb8880a7dd0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 >> 172.21.2.135:0/2833255270 conn(0x7fb88805cfb0 msgr2=0x7fb8880b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:53.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 shutdown_connections 2021-11-15T14:42:53.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.844+0000 7fb88e852700 1 -- 172.21.2.135:0/2833255270 wait complete. 2021-11-15T14:42:53.854 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:42:53.855 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:42:53.856 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-15T14:42:53.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 Processor -- start 2021-11-15T14:42:53.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- start start 2021-11-15T14:42:53.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f75e8067070 0x7f75e8143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e8067450 con 0x7f75e80ad0b0 2021-11-15T14:42:53.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80b0050 con 0x7f75e8067070 2021-11-15T14:42:53.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b02f0 con 0x7f75e80b0760 2021-11-15T14:42:53.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f75e8067070 0x7f75e8143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e659c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f75e80ad0b0 0x7f75e8143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50570/0 (socket says 172.21.2.135:50570) 2021-11-15T14:42:53.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e659c700 1 -- 172.21.2.135:0/1014291856 learned_addr learned my addr 172.21.2.135:0/1014291856 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:53.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e759e700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 -- 172.21.2.135:0/1014291856 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 msgr2=0x7f75e80b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:53.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e80b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 -- 172.21.2.135:0/1014291856 >> v1:172.21.2.135:6789/0 conn(0x7f75e80ad0b0 legacy=0x7f75e8143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 -- 172.21.2.135:0/1014291856 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80af420 con 0x7f75e8067070 2021-11-15T14:42:53.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e6d9d700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e8143950 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f75d0002f70 tx=0x7f75d0006df0).ready entity=mon.1 client_cookie=eb086e0140bed78 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e5d9b700 1 -- 172.21.2.135:0/1014291856 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000d570 con 0x7f75e8067070 2021-11-15T14:42:53.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e5d9b700 1 -- 172.21.2.135:0/1014291856 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0000e90 con 0x7f75e8067070 2021-11-15T14:42:53.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75e5d9b700 1 -- 172.21.2.135:0/1014291856 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000d8c0 con 0x7f75e8067070 2021-11-15T14:42:53.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- 172.21.2.135:0/1014291856 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 msgr2=0x7f75e8143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e8143950 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f75d0002f70 tx=0x7f75d0006df0).stop 2021-11-15T14:42:53.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- 172.21.2.135:0/1014291856 shutdown_connections 2021-11-15T14:42:53.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e80b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- 172.21.2.135:0/1014291856 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e8143950 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:53.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- 172.21.2.135:0/1014291856 >> 172.21.2.135:0/1014291856 conn(0x7f75e805f730 msgr2=0x7f75e805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:53.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- 172.21.2.135:0/1014291856 shutdown_connections 2021-11-15T14:42:53.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- 172.21.2.135:0/1014291856 wait complete. 2021-11-15T14:42:53.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 Processor -- start 2021-11-15T14:42:53.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 -- start start 2021-11-15T14:42:53.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.904+0000 7f75ed119700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e813e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75e813ea00 0x7f75e80a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b62c0 con 0x7f75e813ea00 2021-11-15T14:42:53.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b4d00 con 0x7f75e8067070 2021-11-15T14:42:53.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b4fa0 con 0x7f75e80b0760 2021-11-15T14:42:53.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34756/0 (socket says 172.21.2.135:34756) 2021-11-15T14:42:53.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 -- 172.21.2.135:0/2451283022 learned_addr learned my addr 172.21.2.135:0/2451283022 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:53.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 -- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 msgr2=0x7f75e813e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e813e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 -- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75e813ea00 msgr2=0x7f75e80a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:53.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75e813ea00 0x7f75e80a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:53.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 -- 172.21.2.135:0/2451283022 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d000b180 con 0x7f75e8067070 2021-11-15T14:42:53.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e6d9d700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f75d0002f70 tx=0x7f75d0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d0011900 con 0x7f75e8067070 2021-11-15T14:42:53.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0011a60 con 0x7f75e8067070 2021-11-15T14:42:53.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e80b5240 con 0x7f75e8067070 2021-11-15T14:42:53.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e809efc0 con 0x7f75e8067070 2021-11-15T14:42:53.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d0011dc0 con 0x7f75e8067070 2021-11-15T14:42:53.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c0003410 con 0x7f75e8067070 2021-11-15T14:42:53.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75d0025030 con 0x7f75e8067070 2021-11-15T14:42:53.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:53.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f75d006cae0 con 0x7f75e8067070 2021-11-15T14:42:53.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e659c700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:53.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.908+0000 7f75e659c700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 0x7f75cc055a00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f75e80625a0 tx=0x7f75d8007820).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:53.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:53.912+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75d0043d30 con 0x7f75e8067070 2021-11-15T14:42:54.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.024+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f75c0003c40 con 0x7f75e8067070 2021-11-15T14:42:54.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75dffff700 1 -- 172.21.2.135:0/2451283022 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v369) v1 ==== 131+0+0 (secure 0 0 0) 0x7f75d00230c0 con 0x7f75e8067070 2021-11-15T14:42:54.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 msgr2=0x7f75cc055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 0x7f75cc055a00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f75e80625a0 tx=0x7f75d8007820).stop 2021-11-15T14:42:54.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 msgr2=0x7f75e809ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f75d0002f70 tx=0x7f75d0015000).stop 2021-11-15T14:42:54.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 shutdown_connections 2021-11-15T14:42:54.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75cc053540 0x7f75cc055a00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f75e813ea00 0x7f75e80a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f75e80b0760 0x7f75e813e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 --2- 172.21.2.135:0/2451283022 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f75e8067070 0x7f75e809ead0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:54.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 >> 172.21.2.135:0/2451283022 conn(0x7f75e805f730 msgr2=0x7f75e80b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 shutdown_connections 2021-11-15T14:42:54.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.848+0000 7f75ed119700 1 -- 172.21.2.135:0/2451283022 wait complete. 2021-11-15T14:42:54.859 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:42:54.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 Processor -- start 2021-11-15T14:42:54.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 -- start start 2021-11-15T14:42:54.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f56cc060040 0x7f56cc064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f56cc0b3950 0x7f56cc065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0b2430 con 0x7f56cc0b2ca0 2021-11-15T14:42:54.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc065770 con 0x7f56cc0b3950 2021-11-15T14:42:54.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d344c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0b26d0 con 0x7f56cc060040 2021-11-15T14:42:54.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f56cc060040 0x7f56cc064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:54.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d19e9700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f56cc0b2ca0 0x7f56cc0b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50584/0 (socket says 172.21.2.135:50584) 2021-11-15T14:42:54.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d19e9700 1 -- 172.21.2.135:0/688630278 learned_addr learned my addr 172.21.2.135:0/688630278 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:54.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 -- 172.21.2.135:0/688630278 >> v2:172.21.2.119:3300/0 conn(0x7f56cc0b3950 msgr2=0x7f56cc065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:54.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 --2- 172.21.2.135:0/688630278 >> v2:172.21.2.119:3300/0 conn(0x7f56cc0b3950 0x7f56cc065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:54.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 -- 172.21.2.135:0/688630278 >> v1:172.21.2.135:6789/0 conn(0x7f56cc0b2ca0 legacy=0x7f56cc0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 -- 172.21.2.135:0/688630278 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0b2970 con 0x7f56cc060040 2021-11-15T14:42:54.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.908+0000 7f56d11e8700 1 --2- 172.21.2.135:0/688630278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc060040 0x7f56cc064d90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f56c4001490 tx=0x7f56c8006df0).ready entity=mon.1 client_cookie=8f946593f0e2779a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:54.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56bbfff700 1 -- 172.21.2.135:0/688630278 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c800d570 con 0x7f56cc060040 2021-11-15T14:42:54.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56bbfff700 1 -- 172.21.2.135:0/688630278 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8000e90 con 0x7f56cc060040 2021-11-15T14:42:54.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56bbfff700 1 -- 172.21.2.135:0/688630278 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c800d8c0 con 0x7f56cc060040 2021-11-15T14:42:54.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/688630278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc060040 msgr2=0x7f56cc064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- 172.21.2.135:0/688630278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc060040 0x7f56cc064d90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f56c4001490 tx=0x7f56c8006df0).stop 2021-11-15T14:42:54.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/688630278 shutdown_connections 2021-11-15T14:42:54.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- 172.21.2.135:0/688630278 >> v2:172.21.2.119:3300/0 conn(0x7f56cc0b3950 0x7f56cc065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:54.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- 172.21.2.135:0/688630278 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc060040 0x7f56cc064d90 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:54.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/688630278 >> 172.21.2.135:0/688630278 conn(0x7f56cc05cfe0 msgr2=0x7f56cc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:54.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/688630278 shutdown_connections 2021-11-15T14:42:54.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/688630278 wait complete. 2021-11-15T14:42:54.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 Processor -- start 2021-11-15T14:42:54.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- start start 2021-11-15T14:42:54.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56cc060040 0x7f56cc133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56cc0b2ca0 0x7f56cc131890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc134d20 con 0x7f56cc060040 2021-11-15T14:42:54.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc132270 con 0x7f56cc0b3950 2021-11-15T14:42:54.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1341f0 con 0x7f56cc0b2ca0 2021-11-15T14:42:54.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:54.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34774/0 (socket says 172.21.2.135:34774) 2021-11-15T14:42:54.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 -- 172.21.2.135:0/3227605207 learned_addr learned my addr 172.21.2.135:0/3227605207 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:54.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 -- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56cc0b2ca0 msgr2=0x7f56cc131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d09e7700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56cc0b2ca0 0x7f56cc131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:54.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56cc0b2ca0 0x7f56cc131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:54.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 -- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56cc060040 msgr2=0x7f56cc133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:54.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56cc060040 0x7f56cc133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:54.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 -- 172.21.2.135:0/3227605207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c800b180 con 0x7f56cc0b3950 2021-11-15T14:42:54.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d19e9700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f56cc13afa0 tx=0x7f56c4007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:54.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c4005ba0 con 0x7f56cc0b3950 2021-11-15T14:42:54.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c4005d00 con 0x7f56cc0b3950 2021-11-15T14:42:54.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc132e40 con 0x7f56cc0b3950 2021-11-15T14:42:54.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c4007300 con 0x7f56cc0b3950 2021-11-15T14:42:54.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc134450 con 0x7f56cc0b3950 2021-11-15T14:42:54.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc0648f0 con 0x7f56cc0b3950 2021-11-15T14:42:54.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f56c4010030 con 0x7f56cc0b3950 2021-11-15T14:42:54.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.912+0000 7f56ba7fc700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 0x7f56ac0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:54.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.916+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f56c406b8e0 con 0x7f56cc0b3950 2021-11-15T14:42:54.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.916+0000 7f56d11e8700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 0x7f56ac0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:54.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.916+0000 7f56d11e8700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 0x7f56ac0559b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f56c4001490 tx=0x7f56c8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:54.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:54.916+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56c4042bc0 con 0x7f56cc0b3950 2021-11-15T14:42:55.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.000+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f56cc0573d0 con 0x7f56cc0b3950 2021-11-15T14:42:55.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56ba7fc700 1 -- 172.21.2.135:0/3227605207 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56c40461e0 con 0x7f56cc0b3950 2021-11-15T14:42:55.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 msgr2=0x7f56ac0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 0x7f56ac0559b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f56c4001490 tx=0x7f56c8014000).stop 2021-11-15T14:42:55.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 msgr2=0x7f56cc131d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f56cc13afa0 tx=0x7f56c4007f00).stop 2021-11-15T14:42:55.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 shutdown_connections 2021-11-15T14:42:55.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f56ac0534f0 0x7f56ac0559b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f56cc0b3950 0x7f56cc131d80 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56cc0b2ca0 0x7f56cc131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 --2- 172.21.2.135:0/3227605207 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f56cc060040 0x7f56cc133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 >> 172.21.2.135:0/3227605207 conn(0x7f56cc05cfe0 msgr2=0x7f56cc0b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 shutdown_connections 2021-11-15T14:42:55.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.012+0000 7f56d344c700 1 -- 172.21.2.135:0/3227605207 wait complete. 2021-11-15T14:42:55.023 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:42:55.023 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:55.032 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:55.045 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:55.053 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:42:55.066 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:42:55.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:55.066 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:55.067 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:42:55.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:55.114 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:42:55.114 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:42:55.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:42:55.115 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:42:55.116 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:42:55.123 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:42:55.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:42:55.124 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:42:55.125 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:42:55.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 Processor -- start 2021-11-15T14:42:55.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 -- start start 2021-11-15T14:42:55.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46400b1e30 0x7f46400b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400a7140 0x7f46401447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46400b03d0 con 0x7f4640148420 2021-11-15T14:42:55.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46400a9140 con 0x7f46400b1e30 2021-11-15T14:42:55.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f464757b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46400b0670 con 0x7f46400a7140 2021-11-15T14:42:55.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46400b1e30 0x7f46400b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46400b1e30 0x7f46400b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34778/0 (socket says 172.21.2.135:34778) 2021-11-15T14:42:55.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 -- 172.21.2.135:0/3841184407 learned_addr learned my addr 172.21.2.135:0/3841184407 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 -- 172.21.2.135:0/3841184407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400a7140 msgr2=0x7f46401447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:55.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 --2- 172.21.2.135:0/3841184407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400a7140 0x7f46401447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 -- 172.21.2.135:0/3841184407 >> v1:172.21.2.119:6789/0 conn(0x7f4640148420 legacy=0x7f46400b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:55.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 -- 172.21.2.135:0/3841184407 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400b0910 con 0x7f46400b1e30 2021-11-15T14:42:55.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.192+0000 7f4645317700 1 --2- 172.21.2.135:0/3841184407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400b1e30 0x7f46400b1050 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f46401477b0 tx=0x7f463c006eb0).ready entity=mon.1 client_cookie=10e259e7356f84be server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4633fff700 1 -- 172.21.2.135:0/3841184407 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00d570 con 0x7f46400b1e30 2021-11-15T14:42:55.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4633fff700 1 -- 172.21.2.135:0/3841184407 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c000e90 con 0x7f46400b1e30 2021-11-15T14:42:55.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4633fff700 1 -- 172.21.2.135:0/3841184407 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00d900 con 0x7f46400b1e30 2021-11-15T14:42:55.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/3841184407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400b1e30 msgr2=0x7f46400b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- 172.21.2.135:0/3841184407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400b1e30 0x7f46400b1050 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f46401477b0 tx=0x7f463c006eb0).stop 2021-11-15T14:42:55.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/3841184407 shutdown_connections 2021-11-15T14:42:55.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- 172.21.2.135:0/3841184407 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400a7140 0x7f46401447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- 172.21.2.135:0/3841184407 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400b1e30 0x7f46400b1050 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/3841184407 >> 172.21.2.135:0/3841184407 conn(0x7f464005f730 msgr2=0x7f464005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/3841184407 shutdown_connections 2021-11-15T14:42:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/3841184407 wait complete. 2021-11-15T14:42:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 Processor -- start 2021-11-15T14:42:55.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- start start 2021-11-15T14:42:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400b1e30 0x7f464015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4640148420 0x7f46400b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46400a95a0 con 0x7f4640148420 2021-11-15T14:42:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640149d90 con 0x7f46400a7140 2021-11-15T14:42:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4640149af0 con 0x7f46400b1e30 2021-11-15T14:42:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34784/0 (socket says 172.21.2.135:34784) 2021-11-15T14:42:55.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 -- 172.21.2.135:0/2812752032 learned_addr learned my addr 172.21.2.135:0/2812752032 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 -- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400b1e30 msgr2=0x7f464015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400b1e30 0x7f464015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 -- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4640148420 msgr2=0x7f46400b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4640148420 0x7f46400b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 -- 172.21.2.135:0/2812752032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c00b1e0 con 0x7f46400a7140 2021-11-15T14:42:55.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f4645317700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f46400aa8d0 tx=0x7f463c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00de60 con 0x7f46400a7140 2021-11-15T14:42:55.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c002f50 con 0x7f46400a7140 2021-11-15T14:42:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464015a3c0 con 0x7f46400a7140 2021-11-15T14:42:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c011e90 con 0x7f46400a7140 2021-11-15T14:42:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46400ad5b0 con 0x7f46400a7140 2021-11-15T14:42:55.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46400573d0 con 0x7f46400a7140 2021-11-15T14:42:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f463c025030 con 0x7f46400a7140 2021-11-15T14:42:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 0x7f46200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.196+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f463c06cc00 con 0x7f46400a7140 2021-11-15T14:42:55.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.200+0000 7f4644b16700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 0x7f46200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.200+0000 7f4644b16700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 0x7f46200559b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f4634002fb0 tx=0x7f46340069d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.200+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f463c072020 con 0x7f46400a7140 2021-11-15T14:42:55.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f46400446d0 con 0x7f46400a7140 2021-11-15T14:42:55.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f46327fc700 1 -- 172.21.2.135:0/2812752032 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f463c023020 con 0x7f46400a7140 2021-11-15T14:42:55.288 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:55.288 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:55.289 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 139, 2021-11-15T14:42:55.289 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:42:55.289 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:42:55.289 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:42:52.826691+0000", 2021-11-15T14:42:55.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:55.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:42:55.290 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:42:55.290 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:42:55.291 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:42:55.291 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:42:55.291 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:42:55.292 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:42:55.292 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:42:55.292 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:55.293 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:42:55.293 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:42:55.293 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:42:55.293 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:42:55.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:42:55.294 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 24, 2021-11-15T14:42:55.294 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:42:55.294 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:42:55.295 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:42:55.295 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:42:55.295 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:42:55.295 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.296 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:42:55.296 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:42:55.296 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:42:55.296 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:55.296 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:55.297 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:55.297 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:55.297 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:55.297 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:55.298 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:55.298 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:55.298 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:42:55.298 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:42:55.299 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:42:55.299 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:42:55.299 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:42:55.299 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:55.299 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:55.300 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:55.300 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:55.300 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:55.300 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:55.301 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:55.301 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.301 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:42:55.302 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:55.302 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:55.302 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:55.302 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:55.303 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:55.303 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:55.303 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:55.304 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:55.304 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:55.304 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:55.305 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:55.305 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:55.306 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:55.306 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:55.307 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:55.307 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:55.307 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:55.308 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:55.308 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:55.309 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:55.309 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:55.309 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:55.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:55.310 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:55.310 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:55.311 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:55.311 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.311 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:55.312 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:55.312 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:55.312 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:55.312 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:55.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:55.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:55.313 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:55.313 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:55.313 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:55.314 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:55.314 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:42:55.314 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:42:55.314 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.315 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:55.315 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:42:55.315 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.316 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.316 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:42:55.316 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:42:55.316 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:42:55.317 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:42:55.317 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:42:55.317 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:42:55.317 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:42:55.317 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:42:55.318 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:42:55.318 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:42:55.318 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:42:55.318 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:42:55.319 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:42:55.319 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:42:55.319 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:42:55.319 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:42:55.320 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:42:55.320 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:42:55.320 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:42:55.320 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:42:55.320 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:42:55.321 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:42:55.321 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:42:55.321 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.321 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:42:55.322 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:42:55.322 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:42:55.322 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:42:55.322 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:42:55.323 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:42:55.323 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:42:55.323 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:42:55.323 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:42:55.324 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:42:55.324 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:42:55.324 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:42:55.324 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:42:55.325 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:42:55.325 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:42:55.325 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:42:55.325 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:42:55.326 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:42:55.326 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:42:55.326 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:42:55.326 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:42:55.326 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:42:55.327 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:42:55.327 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:42:55.327 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:42:55.327 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:42:55.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:42:55.328 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.328 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:42:55.328 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:42:55.329 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:42:55.329 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:42:55.329 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:42:55.329 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:42:55.329 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:42:55.330 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:42:55.330 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:42:55.330 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:42:55.330 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:42:55.331 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:42:55.331 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:42:55.331 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:42:55.331 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.332 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.332 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:55.332 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:42:55.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.333 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:55.333 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:42:55.333 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.334 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.334 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.334 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.334 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.335 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.335 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.335 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 111, 2021-11-15T14:42:55.335 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.336 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.336 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.336 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.336 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.337 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.337 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:42:55.337 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.338 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.338 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:42:55.338 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.338 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.339 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.339 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.339 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.339 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.340 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.340 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:42:55.340 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:42:55.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.342 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.342 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.342 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.343 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.343 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:42:55.344 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.344 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.345 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:42:55.345 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.345 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.345 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.346 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.346 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.346 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.346 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:42:55.347 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.347 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.347 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.348 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:42:55.348 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:42:55.348 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.348 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.349 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.349 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:42:55.349 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:42:55.349 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:42:55.349 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:42:55.350 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.350 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.350 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.350 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.351 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.351 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.351 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:55.351 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:42:55.352 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.352 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.352 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.353 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.353 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.353 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.354 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:55.354 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.354 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.354 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.355 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.355 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.355 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:42:55.355 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.356 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.356 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.356 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:42:55.357 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.357 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.357 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.357 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.358 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.358 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.358 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.358 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:42:55.359 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.359 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.359 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:42:55.360 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.360 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.360 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.361 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.361 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.362 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.362 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:42:55.362 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.363 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:42:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.364 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.365 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.365 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.365 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.365 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:42:55.366 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.366 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.366 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.366 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.367 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:42:55.367 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:42:55.367 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.367 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.368 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.368 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:42:55.368 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:42:55.368 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:42:55.368 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:42:55.369 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.369 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.369 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.369 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.370 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.370 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:55.370 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:42:55.371 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.371 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.371 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.371 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.371 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.372 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.372 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.372 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:42:55.372 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.373 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.373 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.373 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.373 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.374 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.374 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:42:55.374 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.375 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.375 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:42:55.375 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.376 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.376 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.376 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.376 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.377 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.377 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.377 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.377 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:42:55.377 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.378 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.378 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.378 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:42:55.379 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.379 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.379 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.379 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.380 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.380 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.380 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:42:55.381 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.381 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.382 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.382 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:42:55.382 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.383 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.383 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.383 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.383 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.384 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.384 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.385 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:42:55.385 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.385 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.386 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.386 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.386 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:42:55.386 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:42:55.387 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.387 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.388 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.388 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:42:55.388 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:42:55.389 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:42:55.389 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:42:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.390 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.391 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.392 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:42:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.393 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.394 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.395 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:42:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.397 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:42:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.399 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:42:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.400 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:42:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.401 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.402 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:42:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.403 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:42:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.404 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.405 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:42:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.406 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:42:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:42:55.407 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:42:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:42:55.408 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:42:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:42:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.409 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:55.410 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:42:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.411 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:55.412 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.413 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:42:55.414 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:42:55.415 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.416 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:42:55.417 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.418 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:42:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.419 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.420 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:42:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.421 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:42:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.423 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:42:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:42:55.425 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:42:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:42:55.426 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:42:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:42:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:42:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.427 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.428 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:42:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.429 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.430 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.431 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:42:55.432 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.433 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:42:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.434 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:42:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.436 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:42:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.437 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.438 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:42:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.439 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:42:55.440 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.441 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:42:55.442 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.443 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:42:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:42:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:42:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:42:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:42:55.445 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:42:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.446 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:55.447 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:42:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.448 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:42:55.449 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.450 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:42:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.451 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:42:55.452 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.453 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:42:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.455 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:42:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.457 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:42:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:42:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.459 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.460 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:42:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.461 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:42:55.462 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:42:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.463 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:42:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:42:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:42:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:42:55.464 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.465 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:42:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:42:55.466 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:42:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:42:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:42:55.467 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:42:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:42:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:42:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 135, 2021-11-15T14:42:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:42:55.468 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:42:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:42:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:42:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.470 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:42:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.471 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:42:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:42:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.473 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:42:55.474 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.475 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:42:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:42:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:42:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.478 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:42:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:42:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.479 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:42:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:42:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.480 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:42:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:42:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:42:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.481 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:42:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:42:55.482 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:42:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:42:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:42:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:42:55.483 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:42:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.484 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:42:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:42:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.485 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.486 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:42:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:42:55.487 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.488 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:42:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.489 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:42:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.490 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:42:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.491 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:42:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.492 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.493 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:42:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.494 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:42:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.495 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:42:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:42:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.497 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:42:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:42:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.499 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.500 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:42:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:55.501 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:42:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:42:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:42:55.502 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:42:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:42:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:42:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:42:55.503 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:42:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:42:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:42:55.504 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:42:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:42:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:42:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:42:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/2122454907": "2021-11-16T14:42:34.744826+0000", 2021-11-15T14:42:55.505 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/2122454907": "2021-11-16T14:42:34.744826+0000" 2021-11-15T14:42:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:42:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:42:55.506 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:42:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:42:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:42:55.507 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:42:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:42:55.508 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:42:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:42:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:42:55.509 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:42:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:42:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:42:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:42:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:42:55.510 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:42:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:42:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:42:55.511 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:42:55.512 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:42:55.512 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:55.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 msgr2=0x7f46200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 0x7f46200559b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f4634002fb0 tx=0x7f46340069d0).stop 2021-11-15T14:42:55.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 msgr2=0x7f46400ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f46400aa8d0 tx=0x7f463c015000).stop 2021-11-15T14:42:55.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 shutdown_connections 2021-11-15T14:42:55.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46200534f0 0x7f46200559b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4640148420 0x7f46400b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46400b1e30 0x7f464015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 --2- 172.21.2.135:0/2812752032 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46400a7140 0x7f46400ad0c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 >> 172.21.2.135:0/2812752032 conn(0x7f464005f730 msgr2=0x7f46401438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 shutdown_connections 2021-11-15T14:42:55.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.284+0000 7f464757b700 1 -- 172.21.2.135:0/2812752032 wait complete. 2021-11-15T14:42:55.518 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:55.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.568+0000 7f43b7acc700 1 Processor -- start 2021-11-15T14:42:55.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.568+0000 7f43b7acc700 1 -- start start 2021-11-15T14:42:55.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f43b00ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f43b00b0bb0 0x7f43b013f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00b04b0 con 0x7f43b00afca0 2021-11-15T14:42:55.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b00b57d0 con 0x7f43b00b0bb0 2021-11-15T14:42:55.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00b06e0 con 0x7f43b005d7e0 2021-11-15T14:42:55.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b5067700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f43b00afca0 0x7f43b013f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50612/0 (socket says 172.21.2.135:50612) 2021-11-15T14:42:55.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b5067700 1 -- 172.21.2.135:0/2928886502 learned_addr learned my addr 172.21.2.135:0/2928886502 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:55.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170630244 0 0) 0x7f43b00b04b0 con 0x7f43b00afca0 2021-11-15T14:42:55.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4398003260 con 0x7f43b00afca0 2021-11-15T14:42:55.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58459649 0 0) 0x7f4398003260 con 0x7f43b00afca0 2021-11-15T14:42:55.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b5868700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f43b00ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 --2- 172.21.2.135:0/2928886502 >> v2:172.21.2.119:3300/0 conn(0x7f43b00b0bb0 0x7f43b013f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 msgr2=0x7f43b00ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:55.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f43b00ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 >> v2:172.21.2.119:3300/0 conn(0x7f43b00b0bb0 msgr2=0x7f43b013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:55.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 --2- 172.21.2.135:0/2928886502 >> v2:172.21.2.119:3300/0 conn(0x7f43b00b0bb0 0x7f43b013f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00b5a30 con 0x7f43b00afca0 2021-11-15T14:42:55.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f43a0001660 con 0x7f43b00afca0 2021-11-15T14:42:55.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 >> v1:172.21.2.135:6789/0 conn(0x7f43b00afca0 legacy=0x7f43b013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43980037d0 0x7f4398003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f4398004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f4398004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00b57d0 con 0x7f43980037d0 2021-11-15T14:42:55.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00b06e0 con 0x7f43980049f0 2021-11-15T14:42:55.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439800fe40 con 0x7f43b005d7e0 2021-11-15T14:42:55.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f4398004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b5067700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f4398004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b5868700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43980037d0 0x7f4398003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 -- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 msgr2=0x7f4398004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:55.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b005d7e0 0x7f4398004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 -- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43980037d0 msgr2=0x7f4398003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:55.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43980037d0 0x7f4398003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 -- 172.21.2.135:0/2928886502 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398003260 con 0x7f43980049f0 2021-11-15T14:42:55.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f4398004e70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f43a8007000 tx=0x7f43a8008040).ready entity=mon.1 client_cookie=3df63b9869ad0670 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a800c640 con 0x7f43980049f0 2021-11-15T14:42:55.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a800c7a0 con 0x7f43980049f0 2021-11-15T14:42:55.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b4866700 1 -- 172.21.2.135:0/2928886502 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a800cb00 con 0x7f43980049f0 2021-11-15T14:42:55.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- 172.21.2.135:0/2928886502 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 msgr2=0x7f4398004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 --2- 172.21.2.135:0/2928886502 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f4398004e70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f43a8007000 tx=0x7f43a8008040).stop 2021-11-15T14:42:55.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b6069700 1 -- 172.21.2.135:0/2928886502 reap_dead start 2021-11-15T14:42:55.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- 172.21.2.135:0/2928886502 shutdown_connections 2021-11-15T14:42:55.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- 172.21.2.135:0/2928886502 >> 172.21.2.135:0/2928886502 conn(0x7f43b0062cb0 msgr2=0x7f43b0063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- 172.21.2.135:0/2928886502 shutdown_connections 2021-11-15T14:42:55.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- 172.21.2.135:0/2928886502 wait complete. 2021-11-15T14:42:55.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 Processor -- start 2021-11-15T14:42:55.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.572+0000 7f43b7acc700 1 -- start start 2021-11-15T14:42:55.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b0140740 0x7f43b0141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43b0152070 0x7f43b0137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b01437a0 con 0x7f43b0152070 2021-11-15T14:42:55.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0145ff0 con 0x7f43980049f0 2021-11-15T14:42:55.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0143120 con 0x7f43b0140740 2021-11-15T14:42:55.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34804/0 (socket says 172.21.2.135:34804) 2021-11-15T14:42:55.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 -- 172.21.2.135:0/1465258162 learned_addr learned my addr 172.21.2.135:0/1465258162 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5067700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b0140740 0x7f43b0141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 -- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b0140740 msgr2=0x7f43b0141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b0140740 0x7f43b0141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 -- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43b0152070 msgr2=0x7f43b0137a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43b0152070 0x7f43b0137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 -- 172.21.2.135:0/1465258162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b01433c0 con 0x7f43980049f0 2021-11-15T14:42:55.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5868700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f43ac00b000 tx=0x7f43ac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac016070 con 0x7f43980049f0 2021-11-15T14:42:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac000e90 con 0x7f43980049f0 2021-11-15T14:42:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b0145d50 con 0x7f43980049f0 2021-11-15T14:42:55.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b013fab0 con 0x7f43980049f0 2021-11-15T14:42:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac011750 con 0x7f43980049f0 2021-11-15T14:42:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00b5cd0 con 0x7f43980049f0 2021-11-15T14:42:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43ac0118b0 con 0x7f43980049f0 2021-11-15T14:42:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 0x7f4390055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f43ac06b610 con 0x7f43980049f0 2021-11-15T14:42:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5067700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 0x7f4390055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.576+0000 7f43b5067700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 0x7f4390055ac0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f43a0006000 tx=0x7f43b00ae5c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.580+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43ac0428f0 con 0x7f43980049f0 2021-11-15T14:42:55.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43b00573d0 con 0x7f43980049f0 2021-11-15T14:42:55.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f439effd700 1 -- 172.21.2.135:0/1465258162 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+504 (secure 0 0 0) 0x7f43ac045f10 con 0x7f43980049f0 2021-11-15T14:42:55.688 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:55.688 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-15T14:42:55.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 msgr2=0x7f4390055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 0x7f4390055ac0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f43a0006000 tx=0x7f43b00ae5c0).stop 2021-11-15T14:42:55.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 msgr2=0x7f43b0151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f43ac00b000 tx=0x7f43ac008040).stop 2021-11-15T14:42:55.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 shutdown_connections 2021-11-15T14:42:55.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4390053600 0x7f4390055ac0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f43b0152070 0x7f43b0137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43b0140740 0x7f43b0141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 --2- 172.21.2.135:0/1465258162 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43980049f0 0x7f43b0151800 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 >> 172.21.2.135:0/1465258162 conn(0x7f43b0062cb0 msgr2=0x7f43b0138830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 shutdown_connections 2021-11-15T14:42:55.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.684+0000 7f43b7acc700 1 -- 172.21.2.135:0/1465258162 wait complete. 2021-11-15T14:42:55.693 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 66 2021-11-15T14:42:55.695 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:42:55.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 Processor -- start 2021-11-15T14:42:55.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 -- start start 2021-11-15T14:42:55.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040b1e30 0x7f64040b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6404148420 0x7f64040b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64040a7140 0x7f64041447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040a9140 con 0x7f6404148420 2021-11-15T14:42:55.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040b03d0 con 0x7f64040a7140 2021-11-15T14:42:55.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.740+0000 7f6408b8a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64040b0670 con 0x7f64040b1e30 2021-11-15T14:42:55.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64040a7140 0x7f64041447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f64040a7140 0x7f64041447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34810/0 (socket says 172.21.2.135:34810) 2021-11-15T14:42:55.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/1771335911 learned_addr learned my addr 172.21.2.135:0/1771335911 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/1771335911 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040b1e30 msgr2=0x7f64040b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:55.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/1771335911 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040b1e30 0x7f64040b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/1771335911 >> v2:172.21.2.119:3300/0 conn(0x7f6404148420 msgr2=0x7f64040b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:55.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/1771335911 >> v2:172.21.2.119:3300/0 conn(0x7f6404148420 0x7f64040b2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/1771335911 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040b0910 con 0x7f64040a7140 2021-11-15T14:42:55.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/1771335911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64040a7140 0x7f64041447a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f63fc0032f0 tx=0x7f63fc009290).ready entity=mon.1 client_cookie=6f22a460da22e148 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f640159a700 1 -- 172.21.2.135:0/1771335911 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc00b870 con 0x7f64040a7140 2021-11-15T14:42:55.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f640159a700 1 -- 172.21.2.135:0/1771335911 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc00b9d0 con 0x7f64040a7140 2021-11-15T14:42:55.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f640159a700 1 -- 172.21.2.135:0/1771335911 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc00bb80 con 0x7f64040a7140 2021-11-15T14:42:55.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/1771335911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64040a7140 msgr2=0x7f64041447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- 172.21.2.135:0/1771335911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64040a7140 0x7f64041447a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f63fc0032f0 tx=0x7f63fc009290).stop 2021-11-15T14:42:55.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/1771335911 shutdown_connections 2021-11-15T14:42:55.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- 172.21.2.135:0/1771335911 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f64040a7140 0x7f64041447a0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- 172.21.2.135:0/1771335911 >> v2:172.21.2.119:3300/0 conn(0x7f6404148420 0x7f64040b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- 172.21.2.135:0/1771335911 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040b1e30 0x7f64040b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/1771335911 >> 172.21.2.135:0/1771335911 conn(0x7f640405f730 msgr2=0x7f640405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/1771335911 shutdown_connections 2021-11-15T14:42:55.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/1771335911 wait complete. 2021-11-15T14:42:55.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 Processor -- start 2021-11-15T14:42:55.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- start start 2021-11-15T14:42:55.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040a7140 0x7f6404143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64040b1e30 0x7f6404156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640415aa50 con 0x7f64040b1e30 2021-11-15T14:42:55.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640413d800 con 0x7f6404148420 2021-11-15T14:42:55.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6404156a50 con 0x7f64040a7140 2021-11-15T14:42:55.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34816/0 (socket says 172.21.2.135:34816) 2021-11-15T14:42:55.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/3231459690 learned_addr learned my addr 172.21.2.135:0/3231459690 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040a7140 msgr2=0x7f6404143110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:55.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040a7140 0x7f6404143110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64040b1e30 msgr2=0x7f6404156f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:42:55.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64040b1e30 0x7f6404156f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 -- 172.21.2.135:0/3231459690 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009530 con 0x7f6404148420 2021-11-15T14:42:55.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6402d9d700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f63fc0032f0 tx=0x7f63fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc021440 con 0x7f6404148420 2021-11-15T14:42:55.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc0215a0 con 0x7f6404148420 2021-11-15T14:42:55.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640415ac80 con 0x7f6404148420 2021-11-15T14:42:55.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc021900 con 0x7f6404148420 2021-11-15T14:42:55.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6404157900 con 0x7f6404148420 2021-11-15T14:42:55.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64040b0bb0 con 0x7f6404148420 2021-11-15T14:42:55.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.744+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63fc027020 con 0x7f6404148420 2021-11-15T14:42:55.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.748+0000 7f63fb7fe700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 0x7f63e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.748+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f63fc06cde0 con 0x7f6404148420 2021-11-15T14:42:55.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.748+0000 7f640259c700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 0x7f63e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.748+0000 7f640259c700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 0x7f63e8055b60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f63ec002fb0 tx=0x7f63ec006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.748+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63fc043fb0 con 0x7f6404148420 2021-11-15T14:42:55.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64040aca60 con 0x7f6404148420 2021-11-15T14:42:55.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f63fb7fe700 1 -- 172.21.2.135:0/3231459690 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+504 (secure 0 0 0) 0x7f63fc015020 con 0x7f6404148420 2021-11-15T14:42:55.860 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:55.861 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-15T14:42:55.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 msgr2=0x7f63e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 0x7f63e8055b60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f63ec002fb0 tx=0x7f63ec006930).stop 2021-11-15T14:42:55.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 msgr2=0x7f6404157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f63fc0032f0 tx=0x7f63fc016000).stop 2021-11-15T14:42:55.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 shutdown_connections 2021-11-15T14:42:55.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f63e80536a0 0x7f63e8055b60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6404148420 0x7f6404157410 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f64040b1e30 0x7f6404156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 --2- 172.21.2.135:0/3231459690 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f64040a7140 0x7f6404143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:55.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 >> 172.21.2.135:0/3231459690 conn(0x7f640405f730 msgr2=0x7f64040af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 shutdown_connections 2021-11-15T14:42:55.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.856+0000 7f6408b8a700 1 -- 172.21.2.135:0/3231459690 wait complete. 2021-11-15T14:42:55.864 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 66 2021-11-15T14:42:55.868 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:42:55.868 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:42:55.868 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:42:55.869 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:42:55.869 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:42:55.870 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:42:55.872 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:42:55.872 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:42:55.873 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:55.873 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:55.874 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:42:55.874 DEBUG:teuthology.parallel:result is None 2021-11-15T14:42:55.875 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:42:55.904 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:42:55.904 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:42:55.907 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:42:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 Processor -- start 2021-11-15T14:42:55.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 -- start start 2021-11-15T14:42:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 0x7f340414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34040b6d60 con 0x7f34040b6980 2021-11-15T14:42:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3404061260 con 0x7f3404060990 2021-11-15T14:42:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f340af5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3404061500 con 0x7f34040acdd0 2021-11-15T14:42:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f3403fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3404060990 0x7f34040aa650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50668/0 (socket says 172.21.2.135:50668) 2021-11-15T14:42:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f3403fff700 1 -- 172.21.2.135:0/1029891957 learned_addr learned my addr 172.21.2.135:0/1029891957 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:55.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f34094fc700 1 --2- 172.21.2.135:0/1029891957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 0x7f340414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f34094fc700 1 -- 172.21.2.135:0/1029891957 >> v1:172.21.2.135:6789/0 conn(0x7f3404060990 legacy=0x7f34040aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f34094fc700 1 -- 172.21.2.135:0/1029891957 >> v1:172.21.2.119:6789/0 conn(0x7f34040b6980 legacy=0x7f34040a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f34094fc700 1 -- 172.21.2.135:0/1029891957 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040617a0 con 0x7f34040acdd0 2021-11-15T14:42:55.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.924+0000 7f34094fc700 1 --2- 172.21.2.135:0/1029891957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 0x7f340414a2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f33fc0032f0 tx=0x7f33fc0091d0).ready entity=mon.2 client_cookie=4484a89b30a15aaf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34037fe700 1 -- 172.21.2.135:0/1029891957 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33fc00b8a0 con 0x7f34040acdd0 2021-11-15T14:42:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34037fe700 1 -- 172.21.2.135:0/1029891957 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc00ba00 con 0x7f34040acdd0 2021-11-15T14:42:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34037fe700 1 -- 172.21.2.135:0/1029891957 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33fc00bb70 con 0x7f34040acdd0 2021-11-15T14:42:55.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/1029891957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 msgr2=0x7f340414a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 --2- 172.21.2.135:0/1029891957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 0x7f340414a2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f33fc0032f0 tx=0x7f33fc0091d0).stop 2021-11-15T14:42:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/1029891957 shutdown_connections 2021-11-15T14:42:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 --2- 172.21.2.135:0/1029891957 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f34040acdd0 0x7f340414a2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/1029891957 >> 172.21.2.135:0/1029891957 conn(0x7f34040b3500 msgr2=0x7f34040b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:55.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/1029891957 shutdown_connections 2021-11-15T14:42:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/1029891957 wait complete. 2021-11-15T14:42:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 Processor -- start 2021-11-15T14:42:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- start start 2021-11-15T14:42:55.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3404060990 0x7f340414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f34040acdd0 0x7f340413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404152530 con 0x7f34040acdd0 2021-11-15T14:42:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34040630b0 con 0x7f34040b6980 2021-11-15T14:42:55.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3404063350 con 0x7f3404060990 2021-11-15T14:42:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34858/0 (socket says 172.21.2.135:34858) 2021-11-15T14:42:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 -- 172.21.2.135:0/369773320 learned_addr learned my addr 172.21.2.135:0/369773320 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:55.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3408cfb700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3404060990 0x7f340414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3403fff700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f34040acdd0 0x7f340413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 -- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3404060990 msgr2=0x7f340414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3404060990 0x7f340414e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 -- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f34040acdd0 msgr2=0x7f340413e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:55.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f34040acdd0 0x7f340413e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:55.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 -- 172.21.2.135:0/369773320 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009470 con 0x7f34040b6980 2021-11-15T14:42:55.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f34094fc700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f33fc0032f0 tx=0x7f33fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33fc00bde0 con 0x7f34040b6980 2021-11-15T14:42:55.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc01f3f0 con 0x7f34040b6980 2021-11-15T14:42:55.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34040af510 con 0x7f34040b6980 2021-11-15T14:42:55.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33fc01f750 con 0x7f34040b6980 2021-11-15T14:42:55.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3404152090 con 0x7f34040b6980 2021-11-15T14:42:55.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404061a40 con 0x7f34040b6980 2021-11-15T14:42:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f33fc026030 con 0x7f34040b6980 2021-11-15T14:42:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 0x7f33e8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f33fc06c4f0 con 0x7f34040b6980 2021-11-15T14:42:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.928+0000 7f3408cfb700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 0x7f33e8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:55.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.932+0000 7f3408cfb700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 0x7f33e8055b00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f33f400d000 tx=0x7f33f4000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:55.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:55.932+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f33fc0437d0 con 0x7f34040b6980 2021-11-15T14:42:56.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:56.028+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f34040573d0 con 0x7f34040b6980 2021-11-15T14:42:57.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f3401ffb700 1 -- 172.21.2.135:0/369773320 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33fc046df0 con 0x7f34040b6980 2021-11-15T14:42:57.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 msgr2=0x7f33e8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 0x7f33e8055b00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f33f400d000 tx=0x7f33f4000bc0).stop 2021-11-15T14:42:57.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 msgr2=0x7f3404143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f33fc0032f0 tx=0x7f33fc016000).stop 2021-11-15T14:42:57.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 shutdown_connections 2021-11-15T14:42:57.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33e8053640 0x7f33e8055b00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f34040b6980 0x7f3404143640 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f34040acdd0 0x7f340413e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 --2- 172.21.2.135:0/369773320 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3404060990 0x7f340414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 >> 172.21.2.135:0/369773320 conn(0x7f34040b3500 msgr2=0x7f34040b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 shutdown_connections 2021-11-15T14:42:57.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.024+0000 7f340af5f700 1 -- 172.21.2.135:0/369773320 wait complete. 2021-11-15T14:42:57.031 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:42:57.034 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:42:57.035 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:42:57.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 Processor -- start 2021-11-15T14:42:57.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 -- start start 2021-11-15T14:42:57.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f99bc148420 0x7f99bc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99bc0a7140 0x7f99bc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b03d0 con 0x7f99bc0b1e30 2021-11-15T14:42:57.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0a9140 con 0x7f99bc148420 2021-11-15T14:42:57.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0b0670 con 0x7f99bc0a7140 2021-11-15T14:42:57.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99bc0a7140 0x7f99bc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99bc0a7140 0x7f99bc1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34868/0 (socket says 172.21.2.135:34868) 2021-11-15T14:42:57.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 -- 172.21.2.135:0/1837636672 learned_addr learned my addr 172.21.2.135:0/1837636672 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 -- 172.21.2.135:0/1837636672 >> v2:172.21.2.119:3300/0 conn(0x7f99bc148420 msgr2=0x7f99bc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 --2- 172.21.2.135:0/1837636672 >> v2:172.21.2.119:3300/0 conn(0x7f99bc148420 0x7f99bc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 -- 172.21.2.135:0/1837636672 >> v1:172.21.2.119:6789/0 conn(0x7f99bc0b1e30 legacy=0x7f99bc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 -- 172.21.2.135:0/1837636672 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0b0910 con 0x7f99bc0a7140 2021-11-15T14:42:57.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c14dd700 1 --2- 172.21.2.135:0/1837636672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc1447a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f99bc0acee0 tx=0x7f99b4009290).ready entity=mon.1 client_cookie=7325fb4a38938165 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99bb7fe700 1 -- 172.21.2.135:0/1837636672 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99b400b820 con 0x7f99bc0a7140 2021-11-15T14:42:57.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99bb7fe700 1 -- 172.21.2.135:0/1837636672 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400b980 con 0x7f99bc0a7140 2021-11-15T14:42:57.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99bb7fe700 1 -- 172.21.2.135:0/1837636672 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99b400bb30 con 0x7f99bc0a7140 2021-11-15T14:42:57.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.172+0000 7f99c2f40700 1 -- 172.21.2.135:0/1837636672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 msgr2=0x7f99bc1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1837636672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc1447a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f99bc0acee0 tx=0x7f99b4009290).stop 2021-11-15T14:42:57.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1837636672 shutdown_connections 2021-11-15T14:42:57.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1837636672 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc1447a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1837636672 >> v2:172.21.2.119:3300/0 conn(0x7f99bc148420 0x7f99bc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1837636672 >> 172.21.2.135:0/1837636672 conn(0x7f99bc05f730 msgr2=0x7f99bc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1837636672 shutdown_connections 2021-11-15T14:42:57.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1837636672 wait complete. 2021-11-15T14:42:57.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 Processor -- start 2021-11-15T14:42:57.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- start start 2021-11-15T14:42:57.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99bc0b1e30 0x7f99bc145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99bc148420 0x7f99bc0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0ada70 con 0x7f99bc0b1e30 2021-11-15T14:42:57.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0adca0 con 0x7f99bc0a7140 2021-11-15T14:42:57.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0adf40 con 0x7f99bc148420 2021-11-15T14:42:57.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34872/0 (socket says 172.21.2.135:34872) 2021-11-15T14:42:57.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 -- 172.21.2.135:0/1677313938 learned_addr learned my addr 172.21.2.135:0/1677313938 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 -- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99bc148420 msgr2=0x7f99bc0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99bc148420 0x7f99bc0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 -- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99bc0b1e30 msgr2=0x7f99bc145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99bc0b1e30 0x7f99bc145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 -- 172.21.2.135:0/1677313938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009530 con 0x7f99bc0a7140 2021-11-15T14:42:57.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c0cdc700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f99bc0afa60 tx=0x7f99a4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a4013460 con 0x7f99bc0a7140 2021-11-15T14:42:57.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40135c0 con 0x7f99bc0a7140 2021-11-15T14:42:57.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0af780 con 0x7f99bc0a7140 2021-11-15T14:42:57.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0ae7b0 con 0x7f99bc0a7140 2021-11-15T14:42:57.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a4013920 con 0x7f99bc0a7140 2021-11-15T14:42:57.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc0ab230 con 0x7f99bc0a7140 2021-11-15T14:42:57.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99a401a060 con 0x7f99bc0a7140 2021-11-15T14:42:57.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.176+0000 7f99b9ffb700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 0x7f99a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.180+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f99a406b1f0 con 0x7f99bc0a7140 2021-11-15T14:42:57.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.180+0000 7f99bbfff700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 0x7f99a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.180+0000 7f99bbfff700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 0x7f99a0055b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f99ac002f70 tx=0x7f99ac0069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.180+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99a4042420 con 0x7f99bc0a7140 2021-11-15T14:42:57.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f99bc0ae100 con 0x7f99bc0a7140 2021-11-15T14:42:57.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99b9ffb700 1 -- 172.21.2.135:0/1677313938 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f99a4018020 con 0x7f99bc0a7140 2021-11-15T14:42:57.318 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:57.318 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:42:57.318 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:42:57.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.319 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:42:57.319 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:42:57.319 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.320 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:57.320 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.320 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.320 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.320 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.321 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.321 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.321 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:42:57.321 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:42:57.322 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.322 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:57.322 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.322 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.323 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.323 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.323 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.323 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:42:57.324 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:42:57.324 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.324 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:57.324 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.324 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.325 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.325 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.326 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:42:57.326 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:42:57.326 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.327 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.327 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.327 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.328 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:42:57.328 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:42:57.328 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.329 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.329 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.329 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.330 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.330 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.330 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.330 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:42:57.331 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:42:57.331 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.331 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.331 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.331 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.332 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.332 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.332 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.332 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:42:57.333 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:42:57.333 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.333 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.333 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.333 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.334 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.334 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.334 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:42:57.335 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:42:57.335 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.335 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.335 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.336 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.336 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.336 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.336 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.337 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:42:57.337 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:42:57.337 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.337 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.337 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.338 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.338 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.338 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.338 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.339 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:42:57.339 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:42:57.339 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.339 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.339 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.340 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.340 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.340 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.340 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.340 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:42:57.341 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:42:57.341 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.341 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.341 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.342 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.342 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.342 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:42:57.343 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:42:57.343 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.343 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:57.343 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:42:57.344 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:42:57.344 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.344 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.345 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:42:57.345 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:42:57.345 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.345 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:42:57.345 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:42:57.346 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:42:57.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.346 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.346 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.347 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:42:57.347 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:42:57.347 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.347 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:57.347 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:42:57.348 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:42:57.348 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.348 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.348 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.349 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:42:57.349 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:42:57.349 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.349 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:57.350 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:42:57.350 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.350 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.350 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.350 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.351 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:42:57.351 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:42:57.351 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:42:57.351 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:42:57.352 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:42:57.352 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:42:57.352 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.352 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.352 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:42:57.353 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:42:57.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 msgr2=0x7f99a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 0x7f99a0055b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f99ac002f70 tx=0x7f99ac0069f0).stop 2021-11-15T14:42:57.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 msgr2=0x7f99bc0abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f99bc0afa60 tx=0x7f99a4006df0).stop 2021-11-15T14:42:57.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 shutdown_connections 2021-11-15T14:42:57.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f99a00536a0 0x7f99a0055b60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99bc148420 0x7f99bc0af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99bc0b1e30 0x7f99bc145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 --2- 172.21.2.135:0/1677313938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99bc0a7140 0x7f99bc0abe80 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 >> 172.21.2.135:0/1677313938 conn(0x7f99bc05f730 msgr2=0x7f99bc0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 shutdown_connections 2021-11-15T14:42:57.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.292+0000 7f99c2f40700 1 -- 172.21.2.135:0/1677313938 wait complete. 2021-11-15T14:42:57.357 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:42:57.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.412+0000 7f6f77e3d700 1 Processor -- start 2021-11-15T14:42:57.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.412+0000 7f6f77e3d700 1 -- start start 2021-11-15T14:42:57.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f700b1cd0 0x7f6f700ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6f700abaa0 0x7f6f700a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.420 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f70143540 con 0x7f6f70139b60 2021-11-15T14:42:57.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f700b3090 con 0x7f6f700abaa0 2021-11-15T14:42:57.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f700abf30 con 0x7f6f700b1cd0 2021-11-15T14:42:57.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f700b1cd0 0x7f6f700ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.421 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f700b1cd0 0x7f6f700ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34882/0 (socket says 172.21.2.135:34882) 2021-11-15T14:42:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/1965178336 learned_addr learned my addr 172.21.2.135:0/1965178336 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/1965178336 >> v2:172.21.2.119:3300/0 conn(0x7f6f700abaa0 msgr2=0x7f6f700a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- 172.21.2.135:0/1965178336 >> v2:172.21.2.119:3300/0 conn(0x7f6f700abaa0 0x7f6f700a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/1965178336 >> v1:172.21.2.119:6789/0 conn(0x7f6f70139b60 legacy=0x7f6f70142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/1965178336 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f700ac4f0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- 172.21.2.135:0/1965178336 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f700ab5b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f6f700afb10 tx=0x7f6f64006f40).ready entity=mon.1 client_cookie=fbc79e3fedb252e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f74bd7700 1 -- 172.21.2.135:0/1965178336 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400dc30 con 0x7f6f700b1cd0 2021-11-15T14:42:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f74bd7700 1 -- 172.21.2.135:0/1965178336 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64000e90 con 0x7f6f700b1cd0 2021-11-15T14:42:57.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f74bd7700 1 -- 172.21.2.135:0/1965178336 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400be90 con 0x7f6f700b1cd0 2021-11-15T14:42:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/1965178336 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 msgr2=0x7f6f700ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/1965178336 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f700ab5b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f6f700afb10 tx=0x7f6f64006f40).stop 2021-11-15T14:42:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/1965178336 shutdown_connections 2021-11-15T14:42:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/1965178336 >> v2:172.21.2.119:3300/0 conn(0x7f6f700abaa0 0x7f6f700a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/1965178336 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f700ab5b0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/1965178336 >> 172.21.2.135:0/1965178336 conn(0x7f6f7005f730 msgr2=0x7f6f7005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/1965178336 shutdown_connections 2021-11-15T14:42:57.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/1965178336 wait complete. 2021-11-15T14:42:57.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 Processor -- start 2021-11-15T14:42:57.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- start start 2021-11-15T14:42:57.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f700abaa0 0x7f6f7014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f70146830 0x7f6f70144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7013a220 con 0x7f6f70146830 2021-11-15T14:42:57.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70146400 con 0x7f6f700b1cd0 2021-11-15T14:42:57.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7013a450 con 0x7f6f700abaa0 2021-11-15T14:42:57.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34888/0 (socket says 172.21.2.135:34888) 2021-11-15T14:42:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/928401685 learned_addr learned my addr 172.21.2.135:0/928401685 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f700abaa0 msgr2=0x7f6f7014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f700abaa0 0x7f6f7014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f70146830 msgr2=0x7f6f70144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f70146830 0x7f6f70144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 -- 172.21.2.135:0/928401685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6400b460 con 0x7f6f700b1cd0 2021-11-15T14:42:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f753d8700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f6f700afb10 tx=0x7f6f700ac680).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f64010e20 con 0x7f6f700b1cd0 2021-11-15T14:42:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64024450 con 0x7f6f700b1cd0 2021-11-15T14:42:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7013a6f0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.416+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f640247b0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7013b630 con 0x7f6f700b1cd0 2021-11-15T14:42:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f701437b0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f64021070 con 0x7f6f700b1cd0 2021-11-15T14:42:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f62ffd700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 0x7f6f50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f6f6406f2b0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f75bd9700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 0x7f6f50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f75bd9700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 0x7f6f50055ad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6f6c002ef0 tx=0x7f6f6c006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.420+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f640465f0 con 0x7f6f700b1cd0 2021-11-15T14:42:57.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.504+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f70146540 con 0x7f6f700b1cd0 2021-11-15T14:42:57.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.504+0000 7f6f62ffd700 1 -- 172.21.2.135:0/928401685 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f6f64049c10 con 0x7f6f700b1cd0 2021-11-15T14:42:57.509 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:57.510 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":140,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:42:57.012672+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:42:57.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 msgr2=0x7f6f50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 0x7f6f50055ad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6f6c002ef0 tx=0x7f6f6c006910).stop 2021-11-15T14:42:57.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 msgr2=0x7f6f70143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f6f700afb10 tx=0x7f6f700ac680).stop 2021-11-15T14:42:57.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 shutdown_connections 2021-11-15T14:42:57.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f50053610 0x7f6f50055ad0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f70146830 0x7f6f70144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f700b1cd0 0x7f6f70143c30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 --2- 172.21.2.135:0/928401685 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f700abaa0 0x7f6f7014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 >> 172.21.2.135:0/928401685 conn(0x7f6f7005f730 msgr2=0x7f6f700aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 shutdown_connections 2021-11-15T14:42:57.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.508+0000 7f6f77e3d700 1 -- 172.21.2.135:0/928401685 wait complete. 2021-11-15T14:42:57.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:42:57.517 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:42:57.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 Processor -- start 2021-11-15T14:42:57.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 -- start start 2021-11-15T14:42:57.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1350 0x7fd8740b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd8740b2320 0x7fd8741412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740a7850 con 0x7fd8740b1f40 2021-11-15T14:42:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8740b17c0 con 0x7fd8740b2320 2021-11-15T14:42:57.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd879e4a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740b06d0 con 0x7fd8740b1350 2021-11-15T14:42:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd8737fe700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fd8740b1f40 0x7fd8740a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:60130/0 (socket says 172.21.2.135:60130) 2021-11-15T14:42:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd8737fe700 1 -- 172.21.2.135:0/3018167778 learned_addr learned my addr 172.21.2.135:0/3018167778 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd872ffd700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1350 0x7fd8740b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 --2- 172.21.2.135:0/3018167778 >> v2:172.21.2.119:3300/0 conn(0x7fd8740b2320 0x7fd8741412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 -- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1350 msgr2=0x7fd8740b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1350 0x7fd8740b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 -- 172.21.2.135:0/3018167778 >> v1:172.21.2.119:6789/0 conn(0x7fd8740b1f40 legacy=0x7fd8740a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 -- 172.21.2.135:0/3018167778 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740b0970 con 0x7fd8740b2320 2021-11-15T14:42:57.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd873fff700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b2320 0x7fd8741412d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fd86c0032f0 tx=0x7fd86c0091d0).ready entity=mon.0 client_cookie=862d52b7fa72b54 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd8727fc700 1 -- 172.21.2.135:0/3018167778 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86c00b6c0 con 0x7fd8740b2320 2021-11-15T14:42:57.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd8727fc700 1 -- 172.21.2.135:0/3018167778 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c00b820 con 0x7fd8740b2320 2021-11-15T14:42:57.577 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.568+0000 7fd8727fc700 1 -- 172.21.2.135:0/3018167778 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86c00b990 con 0x7fd8740b2320 2021-11-15T14:42:57.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b2320 msgr2=0x7fd8741412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b2320 0x7fd8741412d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fd86c0032f0 tx=0x7fd86c0091d0).stop 2021-11-15T14:42:57.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3018167778 shutdown_connections 2021-11-15T14:42:57.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b2320 0x7fd8741412d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3018167778 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1350 0x7fd8740b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3018167778 >> 172.21.2.135:0/3018167778 conn(0x7fd87405f730 msgr2=0x7fd87405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3018167778 shutdown_connections 2021-11-15T14:42:57.579 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3018167778 wait complete. 2021-11-15T14:42:57.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 Processor -- start 2021-11-15T14:42:57.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- start start 2021-11-15T14:42:57.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b1350 0x7fd8741407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1f40 0x7fd87415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740b37d0 con 0x7fd8740b1350 2021-11-15T14:42:57.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740aa970 con 0x7fd8740b2320 2021-11-15T14:42:57.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740a9ad0 con 0x7fd8740b1f40 2021-11-15T14:42:57.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34904/0 (socket says 172.21.2.135:34904) 2021-11-15T14:42:57.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 -- 172.21.2.135:0/3873658656 learned_addr learned my addr 172.21.2.135:0/3873658656 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 -- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1f40 msgr2=0x7fd87415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1f40 0x7fd87415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 -- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b1350 msgr2=0x7fd8741407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b1350 0x7fd8741407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 -- 172.21.2.135:0/3873658656 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c009470 con 0x7fd8740b2320 2021-11-15T14:42:57.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd873fff700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fd8740b4a30 tx=0x7fd86c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86c00b6c0 con 0x7fd8740b2320 2021-11-15T14:42:57.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c011e40 con 0x7fd8740b2320 2021-11-15T14:42:57.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8740b3290 con 0x7fd8740b2320 2021-11-15T14:42:57.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86c0107a0 con 0x7fd8740b2320 2021-11-15T14:42:57.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740aab60 con 0x7fd8740b2320 2021-11-15T14:42:57.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8740573d0 con 0x7fd8740b2320 2021-11-15T14:42:57.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd86c027020 con 0x7fd8740b2320 2021-11-15T14:42:57.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 0x7fd8580559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.572+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fd86c06cb70 con 0x7fd8740b2320 2021-11-15T14:42:57.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.576+0000 7fd8737fe700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 0x7fd8580559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.576+0000 7fd8737fe700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 0x7fd8580559b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fd87406a170 tx=0x7fd8640077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.576+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd86c043eb0 con 0x7fd8740b2320 2021-11-15T14:42:57.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.656+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd8740ab710 con 0x7fd8740b2320 2021-11-15T14:42:57.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.656+0000 7fd870ff9700 1 -- 172.21.2.135:0/3873658656 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v140) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd86c015020 con 0x7fd8740b2320 2021-11-15T14:42:57.662 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:42:57.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 msgr2=0x7fd8580559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 0x7fd8580559b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fd87406a170 tx=0x7fd8640077d0).stop 2021-11-15T14:42:57.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 msgr2=0x7fd87415a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fd8740b4a30 tx=0x7fd86c016000).stop 2021-11-15T14:42:57.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 shutdown_connections 2021-11-15T14:42:57.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8580534f0 0x7fd8580559b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8740b2320 0x7fd87415a710 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8740b1f40 0x7fd87415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 --2- 172.21.2.135:0/3873658656 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8740b1350 0x7fd8741407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 >> 172.21.2.135:0/3873658656 conn(0x7fd87405f730 msgr2=0x7fd8740af660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 shutdown_connections 2021-11-15T14:42:57.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.660+0000 7fd879e4a700 1 -- 172.21.2.135:0/3873658656 wait complete. 2021-11-15T14:42:57.669 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:42:57.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.716+0000 7f18c72af700 1 Processor -- start 2021-11-15T14:42:57.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.716+0000 7f18c72af700 1 -- start start 2021-11-15T14:42:57.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f18c00b0630 0x7f18c00b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00a9c90 0x7f18c00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c01439a0 con 0x7f18c00b3790 2021-11-15T14:42:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c0143c40 con 0x7f18c00b0630 2021-11-15T14:42:57.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0143ee0 con 0x7f18c00a9c90 2021-11-15T14:42:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f18c00b0630 0x7f18c00b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f18c00b0630 0x7f18c00b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34908/0 (socket says 172.21.2.135:34908) 2021-11-15T14:42:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/1716381350 learned_addr learned my addr 172.21.2.135:0/1716381350 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/1716381350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00a9c90 msgr2=0x7f18c00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- 172.21.2.135:0/1716381350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00a9c90 0x7f18c00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/1716381350 >> v1:172.21.2.119:6789/0 conn(0x7f18c00b3790 legacy=0x7f18c013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/1716381350 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0144180 con 0x7f18c00b0630 2021-11-15T14:42:57.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- 172.21.2.135:0/1716381350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00b0630 0x7f18c00b0a10 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f18c006aad0 tx=0x7f18bc006f40).ready entity=mon.1 client_cookie=c3b646f4d902f96a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b3fff700 1 -- 172.21.2.135:0/1716381350 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc00dc30 con 0x7f18c00b0630 2021-11-15T14:42:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b3fff700 1 -- 172.21.2.135:0/1716381350 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc000e90 con 0x7f18c00b0630 2021-11-15T14:42:57.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b3fff700 1 -- 172.21.2.135:0/1716381350 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc00be90 con 0x7f18c00b0630 2021-11-15T14:42:57.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/1716381350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00b0630 msgr2=0x7f18c00b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- 172.21.2.135:0/1716381350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00b0630 0x7f18c00b0a10 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f18c006aad0 tx=0x7f18bc006f40).stop 2021-11-15T14:42:57.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/1716381350 shutdown_connections 2021-11-15T14:42:57.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- 172.21.2.135:0/1716381350 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00a9c90 0x7f18c00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- 172.21.2.135:0/1716381350 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00b0630 0x7f18c00b0a10 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.730 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/1716381350 >> 172.21.2.135:0/1716381350 conn(0x7f18c0060840 msgr2=0x7f18c0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/1716381350 shutdown_connections 2021-11-15T14:42:57.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/1716381350 wait complete. 2021-11-15T14:42:57.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 Processor -- start 2021-11-15T14:42:57.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- start start 2021-11-15T14:42:57.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18c00b0630 0x7f18c0142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00b3790 0x7f18c014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c014c000 con 0x7f18c00b0630 2021-11-15T14:42:57.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0143070 con 0x7f18c00a9c90 2021-11-15T14:42:57.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c00ae1f0 con 0x7f18c00b3790 2021-11-15T14:42:57.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34912/0 (socket says 172.21.2.135:34912) 2021-11-15T14:42:57.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/473929837 learned_addr learned my addr 172.21.2.135:0/473929837 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00b3790 msgr2=0x7f18c014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00b3790 0x7f18c014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18c00b0630 msgr2=0x7f18c0142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18c00b0630 0x7f18c0142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 -- 172.21.2.135:0/473929837 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc00b460 con 0x7f18c00a9c90 2021-11-15T14:42:57.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c504b700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f18c00ad810 tx=0x7f18c00b0550).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc01f070 con 0x7f18c00a9c90 2021-11-15T14:42:57.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc0067a0 con 0x7f18c00a9c90 2021-11-15T14:42:57.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c0152410 con 0x7f18c00a9c90 2021-11-15T14:42:57.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c00b1ab0 con 0x7f18c00a9c90 2021-11-15T14:42:57.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.720+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc024600 con 0x7f18c00a9c90 2021-11-15T14:42:57.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c0152250 con 0x7f18c00a9c90 2021-11-15T14:42:57.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f18bc02b070 con 0x7f18c00a9c90 2021-11-15T14:42:57.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18b27fc700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 0x7f18a8055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f18bc06f230 con 0x7f18c00a9c90 2021-11-15T14:42:57.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18c484a700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 0x7f18a8055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18c484a700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 0x7f18a8055a00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f18b4002f10 tx=0x7f18b4006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.724+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18bc046460 con 0x7f18c00a9c90 2021-11-15T14:42:57.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18c013dce0 con 0x7f18c00a9c90 2021-11-15T14:42:57.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18b27fc700 1 -- 172.21.2.135:0/473929837 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v140) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18bc049a80 con 0x7f18c00a9c90 2021-11-15T14:42:57.813 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:42:57.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 msgr2=0x7f18a8055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 0x7f18a8055a00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f18b4002f10 tx=0x7f18b4006930).stop 2021-11-15T14:42:57.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 msgr2=0x7f18c0063bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f18c00ad810 tx=0x7f18c00b0550).stop 2021-11-15T14:42:57.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 shutdown_connections 2021-11-15T14:42:57.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f18a8053540 0x7f18a8055a00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f18c00b3790 0x7f18c014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f18c00b0630 0x7f18c0142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 --2- 172.21.2.135:0/473929837 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f18c00a9c90 0x7f18c0063bf0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 >> 172.21.2.135:0/473929837 conn(0x7f18c0060840 msgr2=0x7f18c00b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 shutdown_connections 2021-11-15T14:42:57.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.808+0000 7f18c72af700 1 -- 172.21.2.135:0/473929837 wait complete. 2021-11-15T14:42:57.819 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:42:57.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.864+0000 7fef75a6b700 1 Processor -- start 2021-11-15T14:42:57.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.864+0000 7fef75a6b700 1 -- start start 2021-11-15T14:42:57.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fef700b67e0 0x7fef7013cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7013d750 con 0x7fef700aa100 2021-11-15T14:42:57.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef700ac5d0 con 0x7fef700b67e0 2021-11-15T14:42:57.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef700ac870 con 0x7fef7005fe30 2021-11-15T14:42:57.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34924/0 (socket says 172.21.2.135:34924) 2021-11-15T14:42:57.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 -- 172.21.2.135:0/4027422312 learned_addr learned my addr 172.21.2.135:0/4027422312 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 --2- 172.21.2.135:0/4027422312 >> v2:172.21.2.119:3300/0 conn(0x7fef700b67e0 0x7fef7013cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 -- 172.21.2.135:0/4027422312 >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 msgr2=0x7fef7013d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 --2- 172.21.2.135:0/4027422312 >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 -- 172.21.2.135:0/4027422312 >> v1:172.21.2.119:6789/0 conn(0x7fef700aa100 legacy=0x7fef70146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 -- 172.21.2.135:0/4027422312 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700acb10 con 0x7fef700b67e0 2021-11-15T14:42:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- 172.21.2.135:0/4027422312 >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:42:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6f7fe700 1 --2- 172.21.2.135:0/4027422312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef700b67e0 0x7fef7013cd70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fef58002f70 tx=0x7fef58006df0).ready entity=mon.0 client_cookie=1a969945bff77d29 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6e7fc700 1 -- 172.21.2.135:0/4027422312 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5800d570 con 0x7fef700b67e0 2021-11-15T14:42:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6e7fc700 1 -- 172.21.2.135:0/4027422312 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58000e90 con 0x7fef700b67e0 2021-11-15T14:42:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6e7fc700 1 -- 172.21.2.135:0/4027422312 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5800d8c0 con 0x7fef700b67e0 2021-11-15T14:42:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/4027422312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef700b67e0 msgr2=0x7fef7013cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- 172.21.2.135:0/4027422312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef700b67e0 0x7fef7013cd70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fef58002f70 tx=0x7fef58006df0).stop 2021-11-15T14:42:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/4027422312 shutdown_connections 2021-11-15T14:42:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- 172.21.2.135:0/4027422312 >> v2:172.21.2.135:3300/0 conn(0x7fef7005fe30 0x7fef7013d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- 172.21.2.135:0/4027422312 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef700b67e0 0x7fef7013cd70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/4027422312 >> 172.21.2.135:0/4027422312 conn(0x7fef700b3500 msgr2=0x7fef700b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/4027422312 shutdown_connections 2021-11-15T14:42:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/4027422312 wait complete. 2021-11-15T14:42:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 Processor -- start 2021-11-15T14:42:57.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- start start 2021-11-15T14:42:57.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef7005fe30 0x7fef70140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef700aa100 0x7fef70065f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7015aae0 con 0x7fef7005fe30 2021-11-15T14:42:57.881 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7015ad40 con 0x7fef700b67e0 2021-11-15T14:42:57.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7015afe0 con 0x7fef700aa100 2021-11-15T14:42:57.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34926/0 (socket says 172.21.2.135:34926) 2021-11-15T14:42:57.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 -- 172.21.2.135:0/874905607 learned_addr learned my addr 172.21.2.135:0/874905607 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:57.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 -- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef700aa100 msgr2=0x7fef70065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef700aa100 0x7fef70065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 -- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef7005fe30 msgr2=0x7fef70140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef7005fe30 0x7fef70140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 -- 172.21.2.135:0/874905607 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68009530 con 0x7fef700b67e0 2021-11-15T14:42:57.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6ffff700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fef68006ec0 tx=0x7fef68009290).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6800c900 con 0x7fef700b67e0 2021-11-15T14:42:57.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5800b180 con 0x7fef700b67e0 2021-11-15T14:42:57.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6800ca60 con 0x7fef700b67e0 2021-11-15T14:42:57.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6800cdc0 con 0x7fef700b67e0 2021-11-15T14:42:57.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.868+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef701473f0 con 0x7fef700b67e0 2021-11-15T14:42:57.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef700acdb0 con 0x7fef700b67e0 2021-11-15T14:42:57.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef68022070 con 0x7fef700b67e0 2021-11-15T14:42:57.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6cff9700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 0x7fef54055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:57.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fef6806c160 con 0x7fef700b67e0 2021-11-15T14:42:57.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6f7fe700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 0x7fef54055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:57.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6f7fe700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 0x7fef54055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fef58002f70 tx=0x7fef58014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:57.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.872+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef68043400 con 0x7fef700b67e0 2021-11-15T14:42:57.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.956+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef700573d0 con 0x7fef700b67e0 2021-11-15T14:42:57.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.956+0000 7fef6cff9700 1 -- 172.21.2.135:0/874905607 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+143 (secure 0 0 0) 0x7fef68016020 con 0x7fef700b67e0 2021-11-15T14:42:57.961 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:42:57.961 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:42:57.962 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.962 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:42:57.962 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:42:57.962 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:42:57.963 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:42:57.963 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:42:57.963 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:42:57.963 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:42:57.963 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:42:57.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 msgr2=0x7fef54055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 0x7fef54055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fef58002f70 tx=0x7fef58014000).stop 2021-11-15T14:42:57.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 msgr2=0x7fef7013b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:57.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fef68006ec0 tx=0x7fef68009290).stop 2021-11-15T14:42:57.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 shutdown_connections 2021-11-15T14:42:57.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef540536a0 0x7fef54055b60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef700b67e0 0x7fef7013b4e0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:57.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef700aa100 0x7fef70065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 --2- 172.21.2.135:0/874905607 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef7005fe30 0x7fef70140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:57.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 >> 172.21.2.135:0/874905607 conn(0x7fef700b3500 msgr2=0x7fef70143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:57.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 shutdown_connections 2021-11-15T14:42:57.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:57.960+0000 7fef75a6b700 1 -- 172.21.2.135:0/874905607 wait complete. 2021-11-15T14:42:57.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:42:57.969 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:42:58.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 Processor -- start 2021-11-15T14:42:58.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 -- start start 2021-11-15T14:42:58.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 0x7f8a980b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8a980b2320 0x7f8a981412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a980a7850 con 0x7f8a980b1f40 2021-11-15T14:42:58.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a980b17c0 con 0x7f8a980b1350 2021-11-15T14:42:58.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a9d2d5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a980b06d0 con 0x7f8a980b2320 2021-11-15T14:42:58.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a96ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8a980b1f40 0x7f8a980a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50754/0 (socket says 172.21.2.135:50754) 2021-11-15T14:42:58.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.016+0000 7f8a96ffd700 1 -- 172.21.2.135:0/2221933562 learned_addr learned my addr 172.21.2.135:0/2221933562 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:42:58.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 --2- 172.21.2.135:0/2221933562 >> v2:172.21.2.135:3300/0 conn(0x7f8a980b2320 0x7f8a981412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:58.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 -- 172.21.2.135:0/2221933562 >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 msgr2=0x7f8a980b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:42:58.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a967fc700 1 --2- 172.21.2.135:0/2221933562 >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 0x7f8a980b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:58.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 --2- 172.21.2.135:0/2221933562 >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 0x7f8a980b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:58.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 -- 172.21.2.135:0/2221933562 >> v1:172.21.2.135:6789/0 conn(0x7f8a980b1f40 legacy=0x7f8a980a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:58.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 -- 172.21.2.135:0/2221933562 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a980b0970 con 0x7f8a980b2320 2021-11-15T14:42:58.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a967fc700 1 --2- 172.21.2.135:0/2221933562 >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 0x7f8a980b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:42:58.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a977fe700 1 --2- 172.21.2.135:0/2221933562 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b2320 0x7f8a981412d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8a900032f0 tx=0x7f8a900091d0).ready entity=mon.1 client_cookie=4c331e332f3c2880 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:58.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a95ffb700 1 -- 172.21.2.135:0/2221933562 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a90009ea0 con 0x7f8a980b2320 2021-11-15T14:42:58.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a95ffb700 1 -- 172.21.2.135:0/2221933562 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9000b870 con 0x7f8a980b2320 2021-11-15T14:42:58.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a95ffb700 1 -- 172.21.2.135:0/2221933562 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9000b9e0 con 0x7f8a980b2320 2021-11-15T14:42:58.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/2221933562 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b2320 msgr2=0x7f8a981412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:58.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/2221933562 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b2320 0x7f8a981412d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8a900032f0 tx=0x7f8a900091d0).stop 2021-11-15T14:42:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/2221933562 shutdown_connections 2021-11-15T14:42:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/2221933562 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b2320 0x7f8a981412d0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/2221933562 >> v2:172.21.2.119:3300/0 conn(0x7f8a980b1350 0x7f8a980b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:58.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/2221933562 >> 172.21.2.135:0/2221933562 conn(0x7f8a9805f730 msgr2=0x7f8a9805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/2221933562 shutdown_connections 2021-11-15T14:42:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/2221933562 wait complete. 2021-11-15T14:42:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 Processor -- start 2021-11-15T14:42:58.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- start start 2021-11-15T14:42:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a980b1f40 0x7f8a9815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a980b2320 0x7f8a9815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a980b4370 con 0x7f8a980b2320 2021-11-15T14:42:58.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9814b2f0 con 0x7f8a980b1350 2021-11-15T14:42:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a9d2d5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9814b990 con 0x7f8a980b1f40 2021-11-15T14:42:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34940/0 (socket says 172.21.2.135:34940) 2021-11-15T14:42:58.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 -- 172.21.2.135:0/3649238920 learned_addr learned my addr 172.21.2.135:0/3649238920 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:58.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 -- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a980b1f40 msgr2=0x7f8a9815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:58.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a980b1f40 0x7f8a9815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:58.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 -- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a980b2320 msgr2=0x7f8a9815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:58.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a980b2320 0x7f8a9815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:58.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.020+0000 7f8a96ffd700 1 -- 172.21.2.135:0/3649238920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90009470 con 0x7f8a980b1350 2021-11-15T14:42:58.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a96ffd700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f8a9814b120 tx=0x7f8a80007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:58.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8000ce20 con 0x7f8a980b1350 2021-11-15T14:42:58.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a800072e0 con 0x7f8a980b1350 2021-11-15T14:42:58.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a80005800 con 0x7f8a980b1350 2021-11-15T14:42:58.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a98147490 con 0x7f8a980b1350 2021-11-15T14:42:58.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9814acc0 con 0x7f8a980b1350 2021-11-15T14:42:58.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9814bb50 con 0x7f8a980b1350 2021-11-15T14:42:58.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a80010070 con 0x7f8a980b1350 2021-11-15T14:42:58.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 0x7f8a7c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:58.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f8a8006aed0 con 0x7f8a980b1350 2021-11-15T14:42:58.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a967fc700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 0x7f8a7c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:58.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a967fc700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 0x7f8a7c055bb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8a88007000 tx=0x7f8a88008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:58.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.024+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a80042100 con 0x7f8a980b1350 2021-11-15T14:42:58.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:58.108+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f8a980b4050 con 0x7f8a980b1350 2021-11-15T14:42:59.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.032+0000 7f8a8ffff700 1 -- 172.21.2.135:0/3649238920 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v141) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8a80045720 con 0x7f8a980b1350 2021-11-15T14:42:59.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 msgr2=0x7f8a7c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:59.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 0x7f8a7c055bb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f8a88007000 tx=0x7f8a88008040).stop 2021-11-15T14:42:59.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 msgr2=0x7f8a980aa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:59.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f8a9814b120 tx=0x7f8a80007c00).stop 2021-11-15T14:42:59.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 shutdown_connections 2021-11-15T14:42:59.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a7c0536f0 0x7f8a7c055bb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:59.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a980b2320 0x7f8a9815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:59.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a980b1f40 0x7f8a9815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:59.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 --2- 172.21.2.135:0/3649238920 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a980b1350 0x7f8a980aa6c0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:59.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 >> 172.21.2.135:0/3649238920 conn(0x7f8a9805f730 msgr2=0x7f8a981407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:59.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 shutdown_connections 2021-11-15T14:42:59.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.036+0000 7f8a9d2d5700 1 -- 172.21.2.135:0/3649238920 wait complete. 2021-11-15T14:42:59.044 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:42:59.050 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:42:59.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 Processor -- start 2021-11-15T14:42:59.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 -- start start 2021-11-15T14:42:59.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f79680b1f40 0x7f79680b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b2320 0x7f79681412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680b04a0 con 0x7f79680b0030 2021-11-15T14:42:59.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680a7850 con 0x7f79680b1f40 2021-11-15T14:42:59.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796ee0b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b06d0 con 0x7f79680b2320 2021-11-15T14:42:59.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f79680b1f40 0x7f79680b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:59.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f79680b1f40 0x7f79680b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34948/0 (socket says 172.21.2.135:34948) 2021-11-15T14:42:59.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 -- 172.21.2.135:0/3821022244 learned_addr learned my addr 172.21.2.135:0/3821022244 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:59.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 -- 172.21.2.135:0/3821022244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b2320 msgr2=0x7f79681412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:59.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 --2- 172.21.2.135:0/3821022244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b2320 0x7f79681412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:59.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 -- 172.21.2.135:0/3821022244 >> v1:172.21.2.119:6789/0 conn(0x7f79680b0030 legacy=0x7f79680a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:42:59.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 -- 172.21.2.135:0/3821022244 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680b0970 con 0x7f79680b1f40 2021-11-15T14:42:59.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f796cba7700 1 --2- 172.21.2.135:0/3821022244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f79680b1350 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f79680b2fd0 tx=0x7f7958006eb0).ready entity=mon.1 client_cookie=97dd1f618cfc5e00 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:59.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f79677fe700 1 -- 172.21.2.135:0/3821022244 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795800d570 con 0x7f79680b1f40 2021-11-15T14:42:59.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f79677fe700 1 -- 172.21.2.135:0/3821022244 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958000e90 con 0x7f79680b1f40 2021-11-15T14:42:59.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.100+0000 7f79677fe700 1 -- 172.21.2.135:0/3821022244 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795800d8c0 con 0x7f79680b1f40 2021-11-15T14:42:59.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/3821022244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 msgr2=0x7f79680b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:59.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- 172.21.2.135:0/3821022244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f79680b1350 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f79680b2fd0 tx=0x7f7958006eb0).stop 2021-11-15T14:42:59.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/3821022244 shutdown_connections 2021-11-15T14:42:59.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- 172.21.2.135:0/3821022244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b2320 0x7f79681412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:42:59.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- 172.21.2.135:0/3821022244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f79680b1350 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:59.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/3821022244 >> 172.21.2.135:0/3821022244 conn(0x7f796805f730 msgr2=0x7f796805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:42:59.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/3821022244 shutdown_connections 2021-11-15T14:42:59.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/3821022244 wait complete. 2021-11-15T14:42:59.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 Processor -- start 2021-11-15T14:42:59.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- start start 2021-11-15T14:42:59.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b0030 0x7f7968140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79680b2320 0x7f796815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680abaf0 con 0x7f79680b2320 2021-11-15T14:42:59.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680abd90 con 0x7f79680b1f40 2021-11-15T14:42:59.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ac030 con 0x7f79680b0030 2021-11-15T14:42:59.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:59.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34956/0 (socket says 172.21.2.135:34956) 2021-11-15T14:42:59.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796cba7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b0030 0x7f7968140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:59.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 -- 172.21.2.135:0/1079693830 learned_addr learned my addr 172.21.2.135:0/1079693830 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:42:59.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796d3a8700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79680b2320 0x7f796815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:59.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 -- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b0030 msgr2=0x7f7968140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:59.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b0030 0x7f7968140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:59.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 -- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79680b2320 msgr2=0x7f796815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:42:59.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79680b2320 0x7f796815ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:42:59.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 -- 172.21.2.135:0/1079693830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795800b1e0 con 0x7f79680b1f40 2021-11-15T14:42:59.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7967fff700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f7950002fb0 tx=0x7f7950006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:59.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7950013460 con 0x7f79680b1f40 2021-11-15T14:42:59.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79500135c0 con 0x7f79680b1f40 2021-11-15T14:42:59.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680ac2d0 con 0x7f79680b1f40 2021-11-15T14:42:59.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7950013920 con 0x7f79680b1f40 2021-11-15T14:42:59.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680ab6c0 con 0x7f79680b1f40 2021-11-15T14:42:59.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680b0c10 con 0x7f79680b1f40 2021-11-15T14:42:59.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f795000f070 con 0x7f79680b1f40 2021-11-15T14:42:59.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 0x7f794c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:42:59.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f795006b170 con 0x7f79680b1f40 2021-11-15T14:42:59.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.104+0000 7f796cba7700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 0x7f794c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:42:59.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.108+0000 7f796cba7700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 0x7f794c055a40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f795801c000 tx=0x7f7958015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:42:59.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.108+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7950042350 con 0x7f79680b1f40 2021-11-15T14:42:59.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:42:59.192+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f79680573d0 con 0x7f79680b1f40 2021-11-15T14:43:00.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.032+0000 7f7965ffb700 1 -- 172.21.2.135:0/1079693830 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v142) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7950045970 con 0x7f79680b1f40 2021-11-15T14:43:00.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.032+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 msgr2=0x7f794c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.032+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 0x7f794c055a40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f795801c000 tx=0x7f7958015000).stop 2021-11-15T14:43:00.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.032+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 msgr2=0x7f796815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.032+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f7950002fb0 tx=0x7f7950006df0).stop 2021-11-15T14:43:00.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 shutdown_connections 2021-11-15T14:43:00.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f794c053580 0x7f794c055a40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79680b2320 0x7f796815ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79680b1f40 0x7f796815a680 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 --2- 172.21.2.135:0/1079693830 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79680b0030 0x7f7968140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 >> 172.21.2.135:0/1079693830 conn(0x7f796805f730 msgr2=0x7f79680af780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 shutdown_connections 2021-11-15T14:43:00.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.036+0000 7f796ee0b700 1 -- 172.21.2.135:0/1079693830 wait complete. 2021-11-15T14:43:00.041 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:43:00.048 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:43:00.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 Processor -- start 2021-11-15T14:43:00.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 -- start start 2021-11-15T14:43:00.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 0x7fcc280b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280b03d0 con 0x7fcc280a7140 2021-11-15T14:43:00.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280b0670 con 0x7fcc28148420 2021-11-15T14:43:00.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc2dd46700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280a9140 con 0x7fcc280b1e30 2021-11-15T14:43:00.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc26ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcc28148420 0x7fcc280b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50786/0 (socket says 172.21.2.135:50786) 2021-11-15T14:43:00.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc26ffd700 1 -- 172.21.2.135:0/2496324799 learned_addr learned my addr 172.21.2.135:0/2496324799 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:00.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958938644 0 0) 0x7fcc280b0670 con 0x7fcc28148420 2021-11-15T14:43:00.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.096+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc08003260 con 0x7fcc28148420 2021-11-15T14:43:00.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422388443 0 0) 0x7fcc08003260 con 0x7fcc28148420 2021-11-15T14:43:00.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 msgr2=0x7fcc280b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 0x7fcc280b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 >> v1:172.21.2.119:6789/0 conn(0x7fcc280a7140 legacy=0x7fcc281447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280b0910 con 0x7fcc28148420 2021-11-15T14:43:00.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fcc10001660 con 0x7fcc28148420 2021-11-15T14:43:00.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 >> v1:172.21.2.135:6789/0 conn(0x7fcc28148420 legacy=0x7fcc280b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc080037d0 0x7fcc08003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc08004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 0x7fcc0800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08005280 con 0x7fcc080037d0 2021-11-15T14:43:00.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0800bc40 con 0x7fcc08004500 2021-11-15T14:43:00.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0800bd80 con 0x7fcc280b1e30 2021-11-15T14:43:00.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc08004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 -- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 msgr2=0x7fcc0800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc280b1e30 0x7fcc0800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 -- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc080037d0 msgr2=0x7fcc08003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc080037d0 0x7fcc08003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 -- 172.21.2.135:0/2496324799 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08003260 con 0x7fcc08004500 2021-11-15T14:43:00.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc08004980 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fcc28061420 tx=0x7fcc280b0800).ready entity=mon.1 client_cookie=999311baa6983a21 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc100070d0 con 0x7fcc08004500 2021-11-15T14:43:00.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10007230 con 0x7fcc08004500 2021-11-15T14:43:00.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc267fc700 1 -- 172.21.2.135:0/2496324799 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1000c8c0 con 0x7fcc08004500 2021-11-15T14:43:00.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/2496324799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 msgr2=0x7fcc08004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/2496324799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc08004980 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fcc28061420 tx=0x7fcc280b0800).stop 2021-11-15T14:43:00.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc27fff700 1 -- 172.21.2.135:0/2496324799 reap_dead start 2021-11-15T14:43:00.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/2496324799 shutdown_connections 2021-11-15T14:43:00.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/2496324799 >> 172.21.2.135:0/2496324799 conn(0x7fcc2805f730 msgr2=0x7fcc2805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/2496324799 shutdown_connections 2021-11-15T14:43:00.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/2496324799 wait complete. 2021-11-15T14:43:00.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 Processor -- start 2021-11-15T14:43:00.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- start start 2021-11-15T14:43:00.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc280ae1f0 0x7fcc28156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc28156f00 0x7fcc28159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280aaac0 con 0x7fcc280ae1f0 2021-11-15T14:43:00.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28148d00 con 0x7fcc08004500 2021-11-15T14:43:00.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814b250 con 0x7fcc28156f00 2021-11-15T14:43:00.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34976/0 (socket says 172.21.2.135:34976) 2021-11-15T14:43:00.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 -- 172.21.2.135:0/1637691013 learned_addr learned my addr 172.21.2.135:0/1637691013 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc27fff700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc28156f00 0x7fcc28159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc280ae1f0 0x7fcc28156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 -- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc28156f00 msgr2=0x7fcc28159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc28156f00 0x7fcc28159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 -- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc280ae1f0 msgr2=0x7fcc28156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc280ae1f0 0x7fcc28156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 -- 172.21.2.135:0/1637691013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2814b4f0 con 0x7fcc08004500 2021-11-15T14:43:00.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc277fe700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fcc18002f70 tx=0x7fcc18006e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc18013460 con 0x7fcc08004500 2021-11-15T14:43:00.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180135c0 con 0x7fcc08004500 2021-11-15T14:43:00.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2814ada0 con 0x7fcc08004500 2021-11-15T14:43:00.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc18013920 con 0x7fcc08004500 2021-11-15T14:43:00.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.100+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc280af4f0 con 0x7fcc08004500 2021-11-15T14:43:00.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28148f00 con 0x7fcc08004500 2021-11-15T14:43:00.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc1801a060 con 0x7fcc08004500 2021-11-15T14:43:00.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc24ff9700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 0x7fcc0c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fcc1806b3e0 con 0x7fcc08004500 2021-11-15T14:43:00.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 0x7fcc0c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc26ffd700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 0x7fcc0c055b90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fcc10014000 tx=0x7fcc10013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.104+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc18042460 con 0x7fcc08004500 2021-11-15T14:43:00.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.216+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fcc280b0af0 con 0x7fcc08004500 2021-11-15T14:43:00.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.232+0000 7fcc24ff9700 1 -- 172.21.2.135:0/1637691013 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v69) v1 ==== 189+0+0 (secure 0 0 0) 0x7fcc18045a80 con 0x7fcc08004500 2021-11-15T14:43:00.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 msgr2=0x7fcc0c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 0x7fcc0c055b90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fcc10014000 tx=0x7fcc10013000).stop 2021-11-15T14:43:00.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 msgr2=0x7fcc2814b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fcc18002f70 tx=0x7fcc18006e50).stop 2021-11-15T14:43:00.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 shutdown_connections 2021-11-15T14:43:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcc0c0536d0 0x7fcc0c055b90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcc28156f00 0x7fcc28159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcc280ae1f0 0x7fcc28156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 --2- 172.21.2.135:0/1637691013 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcc08004500 0x7fcc2814b990 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 >> 172.21.2.135:0/1637691013 conn(0x7fcc2805f730 msgr2=0x7fcc280a7580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 shutdown_connections 2021-11-15T14:43:00.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.236+0000 7fcc2dd46700 1 -- 172.21.2.135:0/1637691013 wait complete. 2021-11-15T14:43:00.243 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 25 and data pool 26 2021-11-15T14:43:00.247 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:00.297 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.292+0000 7fc38286a700 1 Processor -- start 2021-11-15T14:43:00.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.292+0000 7fc38286a700 1 -- start start 2021-11-15T14:43:00.298 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc37c0b0900 0x7fc37c140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0b2b70 con 0x7fc37c0b0520 2021-11-15T14:43:00.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0b27f0 con 0x7fc37c0b0900 2021-11-15T14:43:00.299 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0b2da0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34984/0 (socket says 172.21.2.135:34984) 2021-11-15T14:43:00.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 -- 172.21.2.135:0/3978174806 learned_addr learned my addr 172.21.2.135:0/3978174806 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 -- 172.21.2.135:0/3978174806 >> v2:172.21.2.119:3300/0 conn(0x7fc37c0b0900 msgr2=0x7fc37c140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 --2- 172.21.2.135:0/3978174806 >> v2:172.21.2.119:3300/0 conn(0x7fc37c0b0900 0x7fc37c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 -- 172.21.2.135:0/3978174806 >> v1:172.21.2.135:6789/0 conn(0x7fc37c0b0520 legacy=0x7fc37c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 -- 172.21.2.135:0/3978174806 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0a9bf0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37b7fe700 1 --2- 172.21.2.135:0/3978174806 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fc36c002f70 tx=0x7fc36c006eb0).ready entity=mon.1 client_cookie=3c08337b8cb7d513 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37affd700 1 -- 172.21.2.135:0/3978174806 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36c00d610 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37affd700 1 -- 172.21.2.135:0/3978174806 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c000e90 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37affd700 1 -- 172.21.2.135:0/3978174806 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36c00d9a0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/3978174806 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 msgr2=0x7fc37c0ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- 172.21.2.135:0/3978174806 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fc36c002f70 tx=0x7fc36c006eb0).stop 2021-11-15T14:43:00.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/3978174806 shutdown_connections 2021-11-15T14:43:00.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- 172.21.2.135:0/3978174806 >> v2:172.21.2.119:3300/0 conn(0x7fc37c0b0900 0x7fc37c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- 172.21.2.135:0/3978174806 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0ae4c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/3978174806 >> 172.21.2.135:0/3978174806 conn(0x7fc37c060840 msgr2=0x7fc37c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/3978174806 shutdown_connections 2021-11-15T14:43:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/3978174806 wait complete. 2021-11-15T14:43:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 Processor -- start 2021-11-15T14:43:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- start start 2021-11-15T14:43:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc37c0b0520 0x7fc37c09f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc37c0b0900 0x7fc37c09f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0a2ea0 con 0x7fc37c0b0900 2021-11-15T14:43:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0a13a0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0a1640 con 0x7fc37c0b0520 2021-11-15T14:43:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34988/0 (socket says 172.21.2.135:34988) 2021-11-15T14:43:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 -- 172.21.2.135:0/1651367331 learned_addr learned my addr 172.21.2.135:0/1651367331 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 -- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc37c0b0520 msgr2=0x7fc37c09f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc37c0b0520 0x7fc37c09f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 -- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc37c0b0900 msgr2=0x7fc37c09f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc37c0b0900 0x7fc37c09f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 -- 172.21.2.135:0/1651367331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c00b1e0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc37bfff700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fc37c0b0130 tx=0x7fc364007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36400ce30 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc364007240 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc364006700 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0a0660 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c0b6460 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.296+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c0a0820 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc364010030 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc3797fa700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 0x7fc360055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc36406b840 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc37b7fe700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 0x7fc360055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc37b7fe700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 0x7fc360055bb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fc36c002f70 tx=0x7fc36c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.300+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc364042740 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.384+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc37c0573d0 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.384+0000 7fc3797fa700 1 -- 172.21.2.135:0/1651367331 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fc364045d60 con 0x7fc37c0aa1a0 2021-11-15T14:43:00.390 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:00.391 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":143,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:00.221221+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 msgr2=0x7fc360055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 0x7fc360055bb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fc36c002f70 tx=0x7fc36c015000).stop 2021-11-15T14:43:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 msgr2=0x7fc37c0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fc37c0b0130 tx=0x7fc364007c10).stop 2021-11-15T14:43:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 shutdown_connections 2021-11-15T14:43:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc3600536f0 0x7fc360055bb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc37c0b0900 0x7fc37c09f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc37c0b0520 0x7fc37c09f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 --2- 172.21.2.135:0/1651367331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc37c0aa1a0 0x7fc37c0a46a0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 >> 172.21.2.135:0/1651367331 conn(0x7fc37c060840 msgr2=0x7fc37c0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 shutdown_connections 2021-11-15T14:43:00.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.388+0000 7fc38286a700 1 -- 172.21.2.135:0/1651367331 wait complete. 2021-11-15T14:43:00.397 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:00.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 Processor -- start 2021-11-15T14:43:00.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 -- start start 2021-11-15T14:43:00.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca580b2600 0x7fca5814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca5814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fca580afc50 0x7fca580a8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580a7140 con 0x7fca580afc50 2021-11-15T14:43:00.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580a7370 con 0x7fca580b2600 2021-11-15T14:43:00.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5f573700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580a7610 con 0x7fca580b0090 2021-11-15T14:43:00.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca580b2600 0x7fca5814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca580b2600 0x7fca5814aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:34998/0 (socket says 172.21.2.135:34998) 2021-11-15T14:43:00.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 -- 172.21.2.135:0/2569571895 learned_addr learned my addr 172.21.2.135:0/2569571895 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 -- 172.21.2.135:0/2569571895 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 msgr2=0x7fca5814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 --2- 172.21.2.135:0/2569571895 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca5814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 -- 172.21.2.135:0/2569571895 >> v2:172.21.2.119:3300/0 conn(0x7fca580afc50 msgr2=0x7fca580a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 --2- 172.21.2.135:0/2569571895 >> v2:172.21.2.119:3300/0 conn(0x7fca580afc50 0x7fca580a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 -- 172.21.2.135:0/2569571895 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580a78b0 con 0x7fca580b2600 2021-11-15T14:43:00.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5e571700 1 --2- 172.21.2.135:0/2569571895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca5814aec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fca54002f70 tx=0x7fca54006eb0).ready entity=mon.1 client_cookie=6037f0036ffe94ce server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5d56f700 1 -- 172.21.2.135:0/2569571895 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca5400d570 con 0x7fca580b2600 2021-11-15T14:43:00.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5d56f700 1 -- 172.21.2.135:0/2569571895 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca54000e90 con 0x7fca580b2600 2021-11-15T14:43:00.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.444+0000 7fca5d56f700 1 -- 172.21.2.135:0/2569571895 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca5400d900 con 0x7fca580b2600 2021-11-15T14:43:00.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/2569571895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 msgr2=0x7fca5814aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- 172.21.2.135:0/2569571895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca5814aec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fca54002f70 tx=0x7fca54006eb0).stop 2021-11-15T14:43:00.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/2569571895 shutdown_connections 2021-11-15T14:43:00.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- 172.21.2.135:0/2569571895 >> v2:172.21.2.119:3300/0 conn(0x7fca580afc50 0x7fca580a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- 172.21.2.135:0/2569571895 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca5814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- 172.21.2.135:0/2569571895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca5814aec0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/2569571895 >> 172.21.2.135:0/2569571895 conn(0x7fca58060200 msgr2=0x7fca580b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/2569571895 shutdown_connections 2021-11-15T14:43:00.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/2569571895 wait complete. 2021-11-15T14:43:00.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 Processor -- start 2021-11-15T14:43:00.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- start start 2021-11-15T14:43:00.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca580afc50 0x7fca58066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca580b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58063160 con 0x7fca580afc50 2021-11-15T14:43:00.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5811cea0 con 0x7fca580b2600 2021-11-15T14:43:00.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5811d140 con 0x7fca580b0090 2021-11-15T14:43:00.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35006/0 (socket says 172.21.2.135:35006) 2021-11-15T14:43:00.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 -- 172.21.2.135:0/243882085 learned_addr learned my addr 172.21.2.135:0/243882085 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5dd70700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca580b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 -- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 msgr2=0x7fca580b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca580b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 -- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca580afc50 msgr2=0x7fca58066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca580afc50 0x7fca58066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 -- 172.21.2.135:0/243882085 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5400b1e0 con 0x7fca580b2600 2021-11-15T14:43:00.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5dd70700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca580b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:00.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5ed72700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fca580abab0 tx=0x7fca50009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca5000d580 con 0x7fca580b2600 2021-11-15T14:43:00.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000d6e0 con 0x7fca580b2600 2021-11-15T14:43:00.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5815a650 con 0x7fca580b2600 2021-11-15T14:43:00.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca580671f0 con 0x7fca580b2600 2021-11-15T14:43:00.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca5000da40 con 0x7fca580b2600 2021-11-15T14:43:00.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca580573d0 con 0x7fca580b2600 2021-11-15T14:43:00.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca5000dba0 con 0x7fca580b2600 2021-11-15T14:43:00.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 0x7fca38055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.448+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fca5006bf00 con 0x7fca580b2600 2021-11-15T14:43:00.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.452+0000 7fca5e571700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 0x7fca38055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.452+0000 7fca5e571700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 0x7fca38055bb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fca54002f70 tx=0x7fca54015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.452+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca50042e00 con 0x7fca580b2600 2021-11-15T14:43:00.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5815a7e0 con 0x7fca580b2600 2021-11-15T14:43:00.538 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca4b7fe700 1 -- 172.21.2.135:0/243882085 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fca50046420 con 0x7fca580b2600 2021-11-15T14:43:00.539 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:00.539 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":143,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:00.221221+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 msgr2=0x7fca38055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.540 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 0x7fca38055bb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fca54002f70 tx=0x7fca54015000).stop 2021-11-15T14:43:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 msgr2=0x7fca58146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fca580abab0 tx=0x7fca50009220).stop 2021-11-15T14:43:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 shutdown_connections 2021-11-15T14:43:00.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca380536f0 0x7fca38055bb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca580b2600 0x7fca58146690 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca580b0090 0x7fca580b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 --2- 172.21.2.135:0/243882085 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca580afc50 0x7fca58066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 >> 172.21.2.135:0/243882085 conn(0x7fca58060200 msgr2=0x7fca580b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 shutdown_connections 2021-11-15T14:43:00.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.536+0000 7fca5f573700 1 -- 172.21.2.135:0/243882085 wait complete. 2021-11-15T14:43:00.546 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:43:00.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.592+0000 7fe549406700 1 Processor -- start 2021-11-15T14:43:00.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- start start 2021-11-15T14:43:00.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe544060040 0x7fe544064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe5440b2ca0 0x7fe544065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440b2430 con 0x7fe5440b3950 2021-11-15T14:43:00.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe544065770 con 0x7fe5440b2ca0 2021-11-15T14:43:00.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440b26d0 con 0x7fe544060040 2021-11-15T14:43:00.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe544060040 0x7fe544064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe544060040 0x7fe544064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35014/0 (socket says 172.21.2.135:35014) 2021-11-15T14:43:00.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/3817875508 learned_addr learned my addr 172.21.2.135:0/3817875508 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/3817875508 >> v2:172.21.2.119:3300/0 conn(0x7fe5440b2ca0 msgr2=0x7fe544065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- 172.21.2.135:0/3817875508 >> v2:172.21.2.119:3300/0 conn(0x7fe5440b2ca0 0x7fe544065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/3817875508 >> v1:172.21.2.119:6789/0 conn(0x7fe5440b3950 legacy=0x7fe5440b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:00.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/3817875508 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440b2970 con 0x7fe544060040 2021-11-15T14:43:00.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- 172.21.2.135:0/3817875508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe544064d90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fe54413b870 tx=0x7fe538006eb0).ready entity=mon.1 client_cookie=3ee6e48dd5b37ede server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe541ffb700 1 -- 172.21.2.135:0/3817875508 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800d5c0 con 0x7fe544060040 2021-11-15T14:43:00.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe541ffb700 1 -- 172.21.2.135:0/3817875508 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe538000e90 con 0x7fe544060040 2021-11-15T14:43:00.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe541ffb700 1 -- 172.21.2.135:0/3817875508 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800d910 con 0x7fe544060040 2021-11-15T14:43:00.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/3817875508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 msgr2=0x7fe544064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- 172.21.2.135:0/3817875508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe544064d90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fe54413b870 tx=0x7fe538006eb0).stop 2021-11-15T14:43:00.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/3817875508 shutdown_connections 2021-11-15T14:43:00.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- 172.21.2.135:0/3817875508 >> v2:172.21.2.119:3300/0 conn(0x7fe5440b2ca0 0x7fe544065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:00.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- 172.21.2.135:0/3817875508 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe544064d90 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/3817875508 >> 172.21.2.135:0/3817875508 conn(0x7fe54405cfe0 msgr2=0x7fe54405f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:00.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/3817875508 shutdown_connections 2021-11-15T14:43:00.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/3817875508 wait complete. 2021-11-15T14:43:00.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 Processor -- start 2021-11-15T14:43:00.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- start start 2021-11-15T14:43:00.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5440b2ca0 0x7fe54414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 0x7fe54414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544151b30 con 0x7fe5440b3950 2021-11-15T14:43:00.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544151dd0 con 0x7fe544060040 2021-11-15T14:43:00.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe544152070 con 0x7fe5440b2ca0 2021-11-15T14:43:00.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35018/0 (socket says 172.21.2.135:35018) 2021-11-15T14:43:00.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/2123402476 learned_addr learned my addr 172.21.2.135:0/2123402476 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:00.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5440b2ca0 msgr2=0x7fe54414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe5427fc700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5440b2ca0 0x7fe54414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5440b2ca0 0x7fe54414e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe5437fe700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 0x7fe54414e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 msgr2=0x7fe54414e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:00.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 0x7fe54414e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:00.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 -- 172.21.2.135:0/2123402476 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53800b1e0 con 0x7fe544060040 2021-11-15T14:43:00.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe5437fe700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 0x7fe54414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:00.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe542ffd700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe54413b870 tx=0x7fe538015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe538002f70 con 0x7fe544060040 2021-11-15T14:43:00.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800d940 con 0x7fe544060040 2021-11-15T14:43:00.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544152310 con 0x7fe544060040 2021-11-15T14:43:00.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe538011e90 con 0x7fe544060040 2021-11-15T14:43:00.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.596+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe544151700 con 0x7fe544060040 2021-11-15T14:43:00.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5440648f0 con 0x7fe544060040 2021-11-15T14:43:00.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe538025030 con 0x7fe544060040 2021-11-15T14:43:00.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe533fff700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 0x7fe520055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:00.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe53806cca0 con 0x7fe544060040 2021-11-15T14:43:00.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe5427fc700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 0x7fe520055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:00.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe5427fc700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 0x7fe520055b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fe53c007000 tx=0x7fe53c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:00.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.600+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe538071070 con 0x7fe544060040 2021-11-15T14:43:00.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:00.712+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe5440573d0 con 0x7fe544060040 2021-11-15T14:43:01.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe533fff700 1 -- 172.21.2.135:0/2123402476 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe538023070 con 0x7fe544060040 2021-11-15T14:43:01.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 msgr2=0x7fe520055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 0x7fe520055b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fe53c007000 tx=0x7fe53c008040).stop 2021-11-15T14:43:01.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 msgr2=0x7fe54413bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe54413b870 tx=0x7fe538015000).stop 2021-11-15T14:43:01.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 shutdown_connections 2021-11-15T14:43:01.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe520053640 0x7fe520055b00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5440b3950 0x7fe54414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5440b2ca0 0x7fe54414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 --2- 172.21.2.135:0/2123402476 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe544060040 0x7fe54413bbf0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 >> 172.21.2.135:0/2123402476 conn(0x7fe54405cfe0 msgr2=0x7fe54413adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 shutdown_connections 2021-11-15T14:43:01.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.236+0000 7fe549406700 1 -- 172.21.2.135:0/2123402476 wait complete. 2021-11-15T14:43:01.247 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:01.300 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 Processor -- start 2021-11-15T14:43:01.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- start start 2021-11-15T14:43:01.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2c74148420 0x7f2c740b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.301 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740b03d0 con 0x7f2c740b1e30 2021-11-15T14:43:01.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740b0670 con 0x7f2c740a7140 2021-11-15T14:43:01.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c740a9140 con 0x7f2c74148420 2021-11-15T14:43:01.302 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2c74148420 0x7f2c740b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2c74148420 0x7f2c740b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35026/0 (socket says 172.21.2.135:35026) 2021-11-15T14:43:01.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 -- 172.21.2.135:0/1157044287 learned_addr learned my addr 172.21.2.135:0/1157044287 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 -- 172.21.2.135:0/1157044287 >> v1:172.21.2.135:6789/0 conn(0x7f2c740a7140 legacy=0x7f2c741447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 -- 172.21.2.135:0/1157044287 >> v1:172.21.2.119:6789/0 conn(0x7f2c740b1e30 legacy=0x7f2c740b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 -- 172.21.2.135:0/1157044287 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740b0910 con 0x7f2c74148420 2021-11-15T14:43:01.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79a49700 1 --2- 172.21.2.135:0/1157044287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c74148420 0x7f2c740b1050 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f2c740acee0 tx=0x7f2c70006eb0).ready entity=mon.1 client_cookie=fbbca482ccba6b39 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79248700 1 -- 172.21.2.135:0/1157044287 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7000d5c0 con 0x7f2c74148420 2021-11-15T14:43:01.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79248700 1 -- 172.21.2.135:0/1157044287 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70000e90 con 0x7f2c74148420 2021-11-15T14:43:01.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c79248700 1 -- 172.21.2.135:0/1157044287 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7000d950 con 0x7f2c74148420 2021-11-15T14:43:01.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1157044287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c74148420 msgr2=0x7f2c740b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1157044287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c74148420 0x7f2c740b1050 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f2c740acee0 tx=0x7f2c70006eb0).stop 2021-11-15T14:43:01.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1157044287 shutdown_connections 2021-11-15T14:43:01.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1157044287 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c74148420 0x7f2c740b1050 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1157044287 >> 172.21.2.135:0/1157044287 conn(0x7f2c7405f730 msgr2=0x7f2c7405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1157044287 shutdown_connections 2021-11-15T14:43:01.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1157044287 wait complete. 2021-11-15T14:43:01.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 Processor -- start 2021-11-15T14:43:01.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- start start 2021-11-15T14:43:01.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c740b1e30 0x7f2c74063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c74148420 0x7f2c74153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740640e0 con 0x7f2c74148420 2021-11-15T14:43:01.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740a9c50 con 0x7f2c740a7140 2021-11-15T14:43:01.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7c4ae700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740aa320 con 0x7f2c740b1e30 2021-11-15T14:43:01.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35030/0 (socket says 172.21.2.135:35030) 2021-11-15T14:43:01.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 -- 172.21.2.135:0/1538681216 learned_addr learned my addr 172.21.2.135:0/1538681216 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 -- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c740b1e30 msgr2=0x7f2c74063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c740b1e30 0x7f2c74063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 -- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c74148420 msgr2=0x7f2c74153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.296+0000 7f2c7a24a700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c74148420 0x7f2c74153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c7a24a700 1 -- 172.21.2.135:0/1538681216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7000b1e0 con 0x7f2c740a7140 2021-11-15T14:43:01.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c7a24a700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f2c68002f90 tx=0x7f2c68006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c68013460 con 0x7f2c740a7140 2021-11-15T14:43:01.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c680135c0 con 0x7f2c740a7140 2021-11-15T14:43:01.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7414b990 con 0x7f2c740a7140 2021-11-15T14:43:01.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c74157750 con 0x7f2c740a7140 2021-11-15T14:43:01.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c68013920 con 0x7f2c740a7140 2021-11-15T14:43:01.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74157ae0 con 0x7f2c740a7140 2021-11-15T14:43:01.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2c6801a060 con 0x7f2c740a7140 2021-11-15T14:43:01.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 0x7f2c54055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2c6806b500 con 0x7f2c740a7140 2021-11-15T14:43:01.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c79a49700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 0x7f2c54055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c79a49700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 0x7f2c54055be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2c740acee0 tx=0x7f2c70015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.300+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c68042400 con 0x7f2c740a7140 2021-11-15T14:43:01.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.408+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c740aa020 con 0x7f2c740a7140 2021-11-15T14:43:01.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.408+0000 7f2c677fe700 1 -- 172.21.2.135:0/1538681216 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f2c68018020 con 0x7f2c740a7140 2021-11-15T14:43:01.414 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:01.414 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:01.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 msgr2=0x7f2c54055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 0x7f2c54055be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2c740acee0 tx=0x7f2c70015000).stop 2021-11-15T14:43:01.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 msgr2=0x7f2c74063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f2c68002f90 tx=0x7f2c68006df0).stop 2021-11-15T14:43:01.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 shutdown_connections 2021-11-15T14:43:01.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2c54053720 0x7f2c54055be0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2c74148420 0x7f2c74153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2c740b1e30 0x7f2c74063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 --2- 172.21.2.135:0/1538681216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2c740a7140 0x7f2c74063700 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 >> 172.21.2.135:0/1538681216 conn(0x7f2c7405f730 msgr2=0x7f2c74143e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 shutdown_connections 2021-11-15T14:43:01.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.412+0000 7f2c7c4ae700 1 -- 172.21.2.135:0/1538681216 wait complete. 2021-11-15T14:43:01.418 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:01.421 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:01.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 Processor -- start 2021-11-15T14:43:01.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 -- start start 2021-11-15T14:43:01.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7facc4148420 0x7facc40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40b03d0 con 0x7facc40a7140 2021-11-15T14:43:01.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc40a9140 con 0x7facc4148420 2021-11-15T14:43:01.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7faccb255700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc40b0670 con 0x7facc40b1e30 2021-11-15T14:43:01.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7facc8ff1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7facc8ff1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:44814/0 (socket says 172.21.2.135:44814) 2021-11-15T14:43:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7facc8ff1700 1 -- 172.21.2.135:0/1728270831 learned_addr learned my addr 172.21.2.135:0/1728270831 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.468+0000 7facc3fff700 1 --2- 172.21.2.135:0/1728270831 >> v2:172.21.2.119:3300/0 conn(0x7facc4148420 0x7facc40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc8ff1700 1 -- 172.21.2.135:0/1728270831 >> v2:172.21.2.119:3300/0 conn(0x7facc4148420 msgr2=0x7facc40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc8ff1700 1 --2- 172.21.2.135:0/1728270831 >> v2:172.21.2.119:3300/0 conn(0x7facc4148420 0x7facc40b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc8ff1700 1 -- 172.21.2.135:0/1728270831 >> v1:172.21.2.119:6789/0 conn(0x7facc40a7140 legacy=0x7facc41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc8ff1700 1 -- 172.21.2.135:0/1728270831 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40b0910 con 0x7facc40b1e30 2021-11-15T14:43:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc8ff1700 1 --2- 172.21.2.135:0/1728270831 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7facac002f70 tx=0x7facac006eb0).ready entity=mon.2 client_cookie=ea40334410ce6013 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc37fe700 1 -- 172.21.2.135:0/1728270831 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac00d570 con 0x7facc40b1e30 2021-11-15T14:43:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc37fe700 1 -- 172.21.2.135:0/1728270831 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac000e90 con 0x7facc40b1e30 2021-11-15T14:43:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc37fe700 1 -- 172.21.2.135:0/1728270831 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac00d900 con 0x7facc40b1e30 2021-11-15T14:43:01.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- 172.21.2.135:0/1728270831 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 msgr2=0x7facc40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- 172.21.2.135:0/1728270831 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7facac002f70 tx=0x7facac006eb0).stop 2021-11-15T14:43:01.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- 172.21.2.135:0/1728270831 shutdown_connections 2021-11-15T14:43:01.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- 172.21.2.135:0/1728270831 >> v2:172.21.2.119:3300/0 conn(0x7facc4148420 0x7facc40b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- 172.21.2.135:0/1728270831 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40b1e30 0x7facc40b1050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- 172.21.2.135:0/1728270831 >> 172.21.2.135:0/1728270831 conn(0x7facc405f730 msgr2=0x7facc405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- 172.21.2.135:0/1728270831 shutdown_connections 2021-11-15T14:43:01.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- 172.21.2.135:0/1728270831 wait complete. 2021-11-15T14:43:01.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 Processor -- start 2021-11-15T14:43:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- start start 2021-11-15T14:43:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40a7140 0x7facc41574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7facc4148420 0x7facc40ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40637d0 con 0x7facc4148420 2021-11-15T14:43:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4063a70 con 0x7facc40b1e30 2021-11-15T14:43:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7faccb255700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc4063d10 con 0x7facc40a7140 2021-11-15T14:43:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35048/0 (socket says 172.21.2.135:35048) 2021-11-15T14:43:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 -- 172.21.2.135:0/590909400 learned_addr learned my addr 172.21.2.135:0/590909400 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 -- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40a7140 msgr2=0x7facc41574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40a7140 0x7facc41574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 -- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7facc4148420 msgr2=0x7facc40ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7facc4148420 0x7facc40ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.472+0000 7facc3fff700 1 -- 172.21.2.135:0/590909400 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac00b1e0 con 0x7facc40b1e30 2021-11-15T14:43:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc3fff700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7facb400c000 tx=0x7facb4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb4010780 con 0x7facc40b1e30 2021-11-15T14:43:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40108e0 con 0x7facc40b1e30 2021-11-15T14:43:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4149da0 con 0x7facc40b1e30 2021-11-15T14:43:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40a9d50 con 0x7facc40b1e30 2021-11-15T14:43:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facb4010c40 con 0x7facc40b1e30 2021-11-15T14:43:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc40b0bb0 con 0x7facc40b1e30 2021-11-15T14:43:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7facb401c460 con 0x7facc40b1e30 2021-11-15T14:43:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 0x7faca8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7facb406c040 con 0x7facc40b1e30 2021-11-15T14:43:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc8ff1700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 0x7faca8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc8ff1700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 0x7faca8055b20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7facac002f70 tx=0x7facac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.476+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facb4042ee0 con 0x7facc40b1e30 2021-11-15T14:43:01.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.560+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facc40573d0 con 0x7facc40b1e30 2021-11-15T14:43:01.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.560+0000 7facc1ffb700 1 -- 172.21.2.135:0/590909400 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16285 (secure 0 0 0) 0x7facb4046500 con 0x7facc40b1e30 2021-11-15T14:43:01.566 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:01.566 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":144,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:01.227552+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:01.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 msgr2=0x7faca8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 0x7faca8055b20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7facac002f70 tx=0x7facac015000).stop 2021-11-15T14:43:01.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 msgr2=0x7facc40a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7facb400c000 tx=0x7facb4006df0).stop 2021-11-15T14:43:01.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 shutdown_connections 2021-11-15T14:43:01.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faca8053660 0x7faca8055b20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7facc4148420 0x7facc40ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7facc40b1e30 0x7facc40a9860 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 --2- 172.21.2.135:0/590909400 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7facc40a7140 0x7facc41574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 >> 172.21.2.135:0/590909400 conn(0x7facc405f730 msgr2=0x7facc40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 shutdown_connections 2021-11-15T14:43:01.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.564+0000 7faccb255700 1 -- 172.21.2.135:0/590909400 wait complete. 2021-11-15T14:43:01.574 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:01.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 Processor -- start 2021-11-15T14:43:01.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 -- start start 2021-11-15T14:43:01.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fae4c148420 0x7fae4c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 0x7fae4c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0b03d0 con 0x7fae4c0b1e30 2021-11-15T14:43:01.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0a9140 con 0x7fae4c148420 2021-11-15T14:43:01.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae5193e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b0670 con 0x7fae4c0a7140 2021-11-15T14:43:01.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae4affd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fae4c0b1e30 0x7fae4c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50872/0 (socket says 172.21.2.135:50872) 2021-11-15T14:43:01.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae4affd700 1 -- 172.21.2.135:0/2784626993 learned_addr learned my addr 172.21.2.135:0/2784626993 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:01.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584827948 0 0) 0x7fae4c0b03d0 con 0x7fae4c0b1e30 2021-11-15T14:43:01.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae2c003260 con 0x7fae4c0b1e30 2021-11-15T14:43:01.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852388852 0 0) 0x7fae2c003260 con 0x7fae4c0b1e30 2021-11-15T14:43:01.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 msgr2=0x7fae4c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 0x7fae4c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 >> v2:172.21.2.119:3300/0 conn(0x7fae4c148420 msgr2=0x7fae4c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 --2- 172.21.2.135:0/2784626993 >> v2:172.21.2.119:3300/0 conn(0x7fae4c148420 0x7fae4c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0b0910 con 0x7fae4c0b1e30 2021-11-15T14:43:01.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fae34001660 con 0x7fae4c0b1e30 2021-11-15T14:43:01.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 >> v1:172.21.2.135:6789/0 conn(0x7fae4c0b1e30 legacy=0x7fae4c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.624+0000 7fae49ffb700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 0x7fae2c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae2c003e10 0x7fae2c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c004b10 0x7fae2c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b0670 con 0x7fae2c004b10 2021-11-15T14:43:01.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00b960 con 0x7fae2c003e10 2021-11-15T14:43:01.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00bb20 con 0x7fae4c0a7140 2021-11-15T14:43:01.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae2c003e10 0x7fae2c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 msgr2=0x7fae2c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c0a7140 0x7fae2c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c004b10 msgr2=0x7fae2c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c004b10 0x7fae2c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/2784626993 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c003260 con 0x7fae2c003e10 2021-11-15T14:43:01.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae2c003e10 0x7fae2c004500 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c006ca0).ready entity=mon.1 client_cookie=1563af7cb19e08ba server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c012410 con 0x7fae2c003e10 2021-11-15T14:43:01.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c012570 con 0x7fae2c003e10 2021-11-15T14:43:01.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae49ffb700 1 -- 172.21.2.135:0/2784626993 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c0128d0 con 0x7fae2c003e10 2021-11-15T14:43:01.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/2784626993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae2c003e10 msgr2=0x7fae2c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 --2- 172.21.2.135:0/2784626993 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae2c003e10 0x7fae2c004500 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c006ca0).stop 2021-11-15T14:43:01.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4b7fe700 1 -- 172.21.2.135:0/2784626993 reap_dead start 2021-11-15T14:43:01.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/2784626993 shutdown_connections 2021-11-15T14:43:01.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/2784626993 >> 172.21.2.135:0/2784626993 conn(0x7fae4c05f730 msgr2=0x7fae4c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/2784626993 shutdown_connections 2021-11-15T14:43:01.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/2784626993 wait complete. 2021-11-15T14:43:01.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 Processor -- start 2021-11-15T14:43:01.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- start start 2021-11-15T14:43:01.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c003e10 0x7fae4c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c156920 0x7fae4c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0ad800 con 0x7fae2c003e10 2021-11-15T14:43:01.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0adaa0 con 0x7fae4c0ad360 2021-11-15T14:43:01.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c15a070 con 0x7fae4c156920 2021-11-15T14:43:01.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35066/0 (socket says 172.21.2.135:35066) 2021-11-15T14:43:01.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/4234699389 learned_addr learned my addr 172.21.2.135:0/4234699389 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c156920 msgr2=0x7fae4c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c156920 0x7fae4c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c003e10 msgr2=0x7fae4c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c003e10 0x7fae4c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 -- 172.21.2.135:0/4234699389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c1544d0 con 0x7fae4c0ad360 2021-11-15T14:43:01.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae4a7fc700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c012410 con 0x7fae4c0ad360 2021-11-15T14:43:01.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c01d610 con 0x7fae4c0ad360 2021-11-15T14:43:01.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c0aac90 con 0x7fae4c0ad360 2021-11-15T14:43:01.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c15a510 con 0x7fae4c0ad360 2021-11-15T14:43:01.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.628+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c01d970 con 0x7fae4c0ad360 2021-11-15T14:43:01.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae24003410 con 0x7fae4c0ad360 2021-11-15T14:43:01.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae3c024030 con 0x7fae4c0ad360 2021-11-15T14:43:01.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae43fff700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 0x7fae30055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fae3c06cd50 con 0x7fae4c0ad360 2021-11-15T14:43:01.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae4affd700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 0x7fae30055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae4affd700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 0x7fae30055bb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fae4c1477b0 tx=0x7fae4c0b0aa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.632+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae3c043ca0 con 0x7fae4c0ad360 2021-11-15T14:43:01.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.744+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fae240036c0 con 0x7fae4c0ad360 2021-11-15T14:43:01.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.756+0000 7fae43fff700 1 -- 172.21.2.135:0/4234699389 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7fae3c022020 con 0x7fae4c0ad360 2021-11-15T14:43:01.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.756+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 msgr2=0x7fae30055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.756+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 0x7fae30055bb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fae4c1477b0 tx=0x7fae4c0b0aa0).stop 2021-11-15T14:43:01.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 msgr2=0x7fae4c157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fae3c002f70 tx=0x7fae3c015000).stop 2021-11-15T14:43:01.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 shutdown_connections 2021-11-15T14:43:01.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fae300536f0 0x7fae30055bb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fae4c156920 0x7fae4c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fae4c0ad360 0x7fae4c157050 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 --2- 172.21.2.135:0/4234699389 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fae2c003e10 0x7fae4c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 >> 172.21.2.135:0/4234699389 conn(0x7fae4c05f730 msgr2=0x7fae4c0b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 shutdown_connections 2021-11-15T14:43:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.760+0000 7fae5193e700 1 -- 172.21.2.135:0/4234699389 wait complete. 2021-11-15T14:43:01.765 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:43:01.768 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:01.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 Processor -- start 2021-11-15T14:43:01.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- start start 2021-11-15T14:43:01.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f61f80b1050 0x7f61f81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80b03d0 con 0x7f61f8148420 2021-11-15T14:43:01.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80b0670 con 0x7f61f80b1e30 2021-11-15T14:43:01.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80a9140 con 0x7f61f80b1050 2021-11-15T14:43:01.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f659c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f61f80b1e30 0x7f61f80b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50892/0 (socket says 172.21.2.135:50892) 2021-11-15T14:43:01.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f659c700 1 -- 172.21.2.135:0/3657087285 learned_addr learned my addr 172.21.2.135:0/3657087285 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:01.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986297958 0 0) 0x7f61f80b0670 con 0x7f61f80b1e30 2021-11-15T14:43:01.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61dc003260 con 0x7f61f80b1e30 2021-11-15T14:43:01.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f6d9d700 1 --2- 172.21.2.135:0/3657087285 >> v2:172.21.2.119:3300/0 conn(0x7f61f80b1050 0x7f61f81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3081262883 0 0) 0x7f61dc003260 con 0x7f61f80b1e30 2021-11-15T14:43:01.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 >> v2:172.21.2.119:3300/0 conn(0x7f61f80b1050 msgr2=0x7f61f81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 --2- 172.21.2.135:0/3657087285 >> v2:172.21.2.119:3300/0 conn(0x7f61f80b1050 0x7f61f81447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 >> v1:172.21.2.119:6789/0 conn(0x7f61f8148420 legacy=0x7f61f80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80b0910 con 0x7f61f80b1e30 2021-11-15T14:43:01.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f61e8001660 con 0x7f61f80b1e30 2021-11-15T14:43:01.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 >> v1:172.21.2.135:6789/0 conn(0x7f61f80b1e30 legacy=0x7f61f80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61dc003750 0x7f61dc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61dc004ec0 0x7f61dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc00bd50 con 0x7f61dc003750 2021-11-15T14:43:01.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc00bec0 con 0x7f61dc004500 2021-11-15T14:43:01.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc00c080 con 0x7f61dc004ec0 2021-11-15T14:43:01.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f659c700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61dc003750 0x7f61dc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f6d9d700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61dc004ec0 0x7f61dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 -- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61dc004ec0 msgr2=0x7f61dc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61dc004ec0 0x7f61dc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 -- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61dc003750 msgr2=0x7f61dc003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:01.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61dc003750 0x7f61dc003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 -- 172.21.2.135:0/3657087285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc003260 con 0x7f61dc004500 2021-11-15T14:43:01.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f6d9d700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61dc004ec0 0x7f61dc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:01.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f6d9d700 1 -- 172.21.2.135:0/3657087285 reap_dead start 2021-11-15T14:43:01.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61dc004980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f61ec001fa0 tx=0x7f61ec007a00).ready entity=mon.1 client_cookie=9f8392266fd461cb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec007030 con 0x7f61dc004500 2021-11-15T14:43:01.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec002e90 con 0x7f61dc004500 2021-11-15T14:43:01.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61f559a700 1 -- 172.21.2.135:0/3657087285 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ec007380 con 0x7f61dc004500 2021-11-15T14:43:01.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 msgr2=0x7f61dc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61dc004980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f61ec001fa0 tx=0x7f61ec007a00).stop 2021-11-15T14:43:01.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- 172.21.2.135:0/3657087285 shutdown_connections 2021-11-15T14:43:01.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 --2- 172.21.2.135:0/3657087285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61dc004980 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- 172.21.2.135:0/3657087285 >> 172.21.2.135:0/3657087285 conn(0x7f61f805f730 msgr2=0x7f61f805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- 172.21.2.135:0/3657087285 shutdown_connections 2021-11-15T14:43:01.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.820+0000 7f61fccb7700 1 -- 172.21.2.135:0/3657087285 wait complete. 2021-11-15T14:43:01.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 Processor -- start 2021-11-15T14:43:01.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- start start 2021-11-15T14:43:01.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61f80ae3e0 0x7f61f8145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61f8148ad0 0x7f61f8148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80ae840 con 0x7f61f8148ad0 2021-11-15T14:43:01.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8146ef0 con 0x7f61dc004500 2021-11-15T14:43:01.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8147190 con 0x7f61f80ae3e0 2021-11-15T14:43:01.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35084/0 (socket says 172.21.2.135:35084) 2021-11-15T14:43:01.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 -- 172.21.2.135:0/2599572862 learned_addr learned my addr 172.21.2.135:0/2599572862 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:01.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61f80ae3e0 0x7f61f8145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 -- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61f80ae3e0 msgr2=0x7f61f8145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61f80ae3e0 0x7f61f8145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 -- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61f8148ad0 msgr2=0x7f61f8148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61f8148ad0 0x7f61f8148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 -- 172.21.2.135:0/2599572862 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8147430 con 0x7f61dc004500 2021-11-15T14:43:01.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f659c700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f61e800b000 tx=0x7f61f80b0800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e8010710 con 0x7f61dc004500 2021-11-15T14:43:01.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8010870 con 0x7f61dc004500 2021-11-15T14:43:01.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8149470 con 0x7f61dc004500 2021-11-15T14:43:01.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61e8010bd0 con 0x7f61dc004500 2021-11-15T14:43:01.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8141e40 con 0x7f61dc004500 2021-11-15T14:43:01.856 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80b0bb0 con 0x7f61dc004500 2021-11-15T14:43:01.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61e8010d30 con 0x7f61dc004500 2021-11-15T14:43:01.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 0x7f61d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:01.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f61e806b990 con 0x7f61dc004500 2021-11-15T14:43:01.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 0x7f61d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:01.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.824+0000 7f61f5d9b700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 0x7f61d4055b60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f61ec018000 tx=0x7f61ec015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:01.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.828+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61e80429a0 con 0x7f61dc004500 2021-11-15T14:43:01.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.940+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f61f80573d0 con 0x7f61dc004500 2021-11-15T14:43:01.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.952+0000 7f61e77fe700 1 -- 172.21.2.135:0/2599572862 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f61e8045fc0 con 0x7f61dc004500 2021-11-15T14:43:01.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 msgr2=0x7f61d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 0x7f61d4055b60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f61ec018000 tx=0x7f61ec015000).stop 2021-11-15T14:43:01.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 msgr2=0x7f61f814b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:01.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f61e800b000 tx=0x7f61f80b0800).stop 2021-11-15T14:43:01.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 shutdown_connections 2021-11-15T14:43:01.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f61d40536a0 0x7f61d4055b60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f61f8148ad0 0x7f61f8148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:01.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f61f80ae3e0 0x7f61f8145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 --2- 172.21.2.135:0/2599572862 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61dc004500 0x7f61f814b850 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:01.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 >> 172.21.2.135:0/2599572862 conn(0x7f61f805f730 msgr2=0x7f61f80b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:01.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 shutdown_connections 2021-11-15T14:43:01.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:01.956+0000 7f61fccb7700 1 -- 172.21.2.135:0/2599572862 wait complete. 2021-11-15T14:43:01.988 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:43:01.989 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 Processor -- start 2021-11-15T14:43:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- start start 2021-11-15T14:43:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f8c0b1050 0x7f6f8c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c0b03d0 con 0x7f6f8c148420 2021-11-15T14:43:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c0b0670 con 0x7f6f8c0b1e30 2021-11-15T14:43:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0a9140 con 0x7f6f8c0b1050 2021-11-15T14:43:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f8c0b1050 0x7f6f8c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6f8c0b1050 0x7f6f8c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35096/0 (socket says 172.21.2.135:35096) 2021-11-15T14:43:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 -- 172.21.2.135:0/1646897829 learned_addr learned my addr 172.21.2.135:0/1646897829 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 -- 172.21.2.135:0/1646897829 >> v1:172.21.2.135:6789/0 conn(0x7f6f8c0b1e30 legacy=0x7f6f8c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 -- 172.21.2.135:0/1646897829 >> v1:172.21.2.119:6789/0 conn(0x7f6f8c148420 legacy=0x7f6f8c0a7140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:02.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f89ffb700 1 -- 172.21.2.135:0/1646897829 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078876030 0 0) 0x7f6f8c0b0670 con 0x7f6f8c0b1e30 2021-11-15T14:43:02.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 -- 172.21.2.135:0/1646897829 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0b0910 con 0x7f6f8c0b1050 2021-11-15T14:43:02.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f8b7fe700 1 --2- 172.21.2.135:0/1646897829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c1447a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6f8c1477b0 tx=0x7f6f84009290).ready entity=mon.1 client_cookie=7813da335e6730cd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f89ffb700 1 -- 172.21.2.135:0/1646897829 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f8400b820 con 0x7f6f8c0b1050 2021-11-15T14:43:02.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f89ffb700 1 -- 172.21.2.135:0/1646897829 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400b980 con 0x7f6f8c0b1050 2021-11-15T14:43:02.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f89ffb700 1 -- 172.21.2.135:0/1646897829 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f8400baf0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- 172.21.2.135:0/1646897829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 msgr2=0x7f6f8c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 --2- 172.21.2.135:0/1646897829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c1447a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6f8c1477b0 tx=0x7f6f84009290).stop 2021-11-15T14:43:02.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- 172.21.2.135:0/1646897829 shutdown_connections 2021-11-15T14:43:02.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 --2- 172.21.2.135:0/1646897829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c1447a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- 172.21.2.135:0/1646897829 >> 172.21.2.135:0/1646897829 conn(0x7f6f8c05f730 msgr2=0x7f6f8c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- 172.21.2.135:0/1646897829 shutdown_connections 2021-11-15T14:43:02.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- 172.21.2.135:0/1646897829 wait complete. 2021-11-15T14:43:02.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 Processor -- start 2021-11-15T14:43:02.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.052+0000 7f6f91376700 1 -- start start 2021-11-15T14:43:02.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f8c0b1e30 0x7f6f8c0ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f8c148420 0x7f6f8c0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14b570 con 0x7f6f8c148420 2021-11-15T14:43:02.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14aab0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14b7c0 con 0x7f6f8c0b1e30 2021-11-15T14:43:02.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35098/0 (socket says 172.21.2.135:35098) 2021-11-15T14:43:02.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 -- 172.21.2.135:0/890364938 learned_addr learned my addr 172.21.2.135:0/890364938 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 -- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f8c0b1e30 msgr2=0x7f6f8c0ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f8c0b1e30 0x7f6f8c0ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 -- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f8c148420 msgr2=0x7f6f8c0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f8c148420 0x7f6f8c0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 -- 172.21.2.135:0/890364938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009530 con 0x7f6f8c0b1050 2021-11-15T14:43:02.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8affd700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f6f7c000bc0 tx=0x7f6f7c007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00ce00 con 0x7f6f8c0b1050 2021-11-15T14:43:02.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00f470 con 0x7f6f8c0b1050 2021-11-15T14:43:02.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c14ba60 con 0x7f6f8c0b1050 2021-11-15T14:43:02.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c149c80 con 0x7f6f8c0b1050 2021-11-15T14:43:02.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00f7d0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0ab1d0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f7c019030 con 0x7f6f8c0b1050 2021-11-15T14:43:02.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 0x7f6f70055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6f7c06af70 con 0x7f6f8c0b1050 2021-11-15T14:43:02.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8a7fc700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 0x7f6f70055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.056+0000 7f6f8a7fc700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 0x7f6f70055b20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6f74000ed0 tx=0x7f6f74006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.060+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f8c0ab1d0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.168+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f8c0ab1d0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.168+0000 7f6f83fff700 1 -- 172.21.2.135:0/890364938 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f6f8c0ab1d0 con 0x7f6f8c0b1050 2021-11-15T14:43:02.174 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:02.174 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:02.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 msgr2=0x7f6f70055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 0x7f6f70055b20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f6f74000ed0 tx=0x7f6f74006930).stop 2021-11-15T14:43:02.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 msgr2=0x7f6f8c0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f6f7c000bc0 tx=0x7f6f7c007a70).stop 2021-11-15T14:43:02.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 shutdown_connections 2021-11-15T14:43:02.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6f70053660 0x7f6f70055b20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6f8c148420 0x7f6f8c0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6f8c0b1e30 0x7f6f8c0ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 --2- 172.21.2.135:0/890364938 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6f8c0b1050 0x7f6f8c0ae2c0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 >> 172.21.2.135:0/890364938 conn(0x7f6f8c05f730 msgr2=0x7f6f8c0b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 shutdown_connections 2021-11-15T14:43:02.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.172+0000 7f6f91376700 1 -- 172.21.2.135:0/890364938 wait complete. 2021-11-15T14:43:02.178 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:02.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:00.221722+0000', 'modified': '2021-11-15T14:43:01.226479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8041}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8041': {'gid': 8041, 'name': 'b', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.119:6835/2587030449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.119:6834', 'nonce': 2587030449}, {'type': 'v1', 'addr': '172.21.2.119:6835', 'nonce': 2587030449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:02.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:02.484 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T14:43:02.551 INFO:teuthology.orchestra.run.gibba019.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8041,"want_state":"up:active","state":"up:active","rank_uptime":2.3169902499999999,"mdsmap_epoch":70,"osdmap_epoch":144,"osdmap_epoch_barrier":143,"uptime":6.6384247529999998} 2021-11-15T14:43:02.551 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8041, "mdsmap_epoch": 70, "osdmap_epoch": 144, "osdmap_epoch_barrier": 143, "rank_uptime": 2.31699025, "state": "up:active", "uptime": 6.638424753, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:02.552 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:02.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 Processor -- start 2021-11-15T14:43:02.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- start start 2021-11-15T14:43:02.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4c1c0a7140 0x7f4c1c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0b03d0 con 0x7f4c1c148420 2021-11-15T14:43:02.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a9140 con 0x7f4c1c0a7140 2021-11-15T14:43:02.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b0670 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35108/0 (socket says 172.21.2.135:35108) 2021-11-15T14:43:02.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 -- 172.21.2.135:0/3953590084 learned_addr learned my addr 172.21.2.135:0/3953590084 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 -- 172.21.2.135:0/3953590084 >> v2:172.21.2.119:3300/0 conn(0x7f4c1c0a7140 msgr2=0x7f4c1c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:02.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 --2- 172.21.2.135:0/3953590084 >> v2:172.21.2.119:3300/0 conn(0x7f4c1c0a7140 0x7f4c1c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 -- 172.21.2.135:0/3953590084 >> v1:172.21.2.119:6789/0 conn(0x7f4c1c148420 legacy=0x7f4c1c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:02.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 -- 172.21.2.135:0/3953590084 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0b0910 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1a59c700 1 --2- 172.21.2.135:0/3953590084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f4c1c1477b0 tx=0x7f4c0c006eb0).ready entity=mon.1 client_cookie=b42ad7cd80d34fe6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1959a700 1 -- 172.21.2.135:0/3953590084 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c00d5c0 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1959a700 1 -- 172.21.2.135:0/3953590084 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c000e90 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c1959a700 1 -- 172.21.2.135:0/3953590084 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c00d950 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- 172.21.2.135:0/3953590084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0b1e30 msgr2=0x7f4c1c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 --2- 172.21.2.135:0/3953590084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f4c1c1477b0 tx=0x7f4c0c006eb0).stop 2021-11-15T14:43:02.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- 172.21.2.135:0/3953590084 shutdown_connections 2021-11-15T14:43:02.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 --2- 172.21.2.135:0/3953590084 >> v2:172.21.2.119:3300/0 conn(0x7f4c1c0a7140 0x7f4c1c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 --2- 172.21.2.135:0/3953590084 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c0b1050 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- 172.21.2.135:0/3953590084 >> 172.21.2.135:0/3953590084 conn(0x7f4c1c05f730 msgr2=0x7f4c1c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- 172.21.2.135:0/3953590084 shutdown_connections 2021-11-15T14:43:02.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.604+0000 7f4c20929700 1 -- 172.21.2.135:0/3953590084 wait complete. 2021-11-15T14:43:02.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 Processor -- start 2021-11-15T14:43:02.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- start start 2021-11-15T14:43:02.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c1c148420 0x7f4c1c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ab310 con 0x7f4c1c0b1e30 2021-11-15T14:43:02.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157790 con 0x7f4c1c0a7140 2021-11-15T14:43:02.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157a30 con 0x7f4c1c148420 2021-11-15T14:43:02.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35114/0 (socket says 172.21.2.135:35114) 2021-11-15T14:43:02.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 -- 172.21.2.135:0/2541451111 learned_addr learned my addr 172.21.2.135:0/2541451111 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 -- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c1c148420 msgr2=0x7f4c1c15a0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:02.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c1c148420 0x7f4c1c15a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 -- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c1c0b1e30 msgr2=0x7f4c1c148950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:02.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c148950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 -- 172.21.2.135:0/2541451111 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c00b1e0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c1a59c700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f4c1c1477b0 tx=0x7f4c0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c0119d0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c011b30 con 0x7f4c1c0a7140 2021-11-15T14:43:02.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0abbd0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c011e90 con 0x7f4c1c0a7140 2021-11-15T14:43:02.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0ab710 con 0x7f4c1c0a7140 2021-11-15T14:43:02.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c1575c0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c0c025030 con 0x7f4c1c0a7140 2021-11-15T14:43:02.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 0x7f4bf8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4c0c06ce90 con 0x7f4c1c0a7140 2021-11-15T14:43:02.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c19d9b700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 0x7f4bf8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.608+0000 7f4c19d9b700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 0x7f4bf8055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f4c10002f10 tx=0x7f4c100068b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.612+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c0c043ea0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.697 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.692+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c0b0bb0 con 0x7f4c1c0a7140 2021-11-15T14:43:02.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c0b7fe700 1 -- 172.21.2.135:0/2541451111 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f4c0c023090 con 0x7f4c1c0a7140 2021-11-15T14:43:02.698 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:02.699 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":144,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:01.227552+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:02.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 msgr2=0x7f4bf8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 0x7f4bf8055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f4c10002f10 tx=0x7f4c100068b0).stop 2021-11-15T14:43:02.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 msgr2=0x7f4c1c0ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f4c1c1477b0 tx=0x7f4c0c015000).stop 2021-11-15T14:43:02.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 shutdown_connections 2021-11-15T14:43:02.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4bf80536a0 0x7f4bf8055b60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c1c148420 0x7f4c1c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c1c0b1e30 0x7f4c1c148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 --2- 172.21.2.135:0/2541451111 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c1c0a7140 0x7f4c1c0ae3d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 >> 172.21.2.135:0/2541451111 conn(0x7f4c1c05f730 msgr2=0x7f4c1c1449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 shutdown_connections 2021-11-15T14:43:02.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.696+0000 7f4c20929700 1 -- 172.21.2.135:0/2541451111 wait complete. 2021-11-15T14:43:02.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:42:58.129588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:42:59.213509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:02.707 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:02.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 Processor -- start 2021-11-15T14:43:02.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- start start 2021-11-15T14:43:02.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f441c0b1f40 0x7f441c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f441c0b0030 0x7f441c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0b04a0 con 0x7f441c0a7140 2021-11-15T14:43:02.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0b2810 con 0x7f441c0b0030 2021-11-15T14:43:02.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0b06d0 con 0x7f441c0b1f40 2021-11-15T14:43:02.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f441c0b1f40 0x7f441c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f441c0b1f40 0x7f441c0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35122/0 (socket says 172.21.2.135:35122) 2021-11-15T14:43:02.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 -- 172.21.2.135:0/690600051 learned_addr learned my addr 172.21.2.135:0/690600051 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 -- 172.21.2.135:0/690600051 >> v2:172.21.2.119:3300/0 conn(0x7f441c0b0030 msgr2=0x7f441c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:02.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 --2- 172.21.2.135:0/690600051 >> v2:172.21.2.119:3300/0 conn(0x7f441c0b0030 0x7f441c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 -- 172.21.2.135:0/690600051 >> v1:172.21.2.119:6789/0 conn(0x7f441c0a7140 legacy=0x7f441c1412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:02.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 -- 172.21.2.135:0/690600051 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0b0970 con 0x7f441c0b1f40 2021-11-15T14:43:02.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44219fc700 1 --2- 172.21.2.135:0/690600051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0b1350 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f441c0ad350 tx=0x7f4410006eb0).ready entity=mon.1 client_cookie=d888194d3c4d6780 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44209fa700 1 -- 172.21.2.135:0/690600051 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f441000d5c0 con 0x7f441c0b1f40 2021-11-15T14:43:02.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44209fa700 1 -- 172.21.2.135:0/690600051 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410000e90 con 0x7f441c0b1f40 2021-11-15T14:43:02.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f44209fa700 1 -- 172.21.2.135:0/690600051 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f441000d910 con 0x7f441c0b1f40 2021-11-15T14:43:02.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- 172.21.2.135:0/690600051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 msgr2=0x7f441c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 --2- 172.21.2.135:0/690600051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0b1350 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f441c0ad350 tx=0x7f4410006eb0).stop 2021-11-15T14:43:02.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- 172.21.2.135:0/690600051 shutdown_connections 2021-11-15T14:43:02.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 --2- 172.21.2.135:0/690600051 >> v2:172.21.2.119:3300/0 conn(0x7f441c0b0030 0x7f441c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 --2- 172.21.2.135:0/690600051 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0b1350 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- 172.21.2.135:0/690600051 >> 172.21.2.135:0/690600051 conn(0x7f441c05f730 msgr2=0x7f441c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- 172.21.2.135:0/690600051 shutdown_connections 2021-11-15T14:43:02.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.756+0000 7f4423c60700 1 -- 172.21.2.135:0/690600051 wait complete. 2021-11-15T14:43:02.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 Processor -- start 2021-11-15T14:43:02.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- start start 2021-11-15T14:43:02.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f441c0a7140 0x7f441c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.769 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f441c0b0030 0x7f441c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0ac3b0 con 0x7f441c0b0030 2021-11-15T14:43:02.770 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1481a0 con 0x7f441c0b1f40 2021-11-15T14:43:02.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c148670 con 0x7f441c0a7140 2021-11-15T14:43:02.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35126/0 (socket says 172.21.2.135:35126) 2021-11-15T14:43:02.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 -- 172.21.2.135:0/2429598047 learned_addr learned my addr 172.21.2.135:0/2429598047 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 -- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f441c0a7140 msgr2=0x7f441c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f441c0a7140 0x7f441c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 -- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f441c0b0030 msgr2=0x7f441c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f441c0b0030 0x7f441c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 -- 172.21.2.135:0/2429598047 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441000b1e0 con 0x7f441c0b1f40 2021-11-15T14:43:02.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f44221fd700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f4414003310 tx=0x7f44140091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4414001500 con 0x7f441c0b1f40 2021-11-15T14:43:02.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414001660 con 0x7f441c0b1f40 2021-11-15T14:43:02.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c063020 con 0x7f441c0b1f40 2021-11-15T14:43:02.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c1483d0 con 0x7f441c0b1f40 2021-11-15T14:43:02.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44140019c0 con 0x7f441c0b1f40 2021-11-15T14:43:02.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c14a690 con 0x7f441c0b1f40 2021-11-15T14:43:02.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4414018030 con 0x7f441c0b1f40 2021-11-15T14:43:02.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 0x7f43fc055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.760+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f441406b4e0 con 0x7f441c0b1f40 2021-11-15T14:43:02.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.764+0000 7f44219fc700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 0x7f43fc055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.764+0000 7f44219fc700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 0x7f43fc055ac0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f441c0ad350 tx=0x7f4410015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.764+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f441c14a690 con 0x7f441c0b1f40 2021-11-15T14:43:02.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f441c14a690 con 0x7f441c0b1f40 2021-11-15T14:43:02.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f440effd700 1 -- 172.21.2.135:0/2429598047 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v144) v1 ==== 110+0+10 (secure 0 0 0) 0x7f441c14a690 con 0x7f441c0b1f40 2021-11-15T14:43:02.849 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:02.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 msgr2=0x7f43fc055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 0x7f43fc055ac0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f441c0ad350 tx=0x7f4410015000).stop 2021-11-15T14:43:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 msgr2=0x7f441c0aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f4414003310 tx=0x7f44140091a0).stop 2021-11-15T14:43:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 shutdown_connections 2021-11-15T14:43:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f43fc053600 0x7f43fc055ac0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f441c0b1f40 0x7f441c0aa430 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f441c0b0030 0x7f441c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 --2- 172.21.2.135:0/2429598047 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f441c0a7140 0x7f441c0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 >> 172.21.2.135:0/2429598047 conn(0x7f441c05f730 msgr2=0x7f441c13f830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 shutdown_connections 2021-11-15T14:43:02.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.844+0000 7f4423c60700 1 -- 172.21.2.135:0/2429598047 wait complete. 2021-11-15T14:43:02.855 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:02.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 Processor -- start 2021-11-15T14:43:02.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- start start 2021-11-15T14:43:02.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f85bc0b3790 0x7f85bc13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85bc13dac0 0x7f85bc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc1439a0 con 0x7f85bc0b3790 2021-11-15T14:43:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc143c40 con 0x7f85bc13dac0 2021-11-15T14:43:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc143ee0 con 0x7f85bc0b0630 2021-11-15T14:43:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85bc13dac0 0x7f85bc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f85bc13dac0 0x7f85bc0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35132/0 (socket says 172.21.2.135:35132) 2021-11-15T14:43:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 -- 172.21.2.135:0/725568761 learned_addr learned my addr 172.21.2.135:0/725568761 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 -- 172.21.2.135:0/725568761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 msgr2=0x7f85bc0b0a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:02.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 --2- 172.21.2.135:0/725568761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0b0a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 -- 172.21.2.135:0/725568761 >> v2:172.21.2.119:3300/0 conn(0x7f85bc0b3790 msgr2=0x7f85bc13d5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:02.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 --2- 172.21.2.135:0/725568761 >> v2:172.21.2.119:3300/0 conn(0x7f85bc0b3790 0x7f85bc13d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 -- 172.21.2.135:0/725568761 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc144180 con 0x7f85bc13dac0 2021-11-15T14:43:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c10e2700 1 --2- 172.21.2.135:0/725568761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc13dac0 0x7f85bc0b1130 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f85b40032f0 tx=0x7f85b400b530).ready entity=mon.1 client_cookie=87c3f43a04a09d92 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85bb7fe700 1 -- 172.21.2.135:0/725568761 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b400ddf0 con 0x7f85bc13dac0 2021-11-15T14:43:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85bb7fe700 1 -- 172.21.2.135:0/725568761 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4012770 con 0x7f85bc13dac0 2021-11-15T14:43:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85bb7fe700 1 -- 172.21.2.135:0/725568761 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85b4012b10 con 0x7f85bc13dac0 2021-11-15T14:43:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- 172.21.2.135:0/725568761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc13dac0 msgr2=0x7f85bc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- 172.21.2.135:0/725568761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc13dac0 0x7f85bc0b1130 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f85b40032f0 tx=0x7f85b400b530).stop 2021-11-15T14:43:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- 172.21.2.135:0/725568761 shutdown_connections 2021-11-15T14:43:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- 172.21.2.135:0/725568761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc13dac0 0x7f85bc0b1130 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- 172.21.2.135:0/725568761 >> v2:172.21.2.119:3300/0 conn(0x7f85bc0b3790 0x7f85bc13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 --2- 172.21.2.135:0/725568761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- 172.21.2.135:0/725568761 >> 172.21.2.135:0/725568761 conn(0x7f85bc060840 msgr2=0x7f85bc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- 172.21.2.135:0/725568761 shutdown_connections 2021-11-15T14:43:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.904+0000 7f85c2b45700 1 -- 172.21.2.135:0/725568761 wait complete. 2021-11-15T14:43:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 Processor -- start 2021-11-15T14:43:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- start start 2021-11-15T14:43:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85bc13dac0 0x7f85bc1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc13e410 con 0x7f85bc13dac0 2021-11-15T14:43:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0aa5a0 con 0x7f85bc0b3790 2021-11-15T14:43:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc140dd0 con 0x7f85bc0b0630 2021-11-15T14:43:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35142/0 (socket says 172.21.2.135:35142) 2021-11-15T14:43:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 -- 172.21.2.135:0/1448371934 learned_addr learned my addr 172.21.2.135:0/1448371934 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 -- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 msgr2=0x7f85bc0abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 -- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85bc13dac0 msgr2=0x7f85bc1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85bc13dac0 0x7f85bc1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 -- 172.21.2.135:0/1448371934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b400b7d0 con 0x7f85bc0b3790 2021-11-15T14:43:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85bbfff700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f85bc0ab9b0 tx=0x7f85a4006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85a4013460 con 0x7f85bc0b3790 2021-11-15T14:43:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40135c0 con 0x7f85bc0b3790 2021-11-15T14:43:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc13ee20 con 0x7f85bc0b3790 2021-11-15T14:43:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85a4013920 con 0x7f85bc0b3790 2021-11-15T14:43:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc13e930 con 0x7f85bc0b3790 2021-11-15T14:43:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc143620 con 0x7f85bc0b3790 2021-11-15T14:43:02.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85a400f070 con 0x7f85bc0b3790 2021-11-15T14:43:02.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 0x7f85a0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:02.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f85a406b500 con 0x7f85bc0b3790 2021-11-15T14:43:02.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.908+0000 7f85c08e1700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 0x7f85a0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:02.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.912+0000 7f85c08e1700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 0x7f85a0055bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f85ac002fb0 tx=0x7f85ac0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:02.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.912+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85a4042510 con 0x7f85bc0b3790 2021-11-15T14:43:02.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.992+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85bc0573d0 con 0x7f85bc0b3790 2021-11-15T14:43:02.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85b9ffb700 1 -- 172.21.2.135:0/1448371934 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85a4045b30 con 0x7f85bc0b3790 2021-11-15T14:43:02.999 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:03.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 msgr2=0x7f85a0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 0x7f85a0055bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f85ac002fb0 tx=0x7f85ac0069b0).stop 2021-11-15T14:43:03.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 msgr2=0x7f85bc156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f85bc0ab9b0 tx=0x7f85a4006de0).stop 2021-11-15T14:43:03.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 shutdown_connections 2021-11-15T14:43:03.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f85a00536f0 0x7f85a0055bb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f85bc13dac0 0x7f85bc1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f85bc0b3790 0x7f85bc156e00 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 --2- 172.21.2.135:0/1448371934 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f85bc0b0630 0x7f85bc0abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 >> 172.21.2.135:0/1448371934 conn(0x7f85bc060840 msgr2=0x7f85bc144730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 shutdown_connections 2021-11-15T14:43:03.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:02.996+0000 7f85c2b45700 1 -- 172.21.2.135:0/1448371934 wait complete. 2021-11-15T14:43:03.006 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:03.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 Processor -- start 2021-11-15T14:43:03.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- start start 2021-11-15T14:43:03.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f613005fd10 0x7f613013e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300b15f0 con 0x7f6130066940 2021-11-15T14:43:03.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6130066d20 con 0x7f61300b0d50 2021-11-15T14:43:03.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61300b13f0 con 0x7f613005fd10 2021-11-15T14:43:03.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f61300b0d50 0x7f613013db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:50966/0 (socket says 172.21.2.135:50966) 2021-11-15T14:43:03.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 -- 172.21.2.135:0/691607940 learned_addr learned my addr 172.21.2.135:0/691607940 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:03.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950772608 0 0) 0x7f6130066d20 con 0x7f61300b0d50 2021-11-15T14:43:03.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110003260 con 0x7f61300b0d50 2021-11-15T14:43:03.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6134841700 1 --2- 172.21.2.135:0/691607940 >> v2:172.21.2.119:3300/0 conn(0x7f613005fd10 0x7f613013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113899892 0 0) 0x7f6110003260 con 0x7f61300b0d50 2021-11-15T14:43:03.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 >> v2:172.21.2.119:3300/0 conn(0x7f613005fd10 msgr2=0x7f613013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:03.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 --2- 172.21.2.135:0/691607940 >> v2:172.21.2.119:3300/0 conn(0x7f613005fd10 0x7f613013e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 >> v1:172.21.2.119:6789/0 conn(0x7f6130066940 legacy=0x7f61300b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:03.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613005f8b0 con 0x7f61300b0d50 2021-11-15T14:43:03.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f6118001660 con 0x7f61300b0d50 2021-11-15T14:43:03.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 >> v1:172.21.2.135:6789/0 conn(0x7f61300b0d50 legacy=0x7f613013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110003820 0x7f6110003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 0x7f6110004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6110004f70 0x7f611000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300b13f0 con 0x7f6110004f70 2021-11-15T14:43:03.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611000be50 con 0x7f6110004500 2021-11-15T14:43:03.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6110010420 con 0x7f6110003820 2021-11-15T14:43:03.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 0x7f6110004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 -- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110003820 msgr2=0x7f6110003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:03.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110003820 0x7f6110003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 -- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6110004f70 msgr2=0x7f611000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:03.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6110004f70 0x7f611000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 -- 172.21.2.135:0/691607940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110003260 con 0x7f6110004500 2021-11-15T14:43:03.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6134841700 1 -- 172.21.2.135:0/691607940 reap_dead start 2021-11-15T14:43:03.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612f7fe700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 0x7f6110004980 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f6130060950 tx=0x7f6118001d60).ready entity=mon.1 client_cookie=ab7b74efbe8918d1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61180070d0 con 0x7f6110004500 2021-11-15T14:43:03.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118007230 con 0x7f6110004500 2021-11-15T14:43:03.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f612effd700 1 -- 172.21.2.135:0/691607940 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f611800c8f0 con 0x7f6110004500 2021-11-15T14:43:03.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 msgr2=0x7f6110004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 0x7f6110004980 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f6130060950 tx=0x7f6118001d60).stop 2021-11-15T14:43:03.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- 172.21.2.135:0/691607940 shutdown_connections 2021-11-15T14:43:03.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 --2- 172.21.2.135:0/691607940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6110004500 0x7f6110004980 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- 172.21.2.135:0/691607940 >> 172.21.2.135:0/691607940 conn(0x7f61300636f0 msgr2=0x7f6130063ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- 172.21.2.135:0/691607940 shutdown_connections 2021-11-15T14:43:03.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.056+0000 7f6135042700 1 -- 172.21.2.135:0/691607940 wait complete. 2021-11-15T14:43:03.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 Processor -- start 2021-11-15T14:43:03.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- start start 2021-11-15T14:43:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110004500 0x7f6130065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6130138e00 0x7f61300a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300a8680 con 0x7f6130138e00 2021-11-15T14:43:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130133ae0 con 0x7f61300a8200 2021-11-15T14:43:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6130064d90 con 0x7f6110004500 2021-11-15T14:43:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35162/0 (socket says 172.21.2.135:35162) 2021-11-15T14:43:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 -- 172.21.2.135:0/2296792269 learned_addr learned my addr 172.21.2.135:0/2296792269 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612f7fe700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6130138e00 0x7f61300a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 -- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110004500 msgr2=0x7f6130065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110004500 0x7f6130065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 -- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6130138e00 msgr2=0x7f61300a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6130138e00 0x7f61300a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 -- 172.21.2.135:0/2296792269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613013b2c0 con 0x7f61300a8200 2021-11-15T14:43:03.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6134841700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f613013a660 tx=0x7f6128008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612800c070 con 0x7f61300a8200 2021-11-15T14:43:03.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61280133f0 con 0x7f61300a8200 2021-11-15T14:43:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613013b560 con 0x7f61300a8200 2021-11-15T14:43:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6128013750 con 0x7f61300a8200 2021-11-15T14:43:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613013ad30 con 0x7f61300a8200 2021-11-15T14:43:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6130060190 con 0x7f61300a8200 2021-11-15T14:43:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f61280138b0 con 0x7f61300a8200 2021-11-15T14:43:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 0x7f6114055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.060+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f612806b170 con 0x7f61300a8200 2021-11-15T14:43:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.064+0000 7f612ffff700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 0x7f6114055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.064+0000 7f612ffff700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 0x7f6114055be0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f6120001fa0 tx=0x7f61200077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.064+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6128042070 con 0x7f61300a8200 2021-11-15T14:43:03.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.144+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61301391e0 con 0x7f61300a8200 2021-11-15T14:43:03.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f612d7fa700 1 -- 172.21.2.135:0/2296792269 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6128045690 con 0x7f61300a8200 2021-11-15T14:43:03.151 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:03.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 msgr2=0x7f6114055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 0x7f6114055be0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f6120001fa0 tx=0x7f61200077f0).stop 2021-11-15T14:43:03.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 msgr2=0x7f6130134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f613013a660 tx=0x7f6128008040).stop 2021-11-15T14:43:03.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 shutdown_connections 2021-11-15T14:43:03.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6114053720 0x7f6114055be0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f61300a8200 0x7f6130134de0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6130138e00 0x7f61300a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 --2- 172.21.2.135:0/2296792269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6110004500 0x7f6130065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 >> 172.21.2.135:0/2296792269 conn(0x7f61300636f0 msgr2=0x7f613013ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 shutdown_connections 2021-11-15T14:43:03.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.148+0000 7f6135042700 1 -- 172.21.2.135:0/2296792269 wait complete. 2021-11-15T14:43:03.160 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:03.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 Processor -- start 2021-11-15T14:43:03.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- start start 2021-11-15T14:43:03.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd9000b1f40 0x7fd9000b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b2320 0x7fd9001412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000b04a0 con 0x7fd9000b0030 2021-11-15T14:43:03.223 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000a7850 con 0x7fd9000b1f40 2021-11-15T14:43:03.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000b06d0 con 0x7fd9000b2320 2021-11-15T14:43:03.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd9000b1f40 0x7fd9000b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd9000b1f40 0x7fd9000b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35168/0 (socket says 172.21.2.135:35168) 2021-11-15T14:43:03.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 -- 172.21.2.135:0/875084160 learned_addr learned my addr 172.21.2.135:0/875084160 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:03.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 -- 172.21.2.135:0/875084160 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b2320 msgr2=0x7fd9001412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:03.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 --2- 172.21.2.135:0/875084160 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b2320 0x7fd9001412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 -- 172.21.2.135:0/875084160 >> v1:172.21.2.135:6789/0 conn(0x7fd9000b0030 legacy=0x7fd9000a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 -- 172.21.2.135:0/875084160 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000b0970 con 0x7fd9000b1f40 2021-11-15T14:43:03.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd904abc700 1 -- 172.21.2.135:0/875084160 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863242927 0 0) 0x7fd9000b04a0 con 0x7fd9000b0030 2021-11-15T14:43:03.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd905abe700 1 --2- 172.21.2.135:0/875084160 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000b1350 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fd8fc002f70 tx=0x7fd8fc006eb0).ready entity=mon.1 client_cookie=5d96e21f435837b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd904abc700 1 -- 172.21.2.135:0/875084160 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc00d5c0 con 0x7fd9000b1f40 2021-11-15T14:43:03.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd904abc700 1 -- 172.21.2.135:0/875084160 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc000e90 con 0x7fd9000b1f40 2021-11-15T14:43:03.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd904abc700 1 -- 172.21.2.135:0/875084160 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc00d910 con 0x7fd9000b1f40 2021-11-15T14:43:03.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- 172.21.2.135:0/875084160 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 msgr2=0x7fd9000b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- 172.21.2.135:0/875084160 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000b1350 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fd8fc002f70 tx=0x7fd8fc006eb0).stop 2021-11-15T14:43:03.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- 172.21.2.135:0/875084160 shutdown_connections 2021-11-15T14:43:03.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- 172.21.2.135:0/875084160 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b2320 0x7fd9001412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- 172.21.2.135:0/875084160 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000b1350 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- 172.21.2.135:0/875084160 >> 172.21.2.135:0/875084160 conn(0x7fd90005f730 msgr2=0x7fd90005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- 172.21.2.135:0/875084160 shutdown_connections 2021-11-15T14:43:03.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- 172.21.2.135:0/875084160 wait complete. 2021-11-15T14:43:03.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 Processor -- start 2021-11-15T14:43:03.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- start start 2021-11-15T14:43:03.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b0030 0x7fd900148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd9000b2320 0x7fd90014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000ab790 con 0x7fd9000b2320 2021-11-15T14:43:03.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9001455d0 con 0x7fd9000b1f40 2021-11-15T14:43:03.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd907d22700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900145330 con 0x7fd9000b0030 2021-11-15T14:43:03.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd9052bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd9052bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35176/0 (socket says 172.21.2.135:35176) 2021-11-15T14:43:03.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.212+0000 7fd9052bd700 1 -- 172.21.2.135:0/2640857829 learned_addr learned my addr 172.21.2.135:0/2640857829 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:03.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 -- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b0030 msgr2=0x7fd900148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b0030 0x7fd900148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 -- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd9000b2320 msgr2=0x7fd90014a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd9000b2320 0x7fd90014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 -- 172.21.2.135:0/2640857829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc00b1e0 con 0x7fd9000b1f40 2021-11-15T14:43:03.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd9052bd700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd8f0000ed0 tx=0x7fd8f0007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f000ce20 con 0x7fd9000b1f40 2021-11-15T14:43:03.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000f470 con 0x7fd9000b1f40 2021-11-15T14:43:03.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000ab9f0 con 0x7fd9000b1f40 2021-11-15T14:43:03.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f000f7d0 con 0x7fd9000b1f40 2021-11-15T14:43:03.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9001408c0 con 0x7fd9000b1f40 2021-11-15T14:43:03.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90014add0 con 0x7fd9000b1f40 2021-11-15T14:43:03.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8f0019030 con 0x7fd9000b1f40 2021-11-15T14:43:03.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 0x7fd8e0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd8f006af20 con 0x7fd9000b1f40 2021-11-15T14:43:03.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd905abe700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 0x7fd8e0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.216+0000 7fd905abe700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 0x7fd8e0055b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd8fc002f70 tx=0x7fd8fc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.220+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8f0041e70 con 0x7fd9000b1f40 2021-11-15T14:43:03.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9000abb80 con 0x7fd9000b1f40 2021-11-15T14:43:03.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd8eeffd700 1 -- 172.21.2.135:0/2640857829 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd8f0045490 con 0x7fd9000b1f40 2021-11-15T14:43:03.307 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:03.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 msgr2=0x7fd8e0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 0x7fd8e0055b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd8fc002f70 tx=0x7fd8fc015000).stop 2021-11-15T14:43:03.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 msgr2=0x7fd9000abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd8f0000ed0 tx=0x7fd8f0007ac0).stop 2021-11-15T14:43:03.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 shutdown_connections 2021-11-15T14:43:03.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8e0053640 0x7fd8e0055b00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd9000b2320 0x7fd90014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd9000b1f40 0x7fd9000abe90 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 --2- 172.21.2.135:0/2640857829 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd9000b0030 0x7fd900148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 >> 172.21.2.135:0/2640857829 conn(0x7fd90005f730 msgr2=0x7fd900146fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 shutdown_connections 2021-11-15T14:43:03.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.304+0000 7fd907d22700 1 -- 172.21.2.135:0/2640857829 wait complete. 2021-11-15T14:43:03.314 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:03.315 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:03.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 Processor -- start 2021-11-15T14:43:03.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- start start 2021-11-15T14:43:03.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6d54148420 0x7f6d540b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d540b03d0 con 0x7f6d540a7140 2021-11-15T14:43:03.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d540b0670 con 0x7f6d540b1e30 2021-11-15T14:43:03.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d540a9140 con 0x7f6d54148420 2021-11-15T14:43:03.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6d54148420 0x7f6d540b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6d54148420 0x7f6d540b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35180/0 (socket says 172.21.2.135:35180) 2021-11-15T14:43:03.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/1883129488 learned_addr learned my addr 172.21.2.135:0/1883129488 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:03.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/1883129488 >> v1:172.21.2.135:6789/0 conn(0x7f6d540b1e30 legacy=0x7f6d540b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/1883129488 >> v1:172.21.2.119:6789/0 conn(0x7f6d540a7140 legacy=0x7f6d541447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:03.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/1883129488 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540b0910 con 0x7f6d54148420 2021-11-15T14:43:03.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- 172.21.2.135:0/1883129488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d54148420 0x7f6d540b1050 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f6d540acee0 tx=0x7f6d48006eb0).ready entity=mon.1 client_cookie=24625e1eda9978ef server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d47fff700 1 -- 172.21.2.135:0/1883129488 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800d5c0 con 0x7f6d54148420 2021-11-15T14:43:03.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d47fff700 1 -- 172.21.2.135:0/1883129488 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48000e90 con 0x7f6d54148420 2021-11-15T14:43:03.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d47fff700 1 -- 172.21.2.135:0/1883129488 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800d950 con 0x7f6d54148420 2021-11-15T14:43:03.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/1883129488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d54148420 msgr2=0x7f6d540b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- 172.21.2.135:0/1883129488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d54148420 0x7f6d540b1050 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f6d540acee0 tx=0x7f6d48006eb0).stop 2021-11-15T14:43:03.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/1883129488 shutdown_connections 2021-11-15T14:43:03.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- 172.21.2.135:0/1883129488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d54148420 0x7f6d540b1050 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/1883129488 >> 172.21.2.135:0/1883129488 conn(0x7f6d5405f730 msgr2=0x7f6d5405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/1883129488 shutdown_connections 2021-11-15T14:43:03.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/1883129488 wait complete. 2021-11-15T14:43:03.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 Processor -- start 2021-11-15T14:43:03.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- start start 2021-11-15T14:43:03.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d540a7140 0x7f6d54144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d54148420 0x7f6d5415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54062fe0 con 0x7f6d540a7140 2021-11-15T14:43:03.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5415a220 con 0x7f6d540b1e30 2021-11-15T14:43:03.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540aa240 con 0x7f6d54148420 2021-11-15T14:43:03.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35186/0 (socket says 172.21.2.135:35186) 2021-11-15T14:43:03.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/3730568535 learned_addr learned my addr 172.21.2.135:0/3730568535 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:03.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d54148420 msgr2=0x7f6d5415a920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:03.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d54148420 0x7f6d5415a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d540a7140 msgr2=0x7f6d54144cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:03.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d540a7140 0x7f6d54144cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 -- 172.21.2.135:0/3730568535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4800b1e0 con 0x7f6d540b1e30 2021-11-15T14:43:03.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d58cf2700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f6d540a9760 tx=0x7f6d48015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d48011970 con 0x7f6d540b1e30 2021-11-15T14:43:03.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48011ad0 con 0x7f6d540b1e30 2021-11-15T14:43:03.380 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d48011e30 con 0x7f6d540b1e30 2021-11-15T14:43:03.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d540aa4e0 con 0x7f6d540b1e30 2021-11-15T14:43:03.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.364+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d540a9f30 con 0x7f6d540b1e30 2021-11-15T14:43:03.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d540b0bb0 con 0x7f6d540b1e30 2021-11-15T14:43:03.381 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d4800f070 con 0x7f6d540b1e30 2021-11-15T14:43:03.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d467fc700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 0x7f6d34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:03.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6d4806d5a0 con 0x7f6d540b1e30 2021-11-15T14:43:03.382 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d594f3700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 0x7f6d34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:03.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d594f3700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 0x7f6d34055ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6d540b31f0 tx=0x7f6d500077b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:03.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.368+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d480444a0 con 0x7f6d540b1e30 2021-11-15T14:43:03.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d540573d0 con 0x7f6d540b1e30 2021-11-15T14:43:03.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d467fc700 1 -- 172.21.2.135:0/3730568535 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f6d48047ac0 con 0x7f6d540b1e30 2021-11-15T14:43:03.484 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:03.484 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:03.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 msgr2=0x7f6d34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 0x7f6d34055ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6d540b31f0 tx=0x7f6d500077b0).stop 2021-11-15T14:43:03.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 msgr2=0x7f6d540aaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:03.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f6d540a9760 tx=0x7f6d48015000).stop 2021-11-15T14:43:03.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 shutdown_connections 2021-11-15T14:43:03.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6d34053610 0x7f6d34055ad0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6d54148420 0x7f6d5415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6d540b1e30 0x7f6d540aaa50 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:03.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 --2- 172.21.2.135:0/3730568535 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6d540a7140 0x7f6d54144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:03.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 >> 172.21.2.135:0/3730568535 conn(0x7f6d5405f730 msgr2=0x7f6d540b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:03.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 shutdown_connections 2021-11-15T14:43:03.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:03.480+0000 7f6d5b757700 1 -- 172.21.2.135:0/3730568535 wait complete. 2021-11-15T14:43:03.488 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:03.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:00.221722+0000', 'modified': '2021-11-15T14:43:01.226479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8041}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8041': {'gid': 8041, 'name': 'b', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.119:6835/2587030449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.119:6834', 'nonce': 2587030449}, {'type': 'v1', 'addr': '172.21.2.119:6835', 'nonce': 2587030449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:03.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:03.795 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T14:43:03.861 INFO:teuthology.orchestra.run.gibba019.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8041,"want_state":"up:active","state":"up:active","rank_uptime":3.6269361830000002,"mdsmap_epoch":70,"osdmap_epoch":144,"osdmap_epoch_barrier":143,"uptime":7.9483707069999996} 2021-11-15T14:43:03.862 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8041, "mdsmap_epoch": 70, "osdmap_epoch": 144, "osdmap_epoch_barrier": 143, "rank_uptime": 3.626936183, "state": "up:active", "uptime": 7.948370707, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:03.862 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:03.863 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:43:03.863 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:43:03.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:03.864 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:03.875 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:03.887 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:03.888 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:03.936 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:03.936 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:03.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:03.938 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:03.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:03.943 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:03.987 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:03.998 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:03.999 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:04.003 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:04.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:04.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:04.006 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:04.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:43:04.030+0000 7f0d8a209080 -1 init, newargv = 0x5612cb9c70f0 newargc=9 2021-11-15T14:43:04.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15145]: starting ceph client 2021-11-15T14:43:04.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15145]: starting fuse 2021-11-15T14:43:05.111 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:05.123 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:05.124 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:05.171 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:05.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:05.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:05.173 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:05.178 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:43:05.179 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:05.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:05.180 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:43:05.180 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:43:05.181 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:43:05.181 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:43:05.181 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:43:05.182 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:05.182 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:43:05.183 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:43:05.183 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:43:05.183 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:05.184 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:43:05.184 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:43:05.185 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:43:05.185 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:43:05.185 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:05.186 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:43:05.186 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:05.187 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:05.187 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:43:05.188 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:05.188 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:05.189 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:43:05.189 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:43:05.256 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.15145.asok 2021-11-15T14:43:05.258 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15145.asok 2021-11-15T14:43:05.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:05.259 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15145.asok status 2021-11-15T14:43:05.307 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:43:05.307 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:43:05.307 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:05.307 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:05.308 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:43:05.308 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:43:05.308 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:43:05.308 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "15145", 2021-11-15T14:43:05.309 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:43:05.309 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:05.309 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:43:05.309 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:05.309 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 8191, 2021-11-15T14:43:05.310 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:43:05.310 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:43:05.310 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:43:05.310 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 8191 2021-11-15T14:43:05.311 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:05.311 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:05.311 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:05.311 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:05.311 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 756256892 2021-11-15T14:43:05.312 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:43:05.312 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:05.312 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:05.312 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:05.313 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:05.313 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 756256892 2021-11-15T14:43:05.313 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:05.313 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.8191 172.21.2.138:0/756256892", 2021-11-15T14:43:05.313 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/756256892", 2021-11-15T14:43:05.314 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:43:05.314 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 70, 2021-11-15T14:43:05.314 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 144, 2021-11-15T14:43:05.314 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:05.315 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:43:05.315 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:43:05.315 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:43:05.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:05.317 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:05.317 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:05.323 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:05.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:05.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:05.324 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:05.373 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:05.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.420+0000 7f561d83b700 1 Processor -- start 2021-11-15T14:43:05.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.420+0000 7f561d83b700 1 -- start start 2021-11-15T14:43:05.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 0x7f561814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5618066f20 con 0x7f56180a9c90 2021-11-15T14:43:05.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56180b34a0 con 0x7f56180b30c0 2021-11-15T14:43:05.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618064960 con 0x7f56181488e0 2021-11-15T14:43:05.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561c839700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f56180b30c0 0x7f5618065f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51014/0 (socket says 172.21.2.135:51014) 2021-11-15T14:43:05.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561c839700 1 -- 172.21.2.135:0/3974636579 learned_addr learned my addr 172.21.2.135:0/3974636579 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:05.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611908193 0 0) 0x7f56180b34a0 con 0x7f56180b30c0 2021-11-15T14:43:05.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f8003260 con 0x7f56180b30c0 2021-11-15T14:43:05.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860652623 0 0) 0x7f55f8003260 con 0x7f56180b30c0 2021-11-15T14:43:05.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 msgr2=0x7f561814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 0x7f561814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 >> v1:172.21.2.119:6789/0 conn(0x7f56180a9c90 legacy=0x7f5618060840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180669e0 con 0x7f56180b30c0 2021-11-15T14:43:05.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5608001660 con 0x7f56180b30c0 2021-11-15T14:43:05.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 >> v1:172.21.2.135:6789/0 conn(0x7f56180b30c0 legacy=0x7f5618065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f80037d0 0x7f55f8003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 0x7f55f8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f55f8004b40 0x7f55f8004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800dbc0 con 0x7f55f80037d0 2021-11-15T14:43:05.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800dd30 con 0x7f55f8004b40 2021-11-15T14:43:05.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f800def0 con 0x7f56181488e0 2021-11-15T14:43:05.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f55f8004b40 0x7f55f8004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 -- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 msgr2=0x7f55f8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56181488e0 0x7f55f8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 -- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f80037d0 msgr2=0x7f55f8003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f80037d0 0x7f55f8003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 -- 172.21.2.135:0/3974636579 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8003260 con 0x7f55f8004b40 2021-11-15T14:43:05.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f55f8004b40 0x7f55f8004fc0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f56100032f0 tx=0x7f5610006f90).ready entity=mon.1 client_cookie=1e381c56f2b916cc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5610011400 con 0x7f55f8004b40 2021-11-15T14:43:05.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610011560 con 0x7f55f8004b40 2021-11-15T14:43:05.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f56177fe700 1 -- 172.21.2.135:0/3974636579 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56100116d0 con 0x7f55f8004b40 2021-11-15T14:43:05.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- 172.21.2.135:0/3974636579 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f55f8004b40 msgr2=0x7f55f8004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 --2- 172.21.2.135:0/3974636579 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f55f8004b40 0x7f55f8004fc0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f56100032f0 tx=0x7f5610006f90).stop 2021-11-15T14:43:05.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d03a700 1 -- 172.21.2.135:0/3974636579 reap_dead start 2021-11-15T14:43:05.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- 172.21.2.135:0/3974636579 shutdown_connections 2021-11-15T14:43:05.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- 172.21.2.135:0/3974636579 >> 172.21.2.135:0/3974636579 conn(0x7f5618063760 msgr2=0x7f5618063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- 172.21.2.135:0/3974636579 shutdown_connections 2021-11-15T14:43:05.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- 172.21.2.135:0/3974636579 wait complete. 2021-11-15T14:43:05.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 Processor -- start 2021-11-15T14:43:05.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.424+0000 7f561d83b700 1 -- start start 2021-11-15T14:43:05.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f8004b40 0x7f56180b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56180ae9a0 0x7f5618151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561813d970 con 0x7f55f8004b40 2021-11-15T14:43:05.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561813dbd0 con 0x7f561814dd10 2021-11-15T14:43:05.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618151260 con 0x7f56180ae9a0 2021-11-15T14:43:05.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35210/0 (socket says 172.21.2.135:35210) 2021-11-15T14:43:05.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 -- 172.21.2.135:0/1276082861 learned_addr learned my addr 172.21.2.135:0/1276082861 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 -- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56180ae9a0 msgr2=0x7f5618151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56180ae9a0 0x7f5618151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 -- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f8004b40 msgr2=0x7f56180b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f8004b40 0x7f56180b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 -- 172.21.2.135:0/1276082861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618151500 con 0x7f561814dd10 2021-11-15T14:43:05.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d03a700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f5618065840 tx=0x7f5610017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561001f070 con 0x7f561814dd10 2021-11-15T14:43:05.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561001b650 con 0x7f561814dd10 2021-11-15T14:43:05.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561001b9b0 con 0x7f561814dd10 2021-11-15T14:43:05.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56181517a0 con 0x7f561814dd10 2021-11-15T14:43:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56180ae5c0 con 0x7f561814dd10 2021-11-15T14:43:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f561000f070 con 0x7f561814dd10 2021-11-15T14:43:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5618151930 con 0x7f561814dd10 2021-11-15T14:43:05.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 0x7f55fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f561006c130 con 0x7f561814dd10 2021-11-15T14:43:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561c839700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 0x7f55fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.428+0000 7f561c839700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 0x7f55fc055ad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f56180633d0 tx=0x7f5618065880).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.432+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5610043030 con 0x7f561814dd10 2021-11-15T14:43:05.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.512+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5618066c80 con 0x7f561814dd10 2021-11-15T14:43:05.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f5615ffb700 1 -- 172.21.2.135:0/1276082861 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f561002dfb0 con 0x7f561814dd10 2021-11-15T14:43:05.518 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:05.519 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":144,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:01.227552+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 msgr2=0x7f55fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 0x7f55fc055ad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f56180633d0 tx=0x7f5618065880).stop 2021-11-15T14:43:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 msgr2=0x7f56181392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f5618065840 tx=0x7f5610017000).stop 2021-11-15T14:43:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 shutdown_connections 2021-11-15T14:43:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f55fc053610 0x7f55fc055ad0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f561814dd10 0x7f56181392b0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f56180ae9a0 0x7f5618151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 --2- 172.21.2.135:0/1276082861 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f55f8004b40 0x7f56180b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 >> 172.21.2.135:0/1276082861 conn(0x7f5618063760 msgr2=0x7f56180b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 shutdown_connections 2021-11-15T14:43:05.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.516+0000 7f561d83b700 1 -- 172.21.2.135:0/1276082861 wait complete. 2021-11-15T14:43:05.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:42:58.129588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:42:59.213509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:05.526 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:05.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 Processor -- start 2021-11-15T14:43:05.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- start start 2021-11-15T14:43:05.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff3640a9f40 0x7ff3640aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff36413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff364061a10 con 0x7ff36413d240 2021-11-15T14:43:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36405cc20 con 0x7ff3640a9f40 2021-11-15T14:43:05.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff364061cb0 con 0x7ff364060450 2021-11-15T14:43:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff3640a9f40 0x7ff3640aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff3640a9f40 0x7ff3640aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35214/0 (socket says 172.21.2.135:35214) 2021-11-15T14:43:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 -- 172.21.2.135:0/468549979 learned_addr learned my addr 172.21.2.135:0/468549979 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 -- 172.21.2.135:0/468549979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 msgr2=0x7ff36413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 --2- 172.21.2.135:0/468549979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff36413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 -- 172.21.2.135:0/468549979 >> v1:172.21.2.119:6789/0 conn(0x7ff36413d240 legacy=0x7ff36405c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 -- 172.21.2.135:0/468549979 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364060c10 con 0x7ff3640a9f40 2021-11-15T14:43:05.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff362ffd700 1 --2- 172.21.2.135:0/468549979 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff3640aa320 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7ff36405f8f0 tx=0x7ff354006eb0).ready entity=mon.1 client_cookie=c304097b7008072 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff361ffb700 1 -- 172.21.2.135:0/468549979 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35400d570 con 0x7ff3640a9f40 2021-11-15T14:43:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff361ffb700 1 -- 172.21.2.135:0/468549979 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354000e90 con 0x7ff3640a9f40 2021-11-15T14:43:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff361ffb700 1 -- 172.21.2.135:0/468549979 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35400d900 con 0x7ff3640a9f40 2021-11-15T14:43:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- 172.21.2.135:0/468549979 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 msgr2=0x7ff3640aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 --2- 172.21.2.135:0/468549979 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff3640aa320 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7ff36405f8f0 tx=0x7ff354006eb0).stop 2021-11-15T14:43:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- 172.21.2.135:0/468549979 shutdown_connections 2021-11-15T14:43:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 --2- 172.21.2.135:0/468549979 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff36413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 --2- 172.21.2.135:0/468549979 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff3640aa320 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- 172.21.2.135:0/468549979 >> 172.21.2.135:0/468549979 conn(0x7ff3640b29f0 msgr2=0x7ff3640b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- 172.21.2.135:0/468549979 shutdown_connections 2021-11-15T14:43:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- 172.21.2.135:0/468549979 wait complete. 2021-11-15T14:43:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 Processor -- start 2021-11-15T14:43:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.576+0000 7ff3696f2700 1 -- start start 2021-11-15T14:43:05.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff364131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff36413d240 0x7ff36413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640ad390 con 0x7ff36413d240 2021-11-15T14:43:05.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36413df50 con 0x7ff3640a9f40 2021-11-15T14:43:05.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36413e4a0 con 0x7ff364060450 2021-11-15T14:43:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35222/0 (socket says 172.21.2.135:35222) 2021-11-15T14:43:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 -- 172.21.2.135:0/147627578 learned_addr learned my addr 172.21.2.135:0/147627578 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff362ffd700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff364131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3637fe700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff36413d240 0x7ff36413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 -- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 msgr2=0x7ff364131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff364131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 -- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff36413d240 msgr2=0x7ff36413ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff36413d240 0x7ff36413ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 -- 172.21.2.135:0/147627578 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35400b1e0 con 0x7ff3640a9f40 2021-11-15T14:43:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3627fc700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7ff34c002f70 tx=0x7ff34c006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c013460 con 0x7ff3640a9f40 2021-11-15T14:43:05.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0135c0 con 0x7ff3640a9f40 2021-11-15T14:43:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36413e740 con 0x7ff3640a9f40 2021-11-15T14:43:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3640ae6a0 con 0x7ff3640a9f40 2021-11-15T14:43:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c013920 con 0x7ff3640a9f40 2021-11-15T14:43:05.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff364060eb0 con 0x7ff3640a9f40 2021-11-15T14:43:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff34c01a060 con 0x7ff3640a9f40 2021-11-15T14:43:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 0x7ff348055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff34c06b4a0 con 0x7ff3640a9f40 2021-11-15T14:43:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.580+0000 7ff362ffd700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 0x7ff348055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.584+0000 7ff362ffd700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 0x7ff348055be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7ff35401a000 tx=0x7ff354015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.584+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff34c0424b0 con 0x7ff3640a9f40 2021-11-15T14:43:05.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3640573d0 con 0x7ff3640a9f40 2021-11-15T14:43:05.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff35bfff700 1 -- 172.21.2.135:0/147627578 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v144) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff34c018030 con 0x7ff3640a9f40 2021-11-15T14:43:05.670 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:05.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 msgr2=0x7ff348055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 0x7ff348055be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7ff35401a000 tx=0x7ff354015000).stop 2021-11-15T14:43:05.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 msgr2=0x7ff36413d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7ff34c002f70 tx=0x7ff34c006ec0).stop 2021-11-15T14:43:05.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 shutdown_connections 2021-11-15T14:43:05.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff348053720 0x7ff348055be0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff36413d240 0x7ff36413ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff3640a9f40 0x7ff36413d6b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 --2- 172.21.2.135:0/147627578 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff364060450 0x7ff364131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 >> 172.21.2.135:0/147627578 conn(0x7ff3640b29f0 msgr2=0x7ff364140a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 shutdown_connections 2021-11-15T14:43:05.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.664+0000 7ff3696f2700 1 -- 172.21.2.135:0/147627578 wait complete. 2021-11-15T14:43:05.676 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:05.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 Processor -- start 2021-11-15T14:43:05.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 -- start start 2021-11-15T14:43:05.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 0x7f57a0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a00b2430 con 0x7f57a00654a0 2021-11-15T14:43:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a00b26d0 con 0x7f57a0060040 2021-11-15T14:43:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a79a1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00b2970 con 0x7f57a00b3950 2021-11-15T14:43:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f57a0060040 0x7f57a0064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51048/0 (socket says 172.21.2.135:51048) 2021-11-15T14:43:05.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 -- 172.21.2.135:0/3018943203 learned_addr learned my addr 172.21.2.135:0/3018943203 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718180795 0 0) 0x7f57a00b26d0 con 0x7f57a0060040 2021-11-15T14:43:05.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5788003260 con 0x7f57a0060040 2021-11-15T14:43:05.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1549195460 0 0) 0x7f5788003260 con 0x7f57a0060040 2021-11-15T14:43:05.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 msgr2=0x7f57a0144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 0x7f57a0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 >> v1:172.21.2.119:6789/0 conn(0x7f57a00654a0 legacy=0x7f57a01444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00648f0 con 0x7f57a0060040 2021-11-15T14:43:05.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f579c001660 con 0x7f57a0060040 2021-11-15T14:43:05.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 >> v1:172.21.2.135:6789/0 conn(0x7f57a0060040 legacy=0x7f57a0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57880037d0 0x7f5788003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 0x7f5788004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5788004af0 0x7f5788004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00b2970 con 0x7f5788004af0 2021-11-15T14:43:05.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578800b990 con 0x7f57880037d0 2021-11-15T14:43:05.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578800bb50 con 0x7f57a00b3950 2021-11-15T14:43:05.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57880037d0 0x7f5788003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 -- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 msgr2=0x7f5788004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00b3950 0x7f5788004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 -- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5788004af0 msgr2=0x7f5788004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5788004af0 0x7f5788004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.740+0000 7f57a573d700 1 -- 172.21.2.135:0/3018943203 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00648f0 con 0x7f57880037d0 2021-11-15T14:43:05.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a573d700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57880037d0 0x7f5788003bd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f579c001020 tx=0x7f579c001e20).ready entity=mon.1 client_cookie=f929cd186a0daaf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579c0070d0 con 0x7f57880037d0 2021-11-15T14:43:05.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c007230 con 0x7f57880037d0 2021-11-15T14:43:05.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578ffff700 1 -- 172.21.2.135:0/3018943203 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579c00c9c0 con 0x7f57880037d0 2021-11-15T14:43:05.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/3018943203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57880037d0 msgr2=0x7f5788003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 --2- 172.21.2.135:0/3018943203 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57880037d0 0x7f5788003bd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f579c001020 tx=0x7f579c001e20).stop 2021-11-15T14:43:05.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 -- 172.21.2.135:0/3018943203 reap_dead start 2021-11-15T14:43:05.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/3018943203 shutdown_connections 2021-11-15T14:43:05.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/3018943203 >> 172.21.2.135:0/3018943203 conn(0x7f57a005cfe0 msgr2=0x7f57a005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/3018943203 shutdown_connections 2021-11-15T14:43:05.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/3018943203 wait complete. 2021-11-15T14:43:05.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 Processor -- start 2021-11-15T14:43:05.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- start start 2021-11-15T14:43:05.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57880037d0 0x7f57a00ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00acdd0 0x7f57a012f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0156d30 con 0x7f57880037d0 2021-11-15T14:43:05.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0155e50 con 0x7f57a012f8a0 2021-11-15T14:43:05.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01560b0 con 0x7f57a00acdd0 2021-11-15T14:43:05.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35242/0 (socket says 172.21.2.135:35242) 2021-11-15T14:43:05.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 -- 172.21.2.135:0/696868411 learned_addr learned my addr 172.21.2.135:0/696868411 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 -- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00acdd0 msgr2=0x7f57a012f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00acdd0 0x7f57a012f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 -- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57880037d0 msgr2=0x7f57a00ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57880037d0 0x7f57a00ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 -- 172.21.2.135:0/696868411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0156350 con 0x7f57a012f8a0 2021-11-15T14:43:05.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a5f3e700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f57a0156c10 tx=0x7f579800a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579800cea0 con 0x7f57a012f8a0 2021-11-15T14:43:05.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798005c30 con 0x7f57a012f8a0 2021-11-15T14:43:05.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a01565f0 con 0x7f57a012f8a0 2021-11-15T14:43:05.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5798007070 con 0x7f57a012f8a0 2021-11-15T14:43:05.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a00ac500 con 0x7f57a012f8a0 2021-11-15T14:43:05.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a00674f0 con 0x7f57a012f8a0 2021-11-15T14:43:05.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.744+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f579801b060 con 0x7f57a012f8a0 2021-11-15T14:43:05.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.748+0000 7f578e7fc700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 0x7f5780055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.748+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f579806b130 con 0x7f57a012f8a0 2021-11-15T14:43:05.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.748+0000 7f57a573d700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 0x7f5780055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.748+0000 7f57a573d700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 0x7f5780055b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f579c001020 tx=0x7f579c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.748+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5798042140 con 0x7f57a012f8a0 2021-11-15T14:43:05.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57a00573d0 con 0x7f57a012f8a0 2021-11-15T14:43:05.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f578e7fc700 1 -- 172.21.2.135:0/696868411 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5798019020 con 0x7f57a012f8a0 2021-11-15T14:43:05.835 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:05.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 msgr2=0x7f5780055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 0x7f5780055b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f579c001020 tx=0x7f579c015000).stop 2021-11-15T14:43:05.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 msgr2=0x7f57a00ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f57a0156c10 tx=0x7f579800a060).stop 2021-11-15T14:43:05.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 shutdown_connections 2021-11-15T14:43:05.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5780053640 0x7f5780055b00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57a012f8a0 0x7f57a00ad3b0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57a00acdd0 0x7f57a012f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 --2- 172.21.2.135:0/696868411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57880037d0 0x7f57a00ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 >> 172.21.2.135:0/696868411 conn(0x7f57a005cfe0 msgr2=0x7f57a013adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.838 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 shutdown_connections 2021-11-15T14:43:05.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.832+0000 7f57a79a1700 1 -- 172.21.2.135:0/696868411 wait complete. 2021-11-15T14:43:05.842 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 Processor -- start 2021-11-15T14:43:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 -- start start 2021-11-15T14:43:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc1469d0 0x7f2bdc1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b4200 0x7f2bdc1407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b4710 0x7f2bdc0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc147590 con 0x7f2bdc0b4710 2021-11-15T14:43:05.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc143be0 con 0x7f2bdc0b4200 2021-11-15T14:43:05.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be3775700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc143e80 con 0x7f2bdc1469d0 2021-11-15T14:43:05.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be0d10700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b4200 0x7f2bdc1407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be0d10700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2bdc0b4200 0x7f2bdc1407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35248/0 (socket says 172.21.2.135:35248) 2021-11-15T14:43:05.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.904+0000 7f2be0d10700 1 -- 172.21.2.135:0/65329137 learned_addr learned my addr 172.21.2.135:0/65329137 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 -- 172.21.2.135:0/65329137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc1469d0 msgr2=0x7f2bdc1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 --2- 172.21.2.135:0/65329137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc1469d0 0x7f2bdc1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 -- 172.21.2.135:0/65329137 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b4710 msgr2=0x7f2bdc0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:05.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 --2- 172.21.2.135:0/65329137 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b4710 0x7f2bdc0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 -- 172.21.2.135:0/65329137 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0b0d10 con 0x7f2bdc0b4200 2021-11-15T14:43:05.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 --2- 172.21.2.135:0/65329137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b4200 0x7f2bdc1407a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0006eb0).ready entity=mon.1 client_cookie=8fbd3d91e337e130 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bcffff700 1 -- 172.21.2.135:0/65329137 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd000d570 con 0x7f2bdc0b4200 2021-11-15T14:43:05.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bcffff700 1 -- 172.21.2.135:0/65329137 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0000e90 con 0x7f2bdc0b4200 2021-11-15T14:43:05.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bcffff700 1 -- 172.21.2.135:0/65329137 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd000d900 con 0x7f2bdc0b4200 2021-11-15T14:43:05.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/65329137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b4200 msgr2=0x7f2bdc1407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- 172.21.2.135:0/65329137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b4200 0x7f2bdc1407a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f2bd0002f70 tx=0x7f2bd0006eb0).stop 2021-11-15T14:43:05.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/65329137 shutdown_connections 2021-11-15T14:43:05.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- 172.21.2.135:0/65329137 >> v2:172.21.2.119:3300/0 conn(0x7f2bdc0b4710 0x7f2bdc0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- 172.21.2.135:0/65329137 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc0b4200 0x7f2bdc1407a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- 172.21.2.135:0/65329137 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc1469d0 0x7f2bdc1402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:05.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/65329137 >> 172.21.2.135:0/65329137 conn(0x7f2bdc05c510 msgr2=0x7f2bdc05c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:05.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/65329137 shutdown_connections 2021-11-15T14:43:05.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/65329137 wait complete. 2021-11-15T14:43:05.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 Processor -- start 2021-11-15T14:43:05.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- start start 2021-11-15T14:43:05.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b4200 0x7f2bdc0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 0x7f2bdc0ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0af600 con 0x7f2bdc0b4710 2021-11-15T14:43:05.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0ae280 con 0x7f2bdc1469d0 2021-11-15T14:43:05.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc141e60 con 0x7f2bdc0b4200 2021-11-15T14:43:05.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35256/0 (socket says 172.21.2.135:35256) 2021-11-15T14:43:05.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 -- 172.21.2.135:0/2363086338 learned_addr learned my addr 172.21.2.135:0/2363086338 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:05.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 0x7f2bdc0ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 -- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b4200 msgr2=0x7f2bdc0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1511700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b4200 0x7f2bdc0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b4200 0x7f2bdc0b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 -- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 msgr2=0x7f2bdc0ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:05.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 0x7f2bdc0ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:05.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 -- 172.21.2.135:0/2363086338 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd000b1e0 con 0x7f2bdc1469d0 2021-11-15T14:43:05.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be0d10700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 0x7f2bdc0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:05.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be1d12700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f2bd40032f0 tx=0x7f2bd40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd400d4a0 con 0x7f2bdc1469d0 2021-11-15T14:43:05.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400d600 con 0x7f2bdc1469d0 2021-11-15T14:43:05.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd400d960 con 0x7f2bdc1469d0 2021-11-15T14:43:05.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc1428a0 con 0x7f2bdc1469d0 2021-11-15T14:43:05.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc0b67a0 con 0x7f2bdc1469d0 2021-11-15T14:43:05.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0573d0 con 0x7f2bdc1469d0 2021-11-15T14:43:05.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.908+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2bd4018030 con 0x7f2bdc1469d0 2021-11-15T14:43:05.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.912+0000 7f2bce7fc700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 0x7f2bbc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:05.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.912+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2bd406b350 con 0x7f2bdc1469d0 2021-11-15T14:43:05.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.912+0000 7f2be1511700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 0x7f2bbc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:05.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.912+0000 7f2be1511700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 0x7f2bbc055b60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f2bd8007000 tx=0x7f2bd8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:05.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.912+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2bd4042410 con 0x7f2bdc1469d0 2021-11-15T14:43:06.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.996+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bdc069960 con 0x7f2bdc1469d0 2021-11-15T14:43:06.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.996+0000 7f2bce7fc700 1 -- 172.21.2.135:0/2363086338 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2bd4045a30 con 0x7f2bdc1469d0 2021-11-15T14:43:06.001 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:06.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:05.996+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 msgr2=0x7f2bbc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 0x7f2bbc055b60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f2bd8007000 tx=0x7f2bd8008040).stop 2021-11-15T14:43:06.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 msgr2=0x7f2bdc0adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f2bd40032f0 tx=0x7f2bd40091a0).stop 2021-11-15T14:43:06.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 shutdown_connections 2021-11-15T14:43:06.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2bbc0536a0 0x7f2bbc055b60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2bdc1469d0 0x7f2bdc0adbd0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2bdc0b4710 0x7f2bdc0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 --2- 172.21.2.135:0/2363086338 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2bdc0b4200 0x7f2bdc0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 >> 172.21.2.135:0/2363086338 conn(0x7f2bdc05c510 msgr2=0x7f2bdc0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:06.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 shutdown_connections 2021-11-15T14:43:06.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.000+0000 7f2be3775700 1 -- 172.21.2.135:0/2363086338 wait complete. 2021-11-15T14:43:06.008 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:06.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 Processor -- start 2021-11-15T14:43:06.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- start start 2021-11-15T14:43:06.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f28bc0ab820 0x7f28bc0abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc144780 0x7f28bc144c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f28bc0ac640 0x7f28bc0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc148010 con 0x7f28bc0ac640 2021-11-15T14:43:06.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc1450f0 con 0x7f28bc0ab820 2021-11-15T14:43:06.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc060880 con 0x7f28bc144780 2021-11-15T14:43:06.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f28bc0ab820 0x7f28bc0abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f28bc0ab820 0x7f28bc0abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35260/0 (socket says 172.21.2.135:35260) 2021-11-15T14:43:06.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 -- 172.21.2.135:0/1884248311 learned_addr learned my addr 172.21.2.135:0/1884248311 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:06.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 -- 172.21.2.135:0/1884248311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc144780 msgr2=0x7f28bc144c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:06.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 --2- 172.21.2.135:0/1884248311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc144780 0x7f28bc144c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 -- 172.21.2.135:0/1884248311 >> v2:172.21.2.119:3300/0 conn(0x7f28bc0ac640 msgr2=0x7f28bc0acad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:06.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 --2- 172.21.2.135:0/1884248311 >> v2:172.21.2.119:3300/0 conn(0x7f28bc0ac640 0x7f28bc0acad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 -- 172.21.2.135:0/1884248311 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc05ff40 con 0x7f28bc0ab820 2021-11-15T14:43:06.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28bbfff700 1 --2- 172.21.2.135:0/1884248311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc0ab820 0x7f28bc0abc00 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f28bc145230 tx=0x7f28ac006eb0).ready entity=mon.1 client_cookie=5ed754949a8819f4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28baffd700 1 -- 172.21.2.135:0/1884248311 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28ac00d570 con 0x7f28bc0ab820 2021-11-15T14:43:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28baffd700 1 -- 172.21.2.135:0/1884248311 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac000e90 con 0x7f28bc0ab820 2021-11-15T14:43:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28baffd700 1 -- 172.21.2.135:0/1884248311 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28ac00d8c0 con 0x7f28bc0ab820 2021-11-15T14:43:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- 172.21.2.135:0/1884248311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc0ab820 msgr2=0x7f28bc0abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- 172.21.2.135:0/1884248311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc0ab820 0x7f28bc0abc00 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f28bc145230 tx=0x7f28ac006eb0).stop 2021-11-15T14:43:06.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- 172.21.2.135:0/1884248311 shutdown_connections 2021-11-15T14:43:06.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- 172.21.2.135:0/1884248311 >> v2:172.21.2.119:3300/0 conn(0x7f28bc0ac640 0x7f28bc0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- 172.21.2.135:0/1884248311 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc144780 0x7f28bc144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- 172.21.2.135:0/1884248311 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc0ab820 0x7f28bc0abc00 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- 172.21.2.135:0/1884248311 >> 172.21.2.135:0/1884248311 conn(0x7f28bc0b29f0 msgr2=0x7f28bc0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:06.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- 172.21.2.135:0/1884248311 shutdown_connections 2021-11-15T14:43:06.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- 172.21.2.135:0/1884248311 wait complete. 2021-11-15T14:43:06.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 Processor -- start 2021-11-15T14:43:06.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- start start 2021-11-15T14:43:06.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28bc0ab820 0x7f28bc14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc0ac640 0x7f28bc0664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0aed20 con 0x7f28bc0ab820 2021-11-15T14:43:06.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc063190 con 0x7f28bc144780 2021-11-15T14:43:06.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c23df700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc066eb0 con 0x7f28bc0ac640 2021-11-15T14:43:06.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c097c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c097c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35268/0 (socket says 172.21.2.135:35268) 2021-11-15T14:43:06.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.080+0000 7f28c097c700 1 -- 172.21.2.135:0/1325838213 learned_addr learned my addr 172.21.2.135:0/1325838213 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:06.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 -- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc0ac640 msgr2=0x7f28bc0664d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:06.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc0ac640 0x7f28bc0664d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 -- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28bc0ab820 msgr2=0x7f28bc14aa70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:06.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28bc0ab820 0x7f28bc14aa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 -- 172.21.2.135:0/1325838213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac00b1e0 con 0x7f28bc144780 2021-11-15T14:43:06.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c097c700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f28b4003330 tx=0x7f28b40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b4001520 con 0x7f28bc144780 2021-11-15T14:43:06.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4001680 con 0x7f28bc144780 2021-11-15T14:43:06.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0aef50 con 0x7f28bc144780 2021-11-15T14:43:06.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b40019e0 con 0x7f28bc144780 2021-11-15T14:43:06.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0af570 con 0x7f28bc144780 2021-11-15T14:43:06.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc148230 con 0x7f28bc144780 2021-11-15T14:43:06.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28b4018030 con 0x7f28bc144780 2021-11-15T14:43:06.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 0x7f28a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f28b406b440 con 0x7f28bc144780 2021-11-15T14:43:06.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28bbfff700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 0x7f28a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28bbfff700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 0x7f28a0055ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f28bc145230 tx=0x7f28ac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.084+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28b4042500 con 0x7f28bc144780 2021-11-15T14:43:06.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.168+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28bc0573d0 con 0x7f28bc144780 2021-11-15T14:43:06.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.168+0000 7f28b97fa700 1 -- 172.21.2.135:0/1325838213 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+10 (secure 0 0 0) 0x7f28b4045b20 con 0x7f28bc144780 2021-11-15T14:43:06.174 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:06.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 msgr2=0x7f28a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 0x7f28a0055ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f28bc145230 tx=0x7f28ac015000).stop 2021-11-15T14:43:06.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 msgr2=0x7f28bc0669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f28b4003330 tx=0x7f28b40091a0).stop 2021-11-15T14:43:06.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 shutdown_connections 2021-11-15T14:43:06.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f28a0053610 0x7f28a0055ad0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f28bc144780 0x7f28bc0669c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f28bc0ac640 0x7f28bc0664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 --2- 172.21.2.135:0/1325838213 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f28bc0ab820 0x7f28bc14aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 >> 172.21.2.135:0/1325838213 conn(0x7f28bc0b29f0 msgr2=0x7f28bc146a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:06.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 shutdown_connections 2021-11-15T14:43:06.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.172+0000 7f28c23df700 1 -- 172.21.2.135:0/1325838213 wait complete. 2021-11-15T14:43:06.181 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:06.182 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:06.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 Processor -- start 2021-11-15T14:43:06.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- start start 2021-11-15T14:43:06.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f510c060180 0x7f510c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f510c067380 0x7f510c143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c0aac30 con 0x7f510c0b4cc0 2021-11-15T14:43:06.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c060560 con 0x7f510c067380 2021-11-15T14:43:06.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c066f20 con 0x7f510c060180 2021-11-15T14:43:06.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f510c060180 0x7f510c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f510c060180 0x7f510c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35274/0 (socket says 172.21.2.135:35274) 2021-11-15T14:43:06.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 -- 172.21.2.135:0/1691065591 learned_addr learned my addr 172.21.2.135:0/1691065591 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:06.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 -- 172.21.2.135:0/1691065591 >> v2:172.21.2.119:3300/0 conn(0x7f510c067380 msgr2=0x7f510c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:06.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 --2- 172.21.2.135:0/1691065591 >> v2:172.21.2.119:3300/0 conn(0x7f510c067380 0x7f510c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 -- 172.21.2.135:0/1691065591 >> v1:172.21.2.119:6789/0 conn(0x7f510c0b4cc0 legacy=0x7f510c144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:06.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 -- 172.21.2.135:0/1691065591 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0b3430 con 0x7f510c060180 2021-11-15T14:43:06.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f510affd700 1 --2- 172.21.2.135:0/1691065591 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c060180 0x7f510c0b47d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f510c05f260 tx=0x7f5100006eb0).ready entity=mon.1 client_cookie=9b3d95056310cba server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5109ffb700 1 -- 172.21.2.135:0/1691065591 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000d5c0 con 0x7f510c060180 2021-11-15T14:43:06.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5109ffb700 1 -- 172.21.2.135:0/1691065591 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100000e90 con 0x7f510c060180 2021-11-15T14:43:06.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5109ffb700 1 -- 172.21.2.135:0/1691065591 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000d910 con 0x7f510c060180 2021-11-15T14:43:06.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- 172.21.2.135:0/1691065591 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c060180 msgr2=0x7f510c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 --2- 172.21.2.135:0/1691065591 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c060180 0x7f510c0b47d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f510c05f260 tx=0x7f5100006eb0).stop 2021-11-15T14:43:06.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- 172.21.2.135:0/1691065591 shutdown_connections 2021-11-15T14:43:06.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 --2- 172.21.2.135:0/1691065591 >> v2:172.21.2.119:3300/0 conn(0x7f510c067380 0x7f510c143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 --2- 172.21.2.135:0/1691065591 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c060180 0x7f510c0b47d0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- 172.21.2.135:0/1691065591 >> 172.21.2.135:0/1691065591 conn(0x7f510c05cfb0 msgr2=0x7f510c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:06.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- 172.21.2.135:0/1691065591 shutdown_connections 2021-11-15T14:43:06.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- 172.21.2.135:0/1691065591 wait complete. 2021-11-15T14:43:06.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 Processor -- start 2021-11-15T14:43:06.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.244+0000 7f5111282700 1 -- start start 2021-11-15T14:43:06.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f510c060180 0x7f510c065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f510c067380 0x7f510c13b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c13e930 con 0x7f510c060180 2021-11-15T14:43:06.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c13cbf0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c13ce90 con 0x7f510c067380 2021-11-15T14:43:06.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35282/0 (socket says 172.21.2.135:35282) 2021-11-15T14:43:06.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 -- 172.21.2.135:0/2495407732 learned_addr learned my addr 172.21.2.135:0/2495407732 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:06.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 -- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f510c067380 msgr2=0x7f510c13b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f510c067380 0x7f510c13b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 -- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f510c060180 msgr2=0x7f510c065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f510c060180 0x7f510c065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 -- 172.21.2.135:0/2495407732 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510000b1e0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510b7fe700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f5104003270 tx=0x7f51040090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510400d4a0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400d600 con 0x7f510c0b4cc0 2021-11-15T14:43:06.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c0addf0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c13bcb0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510400d960 con 0x7f510c0b4cc0 2021-11-15T14:43:06.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0573d0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5104018030 con 0x7f510c0b4cc0 2021-11-15T14:43:06.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 0x7f50e8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:06.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f510406b400 con 0x7f510c0b4cc0 2021-11-15T14:43:06.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.248+0000 7f510affd700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 0x7f50e8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:06.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.252+0000 7f510affd700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 0x7f50e8055a90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f510c05f260 tx=0x7f5100015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:06.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.252+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51040423b0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f510c069960 con 0x7f510c0b4cc0 2021-11-15T14:43:06.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f50fbfff700 1 -- 172.21.2.135:0/2495407732 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f51040459d0 con 0x7f510c0b4cc0 2021-11-15T14:43:06.364 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:06.364 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:06.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 msgr2=0x7f50e8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 0x7f50e8055a90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f510c05f260 tx=0x7f5100015000).stop 2021-11-15T14:43:06.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 msgr2=0x7f510c13b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:06.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f5104003270 tx=0x7f51040090f0).stop 2021-11-15T14:43:06.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 shutdown_connections 2021-11-15T14:43:06.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50e80535d0 0x7f50e8055a90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f510c0b4cc0 0x7f510c13b7c0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:06.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f510c067380 0x7f510c13b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 --2- 172.21.2.135:0/2495407732 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f510c060180 0x7f510c065490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:06.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 >> 172.21.2.135:0/2495407732 conn(0x7f510c05cfb0 msgr2=0x7f510c142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:06.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 shutdown_connections 2021-11-15T14:43:06.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:06.360+0000 7f5111282700 1 -- 172.21.2.135:0/2495407732 wait complete. 2021-11-15T14:43:06.368 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:06.674 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:00.221722+0000', 'modified': '2021-11-15T14:43:01.226479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8041}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8041': {'gid': 8041, 'name': 'b', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.119:6835/2587030449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.119:6834', 'nonce': 2587030449}, {'type': 'v1', 'addr': '172.21.2.119:6835', 'nonce': 2587030449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:06.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:06.675 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T14:43:06.741 INFO:teuthology.orchestra.run.gibba019.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8041,"want_state":"up:active","state":"up:active","rank_uptime":6.5074285270000001,"mdsmap_epoch":70,"osdmap_epoch":144,"osdmap_epoch_barrier":143,"uptime":10.828862741} 2021-11-15T14:43:06.742 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8041, "mdsmap_epoch": 70, "osdmap_epoch": 144, "osdmap_epoch_barrier": 143, "rank_uptime": 6.507428527, "state": "up:active", "uptime": 10.828862741, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:06.743 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:06.743 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:43:06.743 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:43:06.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:06.744 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:06.758 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:06.812 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:06.813 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:06.822 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:06.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:06.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:06.824 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:06.877 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:06.878 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:06.887 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:06.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:06.900 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:06.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:43:06.918+0000 7f1e0fdbe080 -1 init, newargv = 0x5567c38da0b0 newargc=9 2021-11-15T14:43:06.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14630]: starting ceph client 2021-11-15T14:43:06.936 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:06.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:06.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:06.938 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:06.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14630]: starting fuse 2021-11-15T14:43:06.954 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:43:06.954 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:06.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:06.955 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:43:06.955 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:43:06.956 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:43:06.956 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:43:06.956 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:43:06.957 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:06.957 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:43:06.958 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:43:06.958 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:43:06.959 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:06.959 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:43:06.960 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:43:06.960 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:43:06.960 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:43:06.961 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:06.961 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:43:06.962 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:06.962 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:06.962 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:43:06.963 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:06.963 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:06.964 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:43:06.964 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:43:07.036 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14630.asok 2021-11-15T14:43:07.038 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14630.asok 2021-11-15T14:43:07.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.040 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14630.asok status 2021-11-15T14:43:07.154 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:43:07.155 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:43:07.155 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:07.155 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:07.156 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:43:07.156 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:43:07.157 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:43:07.157 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14630", 2021-11-15T14:43:07.158 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:43:07.158 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:07.158 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:43:07.159 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:07.159 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 5060, 2021-11-15T14:43:07.160 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:43:07.160 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:43:07.161 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:43:07.161 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 5060 2021-11-15T14:43:07.161 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:07.162 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:07.162 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:07.163 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:07.163 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 2724891981 2021-11-15T14:43:07.164 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:43:07.164 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:07.164 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:07.164 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:07.165 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:07.165 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 2724891981 2021-11-15T14:43:07.165 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:07.165 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.5060 172.21.2.132:0/2724891981", 2021-11-15T14:43:07.165 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/2724891981", 2021-11-15T14:43:07.166 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:43:07.166 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 70, 2021-11-15T14:43:07.166 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 144, 2021-11-15T14:43:07.166 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:07.167 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:43:07.167 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:43:07.167 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:43:07.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.169 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:07.170 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.176 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:07.177 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:07.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.178 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.234 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:07.235 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.243 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:07.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:07.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.245 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:07.246 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.302 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:07.304 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:07.304 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:43:07.305 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:07.305 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14630]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:07.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:07.329 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:07.330 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:07.383 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:43:07.384 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:07.385 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:43:12.731 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:12.735 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:12.738 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:12.741 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:13.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:43:13.488 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:13.500 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:13.504 DEBUG:teuthology.orchestra.run.gibba032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:13.507 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:13.510 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:13.520 INFO:teuthology.orchestra.run.gibba019.stdout:[global] 2021-11-15T14:43:13.520 INFO:teuthology.orchestra.run.gibba019.stdout: chdir = "" 2021-11-15T14:43:13.520 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:13.521 INFO:teuthology.orchestra.run.gibba019.stdout: auth supported = cephx 2021-11-15T14:43:13.521 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.521 INFO:teuthology.orchestra.run.gibba019.stdout: filestore xattr use omap = true 2021-11-15T14:43:13.521 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.522 INFO:teuthology.orchestra.run.gibba019.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:13.522 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.522 INFO:teuthology.orchestra.run.gibba019.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:13.522 INFO:teuthology.orchestra.run.gibba019.stdout: auth debug = true 2021-11-15T14:43:13.523 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.523 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on old message = true 2021-11-15T14:43:13.523 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on bug = true 2021-11-15T14:43:13.523 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.524 INFO:teuthology.orchestra.run.gibba019.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:13.524 INFO:teuthology.orchestra.run.gibba019.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:13.524 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.524 INFO:teuthology.orchestra.run.gibba019.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:13.524 INFO:teuthology.orchestra.run.gibba019.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:13.525 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.525 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default size = 2 2021-11-15T14:43:13.525 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.525 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:13.526 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow pg remap = true 2021-11-15T14:43:13.526 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:13.526 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:13.526 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:13.527 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:13.527 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on too few osds = false 2021-11-15T14:43:13.527 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:13.527 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:13.527 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.528 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:13.528 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.528 INFO:teuthology.orchestra.run.gibba019.stdout: osd default data pool replay window = 5 2021-11-15T14:43:13.528 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.529 INFO:teuthology.orchestra.run.gibba019.stdout: mon allow pool delete = true 2021-11-15T14:43:13.529 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.529 INFO:teuthology.orchestra.run.gibba019.stdout: mon cluster log file level = debug 2021-11-15T14:43:13.529 INFO:teuthology.orchestra.run.gibba019.stdout: debug asserts on shutdown = true 2021-11-15T14:43:13.530 INFO:teuthology.orchestra.run.gibba019.stdout: mon health detail to clog = false 2021-11-15T14:43:13.530 INFO:teuthology.orchestra.run.gibba019.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:13.530 INFO:teuthology.orchestra.run.gibba019.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:13.530 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.530 INFO:teuthology.orchestra.run.gibba019.stdout:[osd] 2021-11-15T14:43:13.531 INFO:teuthology.orchestra.run.gibba019.stdout: osd journal size = 100 2021-11-15T14:43:13.531 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.531 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:13.531 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub max interval = 600 2021-11-15T14:43:13.532 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.532 INFO:teuthology.orchestra.run.gibba019.stdout: osd recover clone overlap = true 2021-11-15T14:43:13.532 INFO:teuthology.orchestra.run.gibba019.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:13.532 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.532 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug shutdown = true 2021-11-15T14:43:13.533 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug op order = true 2021-11-15T14:43:13.533 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:13.533 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.533 INFO:teuthology.orchestra.run.gibba019.stdout: osd open classes on start = true 2021-11-15T14:43:13.534 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug pg log writeout = true 2021-11-15T14:43:13.534 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.534 INFO:teuthology.orchestra.run.gibba019.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:13.534 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.535 INFO:teuthology.orchestra.run.gibba019.stdout: osd map max advance = 10 2021-11-15T14:43:13.535 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.535 INFO:teuthology.orchestra.run.gibba019.stdout: journal zero on create = true 2021-11-15T14:43:13.535 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.536 INFO:teuthology.orchestra.run.gibba019.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:13.536 INFO:teuthology.orchestra.run.gibba019.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:13.536 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.536 INFO:teuthology.orchestra.run.gibba019.stdout: bdev debug aio = true 2021-11-15T14:43:13.536 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug misdirected ops = true 2021-11-15T14:43:13.537 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore block size = 96636764160 2021-11-15T14:43:13.537 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:13.537 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore fsck on mount = True 2021-11-15T14:43:13.537 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluefs = 20 2021-11-15T14:43:13.538 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluestore = 20 2021-11-15T14:43:13.538 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:13.538 INFO:teuthology.orchestra.run.gibba019.stdout: debug osd = 20 2021-11-15T14:43:13.538 INFO:teuthology.orchestra.run.gibba019.stdout: debug rocksdb = 10 2021-11-15T14:43:13.539 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:13.539 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:13.539 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:13.539 INFO:teuthology.orchestra.run.gibba019.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:13.540 INFO:teuthology.orchestra.run.gibba019.stdout: osd objectstore = bluestore 2021-11-15T14:43:13.540 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:43:13.540 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.540 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr] 2021-11-15T14:43:13.541 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:13.541 INFO:teuthology.orchestra.run.gibba019.stdout: debug mgr = 20 2021-11-15T14:43:13.541 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:43:13.541 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:43:13.541 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.542 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.542 INFO:teuthology.orchestra.run.gibba019.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:13.542 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.542 INFO:teuthology.orchestra.run.gibba019.stdout:[mon] 2021-11-15T14:43:13.543 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:13.543 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:43:13.543 INFO:teuthology.orchestra.run.gibba019.stdout: debug paxos = 20 2021-11-15T14:43:13.543 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:43:13.543 INFO:teuthology.orchestra.run.gibba019.stdout: mon data avail warn = 5 2021-11-15T14:43:13.544 INFO:teuthology.orchestra.run.gibba019.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:13.544 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.544 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:13.544 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd prime pg temp = true 2021-11-15T14:43:13.544 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.545 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.545 INFO:teuthology.orchestra.run.gibba019.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:13.545 INFO:teuthology.orchestra.run.gibba019.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:13.545 INFO:teuthology.orchestra.run.gibba019.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:13.545 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.546 INFO:teuthology.orchestra.run.gibba019.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:13.546 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:13.546 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:13.546 INFO:teuthology.orchestra.run.gibba019.stdout: mon op complaint time = 120 2021-11-15T14:43:13.547 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:13.547 INFO:teuthology.orchestra.run.gibba019.stdout:[client] 2021-11-15T14:43:13.547 INFO:teuthology.orchestra.run.gibba019.stdout: rgw cache enabled = true 2021-11-15T14:43:13.548 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable ops log = true 2021-11-15T14:43:13.548 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable usage log = true 2021-11-15T14:43:13.548 INFO:teuthology.orchestra.run.gibba019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:13.549 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:13.549 INFO:teuthology.orchestra.run.gibba019.stdout: client mount timeout = 600 2021-11-15T14:43:13.549 INFO:teuthology.orchestra.run.gibba019.stdout: debug client = 20 2021-11-15T14:43:13.550 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:13.550 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.550 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.550 INFO:teuthology.orchestra.run.gibba019.stdout: client debug getattr caps = true 2021-11-15T14:43:13.551 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.a] 2021-11-15T14:43:13.551 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.b] 2021-11-15T14:43:13.551 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.c] 2021-11-15T14:43:13.551 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.a] 2021-11-15T14:43:13.552 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.c] 2021-11-15T14:43:13.552 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.b] 2021-11-15T14:43:13.552 INFO:teuthology.orchestra.run.gibba019.stdout:[mds] 2021-11-15T14:43:13.552 INFO:teuthology.orchestra.run.gibba019.stdout: debug mds = 20 2021-11-15T14:43:13.553 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:13.553 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal frag = True 2021-11-15T14:43:13.553 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:13.553 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal merge size = 5 2021-11-15T14:43:13.554 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split bits = 3 2021-11-15T14:43:13.554 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split size = 100 2021-11-15T14:43:13.554 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug frag = True 2021-11-15T14:43:13.554 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug scatterstat = True 2021-11-15T14:43:13.555 INFO:teuthology.orchestra.run.gibba019.stdout: mds op complaint time = 180 2021-11-15T14:43:13.555 INFO:teuthology.orchestra.run.gibba019.stdout: mds verify scatter = True 2021-11-15T14:43:13.555 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:43:13.556 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.556 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.559 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-15T14:43:13.560 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-15T14:43:13.560 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:13.560 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-15T14:43:13.560 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.561 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-15T14:43:13.561 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.561 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:13.561 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.562 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:13.562 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-15T14:43:13.562 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.562 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-15T14:43:13.563 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-15T14:43:13.563 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.563 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:13.563 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:13.564 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.564 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:13.564 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:13.564 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.565 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-15T14:43:13.565 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.565 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:13.565 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-15T14:43:13.566 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:13.566 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:13.566 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:13.566 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:13.567 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-15T14:43:13.567 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:13.567 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:13.567 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.568 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:13.568 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.568 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-15T14:43:13.568 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.569 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-15T14:43:13.569 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.569 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-15T14:43:13.569 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-15T14:43:13.569 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-15T14:43:13.570 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:13.570 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:13.570 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.570 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-15T14:43:13.571 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-15T14:43:13.571 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.571 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:13.571 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-15T14:43:13.571 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.572 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-15T14:43:13.572 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:13.572 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.572 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-15T14:43:13.573 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-15T14:43:13.573 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:13.573 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.573 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-15T14:43:13.574 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-15T14:43:13.574 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.574 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:13.574 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.575 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-15T14:43:13.575 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.575 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-15T14:43:13.575 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.575 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:13.576 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:13.576 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.576 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-15T14:43:13.576 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-15T14:43:13.577 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-15T14:43:13.577 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:13.577 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-15T14:43:13.577 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-15T14:43:13.577 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-15T14:43:13.578 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:13.578 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-15T14:43:13.578 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-15T14:43:13.578 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:13.579 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:13.579 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:13.579 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:13.579 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-15T14:43:13.579 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:43:13.580 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.580 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-15T14:43:13.580 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:13.581 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-15T14:43:13.581 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:43:13.581 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:43:13.581 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.581 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.582 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:13.582 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.582 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-15T14:43:13.583 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:13.583 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:43:13.583 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-15T14:43:13.583 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:43:13.583 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-15T14:43:13.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:13.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:13.584 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-15T14:43:13.585 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.585 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.585 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:13.585 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:13.585 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:13.586 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.586 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:13.586 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:13.587 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:13.587 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-15T14:43:13.587 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:13.587 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-15T14:43:13.587 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-15T14:43:13.588 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-15T14:43:13.588 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-15T14:43:13.588 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:13.588 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:13.589 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-15T14:43:13.589 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-15T14:43:13.589 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:13.589 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.589 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.590 INFO:teuthology.orchestra.run.gibba038.stdout: client debug getattr caps = true 2021-11-15T14:43:13.590 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-15T14:43:13.590 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-15T14:43:13.590 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-15T14:43:13.591 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-15T14:43:13.591 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.c] 2021-11-15T14:43:13.591 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-15T14:43:13.591 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-15T14:43:13.591 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-15T14:43:13.592 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:13.592 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-15T14:43:13.592 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:13.592 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-15T14:43:13.593 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-15T14:43:13.593 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-15T14:43:13.593 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-15T14:43:13.593 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-15T14:43:13.594 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-15T14:43:13.594 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-15T14:43:13.594 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:43:13.594 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.595 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.595 INFO:teuthology.orchestra.run.gibba035.stdout:[global] 2021-11-15T14:43:13.595 INFO:teuthology.orchestra.run.gibba035.stdout: chdir = "" 2021-11-15T14:43:13.595 INFO:teuthology.orchestra.run.gibba035.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:13.596 INFO:teuthology.orchestra.run.gibba035.stdout: auth supported = cephx 2021-11-15T14:43:13.596 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.596 INFO:teuthology.orchestra.run.gibba035.stdout: filestore xattr use omap = true 2021-11-15T14:43:13.596 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.596 INFO:teuthology.orchestra.run.gibba035.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:13.597 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.597 INFO:teuthology.orchestra.run.gibba035.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:13.597 INFO:teuthology.orchestra.run.gibba035.stdout: auth debug = true 2021-11-15T14:43:13.597 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.598 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on old message = true 2021-11-15T14:43:13.598 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on bug = true 2021-11-15T14:43:13.598 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.598 INFO:teuthology.orchestra.run.gibba035.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:13.598 INFO:teuthology.orchestra.run.gibba035.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:13.599 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.599 INFO:teuthology.orchestra.run.gibba035.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:13.599 INFO:teuthology.orchestra.run.gibba035.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:13.599 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.600 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default size = 2 2021-11-15T14:43:13.600 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.600 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:13.601 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow pg remap = true 2021-11-15T14:43:13.601 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:13.601 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:13.601 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:13.601 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:13.602 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on too few osds = false 2021-11-15T14:43:13.602 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:13.602 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:13.602 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.603 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:13.603 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.603 INFO:teuthology.orchestra.run.gibba035.stdout: osd default data pool replay window = 5 2021-11-15T14:43:13.603 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.604 INFO:teuthology.orchestra.run.gibba035.stdout: mon allow pool delete = true 2021-11-15T14:43:13.604 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.604 INFO:teuthology.orchestra.run.gibba035.stdout: mon cluster log file level = debug 2021-11-15T14:43:13.604 INFO:teuthology.orchestra.run.gibba035.stdout: debug asserts on shutdown = true 2021-11-15T14:43:13.605 INFO:teuthology.orchestra.run.gibba035.stdout: mon health detail to clog = false 2021-11-15T14:43:13.605 INFO:teuthology.orchestra.run.gibba035.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:13.605 INFO:teuthology.orchestra.run.gibba035.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:13.605 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.606 INFO:teuthology.orchestra.run.gibba035.stdout:[osd] 2021-11-15T14:43:13.606 INFO:teuthology.orchestra.run.gibba035.stdout: osd journal size = 100 2021-11-15T14:43:13.606 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.607 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:13.607 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub max interval = 600 2021-11-15T14:43:13.607 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.607 INFO:teuthology.orchestra.run.gibba035.stdout: osd recover clone overlap = true 2021-11-15T14:43:13.607 INFO:teuthology.orchestra.run.gibba035.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:13.608 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.608 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug shutdown = true 2021-11-15T14:43:13.608 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug op order = true 2021-11-15T14:43:13.609 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:13.609 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.609 INFO:teuthology.orchestra.run.gibba035.stdout: osd open classes on start = true 2021-11-15T14:43:13.609 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug pg log writeout = true 2021-11-15T14:43:13.610 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.610 INFO:teuthology.orchestra.run.gibba035.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:13.610 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.610 INFO:teuthology.orchestra.run.gibba035.stdout: osd map max advance = 10 2021-11-15T14:43:13.611 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.611 INFO:teuthology.orchestra.run.gibba035.stdout: journal zero on create = true 2021-11-15T14:43:13.611 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.611 INFO:teuthology.orchestra.run.gibba035.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:13.612 INFO:teuthology.orchestra.run.gibba035.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:13.612 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.612 INFO:teuthology.orchestra.run.gibba035.stdout: bdev debug aio = true 2021-11-15T14:43:13.613 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug misdirected ops = true 2021-11-15T14:43:13.613 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore block size = 96636764160 2021-11-15T14:43:13.613 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:13.613 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore fsck on mount = True 2021-11-15T14:43:13.613 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluefs = 20 2021-11-15T14:43:13.614 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluestore = 20 2021-11-15T14:43:13.614 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:13.614 INFO:teuthology.orchestra.run.gibba035.stdout: debug osd = 20 2021-11-15T14:43:13.614 INFO:teuthology.orchestra.run.gibba035.stdout: debug rocksdb = 10 2021-11-15T14:43:13.615 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:13.615 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:13.615 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:13.615 INFO:teuthology.orchestra.run.gibba035.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:13.615 INFO:teuthology.orchestra.run.gibba035.stdout: osd objectstore = bluestore 2021-11-15T14:43:13.616 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:43:13.616 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.616 INFO:teuthology.orchestra.run.gibba035.stdout:[mgr] 2021-11-15T14:43:13.616 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:13.617 INFO:teuthology.orchestra.run.gibba035.stdout: debug mgr = 20 2021-11-15T14:43:13.617 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:43:13.617 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:43:13.617 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.617 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.618 INFO:teuthology.orchestra.run.gibba035.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:13.618 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.618 INFO:teuthology.orchestra.run.gibba035.stdout:[mon] 2021-11-15T14:43:13.619 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:13.619 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:43:13.619 INFO:teuthology.orchestra.run.gibba035.stdout: debug paxos = 20 2021-11-15T14:43:13.619 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:43:13.619 INFO:teuthology.orchestra.run.gibba035.stdout: mon data avail warn = 5 2021-11-15T14:43:13.620 INFO:teuthology.orchestra.run.gibba035.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:13.620 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.620 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:13.620 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd prime pg temp = true 2021-11-15T14:43:13.621 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.621 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.621 INFO:teuthology.orchestra.run.gibba035.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:13.621 INFO:teuthology.orchestra.run.gibba035.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:13.621 INFO:teuthology.orchestra.run.gibba035.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:13.622 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.622 INFO:teuthology.orchestra.run.gibba035.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:13.622 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:13.622 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:13.622 INFO:teuthology.orchestra.run.gibba035.stdout: mon op complaint time = 120 2021-11-15T14:43:13.623 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.623 INFO:teuthology.orchestra.run.gibba035.stdout:[client] 2021-11-15T14:43:13.623 INFO:teuthology.orchestra.run.gibba035.stdout: rgw cache enabled = true 2021-11-15T14:43:13.623 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable ops log = true 2021-11-15T14:43:13.624 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable usage log = true 2021-11-15T14:43:13.624 INFO:teuthology.orchestra.run.gibba035.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:13.624 INFO:teuthology.orchestra.run.gibba035.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:13.624 INFO:teuthology.orchestra.run.gibba035.stdout: client mount timeout = 600 2021-11-15T14:43:13.625 INFO:teuthology.orchestra.run.gibba035.stdout: debug client = 20 2021-11-15T14:43:13.625 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:13.625 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.625 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.626 INFO:teuthology.orchestra.run.gibba035.stdout: client debug getattr caps = true 2021-11-15T14:43:13.626 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.a] 2021-11-15T14:43:13.626 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.b] 2021-11-15T14:43:13.626 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.c] 2021-11-15T14:43:13.626 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.a] 2021-11-15T14:43:13.627 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.c] 2021-11-15T14:43:13.627 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.b] 2021-11-15T14:43:13.627 INFO:teuthology.orchestra.run.gibba035.stdout:[mds] 2021-11-15T14:43:13.627 INFO:teuthology.orchestra.run.gibba035.stdout: debug mds = 20 2021-11-15T14:43:13.628 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:13.628 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal frag = True 2021-11-15T14:43:13.628 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:13.628 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal merge size = 5 2021-11-15T14:43:13.628 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split bits = 3 2021-11-15T14:43:13.629 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split size = 100 2021-11-15T14:43:13.629 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug frag = True 2021-11-15T14:43:13.629 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug scatterstat = True 2021-11-15T14:43:13.629 INFO:teuthology.orchestra.run.gibba035.stdout: mds op complaint time = 180 2021-11-15T14:43:13.630 INFO:teuthology.orchestra.run.gibba035.stdout: mds verify scatter = True 2021-11-15T14:43:13.630 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:43:13.630 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.630 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.631 INFO:teuthology.orchestra.run.gibba032.stdout:[global] 2021-11-15T14:43:13.631 INFO:teuthology.orchestra.run.gibba032.stdout: chdir = "" 2021-11-15T14:43:13.631 INFO:teuthology.orchestra.run.gibba032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:13.631 INFO:teuthology.orchestra.run.gibba032.stdout: auth supported = cephx 2021-11-15T14:43:13.632 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.632 INFO:teuthology.orchestra.run.gibba032.stdout: filestore xattr use omap = true 2021-11-15T14:43:13.632 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.632 INFO:teuthology.orchestra.run.gibba032.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:13.633 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.633 INFO:teuthology.orchestra.run.gibba032.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:13.633 INFO:teuthology.orchestra.run.gibba032.stdout: auth debug = true 2021-11-15T14:43:13.633 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.633 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on old message = true 2021-11-15T14:43:13.634 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on bug = true 2021-11-15T14:43:13.634 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.634 INFO:teuthology.orchestra.run.gibba032.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:13.634 INFO:teuthology.orchestra.run.gibba032.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:13.635 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.635 INFO:teuthology.orchestra.run.gibba032.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:13.635 INFO:teuthology.orchestra.run.gibba032.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:13.635 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.636 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default size = 2 2021-11-15T14:43:13.636 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.636 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:13.636 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow pg remap = true 2021-11-15T14:43:13.636 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:13.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:13.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:13.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:13.637 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on too few osds = false 2021-11-15T14:43:13.638 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:13.638 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:13.638 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.638 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:13.639 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.639 INFO:teuthology.orchestra.run.gibba032.stdout: osd default data pool replay window = 5 2021-11-15T14:43:13.639 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.639 INFO:teuthology.orchestra.run.gibba032.stdout: mon allow pool delete = true 2021-11-15T14:43:13.639 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.640 INFO:teuthology.orchestra.run.gibba032.stdout: mon cluster log file level = debug 2021-11-15T14:43:13.640 INFO:teuthology.orchestra.run.gibba032.stdout: debug asserts on shutdown = true 2021-11-15T14:43:13.640 INFO:teuthology.orchestra.run.gibba032.stdout: mon health detail to clog = false 2021-11-15T14:43:13.640 INFO:teuthology.orchestra.run.gibba032.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:13.641 INFO:teuthology.orchestra.run.gibba032.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:13.641 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.641 INFO:teuthology.orchestra.run.gibba032.stdout:[osd] 2021-11-15T14:43:13.641 INFO:teuthology.orchestra.run.gibba032.stdout: osd journal size = 100 2021-11-15T14:43:13.642 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.642 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:13.642 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub max interval = 600 2021-11-15T14:43:13.642 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.642 INFO:teuthology.orchestra.run.gibba032.stdout: osd recover clone overlap = true 2021-11-15T14:43:13.643 INFO:teuthology.orchestra.run.gibba032.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:13.643 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.643 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug shutdown = true 2021-11-15T14:43:13.643 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug op order = true 2021-11-15T14:43:13.644 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:13.644 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.644 INFO:teuthology.orchestra.run.gibba032.stdout: osd open classes on start = true 2021-11-15T14:43:13.644 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug pg log writeout = true 2021-11-15T14:43:13.645 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.645 INFO:teuthology.orchestra.run.gibba032.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:13.645 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.645 INFO:teuthology.orchestra.run.gibba032.stdout: osd map max advance = 10 2021-11-15T14:43:13.646 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.646 INFO:teuthology.orchestra.run.gibba032.stdout: journal zero on create = true 2021-11-15T14:43:13.646 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.646 INFO:teuthology.orchestra.run.gibba032.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:13.646 INFO:teuthology.orchestra.run.gibba032.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:13.647 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.647 INFO:teuthology.orchestra.run.gibba032.stdout: bdev debug aio = true 2021-11-15T14:43:13.647 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug misdirected ops = true 2021-11-15T14:43:13.647 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore block size = 96636764160 2021-11-15T14:43:13.648 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:13.648 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore fsck on mount = True 2021-11-15T14:43:13.648 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluefs = 20 2021-11-15T14:43:13.648 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluestore = 20 2021-11-15T14:43:13.648 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:13.649 INFO:teuthology.orchestra.run.gibba032.stdout: debug osd = 20 2021-11-15T14:43:13.649 INFO:teuthology.orchestra.run.gibba032.stdout: debug rocksdb = 10 2021-11-15T14:43:13.649 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:13.649 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:13.650 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:13.650 INFO:teuthology.orchestra.run.gibba032.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:13.650 INFO:teuthology.orchestra.run.gibba032.stdout: osd objectstore = bluestore 2021-11-15T14:43:13.650 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:43:13.651 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.651 INFO:teuthology.orchestra.run.gibba032.stdout:[mgr] 2021-11-15T14:43:13.651 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:13.651 INFO:teuthology.orchestra.run.gibba032.stdout: debug mgr = 20 2021-11-15T14:43:13.652 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:43:13.652 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:43:13.652 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.652 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.652 INFO:teuthology.orchestra.run.gibba032.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:13.653 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.653 INFO:teuthology.orchestra.run.gibba032.stdout:[mon] 2021-11-15T14:43:13.653 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:13.653 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:43:13.654 INFO:teuthology.orchestra.run.gibba032.stdout: debug paxos = 20 2021-11-15T14:43:13.654 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:43:13.654 INFO:teuthology.orchestra.run.gibba032.stdout: mon data avail warn = 5 2021-11-15T14:43:13.654 INFO:teuthology.orchestra.run.gibba032.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:13.654 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:13.655 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:13.655 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd prime pg temp = true 2021-11-15T14:43:13.655 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:13.655 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.656 INFO:teuthology.orchestra.run.gibba032.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:13.656 INFO:teuthology.orchestra.run.gibba032.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:13.656 INFO:teuthology.orchestra.run.gibba032.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:13.656 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.657 INFO:teuthology.orchestra.run.gibba032.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:13.657 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:13.657 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:13.657 INFO:teuthology.orchestra.run.gibba032.stdout: mon op complaint time = 120 2021-11-15T14:43:13.658 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:13.658 INFO:teuthology.orchestra.run.gibba032.stdout:[client] 2021-11-15T14:43:13.658 INFO:teuthology.orchestra.run.gibba032.stdout: rgw cache enabled = true 2021-11-15T14:43:13.658 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable ops log = true 2021-11-15T14:43:13.658 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable usage log = true 2021-11-15T14:43:13.659 INFO:teuthology.orchestra.run.gibba032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:13.659 INFO:teuthology.orchestra.run.gibba032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:13.659 INFO:teuthology.orchestra.run.gibba032.stdout: client mount timeout = 600 2021-11-15T14:43:13.659 INFO:teuthology.orchestra.run.gibba032.stdout: debug client = 20 2021-11-15T14:43:13.660 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:13.660 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.660 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.660 INFO:teuthology.orchestra.run.gibba032.stdout: client debug getattr caps = true 2021-11-15T14:43:13.660 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.a] 2021-11-15T14:43:13.661 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.b] 2021-11-15T14:43:13.661 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.c] 2021-11-15T14:43:13.661 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.a] 2021-11-15T14:43:13.661 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.c] 2021-11-15T14:43:13.661 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.b] 2021-11-15T14:43:13.662 INFO:teuthology.orchestra.run.gibba032.stdout:[mds] 2021-11-15T14:43:13.662 INFO:teuthology.orchestra.run.gibba032.stdout: debug mds = 20 2021-11-15T14:43:13.662 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:13.662 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal frag = True 2021-11-15T14:43:13.663 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:13.663 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal merge size = 5 2021-11-15T14:43:13.663 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split bits = 3 2021-11-15T14:43:13.663 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split size = 100 2021-11-15T14:43:13.664 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug frag = True 2021-11-15T14:43:13.664 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug scatterstat = True 2021-11-15T14:43:13.664 INFO:teuthology.orchestra.run.gibba032.stdout: mds op complaint time = 180 2021-11-15T14:43:13.664 INFO:teuthology.orchestra.run.gibba032.stdout: mds verify scatter = True 2021-11-15T14:43:13.665 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:43:13.665 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:43:13.665 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:43:13.666 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:13.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 Processor -- start 2021-11-15T14:43:13.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- start start 2021-11-15T14:43:13.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540b19d0 0x7f38540a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3854147620 0x7f38540ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385414ac90 con 0x7f38540b25e0 2021-11-15T14:43:13.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540a8d40 con 0x7f3854147620 2021-11-15T14:43:13.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3854147a90 con 0x7f38540b19d0 2021-11-15T14:43:13.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3852ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f38540b25e0 0x7f385414b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51108/0 (socket says 172.21.2.135:51108) 2021-11-15T14:43:13.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3852ffd700 1 -- 172.21.2.135:0/884888565 learned_addr learned my addr 172.21.2.135:0/884888565 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:13.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146507580 0 0) 0x7f385414ac90 con 0x7f38540b25e0 2021-11-15T14:43:13.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3834003260 con 0x7f38540b25e0 2021-11-15T14:43:13.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540b19d0 0x7f38540a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38537fe700 1 --2- 172.21.2.135:0/884888565 >> v2:172.21.2.119:3300/0 conn(0x7f3854147620 0x7f38540ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253223964 0 0) 0x7f3834003260 con 0x7f38540b25e0 2021-11-15T14:43:13.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540b19d0 msgr2=0x7f38540a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:13.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540b19d0 0x7f38540a7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 >> v2:172.21.2.119:3300/0 conn(0x7f3854147620 msgr2=0x7f38540ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:13.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 --2- 172.21.2.135:0/884888565 >> v2:172.21.2.119:3300/0 conn(0x7f3854147620 0x7f38540ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540b29c0 con 0x7f38540b25e0 2021-11-15T14:43:13.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f383c001660 con 0x7f38540b25e0 2021-11-15T14:43:13.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 >> v1:172.21.2.135:6789/0 conn(0x7f38540b25e0 legacy=0x7f385414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38340037d0 0x7f3834003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3834004500 0x7f3834004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3834004e70 0x7f383400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540a8d40 con 0x7f3834004e70 2021-11-15T14:43:13.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854147a90 con 0x7f3834004500 2021-11-15T14:43:13.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383400bda0 con 0x7f38340037d0 2021-11-15T14:43:13.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3834004500 0x7f3834004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3852ffd700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38340037d0 0x7f3834003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38537fe700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3834004e70 0x7f383400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 -- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38340037d0 msgr2=0x7f3834003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:13.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38340037d0 0x7f3834003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 -- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3834004e70 msgr2=0x7f383400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:13.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3834004e70 0x7f383400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 -- 172.21.2.135:0/884888565 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834003260 con 0x7f3834004500 2021-11-15T14:43:13.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38527fc700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3834004500 0x7f3834004980 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3844000b60 tx=0x7f3844008040).ready entity=mon.1 client_cookie=5e15b4f2cde00e59 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3844013630 con 0x7f3834004500 2021-11-15T14:43:13.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844000e90 con 0x7f3834004500 2021-11-15T14:43:13.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3851ffb700 1 -- 172.21.2.135:0/884888565 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3844013980 con 0x7f3834004500 2021-11-15T14:43:13.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- 172.21.2.135:0/884888565 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3834004500 msgr2=0x7f3834004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 --2- 172.21.2.135:0/884888565 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3834004500 0x7f3834004980 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3844000b60 tx=0x7f3844008040).stop 2021-11-15T14:43:13.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f38537fe700 1 -- 172.21.2.135:0/884888565 reap_dead start 2021-11-15T14:43:13.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- 172.21.2.135:0/884888565 shutdown_connections 2021-11-15T14:43:13.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- 172.21.2.135:0/884888565 >> 172.21.2.135:0/884888565 conn(0x7f385405caa0 msgr2=0x7f385405ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:13.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- 172.21.2.135:0/884888565 shutdown_connections 2021-11-15T14:43:13.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 -- 172.21.2.135:0/884888565 wait complete. 2021-11-15T14:43:13.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.736+0000 7f3859547700 1 Processor -- start 2021-11-15T14:43:13.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- start start 2021-11-15T14:43:13.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 0x7f385413f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38540aba70 0x7f38540abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540ad020 con 0x7f38540aba70 2021-11-15T14:43:13.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385405ae60 con 0x7f385413fcf0 2021-11-15T14:43:13.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540aafd0 con 0x7f38540aee20 2021-11-15T14:43:13.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35302/0 (socket says 172.21.2.135:35302) 2021-11-15T14:43:13.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 -- 172.21.2.135:0/3666769026 learned_addr learned my addr 172.21.2.135:0/3666769026 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:13.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3852ffd700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 0x7f385413f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 -- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 msgr2=0x7f385413f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 0x7f385413f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 -- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38540aba70 msgr2=0x7f38540abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38540aba70 0x7f38540abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 -- 172.21.2.135:0/3666769026 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540aa430 con 0x7f385413fcf0 2021-11-15T14:43:13.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3852ffd700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 0x7f385413f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:13.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f38527fc700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f38540af9a0 tx=0x7f3844008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3844012930 con 0x7f385413fcf0 2021-11-15T14:43:13.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844012a90 con 0x7f385413fcf0 2021-11-15T14:43:13.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3844012df0 con 0x7f385413fcf0 2021-11-15T14:43:13.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540af200 con 0x7f385413fcf0 2021-11-15T14:43:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540a9ef0 con 0x7f385413fcf0 2021-11-15T14:43:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38540b0990 con 0x7f385413fcf0 2021-11-15T14:43:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f384401b030 con 0x7f385413fcf0 2021-11-15T14:43:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 0x7f38380559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f384406cd10 con 0x7f385413fcf0 2021-11-15T14:43:13.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3852ffd700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 0x7f38380559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.740+0000 7f3852ffd700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 0x7f38380559b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f383c009000 tx=0x7f383c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.744+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3844043d20 con 0x7f385413fcf0 2021-11-15T14:43:13.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.824+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38540573d0 con 0x7f385413fcf0 2021-11-15T14:43:13.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f384bfff700 1 -- 172.21.2.135:0/3666769026 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f3844047340 con 0x7f385413fcf0 2021-11-15T14:43:13.831 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:13.831 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":144,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:01.227552+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:42:58.129588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-15T14:42:59.213509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:13.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 msgr2=0x7f38380559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 0x7f38380559b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f383c009000 tx=0x7f383c009040).stop 2021-11-15T14:43:13.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 msgr2=0x7f38540ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f38540af9a0 tx=0x7f3844008040).stop 2021-11-15T14:43:13.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 shutdown_connections 2021-11-15T14:43:13.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f38380534f0 0x7f38380559b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f38540aba70 0x7f38540abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f385413fcf0 0x7f38540ab580 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 --2- 172.21.2.135:0/3666769026 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f38540aee20 0x7f385413f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 >> 172.21.2.135:0/3666769026 conn(0x7f385405caa0 msgr2=0x7f3854148b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:13.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 shutdown_connections 2021-11-15T14:43:13.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.828+0000 7f3859547700 1 -- 172.21.2.135:0/3666769026 wait complete. 2021-11-15T14:43:13.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:42:58.129588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:42:59.213509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:13.839 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:13.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 Processor -- start 2021-11-15T14:43:13.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- start start 2021-11-15T14:43:13.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f77b40a7d80 0x7f77b4147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b414ac90 con 0x7f77b40b25e0 2021-11-15T14:43:13.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b40b29c0 con 0x7f77b40b19d0 2021-11-15T14:43:13.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b40a8d40 con 0x7f77b40a7d80 2021-11-15T14:43:13.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f77b40a7d80 0x7f77b4147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f77b40a7d80 0x7f77b4147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35312/0 (socket says 172.21.2.135:35312) 2021-11-15T14:43:13.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 -- 172.21.2.135:0/2359495627 learned_addr learned my addr 172.21.2.135:0/2359495627 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:13.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 -- 172.21.2.135:0/2359495627 >> v1:172.21.2.135:6789/0 conn(0x7f77b40b19d0 legacy=0x7f77b40ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 -- 172.21.2.135:0/2359495627 >> v1:172.21.2.119:6789/0 conn(0x7f77b40b25e0 legacy=0x7f77b414b360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:13.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 -- 172.21.2.135:0/2359495627 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40b0990 con 0x7f77b40a7d80 2021-11-15T14:43:13.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b8e0d700 1 --2- 172.21.2.135:0/2359495627 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40a7d80 0x7f77b4147620 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f77b40a9530 tx=0x7f77ac009290).ready entity=mon.1 client_cookie=84ba78d749bf46d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b2ffd700 1 -- 172.21.2.135:0/2359495627 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00b860 con 0x7f77b40a7d80 2021-11-15T14:43:13.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b2ffd700 1 -- 172.21.2.135:0/2359495627 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00b9c0 con 0x7f77b40a7d80 2021-11-15T14:43:13.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77b2ffd700 1 -- 172.21.2.135:0/2359495627 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00bb30 con 0x7f77b40a7d80 2021-11-15T14:43:13.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- 172.21.2.135:0/2359495627 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40a7d80 msgr2=0x7f77b4147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 --2- 172.21.2.135:0/2359495627 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40a7d80 0x7f77b4147620 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f77b40a9530 tx=0x7f77ac009290).stop 2021-11-15T14:43:13.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- 172.21.2.135:0/2359495627 shutdown_connections 2021-11-15T14:43:13.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 --2- 172.21.2.135:0/2359495627 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40a7d80 0x7f77b4147620 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- 172.21.2.135:0/2359495627 >> 172.21.2.135:0/2359495627 conn(0x7f77b405caa0 msgr2=0x7f77b405ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:13.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- 172.21.2.135:0/2359495627 shutdown_connections 2021-11-15T14:43:13.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.888+0000 7f77ba870700 1 -- 172.21.2.135:0/2359495627 wait complete. 2021-11-15T14:43:13.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 Processor -- start 2021-11-15T14:43:13.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- start start 2021-11-15T14:43:13.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40a7d80 0x7f77b41467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b19d0 0x7f77b40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b5710 con 0x7f77b40a7d80 2021-11-15T14:43:13.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b59b0 con 0x7f77b40b25e0 2021-11-15T14:43:13.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b5c50 con 0x7f77b40b19d0 2021-11-15T14:43:13.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35318/0 (socket says 172.21.2.135:35318) 2021-11-15T14:43:13.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 -- 172.21.2.135:0/1886848786 learned_addr learned my addr 172.21.2.135:0/1886848786 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:13.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 -- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b19d0 msgr2=0x7f77b40ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b19d0 0x7f77b40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 -- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40a7d80 msgr2=0x7f77b41467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40a7d80 0x7f77b41467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 -- 172.21.2.135:0/1886848786 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac009530 con 0x7f77b40b25e0 2021-11-15T14:43:13.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b8e0d700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f77b40a9530 tx=0x7f77ac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00b860 con 0x7f77b40b25e0 2021-11-15T14:43:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac01f5e0 con 0x7f77b40b25e0 2021-11-15T14:43:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac01f940 con 0x7f77b40b25e0 2021-11-15T14:43:13.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b40b5ef0 con 0x7f77b40b25e0 2021-11-15T14:43:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b40ae680 con 0x7f77b40b25e0 2021-11-15T14:43:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b40b6080 con 0x7f77b40b25e0 2021-11-15T14:43:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f77ac026030 con 0x7f77b40b25e0 2021-11-15T14:43:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 0x7f77980559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:13.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f77ac06c970 con 0x7f77b40b25e0 2021-11-15T14:43:13.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.892+0000 7f77b3fff700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 0x7f77980559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:13.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.896+0000 7f77b3fff700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 0x7f77980559e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f77a4002ef0 tx=0x7f77a4006910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:13.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.896+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77ac043870 con 0x7f77b40b25e0 2021-11-15T14:43:13.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f77b414aec0 con 0x7f77b40b25e0 2021-11-15T14:43:13.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77b17fa700 1 -- 172.21.2.135:0/1886848786 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v144) v1 ==== 110+0+10 (secure 0 0 0) 0x7f77ac0240b0 con 0x7f77b40b25e0 2021-11-15T14:43:13.984 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:13.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 msgr2=0x7f77980559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 0x7f77980559e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f77a4002ef0 tx=0x7f77a4006910).stop 2021-11-15T14:43:13.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 msgr2=0x7f77b4156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:13.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f77b40a9530 tx=0x7f77ac016000).stop 2021-11-15T14:43:13.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 shutdown_connections 2021-11-15T14:43:13.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7798053520 0x7f77980559e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f77b40b25e0 0x7f77b4156de0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:13.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f77b40b19d0 0x7f77b40ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 --2- 172.21.2.135:0/1886848786 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f77b40a7d80 0x7f77b41467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:13.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 >> 172.21.2.135:0/1886848786 conn(0x7f77b405caa0 msgr2=0x7f77b40ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:13.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 shutdown_connections 2021-11-15T14:43:13.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:13.980+0000 7f77ba870700 1 -- 172.21.2.135:0/1886848786 wait complete. 2021-11-15T14:43:13.991 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 Processor -- start 2021-11-15T14:43:14.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 -- start start 2021-11-15T14:43:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 0x7fbba0066980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba0066e70 con 0x7fbba0064ed0 2021-11-15T14:43:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba0067100 con 0x7fbba0140fb0 2021-11-15T14:43:14.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba6b95700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00673a0 con 0x7fbba00b7f50 2021-11-15T14:43:14.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba4931700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba4931700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45098/0 (socket says 172.21.2.135:45098) 2021-11-15T14:43:14.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba4931700 1 -- 172.21.2.135:0/3838130651 learned_addr learned my addr 172.21.2.135:0/3838130651 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.040+0000 7fbba5132700 1 --2- 172.21.2.135:0/3838130651 >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 0x7fbba0066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 -- 172.21.2.135:0/3838130651 >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 msgr2=0x7fbba0066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 --2- 172.21.2.135:0/3838130651 >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 0x7fbba0066980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 -- 172.21.2.135:0/3838130651 >> v1:172.21.2.119:6789/0 conn(0x7fbba0064ed0 legacy=0x7fbba00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 -- 172.21.2.135:0/3838130651 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0067640 con 0x7fbba00b7f50 2021-11-15T14:43:14.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba5132700 1 --2- 172.21.2.135:0/3838130651 >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 0x7fbba0066980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:43:14.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 --2- 172.21.2.135:0/3838130651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fbb90002f70 tx=0x7fbb90006eb0).ready entity=mon.2 client_cookie=b500cc353abd2ed2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9f7fe700 1 -- 172.21.2.135:0/3838130651 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9000d570 con 0x7fbba00b7f50 2021-11-15T14:43:14.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9f7fe700 1 -- 172.21.2.135:0/3838130651 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90000e90 con 0x7fbba00b7f50 2021-11-15T14:43:14.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9f7fe700 1 -- 172.21.2.135:0/3838130651 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9000d900 con 0x7fbba00b7f50 2021-11-15T14:43:14.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- 172.21.2.135:0/3838130651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 msgr2=0x7fbba00b8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- 172.21.2.135:0/3838130651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fbb90002f70 tx=0x7fbb90006eb0).stop 2021-11-15T14:43:14.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- 172.21.2.135:0/3838130651 shutdown_connections 2021-11-15T14:43:14.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- 172.21.2.135:0/3838130651 >> v2:172.21.2.119:3300/0 conn(0x7fbba0140fb0 0x7fbba0066980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- 172.21.2.135:0/3838130651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba00b7f50 0x7fbba00b8330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- 172.21.2.135:0/3838130651 >> 172.21.2.135:0/3838130651 conn(0x7fbba0060200 msgr2=0x7fbba00b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- 172.21.2.135:0/3838130651 shutdown_connections 2021-11-15T14:43:14.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- 172.21.2.135:0/3838130651 wait complete. 2021-11-15T14:43:14.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 Processor -- start 2021-11-15T14:43:14.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- start start 2021-11-15T14:43:14.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba0064ed0 0x7fbba00b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbba0140fb0 0x7fbba0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00b0a20 con 0x7fbba0140fb0 2021-11-15T14:43:14.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00ab100 con 0x7fbba00b7f50 2021-11-15T14:43:14.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba6b95700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00ae310 con 0x7fbba0064ed0 2021-11-15T14:43:14.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35330/0 (socket says 172.21.2.135:35330) 2021-11-15T14:43:14.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 -- 172.21.2.135:0/184259411 learned_addr learned my addr 172.21.2.135:0/184259411 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbba4931700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba0064ed0 0x7fbba00b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 -- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba0064ed0 msgr2=0x7fbba00b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba0064ed0 0x7fbba00b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 -- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbba0140fb0 msgr2=0x7fbba0150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbba0140fb0 0x7fbba0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.044+0000 7fbb9ffff700 1 -- 172.21.2.135:0/184259411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009470 con 0x7fbba00b7f50 2021-11-15T14:43:14.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9ffff700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fbba00ae4a0 tx=0x7fbb88007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8800ce20 con 0x7fbba00b7f50 2021-11-15T14:43:14.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8800f470 con 0x7fbba00b7f50 2021-11-15T14:43:14.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9000b1e0 con 0x7fbba00b7f50 2021-11-15T14:43:14.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8800f7d0 con 0x7fbba00b7f50 2021-11-15T14:43:14.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba00b0c50 con 0x7fbba00b7f50 2021-11-15T14:43:14.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba00b25a0 con 0x7fbba00b7f50 2021-11-15T14:43:14.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb88019030 con 0x7fbba00b7f50 2021-11-15T14:43:14.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 0x7fbb840559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbb8806aef0 con 0x7fbba00b7f50 2021-11-15T14:43:14.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbba4931700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 0x7fbb840559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbba4931700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 0x7fbb840559b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fbb9001a000 tx=0x7fbb90015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.048+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb88041ea0 con 0x7fbba00b7f50 2021-11-15T14:43:14.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbba00573d0 con 0x7fbba00b7f50 2021-11-15T14:43:14.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbb9dffb700 1 -- 172.21.2.135:0/184259411 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb880454c0 con 0x7fbba00b7f50 2021-11-15T14:43:14.136 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:14.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 msgr2=0x7fbb840559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 0x7fbb840559b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fbb9001a000 tx=0x7fbb90015000).stop 2021-11-15T14:43:14.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 msgr2=0x7fbba01507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fbba00ae4a0 tx=0x7fbb88007c50).stop 2021-11-15T14:43:14.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 shutdown_connections 2021-11-15T14:43:14.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbb840534f0 0x7fbb840559b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbba0140fb0 0x7fbba0150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbba00b7f50 0x7fbba01507c0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 --2- 172.21.2.135:0/184259411 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbba0064ed0 0x7fbba00b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 >> 172.21.2.135:0/184259411 conn(0x7fbba0060200 msgr2=0x7fbba013cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 shutdown_connections 2021-11-15T14:43:14.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.132+0000 7fbba6b95700 1 -- 172.21.2.135:0/184259411 wait complete. 2021-11-15T14:43:14.143 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:14.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 Processor -- start 2021-11-15T14:43:14.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- start start 2021-11-15T14:43:14.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0e01409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00a7140 con 0x7ff0e013a180 2021-11-15T14:43:14.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e0061a10 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0140e90 con 0x7ff0e0060b80 2021-11-15T14:43:14.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff0e00a9ab0 0x7ff0e0139a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51160/0 (socket says 172.21.2.135:51160) 2021-11-15T14:43:14.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 -- 172.21.2.135:0/3274185665 learned_addr learned my addr 172.21.2.135:0/3274185665 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:14.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0dffff700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0e01409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485396189 0 0) 0x7ff0e0061a10 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003260 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795591627 0 0) 0x7ff0c0003260 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 msgr2=0x7ff0e01409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0e01409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 >> v1:172.21.2.119:6789/0 conn(0x7ff0e013a180 legacy=0x7ff0e00a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00a9f50 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7ff0d0001660 con 0x7ff0e00a9ab0 2021-11-15T14:43:14.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 >> v1:172.21.2.135:6789/0 conn(0x7ff0e00a9ab0 legacy=0x7ff0e0139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0c00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c0003e00 0x7ff0c0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0004b10 0x7ff0c0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0140e90 con 0x7ff0c0004b10 2021-11-15T14:43:14.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0005720 con 0x7ff0c0003e00 2021-11-15T14:43:14.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00058e0 con 0x7ff0e0060b80 2021-11-15T14:43:14.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c0003e00 0x7ff0c0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0dffff700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0c00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 -- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 msgr2=0x7ff0c00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e0060b80 0x7ff0c00037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 -- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0004b10 msgr2=0x7ff0c0004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e4c22700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0004b10 0x7ff0c0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0004b10 0x7ff0c0004f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 -- 172.21.2.135:0/3274185665 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0003260 con 0x7ff0c0003e00 2021-11-15T14:43:14.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c0003e00 0x7ff0c0004500 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7ff0d0001370 tx=0x7ff0e013ff60).ready entity=mon.1 client_cookie=d5c6f196992544c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d00070d0 con 0x7ff0c0003e00 2021-11-15T14:43:14.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0007230 con 0x7ff0c0003e00 2021-11-15T14:43:14.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0deffd700 1 -- 172.21.2.135:0/3274185665 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d000c8f0 con 0x7ff0c0003e00 2021-11-15T14:43:14.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- 172.21.2.135:0/3274185665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c0003e00 msgr2=0x7ff0c0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 --2- 172.21.2.135:0/3274185665 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c0003e00 0x7ff0c0004500 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7ff0d0001370 tx=0x7ff0e013ff60).stop 2021-11-15T14:43:14.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e4c22700 1 -- 172.21.2.135:0/3274185665 reap_dead start 2021-11-15T14:43:14.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- 172.21.2.135:0/3274185665 shutdown_connections 2021-11-15T14:43:14.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- 172.21.2.135:0/3274185665 >> 172.21.2.135:0/3274185665 conn(0x7ff0e00b6740 msgr2=0x7ff0e00b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- 172.21.2.135:0/3274185665 shutdown_connections 2021-11-15T14:43:14.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.192+0000 7ff0e6685700 1 -- 172.21.2.135:0/3274185665 wait complete. 2021-11-15T14:43:14.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 Processor -- start 2021-11-15T14:43:14.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- start start 2021-11-15T14:43:14.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0003e00 0x7ff0e013c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e01581c0 0x7ff0e0155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e013bff0 con 0x7ff0c0003e00 2021-11-15T14:43:14.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e013c220 con 0x7ff0e0144140 2021-11-15T14:43:14.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e013c4c0 con 0x7ff0e01581c0 2021-11-15T14:43:14.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35352/0 (socket says 172.21.2.135:35352) 2021-11-15T14:43:14.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 -- 172.21.2.135:0/2757028734 learned_addr learned my addr 172.21.2.135:0/2757028734 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e4c22700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e01581c0 0x7ff0e0155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 -- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e01581c0 msgr2=0x7ff0e0155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e01581c0 0x7ff0e0155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 -- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0003e00 msgr2=0x7ff0e013c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0003e00 0x7ff0e013c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 -- 172.21.2.135:0/2757028734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e013d230 con 0x7ff0e0144140 2021-11-15T14:43:14.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0df7fe700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7ff0e013c840 tx=0x7ff0d0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d00070d0 con 0x7ff0e0144140 2021-11-15T14:43:14.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004920 con 0x7ff0e0144140 2021-11-15T14:43:14.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e015ae40 con 0x7ff0e0144140 2021-11-15T14:43:14.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0d0004c80 con 0x7ff0e0144140 2021-11-15T14:43:14.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0141b40 con 0x7ff0e0144140 2021-11-15T14:43:14.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e013c680 con 0x7ff0e0144140 2021-11-15T14:43:14.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff0d0010070 con 0x7ff0e0144140 2021-11-15T14:43:14.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 0x7ff0c4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff0d006c920 con 0x7ff0e0144140 2021-11-15T14:43:14.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.196+0000 7ff0dffff700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 0x7ff0c4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.200+0000 7ff0dffff700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 0x7ff0c4055b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff0c800c000 tx=0x7ff0c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.222 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.200+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0d0043820 con 0x7ff0e0144140 2021-11-15T14:43:14.286 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0e00573d0 con 0x7ff0e0144140 2021-11-15T14:43:14.287 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0dd7fa700 1 -- 172.21.2.135:0/2757028734 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff0d0025020 con 0x7ff0e0144140 2021-11-15T14:43:14.287 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:14.288 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 msgr2=0x7ff0c4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 0x7ff0c4055b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff0c800c000 tx=0x7ff0c8008040).stop 2021-11-15T14:43:14.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 msgr2=0x7ff0e015a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.289 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7ff0e013c840 tx=0x7ff0d0015000).stop 2021-11-15T14:43:14.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 shutdown_connections 2021-11-15T14:43:14.290 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0c4053640 0x7ff0c4055b00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0e01581c0 0x7ff0e0155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0e0144140 0x7ff0e015a600 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 --2- 172.21.2.135:0/2757028734 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c0003e00 0x7ff0e013c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.291 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 >> 172.21.2.135:0/2757028734 conn(0x7ff0e00b6740 msgr2=0x7ff0e0138510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 shutdown_connections 2021-11-15T14:43:14.292 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.284+0000 7ff0e6685700 1 -- 172.21.2.135:0/2757028734 wait complete. 2021-11-15T14:43:14.294 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:14.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 Processor -- start 2021-11-15T14:43:14.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 -- start start 2021-11-15T14:43:14.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6aac0b19d0 0x7f6aac0a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac0ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac14ac90 con 0x7f6aac0b25e0 2021-11-15T14:43:14.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0a8d40 con 0x7f6aac0b19d0 2021-11-15T14:43:14.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab33d3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac147a90 con 0x7f6aac147620 2021-11-15T14:43:14.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab1970700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac0ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab096e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6aac0b19d0 0x7f6aac0a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab1970700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac0ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45136/0 (socket says 172.21.2.135:45136) 2021-11-15T14:43:14.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab1970700 1 -- 172.21.2.135:0/4292281524 learned_addr learned my addr 172.21.2.135:0/4292281524 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab096e700 1 -- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 msgr2=0x7f6aac0ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab096e700 1 --2- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac0ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab096e700 1 -- 172.21.2.135:0/4292281524 >> v1:172.21.2.119:6789/0 conn(0x7f6aac0b25e0 legacy=0x7f6aac14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.344+0000 7f6ab096e700 1 -- 172.21.2.135:0/4292281524 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0b29c0 con 0x7f6aac0b19d0 2021-11-15T14:43:14.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0a7d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6aa0002f70 tx=0x7f6aa0006df0).ready entity=mon.0 client_cookie=56a7812f438805b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9ffff700 1 -- 172.21.2.135:0/4292281524 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa000d570 con 0x7f6aac0b19d0 2021-11-15T14:43:14.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9ffff700 1 -- 172.21.2.135:0/4292281524 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0000e90 con 0x7f6aac0b19d0 2021-11-15T14:43:14.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9ffff700 1 -- 172.21.2.135:0/4292281524 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa000d8c0 con 0x7f6aac0b19d0 2021-11-15T14:43:14.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 msgr2=0x7f6aac0a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0a7d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6aa0002f70 tx=0x7f6aa0006df0).stop 2021-11-15T14:43:14.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/4292281524 shutdown_connections 2021-11-15T14:43:14.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac0ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/4292281524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0a7d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/4292281524 >> 172.21.2.135:0/4292281524 conn(0x7f6aac05caa0 msgr2=0x7f6aac05ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/4292281524 shutdown_connections 2021-11-15T14:43:14.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/4292281524 wait complete. 2021-11-15T14:43:14.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 Processor -- start 2021-11-15T14:43:14.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- start start 2021-11-15T14:43:14.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0ab980 con 0x7f6aac0b19d0 2021-11-15T14:43:14.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac1411f0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac157a50 con 0x7f6aac147620 2021-11-15T14:43:14.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35362/0 (socket says 172.21.2.135:35362) 2021-11-15T14:43:14.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 -- 172.21.2.135:0/894586346 learned_addr learned my addr 172.21.2.135:0/894586346 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab1970700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 -- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 msgr2=0x7f6aac140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 -- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 msgr2=0x7f6aac0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 -- 172.21.2.135:0/894586346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa000b180 con 0x7f6aac0b25e0 2021-11-15T14:43:14.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab096e700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f6aac156e80 tx=0x7f6aa0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa000dea0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa001e400 con 0x7f6aac0b25e0 2021-11-15T14:43:14.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa001e760 con 0x7f6aac0b25e0 2021-11-15T14:43:14.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac157cf0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.348+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac0ab4e0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aac0ab670 con 0x7f6aac0b25e0 2021-11-15T14:43:14.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6aa0025030 con 0x7f6aac0b25e0 2021-11-15T14:43:14.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6a9e7fc700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 0x7f6a8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6aa006c9a0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6ab116f700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 0x7f6a8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6ab116f700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 0x7f6a8c055ad0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6aac0a9530 tx=0x7f6aa8007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.352+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6aa00439b0 con 0x7f6aac0b25e0 2021-11-15T14:43:14.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6aac0b0990 con 0x7f6aac0b25e0 2021-11-15T14:43:14.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6a9e7fc700 1 -- 172.21.2.135:0/894586346 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6aa0023020 con 0x7f6aac0b25e0 2021-11-15T14:43:14.440 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:14.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 msgr2=0x7f6a8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 0x7f6a8c055ad0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6aac0a9530 tx=0x7f6aa8007810).stop 2021-11-15T14:43:14.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 msgr2=0x7f6aac140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f6aac156e80 tx=0x7f6aa0014000).stop 2021-11-15T14:43:14.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 shutdown_connections 2021-11-15T14:43:14.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a8c053610 0x7f6a8c055ad0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6aac147620 0x7f6aac140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6aac0b25e0 0x7f6aac140810 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 --2- 172.21.2.135:0/894586346 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6aac0b19d0 0x7f6aac0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 >> 172.21.2.135:0/894586346 conn(0x7f6aac05caa0 msgr2=0x7f6aac1489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 shutdown_connections 2021-11-15T14:43:14.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.436+0000 7f6ab33d3700 1 -- 172.21.2.135:0/894586346 wait complete. 2021-11-15T14:43:14.447 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:14.448 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:14.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 Processor -- start 2021-11-15T14:43:14.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- start start 2021-11-15T14:43:14.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b25e0 0x7f62540a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f62540b19d0 0x7f6254147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625414ac90 con 0x7f625414b360 2021-11-15T14:43:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540a8d40 con 0x7f62540b19d0 2021-11-15T14:43:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540b29c0 con 0x7f62540b25e0 2021-11-15T14:43:14.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f62540b19d0 0x7f6254147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62537fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f625414b360 0x7f62540ab830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51190/0 (socket says 172.21.2.135:51190) 2021-11-15T14:43:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62537fe700 1 -- 172.21.2.135:0/2615969632 learned_addr learned my addr 172.21.2.135:0/2615969632 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 -- 172.21.2.135:0/2615969632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b25e0 msgr2=0x7f62540a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:14.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 --2- 172.21.2.135:0/2615969632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b25e0 0x7f62540a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 -- 172.21.2.135:0/2615969632 >> v1:172.21.2.135:6789/0 conn(0x7f625414b360 legacy=0x7f62540ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 -- 172.21.2.135:0/2615969632 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540b0990 con 0x7f62540b19d0 2021-11-15T14:43:14.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62527fc700 1 --2- 172.21.2.135:0/2615969632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b19d0 0x7f6254147620 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f6244002f70 tx=0x7f6244006df0).ready entity=mon.1 client_cookie=92f8be3dc5431a39 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f6251ffb700 1 -- 172.21.2.135:0/2615969632 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624400d570 con 0x7f62540b19d0 2021-11-15T14:43:14.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f6251ffb700 1 -- 172.21.2.135:0/2615969632 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244000e90 con 0x7f62540b19d0 2021-11-15T14:43:14.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f6251ffb700 1 -- 172.21.2.135:0/2615969632 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624400d8c0 con 0x7f62540b19d0 2021-11-15T14:43:14.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- 172.21.2.135:0/2615969632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b19d0 msgr2=0x7f6254147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- 172.21.2.135:0/2615969632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b19d0 0x7f6254147620 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f6244002f70 tx=0x7f6244006df0).stop 2021-11-15T14:43:14.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- 172.21.2.135:0/2615969632 shutdown_connections 2021-11-15T14:43:14.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- 172.21.2.135:0/2615969632 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b19d0 0x7f6254147620 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- 172.21.2.135:0/2615969632 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b25e0 0x7f62540a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- 172.21.2.135:0/2615969632 >> 172.21.2.135:0/2615969632 conn(0x7f625405caa0 msgr2=0x7f625405ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- 172.21.2.135:0/2615969632 shutdown_connections 2021-11-15T14:43:14.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- 172.21.2.135:0/2615969632 wait complete. 2021-11-15T14:43:14.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 Processor -- start 2021-11-15T14:43:14.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- start start 2021-11-15T14:43:14.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b19d0 0x7f625415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f625414b360 0x7f6254142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540b4170 con 0x7f625414b360 2021-11-15T14:43:14.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625415acf0 con 0x7f62540b25e0 2021-11-15T14:43:14.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.496+0000 7f62599e3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625415aa50 con 0x7f62540b19d0 2021-11-15T14:43:14.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35376/0 (socket says 172.21.2.135:35376) 2021-11-15T14:43:14.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 -- 172.21.2.135:0/800939545 learned_addr learned my addr 172.21.2.135:0/800939545 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:14.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 -- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b19d0 msgr2=0x7f625415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b19d0 0x7f625415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 -- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f625414b360 msgr2=0x7f6254142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f625414b360 0x7f6254142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 -- 172.21.2.135:0/800939545 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624400b180 con 0x7f62540b25e0 2021-11-15T14:43:14.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62527fc700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f6244002f70 tx=0x7f6244015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624400de40 con 0x7f62540b25e0 2021-11-15T14:43:14.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244011ce0 con 0x7f62540b25e0 2021-11-15T14:43:14.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624401e650 con 0x7f62540b25e0 2021-11-15T14:43:14.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540b43d0 con 0x7f62540b25e0 2021-11-15T14:43:14.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62540b3750 con 0x7f62540b25e0 2021-11-15T14:43:14.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625414aec0 con 0x7f62540b25e0 2021-11-15T14:43:14.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6244025030 con 0x7f62540b25e0 2021-11-15T14:43:14.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 0x7f6230055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:14.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f624406cfa0 con 0x7f62540b25e0 2021-11-15T14:43:14.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6252ffd700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 0x7f6230055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:14.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.500+0000 7f6252ffd700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 0x7f6230055b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f6248002f70 tx=0x7f6248006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:14.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.504+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6244043fb0 con 0x7f62540b25e0 2021-11-15T14:43:14.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.608+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62540573d0 con 0x7f62540b25e0 2021-11-15T14:43:14.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.608+0000 7f6243fff700 1 -- 172.21.2.135:0/800939545 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f6244023090 con 0x7f62540b25e0 2021-11-15T14:43:14.614 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:14.615 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:14.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 msgr2=0x7f6230055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 0x7f6230055b20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f6248002f70 tx=0x7f6248006a80).stop 2021-11-15T14:43:14.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 msgr2=0x7f62540b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:14.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f6244002f70 tx=0x7f6244015000).stop 2021-11-15T14:43:14.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 shutdown_connections 2021-11-15T14:43:14.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6230053660 0x7f6230055b20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f625414b360 0x7f6254142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f62540b25e0 0x7f62540b57f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:14.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 --2- 172.21.2.135:0/800939545 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f62540b19d0 0x7f625415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:14.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 >> 172.21.2.135:0/800939545 conn(0x7f625405caa0 msgr2=0x7f6254143dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 shutdown_connections 2021-11-15T14:43:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:14.612+0000 7f62599e3700 1 -- 172.21.2.135:0/800939545 wait complete. 2021-11-15T14:43:14.619 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:14.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:00.221722+0000', 'modified': '2021-11-15T14:43:01.226479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8041}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8041': {'gid': 8041, 'name': 'b', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.119:6835/2587030449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.119:6834', 'nonce': 2587030449}, {'type': 'v1', 'addr': '172.21.2.119:6835', 'nonce': 2587030449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:14.925 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:14.925 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-11-15T14:43:14.993 INFO:teuthology.orchestra.run.gibba019.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8041,"want_state":"up:active","state":"up:active","rank_uptime":14.7590149,"mdsmap_epoch":70,"osdmap_epoch":144,"osdmap_epoch_barrier":143,"uptime":19.080448415999999} 2021-11-15T14:43:14.993 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8041, "mdsmap_epoch": 70, "osdmap_epoch": 144, "osdmap_epoch_barrier": 143, "rank_uptime": 14.7590149, "state": "up:active", "uptime": 19.080448416, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:14.994 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:14.994 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:43:14.995 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:43:14.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:14.996 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:15.007 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:15.018 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:15.019 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:15.024 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:15.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:15.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:15.026 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:15.030 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:15.030 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:15.075 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:15.085 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:15.085 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:15.090 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:15.091 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:15.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:15.092 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:15.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:43:15.106+0000 7ff153706080 -1 init, newargv = 0x55593222c1c0 newargc=9 2021-11-15T14:43:15.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14714]: starting ceph client 2021-11-15T14:43:15.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14714]: starting fuse 2021-11-15T14:43:16.197 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:16.209 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:16.210 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:16.260 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:16.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:16.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.264 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:16.270 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:43:16.271 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:16.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.273 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:43:16.274 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:43:16.274 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:43:16.275 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:43:16.276 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:43:16.277 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:16.278 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:43:16.278 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:43:16.279 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:43:16.280 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:16.281 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:43:16.282 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:43:16.282 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:43:16.283 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:43:16.284 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:16.285 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:43:16.286 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:16.286 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:16.287 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:43:16.288 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:16.289 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:16.289 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:43:16.290 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:43:16.326 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14714.asok 2021-11-15T14:43:16.329 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14714.asok 2021-11-15T14:43:16.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.331 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14714.asok status 2021-11-15T14:43:16.433 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:43:16.434 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:43:16.434 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:16.434 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:16.434 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:43:16.435 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:43:16.435 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:43:16.435 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14714", 2021-11-15T14:43:16.435 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:43:16.435 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:16.436 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:43:16.436 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:16.436 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 5081, 2021-11-15T14:43:16.436 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:43:16.437 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:43:16.437 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:43:16.437 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 5081 2021-11-15T14:43:16.437 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:16.437 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:16.438 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:16.438 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:16.438 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 841320949 2021-11-15T14:43:16.438 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:43:16.439 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:16.439 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:16.439 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:16.439 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:16.439 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 841320949 2021-11-15T14:43:16.440 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:16.440 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.5081 172.21.2.132:0/841320949", 2021-11-15T14:43:16.440 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/841320949", 2021-11-15T14:43:16.440 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:43:16.441 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 70, 2021-11-15T14:43:16.441 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 144, 2021-11-15T14:43:16.441 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:16.441 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:43:16.441 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:43:16.442 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:43:16.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.444 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:16.444 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:16.453 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:16.454 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:16.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.455 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:16.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:16.475 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:16.475 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:16.487 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:16.488 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:16.489 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-15T14:43:16.489 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-15T14:43:16.489 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:16.490 DEBUG:teuthology.orchestra.run.gibba038:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-11-15T14:43:16.490 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content'"'"') 2021-11-15T14:43:16.491 DEBUG:teuthology.orchestra.run.gibba038:> f.flush() 2021-11-15T14:43:16.491 DEBUG:teuthology.orchestra.run.gibba038:> f.write('"'"'content2'"'"') 2021-11-15T14:43:16.491 DEBUG:teuthology.orchestra.run.gibba038:> while True: 2021-11-15T14:43:16.492 DEBUG:teuthology.orchestra.run.gibba038:> time.sleep(1) 2021-11-15T14:43:16.492 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:43:16.495 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T14:43:16.512 INFO:teuthology.orchestra.run.gibba038.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-11-15T14:43:16.513 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-15T14:43:17.515 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T14:43:17.527 INFO:teuthology.orchestra.run.gibba038.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-11-15T14:43:17.528 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-11-15T14:43:17.528 DEBUG:teuthology.orchestra.run.gibba032:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-11-15T14:43:17.574 INFO:teuthology.orchestra.run.gibba032.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-11-15T14:43:17.575 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-11-15T14:43:17.575 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T14:43:17.576 DEBUG:teuthology.orchestra.run.gibba032:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-11-15T14:43:17.639 INFO:teuthology.orchestra.run.gibba032.stdout:content 2021-11-15T14:43:17.650 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:43:17.651 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:17.663 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:17.692 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:17.706 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:17.723 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:43:17.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:17.724 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:17.724 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:17.770 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:17.771 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:17.771 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:43:17.772 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:17.772 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:17.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15145]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:17.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:17.784 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:17.785 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:17.793 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:43:17.795 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:17.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:43:17.866 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:17.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:17.870 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:17.871 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:17.882 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:17.883 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:17.884 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:43:17.884 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:17.884 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:17.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14714]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:17.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:17.900 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:17.900 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:17.964 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:43:17.971 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:43:17.972 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:17.978 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:43:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 Processor -- start 2021-11-15T14:43:18.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 -- start start 2021-11-15T14:43:18.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd830147620 0x7fd8300ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83014ac90 con 0x7fd8300b25e0 2021-11-15T14:43:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8300a8d40 con 0x7fd830147620 2021-11-15T14:43:18.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.028+0000 7fd83694a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd830147a90 con 0x7fd8300b19d0 2021-11-15T14:43:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd834ee7700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd830147620 0x7fd8300ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45162/0 (socket says 172.21.2.135:45162) 2021-11-15T14:43:18.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 -- 172.21.2.135:0/492776639 learned_addr learned my addr 172.21.2.135:0/492776639 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:18.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 -- 172.21.2.135:0/492776639 >> v2:172.21.2.119:3300/0 conn(0x7fd830147620 msgr2=0x7fd8300ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 --2- 172.21.2.135:0/492776639 >> v2:172.21.2.119:3300/0 conn(0x7fd830147620 0x7fd8300ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 -- 172.21.2.135:0/492776639 >> v1:172.21.2.119:6789/0 conn(0x7fd8300b25e0 legacy=0x7fd83014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 -- 172.21.2.135:0/492776639 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300b29c0 con 0x7fd8300b19d0 2021-11-15T14:43:18.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82f7fe700 1 --2- 172.21.2.135:0/492776639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824006eb0).ready entity=mon.2 client_cookie=d2a5d3c7bf53825 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82effd700 1 -- 172.21.2.135:0/492776639 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82400d570 con 0x7fd8300b19d0 2021-11-15T14:43:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82effd700 1 -- 172.21.2.135:0/492776639 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824000e90 con 0x7fd8300b19d0 2021-11-15T14:43:18.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd82effd700 1 -- 172.21.2.135:0/492776639 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82400d900 con 0x7fd8300b19d0 2021-11-15T14:43:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 -- 172.21.2.135:0/492776639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 msgr2=0x7fd8300a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 --2- 172.21.2.135:0/492776639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824006eb0).stop 2021-11-15T14:43:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 -- 172.21.2.135:0/492776639 shutdown_connections 2021-11-15T14:43:18.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 --2- 172.21.2.135:0/492776639 >> v2:172.21.2.119:3300/0 conn(0x7fd830147620 0x7fd8300ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 --2- 172.21.2.135:0/492776639 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8300b19d0 0x7fd8300a7d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 -- 172.21.2.135:0/492776639 >> 172.21.2.135:0/492776639 conn(0x7fd83005caa0 msgr2=0x7fd83005ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 -- 172.21.2.135:0/492776639 shutdown_connections 2021-11-15T14:43:18.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.032+0000 7fd83694a700 1 -- 172.21.2.135:0/492776639 wait complete. 2021-11-15T14:43:18.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 Processor -- start 2021-11-15T14:43:18.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- start start 2021-11-15T14:43:18.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8300b19d0 0x7fd8300abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd830147620 0x7fd8300ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300aac60 con 0x7fd8300b19d0 2021-11-15T14:43:18.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300aa830 con 0x7fd8300b25e0 2021-11-15T14:43:18.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300b3c40 con 0x7fd830147620 2021-11-15T14:43:18.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35394/0 (socket says 172.21.2.135:35394) 2021-11-15T14:43:18.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 -- 172.21.2.135:0/3324623900 learned_addr learned my addr 172.21.2.135:0/3324623900 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:18.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd834ee7700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd830147620 0x7fd8300ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 -- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd830147620 msgr2=0x7fd8300ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd830147620 0x7fd8300ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 -- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8300b19d0 msgr2=0x7fd8300abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8300b19d0 0x7fd8300abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 -- 172.21.2.135:0/3324623900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82400b1e0 con 0x7fd8300b25e0 2021-11-15T14:43:18.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82f7fe700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8240117e0 con 0x7fd8300b25e0 2021-11-15T14:43:18.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824011940 con 0x7fd8300b25e0 2021-11-15T14:43:18.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8300a9ca0 con 0x7fd8300b25e0 2021-11-15T14:43:18.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd824011ca0 con 0x7fd8300b25e0 2021-11-15T14:43:18.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8300b3610 con 0x7fd8300b25e0 2021-11-15T14:43:18.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8300a9e60 con 0x7fd8300b25e0 2021-11-15T14:43:18.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd824025030 con 0x7fd8300b25e0 2021-11-15T14:43:18.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 0x7fd810055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd82406cd70 con 0x7fd8300b25e0 2021-11-15T14:43:18.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.036+0000 7fd82ffff700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 0x7fd810055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.040+0000 7fd82ffff700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 0x7fd810055b00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd83014b240 tx=0x7fd820007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.040+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd824043ce0 con 0x7fd8300b25e0 2021-11-15T14:43:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd8300b0990 con 0x7fd8300b25e0 2021-11-15T14:43:18.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd82d7fa700 1 -- 172.21.2.135:0/3324623900 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fd824023020 con 0x7fd8300b25e0 2021-11-15T14:43:18.127 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:18.127 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:18.128 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 144, 2021-11-15T14:43:18.128 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:43:18.128 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:43:18.128 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:43:01.227552+0000", 2021-11-15T14:43:18.129 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:18.129 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:18.129 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:43:18.129 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:43:18.129 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:43:18.130 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:43:18.130 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:43:18.130 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:43:18.131 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:43:18.131 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:18.131 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:43:18.131 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:43:18.132 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:43:18.132 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:43:18.132 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:43:18.132 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 26, 2021-11-15T14:43:18.132 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:43:18.133 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:43:18.133 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:43:18.133 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:43:18.133 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:43:18.133 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:43:18.134 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:43:18.134 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:43:18.134 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:18.135 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:18.135 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:18.135 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:18.135 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:18.136 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:18.136 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:18.136 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:18.136 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:43:18.136 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:43:18.137 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:43:18.137 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:43:18.137 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:43:18.137 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:18.137 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:18.138 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:18.138 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:18.138 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:18.138 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:18.139 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:18.139 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.139 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:43:18.139 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:18.139 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:18.140 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:18.140 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:18.140 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:18.140 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:18.140 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:18.141 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:18.141 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:18.141 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:18.141 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:18.141 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:18.142 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:18.142 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:18.142 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:18.143 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:18.143 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:18.143 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:18.143 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:18.143 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:18.144 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:18.144 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:18.144 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:18.144 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:18.145 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:18.145 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:18.145 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.145 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:18.145 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:18.146 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:18.146 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:18.146 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:18.146 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:18.147 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:18.147 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:18.147 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:18.147 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:18.147 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:18.148 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:18.148 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:43:18.148 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.148 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:18.149 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:43:18.149 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.149 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.149 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.149 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:43:18.150 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:43:18.150 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:43:18.150 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:18.150 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:18.150 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:18.151 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:18.151 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:18.151 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:18.151 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:18.152 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:18.152 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:18.152 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:18.152 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:18.152 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:18.153 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:18.153 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:18.153 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:18.153 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:18.153 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:18.154 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:18.154 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:18.154 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:18.154 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.154 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:43:18.155 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:18.155 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:18.155 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:18.155 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:18.156 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:18.156 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:18.156 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:18.156 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:18.156 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:18.157 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:18.157 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:18.157 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:18.157 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:18.158 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:18.158 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:18.158 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:18.158 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:18.158 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:18.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:18.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:18.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:18.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:18.159 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:18.160 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:18.160 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:18.160 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:18.160 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.160 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:18.161 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:18.161 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:18.161 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:18.161 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:18.162 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:18.162 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:18.162 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:18.162 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:18.162 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:18.163 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:18.163 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:18.163 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:18.163 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:43:18.163 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.164 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.164 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.164 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 25, 2021-11-15T14:43:18.164 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:43:18.165 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:42:58.129588+0000", 2021-11-15T14:43:18.165 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:18.165 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:18.165 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:18.165 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:18.166 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:18.166 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:18.166 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:18.166 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:18.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:18.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:18.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:18.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:18.167 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:18.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:18.168 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:18.168 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:18.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:18.168 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:18.169 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:18.169 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:18.169 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.169 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "143", 2021-11-15T14:43:18.170 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:18.170 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:18.170 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:18.170 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:18.170 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:18.171 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:18.171 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:18.171 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:18.171 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:18.172 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:18.172 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:18.172 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:18.172 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:18.172 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:18.173 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:18.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:18.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:18.173 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:18.173 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:18.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:18.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:18.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:18.174 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:18.175 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:18.175 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:18.175 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:18.175 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:18.176 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:18.176 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:18.176 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:18.176 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:18.177 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:18.177 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:18.177 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:18.177 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:18.177 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:18.178 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:18.178 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:18.178 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:43:18.178 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:43:18.179 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:43:18.179 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.179 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:18.179 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:43:18.179 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:43:18.180 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.180 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.180 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.180 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.181 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 26, 2021-11-15T14:43:18.181 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:43:18.181 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:42:59.213509+0000", 2021-11-15T14:43:18.182 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:18.182 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:18.182 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:18.183 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:18.183 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:18.183 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:18.183 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:18.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:18.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:18.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:18.184 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:18.185 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:18.185 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:18.185 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:18.185 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:18.185 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:18.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:18.186 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:18.186 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:18.186 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:18.187 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.187 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "144", 2021-11-15T14:43:18.187 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:18.187 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:18.188 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:18.188 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:18.188 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:18.189 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:18.189 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:18.190 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:18.190 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:18.191 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:18.191 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:18.191 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:18.192 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:18.192 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:18.193 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:18.193 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:18.194 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:18.194 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:18.195 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:18.195 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:18.195 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:18.196 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:18.196 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:18.197 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:18.197 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:18.198 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:18.198 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.199 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:18.199 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:18.199 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:18.200 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:18.200 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:18.201 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:18.201 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:18.202 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:18.202 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:18.203 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:18.203 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:18.203 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:18.204 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:18.204 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:43:18.204 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:43:18.204 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.205 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.205 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.205 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:18.205 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:43:18.206 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.206 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:18.206 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:43:18.206 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.207 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.207 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.207 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.207 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.208 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.208 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.208 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.208 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.209 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.209 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.209 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.209 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.210 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.210 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:43:18.210 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.210 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.211 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.211 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.211 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:43:18.211 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.212 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.212 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.212 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.212 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.212 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.213 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.213 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.213 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:43:18.213 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.214 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.214 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.214 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.214 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:43:18.215 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.215 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.215 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.215 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.216 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.216 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.216 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.216 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.217 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:43:18.217 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.217 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.217 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.218 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.218 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:43:18.218 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.218 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.219 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.219 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.219 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.219 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.220 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.220 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.220 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:43:18.220 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.221 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.221 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.221 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.221 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:43:18.222 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:18.222 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.222 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.222 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.223 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:43:18.223 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:43:18.223 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:43:18.223 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:43:18.224 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.224 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.224 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.224 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.224 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.225 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.225 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:18.225 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:43:18.225 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.226 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.226 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.226 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.226 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.227 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.227 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.227 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.227 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.228 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.228 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.228 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.228 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.229 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.229 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:43:18.229 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.229 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.230 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.230 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.230 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:43:18.230 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.231 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.231 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.231 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.232 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.232 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.232 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.232 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.233 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:43:18.233 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.233 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.233 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.233 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.234 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:43:18.234 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.234 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.235 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.235 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.235 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.235 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.236 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.236 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:43:18.236 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.236 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.237 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.237 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.237 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:43:18.237 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.238 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.238 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.238 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.238 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.239 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.239 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.239 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:43:18.240 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.240 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.240 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.240 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.241 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:43:18.241 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:18.241 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.241 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.242 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.242 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:43:18.242 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:43:18.242 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:43:18.243 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:43:18.243 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.243 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.244 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.244 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.244 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.244 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:18.245 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:43:18.245 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.245 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.245 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.246 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.246 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.246 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.246 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.247 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:43:18.247 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.247 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.247 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.248 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.248 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.248 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.248 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:43:18.248 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.249 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.249 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.249 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:43:18.250 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.250 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.250 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.250 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.251 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.251 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.251 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.251 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.252 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:43:18.252 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.252 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.252 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.252 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.253 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:43:18.253 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.253 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.253 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.254 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.254 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.254 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.254 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.255 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.255 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:43:18.255 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.255 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.256 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.256 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.256 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:43:18.256 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.257 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.257 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.257 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.257 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.258 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.258 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.258 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.258 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:43:18.259 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.259 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.259 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.259 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.260 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:43:18.260 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:18.260 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.260 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.261 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.261 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:43:18.261 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:43:18.261 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:43:18.261 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:43:18.262 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.262 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.262 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.262 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.263 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.263 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.263 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:18.263 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:43:18.264 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.264 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.264 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.264 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.265 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.265 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.265 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.266 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.266 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.266 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.266 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.267 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.267 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.267 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:43:18.267 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.268 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.268 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.268 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.268 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:43:18.269 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.269 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.269 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.269 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.269 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.270 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.270 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.270 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.270 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:43:18.271 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.271 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.271 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.271 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.272 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:43:18.272 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.272 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.272 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.273 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.273 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.273 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.273 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.274 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.274 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:43:18.274 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.274 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.275 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.275 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.275 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:43:18.275 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.276 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.276 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.276 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.276 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.277 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.277 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.277 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.277 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:43:18.277 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.278 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.278 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.278 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.278 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:43:18.279 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:18.279 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.279 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.279 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.280 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:43:18.280 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:43:18.280 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:43:18.280 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:43:18.281 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.281 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.281 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.281 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.281 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.282 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.282 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:18.282 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:43:18.282 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.283 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.283 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.283 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.283 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.284 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.284 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.284 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.284 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.285 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.285 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.285 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.285 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.285 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.286 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:43:18.286 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.286 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.286 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.287 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.287 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:43:18.287 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.287 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.288 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.288 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.288 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.288 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.289 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.289 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.289 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:43:18.289 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.290 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.290 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.290 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.290 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:43:18.291 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.291 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.291 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.291 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.292 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.292 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.292 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.292 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.292 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:43:18.293 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.293 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.293 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.293 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.294 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:43:18.294 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.294 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.294 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.295 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.295 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.295 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.295 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.296 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.296 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:43:18.296 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.296 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.297 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.297 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.297 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:43:18.297 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:18.298 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.298 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.298 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.298 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:43:18.299 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:43:18.299 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:43:18.299 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:43:18.299 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.300 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.300 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.300 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.301 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.301 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:18.301 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:43:18.301 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.302 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.302 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.302 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.302 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.302 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.303 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.303 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.303 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.303 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.304 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.304 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.304 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.304 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.305 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:43:18.305 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.305 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.305 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.306 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.306 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:43:18.306 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.306 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.307 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.307 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.307 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.307 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.308 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.308 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.308 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:43:18.308 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.308 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.309 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.309 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.309 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:43:18.309 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.310 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.310 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.310 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.310 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.311 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.311 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.311 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.311 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:43:18.311 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.312 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.312 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.312 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.312 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:43:18.313 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.313 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.313 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.313 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.314 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.314 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.314 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.314 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.315 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:43:18.315 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.315 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.315 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.316 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.316 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:43:18.316 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:18.316 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.316 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.317 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.317 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:43:18.317 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:43:18.317 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:43:18.318 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:43:18.318 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.318 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.319 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.319 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.319 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.319 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:18.320 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:43:18.320 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.320 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.320 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.321 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.321 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.321 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.321 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.321 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:43:18.322 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.322 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.322 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.323 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:43:18.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.324 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:43:18.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.325 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.325 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.326 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.327 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:43:18.327 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.327 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:43:18.328 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.328 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.329 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.329 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.329 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.329 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.330 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.330 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.330 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:43:18.330 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.331 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.331 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.332 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:43:18.332 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.332 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.332 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.333 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.333 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.333 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.334 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.334 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:43:18.334 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.335 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.335 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.335 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:43:18.335 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:18.336 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.336 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.336 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.336 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:43:18.337 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:43:18.337 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:43:18.337 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:43:18.337 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.338 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.338 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.338 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.338 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.339 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.339 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:18.339 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:43:18.339 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:18.340 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:18.340 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:18.340 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:18.340 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:18.341 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:18.341 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:18.341 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:18.341 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:18.342 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:18.342 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:18.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.343 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.343 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:43:18.343 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:43:18.344 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.345 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.345 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.345 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:18.346 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.346 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.346 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.346 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:43:18.346 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.347 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.347 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:43:18.348 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.348 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.348 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.348 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.349 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:18.349 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.349 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.349 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.350 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:43:18.350 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.350 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.350 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.351 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.351 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:43:18.351 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.351 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.352 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.352 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.352 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:18.352 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:18.352 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.353 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:18.353 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:43:18.353 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.353 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.354 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.354 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:18.354 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:43:18.354 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:18.355 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.355 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.355 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.355 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:43:18.356 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:43:18.356 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:43:18.356 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:43:18.356 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:18.357 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:18.357 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:18.357 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:18.357 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.358 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:18.358 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:43:18.358 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.358 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:18.358 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.359 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.359 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.359 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.359 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.360 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:43:18.360 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.360 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.361 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:18.361 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.361 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.361 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.362 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.362 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.362 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:43:18.362 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.363 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.363 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:18.363 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.364 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.364 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.364 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.364 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.365 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:43:18.365 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.365 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.365 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.365 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:18.366 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.366 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.366 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.366 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.367 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.367 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:43:18.367 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.367 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.368 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.368 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:18.368 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.368 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.369 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.369 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.369 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.369 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:43:18.369 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.370 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.370 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:18.370 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.371 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.371 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.371 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.371 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.372 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:43:18.372 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.372 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.373 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:18.373 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.373 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.373 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.373 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.374 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.374 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:43:18.374 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:18.375 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:18.375 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:18.375 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:18.376 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:18.376 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:18.376 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:18.376 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:43:18.377 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:18.377 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.377 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:18.377 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:43:18.378 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:43:18.378 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:43:18.378 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:43:18.378 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:43:18.378 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:43:18.379 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:43:18.379 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:43:18.379 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:18.380 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:43:18.380 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:43:18.380 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:18.380 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:43:18.380 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:18.381 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:18.381 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:43:18.381 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:43:18.381 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.382 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:43:18.382 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:18.382 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:18.382 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:43:18.383 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:18.383 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:18.383 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:43:18.383 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:18.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:18.384 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:43:18.384 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:43:18.384 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:43:18.385 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:43:18.385 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:43:18.385 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:18.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 msgr2=0x7fd810055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 0x7fd810055b00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd83014b240 tx=0x7fd820007810).stop 2021-11-15T14:43:18.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 msgr2=0x7fd83014d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fd824002f70 tx=0x7fd824015000).stop 2021-11-15T14:43:18.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 shutdown_connections 2021-11-15T14:43:18.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd810053640 0x7fd810055b00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd830147620 0x7fd8300ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8300b25e0 0x7fd83014d720 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 --2- 172.21.2.135:0/3324623900 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8300b19d0 0x7fd8300abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 >> 172.21.2.135:0/3324623900 conn(0x7fd83005caa0 msgr2=0x7fd83005ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 shutdown_connections 2021-11-15T14:43:18.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.124+0000 7fd83694a700 1 -- 172.21.2.135:0/3324623900 wait complete. 2021-11-15T14:43:18.391 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:18.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 Processor -- start 2021-11-15T14:43:18.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- start start 2021-11-15T14:43:18.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 0x7f043c0a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c14ac90 con 0x7f043c0b19d0 2021-11-15T14:43:18.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0b29c0 con 0x7f043c147620 2021-11-15T14:43:18.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a8d40 con 0x7f043c0b25e0 2021-11-15T14:43:18.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f0441b6d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f043c147620 0x7f043c0ab830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51220/0 (socket says 172.21.2.135:51220) 2021-11-15T14:43:18.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f0441b6d700 1 -- 172.21.2.135:0/1397339091 learned_addr learned my addr 172.21.2.135:0/1397339091 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:18.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995846788 0 0) 0x7f043c0b29c0 con 0x7f043c147620 2021-11-15T14:43:18.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0424003260 con 0x7f043c147620 2021-11-15T14:43:18.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 0x7f043c0a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525424216 0 0) 0x7f0424003260 con 0x7f043c147620 2021-11-15T14:43:18.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 msgr2=0x7f043c0a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 0x7f043c0a7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 >> v1:172.21.2.119:6789/0 conn(0x7f043c0b19d0 legacy=0x7f043c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0b0990 con 0x7f043c147620 2021-11-15T14:43:18.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f04340019e0 con 0x7f043c147620 2021-11-15T14:43:18.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 >> v1:172.21.2.135:6789/0 conn(0x7f043c147620 legacy=0x7f043c0ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04240037d0 0x7f0424003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 0x7f0424004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0424004a60 0x7f0424004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a8d40 con 0x7f0424004a60 2021-11-15T14:43:18.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042400b8e0 con 0x7f04240037d0 2021-11-15T14:43:18.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042400baa0 con 0x7f043c0b25e0 2021-11-15T14:43:18.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04240037d0 0x7f0424003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 -- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 msgr2=0x7f0424004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f043c0b25e0 0x7f0424004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 -- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0424004a60 msgr2=0x7f0424004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0424004a60 0x7f0424004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 -- 172.21.2.135:0/1397339091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424003260 con 0x7f04240037d0 2021-11-15T14:43:18.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f044136c700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04240037d0 0x7f0424003bd0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f043800a000 tx=0x7f0438008040).ready entity=mon.1 client_cookie=dc40d0a9d586c18e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0438013670 con 0x7f04240037d0 2021-11-15T14:43:18.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380137d0 con 0x7f04240037d0 2021-11-15T14:43:18.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f042bfff700 1 -- 172.21.2.135:0/1397339091 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0438013b30 con 0x7f04240037d0 2021-11-15T14:43:18.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- 172.21.2.135:0/1397339091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04240037d0 msgr2=0x7f0424003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 --2- 172.21.2.135:0/1397339091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04240037d0 0x7f0424003bd0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f043800a000 tx=0x7f0438008040).stop 2021-11-15T14:43:18.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f0441b6d700 1 -- 172.21.2.135:0/1397339091 reap_dead start 2021-11-15T14:43:18.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- 172.21.2.135:0/1397339091 shutdown_connections 2021-11-15T14:43:18.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- 172.21.2.135:0/1397339091 >> 172.21.2.135:0/1397339091 conn(0x7f043c05caa0 msgr2=0x7f043c05ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- 172.21.2.135:0/1397339091 shutdown_connections 2021-11-15T14:43:18.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- 172.21.2.135:0/1397339091 wait complete. 2021-11-15T14:43:18.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 Processor -- start 2021-11-15T14:43:18.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.444+0000 7f04435d0700 1 -- start start 2021-11-15T14:43:18.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04240037d0 0x7f043c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f043c0a9c00 0x7f043c0aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c147a90 con 0x7f043c0a9c00 2021-11-15T14:43:18.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0adfe0 con 0x7f043c15a5b0 2021-11-15T14:43:18.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0ae280 con 0x7f04240037d0 2021-11-15T14:43:18.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35410/0 (socket says 172.21.2.135:35410) 2021-11-15T14:43:18.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 -- 172.21.2.135:0/1582029784 learned_addr learned my addr 172.21.2.135:0/1582029784 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:18.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 -- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04240037d0 msgr2=0x7f043c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04240037d0 0x7f043c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 -- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f043c0a9c00 msgr2=0x7f043c0aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f043c0a9c00 0x7f043c0aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 -- 172.21.2.135:0/1582029784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c15a110 con 0x7f043c15a5b0 2021-11-15T14:43:18.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f0441b6d700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f04340016f0 tx=0x7f043c0b0b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0434004ab0 con 0x7f043c15a5b0 2021-11-15T14:43:18.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434004c10 con 0x7f043c15a5b0 2021-11-15T14:43:18.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04340070d0 con 0x7f043c15a5b0 2021-11-15T14:43:18.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c143c30 con 0x7f043c15a5b0 2021-11-15T14:43:18.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0b45d0 con 0x7f043c15a5b0 2021-11-15T14:43:18.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c15a2a0 con 0x7f043c15a5b0 2021-11-15T14:43:18.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f043401c070 con 0x7f043c15a5b0 2021-11-15T14:43:18.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 0x7f041c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f043406af10 con 0x7f043c15a5b0 2021-11-15T14:43:18.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f044136c700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 0x7f041c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.448+0000 7f044136c700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 0x7f041c055b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f043800a000 tx=0x7f0438008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.452+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0434041f20 con 0x7f043c15a5b0 2021-11-15T14:43:18.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.556+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f043c0ae440 con 0x7f043c15a5b0 2021-11-15T14:43:18.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.556+0000 7f042a7fc700 1 -- 172.21.2.135:0/1582029784 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f0434045540 con 0x7f043c15a5b0 2021-11-15T14:43:18.563 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:18.563 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:01.226479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8041},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8041":{"gid":8041,"name":"b","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.2.119:6835/2587030449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":2587030449},{"type":"v1","addr":"172.21.2.119:6835","nonce":2587030449}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:18.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 msgr2=0x7f041c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 0x7f041c055b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f043800a000 tx=0x7f0438008040).stop 2021-11-15T14:43:18.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 msgr2=0x7f043c15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f04340016f0 tx=0x7f043c0b0b20).stop 2021-11-15T14:43:18.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 shutdown_connections 2021-11-15T14:43:18.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f041c053640 0x7f041c055b00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f043c15a5b0 0x7f043c15aa60 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f043c0a9c00 0x7f043c0aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 --2- 172.21.2.135:0/1582029784 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04240037d0 0x7f043c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 >> 172.21.2.135:0/1582029784 conn(0x7f043c05caa0 msgr2=0x7f043c144bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 shutdown_connections 2021-11-15T14:43:18.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.560+0000 7f04435d0700 1 -- 172.21.2.135:0/1582029784 wait complete. 2021-11-15T14:43:18.567 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 70 2021-11-15T14:43:18.569 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:43:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 Processor -- start 2021-11-15T14:43:18.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 -- start start 2021-11-15T14:43:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c980a7d80 0x7f9c98147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9814ac90 con 0x7f9c980b25e0 2021-11-15T14:43:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980b29c0 con 0x7f9c980b19d0 2021-11-15T14:43:18.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.616+0000 7f9c9e504700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980a8d40 con 0x7f9c980a7d80 2021-11-15T14:43:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9c980b19d0 0x7f9c980ab830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51240/0 (socket says 172.21.2.135:51240) 2021-11-15T14:43:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 -- 172.21.2.135:0/3750468133 learned_addr learned my addr 172.21.2.135:0/3750468133 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:18.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9caa1700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c980a7d80 0x7f9c98147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280316697 0 0) 0x7f9c980b29c0 con 0x7f9c980b19d0 2021-11-15T14:43:18.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c84003260 con 0x7f9c980b19d0 2021-11-15T14:43:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823551087 0 0) 0x7f9c84003260 con 0x7f9c980b19d0 2021-11-15T14:43:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c980a7d80 msgr2=0x7f9c98147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c980a7d80 0x7f9c98147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 >> v1:172.21.2.119:6789/0 conn(0x7f9c980b25e0 legacy=0x7f9c9814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b0990 con 0x7f9c980b19d0 2021-11-15T14:43:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f9c88001660 con 0x7f9c980b19d0 2021-11-15T14:43:18.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 >> v1:172.21.2.135:6789/0 conn(0x7f9c980b19d0 legacy=0x7f9c980ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c840037d0 0x7f9c84003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c84004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c84004ee0 0x7f9c8400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980a8d40 con 0x7f9c840037d0 2021-11-15T14:43:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8400bd50 con 0x7f9c84004500 2021-11-15T14:43:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8400bf10 con 0x7f9c84004ee0 2021-11-15T14:43:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c84004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 -- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c84004ee0 msgr2=0x7f9c8400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c84004ee0 0x7f9c8400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 -- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c840037d0 msgr2=0x7f9c84003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c840037d0 0x7f9c84003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 -- 172.21.2.135:0/3750468133 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b0990 con 0x7f9c84004500 2021-11-15T14:43:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c84004980 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f9c88001020 tx=0x7f9c88001e20).ready entity=mon.1 client_cookie=6587d87b5d0d34f1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c880070d0 con 0x7f9c84004500 2021-11-15T14:43:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c88007230 con 0x7f9c84004500 2021-11-15T14:43:18.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c96ffd700 1 -- 172.21.2.135:0/3750468133 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8800c990 con 0x7f9c84004500 2021-11-15T14:43:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3750468133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 msgr2=0x7f9c84004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3750468133 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c84004980 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f9c88001020 tx=0x7f9c88001e20).stop 2021-11-15T14:43:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9caa1700 1 -- 172.21.2.135:0/3750468133 reap_dead start 2021-11-15T14:43:18.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3750468133 shutdown_connections 2021-11-15T14:43:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3750468133 >> 172.21.2.135:0/3750468133 conn(0x7f9c9805caa0 msgr2=0x7f9c9805ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3750468133 shutdown_connections 2021-11-15T14:43:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3750468133 wait complete. 2021-11-15T14:43:18.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 Processor -- start 2021-11-15T14:43:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- start start 2021-11-15T14:43:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c98147ee0 0x7f9c98146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c981471c0 0x7f9c98148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c981477a0 con 0x7f9c981471c0 2021-11-15T14:43:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980aeb30 con 0x7f9c84004500 2021-11-15T14:43:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980acb00 con 0x7f9c98147ee0 2021-11-15T14:43:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35430/0 (socket says 172.21.2.135:35430) 2021-11-15T14:43:18.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 -- 172.21.2.135:0/3759929835 learned_addr learned my addr 172.21.2.135:0/3759929835 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:18.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 -- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c98147ee0 msgr2=0x7f9c98146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c98147ee0 0x7f9c98146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 -- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c981471c0 msgr2=0x7f9c98148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c981471c0 0x7f9c98148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 -- 172.21.2.135:0/3759929835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98145a80 con 0x7f9c84004500 2021-11-15T14:43:18.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c97fff700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f9c981475c0 tx=0x7f9c8c007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c00ce70 con 0x7f9c84004500 2021-11-15T14:43:18.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c000e90 con 0x7f9c84004500 2021-11-15T14:43:18.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.620+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980af930 con 0x7f9c84004500 2021-11-15T14:43:18.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c007430 con 0x7f9c84004500 2021-11-15T14:43:18.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98148360 con 0x7f9c84004500 2021-11-15T14:43:18.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9814aec0 con 0x7f9c84004500 2021-11-15T14:43:18.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c8c01a060 con 0x7f9c84004500 2021-11-15T14:43:18.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c957fa700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 0x7f9c78055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9c8c06b260 con 0x7f9c84004500 2021-11-15T14:43:18.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 0x7f9c78055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c977fe700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 0x7f9c78055b90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f9c88001020 tx=0x7f9c88015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.624+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c8c042270 con 0x7f9c84004500 2021-11-15T14:43:18.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.736+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9c981478e0 con 0x7f9c84004500 2021-11-15T14:43:18.844 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:43:18.840+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:43:18.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.856+0000 7f9c957fa700 1 -- 172.21.2.135:0/3759929835 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9c8c018020 con 0x7f9c84004500 2021-11-15T14:43:18.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 msgr2=0x7f9c78055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 0x7f9c78055b90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f9c88001020 tx=0x7f9c88015000).stop 2021-11-15T14:43:18.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 msgr2=0x7f9c98146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f9c981475c0 tx=0x7f9c8c007c30).stop 2021-11-15T14:43:18.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 shutdown_connections 2021-11-15T14:43:18.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9c780536d0 0x7f9c78055b90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9c981471c0 0x7f9c98148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9c98147ee0 0x7f9c98146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 --2- 172.21.2.135:0/3759929835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9c84004500 0x7f9c98146080 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 >> 172.21.2.135:0/3759929835 conn(0x7f9c9805caa0 msgr2=0x7f9c980a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 shutdown_connections 2021-11-15T14:43:18.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.860+0000 7f9c9e504700 1 -- 172.21.2.135:0/3759929835 wait complete. 2021-11-15T14:43:18.866 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:43:18.869 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:18.875 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:43:18.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 Processor -- start 2021-11-15T14:43:18.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- start start 2021-11-15T14:43:18.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b19d0 0x7f9f880a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f9f88147620 0x7f9f880ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8814ac90 con 0x7f9f880b25e0 2021-11-15T14:43:18.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880a8d40 con 0x7f9f88147620 2021-11-15T14:43:18.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88147a90 con 0x7f9f880b19d0 2021-11-15T14:43:18.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f877fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9f880b25e0 0x7f9f8814b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51258/0 (socket says 172.21.2.135:51258) 2021-11-15T14:43:18.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f877fe700 1 -- 172.21.2.135:0/1433629658 learned_addr learned my addr 172.21.2.135:0/1433629658 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:18.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 --2- 172.21.2.135:0/1433629658 >> v2:172.21.2.135:3300/0 conn(0x7f9f88147620 0x7f9f880ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 -- 172.21.2.135:0/1433629658 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b19d0 msgr2=0x7f9f880a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:18.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 --2- 172.21.2.135:0/1433629658 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b19d0 0x7f9f880a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 -- 172.21.2.135:0/1433629658 >> v1:172.21.2.135:6789/0 conn(0x7f9f880b25e0 legacy=0x7f9f8814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 -- 172.21.2.135:0/1433629658 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880b29c0 con 0x7f9f88147620 2021-11-15T14:43:18.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f87fff700 1 --2- 172.21.2.135:0/1433629658 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f88147620 0x7f9f880ab830 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f9f800032f0 tx=0x7f9f800091d0).ready entity=mon.1 client_cookie=be352baeb0bbfde2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f867fc700 1 -- 172.21.2.135:0/1433629658 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f80009ea0 con 0x7f9f88147620 2021-11-15T14:43:18.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f867fc700 1 -- 172.21.2.135:0/1433629658 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000b8a0 con 0x7f9f88147620 2021-11-15T14:43:18.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f867fc700 1 -- 172.21.2.135:0/1433629658 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8000ba10 con 0x7f9f88147620 2021-11-15T14:43:18.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/1433629658 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f88147620 msgr2=0x7f9f880ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/1433629658 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f88147620 0x7f9f880ab830 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f9f800032f0 tx=0x7f9f800091d0).stop 2021-11-15T14:43:18.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/1433629658 shutdown_connections 2021-11-15T14:43:18.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/1433629658 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f88147620 0x7f9f880ab830 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:18.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/1433629658 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b19d0 0x7f9f880a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/1433629658 >> 172.21.2.135:0/1433629658 conn(0x7f9f8805caa0 msgr2=0x7f9f8805ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:18.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/1433629658 shutdown_connections 2021-11-15T14:43:18.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/1433629658 wait complete. 2021-11-15T14:43:18.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 Processor -- start 2021-11-15T14:43:18.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- start start 2021-11-15T14:43:18.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b25e0 0x7f9f881572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f88147620 0x7f9f880b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880aa4a0 con 0x7f9f88147620 2021-11-15T14:43:18.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880a97d0 con 0x7f9f880b19d0 2021-11-15T14:43:18.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f8dfc5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880aa200 con 0x7f9f880b25e0 2021-11-15T14:43:18.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f877fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35444/0 (socket says 172.21.2.135:35444) 2021-11-15T14:43:18.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.924+0000 7f9f877fe700 1 -- 172.21.2.135:0/2427160431 learned_addr learned my addr 172.21.2.135:0/2427160431 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:18.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 -- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b25e0 msgr2=0x7f9f881572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b25e0 0x7f9f881572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 -- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f88147620 msgr2=0x7f9f880b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:18.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f88147620 0x7f9f880b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:18.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 -- 172.21.2.135:0/2427160431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009470 con 0x7f9f880b19d0 2021-11-15T14:43:18.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f877fe700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f9f8814b240 tx=0x7f9f78007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7800ce30 con 0x7f9f880b19d0 2021-11-15T14:43:18.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f780072e0 con 0x7f9f880b19d0 2021-11-15T14:43:18.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f880b42d0 con 0x7f9f880b19d0 2021-11-15T14:43:18.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f78005800 con 0x7f9f880b19d0 2021-11-15T14:43:18.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f881577c0 con 0x7f9f880b19d0 2021-11-15T14:43:18.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f880b0990 con 0x7f9f880b19d0 2021-11-15T14:43:18.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f78010070 con 0x7f9f880b19d0 2021-11-15T14:43:18.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 0x7f9f6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:18.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f9f7806b100 con 0x7f9f880b19d0 2021-11-15T14:43:18.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f86ffd700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 0x7f9f6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:18.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.928+0000 7f9f86ffd700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 0x7f9f6c055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f9f70002f70 tx=0x7f9f70006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:18.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:18.932+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f780420b0 con 0x7f9f880b19d0 2021-11-15T14:43:19.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.040+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f880573d0 con 0x7f9f880b19d0 2021-11-15T14:43:19.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.040+0000 7f9f84ff9700 1 -- 172.21.2.135:0/2427160431 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f9f78018070 con 0x7f9f880b19d0 2021-11-15T14:43:19.045 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:19.046 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":71,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:00.221722+0000","modified":"2021-11-15T14:43:18.843564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":145,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-15T14:43:19.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 msgr2=0x7f9f6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 0x7f9f6c055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f9f70002f70 tx=0x7f9f70006a80).stop 2021-11-15T14:43:19.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 msgr2=0x7f9f8814a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f9f8814b240 tx=0x7f9f78007c40).stop 2021-11-15T14:43:19.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 shutdown_connections 2021-11-15T14:43:19.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f9f6c053580 0x7f9f6c055a40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9f88147620 0x7f9f880b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9f880b25e0 0x7f9f881572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 --2- 172.21.2.135:0/2427160431 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f9f880b19d0 0x7f9f8814a370 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 >> 172.21.2.135:0/2427160431 conn(0x7f9f8805caa0 msgr2=0x7f9f88143a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:19.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 shutdown_connections 2021-11-15T14:43:19.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.044+0000 7f9f8dfc5700 1 -- 172.21.2.135:0/2427160431 wait complete. 2021-11-15T14:43:19.050 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 71 2021-11-15T14:43:19.053 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:43:19.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 Processor -- start 2021-11-15T14:43:19.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 -- start start 2021-11-15T14:43:19.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2e7c0b25e0 0x7f2e7c0a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f2e7c147620 0x7f2e7c0ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c14ac90 con 0x7f2e7c0b19d0 2021-11-15T14:43:19.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0a8d40 con 0x7f2e7c147620 2021-11-15T14:43:19.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e82bcc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c147a50 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7bfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2e7c0b19d0 0x7f2e7c14b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51272/0 (socket says 172.21.2.135:51272) 2021-11-15T14:43:19.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7bfff700 1 -- 172.21.2.135:0/3147547374 learned_addr learned my addr 172.21.2.135:0/3147547374 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:19.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 --2- 172.21.2.135:0/3147547374 >> v2:172.21.2.135:3300/0 conn(0x7f2e7c0b25e0 0x7f2e7c0a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7b7fe700 1 -- 172.21.2.135:0/3147547374 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222169933 0 0) 0x7f2e7c14ac90 con 0x7f2e7c0b19d0 2021-11-15T14:43:19.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7b7fe700 1 -- 172.21.2.135:0/3147547374 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e68003260 con 0x7f2e7c0b19d0 2021-11-15T14:43:19.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e81169700 1 --2- 172.21.2.135:0/3147547374 >> v2:172.21.2.119:3300/0 conn(0x7f2e7c147620 0x7f2e7c0ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 -- 172.21.2.135:0/3147547374 >> v2:172.21.2.119:3300/0 conn(0x7f2e7c147620 msgr2=0x7f2e7c0ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:19.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 --2- 172.21.2.135:0/3147547374 >> v2:172.21.2.119:3300/0 conn(0x7f2e7c147620 0x7f2e7c0ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 -- 172.21.2.135:0/3147547374 >> v1:172.21.2.135:6789/0 conn(0x7f2e7c0b19d0 legacy=0x7f2e7c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 -- 172.21.2.135:0/3147547374 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0b29c0 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e80968700 1 --2- 172.21.2.135:0/3147547374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c0b25e0 0x7f2e7c0a7d80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f2e6c002f70 tx=0x7f2e6c006df0).ready entity=mon.1 client_cookie=a68edb953fab701b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7b7fe700 1 -- 172.21.2.135:0/3147547374 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e6c00d570 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7b7fe700 1 -- 172.21.2.135:0/3147547374 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c000e90 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.100+0000 7f2e7b7fe700 1 -- 172.21.2.135:0/3147547374 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e6c00d8c0 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/3147547374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c0b25e0 msgr2=0x7f2e7c0a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/3147547374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c0b25e0 0x7f2e7c0a7d80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f2e6c002f70 tx=0x7f2e6c006df0).stop 2021-11-15T14:43:19.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/3147547374 shutdown_connections 2021-11-15T14:43:19.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/3147547374 >> v2:172.21.2.119:3300/0 conn(0x7f2e7c147620 0x7f2e7c0ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/3147547374 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c0b25e0 0x7f2e7c0a7d80 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/3147547374 >> 172.21.2.135:0/3147547374 conn(0x7f2e7c05caa0 msgr2=0x7f2e7c05ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:19.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/3147547374 shutdown_connections 2021-11-15T14:43:19.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/3147547374 wait complete. 2021-11-15T14:43:19.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 Processor -- start 2021-11-15T14:43:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- start start 2021-11-15T14:43:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e7c0b19d0 0x7f2e7c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2e7c0b25e0 0x7f2e7c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0aeea0 con 0x7f2e7c0b19d0 2021-11-15T14:43:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0b5c70 con 0x7f2e7c147620 2021-11-15T14:43:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0af3a0 con 0x7f2e7c0b25e0 2021-11-15T14:43:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35460/0 (socket says 172.21.2.135:35460) 2021-11-15T14:43:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 -- 172.21.2.135:0/834479477 learned_addr learned my addr 172.21.2.135:0/834479477 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 -- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2e7c0b25e0 msgr2=0x7f2e7c0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2e7c0b25e0 0x7f2e7c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 -- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e7c0b19d0 msgr2=0x7f2e7c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e7c0b19d0 0x7f2e7c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 -- 172.21.2.135:0/834479477 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c00b180 con 0x7f2e7c147620 2021-11-15T14:43:19.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e81169700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f2e74007000 tx=0x7f2e74008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e74010580 con 0x7f2e7c147620 2021-11-15T14:43:19.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740106e0 con 0x7f2e7c147620 2021-11-15T14:43:19.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c0af100 con 0x7f2e7c147620 2021-11-15T14:43:19.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e74010a40 con 0x7f2e7c147620 2021-11-15T14:43:19.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0ae6e0 con 0x7f2e7c147620 2021-11-15T14:43:19.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0b5de0 con 0x7f2e7c147620 2021-11-15T14:43:19.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e74010ba0 con 0x7f2e7c147620 2021-11-15T14:43:19.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.104+0000 7f2e79ffb700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 0x7f2e5c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.108+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f2e7406be80 con 0x7f2e7c147620 2021-11-15T14:43:19.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.108+0000 7f2e80968700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 0x7f2e5c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.108+0000 7f2e80968700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 0x7f2e5c0559e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f2e6c002f70 tx=0x7f2e6c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.108+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e74042e30 con 0x7f2e7c147620 2021-11-15T14:43:19.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.216+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e7c14aec0 con 0x7f2e7c147620 2021-11-15T14:43:19.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.860+0000 7f2e79ffb700 1 -- 172.21.2.135:0/834479477 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e74046450 con 0x7f2e7c147620 2021-11-15T14:43:19.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 msgr2=0x7f2e5c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 0x7f2e5c0559e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f2e6c002f70 tx=0x7f2e6c014000).stop 2021-11-15T14:43:19.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 msgr2=0x7f2e7c0af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f2e74007000 tx=0x7f2e74008040).stop 2021-11-15T14:43:19.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 shutdown_connections 2021-11-15T14:43:19.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2e5c053520 0x7f2e5c0559e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2e7c147620 0x7f2e7c0af590 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2e7c0b25e0 0x7f2e7c0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 --2- 172.21.2.135:0/834479477 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2e7c0b19d0 0x7f2e7c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 >> 172.21.2.135:0/834479477 conn(0x7f2e7c05caa0 msgr2=0x7f2e7c148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:19.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 shutdown_connections 2021-11-15T14:43:19.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.864+0000 7f2e82bcc700 1 -- 172.21.2.135:0/834479477 wait complete. 2021-11-15T14:43:19.873 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:43:19.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 Processor -- start 2021-11-15T14:43:19.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 -- start start 2021-11-15T14:43:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbaac0955d0 0x7fbaac097480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac143820 con 0x7fbaac0b56c0 2021-11-15T14:43:19.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac143ac0 con 0x7fbaac142fe0 2021-11-15T14:43:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbab1965700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac0b4dc0 con 0x7fbaac0955d0 2021-11-15T14:43:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaaaffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fbaac142fe0 0x7fbaac096d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51286/0 (socket says 172.21.2.135:51286) 2021-11-15T14:43:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaaaffd700 1 -- 172.21.2.135:0/4017160855 learned_addr learned my addr 172.21.2.135:0/4017160855 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:19.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaab7fe700 1 --2- 172.21.2.135:0/4017160855 >> v2:172.21.2.119:3300/0 conn(0x7fbaac0955d0 0x7fbaac097480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84375770 0 0) 0x7fbaac143ac0 con 0x7fbaac142fe0 2021-11-15T14:43:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba90003260 con 0x7fbaac142fe0 2021-11-15T14:43:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1177342118 0 0) 0x7fba90003260 con 0x7fbaac142fe0 2021-11-15T14:43:19.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 >> v2:172.21.2.119:3300/0 conn(0x7fbaac0955d0 msgr2=0x7fbaac097480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 --2- 172.21.2.135:0/4017160855 >> v2:172.21.2.119:3300/0 conn(0x7fbaac0955d0 0x7fbaac097480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 >> v1:172.21.2.119:6789/0 conn(0x7fbaac0b56c0 legacy=0x7fbaac13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0b4920 con 0x7fbaac142fe0 2021-11-15T14:43:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fba9c001660 con 0x7fbaac142fe0 2021-11-15T14:43:19.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 >> v1:172.21.2.135:6789/0 conn(0x7fbaac142fe0 legacy=0x7fbaac096d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fba90003750 0x7fba90003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 0x7fba90004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004e70 0x7fba9000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9000bcf0 con 0x7fba90003750 2021-11-15T14:43:19.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9000be60 con 0x7fba90004500 2021-11-15T14:43:19.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9000c020 con 0x7fba90004e70 2021-11-15T14:43:19.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.924+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 0x7fba90004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004e70 msgr2=0x7fba9000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004e70 0x7fba9000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fba90003750 msgr2=0x7fba90003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fba90003750 0x7fba90003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/4017160855 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90003260 con 0x7fba90004500 2021-11-15T14:43:19.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaab7fe700 1 -- 172.21.2.135:0/4017160855 reap_dead start 2021-11-15T14:43:19.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 0x7fba90004980 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fbaac096a90 tx=0x7fbaa0007a00).ready entity=mon.1 client_cookie=402c7aff4fcd5322 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa0007030 con 0x7fba90004500 2021-11-15T14:43:19.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0007190 con 0x7fba90004500 2021-11-15T14:43:19.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaa9ffb700 1 -- 172.21.2.135:0/4017160855 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa0006510 con 0x7fba90004500 2021-11-15T14:43:19.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 msgr2=0x7fba90004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 0x7fba90004980 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fbaac096a90 tx=0x7fbaa0007a00).stop 2021-11-15T14:43:19.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/4017160855 shutdown_connections 2021-11-15T14:43:19.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 --2- 172.21.2.135:0/4017160855 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fba90004500 0x7fba90004980 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/4017160855 >> 172.21.2.135:0/4017160855 conn(0x7fbaac05c650 msgr2=0x7fbaac05ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:19.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/4017160855 shutdown_connections 2021-11-15T14:43:19.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/4017160855 wait complete. 2021-11-15T14:43:19.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 Processor -- start 2021-11-15T14:43:19.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- start start 2021-11-15T14:43:19.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 0x7fbaac13faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbaac0ad870 0x7fbaac0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac13ebf0 con 0x7fbaac0ad870 2021-11-15T14:43:19.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0a9180 con 0x7fbaac13ffe0 2021-11-15T14:43:19.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac140460 con 0x7fba90004500 2021-11-15T14:43:19.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35480/0 (socket says 172.21.2.135:35480) 2021-11-15T14:43:19.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/3643248526 learned_addr learned my addr 172.21.2.135:0/3643248526 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:19.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaaffd700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 0x7fbaac13faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 msgr2=0x7fbaac13faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 0x7fbaac13faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:19.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbaac0ad870 msgr2=0x7fbaac0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:19.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbaac0ad870 0x7fbaac0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:19.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 -- 172.21.2.135:0/3643248526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0afd90 con 0x7fbaac13ffe0 2021-11-15T14:43:19.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaaffd700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 0x7fbaac13faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:19.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbaaa7fc700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fbaac096a90 tx=0x7fbaa0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa00127b0 con 0x7fbaac13ffe0 2021-11-15T14:43:19.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0007450 con 0x7fbaac13ffe0 2021-11-15T14:43:19.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac0a93b0 con 0x7fbaac13ffe0 2021-11-15T14:43:19.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaa0012b00 con 0x7fbaac13ffe0 2021-11-15T14:43:19.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac0afab0 con 0x7fbaac13ffe0 2021-11-15T14:43:19.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac0b4640 con 0x7fbaac13ffe0 2021-11-15T14:43:19.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.928+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbaa0010070 con 0x7fbaac13ffe0 2021-11-15T14:43:19.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.932+0000 7fba9bfff700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 0x7fba88055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:19.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.932+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fbaa006ca40 con 0x7fbaac13ffe0 2021-11-15T14:43:19.950 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.932+0000 7fbaaaffd700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 0x7fba88055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:19.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.932+0000 7fbaaaffd700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 0x7fba88055b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fba9c008000 tx=0x7fba9c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:19.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:19.932+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbaa00439f0 con 0x7fbaac13ffe0 2021-11-15T14:43:20.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.016+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbaac0573d0 con 0x7fbaac13ffe0 2021-11-15T14:43:20.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fba9bfff700 1 -- 172.21.2.135:0/3643248526 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbaa0025070 con 0x7fbaac13ffe0 2021-11-15T14:43:20.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 msgr2=0x7fba88055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:20.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 0x7fba88055b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fba9c008000 tx=0x7fba9c009040).stop 2021-11-15T14:43:20.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 msgr2=0x7fbaac0ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:20.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fbaac096a90 tx=0x7fbaa0015000).stop 2021-11-15T14:43:20.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 shutdown_connections 2021-11-15T14:43:20.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fba880536a0 0x7fba88055b60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:20.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbaac0ad870 0x7fbaac0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbaac13ffe0 0x7fbaac0ad380 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:20.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 --2- 172.21.2.135:0/3643248526 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fba90004500 0x7fbaac13faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:20.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 >> 172.21.2.135:0/3643248526 conn(0x7fbaac05c650 msgr2=0x7fbaac141af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:20.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 shutdown_connections 2021-11-15T14:43:20.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.864+0000 7fbab1965700 1 -- 172.21.2.135:0/3643248526 wait complete. 2021-11-15T14:43:20.872 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:43:20.876 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:43:20.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 Processor -- start 2021-11-15T14:43:20.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- start start 2021-11-15T14:43:20.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f3784096730 0x7f37840611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3784096b10 0x7f37840b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37840b1cf0 0x7f378405ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378405c140 con 0x7f3784096730 2021-11-15T14:43:20.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784148490 con 0x7f3784096b10 2021-11-15T14:43:20.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840b2180 con 0x7f37840b1cf0 2021-11-15T14:43:20.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3784096b10 0x7f37840b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:20.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3784096b10 0x7f37840b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35488/0 (socket says 172.21.2.135:35488) 2021-11-15T14:43:20.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 -- 172.21.2.135:0/3722131025 learned_addr learned my addr 172.21.2.135:0/3722131025 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:20.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 -- 172.21.2.135:0/3722131025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37840b1cf0 msgr2=0x7f378405ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:20.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 --2- 172.21.2.135:0/3722131025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37840b1cf0 0x7f378405ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 -- 172.21.2.135:0/3722131025 >> v2:172.21.2.119:3300/0 conn(0x7f3784096730 msgr2=0x7f37840611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:20.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 --2- 172.21.2.135:0/3722131025 >> v2:172.21.2.119:3300/0 conn(0x7f3784096730 0x7f37840611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 -- 172.21.2.135:0/3722131025 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784098660 con 0x7f3784096b10 2021-11-15T14:43:20.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f3789b7d700 1 --2- 172.21.2.135:0/3722131025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3784096b10 0x7f37840b1800 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f3774002f70 tx=0x7f3774006eb0).ready entity=mon.1 client_cookie=c7237bd138a11a2b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378937c700 1 -- 172.21.2.135:0/3722131025 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377400d570 con 0x7f3784096b10 2021-11-15T14:43:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378937c700 1 -- 172.21.2.135:0/3722131025 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774000e90 con 0x7f3784096b10 2021-11-15T14:43:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378937c700 1 -- 172.21.2.135:0/3722131025 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377400d900 con 0x7f3784096b10 2021-11-15T14:43:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- 172.21.2.135:0/3722131025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3784096b10 msgr2=0x7f37840b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:20.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3722131025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3784096b10 0x7f37840b1800 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f3774002f70 tx=0x7f3774006eb0).stop 2021-11-15T14:43:20.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- 172.21.2.135:0/3722131025 shutdown_connections 2021-11-15T14:43:20.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3722131025 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37840b1cf0 0x7f378405ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3722131025 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3784096b10 0x7f37840b1800 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:20.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3722131025 >> v2:172.21.2.119:3300/0 conn(0x7f3784096730 0x7f37840611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- 172.21.2.135:0/3722131025 >> 172.21.2.135:0/3722131025 conn(0x7f37840b5e50 msgr2=0x7f37840b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- 172.21.2.135:0/3722131025 shutdown_connections 2021-11-15T14:43:20.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- 172.21.2.135:0/3722131025 wait complete. 2021-11-15T14:43:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 Processor -- start 2021-11-15T14:43:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.928+0000 7f378c5e2700 1 -- start start 2021-11-15T14:43:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3784096730 0x7f3784146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3784096b10 0x7f3784157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840add10 con 0x7f3784096730 2021-11-15T14:43:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378409a300 con 0x7f37840b1cf0 2021-11-15T14:43:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840ad1a0 con 0x7f3784096b10 2021-11-15T14:43:20.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35494/0 (socket says 172.21.2.135:35494) 2021-11-15T14:43:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 -- 172.21.2.135:0/3905799809 learned_addr learned my addr 172.21.2.135:0/3905799809 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 -- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3784096b10 msgr2=0x7f3784157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3784096b10 0x7f3784157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 -- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3784096730 msgr2=0x7f3784146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3784096730 0x7f3784146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 -- 172.21.2.135:0/3905799809 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377400b1e0 con 0x7f37840b1cf0 2021-11-15T14:43:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378ab7f700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f377c0032f0 tx=0x7f377c009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377c00d4a0 con 0x7f37840b1cf0 2021-11-15T14:43:20.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00d600 con 0x7f37840b1cf0 2021-11-15T14:43:20.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f377c00d960 con 0x7f37840b1cf0 2021-11-15T14:43:20.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378409a530 con 0x7f37840b1cf0 2021-11-15T14:43:20.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37840afaf0 con 0x7f37840b1cf0 2021-11-15T14:43:20.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3784098900 con 0x7f37840b1cf0 2021-11-15T14:43:20.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f377c018030 con 0x7f37840b1cf0 2021-11-15T14:43:20.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 0x7f37640559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:20.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f377c06b340 con 0x7f37840b1cf0 2021-11-15T14:43:20.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378a37e700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 0x7f37640559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:20.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.932+0000 7f378a37e700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 0x7f37640559b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f3780002f70 tx=0x7f3780006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:20.947 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:20.936+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f377c042450 con 0x7f37840b1cf0 2021-11-15T14:43:21.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.016+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37840573d0 con 0x7f37840b1cf0 2021-11-15T14:43:21.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f37737fe700 1 -- 172.21.2.135:0/3905799809 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) v1 ==== 173+0+0 (secure 0 0 0) 0x7f377c045a70 con 0x7f37840b1cf0 2021-11-15T14:43:21.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 msgr2=0x7f37640559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 0x7f37640559b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f3780002f70 tx=0x7f3780006a80).stop 2021-11-15T14:43:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 msgr2=0x7f3784157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f377c0032f0 tx=0x7f377c009120).stop 2021-11-15T14:43:21.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 shutdown_connections 2021-11-15T14:43:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f37640534f0 0x7f37640559b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f37840b1cf0 0x7f3784157650 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3784096b10 0x7f3784157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:21.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 --2- 172.21.2.135:0/3905799809 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3784096730 0x7f3784146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 >> 172.21.2.135:0/3905799809 conn(0x7f37840b5e50 msgr2=0x7f37840b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 shutdown_connections 2021-11-15T14:43:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:21.876+0000 7f378c5e2700 1 -- 172.21.2.135:0/3905799809 wait complete. 2021-11-15T14:43:21.887 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:43:21.889 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:21.892 DEBUG:teuthology.orchestra.run.gibba032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:21.895 DEBUG:teuthology.orchestra.run.gibba035:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:21.898 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-15T14:43:21.903 INFO:teuthology.orchestra.run.gibba019.stdout:[global] 2021-11-15T14:43:21.903 INFO:teuthology.orchestra.run.gibba019.stdout: chdir = "" 2021-11-15T14:43:21.904 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:21.904 INFO:teuthology.orchestra.run.gibba019.stdout: auth supported = cephx 2021-11-15T14:43:21.904 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.904 INFO:teuthology.orchestra.run.gibba019.stdout: filestore xattr use omap = true 2021-11-15T14:43:21.905 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.905 INFO:teuthology.orchestra.run.gibba019.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:21.905 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.905 INFO:teuthology.orchestra.run.gibba019.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:21.905 INFO:teuthology.orchestra.run.gibba019.stdout: auth debug = true 2021-11-15T14:43:21.906 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.906 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on old message = true 2021-11-15T14:43:21.906 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on bug = true 2021-11-15T14:43:21.906 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.907 INFO:teuthology.orchestra.run.gibba019.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:21.907 INFO:teuthology.orchestra.run.gibba019.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:21.907 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.907 INFO:teuthology.orchestra.run.gibba019.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:21.907 INFO:teuthology.orchestra.run.gibba019.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:21.908 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.908 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default size = 2 2021-11-15T14:43:21.908 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.908 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:21.908 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow pg remap = true 2021-11-15T14:43:21.909 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:21.909 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:21.909 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:21.909 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:21.909 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on too few osds = false 2021-11-15T14:43:21.910 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:21.910 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:21.910 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.910 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:21.911 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.911 INFO:teuthology.orchestra.run.gibba019.stdout: osd default data pool replay window = 5 2021-11-15T14:43:21.911 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.911 INFO:teuthology.orchestra.run.gibba019.stdout: mon allow pool delete = true 2021-11-15T14:43:21.911 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.912 INFO:teuthology.orchestra.run.gibba019.stdout: mon cluster log file level = debug 2021-11-15T14:43:21.912 INFO:teuthology.orchestra.run.gibba019.stdout: debug asserts on shutdown = true 2021-11-15T14:43:21.912 INFO:teuthology.orchestra.run.gibba019.stdout: mon health detail to clog = false 2021-11-15T14:43:21.912 INFO:teuthology.orchestra.run.gibba019.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:21.912 INFO:teuthology.orchestra.run.gibba019.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:21.913 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.913 INFO:teuthology.orchestra.run.gibba019.stdout:[osd] 2021-11-15T14:43:21.913 INFO:teuthology.orchestra.run.gibba019.stdout: osd journal size = 100 2021-11-15T14:43:21.913 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.914 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:21.914 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub max interval = 600 2021-11-15T14:43:21.914 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.914 INFO:teuthology.orchestra.run.gibba019.stdout: osd recover clone overlap = true 2021-11-15T14:43:21.914 INFO:teuthology.orchestra.run.gibba019.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:21.915 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.915 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug shutdown = true 2021-11-15T14:43:21.915 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug op order = true 2021-11-15T14:43:21.915 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:21.915 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.916 INFO:teuthology.orchestra.run.gibba019.stdout: osd open classes on start = true 2021-11-15T14:43:21.916 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug pg log writeout = true 2021-11-15T14:43:21.916 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.916 INFO:teuthology.orchestra.run.gibba019.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:21.917 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.917 INFO:teuthology.orchestra.run.gibba019.stdout: osd map max advance = 10 2021-11-15T14:43:21.917 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.917 INFO:teuthology.orchestra.run.gibba019.stdout: journal zero on create = true 2021-11-15T14:43:21.917 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.918 INFO:teuthology.orchestra.run.gibba019.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:21.918 INFO:teuthology.orchestra.run.gibba019.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:21.918 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.918 INFO:teuthology.orchestra.run.gibba019.stdout: bdev debug aio = true 2021-11-15T14:43:21.918 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug misdirected ops = true 2021-11-15T14:43:21.919 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore block size = 96636764160 2021-11-15T14:43:21.919 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:21.919 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore fsck on mount = True 2021-11-15T14:43:21.919 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluefs = 20 2021-11-15T14:43:21.920 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluestore = 20 2021-11-15T14:43:21.920 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:21.920 INFO:teuthology.orchestra.run.gibba019.stdout: debug osd = 20 2021-11-15T14:43:21.920 INFO:teuthology.orchestra.run.gibba019.stdout: debug rocksdb = 10 2021-11-15T14:43:21.921 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:21.921 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:21.921 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:21.921 INFO:teuthology.orchestra.run.gibba019.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:21.922 INFO:teuthology.orchestra.run.gibba019.stdout: osd objectstore = bluestore 2021-11-15T14:43:21.922 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:43:21.922 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.922 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr] 2021-11-15T14:43:21.922 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:21.923 INFO:teuthology.orchestra.run.gibba019.stdout: debug mgr = 20 2021-11-15T14:43:21.923 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:43:21.923 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:43:21.923 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.924 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.924 INFO:teuthology.orchestra.run.gibba019.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:21.924 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.924 INFO:teuthology.orchestra.run.gibba019.stdout:[mon] 2021-11-15T14:43:21.924 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:21.925 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-15T14:43:21.925 INFO:teuthology.orchestra.run.gibba019.stdout: debug paxos = 20 2021-11-15T14:43:21.925 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-15T14:43:21.925 INFO:teuthology.orchestra.run.gibba019.stdout: mon data avail warn = 5 2021-11-15T14:43:21.925 INFO:teuthology.orchestra.run.gibba019.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:21.926 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.926 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:21.926 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd prime pg temp = true 2021-11-15T14:43:21.926 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.927 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.927 INFO:teuthology.orchestra.run.gibba019.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:21.927 INFO:teuthology.orchestra.run.gibba019.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:21.927 INFO:teuthology.orchestra.run.gibba019.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:21.927 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.928 INFO:teuthology.orchestra.run.gibba019.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:21.928 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:21.928 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:21.928 INFO:teuthology.orchestra.run.gibba019.stdout: mon op complaint time = 120 2021-11-15T14:43:21.929 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-15T14:43:21.929 INFO:teuthology.orchestra.run.gibba019.stdout:[client] 2021-11-15T14:43:21.929 INFO:teuthology.orchestra.run.gibba019.stdout: rgw cache enabled = true 2021-11-15T14:43:21.929 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable ops log = true 2021-11-15T14:43:21.929 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable usage log = true 2021-11-15T14:43:21.930 INFO:teuthology.orchestra.run.gibba019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:21.930 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:21.930 INFO:teuthology.orchestra.run.gibba019.stdout: client mount timeout = 600 2021-11-15T14:43:21.930 INFO:teuthology.orchestra.run.gibba019.stdout: debug client = 20 2021-11-15T14:43:21.930 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:21.931 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:43:21.931 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:43:21.931 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.a] 2021-11-15T14:43:21.931 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.b] 2021-11-15T14:43:21.931 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.c] 2021-11-15T14:43:21.932 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.a] 2021-11-15T14:43:21.932 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.c] 2021-11-15T14:43:21.932 INFO:teuthology.orchestra.run.gibba019.stdout:[mds.b] 2021-11-15T14:43:21.932 INFO:teuthology.orchestra.run.gibba019.stdout:[mds] 2021-11-15T14:43:21.933 INFO:teuthology.orchestra.run.gibba019.stdout: debug mds = 20 2021-11-15T14:43:21.933 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-15T14:43:21.933 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal frag = True 2021-11-15T14:43:21.933 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:21.933 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal merge size = 5 2021-11-15T14:43:21.934 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split bits = 3 2021-11-15T14:43:21.934 INFO:teuthology.orchestra.run.gibba019.stdout: mds bal split size = 100 2021-11-15T14:43:21.934 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug frag = True 2021-11-15T14:43:21.934 INFO:teuthology.orchestra.run.gibba019.stdout: mds debug scatterstat = True 2021-11-15T14:43:21.934 INFO:teuthology.orchestra.run.gibba019.stdout: mds op complaint time = 180 2021-11-15T14:43:21.935 INFO:teuthology.orchestra.run.gibba019.stdout: mds verify scatter = True 2021-11-15T14:43:21.935 INFO:teuthology.orchestra.run.gibba019.stdout: osd op complaint time = 180 2021-11-15T14:43:21.935 INFO:teuthology.orchestra.run.gibba019.stdout: rados mon op timeout = 15m 2021-11-15T14:43:21.935 INFO:teuthology.orchestra.run.gibba019.stdout: rados osd op timeout = 15m 2021-11-15T14:43:21.938 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-15T14:43:21.939 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-15T14:43:21.939 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:21.939 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-15T14:43:21.939 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.940 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-15T14:43:21.940 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.940 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:21.940 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.940 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:21.941 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-15T14:43:21.941 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.941 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-15T14:43:21.941 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-15T14:43:21.941 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.942 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:21.942 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:21.942 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.942 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:21.943 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:21.943 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.943 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-15T14:43:21.943 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.943 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:21.944 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-15T14:43:21.944 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:21.944 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:21.944 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:21.945 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:21.945 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-15T14:43:21.945 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:21.945 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:21.945 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.946 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:21.946 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.946 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-15T14:43:21.946 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.947 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-15T14:43:21.947 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.947 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-15T14:43:21.947 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-15T14:43:21.947 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-15T14:43:21.948 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:21.948 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:21.948 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.948 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-15T14:43:21.949 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-15T14:43:21.949 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.949 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:21.949 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-15T14:43:21.949 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.950 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-15T14:43:21.950 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:21.950 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.950 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-15T14:43:21.951 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-15T14:43:21.951 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:21.951 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.951 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-15T14:43:21.951 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-15T14:43:21.952 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.952 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:21.952 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.952 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-15T14:43:21.952 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.953 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-15T14:43:21.953 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.953 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:21.953 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:21.954 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.954 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-15T14:43:21.954 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-15T14:43:21.954 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-15T14:43:21.954 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:21.955 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-15T14:43:21.955 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-15T14:43:21.955 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-15T14:43:21.955 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:21.955 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-15T14:43:21.956 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-15T14:43:21.956 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:21.956 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:21.956 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:21.957 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:21.957 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-15T14:43:21.957 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:43:21.957 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.957 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-15T14:43:21.958 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:21.958 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-15T14:43:21.958 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:43:21.958 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:43:21.959 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.959 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.959 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:21.959 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.959 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-15T14:43:21.960 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:21.960 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-15T14:43:21.960 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-15T14:43:21.960 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-15T14:43:21.960 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-15T14:43:21.961 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:21.961 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.961 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:21.961 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-15T14:43:21.961 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.962 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.962 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:21.962 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:21.962 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:21.963 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.963 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:21.963 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:21.963 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:21.963 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-15T14:43:21.964 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-15T14:43:21.964 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-15T14:43:21.964 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-15T14:43:21.964 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-15T14:43:21.965 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-15T14:43:21.965 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:21.965 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:21.965 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-15T14:43:21.965 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-15T14:43:21.966 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:21.966 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:43:21.966 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:43:21.966 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-15T14:43:21.966 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-15T14:43:21.967 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-15T14:43:21.967 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-15T14:43:21.967 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.c] 2021-11-15T14:43:21.967 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-15T14:43:21.967 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-15T14:43:21.968 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-15T14:43:21.968 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-15T14:43:21.968 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-15T14:43:21.968 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:21.969 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-15T14:43:21.969 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-15T14:43:21.969 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-15T14:43:21.969 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-15T14:43:21.969 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-15T14:43:21.970 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-15T14:43:21.970 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-15T14:43:21.970 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-15T14:43:21.970 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-15T14:43:21.970 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-15T14:43:21.971 INFO:teuthology.orchestra.run.gibba032.stdout:[global] 2021-11-15T14:43:21.971 INFO:teuthology.orchestra.run.gibba032.stdout: chdir = "" 2021-11-15T14:43:21.971 INFO:teuthology.orchestra.run.gibba032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:21.971 INFO:teuthology.orchestra.run.gibba032.stdout: auth supported = cephx 2021-11-15T14:43:21.972 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.972 INFO:teuthology.orchestra.run.gibba032.stdout: filestore xattr use omap = true 2021-11-15T14:43:21.972 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.972 INFO:teuthology.orchestra.run.gibba032.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:21.972 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.973 INFO:teuthology.orchestra.run.gibba032.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:21.973 INFO:teuthology.orchestra.run.gibba032.stdout: auth debug = true 2021-11-15T14:43:21.973 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.973 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on old message = true 2021-11-15T14:43:21.973 INFO:teuthology.orchestra.run.gibba032.stdout: ms die on bug = true 2021-11-15T14:43:21.974 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.974 INFO:teuthology.orchestra.run.gibba032.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:21.974 INFO:teuthology.orchestra.run.gibba032.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:21.974 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.975 INFO:teuthology.orchestra.run.gibba032.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:21.975 INFO:teuthology.orchestra.run.gibba032.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:21.975 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.975 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default size = 2 2021-11-15T14:43:21.975 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.976 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:21.976 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd allow pg remap = true 2021-11-15T14:43:21.976 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:21.976 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:21.976 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:21.977 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:21.977 INFO:teuthology.orchestra.run.gibba032.stdout: mon warn on too few osds = false 2021-11-15T14:43:21.977 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:21.977 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:21.978 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.978 INFO:teuthology.orchestra.run.gibba032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:21.978 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.978 INFO:teuthology.orchestra.run.gibba032.stdout: osd default data pool replay window = 5 2021-11-15T14:43:21.978 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.979 INFO:teuthology.orchestra.run.gibba032.stdout: mon allow pool delete = true 2021-11-15T14:43:21.979 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.979 INFO:teuthology.orchestra.run.gibba032.stdout: mon cluster log file level = debug 2021-11-15T14:43:21.979 INFO:teuthology.orchestra.run.gibba032.stdout: debug asserts on shutdown = true 2021-11-15T14:43:21.979 INFO:teuthology.orchestra.run.gibba032.stdout: mon health detail to clog = false 2021-11-15T14:43:21.980 INFO:teuthology.orchestra.run.gibba032.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:21.980 INFO:teuthology.orchestra.run.gibba032.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:21.980 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.980 INFO:teuthology.orchestra.run.gibba032.stdout:[osd] 2021-11-15T14:43:21.981 INFO:teuthology.orchestra.run.gibba032.stdout: osd journal size = 100 2021-11-15T14:43:21.981 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.981 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:21.981 INFO:teuthology.orchestra.run.gibba032.stdout: osd scrub max interval = 600 2021-11-15T14:43:21.981 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.982 INFO:teuthology.orchestra.run.gibba032.stdout: osd recover clone overlap = true 2021-11-15T14:43:21.982 INFO:teuthology.orchestra.run.gibba032.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:21.982 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.982 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug shutdown = true 2021-11-15T14:43:21.983 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug op order = true 2021-11-15T14:43:21.983 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:21.983 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.983 INFO:teuthology.orchestra.run.gibba032.stdout: osd open classes on start = true 2021-11-15T14:43:21.983 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug pg log writeout = true 2021-11-15T14:43:21.984 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.984 INFO:teuthology.orchestra.run.gibba032.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:21.984 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.984 INFO:teuthology.orchestra.run.gibba032.stdout: osd map max advance = 10 2021-11-15T14:43:21.984 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.985 INFO:teuthology.orchestra.run.gibba032.stdout: journal zero on create = true 2021-11-15T14:43:21.985 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.985 INFO:teuthology.orchestra.run.gibba032.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:21.985 INFO:teuthology.orchestra.run.gibba032.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:21.986 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.986 INFO:teuthology.orchestra.run.gibba032.stdout: bdev debug aio = true 2021-11-15T14:43:21.986 INFO:teuthology.orchestra.run.gibba032.stdout: osd debug misdirected ops = true 2021-11-15T14:43:21.986 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore block size = 96636764160 2021-11-15T14:43:21.986 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:21.987 INFO:teuthology.orchestra.run.gibba032.stdout: bluestore fsck on mount = True 2021-11-15T14:43:21.987 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluefs = 20 2021-11-15T14:43:21.987 INFO:teuthology.orchestra.run.gibba032.stdout: debug bluestore = 20 2021-11-15T14:43:21.987 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:21.987 INFO:teuthology.orchestra.run.gibba032.stdout: debug osd = 20 2021-11-15T14:43:21.988 INFO:teuthology.orchestra.run.gibba032.stdout: debug rocksdb = 10 2021-11-15T14:43:21.988 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:21.988 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:21.988 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:21.988 INFO:teuthology.orchestra.run.gibba032.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:21.989 INFO:teuthology.orchestra.run.gibba032.stdout: osd objectstore = bluestore 2021-11-15T14:43:21.989 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:43:21.989 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.989 INFO:teuthology.orchestra.run.gibba032.stdout:[mgr] 2021-11-15T14:43:21.990 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:21.990 INFO:teuthology.orchestra.run.gibba032.stdout: debug mgr = 20 2021-11-15T14:43:21.990 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:43:21.990 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:43:21.991 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.991 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.991 INFO:teuthology.orchestra.run.gibba032.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:21.991 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.991 INFO:teuthology.orchestra.run.gibba032.stdout:[mon] 2021-11-15T14:43:21.992 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:21.992 INFO:teuthology.orchestra.run.gibba032.stdout: debug mon = 20 2021-11-15T14:43:21.992 INFO:teuthology.orchestra.run.gibba032.stdout: debug paxos = 20 2021-11-15T14:43:21.992 INFO:teuthology.orchestra.run.gibba032.stdout: debug auth = 20 2021-11-15T14:43:21.992 INFO:teuthology.orchestra.run.gibba032.stdout: mon data avail warn = 5 2021-11-15T14:43:21.993 INFO:teuthology.orchestra.run.gibba032.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:21.993 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:21.993 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:21.993 INFO:teuthology.orchestra.run.gibba032.stdout: mon osd prime pg temp = true 2021-11-15T14:43:21.993 INFO:teuthology.orchestra.run.gibba032.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:21.994 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.994 INFO:teuthology.orchestra.run.gibba032.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:21.994 INFO:teuthology.orchestra.run.gibba032.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:21.994 INFO:teuthology.orchestra.run.gibba032.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:21.995 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.995 INFO:teuthology.orchestra.run.gibba032.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:21.995 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:21.995 INFO:teuthology.orchestra.run.gibba032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:21.995 INFO:teuthology.orchestra.run.gibba032.stdout: mon op complaint time = 120 2021-11-15T14:43:21.996 INFO:teuthology.orchestra.run.gibba032.stdout: 2021-11-15T14:43:21.996 INFO:teuthology.orchestra.run.gibba032.stdout:[client] 2021-11-15T14:43:21.996 INFO:teuthology.orchestra.run.gibba032.stdout: rgw cache enabled = true 2021-11-15T14:43:21.996 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable ops log = true 2021-11-15T14:43:21.996 INFO:teuthology.orchestra.run.gibba032.stdout: rgw enable usage log = true 2021-11-15T14:43:21.997 INFO:teuthology.orchestra.run.gibba032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:21.997 INFO:teuthology.orchestra.run.gibba032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:21.997 INFO:teuthology.orchestra.run.gibba032.stdout: client mount timeout = 600 2021-11-15T14:43:21.997 INFO:teuthology.orchestra.run.gibba032.stdout: debug client = 20 2021-11-15T14:43:21.997 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:21.998 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:43:21.998 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:43:21.998 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.a] 2021-11-15T14:43:21.998 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.b] 2021-11-15T14:43:21.999 INFO:teuthology.orchestra.run.gibba032.stdout:[mon.c] 2021-11-15T14:43:21.999 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.a] 2021-11-15T14:43:21.999 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.c] 2021-11-15T14:43:21.999 INFO:teuthology.orchestra.run.gibba032.stdout:[mds.b] 2021-11-15T14:43:21.999 INFO:teuthology.orchestra.run.gibba032.stdout:[mds] 2021-11-15T14:43:22.000 INFO:teuthology.orchestra.run.gibba032.stdout: debug mds = 20 2021-11-15T14:43:22.000 INFO:teuthology.orchestra.run.gibba032.stdout: debug ms = 1 2021-11-15T14:43:22.000 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal frag = True 2021-11-15T14:43:22.000 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:22.000 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal merge size = 5 2021-11-15T14:43:22.001 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split bits = 3 2021-11-15T14:43:22.001 INFO:teuthology.orchestra.run.gibba032.stdout: mds bal split size = 100 2021-11-15T14:43:22.001 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug frag = True 2021-11-15T14:43:22.001 INFO:teuthology.orchestra.run.gibba032.stdout: mds debug scatterstat = True 2021-11-15T14:43:22.001 INFO:teuthology.orchestra.run.gibba032.stdout: mds op complaint time = 180 2021-11-15T14:43:22.002 INFO:teuthology.orchestra.run.gibba032.stdout: mds verify scatter = True 2021-11-15T14:43:22.002 INFO:teuthology.orchestra.run.gibba032.stdout: osd op complaint time = 180 2021-11-15T14:43:22.002 INFO:teuthology.orchestra.run.gibba032.stdout: rados mon op timeout = 15m 2021-11-15T14:43:22.002 INFO:teuthology.orchestra.run.gibba032.stdout: rados osd op timeout = 15m 2021-11-15T14:43:22.003 INFO:teuthology.orchestra.run.gibba035.stdout:[global] 2021-11-15T14:43:22.003 INFO:teuthology.orchestra.run.gibba035.stdout: chdir = "" 2021-11-15T14:43:22.003 INFO:teuthology.orchestra.run.gibba035.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-15T14:43:22.003 INFO:teuthology.orchestra.run.gibba035.stdout: auth supported = cephx 2021-11-15T14:43:22.003 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.004 INFO:teuthology.orchestra.run.gibba035.stdout: filestore xattr use omap = true 2021-11-15T14:43:22.004 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.004 INFO:teuthology.orchestra.run.gibba035.stdout: mon clock drift allowed = 1.000 2021-11-15T14:43:22.004 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.005 INFO:teuthology.orchestra.run.gibba035.stdout: osd crush chooseleaf type = 0 2021-11-15T14:43:22.005 INFO:teuthology.orchestra.run.gibba035.stdout: auth debug = true 2021-11-15T14:43:22.005 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.005 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on old message = true 2021-11-15T14:43:22.005 INFO:teuthology.orchestra.run.gibba035.stdout: ms die on bug = true 2021-11-15T14:43:22.006 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.006 INFO:teuthology.orchestra.run.gibba035.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-15T14:43:22.006 INFO:teuthology.orchestra.run.gibba035.stdout: mon pg warn max object skew = 0 2021-11-15T14:43:22.006 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.006 INFO:teuthology.orchestra.run.gibba035.stdout: # disable pg_autoscaler by default for new pools 2021-11-15T14:43:22.007 INFO:teuthology.orchestra.run.gibba035.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-15T14:43:22.007 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.007 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default size = 2 2021-11-15T14:43:22.007 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.007 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow primary affinity = true 2021-11-15T14:43:22.008 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd allow pg remap = true 2021-11-15T14:43:22.008 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on legacy crush tunables = false 2021-11-15T14:43:22.008 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on crush straw calc version zero = false 2021-11-15T14:43:22.008 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on no sortbitwise = false 2021-11-15T14:43:22.009 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on osd down out interval zero = false 2021-11-15T14:43:22.009 INFO:teuthology.orchestra.run.gibba035.stdout: mon warn on too few osds = false 2021-11-15T14:43:22.009 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-15T14:43:22.009 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-15T14:43:22.009 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.010 INFO:teuthology.orchestra.run.gibba035.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-15T14:43:22.010 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.010 INFO:teuthology.orchestra.run.gibba035.stdout: osd default data pool replay window = 5 2021-11-15T14:43:22.010 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.011 INFO:teuthology.orchestra.run.gibba035.stdout: mon allow pool delete = true 2021-11-15T14:43:22.011 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.011 INFO:teuthology.orchestra.run.gibba035.stdout: mon cluster log file level = debug 2021-11-15T14:43:22.011 INFO:teuthology.orchestra.run.gibba035.stdout: debug asserts on shutdown = true 2021-11-15T14:43:22.011 INFO:teuthology.orchestra.run.gibba035.stdout: mon health detail to clog = false 2021-11-15T14:43:22.012 INFO:teuthology.orchestra.run.gibba035.stdout: mon host = "172.21.2.135,172.21.2.119,[v2:172.21.2.119:3301,v1:172.21.2.119:6790]" 2021-11-15T14:43:22.012 INFO:teuthology.orchestra.run.gibba035.stdout: fsid = aa03efb2-9530-4b02-8a4e-1fb04db0e3e8 2021-11-15T14:43:22.012 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.012 INFO:teuthology.orchestra.run.gibba035.stdout:[osd] 2021-11-15T14:43:22.012 INFO:teuthology.orchestra.run.gibba035.stdout: osd journal size = 100 2021-11-15T14:43:22.013 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.013 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub load threshold = 5.0 2021-11-15T14:43:22.013 INFO:teuthology.orchestra.run.gibba035.stdout: osd scrub max interval = 600 2021-11-15T14:43:22.013 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.014 INFO:teuthology.orchestra.run.gibba035.stdout: osd recover clone overlap = true 2021-11-15T14:43:22.014 INFO:teuthology.orchestra.run.gibba035.stdout: osd recovery max chunk = 1048576 2021-11-15T14:43:22.014 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.014 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug shutdown = true 2021-11-15T14:43:22.014 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug op order = true 2021-11-15T14:43:22.015 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug verify stray on activate = true 2021-11-15T14:43:22.015 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.015 INFO:teuthology.orchestra.run.gibba035.stdout: osd open classes on start = true 2021-11-15T14:43:22.015 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug pg log writeout = true 2021-11-15T14:43:22.016 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.016 INFO:teuthology.orchestra.run.gibba035.stdout: osd deep scrub update digest min age = 30 2021-11-15T14:43:22.016 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.016 INFO:teuthology.orchestra.run.gibba035.stdout: osd map max advance = 10 2021-11-15T14:43:22.016 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.017 INFO:teuthology.orchestra.run.gibba035.stdout: journal zero on create = true 2021-11-15T14:43:22.017 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.017 INFO:teuthology.orchestra.run.gibba035.stdout: filestore ondisk finisher threads = 3 2021-11-15T14:43:22.017 INFO:teuthology.orchestra.run.gibba035.stdout: filestore apply finisher threads = 3 2021-11-15T14:43:22.018 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.018 INFO:teuthology.orchestra.run.gibba035.stdout: bdev debug aio = true 2021-11-15T14:43:22.018 INFO:teuthology.orchestra.run.gibba035.stdout: osd debug misdirected ops = true 2021-11-15T14:43:22.018 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore block size = 96636764160 2021-11-15T14:43:22.018 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore compression mode = aggressive 2021-11-15T14:43:22.019 INFO:teuthology.orchestra.run.gibba035.stdout: bluestore fsck on mount = True 2021-11-15T14:43:22.019 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluefs = 20 2021-11-15T14:43:22.019 INFO:teuthology.orchestra.run.gibba035.stdout: debug bluestore = 20 2021-11-15T14:43:22.019 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:22.020 INFO:teuthology.orchestra.run.gibba035.stdout: debug osd = 20 2021-11-15T14:43:22.020 INFO:teuthology.orchestra.run.gibba035.stdout: debug rocksdb = 10 2021-11-15T14:43:22.020 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd backfillfull_ratio = 0.85 2021-11-15T14:43:22.020 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd full ratio = 0.9 2021-11-15T14:43:22.020 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd nearfull ratio = 0.8 2021-11-15T14:43:22.021 INFO:teuthology.orchestra.run.gibba035.stdout: osd failsafe full ratio = 0.95 2021-11-15T14:43:22.021 INFO:teuthology.orchestra.run.gibba035.stdout: osd objectstore = bluestore 2021-11-15T14:43:22.021 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:43:22.021 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.021 INFO:teuthology.orchestra.run.gibba035.stdout:[mgr] 2021-11-15T14:43:22.022 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:22.022 INFO:teuthology.orchestra.run.gibba035.stdout: debug mgr = 20 2021-11-15T14:43:22.022 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:43:22.022 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:43:22.022 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:22.023 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:22.023 INFO:teuthology.orchestra.run.gibba035.stdout: mgr/telemetry/nag = false 2021-11-15T14:43:22.023 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.023 INFO:teuthology.orchestra.run.gibba035.stdout:[mon] 2021-11-15T14:43:22.024 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:22.024 INFO:teuthology.orchestra.run.gibba035.stdout: debug mon = 20 2021-11-15T14:43:22.024 INFO:teuthology.orchestra.run.gibba035.stdout: debug paxos = 20 2021-11-15T14:43:22.024 INFO:teuthology.orchestra.run.gibba035.stdout: debug auth = 20 2021-11-15T14:43:22.024 INFO:teuthology.orchestra.run.gibba035.stdout: mon data avail warn = 5 2021-11-15T14:43:22.025 INFO:teuthology.orchestra.run.gibba035.stdout: mon mgr mkfs grace = 240 2021-11-15T14:43:22.025 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min pgs per osd = 4 2021-11-15T14:43:22.025 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd reporter subtree level = osd 2021-11-15T14:43:22.025 INFO:teuthology.orchestra.run.gibba035.stdout: mon osd prime pg temp = true 2021-11-15T14:43:22.025 INFO:teuthology.orchestra.run.gibba035.stdout: mon reweight min bytes per osd = 10 2021-11-15T14:43:22.026 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.026 INFO:teuthology.orchestra.run.gibba035.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-15T14:43:22.026 INFO:teuthology.orchestra.run.gibba035.stdout: auth mon ticket ttl = 660 # 11m 2021-11-15T14:43:22.026 INFO:teuthology.orchestra.run.gibba035.stdout: auth service ticket ttl = 240 # 4m 2021-11-15T14:43:22.027 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.027 INFO:teuthology.orchestra.run.gibba035.stdout: # don't complain about insecure global_id in the test suite 2021-11-15T14:43:22.027 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-15T14:43:22.027 INFO:teuthology.orchestra.run.gibba035.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-15T14:43:22.027 INFO:teuthology.orchestra.run.gibba035.stdout: mon op complaint time = 120 2021-11-15T14:43:22.028 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:22.028 INFO:teuthology.orchestra.run.gibba035.stdout:[client] 2021-11-15T14:43:22.028 INFO:teuthology.orchestra.run.gibba035.stdout: rgw cache enabled = true 2021-11-15T14:43:22.028 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable ops log = true 2021-11-15T14:43:22.028 INFO:teuthology.orchestra.run.gibba035.stdout: rgw enable usage log = true 2021-11-15T14:43:22.029 INFO:teuthology.orchestra.run.gibba035.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-15T14:43:22.029 INFO:teuthology.orchestra.run.gibba035.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-15T14:43:22.029 INFO:teuthology.orchestra.run.gibba035.stdout: client mount timeout = 600 2021-11-15T14:43:22.029 INFO:teuthology.orchestra.run.gibba035.stdout: debug client = 20 2021-11-15T14:43:22.029 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:22.030 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:43:22.030 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:43:22.030 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.a] 2021-11-15T14:43:22.030 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.b] 2021-11-15T14:43:22.031 INFO:teuthology.orchestra.run.gibba035.stdout:[mon.c] 2021-11-15T14:43:22.031 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.a] 2021-11-15T14:43:22.031 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.c] 2021-11-15T14:43:22.031 INFO:teuthology.orchestra.run.gibba035.stdout:[mds.b] 2021-11-15T14:43:22.031 INFO:teuthology.orchestra.run.gibba035.stdout:[mds] 2021-11-15T14:43:22.032 INFO:teuthology.orchestra.run.gibba035.stdout: debug mds = 20 2021-11-15T14:43:22.032 INFO:teuthology.orchestra.run.gibba035.stdout: debug ms = 1 2021-11-15T14:43:22.032 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal frag = True 2021-11-15T14:43:22.032 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal fragment size max = 10000 2021-11-15T14:43:22.032 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal merge size = 5 2021-11-15T14:43:22.033 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split bits = 3 2021-11-15T14:43:22.033 INFO:teuthology.orchestra.run.gibba035.stdout: mds bal split size = 100 2021-11-15T14:43:22.033 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug frag = True 2021-11-15T14:43:22.033 INFO:teuthology.orchestra.run.gibba035.stdout: mds debug scatterstat = True 2021-11-15T14:43:22.033 INFO:teuthology.orchestra.run.gibba035.stdout: mds op complaint time = 180 2021-11-15T14:43:22.034 INFO:teuthology.orchestra.run.gibba035.stdout: mds verify scatter = True 2021-11-15T14:43:22.034 INFO:teuthology.orchestra.run.gibba035.stdout: osd op complaint time = 180 2021-11-15T14:43:22.034 INFO:teuthology.orchestra.run.gibba035.stdout: rados mon op timeout = 15m 2021-11-15T14:43:22.034 INFO:teuthology.orchestra.run.gibba035.stdout: rados osd op timeout = 15m 2021-11-15T14:43:22.035 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:43:22.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 Processor -- start 2021-11-15T14:43:22.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 -- start start 2021-11-15T14:43:22.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe1480a9c90 0x7fe1480b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1481439a0 con 0x7fe1480b0630 2021-11-15T14:43:22.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe148143c40 con 0x7fe1480b3790 2021-11-15T14:43:22.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14f834700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe148143ee0 con 0x7fe1480a9c90 2021-11-15T14:43:22.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe1480b3790 0x7fe1480b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51322/0 (socket says 172.21.2.135:51322) 2021-11-15T14:43:22.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 -- 172.21.2.135:0/2963988835 learned_addr learned my addr 172.21.2.135:0/2963988835 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:22.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851344509 0 0) 0x7fe148143c40 con 0x7fe1480b3790 2021-11-15T14:43:22.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe130003260 con 0x7fe1480b3790 2021-11-15T14:43:22.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1740363637 0 0) 0x7fe130003260 con 0x7fe1480b3790 2021-11-15T14:43:22.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 >> v2:172.21.2.119:3300/0 conn(0x7fe1480a9c90 msgr2=0x7fe1480b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 --2- 172.21.2.135:0/2963988835 >> v2:172.21.2.119:3300/0 conn(0x7fe1480a9c90 0x7fe1480b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 >> v1:172.21.2.119:6789/0 conn(0x7fe1480b0630 legacy=0x7fe14813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148144180 con 0x7fe1480b3790 2021-11-15T14:43:22.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fe138001660 con 0x7fe1480b3790 2021-11-15T14:43:22.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 >> v1:172.21.2.135:6789/0 conn(0x7fe1480b3790 legacy=0x7fe1480b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130003820 0x7fe130003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 0x7fe130004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe130005050 0x7fe13000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148143ee0 con 0x7fe130003820 2021-11-15T14:43:22.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13000bfe0 con 0x7fe130004500 2021-11-15T14:43:22.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13000c1a0 con 0x7fe130005050 2021-11-15T14:43:22.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 0x7fe130004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 -- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe130005050 msgr2=0x7fe13000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe130005050 0x7fe13000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 -- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130003820 msgr2=0x7fe130003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130003820 0x7fe130003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 -- 172.21.2.135:0/2963988835 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130003260 con 0x7fe130004500 2021-11-15T14:43:22.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14ddd1700 1 -- 172.21.2.135:0/2963988835 reap_dead start 2021-11-15T14:43:22.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 0x7fe130004980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fe14806aad0 tx=0x7fe148143dd0).ready entity=mon.1 client_cookie=3cc17a609190d88 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1380070d0 con 0x7fe130004500 2021-11-15T14:43:22.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138007230 con 0x7fe130004500 2021-11-15T14:43:22.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.088+0000 7fe137fff700 1 -- 172.21.2.135:0/2963988835 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe13800c8c0 con 0x7fe130004500 2021-11-15T14:43:22.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 msgr2=0x7fe130004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 0x7fe130004980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fe14806aad0 tx=0x7fe148143dd0).stop 2021-11-15T14:43:22.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/2963988835 shutdown_connections 2021-11-15T14:43:22.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 --2- 172.21.2.135:0/2963988835 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe130004500 0x7fe130004980 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/2963988835 >> 172.21.2.135:0/2963988835 conn(0x7fe148060840 msgr2=0x7fe148060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:22.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/2963988835 shutdown_connections 2021-11-15T14:43:22.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/2963988835 wait complete. 2021-11-15T14:43:22.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 Processor -- start 2021-11-15T14:43:22.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- start start 2021-11-15T14:43:22.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130004500 0x7fe148064360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe14813dc20 0x7fe14813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148140a10 con 0x7fe130004500 2021-11-15T14:43:22.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14813fcf0 con 0x7fe148064850 2021-11-15T14:43:22.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148156c30 con 0x7fe14813dc20 2021-11-15T14:43:22.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35512/0 (socket says 172.21.2.135:35512) 2021-11-15T14:43:22.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 -- 172.21.2.135:0/3452753420 learned_addr learned my addr 172.21.2.135:0/3452753420 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:22.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 -- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe14813dc20 msgr2=0x7fe14813f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe14813dc20 0x7fe14813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 -- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130004500 msgr2=0x7fe148064360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130004500 0x7fe148064360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 -- 172.21.2.135:0/3452753420 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148156ed0 con 0x7fe148064850 2021-11-15T14:43:22.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14cdcf700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fe148157790 tx=0x7fe138013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe13801b070 con 0x7fe148064850 2021-11-15T14:43:22.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138004710 con 0x7fe148064850 2021-11-15T14:43:22.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe148157170 con 0x7fe148064850 2021-11-15T14:43:22.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1380070d0 con 0x7fe148064850 2021-11-15T14:43:22.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148142c40 con 0x7fe148064850 2021-11-15T14:43:22.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe148143620 con 0x7fe148064850 2021-11-15T14:43:22.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe138010070 con 0x7fe148064850 2021-11-15T14:43:22.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 0x7fe1280559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.092+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe13806b960 con 0x7fe148064850 2021-11-15T14:43:22.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.096+0000 7fe14d5d0700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 0x7fe1280559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.096+0000 7fe14d5d0700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 0x7fe1280559e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe144000f70 tx=0x7fe144006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.096+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe138042c40 con 0x7fe148064850 2021-11-15T14:43:22.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.176+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe1480573d0 con 0x7fe148064850 2021-11-15T14:43:22.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe1367fc700 1 -- 172.21.2.135:0/3452753420 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe13806b030 con 0x7fe148064850 2021-11-15T14:43:22.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 msgr2=0x7fe1280559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 0x7fe1280559e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe144000f70 tx=0x7fe144006930).stop 2021-11-15T14:43:22.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 msgr2=0x7fe14813f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fe148157790 tx=0x7fe138013000).stop 2021-11-15T14:43:22.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 shutdown_connections 2021-11-15T14:43:22.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe128053520 0x7fe1280559e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe14813dc20 0x7fe14813f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe148064850 0x7fe14813f310 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 --2- 172.21.2.135:0/3452753420 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe130004500 0x7fe148064360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 >> 172.21.2.135:0/3452753420 conn(0x7fe148060840 msgr2=0x7fe14814cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:22.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 shutdown_connections 2021-11-15T14:43:22.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.192+0000 7fe14f834700 1 -- 172.21.2.135:0/3452753420 wait complete. 2021-11-15T14:43:22.202 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-15T14:43:22.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 Processor -- start 2021-11-15T14:43:22.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 -- start start 2021-11-15T14:43:22.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580b1e30 0x7f41580b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4158148420 0x7f41580b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580b03d0 con 0x7f41580a7140 2021-11-15T14:43:22.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41580a9140 con 0x7f4158148420 2021-11-15T14:43:22.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f415c957700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41580b0670 con 0x7f41580b1e30 2021-11-15T14:43:22.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4158148420 0x7f41580b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4158148420 0x7f41580b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35522/0 (socket says 172.21.2.135:35522) 2021-11-15T14:43:22.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 -- 172.21.2.135:0/3190867595 learned_addr learned my addr 172.21.2.135:0/3190867595 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:22.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 -- 172.21.2.135:0/3190867595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580b1e30 msgr2=0x7f41580b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 --2- 172.21.2.135:0/3190867595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580b1e30 0x7f41580b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 -- 172.21.2.135:0/3190867595 >> v1:172.21.2.119:6789/0 conn(0x7f41580a7140 legacy=0x7f41581447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 -- 172.21.2.135:0/3190867595 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580b0910 con 0x7f4158148420 2021-11-15T14:43:22.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.248+0000 7f4155d9b700 1 --2- 172.21.2.135:0/3190867595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41580b2210 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4158061420 tx=0x7f4148006eb0).ready entity=mon.1 client_cookie=8393d438ae569457 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415559a700 1 -- 172.21.2.135:0/3190867595 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800d570 con 0x7f4158148420 2021-11-15T14:43:22.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415559a700 1 -- 172.21.2.135:0/3190867595 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148000e90 con 0x7f4158148420 2021-11-15T14:43:22.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415559a700 1 -- 172.21.2.135:0/3190867595 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800d8c0 con 0x7f4158148420 2021-11-15T14:43:22.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/3190867595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 msgr2=0x7f41580b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- 172.21.2.135:0/3190867595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41580b2210 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4158061420 tx=0x7f4148006eb0).stop 2021-11-15T14:43:22.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/3190867595 shutdown_connections 2021-11-15T14:43:22.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- 172.21.2.135:0/3190867595 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41580b2210 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- 172.21.2.135:0/3190867595 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580b1e30 0x7f41580b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/3190867595 >> 172.21.2.135:0/3190867595 conn(0x7f415805f730 msgr2=0x7f415805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:22.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/3190867595 shutdown_connections 2021-11-15T14:43:22.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/3190867595 wait complete. 2021-11-15T14:43:22.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 Processor -- start 2021-11-15T14:43:22.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- start start 2021-11-15T14:43:22.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580a7140 0x7f4158147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41580b1e30 0x7f41580a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4158156ca0 con 0x7f41580b1e30 2021-11-15T14:43:22.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415815a430 con 0x7f4158148420 2021-11-15T14:43:22.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415815a190 con 0x7f41580a7140 2021-11-15T14:43:22.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35528/0 (socket says 172.21.2.135:35528) 2021-11-15T14:43:22.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 -- 172.21.2.135:0/4058759671 learned_addr learned my addr 172.21.2.135:0/4058759671 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:22.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 -- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580a7140 msgr2=0x7f4158147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580a7140 0x7f4158147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 -- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41580b1e30 msgr2=0x7f41580a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41580b1e30 0x7f41580a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 -- 172.21.2.135:0/4058759671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414800b1e0 con 0x7f4158148420 2021-11-15T14:43:22.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f4156d9d700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f4150003310 tx=0x7f41500091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4150001500 con 0x7f4158148420 2021-11-15T14:43:22.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150001660 con 0x7f4158148420 2021-11-15T14:43:22.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41500019c0 con 0x7f4158148420 2021-11-15T14:43:22.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4158156f00 con 0x7f4158148420 2021-11-15T14:43:22.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4158157890 con 0x7f4158148420 2021-11-15T14:43:22.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158157090 con 0x7f4158148420 2021-11-15T14:43:22.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4150018030 con 0x7f4158148420 2021-11-15T14:43:22.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 0x7f413c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.252+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f415006b2c0 con 0x7f4158148420 2021-11-15T14:43:22.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.256+0000 7f415659c700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 0x7f413c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.256+0000 7f415659c700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 0x7f413c055b60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f4140002f70 tx=0x7f4140006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.256+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4150042540 con 0x7f4158148420 2021-11-15T14:43:22.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.364+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f41580b0bb0 con 0x7f4158148420 2021-11-15T14:43:22.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f414f7fe700 1 -- 172.21.2.135:0/4058759671 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v391) v1 ==== 128+0+0 (secure 0 0 0) 0x7f4150045b60 con 0x7f4158148420 2021-11-15T14:43:22.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 msgr2=0x7f413c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 0x7f413c055b60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f4140002f70 tx=0x7f4140006a80).stop 2021-11-15T14:43:22.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 msgr2=0x7f41581573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f4150003310 tx=0x7f41500091a0).stop 2021-11-15T14:43:22.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 shutdown_connections 2021-11-15T14:43:22.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f413c0536a0 0x7f413c055b60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4158148420 0x7f41581573a0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f41580b1e30 0x7f41580a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 --2- 172.21.2.135:0/4058759671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f41580a7140 0x7f4158147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 >> 172.21.2.135:0/4058759671 conn(0x7f415805f730 msgr2=0x7f415814cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:22.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 shutdown_connections 2021-11-15T14:43:22.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.888+0000 7f415c957700 1 -- 172.21.2.135:0/4058759671 wait complete. 2021-11-15T14:43:22.898 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:43:22.899 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:43:22.899 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-15T14:43:22.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 Processor -- start 2021-11-15T14:43:22.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 -- start start 2021-11-15T14:43:22.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 0x7f0c380b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c380aac30 con 0x7f0c38067380 2021-11-15T14:43:22.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c38060560 con 0x7f0c380b4cc0 2021-11-15T14:43:22.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3f262700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38066f20 con 0x7f0c38060180 2021-11-15T14:43:22.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3d7ff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0c380b4cc0 0x7f0c3814b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51356/0 (socket says 172.21.2.135:51356) 2021-11-15T14:43:22.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c3d7ff700 1 -- 172.21.2.135:0/1166430761 learned_addr learned my addr 172.21.2.135:0/1166430761 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:22.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.948+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189624581 0 0) 0x7f0c38060560 con 0x7f0c380b4cc0 2021-11-15T14:43:22.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24003260 con 0x7f0c380b4cc0 2021-11-15T14:43:22.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141016487 0 0) 0x7f0c24003260 con 0x7f0c380b4cc0 2021-11-15T14:43:22.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 msgr2=0x7f0c380b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 0x7f0c380b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 >> v1:172.21.2.119:6789/0 conn(0x7f0c38067380 legacy=0x7f0c38143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380b3430 con 0x7f0c380b4cc0 2021-11-15T14:43:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0c300019e0 con 0x7f0c380b4cc0 2021-11-15T14:43:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 >> v1:172.21.2.135:6789/0 conn(0x7f0c380b4cc0 legacy=0x7f0c3814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 0x7f0c24003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c24003df0 0x7f0c24004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c24004b10 0x7f0c24004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38066f20 con 0x7f0c24004b10 2021-11-15T14:43:22.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2400fd50 con 0x7f0c24003df0 2021-11-15T14:43:22.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2400ff10 con 0x7f0c38060180 2021-11-15T14:43:22.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c24003df0 0x7f0c24004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3d7ff700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c24004b10 0x7f0c24004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 msgr2=0x7f0c24003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c38060180 0x7f0c24003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c24004b10 msgr2=0x7f0c24004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:22.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c24004b10 0x7f0c24004f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:22.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1166430761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c24003260 con 0x7f0c24003df0 2021-11-15T14:43:22.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c24003df0 0x7f0c24004500 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f0c28000f70 tx=0x7f0c280079e0).ready entity=mon.1 client_cookie=9729e0711ff71a43 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28007cf0 con 0x7f0c24003df0 2021-11-15T14:43:22.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28014410 con 0x7f0c24003df0 2021-11-15T14:43:22.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c377fe700 1 -- 172.21.2.135:0/1166430761 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28014770 con 0x7f0c24003df0 2021-11-15T14:43:22.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1166430761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c24003df0 msgr2=0x7f0c24004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1166430761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c24003df0 0x7f0c24004500 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f0c28000f70 tx=0x7f0c280079e0).stop 2021-11-15T14:43:22.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3d7ff700 1 -- 172.21.2.135:0/1166430761 reap_dead start 2021-11-15T14:43:22.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1166430761 shutdown_connections 2021-11-15T14:43:22.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1166430761 >> 172.21.2.135:0/1166430761 conn(0x7f0c3805cfb0 msgr2=0x7f0c3805f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:22.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1166430761 shutdown_connections 2021-11-15T14:43:22.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1166430761 wait complete. 2021-11-15T14:43:22.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 Processor -- start 2021-11-15T14:43:22.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- start start 2021-11-15T14:43:22.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c24003df0 0x7f0c380ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c380ad500 0x7f0c3813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380b00d0 con 0x7f0c380ad500 2021-11-15T14:43:22.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380b0300 con 0x7f0c380abcf0 2021-11-15T14:43:22.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380b05a0 con 0x7f0c24003df0 2021-11-15T14:43:22.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35548/0 (socket says 172.21.2.135:35548) 2021-11-15T14:43:22.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1442989307 learned_addr learned my addr 172.21.2.135:0/1442989307 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:22.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c24003df0 msgr2=0x7f0c380ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c24003df0 0x7f0c380ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c380ad500 msgr2=0x7f0c3813f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:22.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c380ad500 0x7f0c3813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:22.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 -- 172.21.2.135:0/1442989307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38152430 con 0x7f0c380abcf0 2021-11-15T14:43:22.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c37fff700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f0c28000f70 tx=0x7f0c28015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28007cf0 con 0x7f0c380abcf0 2021-11-15T14:43:22.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28013e40 con 0x7f0c380abcf0 2021-11-15T14:43:22.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28022660 con 0x7f0c380abcf0 2021-11-15T14:43:22.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c38152150 con 0x7f0c380abcf0 2021-11-15T14:43:22.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3813f9c0 con 0x7f0c380abcf0 2021-11-15T14:43:22.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.952+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c380573d0 con 0x7f0c380abcf0 2021-11-15T14:43:22.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c2802b3f0 con 0x7f0c380abcf0 2021-11-15T14:43:22.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c35ffb700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 0x7f0c18055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:22.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0c2801c040 con 0x7f0c380abcf0 2021-11-15T14:43:22.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c3cffe700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 0x7f0c18055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:22.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c3cffe700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 0x7f0c18055b20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0c2c002f70 tx=0x7f0c2c006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:22.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:22.956+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c280441f0 con 0x7f0c380abcf0 2021-11-15T14:43:23.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.072+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f0c380b07d0 con 0x7f0c380abcf0 2021-11-15T14:43:23.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.888+0000 7f0c35ffb700 1 -- 172.21.2.135:0/1442989307 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v392) v1 ==== 130+0+0 (secure 0 0 0) 0x7f0c28047810 con 0x7f0c380abcf0 2021-11-15T14:43:23.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 msgr2=0x7f0c18055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 0x7f0c18055b20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0c2c002f70 tx=0x7f0c2c006a10).stop 2021-11-15T14:43:23.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 msgr2=0x7f0c380ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f0c28000f70 tx=0x7f0c28015000).stop 2021-11-15T14:43:23.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 shutdown_connections 2021-11-15T14:43:23.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c18053660 0x7f0c18055b20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:23.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c380ad500 0x7f0c3813f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c380abcf0 0x7f0c380ad010 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:23.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 --2- 172.21.2.135:0/1442989307 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c24003df0 0x7f0c380ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 >> 172.21.2.135:0/1442989307 conn(0x7f0c3805cfb0 msgr2=0x7f0c38142090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:23.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 shutdown_connections 2021-11-15T14:43:23.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.892+0000 7f0c3f262700 1 -- 172.21.2.135:0/1442989307 wait complete. 2021-11-15T14:43:23.906 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:43:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 Processor -- start 2021-11-15T14:43:23.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 -- start start 2021-11-15T14:43:23.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 0x7f00e80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80a7850 con 0x7f00e80b2320 2021-11-15T14:43:23.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80b06d0 con 0x7f00e80b1f40 2021-11-15T14:43:23.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00ec903700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b17c0 con 0x7f00e80b1350 2021-11-15T14:43:23.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e659c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f00e80b1f40 0x7f00e80a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51374/0 (socket says 172.21.2.135:51374) 2021-11-15T14:43:23.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e659c700 1 -- 172.21.2.135:0/1669013244 learned_addr learned my addr 172.21.2.135:0/1669013244 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:23.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536451419 0 0) 0x7f00e80b06d0 con 0x7f00e80b1f40 2021-11-15T14:43:23.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c8003260 con 0x7f00e80b1f40 2021-11-15T14:43:23.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2882739706 0 0) 0x7f00c8003260 con 0x7f00e80b1f40 2021-11-15T14:43:23.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 msgr2=0x7f00e80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:23.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 0x7f00e80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 >> v1:172.21.2.119:6789/0 conn(0x7f00e80b2320 legacy=0x7f00e81412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:23.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80b0970 con 0x7f00e80b1f40 2021-11-15T14:43:23.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f00d8001660 con 0x7f00e80b1f40 2021-11-15T14:43:23.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 >> v1:172.21.2.135:6789/0 conn(0x7f00e80b1f40 legacy=0x7f00e80a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 0x7f00c80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00c8003ec0 0x7f00c8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00c8004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b17c0 con 0x7f00c8003ec0 2021-11-15T14:43:23.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c800ba00 con 0x7f00c8004b40 2021-11-15T14:43:23.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c800bbc0 con 0x7f00e80b1350 2021-11-15T14:43:23.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e6d9d700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00c8004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:23.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e6d9d700 1 -- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 msgr2=0x7f00c80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:23.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e6d9d700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e80b1350 0x7f00c80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e6d9d700 1 -- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00c8003ec0 msgr2=0x7f00c8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:23.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.956+0000 7f00e6d9d700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00c8003ec0 0x7f00c8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e6d9d700 1 -- 172.21.2.135:0/1669013244 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8003260 con 0x7f00c8004b40 2021-11-15T14:43:23.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e6d9d700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00c8004fc0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f00e0002320 tx=0x7f00e0007d80).ready entity=mon.1 client_cookie=9969c861fa207b3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:23.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e0002510 con 0x7f00c8004b40 2021-11-15T14:43:23.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0006890 con 0x7f00c8004b40 2021-11-15T14:43:23.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e559a700 1 -- 172.21.2.135:0/1669013244 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e0006bf0 con 0x7f00c8004b40 2021-11-15T14:43:23.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1669013244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 msgr2=0x7f00c8004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 --2- 172.21.2.135:0/1669013244 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00c8004fc0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f00e0002320 tx=0x7f00e0007d80).stop 2021-11-15T14:43:23.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e6d9d700 1 -- 172.21.2.135:0/1669013244 reap_dead start 2021-11-15T14:43:23.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1669013244 shutdown_connections 2021-11-15T14:43:23.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1669013244 >> 172.21.2.135:0/1669013244 conn(0x7f00e805f730 msgr2=0x7f00e805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:23.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1669013244 shutdown_connections 2021-11-15T14:43:23.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1669013244 wait complete. 2021-11-15T14:43:23.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 Processor -- start 2021-11-15T14:43:23.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- start start 2021-11-15T14:43:23.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00e814ab80 0x7f00e814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e813c830 0x7f00e813ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e814a270 con 0x7f00e814ab80 2021-11-15T14:43:23.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b5f40 con 0x7f00c8004b40 2021-11-15T14:43:23.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e814b8d0 con 0x7f00e813c830 2021-11-15T14:43:23.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:23.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35566/0 (socket says 172.21.2.135:35566) 2021-11-15T14:43:23.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 -- 172.21.2.135:0/1007571332 learned_addr learned my addr 172.21.2.135:0/1007571332 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:23.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e5d9b700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00e814ab80 0x7f00e814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:23.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 -- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e813c830 msgr2=0x7f00e813ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e813c830 0x7f00e813ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:23.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 -- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00e814ab80 msgr2=0x7f00e814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:23.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00e814ab80 0x7f00e814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:23.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 -- 172.21.2.135:0/1007571332 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e814a4d0 con 0x7f00c8004b40 2021-11-15T14:43:23.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00e659c700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f00e806a170 tx=0x7f00e80b0860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:23.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00d8007170 con 0x7f00c8004b40 2021-11-15T14:43:23.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d80072d0 con 0x7f00c8004b40 2021-11-15T14:43:23.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e814b600 con 0x7f00c8004b40 2021-11-15T14:43:23.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e81483b0 con 0x7f00c8004b40 2021-11-15T14:43:23.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00d8004920 con 0x7f00c8004b40 2021-11-15T14:43:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e813d350 con 0x7f00c8004b40 2021-11-15T14:43:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.960+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f00d801b070 con 0x7f00c8004b40 2021-11-15T14:43:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.964+0000 7f00df7fe700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 0x7f00cc055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:23.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.964+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f00d806b130 con 0x7f00c8004b40 2021-11-15T14:43:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.964+0000 7f00e5d9b700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 0x7f00cc055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.964+0000 7f00e5d9b700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 0x7f00cc055ac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f00d000a000 tx=0x7f00d0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:23.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:23.964+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00d8042300 con 0x7f00c8004b40 2021-11-15T14:43:24.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.048+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f00e80b3430 con 0x7f00c8004b40 2021-11-15T14:43:24.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.056+0000 7f00df7fe700 1 -- 172.21.2.135:0/1007571332 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00e80b3430 con 0x7f00c8004b40 2021-11-15T14:43:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 msgr2=0x7f00cc055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 0x7f00cc055ac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f00d000a000 tx=0x7f00d0008040).stop 2021-11-15T14:43:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 msgr2=0x7f00e80aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f00e806a170 tx=0x7f00e80b0860).stop 2021-11-15T14:43:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 shutdown_connections 2021-11-15T14:43:24.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f00cc053600 0x7f00cc055ac0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f00e813c830 0x7f00e813ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f00e814ab80 0x7f00e814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 --2- 172.21.2.135:0/1007571332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f00c8004b40 0x7f00e80aa770 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 >> 172.21.2.135:0/1007571332 conn(0x7f00e805f730 msgr2=0x7f00e813ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 shutdown_connections 2021-11-15T14:43:24.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.060+0000 7f00ec903700 1 -- 172.21.2.135:0/1007571332 wait complete. 2021-11-15T14:43:24.069 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:43:24.070 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:24.079 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:24.093 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:24.101 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:24.114 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:43:24.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:24.115 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:24.116 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:24.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:43:24.120 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:43:24.121 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:24.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:24.122 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:24.122 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:24.126 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:43:24.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:43:24.128 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:24.128 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:43:24.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 Processor -- start 2021-11-15T14:43:24.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 -- start start 2021-11-15T14:43:24.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fef80148420 0x7fef800b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef800a7140 0x7fef801447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800b03d0 con 0x7fef800b1e30 2021-11-15T14:43:24.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800a9140 con 0x7fef80148420 2021-11-15T14:43:24.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef84c75700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800b0670 con 0x7fef800a7140 2021-11-15T14:43:24.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7ed9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fef800a7140 0x7fef801447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7e59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fef800b1e30 0x7fef800b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51392/0 (socket says 172.21.2.135:51392) 2021-11-15T14:43:24.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7e59c700 1 -- 172.21.2.135:0/2893458691 learned_addr learned my addr 172.21.2.135:0/2893458691 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:24.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7ed9d700 1 -- 172.21.2.135:0/2893458691 >> v2:172.21.2.119:3300/0 conn(0x7fef80148420 msgr2=0x7fef800b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:24.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7ed9d700 1 --2- 172.21.2.135:0/2893458691 >> v2:172.21.2.119:3300/0 conn(0x7fef80148420 0x7fef800b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7ed9d700 1 -- 172.21.2.135:0/2893458691 >> v1:172.21.2.135:6789/0 conn(0x7fef800b1e30 legacy=0x7fef800b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.180+0000 7fef7ed9d700 1 -- 172.21.2.135:0/2893458691 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b0910 con 0x7fef800a7140 2021-11-15T14:43:24.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7ed9d700 1 --2- 172.21.2.135:0/2893458691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef801447a0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fef68001110 tx=0x7fef780091d0).ready entity=mon.1 client_cookie=5899455b8acd406d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7d59a700 1 -- 172.21.2.135:0/2893458691 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef78009ea0 con 0x7fef800a7140 2021-11-15T14:43:24.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7d59a700 1 -- 172.21.2.135:0/2893458691 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7800b760 con 0x7fef800a7140 2021-11-15T14:43:24.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7d59a700 1 -- 172.21.2.135:0/2893458691 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7800b8d0 con 0x7fef800a7140 2021-11-15T14:43:24.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2893458691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 msgr2=0x7fef801447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- 172.21.2.135:0/2893458691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef801447a0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fef68001110 tx=0x7fef780091d0).stop 2021-11-15T14:43:24.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2893458691 shutdown_connections 2021-11-15T14:43:24.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- 172.21.2.135:0/2893458691 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef801447a0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- 172.21.2.135:0/2893458691 >> v2:172.21.2.119:3300/0 conn(0x7fef80148420 0x7fef800b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2893458691 >> 172.21.2.135:0/2893458691 conn(0x7fef8005f730 msgr2=0x7fef8005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2893458691 shutdown_connections 2021-11-15T14:43:24.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2893458691 wait complete. 2021-11-15T14:43:24.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 Processor -- start 2021-11-15T14:43:24.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- start start 2021-11-15T14:43:24.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef800b1e30 0x7fef800acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef80148420 0x7fef80143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80156a50 con 0x7fef80148420 2021-11-15T14:43:24.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8014aa60 con 0x7fef800a7140 2021-11-15T14:43:24.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8014af30 con 0x7fef800b1e30 2021-11-15T14:43:24.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35576/0 (socket says 172.21.2.135:35576) 2021-11-15T14:43:24.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 -- 172.21.2.135:0/2537975275 learned_addr learned my addr 172.21.2.135:0/2537975275 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:24.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 -- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef800b1e30 msgr2=0x7fef800acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef800b1e30 0x7fef800acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 -- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef80148420 msgr2=0x7fef80143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef80148420 0x7fef80143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 -- 172.21.2.135:0/2537975275 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78009470 con 0x7fef800a7140 2021-11-15T14:43:24.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef7e59c700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fef800adc70 tx=0x7fef68007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef680072e0 con 0x7fef800a7140 2021-11-15T14:43:24.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68007440 con 0x7fef800a7140 2021-11-15T14:43:24.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8014ac90 con 0x7fef800a7140 2021-11-15T14:43:24.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef80149af0 con 0x7fef800a7140 2021-11-15T14:43:24.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef68005800 con 0x7fef800a7140 2021-11-15T14:43:24.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.184+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef58003410 con 0x7fef800a7140 2021-11-15T14:43:24.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef68010070 con 0x7fef800a7140 2021-11-15T14:43:24.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef777fe700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 0x7fef64055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fef6806b000 con 0x7fef800a7140 2021-11-15T14:43:24.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef7dd9b700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 0x7fef64055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef7dd9b700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 0x7fef64055a00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fef70002f70 tx=0x7fef700069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.188+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef68068e90 con 0x7fef800a7140 2021-11-15T14:43:24.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fef580036c0 con 0x7fef800a7140 2021-11-15T14:43:24.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef777fe700 1 -- 172.21.2.135:0/2537975275 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+29229 (secure 0 0 0) 0x7fef68047090 con 0x7fef800a7140 2021-11-15T14:43:24.277 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:24.277 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:24.277 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 147, 2021-11-15T14:43:24.278 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:43:24.278 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:43:24.278 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:43:21.866383+0000", 2021-11-15T14:43:24.278 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:24.279 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:24.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:43:24.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:43:24.279 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:43:24.280 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:43:24.280 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:43:24.280 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:43:24.280 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:43:24.280 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:24.281 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:43:24.281 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:43:24.281 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:43:24.281 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:43:24.282 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:43:24.282 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 26, 2021-11-15T14:43:24.282 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:43:24.282 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:43:24.283 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:43:24.283 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:43:24.283 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:43:24.283 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.284 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:43:24.284 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:43:24.284 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:43:24.285 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:24.285 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:24.285 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:24.285 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:24.286 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:24.286 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:24.286 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:24.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:24.286 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:43:24.287 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:43:24.287 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:43:24.287 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:43:24.287 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:43:24.288 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:24.288 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:24.288 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:24.288 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:24.289 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:24.289 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:24.289 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:24.289 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.289 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:43:24.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:24.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:24.290 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:24.290 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:24.291 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:24.291 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:24.291 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:24.291 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:24.291 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:24.292 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:24.292 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:24.292 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:24.292 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:24.293 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:24.293 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:24.293 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:24.293 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:24.294 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:24.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:24.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:24.294 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:24.295 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:24.295 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:24.295 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:24.295 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:24.295 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:24.296 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.296 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:24.296 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:24.296 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:24.297 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:24.297 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:24.297 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:24.297 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:24.297 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:24.298 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:24.298 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:24.298 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:24.298 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:24.299 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:43:24.299 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.299 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:24.299 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:43:24.300 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.300 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.300 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.300 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:43:24.300 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:43:24.301 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:43:24.301 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:24.301 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:24.301 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:24.302 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:24.302 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:24.302 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:24.303 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:24.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:24.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:24.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:24.303 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:24.304 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:24.304 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:24.304 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:24.304 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:24.305 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:24.305 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:24.305 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:24.305 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:24.306 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:24.306 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:43:24.306 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:24.307 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:24.307 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:24.307 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:24.307 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:24.308 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:24.308 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:24.308 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:24.308 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:24.309 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:24.309 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:24.309 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:24.309 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:24.310 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:24.310 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:24.310 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:24.311 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:24.311 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:24.311 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:24.311 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:24.312 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:24.312 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:24.312 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:24.312 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:24.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:24.313 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:24.313 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:24.313 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:24.314 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:24.314 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:24.314 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:24.314 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:24.315 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:24.315 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:24.315 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:24.315 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:24.316 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:24.316 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:24.316 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:24.316 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:43:24.317 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.317 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.317 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:24.317 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:43:24.318 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.318 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:24.318 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:43:24.318 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.318 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.319 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.319 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.319 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.319 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.320 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.320 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.320 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.321 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.321 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.321 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.321 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.322 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.322 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:43:24.322 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.322 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.322 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.323 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.323 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:43:24.323 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.323 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.324 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.324 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.324 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.324 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.324 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.325 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.325 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:43:24.325 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.325 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.326 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.326 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.326 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:43:24.326 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.327 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.327 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.327 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.327 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.328 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.328 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.328 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:43:24.329 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.329 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.329 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.329 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.330 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:43:24.330 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.330 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.330 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.331 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.331 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.331 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.331 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.332 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.332 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:43:24.332 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.332 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.333 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.333 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.333 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:43:24.334 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:24.334 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.334 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.334 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.335 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:43:24.335 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:43:24.335 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:43:24.335 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:43:24.336 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.336 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.336 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.336 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.337 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.337 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.337 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:24.337 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:43:24.338 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.338 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.338 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.339 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.339 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.339 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.339 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.340 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.340 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.340 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.340 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.341 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.341 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.341 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:43:24.341 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.342 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.342 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.342 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.342 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:43:24.343 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.343 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.343 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.343 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.344 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.344 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.344 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.344 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:43:24.345 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.345 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.345 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.345 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.346 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:43:24.346 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.346 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.346 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.347 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.347 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.347 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.347 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.348 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.348 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:43:24.348 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.349 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.349 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.349 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.349 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:43:24.350 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.350 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.350 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.350 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.351 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.351 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.351 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.351 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.351 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:43:24.352 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.352 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.352 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.352 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.353 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:43:24.353 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:24.353 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.353 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.353 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.354 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:43:24.354 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:43:24.354 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:43:24.354 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:43:24.355 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.355 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.355 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.355 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.355 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.356 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.356 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:24.356 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:43:24.357 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.357 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.357 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.357 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.358 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.358 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.358 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.358 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:43:24.359 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.359 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.359 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.359 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.359 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.360 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.360 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:43:24.360 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.360 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.361 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.361 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.361 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:43:24.361 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.362 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.362 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.362 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.362 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.362 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.363 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.363 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.363 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:43:24.363 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.364 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.364 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.364 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.364 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:43:24.365 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.365 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.365 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.365 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.366 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.366 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.366 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.366 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.367 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:43:24.367 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.367 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.367 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.368 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.368 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:43:24.368 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.368 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.369 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.369 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.369 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.369 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.369 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.370 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.370 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:43:24.370 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.370 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.371 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.371 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.371 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:43:24.371 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:24.371 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.372 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.372 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.372 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:43:24.372 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:43:24.373 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:43:24.373 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:43:24.373 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.373 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.374 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.374 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.374 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.374 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.375 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:24.375 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:43:24.375 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.375 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.376 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.376 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.376 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.376 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.376 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.377 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.377 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.377 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.377 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.378 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.378 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.378 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:43:24.379 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.379 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.379 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.379 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.379 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:43:24.380 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.380 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.380 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.381 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.381 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.381 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.381 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:43:24.382 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.382 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.382 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.382 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.383 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:43:24.383 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.383 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.383 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.384 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.384 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.384 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.385 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.385 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:43:24.385 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.385 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.385 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.386 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.386 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:43:24.386 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.386 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.387 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.387 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.387 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.387 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.388 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.388 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.388 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:43:24.388 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.388 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.389 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.389 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.389 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:43:24.389 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:24.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.390 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.390 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.390 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:43:24.390 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:43:24.391 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:43:24.391 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:43:24.391 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.391 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.392 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.392 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.393 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:24.393 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:43:24.393 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.393 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.394 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.394 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.394 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.394 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.395 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.395 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.395 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.395 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.396 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.396 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.396 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.396 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:43:24.397 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.397 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.397 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.397 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.398 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:43:24.398 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.398 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.398 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.399 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.399 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.399 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.399 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.400 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:43:24.400 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.400 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.401 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:43:24.401 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.401 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.402 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.402 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.402 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.402 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.403 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.403 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.403 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:43:24.403 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.403 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.404 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.404 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:43:24.404 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.405 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.405 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.405 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.405 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.405 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.406 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.406 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.406 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:43:24.406 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.407 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.407 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.407 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.407 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:43:24.407 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:24.408 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.408 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.408 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.408 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:43:24.409 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:43:24.409 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:43:24.409 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:43:24.409 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.409 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.410 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.410 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.410 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.411 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.411 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:24.411 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:43:24.411 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.412 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.412 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.412 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.412 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.413 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.413 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.413 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.413 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.414 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.414 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.414 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.414 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.414 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.415 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:43:24.415 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.415 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.416 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.416 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.416 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:43:24.416 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.416 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.417 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.417 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.417 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.417 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.418 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.418 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.418 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:43:24.418 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.419 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.419 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.419 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.419 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:43:24.420 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.420 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.420 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.420 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.421 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.421 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.421 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.421 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.422 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:43:24.422 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.422 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.422 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.423 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.423 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:43:24.423 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.424 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.424 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.424 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.424 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.425 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.425 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.425 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.425 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:43:24.426 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.426 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.426 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.426 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.427 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:43:24.427 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:24.427 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.428 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.428 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.428 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:43:24.428 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:43:24.429 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:43:24.429 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:43:24.429 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.429 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.430 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.430 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.430 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.430 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.430 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:24.431 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:43:24.431 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.431 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.431 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.432 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.432 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.432 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.432 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.433 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 130, 2021-11-15T14:43:24.433 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.433 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.433 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.434 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.434 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.434 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:43:24.435 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.435 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.435 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.435 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.435 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:43:24.436 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.436 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.436 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.437 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.437 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.437 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.437 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.438 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:43:24.438 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.438 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.438 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.439 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.439 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:43:24.439 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.439 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.439 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.440 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.440 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.440 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.441 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.441 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:43:24.441 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.441 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.442 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.442 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.442 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:43:24.442 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.443 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.443 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.443 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.443 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.443 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.444 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.444 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.444 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:43:24.444 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.444 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.445 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.445 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.445 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:43:24.446 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:24.446 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.446 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.446 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.446 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:43:24.447 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:43:24.447 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:43:24.447 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:43:24.447 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.448 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.448 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.448 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.448 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.449 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.449 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:24.449 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:43:24.449 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:24.449 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:24.450 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:24.450 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:24.450 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:24.450 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:24.451 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:24.451 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 142, 2021-11-15T14:43:24.451 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:24.451 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:24.451 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:24.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.452 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.452 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:43:24.453 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.453 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.453 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.453 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.454 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:43:24.454 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.454 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.454 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.455 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.455 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:24.455 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.455 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.456 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.456 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:43:24.456 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.456 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.456 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.457 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.457 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:43:24.457 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.457 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.458 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.458 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.458 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:24.458 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.458 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:43:24.459 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.459 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.460 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.460 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:43:24.460 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.460 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.461 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.461 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.461 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:24.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:24.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:24.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:43:24.462 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:24.463 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:43:24.464 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:24.464 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.465 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:43:24.465 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:43:24.465 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:43:24.465 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:43:24.465 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:24.466 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:24.466 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:24.466 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:24.466 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.467 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:24.467 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:43:24.467 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.467 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:24.468 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.468 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.468 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.468 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.468 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.469 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:43:24.469 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.470 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:24.470 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.470 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.470 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.471 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.471 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.471 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:43:24.471 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.472 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:24.472 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.473 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.473 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.473 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.473 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:43:24.474 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.474 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.474 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.474 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:24.475 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.475 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.475 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.475 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.476 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.476 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:43:24.476 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.476 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.477 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:24.477 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.477 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.477 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.478 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.478 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.478 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:43:24.478 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.479 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.479 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:24.479 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.479 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.480 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.480 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.480 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.481 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:43:24.481 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.481 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.482 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:24.482 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.482 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.482 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.483 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.483 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.483 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:43:24.483 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.484 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:24.484 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:24.484 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:24.484 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:24.485 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:24.485 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:24.485 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:24.485 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:43:24.486 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:24.486 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.486 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:24.486 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:43:24.486 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:43:24.487 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:43:24.487 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:43:24.487 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:43:24.487 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.119:6835/2587030449": "2021-11-16T14:43:18.739835+0000", 2021-11-15T14:43:24.488 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.119:6834/2587030449": "2021-11-16T14:43:18.739835+0000" 2021-11-15T14:43:24.488 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.488 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:43:24.488 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:43:24.488 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:43:24.489 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:24.489 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:43:24.489 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:43:24.489 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:24.490 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:43:24.490 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:24.490 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:24.491 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:43:24.491 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:43:24.491 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.491 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:43:24.491 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:24.492 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:24.492 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:43:24.492 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:24.492 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:24.493 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:43:24.493 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:24.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:24.493 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:43:24.494 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:43:24.494 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:43:24.494 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:43:24.494 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:43:24.494 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:24.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 msgr2=0x7fef64055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 0x7fef64055a00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fef70002f70 tx=0x7fef700069f0).stop 2021-11-15T14:43:24.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 msgr2=0x7fef8014b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fef800adc70 tx=0x7fef68007c00).stop 2021-11-15T14:43:24.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 shutdown_connections 2021-11-15T14:43:24.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef64053540 0x7fef64055a00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef80148420 0x7fef80143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef800b1e30 0x7fef800acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 --2- 172.21.2.135:0/2537975275 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef800a7140 0x7fef8014b440 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 >> 172.21.2.135:0/2537975275 conn(0x7fef8005f730 msgr2=0x7fef800b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 shutdown_connections 2021-11-15T14:43:24.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.272+0000 7fef84c75700 1 -- 172.21.2.135:0/2537975275 wait complete. 2021-11-15T14:43:24.500 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:24.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 Processor -- start 2021-11-15T14:43:24.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- start start 2021-11-15T14:43:24.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff0c80b1e30 0x7ff0c80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c8148420 0x7ff0c80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff0c80a7140 0x7ff0c81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80a9140 con 0x7ff0c80b1e30 2021-11-15T14:43:24.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80b03d0 con 0x7ff0c80a7140 2021-11-15T14:43:24.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80b0670 con 0x7ff0c8148420 2021-11-15T14:43:24.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff0c80a7140 0x7ff0c81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff0c80a7140 0x7ff0c81447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35588/0 (socket says 172.21.2.135:35588) 2021-11-15T14:43:24.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 -- 172.21.2.135:0/2346732522 learned_addr learned my addr 172.21.2.135:0/2346732522 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:24.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 -- 172.21.2.135:0/2346732522 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c8148420 msgr2=0x7ff0c80b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:24.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 --2- 172.21.2.135:0/2346732522 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c8148420 0x7ff0c80b2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 -- 172.21.2.135:0/2346732522 >> v2:172.21.2.119:3300/0 conn(0x7ff0c80b1e30 msgr2=0x7ff0c80b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:24.564 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 --2- 172.21.2.135:0/2346732522 >> v2:172.21.2.119:3300/0 conn(0x7ff0c80b1e30 0x7ff0c80b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 -- 172.21.2.135:0/2346732522 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80b0910 con 0x7ff0c80a7140 2021-11-15T14:43:24.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0ceaa4700 1 --2- 172.21.2.135:0/2346732522 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80a7140 0x7ff0c81447a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7ff0c00032f0 tx=0x7ff0c0009290).ready entity=mon.1 client_cookie=454cca08d3960da3 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0cd2a1700 1 -- 172.21.2.135:0/2346732522 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c000b870 con 0x7ff0c80a7140 2021-11-15T14:43:24.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0cd2a1700 1 -- 172.21.2.135:0/2346732522 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000b9d0 con 0x7ff0c80a7140 2021-11-15T14:43:24.565 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0cd2a1700 1 -- 172.21.2.135:0/2346732522 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c000bb80 con 0x7ff0c80a7140 2021-11-15T14:43:24.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- 172.21.2.135:0/2346732522 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80a7140 msgr2=0x7ff0c81447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2346732522 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80a7140 0x7ff0c81447a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7ff0c00032f0 tx=0x7ff0c0009290).stop 2021-11-15T14:43:24.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- 172.21.2.135:0/2346732522 shutdown_connections 2021-11-15T14:43:24.566 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2346732522 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80a7140 0x7ff0c81447a0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2346732522 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c8148420 0x7ff0c80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2346732522 >> v2:172.21.2.119:3300/0 conn(0x7ff0c80b1e30 0x7ff0c80b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- 172.21.2.135:0/2346732522 >> 172.21.2.135:0/2346732522 conn(0x7ff0c805f730 msgr2=0x7ff0c805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.567 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- 172.21.2.135:0/2346732522 shutdown_connections 2021-11-15T14:43:24.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.552+0000 7ff0d0507700 1 -- 172.21.2.135:0/2346732522 wait complete. 2021-11-15T14:43:24.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 Processor -- start 2021-11-15T14:43:24.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- start start 2021-11-15T14:43:24.568 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c80a7140 0x7ff0c814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c8148420 0x7ff0c80ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80ae850 con 0x7ff0c8148420 2021-11-15T14:43:24.569 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80aeaf0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80aed90 con 0x7ff0c80a7140 2021-11-15T14:43:24.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.570 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35590/0 (socket says 172.21.2.135:35590) 2021-11-15T14:43:24.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 -- 172.21.2.135:0/2318668939 learned_addr learned my addr 172.21.2.135:0/2318668939 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:24.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 -- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c80a7140 msgr2=0x7ff0c814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c80a7140 0x7ff0c814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 -- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c8148420 msgr2=0x7ff0c80ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c8148420 0x7ff0c80ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 -- 172.21.2.135:0/2318668939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0009530 con 0x7ff0c80b1e30 2021-11-15T14:43:24.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0cdaa2700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7ff0c4000ed0 tx=0x7ff0c4006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.572 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c4009e00 con 0x7ff0c80b1e30 2021-11-15T14:43:24.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4012410 con 0x7ff0c80b1e30 2021-11-15T14:43:24.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8149f20 con 0x7ff0c80b1e30 2021-11-15T14:43:24.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c4012770 con 0x7ff0c80b1e30 2021-11-15T14:43:24.573 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c814ade0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c80aef50 con 0x7ff0c80b1e30 2021-11-15T14:43:24.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff0c400f030 con 0x7ff0c80b1e30 2021-11-15T14:43:24.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 0x7ff0a8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.574 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.556+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff0c406b3c0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.560+0000 7ff0ce2a3700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 0x7ff0a8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.560+0000 7ff0ce2a3700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 0x7ff0a8055b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7ff0bc002fb0 tx=0x7ff0bc0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.575 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.560+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0c40426a0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0c80b0bb0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0bb7fe700 1 -- 172.21.2.135:0/2318668939 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1559 (secure 0 0 0) 0x7ff0c4045cc0 con 0x7ff0c80b1e30 2021-11-15T14:43:24.672 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:24.673 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/134886050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":134886050},{"type":"v1","addr":"172.21.2.119:6835","nonce":134886050}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[]} 2021-11-15T14:43:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 msgr2=0x7ff0a8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 0x7ff0a8055b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7ff0bc002fb0 tx=0x7ff0bc0069b0).stop 2021-11-15T14:43:24.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 msgr2=0x7ff0c814b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7ff0c4000ed0 tx=0x7ff0c4006d60).stop 2021-11-15T14:43:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 shutdown_connections 2021-11-15T14:43:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff0a8053660 0x7ff0a8055b20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff0c8148420 0x7ff0c80ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff0c80b1e30 0x7ff0c814b730 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 --2- 172.21.2.135:0/2318668939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff0c80a7140 0x7ff0c814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 >> 172.21.2.135:0/2318668939 conn(0x7ff0c805f730 msgr2=0x7ff0c80b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 shutdown_connections 2021-11-15T14:43:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.668+0000 7ff0d0507700 1 -- 172.21.2.135:0/2318668939 wait complete. 2021-11-15T14:43:24.677 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 73 2021-11-15T14:43:24.679 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:24.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 Processor -- start 2021-11-15T14:43:24.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 -- start start 2021-11-15T14:43:24.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc1340b6980 0x7fc1340acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340aa650 0x7fc13413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340b6d60 con 0x7fc134060990 2021-11-15T14:43:24.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134061260 con 0x7fc1340b6980 2021-11-15T14:43:24.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc139bf6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc134061500 con 0x7fc1340aa650 2021-11-15T14:43:24.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc132ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc134060990 0x7fc1340a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51422/0 (socket says 172.21.2.135:51422) 2021-11-15T14:43:24.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc132ffd700 1 -- 172.21.2.135:0/2304010861 learned_addr learned my addr 172.21.2.135:0/2304010861 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:24.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc1337fe700 1 --2- 172.21.2.135:0/2304010861 >> v2:172.21.2.135:3300/0 conn(0x7fc1340b6980 0x7fc1340acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.724+0000 7fc1327fc700 1 -- 172.21.2.135:0/2304010861 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264905934 0 0) 0x7fc1340b6d60 con 0x7fc134060990 2021-11-15T14:43:24.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1327fc700 1 -- 172.21.2.135:0/2304010861 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc114003260 con 0x7fc134060990 2021-11-15T14:43:24.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/2304010861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340aa650 msgr2=0x7fc13413c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:24.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- 172.21.2.135:0/2304010861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340aa650 0x7fc13413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/2304010861 >> v1:172.21.2.135:6789/0 conn(0x7fc134060990 legacy=0x7fc1340a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/2304010861 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340617a0 con 0x7fc1340b6980 2021-11-15T14:43:24.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- 172.21.2.135:0/2304010861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1340b6980 0x7fc1340acdd0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fc124002f70 tx=0x7fc124007f00).ready entity=mon.1 client_cookie=56c36755125dbd2a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1327fc700 1 -- 172.21.2.135:0/2304010861 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400e4a0 con 0x7fc1340b6980 2021-11-15T14:43:24.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1327fc700 1 -- 172.21.2.135:0/2304010861 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc124000e90 con 0x7fc1340b6980 2021-11-15T14:43:24.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1327fc700 1 -- 172.21.2.135:0/2304010861 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400e7f0 con 0x7fc1340b6980 2021-11-15T14:43:24.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/2304010861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1340b6980 msgr2=0x7fc1340acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- 172.21.2.135:0/2304010861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1340b6980 0x7fc1340acdd0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fc124002f70 tx=0x7fc124007f00).stop 2021-11-15T14:43:24.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/2304010861 shutdown_connections 2021-11-15T14:43:24.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- 172.21.2.135:0/2304010861 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340aa650 0x7fc13413c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- 172.21.2.135:0/2304010861 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc1340b6980 0x7fc1340acdd0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/2304010861 >> 172.21.2.135:0/2304010861 conn(0x7fc1340b3500 msgr2=0x7fc1340b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/2304010861 shutdown_connections 2021-11-15T14:43:24.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/2304010861 wait complete. 2021-11-15T14:43:24.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 Processor -- start 2021-11-15T14:43:24.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- start start 2021-11-15T14:43:24.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1340aa650 0x7fc13415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340b6980 0x7fc1340a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341568d0 con 0x7fc1340aa650 2021-11-15T14:43:24.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13415ad50 con 0x7fc134060990 2021-11-15T14:43:24.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc134135050 con 0x7fc1340b6980 2021-11-15T14:43:24.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35604/0 (socket says 172.21.2.135:35604) 2021-11-15T14:43:24.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/833838711 learned_addr learned my addr 172.21.2.135:0/833838711 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:24.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340b6980 msgr2=0x7fc1340a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340b6980 0x7fc1340a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1340aa650 msgr2=0x7fc13415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1340aa650 0x7fc13415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 -- 172.21.2.135:0/833838711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12400c200 con 0x7fc134060990 2021-11-15T14:43:24.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc1337fe700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fc134134450 tx=0x7fc124016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1240073f0 con 0x7fc134060990 2021-11-15T14:43:24.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc124007550 con 0x7fc134060990 2021-11-15T14:43:24.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1240058e0 con 0x7fc134060990 2021-11-15T14:43:24.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1341352f0 con 0x7fc134060990 2021-11-15T14:43:24.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134134b80 con 0x7fc134060990 2021-11-15T14:43:24.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.728+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc134061a40 con 0x7fc134060990 2021-11-15T14:43:24.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc124010070 con 0x7fc134060990 2021-11-15T14:43:24.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc130ff9700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 0x7fc118055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc12406c640 con 0x7fc134060990 2021-11-15T14:43:24.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc132ffd700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 0x7fc118055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc132ffd700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 0x7fc118055bb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fc11c001110 tx=0x7fc11c0076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.732+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc124043920 con 0x7fc134060990 2021-11-15T14:43:24.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.840+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1340573d0 con 0x7fc134060990 2021-11-15T14:43:24.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc130ff9700 1 -- 172.21.2.135:0/833838711 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1559 (secure 0 0 0) 0x7fc124046f40 con 0x7fc134060990 2021-11-15T14:43:24.846 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:24.847 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/134886050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":134886050},{"type":"v1","addr":"172.21.2.119:6835","nonce":134886050}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6834/2285528320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":2285528320},{"type":"v1","addr":"172.21.2.135:6834","nonce":2285528320}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8035,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6835/3296187598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":3296187598},{"type":"v1","addr":"172.21.2.135:6835","nonce":3296187598}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[]} 2021-11-15T14:43:24.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 msgr2=0x7fc118055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 0x7fc118055bb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fc11c001110 tx=0x7fc11c0076c0).stop 2021-11-15T14:43:24.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 msgr2=0x7fc13414ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fc134134450 tx=0x7fc124016000).stop 2021-11-15T14:43:24.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 shutdown_connections 2021-11-15T14:43:24.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc1180536f0 0x7fc118055bb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc1340b6980 0x7fc1340a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc1340aa650 0x7fc13415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:24.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 --2- 172.21.2.135:0/833838711 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc134060990 0x7fc13414ebb0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 >> 172.21.2.135:0/833838711 conn(0x7fc1340b3500 msgr2=0x7fc1340b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 shutdown_connections 2021-11-15T14:43:24.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.844+0000 7fc139bf6700 1 -- 172.21.2.135:0/833838711 wait complete. 2021-11-15T14:43:24.851 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 73 2021-11-15T14:43:24.854 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:43:24.854 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:43:24.855 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:43:24.855 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:24.855 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:43:24.856 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:43:24.856 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:43:24.856 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:24.857 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:43:24.857 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:43:24.857 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:43:24.858 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:24.860 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:43:24.861 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:43:24.862 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:43:24.863 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:43:24.864 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:43:24.864 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:24.865 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:43:24.866 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:24.869 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:43:24.869 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:43:24.871 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:43:24.871 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:24.872 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:43:24.897 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:43:24.898 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:43:24.905 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:43:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 Processor -- start 2021-11-15T14:43:24.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- start start 2021-11-15T14:43:24.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f39fc0a9bf0 0x7f39fc0b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0aa410 con 0x7f39fc0b1f90 2021-11-15T14:43:24.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0ab2e0 con 0x7f39fc0b0140 2021-11-15T14:43:24.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39fc0b0520 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fa59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f39fc0b0140 0x7f39fc0aabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51458/0 (socket says 172.21.2.135:51458) 2021-11-15T14:43:24.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fa59c700 1 -- 172.21.2.135:0/616210560 learned_addr learned my addr 172.21.2.135:0/616210560 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:24.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fad9d700 1 --2- 172.21.2.135:0/616210560 >> v2:172.21.2.135:3300/0 conn(0x7f39fc0a9bf0 0x7f39fc0b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fad9d700 1 -- 172.21.2.135:0/616210560 >> v1:172.21.2.135:6789/0 conn(0x7f39fc0b0140 legacy=0x7f39fc0aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fad9d700 1 -- 172.21.2.135:0/616210560 >> v1:172.21.2.119:6789/0 conn(0x7f39fc0b1f90 legacy=0x7f39fc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:24.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fad9d700 1 -- 172.21.2.135:0/616210560 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0aa170 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39fad9d700 1 --2- 172.21.2.135:0/616210560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc0b19a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f39fc0ada60 tx=0x7f39f40091d0).ready entity=mon.1 client_cookie=db0540aaff9fa394 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39f959a700 1 -- 172.21.2.135:0/616210560 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4009ea0 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39f959a700 1 -- 172.21.2.135:0/616210560 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f400b860 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f39f959a700 1 -- 172.21.2.135:0/616210560 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f400b9d0 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- 172.21.2.135:0/616210560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0a9bf0 msgr2=0x7f39fc0b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 --2- 172.21.2.135:0/616210560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc0b19a0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f39fc0ada60 tx=0x7f39f40091d0).stop 2021-11-15T14:43:24.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- 172.21.2.135:0/616210560 shutdown_connections 2021-11-15T14:43:24.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 --2- 172.21.2.135:0/616210560 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc0b19a0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- 172.21.2.135:0/616210560 >> 172.21.2.135:0/616210560 conn(0x7f39fc060840 msgr2=0x7f39fc060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:24.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- 172.21.2.135:0/616210560 shutdown_connections 2021-11-15T14:43:24.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- 172.21.2.135:0/616210560 wait complete. 2021-11-15T14:43:24.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 Processor -- start 2021-11-15T14:43:24.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.924+0000 7f3a009e4700 1 -- start start 2021-11-15T14:43:24.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f39fc0b1f90 0x7f39fc137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0b5d70 con 0x7f39fc0a9bf0 2021-11-15T14:43:24.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc05efb0 con 0x7f39fc0b0140 2021-11-15T14:43:24.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1379a0 con 0x7f39fc0b1f90 2021-11-15T14:43:24.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35646/0 (socket says 172.21.2.135:35646) 2021-11-15T14:43:24.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 -- 172.21.2.135:0/2566564914 learned_addr learned my addr 172.21.2.135:0/2566564914 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:24.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39fad9d700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f39fc0b1f90 0x7f39fc137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39fa59c700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 -- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f39fc0b1f90 msgr2=0x7f39fc137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f39fc0b1f90 0x7f39fc137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 -- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 msgr2=0x7f39fc13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:24.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc13aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:24.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 -- 172.21.2.135:0/2566564914 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4009470 con 0x7f39fc0b0140 2021-11-15T14:43:24.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39fa59c700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc13aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:24.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39f9d9b700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f39f0002ef0 tx=0x7f39f0006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f0009e00 con 0x7f39fc0b0140 2021-11-15T14:43:24.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0002320 con 0x7f39fc0b0140 2021-11-15T14:43:24.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc136ee0 con 0x7f39fc0b0140 2021-11-15T14:43:24.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f0002680 con 0x7f39fc0b0140 2021-11-15T14:43:24.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc063e40 con 0x7f39fc0b0140 2021-11-15T14:43:24.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc0573d0 con 0x7f39fc0b0140 2021-11-15T14:43:24.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f39f000f030 con 0x7f39fc0b0140 2021-11-15T14:43:24.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 0x7f39d8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:24.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f39f006b460 con 0x7f39fc0b0140 2021-11-15T14:43:24.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39fa59c700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 0x7f39d8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:24.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.928+0000 7f39fa59c700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 0x7f39d8055a70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f39ec008000 tx=0x7f39ec009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:24.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:24.932+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f39f0042740 con 0x7f39fc0b0140 2021-11-15T14:43:25.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.024+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f39fc0446d0 con 0x7f39fc0b0140 2021-11-15T14:43:25.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f39eb7fe700 1 -- 172.21.2.135:0/2566564914 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v151) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39f0045d60 con 0x7f39fc0b0140 2021-11-15T14:43:25.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 msgr2=0x7f39d8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:25.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 0x7f39d8055a70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f39ec008000 tx=0x7f39ec009040).stop 2021-11-15T14:43:25.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 msgr2=0x7f39fc063950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:25.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f39f0002ef0 tx=0x7f39f0006d40).stop 2021-11-15T14:43:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 shutdown_connections 2021-11-15T14:43:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f39d80535b0 0x7f39d8055a70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:25.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f39fc0b1f90 0x7f39fc137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f39fc0b0140 0x7f39fc063950 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 --2- 172.21.2.135:0/2566564914 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f39fc0a9bf0 0x7f39fc13aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:25.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 >> 172.21.2.135:0/2566564914 conn(0x7f39fc060840 msgr2=0x7f39fc0ac630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 shutdown_connections 2021-11-15T14:43:25.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:25.916+0000 7f3a009e4700 1 -- 172.21.2.135:0/2566564914 wait complete. 2021-11-15T14:43:25.925 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:43:25.927 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:43:25.927 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:43:26.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 Processor -- start 2021-11-15T14:43:26.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 -- start start 2021-11-15T14:43:26.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 0x7fcae0143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0067450 con 0x7fcae00b0760 2021-11-15T14:43:26.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae00b0050 con 0x7fcae00ad0b0 2021-11-15T14:43:26.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcae583f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00b02f0 con 0x7fcae0067070 2021-11-15T14:43:26.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcade7fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcae00ad0b0 0x7fcae0143e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51474/0 (socket says 172.21.2.135:51474) 2021-11-15T14:43:26.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.020+0000 7fcade7fc700 1 -- 172.21.2.135:0/1159660372 learned_addr learned my addr 172.21.2.135:0/1159660372 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:26.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804768444 0 0) 0x7fcae00b0050 con 0x7fcae00ad0b0 2021-11-15T14:43:26.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac0003260 con 0x7fcae00ad0b0 2021-11-15T14:43:26.033 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2804980518 0 0) 0x7fcac0003260 con 0x7fcae00ad0b0 2021-11-15T14:43:26.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 msgr2=0x7fcae0143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 0x7fcae0143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 >> v1:172.21.2.119:6789/0 conn(0x7fcae00b0760 legacy=0x7fcae00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.034 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00af420 con 0x7fcae00ad0b0 2021-11-15T14:43:26.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fcac8001660 con 0x7fcae00ad0b0 2021-11-15T14:43:26.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 >> v1:172.21.2.135:6789/0 conn(0x7fcae00ad0b0 legacy=0x7fcae0143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac00037d0 0x7fcac0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.035 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcac0004500 0x7fcac0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 0x7fcac000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00b02f0 con 0x7fcac00037d0 2021-11-15T14:43:26.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0005280 con 0x7fcac0004500 2021-11-15T14:43:26.036 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac000bc40 con 0x7fcae0067070 2021-11-15T14:43:26.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcac0004500 0x7fcac0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 -- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 msgr2=0x7fcac000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae0067070 0x7fcac000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 -- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac00037d0 msgr2=0x7fcac0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac00037d0 0x7fcac0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 -- 172.21.2.135:0/1159660372 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0003260 con 0x7fcac0004500 2021-11-15T14:43:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcade7fc700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcac0004500 0x7fcac0004980 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7fcae00625a0 tx=0x7fcae00afde0).ready entity=mon.1 client_cookie=44ec9729fdbf7d70 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac80070d0 con 0x7fcac0004500 2021-11-15T14:43:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8007230 con 0x7fcac0004500 2021-11-15T14:43:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcaddffb700 1 -- 172.21.2.135:0/1159660372 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac800c8f0 con 0x7fcac0004500 2021-11-15T14:43:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- 172.21.2.135:0/1159660372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcac0004500 msgr2=0x7fcac0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 --2- 172.21.2.135:0/1159660372 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcac0004500 0x7fcac0004980 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7fcae00625a0 tx=0x7fcae00afde0).stop 2021-11-15T14:43:26.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 -- 172.21.2.135:0/1159660372 reap_dead start 2021-11-15T14:43:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- 172.21.2.135:0/1159660372 shutdown_connections 2021-11-15T14:43:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- 172.21.2.135:0/1159660372 >> 172.21.2.135:0/1159660372 conn(0x7fcae005f730 msgr2=0x7fcae005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- 172.21.2.135:0/1159660372 shutdown_connections 2021-11-15T14:43:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- 172.21.2.135:0/1159660372 wait complete. 2021-11-15T14:43:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 Processor -- start 2021-11-15T14:43:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- start start 2021-11-15T14:43:26.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac0004500 0x7fcae0146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae00a0df0 0x7fcae0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae009fd70 con 0x7fcac0004500 2021-11-15T14:43:26.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00a03e0 con 0x7fcae0156710 2021-11-15T14:43:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcae583f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00a0680 con 0x7fcae00a0df0 2021-11-15T14:43:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35670/0 (socket says 172.21.2.135:35670) 2021-11-15T14:43:26.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 -- 172.21.2.135:0/3244120763 learned_addr learned my addr 172.21.2.135:0/3244120763 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 -- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae00a0df0 msgr2=0x7fcae0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae00a0df0 0x7fcae0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 -- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac0004500 msgr2=0x7fcae0146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac0004500 0x7fcae0146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 -- 172.21.2.135:0/3244120763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00a0920 con 0x7fcae0156710 2021-11-15T14:43:26.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcadf7fe700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fcae00a3a80 tx=0x7fcad8007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad8007170 con 0x7fcae0156710 2021-11-15T14:43:26.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.024+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80072d0 con 0x7fcae0156710 2021-11-15T14:43:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae0155d80 con 0x7fcae0156710 2021-11-15T14:43:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0156b90 con 0x7fcae0156710 2021-11-15T14:43:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad8007670 con 0x7fcae0156710 2021-11-15T14:43:26.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0155f10 con 0x7fcae0156710 2021-11-15T14:43:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcad8004850 con 0x7fcae0156710 2021-11-15T14:43:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcad7fff700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 0x7fcac4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fcad806b060 con 0x7fcae0156710 2021-11-15T14:43:26.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcadeffd700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 0x7fcac4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcadeffd700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 0x7fcac4055b60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fcad0002f70 tx=0x7fcad0006a10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.028+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcad8042340 con 0x7fcae0156710 2021-11-15T14:43:26.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcae00573d0 con 0x7fcae0156710 2021-11-15T14:43:26.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcad7fff700 1 -- 172.21.2.135:0/3244120763 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fcad8045960 con 0x7fcae0156710 2021-11-15T14:43:26.214 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:26.215 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:26.215 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:43:26.215 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.215 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:43:26.216 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:43:26.216 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.216 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:26.216 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.217 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.217 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.217 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.217 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.217 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.218 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:43:26.218 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:43:26.218 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.220 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:26.221 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.222 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.222 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.223 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.224 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.226 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.226 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:43:26.227 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:43:26.227 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.227 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:26.228 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.228 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.228 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.229 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.229 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.229 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.230 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:43:26.230 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:43:26.230 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.231 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.231 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.231 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.232 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.232 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.232 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.233 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:43:26.233 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:43:26.233 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.233 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.234 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.234 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.235 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.235 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.235 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.236 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:43:26.236 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:43:26.236 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.237 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.237 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.237 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.238 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.238 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.238 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.239 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:43:26.239 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:43:26.239 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.239 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.240 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.240 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.240 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.241 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.241 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.241 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:43:26.242 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:43:26.242 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.242 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.243 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.243 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.243 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.244 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.244 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.244 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:43:26.245 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:43:26.245 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.245 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.246 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.246 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.246 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.247 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.247 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.247 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:43:26.248 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:43:26.248 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.248 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.249 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.249 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.249 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.249 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.250 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.250 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:43:26.250 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:43:26.251 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.251 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.251 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.252 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.252 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.252 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.253 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.253 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:43:26.253 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:43:26.253 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.254 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:26.254 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:43:26.254 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:43:26.255 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.255 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.255 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.256 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:43:26.256 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:43:26.256 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.257 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:26.257 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:43:26.257 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:43:26.258 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.258 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.258 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.259 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:43:26.259 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:43:26.259 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:26.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:26.260 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:26.261 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.261 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.261 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.262 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.262 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:43:26.262 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:43:26.262 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.263 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:26.263 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:43:26.263 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.264 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.264 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.264 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.265 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:43:26.265 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:43:26.265 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:26.266 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:26.266 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:43:26.267 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:26.267 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.267 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.268 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:26.268 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:26.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 msgr2=0x7fcac4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 0x7fcac4055b60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fcad0002f70 tx=0x7fcad0006a10).stop 2021-11-15T14:43:26.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 msgr2=0x7fcae00aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7fcae00a3a80 tx=0x7fcad8007e50).stop 2021-11-15T14:43:26.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 shutdown_connections 2021-11-15T14:43:26.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcac40536a0 0x7fcac4055b60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcae0156710 0x7fcae00aaf90 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcae00a0df0 0x7fcae0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 --2- 172.21.2.135:0/3244120763 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcac0004500 0x7fcae0146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 >> 172.21.2.135:0/3244120763 conn(0x7fcae005f730 msgr2=0x7fcae01495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 shutdown_connections 2021-11-15T14:43:26.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.140+0000 7fcae583f700 1 -- 172.21.2.135:0/3244120763 wait complete. 2021-11-15T14:43:26.274 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 Processor -- start 2021-11-15T14:43:26.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- start start 2021-11-15T14:43:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff814148420 0x7ff8140b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff8140a7140 0x7ff8141447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140b03d0 con 0x7ff8140b1e30 2021-11-15T14:43:26.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140a9140 con 0x7ff8140a7140 2021-11-15T14:43:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140b0670 con 0x7ff814148420 2021-11-15T14:43:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff814148420 0x7ff8140b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff814148420 0x7ff8140b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35674/0 (socket says 172.21.2.135:35674) 2021-11-15T14:43:26.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/3574170710 learned_addr learned my addr 172.21.2.135:0/3574170710 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/3574170710 >> v2:172.21.2.119:3300/0 conn(0x7ff8140a7140 msgr2=0x7ff8141447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- 172.21.2.135:0/3574170710 >> v2:172.21.2.119:3300/0 conn(0x7ff8140a7140 0x7ff8141447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/3574170710 >> v1:172.21.2.119:6789/0 conn(0x7ff8140b1e30 legacy=0x7ff8140b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/3574170710 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140b0910 con 0x7ff814148420 2021-11-15T14:43:26.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- 172.21.2.135:0/3574170710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff814148420 0x7ff8140b1050 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7ff8140acee0 tx=0x7ff804006eb0).ready entity=mon.1 client_cookie=4facaaf9636870f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff803fff700 1 -- 172.21.2.135:0/3574170710 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80400d5c0 con 0x7ff814148420 2021-11-15T14:43:26.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff803fff700 1 -- 172.21.2.135:0/3574170710 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804000e90 con 0x7ff814148420 2021-11-15T14:43:26.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff803fff700 1 -- 172.21.2.135:0/3574170710 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80400d950 con 0x7ff814148420 2021-11-15T14:43:26.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- 172.21.2.135:0/3574170710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff814148420 msgr2=0x7ff8140b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/3574170710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff814148420 0x7ff8140b1050 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7ff8140acee0 tx=0x7ff804006eb0).stop 2021-11-15T14:43:26.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- 172.21.2.135:0/3574170710 shutdown_connections 2021-11-15T14:43:26.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/3574170710 >> v2:172.21.2.119:3300/0 conn(0x7ff8140a7140 0x7ff8141447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/3574170710 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff814148420 0x7ff8140b1050 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- 172.21.2.135:0/3574170710 >> 172.21.2.135:0/3574170710 conn(0x7ff81405f730 msgr2=0x7ff81405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- 172.21.2.135:0/3574170710 shutdown_connections 2021-11-15T14:43:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- 172.21.2.135:0/3574170710 wait complete. 2021-11-15T14:43:26.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 Processor -- start 2021-11-15T14:43:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- start start 2021-11-15T14:43:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8140a7140 0x7ff8140aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff814148420 0x7ff814142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81414b880 con 0x7ff8140a7140 2021-11-15T14:43:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81414bae0 con 0x7ff8140b1e30 2021-11-15T14:43:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff81b4fd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff814148b40 con 0x7ff814148420 2021-11-15T14:43:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35682/0 (socket says 172.21.2.135:35682) 2021-11-15T14:43:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/711088014 learned_addr learned my addr 172.21.2.135:0/711088014 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff814148420 msgr2=0x7ff814142670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff814148420 0x7ff814142670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8140a7140 msgr2=0x7ff8140aa230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:26.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8140a7140 0x7ff8140aa230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 -- 172.21.2.135:0/711088014 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80400b1e0 con 0x7ff8140b1e30 2021-11-15T14:43:26.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.332+0000 7ff818a98700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7ff8140acee0 tx=0x7ff804015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff804006be0 con 0x7ff8140b1e30 2021-11-15T14:43:26.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400de70 con 0x7ff8140b1e30 2021-11-15T14:43:26.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff814148de0 con 0x7ff8140b1e30 2021-11-15T14:43:26.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff804002f70 con 0x7ff8140b1e30 2021-11-15T14:43:26.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8140a94c0 con 0x7ff8140b1e30 2021-11-15T14:43:26.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8140b0bb0 con 0x7ff8140b1e30 2021-11-15T14:43:26.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff804025030 con 0x7ff8140b1e30 2021-11-15T14:43:26.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 0x7ff7f4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff80406c9c0 con 0x7ff8140b1e30 2021-11-15T14:43:26.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff819299700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 0x7ff7f4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff819299700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 0x7ff7f4055b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff80c003310 tx=0x7ff80c006cb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.336+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff804043d00 con 0x7ff8140b1e30 2021-11-15T14:43:26.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8140573d0 con 0x7ff8140b1e30 2021-11-15T14:43:26.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff8027fc700 1 -- 172.21.2.135:0/711088014 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+13424 (secure 0 0 0) 0x7ff804023020 con 0x7ff8140b1e30 2021-11-15T14:43:26.425 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:26.425 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":151,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:25.911610+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:26.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 msgr2=0x7ff7f4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 0x7ff7f4055b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff80c003310 tx=0x7ff80c006cb0).stop 2021-11-15T14:43:26.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 msgr2=0x7ff81414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7ff8140acee0 tx=0x7ff804015000).stop 2021-11-15T14:43:26.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 shutdown_connections 2021-11-15T14:43:26.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff7f40536a0 0x7ff7f4055b60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff814148420 0x7ff814142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff8140b1e30 0x7ff81414a4e0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 --2- 172.21.2.135:0/711088014 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff8140a7140 0x7ff8140aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.428 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 >> 172.21.2.135:0/711088014 conn(0x7ff81405f730 msgr2=0x7ff8140b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 shutdown_connections 2021-11-15T14:43:26.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.420+0000 7ff81b4fd700 1 -- 172.21.2.135:0/711088014 wait complete. 2021-11-15T14:43:26.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:43:26.432 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:26.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 Processor -- start 2021-11-15T14:43:26.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 -- start start 2021-11-15T14:43:26.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f837413ca40 0x7f83740b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740b5fc0 con 0x7f83740ad0c0 2021-11-15T14:43:26.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740ad4a0 con 0x7f83740afb70 2021-11-15T14:43:26.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f837abd8700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740aebe0 con 0x7f837413ca40 2021-11-15T14:43:26.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f83740afb70 0x7f837413f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51512/0 (socket says 172.21.2.135:51512) 2021-11-15T14:43:26.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 -- 172.21.2.135:0/3952816355 learned_addr learned my addr 172.21.2.135:0/3952816355 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:26.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876539211 0 0) 0x7f83740ad4a0 con 0x7f83740afb70 2021-11-15T14:43:26.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8354003260 con 0x7f83740afb70 2021-11-15T14:43:26.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3277698121 0 0) 0x7f8354003260 con 0x7f83740afb70 2021-11-15T14:43:26.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 >> v2:172.21.2.119:3300/0 conn(0x7f837413ca40 msgr2=0x7f83740b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 --2- 172.21.2.135:0/3952816355 >> v2:172.21.2.119:3300/0 conn(0x7f837413ca40 0x7f83740b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 >> v1:172.21.2.119:6789/0 conn(0x7f83740ad0c0 legacy=0x7f837413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740aee80 con 0x7f83740afb70 2021-11-15T14:43:26.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f836c0019e0 con 0x7f83740afb70 2021-11-15T14:43:26.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 >> v1:172.21.2.135:6789/0 conn(0x7f83740afb70 legacy=0x7f837413f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354003820 0x7f8354003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8354004500 0x7f8354004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 0x7f835400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740aebe0 con 0x7f8354003820 2021-11-15T14:43:26.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835400d050 con 0x7f8354005050 2021-11-15T14:43:26.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835400d210 con 0x7f8354004500 2021-11-15T14:43:26.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 0x7f835400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 -- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8354004500 msgr2=0x7f8354004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8354004500 0x7f8354004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 -- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354003820 msgr2=0x7f8354003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354003820 0x7f8354003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 -- 172.21.2.135:0/3952816355 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354003260 con 0x7f8354005050 2021-11-15T14:43:26.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 -- 172.21.2.135:0/3952816355 reap_dead start 2021-11-15T14:43:26.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f8379175700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 0x7f835400c860 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f8374062980 tx=0x7f83740b12f0).ready entity=mon.1 client_cookie=65a80e0961c45a1e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c00dcb0 con 0x7f8354005050 2021-11-15T14:43:26.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00de10 con 0x7f8354005050 2021-11-15T14:43:26.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.484+0000 7f83737fe700 1 -- 172.21.2.135:0/3952816355 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c00f620 con 0x7f8354005050 2021-11-15T14:43:26.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 msgr2=0x7f835400c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 0x7f835400c860 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f8374062980 tx=0x7f83740b12f0).stop 2021-11-15T14:43:26.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/3952816355 shutdown_connections 2021-11-15T14:43:26.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 --2- 172.21.2.135:0/3952816355 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8354005050 0x7f835400c860 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/3952816355 >> 172.21.2.135:0/3952816355 conn(0x7f837405c510 msgr2=0x7f837405c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/3952816355 shutdown_connections 2021-11-15T14:43:26.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/3952816355 wait complete. 2021-11-15T14:43:26.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 Processor -- start 2021-11-15T14:43:26.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- start start 2021-11-15T14:43:26.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354005050 0x7f83741410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8374145e30 0x7f8374065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374141ef0 con 0x7f8354005050 2021-11-15T14:43:26.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374064fa0 con 0x7f8374153680 2021-11-15T14:43:26.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83741419b0 con 0x7f8374145e30 2021-11-15T14:43:26.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35704/0 (socket says 172.21.2.135:35704) 2021-11-15T14:43:26.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 -- 172.21.2.135:0/1020378040 learned_addr learned my addr 172.21.2.135:0/1020378040 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 -- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8374145e30 msgr2=0x7f8374065400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8374145e30 0x7f8374065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 -- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354005050 msgr2=0x7f83741410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354005050 0x7f83741410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 -- 172.21.2.135:0/1020378040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374141c50 con 0x7f8374153680 2021-11-15T14:43:26.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8379175700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f8374062980 tx=0x7f836c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c01f070 con 0x7f8374153680 2021-11-15T14:43:26.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c001210 con 0x7f8374153680 2021-11-15T14:43:26.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836c00dcb0 con 0x7f8374153680 2021-11-15T14:43:26.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740658f0 con 0x7f8374153680 2021-11-15T14:43:26.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8374153b30 con 0x7f8374153680 2021-11-15T14:43:26.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8374146270 con 0x7f8374153680 2021-11-15T14:43:26.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f836c02b070 con 0x7f8374153680 2021-11-15T14:43:26.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 0x7f8358055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.488+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f836c06d7f0 con 0x7f8374153680 2021-11-15T14:43:26.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.492+0000 7f8378974700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 0x7f8358055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.492+0000 7f8378974700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 0x7f8358055b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f835c000f70 tx=0x7f835c0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.492+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f836c044b30 con 0x7f8374153680 2021-11-15T14:43:26.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f83740af120 con 0x7f8374153680 2021-11-15T14:43:26.578 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f8371ffb700 1 -- 172.21.2.135:0/1020378040 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v151) v1 ==== 110+0+10 (secure 0 0 0) 0x7f836c048150 con 0x7f8374153680 2021-11-15T14:43:26.579 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:26.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 msgr2=0x7f8358055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 0x7f8358055b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f835c000f70 tx=0x7f835c0069b0).stop 2021-11-15T14:43:26.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 msgr2=0x7f8374137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f8374062980 tx=0x7f836c014000).stop 2021-11-15T14:43:26.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 shutdown_connections 2021-11-15T14:43:26.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8358053640 0x7f8358055b00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8374153680 0x7f8374137a30 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8374145e30 0x7f8374065400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 --2- 172.21.2.135:0/1020378040 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8354005050 0x7f83741410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 >> 172.21.2.135:0/1020378040 conn(0x7f837405c510 msgr2=0x7f837405c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 shutdown_connections 2021-11-15T14:43:26.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.576+0000 7f837abd8700 1 -- 172.21.2.135:0/1020378040 wait complete. 2021-11-15T14:43:26.586 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 Processor -- start 2021-11-15T14:43:26.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- start start 2021-11-15T14:43:26.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8600b1350 0x7fb8600b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb8600b2320 0x7fb8601412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600a7850 con 0x7fb8600b1f40 2021-11-15T14:43:26.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600b17c0 con 0x7fb8600b2320 2021-11-15T14:43:26.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b06d0 con 0x7fb8600b1350 2021-11-15T14:43:26.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85effd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb8600b1f40 0x7fb8600a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51528/0 (socket says 172.21.2.135:51528) 2021-11-15T14:43:26.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85effd700 1 -- 172.21.2.135:0/55446030 learned_addr learned my addr 172.21.2.135:0/55446030 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:26.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004740267 0 0) 0x7fb8600a7850 con 0x7fb8600b1f40 2021-11-15T14:43:26.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb840003260 con 0x7fb8600b1f40 2021-11-15T14:43:26.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/55446030 >> v2:172.21.2.119:3300/0 conn(0x7fb8600b2320 0x7fb8601412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85e7fc700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8600b1350 0x7fb8600b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888912261 0 0) 0x7fb840003260 con 0x7fb8600b1f40 2021-11-15T14:43:26.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8600b1350 msgr2=0x7fb8600b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8600b1350 0x7fb8600b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 >> v2:172.21.2.119:3300/0 conn(0x7fb8600b2320 msgr2=0x7fb8601412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 --2- 172.21.2.135:0/55446030 >> v2:172.21.2.119:3300/0 conn(0x7fb8600b2320 0x7fb8601412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600b0970 con 0x7fb8600b1f40 2021-11-15T14:43:26.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fb848001660 con 0x7fb8600b1f40 2021-11-15T14:43:26.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 >> v1:172.21.2.135:6789/0 conn(0x7fb8600b1f40 legacy=0x7fb8600a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8400037d0 0x7fb840003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb840004500 0x7fb840004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb840004e70 0x7fb84000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b17c0 con 0x7fb840004500 2021-11-15T14:43:26.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600b06d0 con 0x7fb840004e70 2021-11-15T14:43:26.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84000bd70 con 0x7fb8400037d0 2021-11-15T14:43:26.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb840004e70 0x7fb84000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 -- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8400037d0 msgr2=0x7fb840003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb8400037d0 0x7fb840003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 -- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb840004500 msgr2=0x7fb840004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb840004500 0x7fb840004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 -- 172.21.2.135:0/55446030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840003260 con 0x7fb840004e70 2021-11-15T14:43:26.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb840004e70 0x7fb84000b750 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fb85800a000 tx=0x7fb858008040).ready entity=mon.1 client_cookie=189c05d8f418169f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85800c070 con 0x7fb840004e70 2021-11-15T14:43:26.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800e620 con 0x7fb840004e70 2021-11-15T14:43:26.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85dffb700 1 -- 172.21.2.135:0/55446030 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85800e980 con 0x7fb840004e70 2021-11-15T14:43:26.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- 172.21.2.135:0/55446030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb840004e70 msgr2=0x7fb84000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 --2- 172.21.2.135:0/55446030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb840004e70 0x7fb84000b750 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fb85800a000 tx=0x7fb858008040).stop 2021-11-15T14:43:26.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb85f7fe700 1 -- 172.21.2.135:0/55446030 reap_dead start 2021-11-15T14:43:26.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- 172.21.2.135:0/55446030 shutdown_connections 2021-11-15T14:43:26.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.640+0000 7fb865885700 1 -- 172.21.2.135:0/55446030 >> 172.21.2.135:0/55446030 conn(0x7fb86005f730 msgr2=0x7fb86005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- 172.21.2.135:0/55446030 shutdown_connections 2021-11-15T14:43:26.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- 172.21.2.135:0/55446030 wait complete. 2021-11-15T14:43:26.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 Processor -- start 2021-11-15T14:43:26.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- start start 2021-11-15T14:43:26.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb840004e70 0x7fb8601406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb860148ec0 0x7fb86014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600af0b0 con 0x7fb860148ec0 2021-11-15T14:43:26.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86014a850 con 0x7fb8600aeb40 2021-11-15T14:43:26.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86014aaf0 con 0x7fb840004e70 2021-11-15T14:43:26.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35720/0 (socket says 172.21.2.135:35720) 2021-11-15T14:43:26.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 -- 172.21.2.135:0/3831349138 learned_addr learned my addr 172.21.2.135:0/3831349138 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 -- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb840004e70 msgr2=0x7fb8601406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb840004e70 0x7fb8601406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 -- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb860148ec0 msgr2=0x7fb86014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb860148ec0 0x7fb86014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 -- 172.21.2.135:0/3831349138 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860156fe0 con 0x7fb8600aeb40 2021-11-15T14:43:26.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85f7fe700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fb848001840 tx=0x7fb858008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85801d440 con 0x7fb8600aeb40 2021-11-15T14:43:26.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85801d5a0 con 0x7fb8600aeb40 2021-11-15T14:43:26.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb860149a30 con 0x7fb8600aeb40 2021-11-15T14:43:26.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86014a590 con 0x7fb8600aeb40 2021-11-15T14:43:26.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85801d710 con 0x7fb8600aeb40 2021-11-15T14:43:26.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860148bb0 con 0x7fb8600aeb40 2021-11-15T14:43:26.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb85801d870 con 0x7fb8600aeb40 2021-11-15T14:43:26.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 0x7fb844055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fb85806c1e0 con 0x7fb8600aeb40 2021-11-15T14:43:26.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.644+0000 7fb85effd700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 0x7fb844055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.648+0000 7fb85effd700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 0x7fb844055ac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fb848001370 tx=0x7fb8600b2a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.648+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb858043410 con 0x7fb8600aeb40 2021-11-15T14:43:26.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.728+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb86014acb0 con 0x7fb8600aeb40 2021-11-15T14:43:26.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.728+0000 7fb857fff700 1 -- 172.21.2.135:0/3831349138 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v151) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb858046a30 con 0x7fb8600aeb40 2021-11-15T14:43:26.733 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:26.734 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 msgr2=0x7fb844055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 0x7fb844055ac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fb848001370 tx=0x7fb8600b2a80).stop 2021-11-15T14:43:26.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 msgr2=0x7fb860149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fb848001840 tx=0x7fb858008040).stop 2021-11-15T14:43:26.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 shutdown_connections 2021-11-15T14:43:26.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb844053600 0x7fb844055ac0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb8600aeb40 0x7fb860149540 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb860148ec0 0x7fb86014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 --2- 172.21.2.135:0/3831349138 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb840004e70 0x7fb8601406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 >> 172.21.2.135:0/3831349138 conn(0x7fb86005f730 msgr2=0x7fb86013f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 shutdown_connections 2021-11-15T14:43:26.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.732+0000 7fb865885700 1 -- 172.21.2.135:0/3831349138 wait complete. 2021-11-15T14:43:26.741 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:43:26.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 Processor -- start 2021-11-15T14:43:26.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 -- start start 2021-11-15T14:43:26.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fef20144080 0x7fef2014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200aac30 con 0x7fef20060180 2021-11-15T14:43:26.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef20060560 con 0x7fef20067380 2021-11-15T14:43:26.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef27882700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef20066f20 con 0x7fef20144080 2021-11-15T14:43:26.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef24e1d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fef20067380 0x7fef20143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51552/0 (socket says 172.21.2.135:51552) 2021-11-15T14:43:26.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.788+0000 7fef24e1d700 1 -- 172.21.2.135:0/2139529739 learned_addr learned my addr 172.21.2.135:0/2139529739 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:26.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372821675 0 0) 0x7fef20060560 con 0x7fef20067380 2021-11-15T14:43:26.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef08003260 con 0x7fef20067380 2021-11-15T14:43:26.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197967140 0 0) 0x7fef08003260 con 0x7fef20067380 2021-11-15T14:43:26.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 >> v2:172.21.2.119:3300/0 conn(0x7fef20144080 msgr2=0x7fef2014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 --2- 172.21.2.135:0/2139529739 >> v2:172.21.2.119:3300/0 conn(0x7fef20144080 0x7fef2014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 >> v1:172.21.2.119:6789/0 conn(0x7fef20060180 legacy=0x7fef200b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200b3430 con 0x7fef20067380 2021-11-15T14:43:26.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fef14001660 con 0x7fef20067380 2021-11-15T14:43:26.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 >> v1:172.21.2.135:6789/0 conn(0x7fef20067380 legacy=0x7fef20143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08003820 0x7fef08003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef08004500 0x7fef08004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 0x7fef0800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20066f20 con 0x7fef08003820 2021-11-15T14:43:26.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0800bf40 con 0x7fef08005050 2021-11-15T14:43:26.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0800c100 con 0x7fef08004500 2021-11-15T14:43:26.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 0x7fef0800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef2561e700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08003820 0x7fef08003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef08004500 0x7fef08004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 -- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef08004500 msgr2=0x7fef08004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef08004500 0x7fef08004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 -- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08003820 msgr2=0x7fef08003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08003820 0x7fef08003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 -- 172.21.2.135:0/2139529739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08003260 con 0x7fef08005050 2021-11-15T14:43:26.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef08004500 0x7fef08004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:26.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 -- 172.21.2.135:0/2139529739 reap_dead start 2021-11-15T14:43:26.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef25e1f700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 0x7fef0800b750 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fef180032f0 tx=0x7fef18006f90).ready entity=mon.1 client_cookie=c603aac39d74c29d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef1800b460 con 0x7fef08005050 2021-11-15T14:43:26.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800b5c0 con 0x7fef08005050 2021-11-15T14:43:26.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef13fff700 1 -- 172.21.2.135:0/2139529739 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef1800b730 con 0x7fef08005050 2021-11-15T14:43:26.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 msgr2=0x7fef0800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 0x7fef0800b750 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fef180032f0 tx=0x7fef18006f90).stop 2021-11-15T14:43:26.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2139529739 shutdown_connections 2021-11-15T14:43:26.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 --2- 172.21.2.135:0/2139529739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef08005050 0x7fef0800b750 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2139529739 >> 172.21.2.135:0/2139529739 conn(0x7fef2005cfb0 msgr2=0x7fef2005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2139529739 shutdown_connections 2021-11-15T14:43:26.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2139529739 wait complete. 2021-11-15T14:43:26.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 Processor -- start 2021-11-15T14:43:26.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- start start 2021-11-15T14:43:26.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08005050 0x7fef200b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef20061c30 0x7fef200aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20130660 con 0x7fef08005050 2021-11-15T14:43:26.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20133210 con 0x7fef200612c0 2021-11-15T14:43:26.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef20133440 con 0x7fef20061c30 2021-11-15T14:43:26.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35742/0 (socket says 172.21.2.135:35742) 2021-11-15T14:43:26.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 -- 172.21.2.135:0/2634741517 learned_addr learned my addr 172.21.2.135:0/2634741517 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 -- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef20061c30 msgr2=0x7fef200aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef20061c30 0x7fef200aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 -- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08005050 msgr2=0x7fef200b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08005050 0x7fef200b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 -- 172.21.2.135:0/2634741517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef201385b0 con 0x7fef200612c0 2021-11-15T14:43:26.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef24e1d700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fef20138bd0 tx=0x7fef14009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef14007170 con 0x7fef200612c0 2021-11-15T14:43:26.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef140072d0 con 0x7fef200612c0 2021-11-15T14:43:26.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef200b4490 con 0x7fef200612c0 2021-11-15T14:43:26.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef14004920 con 0x7fef200612c0 2021-11-15T14:43:26.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.792+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef20143310 con 0x7fef200612c0 2021-11-15T14:43:26.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef200573d0 con 0x7fef200612c0 2021-11-15T14:43:26.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef1401b060 con 0x7fef200612c0 2021-11-15T14:43:26.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef127fc700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 0x7fef000559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fef1406b2c0 con 0x7fef200612c0 2021-11-15T14:43:26.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef2561e700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 0x7fef000559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef2561e700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 0x7fef000559e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fef1c00b000 tx=0x7fef1c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.796+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef14042490 con 0x7fef200612c0 2021-11-15T14:43:26.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef20069960 con 0x7fef200612c0 2021-11-15T14:43:26.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef127fc700 1 -- 172.21.2.135:0/2634741517 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) v1 ==== 84+0+143 (secure 0 0 0) 0x7fef14019070 con 0x7fef200612c0 2021-11-15T14:43:26.887 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:26.887 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:43:26.887 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.888 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:43:26.888 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:43:26.888 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:26.888 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:26.889 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:43:26.889 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:43:26.889 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:26.889 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:43:26.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 msgr2=0x7fef000559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 0x7fef000559e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fef1c00b000 tx=0x7fef1c009040).stop 2021-11-15T14:43:26.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 msgr2=0x7fef20061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fef20138bd0 tx=0x7fef14009040).stop 2021-11-15T14:43:26.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 shutdown_connections 2021-11-15T14:43:26.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fef00053520 0x7fef000559e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fef20061c30 0x7fef200aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fef200612c0 0x7fef20061740 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 --2- 172.21.2.135:0/2634741517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fef08005050 0x7fef200b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:26.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 >> 172.21.2.135:0/2634741517 conn(0x7fef2005cfb0 msgr2=0x7fef200b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 shutdown_connections 2021-11-15T14:43:26.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.884+0000 7fef27882700 1 -- 172.21.2.135:0/2634741517 wait complete. 2021-11-15T14:43:26.894 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:43:26.894 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:43:26.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 Processor -- start 2021-11-15T14:43:26.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 -- start start 2021-11-15T14:43:26.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 0x7f40580b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.948 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f40580b3790 0x7f405813d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40581439a0 con 0x7f405813dac0 2021-11-15T14:43:26.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4058143c40 con 0x7f40580b3790 2021-11-15T14:43:26.949 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405fef2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058143ee0 con 0x7f40580b0630 2021-11-15T14:43:26.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405e48f700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f405813dac0 0x7f40580b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:60984/0 (socket says 172.21.2.135:60984) 2021-11-15T14:43:26.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405e48f700 1 -- 172.21.2.135:0/1295528686 learned_addr learned my addr 172.21.2.135:0/1295528686 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:26.951 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405dc8e700 1 --2- 172.21.2.135:0/1295528686 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 0x7f40580b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.944+0000 7f405d48d700 1 --2- 172.21.2.135:0/1295528686 >> v2:172.21.2.119:3300/0 conn(0x7f40580b3790 0x7f405813d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/1295528686 >> v2:172.21.2.119:3300/0 conn(0x7f40580b3790 msgr2=0x7f405813d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:26.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- 172.21.2.135:0/1295528686 >> v2:172.21.2.119:3300/0 conn(0x7f40580b3790 0x7f405813d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.952 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/1295528686 >> v1:172.21.2.119:6789/0 conn(0x7f405813dac0 legacy=0x7f40580b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/1295528686 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058144180 con 0x7f40580b0630 2021-11-15T14:43:26.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- 172.21.2.135:0/1295528686 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 0x7f40580b0a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4054002f70 tx=0x7f4054006df0).ready entity=mon.2 client_cookie=3c48aa1c1c0e82e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405cc8c700 1 -- 172.21.2.135:0/1295528686 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f405400d570 con 0x7f40580b0630 2021-11-15T14:43:26.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405cc8c700 1 -- 172.21.2.135:0/1295528686 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054000e90 con 0x7f40580b0630 2021-11-15T14:43:26.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405cc8c700 1 -- 172.21.2.135:0/1295528686 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f405400d8c0 con 0x7f40580b0630 2021-11-15T14:43:26.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/1295528686 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 msgr2=0x7f40580b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- 172.21.2.135:0/1295528686 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 0x7f40580b0a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4054002f70 tx=0x7f4054006df0).stop 2021-11-15T14:43:26.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/1295528686 shutdown_connections 2021-11-15T14:43:26.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- 172.21.2.135:0/1295528686 >> v2:172.21.2.119:3300/0 conn(0x7f40580b3790 0x7f405813d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- 172.21.2.135:0/1295528686 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b0630 0x7f40580b0a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/1295528686 >> 172.21.2.135:0/1295528686 conn(0x7f4058060840 msgr2=0x7f4058060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:26.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/1295528686 shutdown_connections 2021-11-15T14:43:26.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/1295528686 wait complete. 2021-11-15T14:43:26.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 Processor -- start 2021-11-15T14:43:26.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- start start 2021-11-15T14:43:26.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b3790 0x7f405813d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f405813dac0 0x7f4058153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058151390 con 0x7f405813dac0 2021-11-15T14:43:26.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058066770 con 0x7f40580b0630 2021-11-15T14:43:26.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058066a10 con 0x7f40580b3790 2021-11-15T14:43:26.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35756/0 (socket says 172.21.2.135:35756) 2021-11-15T14:43:26.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/2226788226 learned_addr learned my addr 172.21.2.135:0/2226788226 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:26.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405d48d700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b3790 0x7f405813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405e48f700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f405813dac0 0x7f4058153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b3790 msgr2=0x7f405813d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b3790 0x7f405813d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f405813dac0 msgr2=0x7f4058153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:26.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f405813dac0 0x7f4058153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:26.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 -- 172.21.2.135:0/2226788226 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405400b180 con 0x7f40580b0630 2021-11-15T14:43:26.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405dc8e700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f405805fb50 tx=0x7f4054014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4054016070 con 0x7f40580b0630 2021-11-15T14:43:26.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405400de40 con 0x7f40580b0630 2021-11-15T14:43:26.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4058066cb0 con 0x7f40580b0630 2021-11-15T14:43:26.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40580673d0 con 0x7f40580b0630 2021-11-15T14:43:26.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4054013e80 con 0x7f40580b0630 2021-11-15T14:43:26.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.948+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034003410 con 0x7f40580b0630 2021-11-15T14:43:26.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4054025030 con 0x7f40580b0630 2021-11-15T14:43:26.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f404affd700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 0x7f4038055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:26.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f405406c660 con 0x7f40580b0630 2021-11-15T14:43:26.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f405d48d700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 0x7f4038055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:26.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f405d48d700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 0x7f4038055b60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f404c00b000 tx=0x7f404c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:26.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:26.952+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4054043890 con 0x7f40580b0630 2021-11-15T14:43:27.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.036+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4034003c40 con 0x7f40580b0630 2021-11-15T14:43:27.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.916+0000 7f404affd700 1 -- 172.21.2.135:0/2226788226 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v152) v1 ==== 133+0+0 (secure 0 0 0) 0x7f40540230a0 con 0x7f40580b0630 2021-11-15T14:43:27.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 msgr2=0x7f4038055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:27.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 0x7f4038055b60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f404c00b000 tx=0x7f404c006df0).stop 2021-11-15T14:43:27.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 msgr2=0x7f4058150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:27.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f405805fb50 tx=0x7f4054014000).stop 2021-11-15T14:43:27.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 shutdown_connections 2021-11-15T14:43:27.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f40380536a0 0x7f4038055b60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:27.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f405813dac0 0x7f4058153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:27.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f40580b3790 0x7f405813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:27.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 --2- 172.21.2.135:0/2226788226 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f40580b0630 0x7f4058150de0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:27.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 >> 172.21.2.135:0/2226788226 conn(0x7f4058060840 msgr2=0x7f40580aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:27.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 shutdown_connections 2021-11-15T14:43:27.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.920+0000 7f405fef2700 1 -- 172.21.2.135:0/2226788226 wait complete. 2021-11-15T14:43:27.926 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:43:27.930 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:43:27.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 Processor -- start 2021-11-15T14:43:27.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- start start 2021-11-15T14:43:27.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f88640b1f40 0x7f88640b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:27.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 0x7f88641412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:27.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640b04a0 con 0x7f88640b0030 2021-11-15T14:43:27.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640a7850 con 0x7f88640b1f40 2021-11-15T14:43:27.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b06d0 con 0x7f88640b2320 2021-11-15T14:43:27.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8863fff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f88640b0030 0x7f88640a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51582/0 (socket says 172.21.2.135:51582) 2021-11-15T14:43:27.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8863fff700 1 -- 172.21.2.135:0/3854670179 learned_addr learned my addr 172.21.2.135:0/3854670179 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:27.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207186998 0 0) 0x7f88640b04a0 con 0x7f88640b0030 2021-11-15T14:43:27.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8850003260 con 0x7f88640b0030 2021-11-15T14:43:27.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886957d700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 0x7f88641412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:27.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 226578512 0 0) 0x7f8850003260 con 0x7f88640b0030 2021-11-15T14:43:27.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 msgr2=0x7f88641412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:27.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 0x7f88641412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:27.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 >> v2:172.21.2.119:3300/0 conn(0x7f88640b1f40 msgr2=0x7f88640b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:27.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 --2- 172.21.2.135:0/3854670179 >> v2:172.21.2.119:3300/0 conn(0x7f88640b1f40 0x7f88640b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:27.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640b0970 con 0x7f88640b0030 2021-11-15T14:43:27.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8858001660 con 0x7f88640b0030 2021-11-15T14:43:27.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 >> v1:172.21.2.135:6789/0 conn(0x7f88640b0030 legacy=0x7f88640a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:27.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88500037d0 0x7f8850003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:27.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 0x7f8850004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:27.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8850004bf0 0x7f885000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:27.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640a7850 con 0x7f8850004bf0 2021-11-15T14:43:27.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b06d0 con 0x7f88500037d0 2021-11-15T14:43:27.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8850005300 con 0x7f88640b2320 2021-11-15T14:43:27.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88500037d0 0x7f8850003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:27.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 -- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 msgr2=0x7f8850004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:27.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88640b2320 0x7f8850004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:27.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 -- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8850004bf0 msgr2=0x7f885000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:27.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8850004bf0 0x7f885000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:27.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 -- 172.21.2.135:0/3854670179 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850003260 con 0x7f88500037d0 2021-11-15T14:43:27.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f8868d7c700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88500037d0 0x7f8850003bf0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854006ca0).ready entity=mon.1 client_cookie=17d1ce5f3f40e031 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:27.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8854012410 con 0x7f88500037d0 2021-11-15T14:43:27.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854012570 con 0x7f88500037d0 2021-11-15T14:43:27.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f88637fe700 1 -- 172.21.2.135:0/3854670179 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88540128d0 con 0x7f88500037d0 2021-11-15T14:43:27.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- 172.21.2.135:0/3854670179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88500037d0 msgr2=0x7f8850003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:27.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 --2- 172.21.2.135:0/3854670179 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f88500037d0 0x7f8850003bf0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854006ca0).stop 2021-11-15T14:43:27.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886957d700 1 -- 172.21.2.135:0/3854670179 reap_dead start 2021-11-15T14:43:27.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- 172.21.2.135:0/3854670179 shutdown_connections 2021-11-15T14:43:27.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.980+0000 7f886afe0700 1 -- 172.21.2.135:0/3854670179 >> 172.21.2.135:0/3854670179 conn(0x7f886405f730 msgr2=0x7f886405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:27.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- 172.21.2.135:0/3854670179 shutdown_connections 2021-11-15T14:43:27.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- 172.21.2.135:0/3854670179 wait complete. 2021-11-15T14:43:27.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 Processor -- start 2021-11-15T14:43:27.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- start start 2021-11-15T14:43:27.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88500037d0 0x7f88640b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:28.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88640b3b20 0x7f88641570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:28.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:28.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641487c0 con 0x7f88640b3b20 2021-11-15T14:43:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b5be0 con 0x7f8864063800 2021-11-15T14:43:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b4e90 con 0x7f88500037d0 2021-11-15T14:43:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35774/0 (socket says 172.21.2.135:35774) 2021-11-15T14:43:28.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 -- 172.21.2.135:0/6073473 learned_addr learned my addr 172.21.2.135:0/6073473 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:28.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 -- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88500037d0 msgr2=0x7f88640b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:28.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88500037d0 0x7f88640b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:28.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 -- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88640b3b20 msgr2=0x7f88641570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:28.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88640b3b20 0x7f88641570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 -- 172.21.2.135:0/6073473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640b4bf0 con 0x7f8864063800 2021-11-15T14:43:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886957d700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f88580017c0 tx=0x7f885c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885c010580 con 0x7f8864063800 2021-11-15T14:43:28.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0106e0 con 0x7f8864063800 2021-11-15T14:43:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640b5e40 con 0x7f8864063800 2021-11-15T14:43:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640b38c0 con 0x7f8864063800 2021-11-15T14:43:28.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885c010a40 con 0x7f8864063800 2021-11-15T14:43:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640b0c10 con 0x7f8864063800 2021-11-15T14:43:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f885c010ba0 con 0x7f8864063800 2021-11-15T14:43:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 0x7f8844055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f885c06b940 con 0x7f8864063800 2021-11-15T14:43:28.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.984+0000 7f8868d7c700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 0x7f8844055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:28.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.988+0000 7f8868d7c700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 0x7f8844055b60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:28.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:27.988+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f885c042b20 con 0x7f8864063800 2021-11-15T14:43:28.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.072+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f88640573d0 con 0x7f8864063800 2021-11-15T14:43:28.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f8861ffb700 1 -- 172.21.2.135:0/6073473 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v153) v1 ==== 125+0+0 (secure 0 0 0) 0x7f885c046140 con 0x7f8864063800 2021-11-15T14:43:28.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 msgr2=0x7f8844055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:28.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 0x7f8844055b60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854015000).stop 2021-11-15T14:43:28.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 msgr2=0x7f8864063c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:28.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f88580017c0 tx=0x7f885c008040).stop 2021-11-15T14:43:28.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 shutdown_connections 2021-11-15T14:43:28.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f88440536a0 0x7f8844055b60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:28.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8864063800 0x7f8864063c80 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:28.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f88640b3b20 0x7f88641570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:28.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 --2- 172.21.2.135:0/6073473 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f88500037d0 0x7f88640b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:28.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 >> 172.21.2.135:0/6073473 conn(0x7f886405f730 msgr2=0x7f88640af770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:28.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 shutdown_connections 2021-11-15T14:43:28.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.924+0000 7f886afe0700 1 -- 172.21.2.135:0/6073473 wait complete. 2021-11-15T14:43:28.931 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:43:28.934 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:43:28.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 Processor -- start 2021-11-15T14:43:28.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- start start 2021-11-15T14:43:28.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f06c40ad640 0x7f06c4061780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:28.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40aed70 con 0x7f06c41404c0 2021-11-15T14:43:28.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40b6fa0 con 0x7f06c40613a0 2021-11-15T14:43:28.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40aefa0 con 0x7f06c40ad640 2021-11-15T14:43:28.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f06c40613a0 0x7f06c40b9ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51600/0 (socket says 172.21.2.135:51600) 2021-11-15T14:43:29.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 -- 172.21.2.135:0/41749253 learned_addr learned my addr 172.21.2.135:0/41749253 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:29.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757970140 0 0) 0x7f06c40b6fa0 con 0x7f06c40613a0 2021-11-15T14:43:29.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ac003260 con 0x7f06c40613a0 2021-11-15T14:43:29.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152401976 0 0) 0x7f06ac003260 con 0x7f06c40613a0 2021-11-15T14:43:29.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 >> v2:172.21.2.119:3300/0 conn(0x7f06c40ad640 msgr2=0x7f06c4061780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 --2- 172.21.2.135:0/41749253 >> v2:172.21.2.119:3300/0 conn(0x7f06c40ad640 0x7f06c4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 >> v1:172.21.2.119:6789/0 conn(0x7f06c41404c0 legacy=0x7f06c41465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40af240 con 0x7f06c40613a0 2021-11-15T14:43:29.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f06b8001660 con 0x7f06c40613a0 2021-11-15T14:43:29.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 >> v1:172.21.2.135:6789/0 conn(0x7f06c40613a0 legacy=0x7f06c40b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 0x7f06ac003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06ac004500 0x7f06ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac005050 0x7f06ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40aefa0 con 0x7f06ac005050 2021-11-15T14:43:29.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac00bf40 con 0x7f06ac003820 2021-11-15T14:43:29.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac00c100 con 0x7f06ac004500 2021-11-15T14:43:29.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 0x7f06ac003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 -- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06ac004500 msgr2=0x7f06ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06ac004500 0x7f06ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 -- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac005050 msgr2=0x7f06ac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac005050 0x7f06ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 -- 172.21.2.135:0/41749253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac003260 con 0x7f06ac003820 2021-11-15T14:43:29.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06ca2e9700 1 -- 172.21.2.135:0/41749253 reap_dead start 2021-11-15T14:43:29.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 0x7f06ac003c20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f06c40ae1a0 tx=0x7f06c40af3d0).ready entity=mon.1 client_cookie=810fcfe9e5f8e5ec server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b80070d0 con 0x7f06ac003820 2021-11-15T14:43:29.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b8007230 con 0x7f06ac003820 2021-11-15T14:43:29.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06c8ae6700 1 -- 172.21.2.135:0/41749253 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b800c8f0 con 0x7f06ac003820 2021-11-15T14:43:29.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 msgr2=0x7f06ac003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 0x7f06ac003c20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f06c40ae1a0 tx=0x7f06c40af3d0).stop 2021-11-15T14:43:29.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- 172.21.2.135:0/41749253 shutdown_connections 2021-11-15T14:43:29.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 --2- 172.21.2.135:0/41749253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06ac003820 0x7f06ac003c20 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- 172.21.2.135:0/41749253 >> 172.21.2.135:0/41749253 conn(0x7f06c4066e60 msgr2=0x7f06c4067240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- 172.21.2.135:0/41749253 shutdown_connections 2021-11-15T14:43:29.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.988+0000 7f06caaea700 1 -- 172.21.2.135:0/41749253 wait complete. 2021-11-15T14:43:29.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 Processor -- start 2021-11-15T14:43:29.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- start start 2021-11-15T14:43:29.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac003820 0x7f06c40a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c40a8d20 0x7f06c40ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40a83d0 con 0x7f06ac003820 2021-11-15T14:43:29.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40a7ff0 con 0x7f06c40abe20 2021-11-15T14:43:29.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40ac2b0 con 0x7f06c40a8d20 2021-11-15T14:43:29.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35794/0 (socket says 172.21.2.135:35794) 2021-11-15T14:43:29.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 -- 172.21.2.135:0/2122204106 learned_addr learned my addr 172.21.2.135:0/2122204106 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:29.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 -- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c40a8d20 msgr2=0x7f06c40ab930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c40a8d20 0x7f06c40ab930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 -- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac003820 msgr2=0x7f06c40a8830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac003820 0x7f06c40a8830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 -- 172.21.2.135:0/2122204106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40aa090 con 0x7f06c40abe20 2021-11-15T14:43:29.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06ca2e9700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f06c40ab6e0 tx=0x7f06bc007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06bc00cec0 con 0x7f06c40abe20 2021-11-15T14:43:29.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc0070d0 con 0x7f06c40abe20 2021-11-15T14:43:29.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40a7d50 con 0x7f06c40abe20 2021-11-15T14:43:29.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06bc007430 con 0x7f06c40abe20 2021-11-15T14:43:29.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c4146200 con 0x7f06c40abe20 2021-11-15T14:43:29.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40af4e0 con 0x7f06c40abe20 2021-11-15T14:43:29.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06bc01c070 con 0x7f06c40abe20 2021-11-15T14:43:29.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 0x7f06a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f06bc06aaa0 con 0x7f06c40abe20 2021-11-15T14:43:29.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 0x7f06a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.992+0000 7f06c9ae8700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 0x7f06a4055ad0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f06c40ae1a0 tx=0x7f06b8013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:28.996+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06bc041b20 con 0x7f06c40abe20 2021-11-15T14:43:29.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.104+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f06c4062180 con 0x7f06c40abe20 2021-11-15T14:43:29.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06b6ffd700 1 -- 172.21.2.135:0/2122204106 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v75) v1 ==== 189+0+0 (secure 0 0 0) 0x7f06bc045140 con 0x7f06c40abe20 2021-11-15T14:43:29.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 msgr2=0x7f06a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 0x7f06a4055ad0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f06c40ae1a0 tx=0x7f06b8013000).stop 2021-11-15T14:43:29.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 msgr2=0x7f06c4159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f06c40ab6e0 tx=0x7f06bc007dd0).stop 2021-11-15T14:43:29.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 shutdown_connections 2021-11-15T14:43:29.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f06a4053610 0x7f06a4055ad0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f06c40abe20 0x7f06c4159e30 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f06c40a8d20 0x7f06c40ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 --2- 172.21.2.135:0/2122204106 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f06ac003820 0x7f06c40a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 >> 172.21.2.135:0/2122204106 conn(0x7f06c4066e60 msgr2=0x7f06c405ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 shutdown_connections 2021-11-15T14:43:29.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.120+0000 7f06caaea700 1 -- 172.21.2.135:0/2122204106 wait complete. 2021-11-15T14:43:29.129 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 27 and data pool 28 2021-11-15T14:43:29.132 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:29.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 Processor -- start 2021-11-15T14:43:29.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- start start 2021-11-15T14:43:29.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0e840b1e30 0x7f0e840b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e840a7140 0x7f0e841447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e840b03d0 con 0x7f0e84148420 2021-11-15T14:43:29.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840a9140 con 0x7f0e840b1e30 2021-11-15T14:43:29.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840b0670 con 0x7f0e840a7140 2021-11-15T14:43:29.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e840a7140 0x7f0e841447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0e840a7140 0x7f0e841447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35810/0 (socket says 172.21.2.135:35810) 2021-11-15T14:43:29.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 -- 172.21.2.135:0/335901895 learned_addr learned my addr 172.21.2.135:0/335901895 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:29.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 -- 172.21.2.135:0/335901895 >> v2:172.21.2.119:3300/0 conn(0x7f0e840b1e30 msgr2=0x7f0e840b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 --2- 172.21.2.135:0/335901895 >> v2:172.21.2.119:3300/0 conn(0x7f0e840b1e30 0x7f0e840b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 -- 172.21.2.135:0/335901895 >> v1:172.21.2.119:6789/0 conn(0x7f0e84148420 legacy=0x7f0e840b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 -- 172.21.2.135:0/335901895 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e840b0910 con 0x7f0e840a7140 2021-11-15T14:43:29.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e837fe700 1 --2- 172.21.2.135:0/335901895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840a7140 0x7f0e841447a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f0e841477b0 tx=0x7f0e7c009290).ready entity=mon.1 client_cookie=871a3685777c6937 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e81ffb700 1 -- 172.21.2.135:0/335901895 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7c00b820 con 0x7f0e840a7140 2021-11-15T14:43:29.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e81ffb700 1 -- 172.21.2.135:0/335901895 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c00b980 con 0x7f0e840a7140 2021-11-15T14:43:29.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e81ffb700 1 -- 172.21.2.135:0/335901895 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7c00bb30 con 0x7f0e840a7140 2021-11-15T14:43:29.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- 172.21.2.135:0/335901895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840a7140 msgr2=0x7f0e841447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 --2- 172.21.2.135:0/335901895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840a7140 0x7f0e841447a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f0e841477b0 tx=0x7f0e7c009290).stop 2021-11-15T14:43:29.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- 172.21.2.135:0/335901895 shutdown_connections 2021-11-15T14:43:29.191 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 --2- 172.21.2.135:0/335901895 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840a7140 0x7f0e841447a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 --2- 172.21.2.135:0/335901895 >> v2:172.21.2.119:3300/0 conn(0x7f0e840b1e30 0x7f0e840b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- 172.21.2.135:0/335901895 >> 172.21.2.135:0/335901895 conn(0x7f0e8405f730 msgr2=0x7f0e8405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.192 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- 172.21.2.135:0/335901895 shutdown_connections 2021-11-15T14:43:29.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- 172.21.2.135:0/335901895 wait complete. 2021-11-15T14:43:29.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 Processor -- start 2021-11-15T14:43:29.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.180+0000 7f0e896e5700 1 -- start start 2021-11-15T14:43:29.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e840a7140 0x7f0e840a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e84148420 0x7f0e84143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e841444d0 con 0x7f0e840a7140 2021-11-15T14:43:29.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840abb50 con 0x7f0e840b1e30 2021-11-15T14:43:29.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840af8b0 con 0x7f0e84148420 2021-11-15T14:43:29.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35814/0 (socket says 172.21.2.135:35814) 2021-11-15T14:43:29.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 -- 172.21.2.135:0/1816250202 learned_addr learned my addr 172.21.2.135:0/1816250202 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:29.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 -- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e84148420 msgr2=0x7f0e84143fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e84148420 0x7f0e84143fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 -- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e840a7140 msgr2=0x7f0e840a9800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e840a7140 0x7f0e840a9800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 -- 172.21.2.135:0/1816250202 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009530 con 0x7f0e840b1e30 2021-11-15T14:43:29.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e827fc700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f0e74002f10 tx=0x7f0e74006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e74009e00 con 0x7f0e840b1e30 2021-11-15T14:43:29.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400f510 con 0x7f0e840b1e30 2021-11-15T14:43:29.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e840afb50 con 0x7f0e840b1e30 2021-11-15T14:43:29.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7400f680 con 0x7f0e840b1e30 2021-11-15T14:43:29.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e840ae8f0 con 0x7f0e840b1e30 2021-11-15T14:43:29.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e840adee0 con 0x7f0e840b1e30 2021-11-15T14:43:29.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e7400f070 con 0x7f0e840b1e30 2021-11-15T14:43:29.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 0x7f0e68055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0e7406b310 con 0x7f0e840b1e30 2021-11-15T14:43:29.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e82ffd700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 0x7f0e68055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.184+0000 7f0e82ffd700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 0x7f0e68055b60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0e6c002f70 tx=0x7f0e6c006a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.206 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.188+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e74042320 con 0x7f0e840b1e30 2021-11-15T14:43:29.275 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e840aea80 con 0x7f0e840b1e30 2021-11-15T14:43:29.276 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e7bfff700 1 -- 172.21.2.135:0/1816250202 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f0e74045940 con 0x7f0e840b1e30 2021-11-15T14:43:29.277 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:29.277 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":154,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:29.109762+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:27.057306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:28.115642+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:29.278 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 msgr2=0x7f0e68055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 0x7f0e68055b60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0e6c002f70 tx=0x7f0e6c006a00).stop 2021-11-15T14:43:29.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 msgr2=0x7f0e84143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f0e74002f10 tx=0x7f0e74006d60).stop 2021-11-15T14:43:29.279 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 shutdown_connections 2021-11-15T14:43:29.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0e680536a0 0x7f0e68055b60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0e84148420 0x7f0e84143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0e840b1e30 0x7f0e84143af0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 --2- 172.21.2.135:0/1816250202 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0e840a7140 0x7f0e840a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.280 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 >> 172.21.2.135:0/1816250202 conn(0x7f0e8405f730 msgr2=0x7f0e840b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 shutdown_connections 2021-11-15T14:43:29.281 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.272+0000 7f0e896e5700 1 -- 172.21.2.135:0/1816250202 wait complete. 2021-11-15T14:43:29.284 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:29.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 Processor -- start 2021-11-15T14:43:29.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- start start 2021-11-15T14:43:29.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5cf00b6980 0x7f5cf00acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5cf00aa650 0x7f5cf005c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00b6d60 con 0x7f5cf0060990 2021-11-15T14:43:29.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf0061260 con 0x7f5cf00b6980 2021-11-15T14:43:29.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf0061500 con 0x7f5cf00aa650 2021-11-15T14:43:29.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cedd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5cf0060990 0x7f5cf00a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51644/0 (socket says 172.21.2.135:51644) 2021-11-15T14:43:29.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cedd9b700 1 -- 172.21.2.135:0/3654313970 learned_addr learned my addr 172.21.2.135:0/3654313970 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:29.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 --2- 172.21.2.135:0/3654313970 >> v2:172.21.2.135:3300/0 conn(0x7f5cf00aa650 0x7f5cf005c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 -- 172.21.2.135:0/3654313970 >> v2:172.21.2.119:3300/0 conn(0x7f5cf00b6980 msgr2=0x7f5cf00acdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:29.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 --2- 172.21.2.135:0/3654313970 >> v2:172.21.2.119:3300/0 conn(0x7f5cf00b6980 0x7f5cf00acdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 -- 172.21.2.135:0/3654313970 >> v1:172.21.2.135:6789/0 conn(0x7f5cf0060990 legacy=0x7f5cf00a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 -- 172.21.2.135:0/3654313970 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00617a0 con 0x7f5cf00aa650 2021-11-15T14:43:29.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ceed9d700 1 --2- 172.21.2.135:0/3654313970 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf00aa650 0x7f5cf005c510 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f5ce80032f0 tx=0x7f5ce80091d0).ready entity=mon.1 client_cookie=6b178f1b030be4e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ced59a700 1 -- 172.21.2.135:0/3654313970 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce8009ea0 con 0x7f5cf00aa650 2021-11-15T14:43:29.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ced59a700 1 -- 172.21.2.135:0/3654313970 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800b870 con 0x7f5cf00aa650 2021-11-15T14:43:29.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5ced59a700 1 -- 172.21.2.135:0/3654313970 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce800ba20 con 0x7f5cf00aa650 2021-11-15T14:43:29.343 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- 172.21.2.135:0/3654313970 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf00aa650 msgr2=0x7f5cf005c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/3654313970 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf00aa650 0x7f5cf005c510 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f5ce80032f0 tx=0x7f5ce80091d0).stop 2021-11-15T14:43:29.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- 172.21.2.135:0/3654313970 shutdown_connections 2021-11-15T14:43:29.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/3654313970 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf00aa650 0x7f5cf005c510 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/3654313970 >> v2:172.21.2.119:3300/0 conn(0x7f5cf00b6980 0x7f5cf00acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- 172.21.2.135:0/3654313970 >> 172.21.2.135:0/3654313970 conn(0x7f5cf00b3500 msgr2=0x7f5cf00b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- 172.21.2.135:0/3654313970 shutdown_connections 2021-11-15T14:43:29.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.332+0000 7f5cf4c75700 1 -- 172.21.2.135:0/3654313970 wait complete. 2021-11-15T14:43:29.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 Processor -- start 2021-11-15T14:43:29.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- start start 2021-11-15T14:43:29.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cf00aa650 0x7f5cf0137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cf00b6980 0x7f5cf0137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0142ce0 con 0x7f5cf00aa650 2021-11-15T14:43:29.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0137a50 con 0x7f5cf0060990 2021-11-15T14:43:29.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01389c0 con 0x7f5cf00b6980 2021-11-15T14:43:29.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35832/0 (socket says 172.21.2.135:35832) 2021-11-15T14:43:29.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 -- 172.21.2.135:0/889968200 learned_addr learned my addr 172.21.2.135:0/889968200 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:29.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 -- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cf00b6980 msgr2=0x7f5cf0137560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cf00b6980 0x7f5cf0137560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 -- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cf00aa650 msgr2=0x7f5cf0137070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:29.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cf00aa650 0x7f5cf0137070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 -- 172.21.2.135:0/889968200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009470 con 0x7f5cf0060990 2021-11-15T14:43:29.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cee59c700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f5cf0142e20 tx=0x7f5ce0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce0013460 con 0x7f5cf0060990 2021-11-15T14:43:29.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce00135c0 con 0x7f5cf0060990 2021-11-15T14:43:29.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf0143110 con 0x7f5cf0060990 2021-11-15T14:43:29.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce0013920 con 0x7f5cf0060990 2021-11-15T14:43:29.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf013bd10 con 0x7f5cf0060990 2021-11-15T14:43:29.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ce000f070 con 0x7f5cf0060990 2021-11-15T14:43:29.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0061a40 con 0x7f5cf0060990 2021-11-15T14:43:29.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 0x7f5ccc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5ce006b4c0 con 0x7f5cf0060990 2021-11-15T14:43:29.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.336+0000 7f5cedd9b700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 0x7f5ccc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.340+0000 7f5cedd9b700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 0x7f5ccc055ad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f5cf0060380 tx=0x7f5ce40077f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.340+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ce00424d0 con 0x7f5cf0060990 2021-11-15T14:43:29.426 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf00573d0 con 0x7f5cf0060990 2021-11-15T14:43:29.427 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cdf7fe700 1 -- 172.21.2.135:0/889968200 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f5ce0045af0 con 0x7f5cf0060990 2021-11-15T14:43:29.427 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:29.428 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":154,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:29.109762+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:27.057306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:28.115642+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:29.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 msgr2=0x7f5ccc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 0x7f5ccc055ad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f5cf0060380 tx=0x7f5ce40077f0).stop 2021-11-15T14:43:29.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 msgr2=0x7f5cf00afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f5cf0142e20 tx=0x7f5ce0006df0).stop 2021-11-15T14:43:29.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 shutdown_connections 2021-11-15T14:43:29.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ccc053610 0x7f5ccc055ad0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5cf00b6980 0x7f5cf0137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5cf00aa650 0x7f5cf0137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 --2- 172.21.2.135:0/889968200 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5cf0060990 0x7f5cf00afca0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 >> 172.21.2.135:0/889968200 conn(0x7f5cf00b3500 msgr2=0x7f5cf013f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 shutdown_connections 2021-11-15T14:43:29.431 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.424+0000 7f5cf4c75700 1 -- 172.21.2.135:0/889968200 wait complete. 2021-11-15T14:43:29.435 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:43:29.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 Processor -- start 2021-11-15T14:43:29.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- start start 2021-11-15T14:43:29.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f81200b1350 0x7f81200b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 0x7f81201412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200a7850 con 0x7f81200b1f40 2021-11-15T14:43:29.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200b17c0 con 0x7f81200b1350 2021-11-15T14:43:29.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b06d0 con 0x7f81200b2320 2021-11-15T14:43:29.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f81200b1f40 0x7f81200a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51658/0 (socket says 172.21.2.135:51658) 2021-11-15T14:43:29.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 -- 172.21.2.135:0/1502048598 learned_addr learned my addr 172.21.2.135:0/1502048598 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:29.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030265725 0 0) 0x7f81200a7850 con 0x7f81200b1f40 2021-11-15T14:43:29.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8104003260 con 0x7f81200b1f40 2021-11-15T14:43:29.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536993174 0 0) 0x7f8104003260 con 0x7f81200b1f40 2021-11-15T14:43:29.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 msgr2=0x7f81201412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 0x7f81201412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 >> v2:172.21.2.119:3300/0 conn(0x7f81200b1350 msgr2=0x7f81200b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:29.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 --2- 172.21.2.135:0/1502048598 >> v2:172.21.2.119:3300/0 conn(0x7f81200b1350 0x7f81200b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200b0970 con 0x7f81200b1f40 2021-11-15T14:43:29.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8114001660 con 0x7f81200b1f40 2021-11-15T14:43:29.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 >> v1:172.21.2.135:6789/0 conn(0x7f81200b1f40 legacy=0x7f81200a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81040037d0 0x7f8104003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 0x7f8104004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8104004bf0 0x7f810400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b17c0 con 0x7f8104004bf0 2021-11-15T14:43:29.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b06d0 con 0x7f81040037d0 2021-11-15T14:43:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8104005300 con 0x7f81200b2320 2021-11-15T14:43:29.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81040037d0 0x7f8104003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 -- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 msgr2=0x7f8104004500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:29.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f81200b2320 0x7f8104004500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 -- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8104004bf0 msgr2=0x7f810400b750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:29.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8104004bf0 0x7f810400b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 -- 172.21.2.135:0/1502048598 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104003260 con 0x7f81040037d0 2021-11-15T14:43:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811e59c700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81040037d0 0x7f8104003bf0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f8114001370 tx=0x7f81200b0b00).ready entity=mon.1 client_cookie=1ab2a68e22df6dbb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81140070d0 con 0x7f81040037d0 2021-11-15T14:43:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114007230 con 0x7f81040037d0 2021-11-15T14:43:29.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811d59a700 1 -- 172.21.2.135:0/1502048598 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f811400c8f0 con 0x7f81040037d0 2021-11-15T14:43:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- 172.21.2.135:0/1502048598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81040037d0 msgr2=0x7f8104003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 --2- 172.21.2.135:0/1502048598 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f81040037d0 0x7f8104003bf0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f8114001370 tx=0x7f81200b0b00).stop 2021-11-15T14:43:29.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f811ed9d700 1 -- 172.21.2.135:0/1502048598 reap_dead start 2021-11-15T14:43:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- 172.21.2.135:0/1502048598 shutdown_connections 2021-11-15T14:43:29.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- 172.21.2.135:0/1502048598 >> 172.21.2.135:0/1502048598 conn(0x7f812005f730 msgr2=0x7f812005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- 172.21.2.135:0/1502048598 shutdown_connections 2021-11-15T14:43:29.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.484+0000 7f8124b15700 1 -- 172.21.2.135:0/1502048598 wait complete. 2021-11-15T14:43:29.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 Processor -- start 2021-11-15T14:43:29.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- start start 2021-11-15T14:43:29.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 0x7f8120148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8120148bb0 0x7f8120149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015ad40 con 0x7f81040037d0 2021-11-15T14:43:29.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015afe0 con 0x7f812014ae60 2021-11-15T14:43:29.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812014b5a0 con 0x7f8120148bb0 2021-11-15T14:43:29.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35852/0 (socket says 172.21.2.135:35852) 2021-11-15T14:43:29.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 -- 172.21.2.135:0/2766677749 learned_addr learned my addr 172.21.2.135:0/2766677749 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:29.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811e59c700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 0x7f8120148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 -- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8120148bb0 msgr2=0x7f8120149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8120148bb0 0x7f8120149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:29.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 -- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 msgr2=0x7f8120148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:29.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 0x7f8120148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:29.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 -- 172.21.2.135:0/2766677749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200b48d0 con 0x7f812014ae60 2021-11-15T14:43:29.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811e59c700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 0x7f8120148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:29.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811dd9b700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f8110002f70 tx=0x7f8110006e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8110013460 con 0x7f812014ae60 2021-11-15T14:43:29.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81100135c0 con 0x7f812014ae60 2021-11-15T14:43:29.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8110013920 con 0x7f812014ae60 2021-11-15T14:43:29.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200b4550 con 0x7f812014ae60 2021-11-15T14:43:29.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200b61b0 con 0x7f812014ae60 2021-11-15T14:43:29.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812015ab60 con 0x7f812014ae60 2021-11-15T14:43:29.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f811001a060 con 0x7f812014ae60 2021-11-15T14:43:29.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 0x7f80fc055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:29.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f811006b600 con 0x7f812014ae60 2021-11-15T14:43:29.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.488+0000 7f811e59c700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 0x7f80fc055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:29.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.492+0000 7f811e59c700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 0x7f80fc055be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8114005000 tx=0x7f8114013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:29.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.492+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8110042500 con 0x7f812014ae60 2021-11-15T14:43:29.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:29.600+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81200573d0 con 0x7f812014ae60 2021-11-15T14:43:30.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f810f7fe700 1 -- 172.21.2.135:0/2766677749 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8110018020 con 0x7f812014ae60 2021-11-15T14:43:30.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 msgr2=0x7f80fc055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 0x7f80fc055be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8114005000 tx=0x7f8114013000).stop 2021-11-15T14:43:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 msgr2=0x7f81200b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f8110002f70 tx=0x7f8110006e40).stop 2021-11-15T14:43:30.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 shutdown_connections 2021-11-15T14:43:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80fc053720 0x7f80fc055be0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8120148bb0 0x7f8120149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f812014ae60 0x7f81200b5cc0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 --2- 172.21.2.135:0/2766677749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f81040037d0 0x7f8120148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 >> 172.21.2.135:0/2766677749 conn(0x7f812005f730 msgr2=0x7f812013d070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 shutdown_connections 2021-11-15T14:43:30.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.124+0000 7f8124b15700 1 -- 172.21.2.135:0/2766677749 wait complete. 2021-11-15T14:43:30.136 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:30.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 Processor -- start 2021-11-15T14:43:30.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- start start 2021-11-15T14:43:30.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f46e00b0520 0x7f46e00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46e00b0900 0x7f46e0140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e00b2b70 con 0x7f46e00aa1a0 2021-11-15T14:43:30.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00b27f0 con 0x7f46e00b0520 2021-11-15T14:43:30.189 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00b2da0 con 0x7f46e00b0900 2021-11-15T14:43:30.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46e00b0900 0x7f46e0140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f46e00b0900 0x7f46e0140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35860/0 (socket says 172.21.2.135:35860) 2021-11-15T14:43:30.190 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 -- 172.21.2.135:0/3524039757 learned_addr learned my addr 172.21.2.135:0/3524039757 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 -- 172.21.2.135:0/3524039757 >> v2:172.21.2.119:3300/0 conn(0x7f46e00b0520 msgr2=0x7f46e00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 --2- 172.21.2.135:0/3524039757 >> v2:172.21.2.119:3300/0 conn(0x7f46e00b0520 0x7f46e00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.193 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 -- 172.21.2.135:0/3524039757 >> v1:172.21.2.119:6789/0 conn(0x7f46e00aa1a0 legacy=0x7f46e00ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 -- 172.21.2.135:0/3524039757 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00a9bf0 con 0x7f46e00b0900 2021-11-15T14:43:30.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e4951700 1 --2- 172.21.2.135:0/3524039757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0900 0x7f46e0140620 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f46e00b0130 tx=0x7f46d800b530).ready entity=mon.1 client_cookie=9cd6fa51d83ebe20 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46deffd700 1 -- 172.21.2.135:0/3524039757 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d800be70 con 0x7f46e00b0900 2021-11-15T14:43:30.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46deffd700 1 -- 172.21.2.135:0/3524039757 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8010470 con 0x7f46e00b0900 2021-11-15T14:43:30.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46deffd700 1 -- 172.21.2.135:0/3524039757 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d80107d0 con 0x7f46e00b0900 2021-11-15T14:43:30.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- 172.21.2.135:0/3524039757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0900 msgr2=0x7f46e0140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3524039757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0900 0x7f46e0140620 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f46e00b0130 tx=0x7f46d800b530).stop 2021-11-15T14:43:30.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- 172.21.2.135:0/3524039757 shutdown_connections 2021-11-15T14:43:30.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3524039757 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0900 0x7f46e0140620 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3524039757 >> v2:172.21.2.119:3300/0 conn(0x7f46e00b0520 0x7f46e00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- 172.21.2.135:0/3524039757 >> 172.21.2.135:0/3524039757 conn(0x7f46e0060840 msgr2=0x7f46e0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- 172.21.2.135:0/3524039757 shutdown_connections 2021-11-15T14:43:30.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.184+0000 7f46e63b4700 1 -- 172.21.2.135:0/3524039757 wait complete. 2021-11-15T14:43:30.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 Processor -- start 2021-11-15T14:43:30.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- start start 2021-11-15T14:43:30.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46e00aa1a0 0x7f46e013a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46e00b0900 0x7f46e014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e013b0b0 con 0x7f46e00b0900 2021-11-15T14:43:30.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e013bc40 con 0x7f46e00b0520 2021-11-15T14:43:30.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e013bee0 con 0x7f46e00aa1a0 2021-11-15T14:43:30.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35864/0 (socket says 172.21.2.135:35864) 2021-11-15T14:43:30.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 -- 172.21.2.135:0/3612092772 learned_addr learned my addr 172.21.2.135:0/3612092772 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 -- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46e00aa1a0 msgr2=0x7f46e013a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46e00aa1a0 0x7f46e013a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.199 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 -- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46e00b0900 msgr2=0x7f46e014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46e00b0900 0x7f46e014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 -- 172.21.2.135:0/3612092772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d800b7d0 con 0x7f46e00b0520 2021-11-15T14:43:30.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46df7fe700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f46d0002f90 tx=0x7f46d0006de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d0013460 con 0x7f46e00b0520 2021-11-15T14:43:30.200 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d00135c0 con 0x7f46e00b0520 2021-11-15T14:43:30.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e013a970 con 0x7f46e00b0520 2021-11-15T14:43:30.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d0013920 con 0x7f46e00b0520 2021-11-15T14:43:30.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e013b930 con 0x7f46e00b0520 2021-11-15T14:43:30.201 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e00573d0 con 0x7f46e00b0520 2021-11-15T14:43:30.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46d001a060 con 0x7f46e00b0520 2021-11-15T14:43:30.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 0x7f46c4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.202 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f46d006b460 con 0x7f46e00b0520 2021-11-15T14:43:30.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.188+0000 7f46dffff700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 0x7f46c4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.192+0000 7f46dffff700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 0x7f46c4055b20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f46c8002f70 tx=0x7f46c8006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.192+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46d0042470 con 0x7f46e00b0520 2021-11-15T14:43:30.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46e00446d0 con 0x7f46e00b0520 2021-11-15T14:43:30.303 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46dd7fa700 1 -- 172.21.2.135:0/3612092772 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f46d0018020 con 0x7f46e00b0520 2021-11-15T14:43:30.304 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:30.304 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:30.114949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8386":{"gid":8386,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/3501994559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3501994559},{"type":"v1","addr":"172.21.2.135:6835","nonce":3501994559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:30.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 msgr2=0x7f46c4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 0x7f46c4055b20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f46c8002f70 tx=0x7f46c8006a80).stop 2021-11-15T14:43:30.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 msgr2=0x7f46e00ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f46d0002f90 tx=0x7f46d0006de0).stop 2021-11-15T14:43:30.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 shutdown_connections 2021-11-15T14:43:30.306 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f46c4053660 0x7f46c4055b20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f46e00b0900 0x7f46e014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f46e00b0520 0x7f46e00ab040 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 --2- 172.21.2.135:0/3612092772 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f46e00aa1a0 0x7f46e013a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 >> 172.21.2.135:0/3612092772 conn(0x7f46e0060840 msgr2=0x7f46e0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 shutdown_connections 2021-11-15T14:43:30.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.300+0000 7f46e63b4700 1 -- 172.21.2.135:0/3612092772 wait complete. 2021-11-15T14:43:30.309 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 76 2021-11-15T14:43:30.311 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:30.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 Processor -- start 2021-11-15T14:43:30.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 -- start start 2021-11-15T14:43:30.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c148420 0x7f656c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f656c0a7140 0x7f656c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0b03d0 con 0x7f656c0b1e30 2021-11-15T14:43:30.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0a9140 con 0x7f656c0a7140 2021-11-15T14:43:30.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6574465700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0b0670 con 0x7f656c148420 2021-11-15T14:43:30.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6572a02700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f656c0a7140 0x7f656c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6572a02700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f656c0a7140 0x7f656c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35874/0 (socket says 172.21.2.135:35874) 2021-11-15T14:43:30.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.356+0000 7f6572a02700 1 -- 172.21.2.135:0/1714938442 learned_addr learned my addr 172.21.2.135:0/1714938442 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/1714938442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c148420 msgr2=0x7f656c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- 172.21.2.135:0/1714938442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c148420 0x7f656c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/1714938442 >> v1:172.21.2.119:6789/0 conn(0x7f656c0b1e30 legacy=0x7f656c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/1714938442 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0b0910 con 0x7f656c0a7140 2021-11-15T14:43:30.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- 172.21.2.135:0/1714938442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c0a7140 0x7f656c1447a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f656c061420 tx=0x7f6564009290).ready entity=mon.1 client_cookie=e7194c64bf6b41bc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f65711ff700 1 -- 172.21.2.135:0/1714938442 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656400b860 con 0x7f656c0a7140 2021-11-15T14:43:30.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f65711ff700 1 -- 172.21.2.135:0/1714938442 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400b9c0 con 0x7f656c0a7140 2021-11-15T14:43:30.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f65711ff700 1 -- 172.21.2.135:0/1714938442 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656400bb70 con 0x7f656c0a7140 2021-11-15T14:43:30.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/1714938442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c0a7140 msgr2=0x7f656c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.369 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- 172.21.2.135:0/1714938442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c0a7140 0x7f656c1447a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f656c061420 tx=0x7f6564009290).stop 2021-11-15T14:43:30.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/1714938442 shutdown_connections 2021-11-15T14:43:30.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- 172.21.2.135:0/1714938442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c0a7140 0x7f656c1447a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- 172.21.2.135:0/1714938442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c148420 0x7f656c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.370 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/1714938442 >> 172.21.2.135:0/1714938442 conn(0x7f656c05f730 msgr2=0x7f656c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/1714938442 shutdown_connections 2021-11-15T14:43:30.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/1714938442 wait complete. 2021-11-15T14:43:30.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 Processor -- start 2021-11-15T14:43:30.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- start start 2021-11-15T14:43:30.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 0x7f656c14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c0b1e30 0x7f656c0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c149120 con 0x7f656c0a7140 2021-11-15T14:43:30.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0aad00 con 0x7f656c148420 2021-11-15T14:43:30.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c148be0 con 0x7f656c0b1e30 2021-11-15T14:43:30.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35880/0 (socket says 172.21.2.135:35880) 2021-11-15T14:43:30.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/3651580682 learned_addr learned my addr 172.21.2.135:0/3651580682 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.373 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6571a00700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c0b1e30 0x7f656c0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572201700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 0x7f656c14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c0b1e30 msgr2=0x7f656c0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c0b1e30 0x7f656c0ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.374 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 msgr2=0x7f656c14a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 0x7f656c14a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 -- 172.21.2.135:0/3651580682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564009530 con 0x7f656c148420 2021-11-15T14:43:30.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572201700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 0x7f656c14a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:30.375 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6572a02700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f656c149cb0 tx=0x7f6564016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656400b860 con 0x7f656c148420 2021-11-15T14:43:30.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564020620 con 0x7f656c148420 2021-11-15T14:43:30.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c148e80 con 0x7f656c148420 2021-11-15T14:43:30.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6564020980 con 0x7f656c148420 2021-11-15T14:43:30.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.360+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c0ac090 con 0x7f656c148420 2021-11-15T14:43:30.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c0573d0 con 0x7f656c148420 2021-11-15T14:43:30.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6564026020 con 0x7f656c148420 2021-11-15T14:43:30.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f655f7fe700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 0x7f654c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f656406c8e0 con 0x7f656c148420 2021-11-15T14:43:30.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f6572201700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 0x7f654c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f6572201700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 0x7f654c055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f6568007000 tx=0x7f6568008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.364+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65640438f0 con 0x7f656c148420 2021-11-15T14:43:30.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f656c0a7520 con 0x7f656c148420 2021-11-15T14:43:30.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f655f7fe700 1 -- 172.21.2.135:0/3651580682 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f6564015020 con 0x7f656c148420 2021-11-15T14:43:30.452 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:30.452 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":155,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:30.116081+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:27.057306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:28.115642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:30.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 msgr2=0x7f654c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 0x7f654c055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f6568007000 tx=0x7f6568008040).stop 2021-11-15T14:43:30.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 msgr2=0x7f656c0abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f656c149cb0 tx=0x7f6564016000).stop 2021-11-15T14:43:30.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 shutdown_connections 2021-11-15T14:43:30.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f654c053640 0x7f654c055b00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f656c148420 0x7f656c0abba0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f656c0b1e30 0x7f656c0ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 --2- 172.21.2.135:0/3651580682 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f656c0a7140 0x7f656c14a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 >> 172.21.2.135:0/3651580682 conn(0x7f656c05f730 msgr2=0x7f656c0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 shutdown_connections 2021-11-15T14:43:30.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.448+0000 7f6574465700 1 -- 172.21.2.135:0/3651580682 wait complete. 2021-11-15T14:43:30.459 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:30.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.508+0000 7fabb0cf2700 1 Processor -- start 2021-11-15T14:43:30.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.508+0000 7fabb0cf2700 1 -- start start 2021-11-15T14:43:30.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fabac0afca0 0x7fabac13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fabac0b0bb0 0x7fabac13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0b04b0 con 0x7fabac0ad150 2021-11-15T14:43:30.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabac0ad530 con 0x7fabac0afca0 2021-11-15T14:43:30.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabac0b57d0 con 0x7fabac0b0bb0 2021-11-15T14:43:30.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fabac0b0bb0 0x7fabac13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fabac0b0bb0 0x7fabac13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35888/0 (socket says 172.21.2.135:35888) 2021-11-15T14:43:30.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaa59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fabac0ad150 0x7fabac13f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51704/0 (socket says 172.21.2.135:51704) 2021-11-15T14:43:30.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 -- 172.21.2.135:0/4099844248 learned_addr learned my addr 172.21.2.135:0/4099844248 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 -- 172.21.2.135:0/4099844248 >> v2:172.21.2.119:3300/0 conn(0x7fabac0afca0 msgr2=0x7fabac13f860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:30.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 --2- 172.21.2.135:0/4099844248 >> v2:172.21.2.119:3300/0 conn(0x7fabac0afca0 0x7fabac13f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 -- 172.21.2.135:0/4099844248 >> v1:172.21.2.135:6789/0 conn(0x7fabac0ad150 legacy=0x7fabac13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 -- 172.21.2.135:0/4099844248 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0b06e0 con 0x7fabac0b0bb0 2021-11-15T14:43:30.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabaad9d700 1 --2- 172.21.2.135:0/4099844248 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0b0bb0 0x7fabac13bf70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7faba40032f0 tx=0x7faba4009290).ready entity=mon.1 client_cookie=29512167f58c8dbe server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba959a700 1 -- 172.21.2.135:0/4099844248 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba400ba60 con 0x7fabac0b0bb0 2021-11-15T14:43:30.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba959a700 1 -- 172.21.2.135:0/4099844248 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400bbc0 con 0x7fabac0b0bb0 2021-11-15T14:43:30.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba959a700 1 -- 172.21.2.135:0/4099844248 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba4010410 con 0x7fabac0b0bb0 2021-11-15T14:43:30.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/4099844248 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0b0bb0 msgr2=0x7fabac13bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/4099844248 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0b0bb0 0x7fabac13bf70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7faba40032f0 tx=0x7faba4009290).stop 2021-11-15T14:43:30.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/4099844248 shutdown_connections 2021-11-15T14:43:30.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/4099844248 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0b0bb0 0x7fabac13bf70 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/4099844248 >> v2:172.21.2.119:3300/0 conn(0x7fabac0afca0 0x7fabac13f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/4099844248 >> 172.21.2.135:0/4099844248 conn(0x7fabac062cb0 msgr2=0x7fabac063090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/4099844248 shutdown_connections 2021-11-15T14:43:30.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/4099844248 wait complete. 2021-11-15T14:43:30.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 Processor -- start 2021-11-15T14:43:30.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- start start 2021-11-15T14:43:30.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabac0ad150 0x7fabac140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabac0b0bb0 0x7fabac133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac137bb0 con 0x7fabac0b0bb0 2021-11-15T14:43:30.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac141f20 con 0x7fabac0afca0 2021-11-15T14:43:30.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac1421c0 con 0x7fabac0ad150 2021-11-15T14:43:30.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35892/0 (socket says 172.21.2.135:35892) 2021-11-15T14:43:30.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 -- 172.21.2.135:0/1867899655 learned_addr learned my addr 172.21.2.135:0/1867899655 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 -- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabac0ad150 msgr2=0x7fabac140db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:30.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabac0ad150 0x7fabac140db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 -- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabac0b0bb0 msgr2=0x7fabac133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabac0b0bb0 0x7fabac133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 -- 172.21.2.135:0/1867899655 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009530 con 0x7fabac0afca0 2021-11-15T14:43:30.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba9d9b700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fabac137cf0 tx=0x7fab9c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab9c013460 con 0x7fabac0afca0 2021-11-15T14:43:30.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0135c0 con 0x7fabac0afca0 2021-11-15T14:43:30.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac137470 con 0x7fabac0afca0 2021-11-15T14:43:30.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac133570 con 0x7fabac0afca0 2021-11-15T14:43:30.528 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.512+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab9c013920 con 0x7fabac0afca0 2021-11-15T14:43:30.529 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac0b5a30 con 0x7fabac0afca0 2021-11-15T14:43:30.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab9c00f070 con 0x7fabac0afca0 2021-11-15T14:43:30.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7faba37fe700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 0x7fab90055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fab9c06b5c0 con 0x7fabac0afca0 2021-11-15T14:43:30.530 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7fabaa59c700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 0x7fab90055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7fabaa59c700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 0x7fab90055b20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fabac0b00d0 tx=0x7fab94007740).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.531 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.516+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab9c0424c0 con 0x7fabac0afca0 2021-11-15T14:43:30.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.628+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fabac0573d0 con 0x7fabac0afca0 2021-11-15T14:43:30.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.640+0000 7faba37fe700 1 -- 172.21.2.135:0/1867899655 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7fab9c045ae0 con 0x7fabac0afca0 2021-11-15T14:43:30.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 msgr2=0x7fab90055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 0x7fab90055b20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fabac0b00d0 tx=0x7fab94007740).stop 2021-11-15T14:43:30.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 msgr2=0x7fabac132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fabac137cf0 tx=0x7fab9c006df0).stop 2021-11-15T14:43:30.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 shutdown_connections 2021-11-15T14:43:30.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fab90053660 0x7fab90055b20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fabac0b0bb0 0x7fabac133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fabac0afca0 0x7fabac132b90 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.648 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 --2- 172.21.2.135:0/1867899655 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fabac0ad150 0x7fabac140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 >> 172.21.2.135:0/1867899655 conn(0x7fabac062cb0 msgr2=0x7fabac1388f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 shutdown_connections 2021-11-15T14:43:30.649 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.644+0000 7fabb0cf2700 1 -- 172.21.2.135:0/1867899655 wait complete. 2021-11-15T14:43:30.650 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:43:30.653 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:30.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 Processor -- start 2021-11-15T14:43:30.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- start start 2021-11-15T14:43:30.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd0600b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd0600a7140 0x7fd0601447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600b03d0 con 0x7fd060148420 2021-11-15T14:43:30.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600a9140 con 0x7fd0600a7140 2021-11-15T14:43:30.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b0670 con 0x7fd0600b1e30 2021-11-15T14:43:30.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05e59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd060148420 0x7fd0600b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51722/0 (socket says 172.21.2.135:51722) 2021-11-15T14:43:30.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd0600a7140 0x7fd0601447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05e59c700 1 -- 172.21.2.135:0/3574996170 learned_addr learned my addr 172.21.2.135:0/3574996170 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:30.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 -- 172.21.2.135:0/3574996170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 msgr2=0x7fd0600b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 --2- 172.21.2.135:0/3574996170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd0600b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05dd9b700 1 -- 172.21.2.135:0/3574996170 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273105638 0 0) 0x7fd0600b03d0 con 0x7fd060148420 2021-11-15T14:43:30.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 -- 172.21.2.135:0/3574996170 >> v1:172.21.2.135:6789/0 conn(0x7fd060148420 legacy=0x7fd0600b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 -- 172.21.2.135:0/3574996170 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600b0910 con 0x7fd0600a7140 2021-11-15T14:43:30.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05f59e700 1 --2- 172.21.2.135:0/3574996170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd0601447a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fd0580032f0 tx=0x7fd0580091d0).ready entity=mon.1 client_cookie=1c9824499e8cba60 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05dd9b700 1 -- 172.21.2.135:0/3574996170 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd058009ea0 con 0x7fd0600a7140 2021-11-15T14:43:30.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05dd9b700 1 -- 172.21.2.135:0/3574996170 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800b8a0 con 0x7fd0600a7140 2021-11-15T14:43:30.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd05dd9b700 1 -- 172.21.2.135:0/3574996170 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05800ba10 con 0x7fd0600a7140 2021-11-15T14:43:30.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- 172.21.2.135:0/3574996170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 msgr2=0x7fd0601447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 --2- 172.21.2.135:0/3574996170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd0601447a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fd0580032f0 tx=0x7fd0580091d0).stop 2021-11-15T14:43:30.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- 172.21.2.135:0/3574996170 shutdown_connections 2021-11-15T14:43:30.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 --2- 172.21.2.135:0/3574996170 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd0601447a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 --2- 172.21.2.135:0/3574996170 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd0600b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- 172.21.2.135:0/3574996170 >> 172.21.2.135:0/3574996170 conn(0x7fd06005f730 msgr2=0x7fd06005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- 172.21.2.135:0/3574996170 shutdown_connections 2021-11-15T14:43:30.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.708+0000 7fd065056700 1 -- 172.21.2.135:0/3574996170 wait complete. 2021-11-15T14:43:30.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 Processor -- start 2021-11-15T14:43:30.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- start start 2021-11-15T14:43:30.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd06013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd060148420 0x7fd06013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600a9b50 con 0x7fd060148420 2021-11-15T14:43:30.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014ea60 con 0x7fd0600a7140 2021-11-15T14:43:30.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06013e380 con 0x7fd0600b1e30 2021-11-15T14:43:30.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35904/0 (socket says 172.21.2.135:35904) 2021-11-15T14:43:30.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 -- 172.21.2.135:0/1791038317 learned_addr learned my addr 172.21.2.135:0/1791038317 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 -- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 msgr2=0x7fd06013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd06013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 -- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd060148420 msgr2=0x7fd06013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd060148420 0x7fd06013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 -- 172.21.2.135:0/1791038317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009470 con 0x7fd0600a7140 2021-11-15T14:43:30.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05ed9d700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd048013460 con 0x7fd0600a7140 2021-11-15T14:43:30.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0480135c0 con 0x7fd0600a7140 2021-11-15T14:43:30.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd048013920 con 0x7fd0600a7140 2021-11-15T14:43:30.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600b3c00 con 0x7fd0600a7140 2021-11-15T14:43:30.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600b4140 con 0x7fd0600a7140 2021-11-15T14:43:30.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600573d0 con 0x7fd0600a7140 2021-11-15T14:43:30.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd04801a060 con 0x7fd0600a7140 2021-11-15T14:43:30.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 0x7fd044055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd04806b5e0 con 0x7fd0600a7140 2021-11-15T14:43:30.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.712+0000 7fd05e59c700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 0x7fd044055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.716+0000 7fd05e59c700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 0x7fd044055b50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fd050000ed0 tx=0x7fd0500078a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.716+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0480424e0 con 0x7fd0600a7140 2021-11-15T14:43:30.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.828+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd0600446d0 con 0x7fd0600a7140 2021-11-15T14:43:30.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd057fff700 1 -- 172.21.2.135:0/1791038317 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd048018030 con 0x7fd0600a7140 2021-11-15T14:43:30.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 msgr2=0x7fd044055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 0x7fd044055b50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fd050000ed0 tx=0x7fd0500078a0).stop 2021-11-15T14:43:30.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 msgr2=0x7fd06014e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048006ec0).stop 2021-11-15T14:43:30.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 shutdown_connections 2021-11-15T14:43:30.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd044053690 0x7fd044055b50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd060148420 0x7fd06013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd0600b1e30 0x7fd06013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 --2- 172.21.2.135:0/1791038317 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd0600a7140 0x7fd06014e2e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 >> 172.21.2.135:0/1791038317 conn(0x7fd06005f730 msgr2=0x7fd060146580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 shutdown_connections 2021-11-15T14:43:30.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.840+0000 7fd065056700 1 -- 172.21.2.135:0/1791038317 wait complete. 2021-11-15T14:43:30.847 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:43:30.851 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:30.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.896+0000 7fc28fc20700 1 Processor -- start 2021-11-15T14:43:30.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.896+0000 7fc28fc20700 1 -- start start 2021-11-15T14:43:30.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc2880b1e30 0x7fc2880b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc288148420 0x7fc2880b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc2880a7140 0x7fc2881447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880a9140 con 0x7fc2880a7140 2021-11-15T14:43:30.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b03d0 con 0x7fc2880b1e30 2021-11-15T14:43:30.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880b0670 con 0x7fc288148420 2021-11-15T14:43:30.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc2880b1e30 0x7fc2880b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc2880b1e30 0x7fc2880b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35912/0 (socket says 172.21.2.135:35912) 2021-11-15T14:43:30.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 -- 172.21.2.135:0/755483331 learned_addr learned my addr 172.21.2.135:0/755483331 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 -- 172.21.2.135:0/755483331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc288148420 msgr2=0x7fc2880b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 --2- 172.21.2.135:0/755483331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc288148420 0x7fc2880b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 -- 172.21.2.135:0/755483331 >> v2:172.21.2.119:3300/0 conn(0x7fc2880a7140 msgr2=0x7fc2881447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:30.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 --2- 172.21.2.135:0/755483331 >> v2:172.21.2.119:3300/0 conn(0x7fc2880a7140 0x7fc2881447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 -- 172.21.2.135:0/755483331 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b0910 con 0x7fc2880b1e30 2021-11-15T14:43:30.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28d9bc700 1 --2- 172.21.2.135:0/755483331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2880b1e30 0x7fc2880b1050 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc27c002f70 tx=0x7fc27c006eb0).ready entity=mon.1 client_cookie=c6d8c9a269dc0ea server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28c9ba700 1 -- 172.21.2.135:0/755483331 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c00d570 con 0x7fc2880b1e30 2021-11-15T14:43:30.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28c9ba700 1 -- 172.21.2.135:0/755483331 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c000e90 con 0x7fc2880b1e30 2021-11-15T14:43:30.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28c9ba700 1 -- 172.21.2.135:0/755483331 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c00d900 con 0x7fc2880b1e30 2021-11-15T14:43:30.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- 172.21.2.135:0/755483331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2880b1e30 msgr2=0x7fc2880b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- 172.21.2.135:0/755483331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2880b1e30 0x7fc2880b1050 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc27c002f70 tx=0x7fc27c006eb0).stop 2021-11-15T14:43:30.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- 172.21.2.135:0/755483331 shutdown_connections 2021-11-15T14:43:30.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- 172.21.2.135:0/755483331 >> v2:172.21.2.119:3300/0 conn(0x7fc2880a7140 0x7fc2881447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- 172.21.2.135:0/755483331 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc288148420 0x7fc2880b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- 172.21.2.135:0/755483331 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc2880b1e30 0x7fc2880b1050 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:30.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- 172.21.2.135:0/755483331 >> 172.21.2.135:0/755483331 conn(0x7fc28805f730 msgr2=0x7fc28805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:30.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- 172.21.2.135:0/755483331 shutdown_connections 2021-11-15T14:43:30.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- 172.21.2.135:0/755483331 wait complete. 2021-11-15T14:43:30.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 Processor -- start 2021-11-15T14:43:30.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- start start 2021-11-15T14:43:30.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2880a7140 0x7fc2880ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2880b1e30 0x7fc28814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288149370 con 0x7fc2880a7140 2021-11-15T14:43:30.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28814bbe0 con 0x7fc288148420 2021-11-15T14:43:30.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28fc20700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880aac80 con 0x7fc2880b1e30 2021-11-15T14:43:30.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28e1bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28e1bd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35920/0 (socket says 172.21.2.135:35920) 2021-11-15T14:43:30.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.900+0000 7fc28e1bd700 1 -- 172.21.2.135:0/3004656265 learned_addr learned my addr 172.21.2.135:0/3004656265 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:30.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 -- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2880b1e30 msgr2=0x7fc28814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2880b1e30 0x7fc28814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 -- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2880a7140 msgr2=0x7fc2880ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:30.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2880a7140 0x7fc2880ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:30.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 -- 172.21.2.135:0/3004656265 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c00b1e0 con 0x7fc288148420 2021-11-15T14:43:30.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28e1bd700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc2800032f0 tx=0x7fc280009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28000d580 con 0x7fc288148420 2021-11-15T14:43:30.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000d6e0 con 0x7fc288148420 2021-11-15T14:43:30.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880aaf20 con 0x7fc288148420 2021-11-15T14:43:30.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28000da40 con 0x7fc288148420 2021-11-15T14:43:30.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288147120 con 0x7fc288148420 2021-11-15T14:43:30.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28814b0b0 con 0x7fc288148420 2021-11-15T14:43:30.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc28000dba0 con 0x7fc288148420 2021-11-15T14:43:30.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 0x7fc270055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:30.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc28006bf20 con 0x7fc288148420 2021-11-15T14:43:30.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28d9bc700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 0x7fc270055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:30.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.904+0000 7fc28d9bc700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 0x7fc270055ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc27c002f70 tx=0x7fc27c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:30.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:30.908+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc28814b0b0 con 0x7fc288148420 2021-11-15T14:43:31.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc28814b450 con 0x7fc288148420 2021-11-15T14:43:31.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc27affd700 1 -- 172.21.2.135:0/3004656265 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fc28814b450 con 0x7fc288148420 2021-11-15T14:43:31.021 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:31.021 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:30.114949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8386":{"gid":8386,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/3501994559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3501994559},{"type":"v1","addr":"172.21.2.135:6835","nonce":3501994559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:31.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 msgr2=0x7fc270055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 0x7fc270055ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc27c002f70 tx=0x7fc27c015000).stop 2021-11-15T14:43:31.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 msgr2=0x7fc28814a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc2800032f0 tx=0x7fc280009220).stop 2021-11-15T14:43:31.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 shutdown_connections 2021-11-15T14:43:31.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc270053610 0x7fc270055ad0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc288148420 0x7fc28814a3d0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc2880b1e30 0x7fc28814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 --2- 172.21.2.135:0/3004656265 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc2880a7140 0x7fc2880ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 >> 172.21.2.135:0/3004656265 conn(0x7fc28805f730 msgr2=0x7fc2880b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 shutdown_connections 2021-11-15T14:43:31.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.016+0000 7fc28fc20700 1 -- 172.21.2.135:0/3004656265 wait complete. 2021-11-15T14:43:31.025 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 76 2021-11-15T14:43:31.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:29.110271+0000', 'modified': '2021-11-15T14:43:30.114949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8386}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8386': {'gid': 8386, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/3501994559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 3501994559}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 3501994559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:31.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:31.331 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:31.396 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8386,"want_state":"up:active","state":"up:active","rank_uptime":2.2746034879999999,"mdsmap_epoch":76,"osdmap_epoch":155,"osdmap_epoch_barrier":154,"uptime":6.492687213} 2021-11-15T14:43:31.397 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8386, "mdsmap_epoch": 76, "osdmap_epoch": 155, "osdmap_epoch_barrier": 154, "rank_uptime": 2.274603488, "state": "up:active", "uptime": 6.492687213, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:31.397 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:31.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 Processor -- start 2021-11-15T14:43:31.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 -- start start 2021-11-15T14:43:31.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f888c139b60 0x7f888c142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f888c0b1cd0 0x7f888c0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c0ac4f0 con 0x7f888c143320 2021-11-15T14:43:31.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0b3090 con 0x7f888c0b1cd0 2021-11-15T14:43:31.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f88941f4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0af3a0 con 0x7f888c139b60 2021-11-15T14:43:31.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f888c139b60 0x7f888c142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f888c139b60 0x7f888c142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35924/0 (socket says 172.21.2.135:35924) 2021-11-15T14:43:31.451 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 -- 172.21.2.135:0/3545509518 learned_addr learned my addr 172.21.2.135:0/3545509518 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:31.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 -- 172.21.2.135:0/3545509518 >> v2:172.21.2.119:3300/0 conn(0x7f888c0b1cd0 msgr2=0x7f888c0a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 --2- 172.21.2.135:0/3545509518 >> v2:172.21.2.119:3300/0 conn(0x7f888c0b1cd0 0x7f888c0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.452 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 -- 172.21.2.135:0/3545509518 >> v1:172.21.2.119:6789/0 conn(0x7f888c143320 legacy=0x7f888c0ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 -- 172.21.2.135:0/3545509518 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c1437b0 con 0x7f888c139b60 2021-11-15T14:43:31.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8891f90700 1 --2- 172.21.2.135:0/3545509518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c139b60 0x7f888c142e30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f888c0afb10 tx=0x7f8880006f40).ready entity=mon.1 client_cookie=a2bb8eff8466c878 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8890f8e700 1 -- 172.21.2.135:0/3545509518 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888000c900 con 0x7f888c139b60 2021-11-15T14:43:31.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8890f8e700 1 -- 172.21.2.135:0/3545509518 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8880000e90 con 0x7f888c139b60 2021-11-15T14:43:31.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.444+0000 7f8890f8e700 1 -- 172.21.2.135:0/3545509518 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888000cc50 con 0x7f888c139b60 2021-11-15T14:43:31.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/3545509518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c139b60 msgr2=0x7f888c142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- 172.21.2.135:0/3545509518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c139b60 0x7f888c142e30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f888c0afb10 tx=0x7f8880006f40).stop 2021-11-15T14:43:31.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/3545509518 shutdown_connections 2021-11-15T14:43:31.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- 172.21.2.135:0/3545509518 >> v2:172.21.2.119:3300/0 conn(0x7f888c0b1cd0 0x7f888c0a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- 172.21.2.135:0/3545509518 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c139b60 0x7f888c142e30 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/3545509518 >> 172.21.2.135:0/3545509518 conn(0x7f888c05f730 msgr2=0x7f888c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/3545509518 shutdown_connections 2021-11-15T14:43:31.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/3545509518 wait complete. 2021-11-15T14:43:31.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 Processor -- start 2021-11-15T14:43:31.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- start start 2021-11-15T14:43:31.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.460 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f888c157700 0x7f888c0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f888c0ab360 0x7f888c138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0aa490 con 0x7f888c157700 2021-11-15T14:43:31.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0a96d0 con 0x7f888c0b1cd0 2021-11-15T14:43:31.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c141150 con 0x7f888c0ab360 2021-11-15T14:43:31.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35928/0 (socket says 172.21.2.135:35928) 2021-11-15T14:43:31.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 -- 172.21.2.135:0/2131039746 learned_addr learned my addr 172.21.2.135:0/2131039746 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:31.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 -- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f888c0ab360 msgr2=0x7f888c138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f888c0ab360 0x7f888c138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 -- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f888c157700 msgr2=0x7f888c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f888c157700 0x7f888c0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 -- 172.21.2.135:0/2131039746 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888000a360 con 0x7f888c0b1cd0 2021-11-15T14:43:31.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f8891f90700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f888c156cf0 tx=0x7f888c0ac680).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8880010ea0 con 0x7f888c0b1cd0 2021-11-15T14:43:31.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888001a440 con 0x7f888c0b1cd0 2021-11-15T14:43:31.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888001a7a0 con 0x7f888c0b1cd0 2021-11-15T14:43:31.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c13a010 con 0x7f888c0b1cd0 2021-11-15T14:43:31.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c0a9b10 con 0x7f888c0b1cd0 2021-11-15T14:43:31.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c0aa5d0 con 0x7f888c0b1cd0 2021-11-15T14:43:31.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f888002a070 con 0x7f888c0b1cd0 2021-11-15T14:43:31.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 0x7f886c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.448+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f888006d270 con 0x7f888c0b1cd0 2021-11-15T14:43:31.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.452+0000 7f889178f700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 0x7f886c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.452+0000 7f889178f700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 0x7f886c055a40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f8888002f10 tx=0x7f8888006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.452+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f888006ae90 con 0x7f888c0b1cd0 2021-11-15T14:43:31.537 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.532+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888c0a9810 con 0x7f888c0b1cd0 2021-11-15T14:43:31.539 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f887effd700 1 -- 172.21.2.135:0/2131039746 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f8880044280 con 0x7f888c0b1cd0 2021-11-15T14:43:31.539 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:31.540 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":155,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:30.116081+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:27.057306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:28.115642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:31.541 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 msgr2=0x7f886c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 0x7f886c055a40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f8888002f10 tx=0x7f8888006930).stop 2021-11-15T14:43:31.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 msgr2=0x7f888c140c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f888c156cf0 tx=0x7f888c0ac680).stop 2021-11-15T14:43:31.542 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 shutdown_connections 2021-11-15T14:43:31.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f886c053580 0x7f886c055a40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f888c0ab360 0x7f888c138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.543 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f888c157700 0x7f888c0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 --2- 172.21.2.135:0/2131039746 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f888c0b1cd0 0x7f888c140c60 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 >> 172.21.2.135:0/2131039746 conn(0x7f888c05f730 msgr2=0x7f888c0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 shutdown_connections 2021-11-15T14:43:31.544 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.536+0000 7f88941f4700 1 -- 172.21.2.135:0/2131039746 wait complete. 2021-11-15T14:43:31.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:43:27.057306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:43:28.115642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:31.548 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:31.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 Processor -- start 2021-11-15T14:43:31.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- start start 2021-11-15T14:43:31.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcec00ad0c0 0x7fcec00b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec00b5fc0 con 0x7fcec00afb70 2021-11-15T14:43:31.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec00ad4a0 con 0x7fcec013ca40 2021-11-15T14:43:31.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00aebe0 con 0x7fcec00ad0c0 2021-11-15T14:43:31.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcec013ca40 0x7fcec013f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51758/0 (socket says 172.21.2.135:51758) 2021-11-15T14:43:31.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 -- 172.21.2.135:0/2761823445 learned_addr learned my addr 172.21.2.135:0/2761823445 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:31.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473879382 0 0) 0x7fcec00ad4a0 con 0x7fcec013ca40 2021-11-15T14:43:31.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003260 con 0x7fcec013ca40 2021-11-15T14:43:31.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2525277798 0 0) 0x7fcea0003260 con 0x7fcec013ca40 2021-11-15T14:43:31.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 >> v2:172.21.2.119:3300/0 conn(0x7fcec00ad0c0 msgr2=0x7fcec00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 --2- 172.21.2.135:0/2761823445 >> v2:172.21.2.119:3300/0 conn(0x7fcec00ad0c0 0x7fcec00b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 >> v1:172.21.2.119:6789/0 conn(0x7fcec00afb70 legacy=0x7fcec013c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec00aee80 con 0x7fcec013ca40 2021-11-15T14:43:31.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fceb8001a00 con 0x7fcec013ca40 2021-11-15T14:43:31.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 >> v1:172.21.2.135:6789/0 conn(0x7fcec013ca40 legacy=0x7fcec013f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcea0003750 0x7fcea0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcea0004500 0x7fcea0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcea0007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00aebe0 con 0x7fcea0003750 2021-11-15T14:43:31.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0007e00 con 0x7fcea0004f90 2021-11-15T14:43:31.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0007fc0 con 0x7fcea0004500 2021-11-15T14:43:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcea0007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebe59c700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcea0003750 0x7fcea0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 -- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcea0004500 msgr2=0x7fcea0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcea0004500 0x7fcea0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 -- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcea0003750 msgr2=0x7fcea0003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcea0003750 0x7fcea0003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 -- 172.21.2.135:0/2761823445 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec00aee80 con 0x7fcea0004f90 2021-11-15T14:43:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebe59c700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcea0003750 0x7fcea0003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:31.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 -- 172.21.2.135:0/2761823445 reap_dead start 2021-11-15T14:43:31.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebed9d700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcea0007730 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fceb80013c0 tx=0x7fceb80049f0).ready entity=mon.1 client_cookie=5df20a760352cf2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb8014070 con 0x7fcea0004f90 2021-11-15T14:43:31.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb800f620 con 0x7fcea0004f90 2021-11-15T14:43:31.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcebd59a700 1 -- 172.21.2.135:0/2761823445 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb800f980 con 0x7fcea0004f90 2021-11-15T14:43:31.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 msgr2=0x7fcea0007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcea0007730 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fceb80013c0 tx=0x7fceb80049f0).stop 2021-11-15T14:43:31.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- 172.21.2.135:0/2761823445 shutdown_connections 2021-11-15T14:43:31.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 --2- 172.21.2.135:0/2761823445 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcea0007730 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- 172.21.2.135:0/2761823445 >> 172.21.2.135:0/2761823445 conn(0x7fcec005c510 msgr2=0x7fcec005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- 172.21.2.135:0/2761823445 shutdown_connections 2021-11-15T14:43:31.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.620+0000 7fcec4dff700 1 -- 172.21.2.135:0/2761823445 wait complete. 2021-11-15T14:43:31.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 Processor -- start 2021-11-15T14:43:31.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- start start 2021-11-15T14:43:31.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcec0145a60 0x7fcec01512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcec013d370 0x7fcec01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec013d880 con 0x7fcec0145a60 2021-11-15T14:43:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0145320 con 0x7fcea0004f90 2021-11-15T14:43:31.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec01455c0 con 0x7fcec013d370 2021-11-15T14:43:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35948/0 (socket says 172.21.2.135:35948) 2021-11-15T14:43:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 -- 172.21.2.135:0/1537135253 learned_addr learned my addr 172.21.2.135:0/1537135253 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:31.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 -- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcec013d370 msgr2=0x7fcec01517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcec013d370 0x7fcec01517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 -- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcec0145a60 msgr2=0x7fcec01512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcec0145a60 0x7fcec01512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 -- 172.21.2.135:0/1537135253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec013ce90 con 0x7fcea0004f90 2021-11-15T14:43:31.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebe59c700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fceb0007000 tx=0x7fceb0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb000e440 con 0x7fcea0004f90 2021-11-15T14:43:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000c030 con 0x7fcea0004f90 2021-11-15T14:43:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec01438e0 con 0x7fcea0004f90 2021-11-15T14:43:31.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb000e790 con 0x7fcea0004f90 2021-11-15T14:43:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec00b45f0 con 0x7fcea0004f90 2021-11-15T14:43:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec0145780 con 0x7fcea0004f90 2021-11-15T14:43:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fceb000e8f0 con 0x7fcea0004f90 2021-11-15T14:43:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 0x7fcea4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fceb006bb30 con 0x7fcea0004f90 2021-11-15T14:43:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebdd9b700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 0x7fcea4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.642 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.624+0000 7fcebdd9b700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 0x7fcea4055b60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fcea8000f70 tx=0x7fcea80069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.643 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.628+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fceb0042b40 con 0x7fcea0004f90 2021-11-15T14:43:31.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.708+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcec00af120 con 0x7fcea0004f90 2021-11-15T14:43:31.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fceb77fe700 1 -- 172.21.2.135:0/1537135253 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v155) v1 ==== 110+0+10 (secure 0 0 0) 0x7fceb0046160 con 0x7fcea0004f90 2021-11-15T14:43:31.715 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:31.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 msgr2=0x7fcea4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 0x7fcea4055b60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fcea8000f70 tx=0x7fcea80069b0).stop 2021-11-15T14:43:31.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 msgr2=0x7fcec00b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fceb0007000 tx=0x7fceb0008040).stop 2021-11-15T14:43:31.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 shutdown_connections 2021-11-15T14:43:31.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcea40536a0 0x7fcea4055b60 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcec013d370 0x7fcec01517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcec0145a60 0x7fcec01512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 --2- 172.21.2.135:0/1537135253 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcea0004f90 0x7fcec00b2a10 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 >> 172.21.2.135:0/1537135253 conn(0x7fcec005c510 msgr2=0x7fcec005c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 shutdown_connections 2021-11-15T14:43:31.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.712+0000 7fcec4dff700 1 -- 172.21.2.135:0/1537135253 wait complete. 2021-11-15T14:43:31.721 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:31.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 Processor -- start 2021-11-15T14:43:31.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- start start 2021-11-15T14:43:31.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f96bc0ad0c0 0x7f96bc0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0b5fc0 con 0x7f96bc13ca40 2021-11-15T14:43:31.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0ad4a0 con 0x7f96bc0afb70 2021-11-15T14:43:31.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0aebe0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bb7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f96bc0afb70 0x7f96bc13c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51778/0 (socket says 172.21.2.135:51778) 2021-11-15T14:43:31.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bb7fe700 1 -- 172.21.2.135:0/2732951075 learned_addr learned my addr 172.21.2.135:0/2732951075 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:31.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bbfff700 1 --2- 172.21.2.135:0/2732951075 >> v2:172.21.2.135:3300/0 conn(0x7f96bc0ad0c0 0x7f96bc0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bbfff700 1 -- 172.21.2.135:0/2732951075 >> v1:172.21.2.135:6789/0 conn(0x7f96bc0afb70 legacy=0x7f96bc13c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bbfff700 1 -- 172.21.2.135:0/2732951075 >> v1:172.21.2.119:6789/0 conn(0x7f96bc13ca40 legacy=0x7f96bc13f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bbfff700 1 -- 172.21.2.135:0/2732951075 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0aee80 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96bbfff700 1 --2- 172.21.2.135:0/2732951075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc0b5ad0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f96bc062980 tx=0x7f96ac007e90).ready entity=mon.1 client_cookie=c24ddd8f82e5d1c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96baffd700 1 -- 172.21.2.135:0/2732951075 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac00bb80 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96baffd700 1 -- 172.21.2.135:0/2732951075 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac000e90 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96baffd700 1 -- 172.21.2.135:0/2732951075 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac010460 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- 172.21.2.135:0/2732951075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 msgr2=0x7f96bc0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 --2- 172.21.2.135:0/2732951075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc0b5ad0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f96bc062980 tx=0x7f96ac007e90).stop 2021-11-15T14:43:31.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- 172.21.2.135:0/2732951075 shutdown_connections 2021-11-15T14:43:31.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 --2- 172.21.2.135:0/2732951075 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc0b5ad0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- 172.21.2.135:0/2732951075 >> 172.21.2.135:0/2732951075 conn(0x7f96bc05c510 msgr2=0x7f96bc05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- 172.21.2.135:0/2732951075 shutdown_connections 2021-11-15T14:43:31.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.780+0000 7f96c257a700 1 -- 172.21.2.135:0/2732951075 wait complete. 2021-11-15T14:43:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 Processor -- start 2021-11-15T14:43:31.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- start start 2021-11-15T14:43:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96bc0afb70 0x7f96bc135a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96bc13ca40 0x7f96bc135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc142120 con 0x7f96bc13ca40 2021-11-15T14:43:31.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc1423c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc142660 con 0x7f96bc0afb70 2021-11-15T14:43:31.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35960/0 (socket says 172.21.2.135:35960) 2021-11-15T14:43:31.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 -- 172.21.2.135:0/600007285 learned_addr learned my addr 172.21.2.135:0/600007285 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 -- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96bc0afb70 msgr2=0x7f96bc135a10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96bc0afb70 0x7f96bc135a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 -- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96bc13ca40 msgr2=0x7f96bc135f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96bc13ca40 0x7f96bc135f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 -- 172.21.2.135:0/600007285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac00d3c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bbfff700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f96bc062980 tx=0x7f96bc0b6800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac007430 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac007590 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc1363f0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac0069b0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc0b4c10 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc1430c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96ac00c040 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 0x7f96a00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f96ac06ca40 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.784+0000 7f96bb7fe700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 0x7f96a00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.788+0000 7f96bb7fe700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 0x7f96a00559b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f96bc05d090 tx=0x7f96a40059b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.788+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96bc1430c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.868+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96bc1430c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96b97fa700 1 -- 172.21.2.135:0/600007285 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96bc1430c0 con 0x7f96bc0ad0c0 2021-11-15T14:43:31.875 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:31.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 msgr2=0x7f96a00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 0x7f96a00559b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f96bc05d090 tx=0x7f96a40059b0).stop 2021-11-15T14:43:31.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 msgr2=0x7f96bc1406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f96bc062980 tx=0x7f96bc0b6800).stop 2021-11-15T14:43:31.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 shutdown_connections 2021-11-15T14:43:31.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f96a00534f0 0x7f96a00559b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96bc13ca40 0x7f96bc135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96bc0afb70 0x7f96bc135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 --2- 172.21.2.135:0/600007285 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96bc0ad0c0 0x7f96bc1406e0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 >> 172.21.2.135:0/600007285 conn(0x7f96bc05c510 msgr2=0x7f96bc137be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 shutdown_connections 2021-11-15T14:43:31.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.872+0000 7f96c257a700 1 -- 172.21.2.135:0/600007285 wait complete. 2021-11-15T14:43:31.881 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 Processor -- start 2021-11-15T14:43:31.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 -- start start 2021-11-15T14:43:31.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5c5c060040 0x7f5c5c064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0b4eb0 con 0x7f5c5c0b3950 2021-11-15T14:43:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0b2430 con 0x7f5c5c0b2ca0 2021-11-15T14:43:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c64036700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0b26d0 con 0x7f5c5c060040 2021-11-15T14:43:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c61dd2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5c5c060040 0x7f5c5c064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c625d3700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5c5c0b2ca0 0x7f5c5c0b47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51792/0 (socket says 172.21.2.135:51792) 2021-11-15T14:43:31.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.948+0000 7f5c625d3700 1 -- 172.21.2.135:0/1053098208 learned_addr learned my addr 172.21.2.135:0/1053098208 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:31.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c61dd2700 1 -- 172.21.2.135:0/1053098208 >> v1:172.21.2.135:6789/0 conn(0x7f5c5c0b2ca0 legacy=0x7f5c5c0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c60dd0700 1 -- 172.21.2.135:0/1053098208 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407410947 0 0) 0x7f5c5c0b2430 con 0x7f5c5c0b2ca0 2021-11-15T14:43:31.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c61dd2700 1 -- 172.21.2.135:0/1053098208 >> v1:172.21.2.119:6789/0 conn(0x7f5c5c0b3950 legacy=0x7f5c5c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:31.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c61dd2700 1 -- 172.21.2.135:0/1053098208 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0b2970 con 0x7f5c5c060040 2021-11-15T14:43:31.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c61dd2700 1 --2- 172.21.2.135:0/1053098208 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c060040 0x7f5c5c064d90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f5c5c13b870 tx=0x7f5c50006df0).ready entity=mon.1 client_cookie=f5e7ee3f43f92b3b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c60dd0700 1 -- 172.21.2.135:0/1053098208 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5000d5c0 con 0x7f5c5c060040 2021-11-15T14:43:31.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c60dd0700 1 -- 172.21.2.135:0/1053098208 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50000e90 con 0x7f5c5c060040 2021-11-15T14:43:31.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c60dd0700 1 -- 172.21.2.135:0/1053098208 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5000d910 con 0x7f5c5c060040 2021-11-15T14:43:31.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/1053098208 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c060040 msgr2=0x7f5c5c064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 --2- 172.21.2.135:0/1053098208 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c060040 0x7f5c5c064d90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f5c5c13b870 tx=0x7f5c50006df0).stop 2021-11-15T14:43:31.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/1053098208 shutdown_connections 2021-11-15T14:43:31.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 --2- 172.21.2.135:0/1053098208 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c060040 0x7f5c5c064d90 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/1053098208 >> 172.21.2.135:0/1053098208 conn(0x7f5c5c05cfe0 msgr2=0x7f5c5c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:31.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/1053098208 shutdown_connections 2021-11-15T14:43:31.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/1053098208 wait complete. 2021-11-15T14:43:31.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 Processor -- start 2021-11-15T14:43:31.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- start start 2021-11-15T14:43:31.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5c5c060040 0x7f5c5c141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5c5c0b2ca0 0x7f5c5c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0ade80 con 0x7f5c5c0b2ca0 2021-11-15T14:43:31.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c0b1360 con 0x7f5c5c0b3950 2021-11-15T14:43:31.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c13dcd0 con 0x7f5c5c060040 2021-11-15T14:43:31.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35978/0 (socket says 172.21.2.135:35978) 2021-11-15T14:43:31.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 -- 172.21.2.135:0/2631140313 learned_addr learned my addr 172.21.2.135:0/2631140313 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:31.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c615d1700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5c5c0b2ca0 0x7f5c5c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c61dd2700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5c5c060040 0x7f5c5c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 -- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5c5c060040 msgr2=0x7f5c5c141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5c5c060040 0x7f5c5c141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 -- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5c5c0b2ca0 msgr2=0x7f5c5c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:31.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5c5c0b2ca0 0x7f5c5c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:31.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 -- 172.21.2.135:0/2631140313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5000b180 con 0x7f5c5c0b3950 2021-11-15T14:43:31.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c625d3700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f5c5c0b1280 tx=0x7f5c54007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c54005c70 con 0x7f5c5c0b3950 2021-11-15T14:43:31.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c060d30 con 0x7f5c5c0b3950 2021-11-15T14:43:31.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54005dd0 con 0x7f5c5c0b3950 2021-11-15T14:43:31.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c54004a90 con 0x7f5c5c0b3950 2021-11-15T14:43:31.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.952+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c13b8b0 con 0x7f5c5c0b3950 2021-11-15T14:43:31.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c13de90 con 0x7f5c5c0b3950 2021-11-15T14:43:31.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c54004bf0 con 0x7f5c5c0b3950 2021-11-15T14:43:31.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c4effd700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 0x7f5c3c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:31.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5c5406b8c0 con 0x7f5c5c0b3950 2021-11-15T14:43:31.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c61dd2700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 0x7f5c3c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:31.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c61dd2700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 0x7f5c3c055bb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f5c50018000 tx=0x7f5c50012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:31.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:31.956+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c540427c0 con 0x7f5c5c0b3950 2021-11-15T14:43:32.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c5c0648f0 con 0x7f5c5c0b3950 2021-11-15T14:43:32.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c4effd700 1 -- 172.21.2.135:0/2631140313 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5c54045de0 con 0x7f5c5c0b3950 2021-11-15T14:43:32.044 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:32.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 msgr2=0x7f5c3c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 0x7f5c3c055bb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f5c50018000 tx=0x7f5c50012000).stop 2021-11-15T14:43:32.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 msgr2=0x7f5c5c060840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f5c5c0b1280 tx=0x7f5c54007dc0).stop 2021-11-15T14:43:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 shutdown_connections 2021-11-15T14:43:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5c3c0536f0 0x7f5c3c055bb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5c5c0b3950 0x7f5c5c060840 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5c5c0b2ca0 0x7f5c5c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 --2- 172.21.2.135:0/2631140313 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5c5c060040 0x7f5c5c141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 >> 172.21.2.135:0/2631140313 conn(0x7f5c5c05cfe0 msgr2=0x7f5c5c13ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:32.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 shutdown_connections 2021-11-15T14:43:32.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.040+0000 7f5c64036700 1 -- 172.21.2.135:0/2631140313 wait complete. 2021-11-15T14:43:32.051 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:32.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 Processor -- start 2021-11-15T14:43:32.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 -- start start 2021-11-15T14:43:32.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c0b1f40 0x7f760c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b0030 0x7f760c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f760c0a7140 0x7f760c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0b04a0 con 0x7f760c0a7140 2021-11-15T14:43:32.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0b2810 con 0x7f760c0b1f40 2021-11-15T14:43:32.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f76134a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b06d0 con 0x7f760c0b0030 2021-11-15T14:43:32.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c0b1f40 0x7f760c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f760c0b1f40 0x7f760c0b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35982/0 (socket says 172.21.2.135:35982) 2021-11-15T14:43:32.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 -- 172.21.2.135:0/3885332773 learned_addr learned my addr 172.21.2.135:0/3885332773 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:32.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 -- 172.21.2.135:0/3885332773 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b0030 msgr2=0x7f760c0b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:32.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 --2- 172.21.2.135:0/3885332773 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b0030 0x7f760c0b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 -- 172.21.2.135:0/3885332773 >> v2:172.21.2.119:3300/0 conn(0x7f760c0a7140 msgr2=0x7f760c1412d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:32.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.164+0000 7f761123c700 1 --2- 172.21.2.135:0/3885332773 >> v2:172.21.2.119:3300/0 conn(0x7f760c0a7140 0x7f760c1412d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f761123c700 1 -- 172.21.2.135:0/3885332773 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0b0970 con 0x7f760c0b1f40 2021-11-15T14:43:32.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f761123c700 1 --2- 172.21.2.135:0/3885332773 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b1f40 0x7f760c0b1350 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f7600002f70 tx=0x7f7600006eb0).ready entity=mon.1 client_cookie=eac21a282f81ca80 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fffff700 1 -- 172.21.2.135:0/3885332773 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760000d570 con 0x7f760c0b1f40 2021-11-15T14:43:32.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fffff700 1 -- 172.21.2.135:0/3885332773 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600000e90 con 0x7f760c0b1f40 2021-11-15T14:43:32.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fffff700 1 -- 172.21.2.135:0/3885332773 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760000d900 con 0x7f760c0b1f40 2021-11-15T14:43:32.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/3885332773 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b1f40 msgr2=0x7f760c0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- 172.21.2.135:0/3885332773 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b1f40 0x7f760c0b1350 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f7600002f70 tx=0x7f7600006eb0).stop 2021-11-15T14:43:32.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/3885332773 shutdown_connections 2021-11-15T14:43:32.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- 172.21.2.135:0/3885332773 >> v2:172.21.2.119:3300/0 conn(0x7f760c0a7140 0x7f760c1412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- 172.21.2.135:0/3885332773 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b0030 0x7f760c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- 172.21.2.135:0/3885332773 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b1f40 0x7f760c0b1350 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/3885332773 >> 172.21.2.135:0/3885332773 conn(0x7f760c05f730 msgr2=0x7f760c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:32.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/3885332773 shutdown_connections 2021-11-15T14:43:32.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/3885332773 wait complete. 2021-11-15T14:43:32.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 Processor -- start 2021-11-15T14:43:32.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- start start 2021-11-15T14:43:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c0a7140 0x7f760c146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b1f40 0x7f760c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c142e90 con 0x7f760c0a7140 2021-11-15T14:43:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0a94a0 con 0x7f760c0b0030 2021-11-15T14:43:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0a96d0 con 0x7f760c0b1f40 2021-11-15T14:43:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:35990/0 (socket says 172.21.2.135:35990) 2021-11-15T14:43:32.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 -- 172.21.2.135:0/1647342945 learned_addr learned my addr 172.21.2.135:0/1647342945 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 -- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b1f40 msgr2=0x7f760c1429a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b1f40 0x7f760c1429a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 -- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c0a7140 msgr2=0x7f760c146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c0a7140 0x7f760c146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 -- 172.21.2.135:0/1647342945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760000b1e0 con 0x7f760c0b0030 2021-11-15T14:43:32.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f7610a3b700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f760c142fd0 tx=0x7f7608006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7608013460 con 0x7f760c0b0030 2021-11-15T14:43:32.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76080135c0 con 0x7f760c0b0030 2021-11-15T14:43:32.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0aaea0 con 0x7f760c0b0030 2021-11-15T14:43:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7608013920 con 0x7f760c0b0030 2021-11-15T14:43:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c140c00 con 0x7f760c0b0030 2021-11-15T14:43:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0b0c10 con 0x7f760c0b0030 2021-11-15T14:43:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f760800f070 con 0x7f760c0b0030 2021-11-15T14:43:32.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 0x7f75ec055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.168+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f760806b5e0 con 0x7f760c0b0030 2021-11-15T14:43:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.172+0000 7f761123c700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 0x7f75ec055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.172+0000 7f761123c700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 0x7f75ec055b50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7600002f70 tx=0x7f7600015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.172+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76080424e0 con 0x7f760c0b0030 2021-11-15T14:43:32.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f760c0573d0 con 0x7f760c0b0030 2021-11-15T14:43:32.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f75fe7fc700 1 -- 172.21.2.135:0/1647342945 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7608045b00 con 0x7f760c0b0030 2021-11-15T14:43:32.263 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:32.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 msgr2=0x7f75ec055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 0x7f75ec055b50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7600002f70 tx=0x7f7600015000).stop 2021-11-15T14:43:32.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 msgr2=0x7f760c1424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f760c142fd0 tx=0x7f7608006df0).stop 2021-11-15T14:43:32.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 shutdown_connections 2021-11-15T14:43:32.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75ec053690 0x7f75ec055b50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f760c0b1f40 0x7f760c1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f760c0b0030 0x7f760c1424b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 --2- 172.21.2.135:0/1647342945 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f760c0a7140 0x7f760c146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 >> 172.21.2.135:0/1647342945 conn(0x7f760c05f730 msgr2=0x7f760c13d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 shutdown_connections 2021-11-15T14:43:32.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.256+0000 7f76134a0700 1 -- 172.21.2.135:0/1647342945 wait complete. 2021-11-15T14:43:32.268 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:32.268 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:32.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 Processor -- start 2021-11-15T14:43:32.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- start start 2021-11-15T14:43:32.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f58bc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f58bc148420 0x7f58bc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0b03d0 con 0x7f58bc0a7140 2021-11-15T14:43:32.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0a9140 con 0x7f58bc148420 2021-11-15T14:43:32.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b0670 con 0x7f58bc0b1e30 2021-11-15T14:43:32.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bbfff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f58bc0a7140 0x7f58bc1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51818/0 (socket says 172.21.2.135:51818) 2021-11-15T14:43:32.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bbfff700 1 -- 172.21.2.135:0/903078963 learned_addr learned my addr 172.21.2.135:0/903078963 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:32.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083971520 0 0) 0x7f58bc0b03d0 con 0x7f58bc0a7140 2021-11-15T14:43:32.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f589c003260 con 0x7f58bc0a7140 2021-11-15T14:43:32.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249203203 0 0) 0x7f589c003260 con 0x7f58bc0a7140 2021-11-15T14:43:32.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 msgr2=0x7f58bc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:32.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f58bc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 >> v2:172.21.2.119:3300/0 conn(0x7f58bc148420 msgr2=0x7f58bc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:32.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 --2- 172.21.2.135:0/903078963 >> v2:172.21.2.119:3300/0 conn(0x7f58bc148420 0x7f58bc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:32.348 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0b0910 con 0x7f58bc0a7140 2021-11-15T14:43:32.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f58b40019e0 con 0x7f58bc0a7140 2021-11-15T14:43:32.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 >> v1:172.21.2.135:6789/0 conn(0x7f58bc0a7140 legacy=0x7f58bc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f589c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f589c004500 0x7f589c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f589c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b0670 con 0x7f589c004500 2021-11-15T14:43:32.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c005280 con 0x7f589c0037d0 2021-11-15T14:43:32.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c00bc40 con 0x7f58bc0b1e30 2021-11-15T14:43:32.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f589c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bbfff700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f589c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58baffd700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f589c004500 0x7f589c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 -- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 msgr2=0x7f589c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:32.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f589c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 -- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f589c004500 msgr2=0x7f589c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:32.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f589c004500 0x7f589c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 -- 172.21.2.135:0/903078963 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c003260 con 0x7f589c0037d0 2021-11-15T14:43:32.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bbfff700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0b1e30 0x7f589c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:32.354 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58baffd700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f589c004500 0x7f589c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:32.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f589c003bf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f58a4002f70 tx=0x7f58a4006ca0).ready entity=mon.1 client_cookie=3484b7d69870a0ac server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a4013410 con 0x7f589c0037d0 2021-11-15T14:43:32.355 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4013570 con 0x7f589c0037d0 2021-11-15T14:43:32.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58ba7fc700 1 -- 172.21.2.135:0/903078963 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a40138d0 con 0x7f589c0037d0 2021-11-15T14:43:32.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- 172.21.2.135:0/903078963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 msgr2=0x7f589c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 --2- 172.21.2.135:0/903078963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f589c003bf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f58a4002f70 tx=0x7f58a4006ca0).stop 2021-11-15T14:43:32.356 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58bbfff700 1 -- 172.21.2.135:0/903078963 reap_dead start 2021-11-15T14:43:32.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- 172.21.2.135:0/903078963 shutdown_connections 2021-11-15T14:43:32.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- 172.21.2.135:0/903078963 >> 172.21.2.135:0/903078963 conn(0x7f58bc05f730 msgr2=0x7f58bc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:32.357 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- 172.21.2.135:0/903078963 shutdown_connections 2021-11-15T14:43:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.332+0000 7f58c2135700 1 -- 172.21.2.135:0/903078963 wait complete. 2021-11-15T14:43:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 Processor -- start 2021-11-15T14:43:32.358 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- start start 2021-11-15T14:43:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 0x7f58bc1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.359 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 0x7f58bc14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0a9a10 con 0x7f58bc14ad50 2021-11-15T14:43:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0a9cb0 con 0x7f589c0037d0 2021-11-15T14:43:32.360 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc157540 con 0x7f58bc0a94c0 2021-11-15T14:43:32.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36010/0 (socket says 172.21.2.135:36010) 2021-11-15T14:43:32.361 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 -- 172.21.2.135:0/2634311715 learned_addr learned my addr 172.21.2.135:0/2634311715 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:32.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bbfff700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 0x7f58bc14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58baffd700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 0x7f58bc1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 -- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 msgr2=0x7f58bc14b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 0x7f58bc14b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 -- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 msgr2=0x7f58bc1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.363 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 0x7f58bc1499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 -- 172.21.2.135:0/2634311715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0ab830 con 0x7f589c0037d0 2021-11-15T14:43:32.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bbfff700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 0x7f58bc14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:32.364 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58baffd700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 0x7f58bc1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:32.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58bb7fe700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f58a4002f70 tx=0x7f58a4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a4013410 con 0x7f589c0037d0 2021-11-15T14:43:32.365 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4012da0 con 0x7f589c0037d0 2021-11-15T14:43:32.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc14b7d0 con 0x7f589c0037d0 2021-11-15T14:43:32.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a4021660 con 0x7f589c0037d0 2021-11-15T14:43:32.366 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc143a60 con 0x7f589c0037d0 2021-11-15T14:43:32.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc157380 con 0x7f589c0037d0 2021-11-15T14:43:32.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58a40217c0 con 0x7f589c0037d0 2021-11-15T14:43:32.367 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 0x7f58a0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:32.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f58a401b040 con 0x7f589c0037d0 2021-11-15T14:43:32.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.336+0000 7f58baffd700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 0x7f58a0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:32.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.340+0000 7f58baffd700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 0x7f58a0055b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f58ac008000 tx=0x7f58ac008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:32.368 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.340+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58a4043d30 con 0x7f589c0037d0 2021-11-15T14:43:32.453 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.448+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58bc0b0bb0 con 0x7f589c0037d0 2021-11-15T14:43:32.454 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58b8ff9700 1 -- 172.21.2.135:0/2634311715 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f58a4026070 con 0x7f589c0037d0 2021-11-15T14:43:32.454 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:32.455 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:30.114949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8386":{"gid":8386,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/3501994559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3501994559},{"type":"v1","addr":"172.21.2.135:6835","nonce":3501994559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:32.455 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 msgr2=0x7f58a0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 0x7f58a0055b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f58ac008000 tx=0x7f58ac008040).stop 2021-11-15T14:43:32.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 msgr2=0x7f58bc0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:32.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f58a4002f70 tx=0x7f58a4014000).stop 2021-11-15T14:43:32.456 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 shutdown_connections 2021-11-15T14:43:32.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f58a00536d0 0x7f58a0055b90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f58bc0a94c0 0x7f58bc14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f58bc14ad50 0x7f58bc1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.457 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 --2- 172.21.2.135:0/2634311715 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f589c0037d0 0x7f58bc0ab130 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:32.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 >> 172.21.2.135:0/2634311715 conn(0x7f58bc05f730 msgr2=0x7f58bc0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:32.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 shutdown_connections 2021-11-15T14:43:32.458 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:32.452+0000 7f58c2135700 1 -- 172.21.2.135:0/2634311715 wait complete. 2021-11-15T14:43:32.458 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 76 2021-11-15T14:43:32.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:29.110271+0000', 'modified': '2021-11-15T14:43:30.114949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8386}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8386': {'gid': 8386, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/3501994559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 3501994559}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 3501994559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:32.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:32.765 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:32.845 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8386,"want_state":"up:active","state":"up:active","rank_uptime":3.7235122020000002,"mdsmap_epoch":76,"osdmap_epoch":155,"osdmap_epoch_barrier":154,"uptime":7.9415955470000004} 2021-11-15T14:43:32.845 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8386, "mdsmap_epoch": 76, "osdmap_epoch": 155, "osdmap_epoch_barrier": 154, "rank_uptime": 3.723512202, "state": "up:active", "uptime": 7.941595547, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:32.846 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:32.846 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:43:32.847 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:43:32.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:32.848 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:32.866 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:32.927 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:32.927 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:32.937 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:32.938 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:32.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:32.939 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:32.986 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:32.986 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:32.992 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:33.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:33.003 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:33.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:43:33.034+0000 7f8f0b995080 -1 init, newargv = 0x555f82a68380 newargc=9ceph-fuse[ 2021-11-15T14:43:33.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:15257]: starting ceph client 2021-11-15T14:43:33.036 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:33.037 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:33.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:33.038 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:33.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15257]: starting fuse 2021-11-15T14:43:33.044 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:43:33.045 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:33.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:33.046 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:43:33.047 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:43:33.047 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:43:33.048 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:43:33.048 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:43:33.049 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:33.049 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:43:33.050 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:43:33.050 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:43:33.050 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:33.051 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:43:33.051 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:43:33.052 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:43:33.052 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:43:33.052 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:33.053 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:43:33.053 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:33.054 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:33.054 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:43:33.055 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:33.055 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:33.055 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:43:33.056 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:43:33.161 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.15257.asok 2021-11-15T14:43:33.165 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15257.asok 2021-11-15T14:43:33.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:33.166 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15257.asok status 2021-11-15T14:43:33.220 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:43:33.221 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:43:33.221 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:33.221 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:33.221 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:43:33.222 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:43:33.222 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:43:33.222 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "15257", 2021-11-15T14:43:33.222 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:43:33.223 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:33.223 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:43:33.223 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:33.223 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 8548, 2021-11-15T14:43:33.223 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:43:33.224 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:43:33.224 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:43:33.224 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 8548 2021-11-15T14:43:33.224 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:33.225 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:33.225 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:33.225 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:33.225 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4138653034 2021-11-15T14:43:33.225 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:43:33.226 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:33.226 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:33.226 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:33.226 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:33.227 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4138653034 2021-11-15T14:43:33.227 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:33.227 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.8548 172.21.2.138:0/4138653034", 2021-11-15T14:43:33.227 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/4138653034", 2021-11-15T14:43:33.228 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:43:33.228 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 76, 2021-11-15T14:43:33.228 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 155, 2021-11-15T14:43:33.228 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:33.228 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:43:33.229 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:43:33.229 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:43:33.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:33.231 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:33.231 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:33.238 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:33.239 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:33.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:33.240 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:33.249 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:33.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 Processor -- start 2021-11-15T14:43:33.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- start start 2021-11-15T14:43:33.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9500b0790 0x7ff950142da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff95005c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9501439a0 con 0x7ff9500b3150 2021-11-15T14:43:33.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500b0b70 con 0x7ff9500b0790 2021-11-15T14:43:33.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500ae700 con 0x7ff9500acef0 2021-11-15T14:43:33.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9500b0790 0x7ff950142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ff9500b0790 0x7ff950142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36018/0 (socket says 172.21.2.135:36018) 2021-11-15T14:43:33.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 -- 172.21.2.135:0/1163424037 learned_addr learned my addr 172.21.2.135:0/1163424037 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff954a32700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7ff9500b3150 0x7ff950143290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51836/0 (socket says 172.21.2.135:51836) 2021-11-15T14:43:33.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 -- 172.21.2.135:0/1163424037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 msgr2=0x7ff95005c510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:33.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 --2- 172.21.2.135:0/1163424037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff95005c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 -- 172.21.2.135:0/1163424037 >> v1:172.21.2.135:6789/0 conn(0x7ff9500b3150 legacy=0x7ff950143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff93ffff700 1 -- 172.21.2.135:0/1163424037 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300502116 0 0) 0x7ff9501439a0 con 0x7ff9500b3150 2021-11-15T14:43:33.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 -- 172.21.2.135:0/1163424037 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500ae9a0 con 0x7ff9500b0790 2021-11-15T14:43:33.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff955233700 1 --2- 172.21.2.135:0/1163424037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b0790 0x7ff950142da0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7ff94c002f70 tx=0x7ff94c006eb0).ready entity=mon.1 client_cookie=114fd3b3da68a171 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff93ffff700 1 -- 172.21.2.135:0/1163424037 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c010bb0 con 0x7ff9500b0790 2021-11-15T14:43:33.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff93ffff700 1 -- 172.21.2.135:0/1163424037 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c000e90 con 0x7ff9500b0790 2021-11-15T14:43:33.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff93ffff700 1 -- 172.21.2.135:0/1163424037 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c0183d0 con 0x7ff9500b0790 2021-11-15T14:43:33.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- 172.21.2.135:0/1163424037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b0790 msgr2=0x7ff950142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 --2- 172.21.2.135:0/1163424037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b0790 0x7ff950142da0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7ff94c002f70 tx=0x7ff94c006eb0).stop 2021-11-15T14:43:33.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- 172.21.2.135:0/1163424037 shutdown_connections 2021-11-15T14:43:33.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 --2- 172.21.2.135:0/1163424037 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff95005c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 --2- 172.21.2.135:0/1163424037 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b0790 0x7ff950142da0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- 172.21.2.135:0/1163424037 >> 172.21.2.135:0/1163424037 conn(0x7ff9500611c0 msgr2=0x7ff950062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- 172.21.2.135:0/1163424037 shutdown_connections 2021-11-15T14:43:33.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- 172.21.2.135:0/1163424037 wait complete. 2021-11-15T14:43:33.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 Processor -- start 2021-11-15T14:43:33.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.304+0000 7ff956235700 1 -- start start 2021-11-15T14:43:33.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff9500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9500b0790 0x7ff950065370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff950065d50 con 0x7ff9500b0790 2021-11-15T14:43:33.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff950064dc0 con 0x7ff9500b3150 2021-11-15T14:43:33.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff950065060 con 0x7ff9500acef0 2021-11-15T14:43:33.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36026/0 (socket says 172.21.2.135:36026) 2021-11-15T14:43:33.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 -- 172.21.2.135:0/32583161 learned_addr learned my addr 172.21.2.135:0/32583161 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 -- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 msgr2=0x7ff9500b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff9500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 -- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9500b0790 msgr2=0x7ff950065370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9500b0790 0x7ff950065370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 -- 172.21.2.135:0/32583161 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c00b1e0 con 0x7ff9500b3150 2021-11-15T14:43:33.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955a34700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7ff948003330 tx=0x7ff9480091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff948001520 con 0x7ff9500b3150 2021-11-15T14:43:33.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948001680 con 0x7ff9500b3150 2021-11-15T14:43:33.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9480019e0 con 0x7ff9500b3150 2021-11-15T14:43:33.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9501523b0 con 0x7ff9500b3150 2021-11-15T14:43:33.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9500b65d0 con 0x7ff9500b3150 2021-11-15T14:43:33.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950063bb0 con 0x7ff9500b3150 2021-11-15T14:43:33.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff948018030 con 0x7ff9500b3150 2021-11-15T14:43:33.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 0x7ff930055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff94806b460 con 0x7ff9500b3150 2021-11-15T14:43:33.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.308+0000 7ff955233700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 0x7ff930055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.312+0000 7ff955233700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 0x7ff930055be0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7ff94c002f70 tx=0x7ff94c017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.312+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff950063bb0 con 0x7ff9500b3150 2021-11-15T14:43:33.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff950063bb0 con 0x7ff9500b3150 2021-11-15T14:43:33.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff93e7fc700 1 -- 172.21.2.135:0/32583161 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16285 (secure 0 0 0) 0x7ff950063bb0 con 0x7ff9500b3150 2021-11-15T14:43:33.399 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:33.399 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":155,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:30.116081+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:27.057306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:28.115642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:33.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 msgr2=0x7ff930055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 0x7ff930055be0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7ff94c002f70 tx=0x7ff94c017000).stop 2021-11-15T14:43:33.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 msgr2=0x7ff950065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7ff948003330 tx=0x7ff9480091a0).stop 2021-11-15T14:43:33.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 shutdown_connections 2021-11-15T14:43:33.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff930053720 0x7ff930055be0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff9500b3150 0x7ff950065860 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff9500b0790 0x7ff950065370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 --2- 172.21.2.135:0/32583161 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff9500acef0 0x7ff9500b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 >> 172.21.2.135:0/32583161 conn(0x7ff9500611c0 msgr2=0x7ff95013f070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 shutdown_connections 2021-11-15T14:43:33.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.396+0000 7ff956235700 1 -- 172.21.2.135:0/32583161 wait complete. 2021-11-15T14:43:33.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:43:27.057306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:43:28.115642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:33.409 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:33.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.484+0000 7f96bee22700 1 Processor -- start 2021-11-15T14:43:33.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.484+0000 7f96bee22700 1 -- start start 2021-11-15T14:43:33.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 0x7f96b8140120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b805ff00 con 0x7f96b80ac580 2021-11-15T14:43:33.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80acce0 con 0x7f96b805fb20 2021-11-15T14:43:33.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b81432c0 con 0x7f96b8060850 2021-11-15T14:43:33.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f96b805fb20 0x7f96b8143950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51850/0 (socket says 172.21.2.135:51850) 2021-11-15T14:43:33.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 -- 172.21.2.135:0/1830343017 learned_addr learned my addr 172.21.2.135:0/1830343017 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:33.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229977041 0 0) 0x7f96b80acce0 con 0x7f96b805fb20 2021-11-15T14:43:33.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9698003260 con 0x7f96b805fb20 2021-11-15T14:43:33.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3854746349 0 0) 0x7f9698003260 con 0x7f96b805fb20 2021-11-15T14:43:33.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 msgr2=0x7f96b8140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 0x7f96b8140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 >> v1:172.21.2.119:6789/0 conn(0x7f96b80ac580 legacy=0x7f96b8140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80acf80 con 0x7f96b805fb20 2021-11-15T14:43:33.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f96a8001680 con 0x7f96b805fb20 2021-11-15T14:43:33.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 >> v1:172.21.2.135:6789/0 conn(0x7f96b805fb20 legacy=0x7f96b8143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96980037d0 0x7f9698003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9698004500 0x7f9698004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 0x7f969800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96980052e0 con 0x7f9698004500 2021-11-15T14:43:33.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969800bc40 con 0x7f96980037d0 2021-11-15T14:43:33.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969800bd80 con 0x7f96b8060850 2021-11-15T14:43:33.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96980037d0 0x7f9698003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 -- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 msgr2=0x7f969800b750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:33.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b8060850 0x7f969800b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 -- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9698004500 msgr2=0x7f9698004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f9698004500 0x7f9698004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 -- 172.21.2.135:0/1830343017 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698003260 con 0x7f96980037d0 2021-11-15T14:43:33.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96980037d0 0x7f9698003bd0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f96980054d0 tx=0x7f96b80ace70).ready entity=mon.1 client_cookie=1d5b3486a83ea3ca server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a8007170 con 0x7f96980037d0 2021-11-15T14:43:33.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a80072d0 con 0x7f96980037d0 2021-11-15T14:43:33.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b77fe700 1 -- 172.21.2.135:0/1830343017 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a800c8b0 con 0x7f96980037d0 2021-11-15T14:43:33.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- 172.21.2.135:0/1830343017 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96980037d0 msgr2=0x7f9698003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 --2- 172.21.2.135:0/1830343017 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96980037d0 0x7f9698003bd0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f96980054d0 tx=0x7f96b80ace70).stop 2021-11-15T14:43:33.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bd3bf700 1 -- 172.21.2.135:0/1830343017 reap_dead start 2021-11-15T14:43:33.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- 172.21.2.135:0/1830343017 shutdown_connections 2021-11-15T14:43:33.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- 172.21.2.135:0/1830343017 >> 172.21.2.135:0/1830343017 conn(0x7f96b80b29f0 msgr2=0x7f96b80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- 172.21.2.135:0/1830343017 shutdown_connections 2021-11-15T14:43:33.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- 172.21.2.135:0/1830343017 wait complete. 2021-11-15T14:43:33.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 Processor -- start 2021-11-15T14:43:33.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- start start 2021-11-15T14:43:33.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96b80b4b10 0x7f96b81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b813d770 0x7f96b8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80b4ef0 con 0x7f96b80b4b10 2021-11-15T14:43:33.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80b0120 con 0x7f96b8152ec0 2021-11-15T14:43:33.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96bee22700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80b03c0 con 0x7f96b813d770 2021-11-15T14:43:33.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36044/0 (socket says 172.21.2.135:36044) 2021-11-15T14:43:33.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 -- 172.21.2.135:0/3241067515 learned_addr learned my addr 172.21.2.135:0/3241067515 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 -- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b813d770 msgr2=0x7f96b8155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b813d770 0x7f96b8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 -- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96b80b4b10 msgr2=0x7f96b81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96b80b4b10 0x7f96b81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.488+0000 7f96b7fff700 1 -- 172.21.2.135:0/3241067515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80ad320 con 0x7f96b8152ec0 2021-11-15T14:43:33.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b7fff700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f96a0002f70 tx=0x7f96a0006e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a0013460 con 0x7f96b8152ec0 2021-11-15T14:43:33.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00135c0 con 0x7f96b8152ec0 2021-11-15T14:43:33.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b8153340 con 0x7f96b8152ec0 2021-11-15T14:43:33.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a0013920 con 0x7f96b8152ec0 2021-11-15T14:43:33.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b80afcf0 con 0x7f96b8152ec0 2021-11-15T14:43:33.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b80ad4b0 con 0x7f96b8152ec0 2021-11-15T14:43:33.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96a001a060 con 0x7f96b8152ec0 2021-11-15T14:43:33.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 0x7f969c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f96a006b410 con 0x7f96b8152ec0 2021-11-15T14:43:33.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 0x7f969c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96bcbbe700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 0x7f969c0559e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f96980054d0 tx=0x7f96a8013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.492+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96a00423c0 con 0x7f96b8152ec0 2021-11-15T14:43:33.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.576+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f96b80573d0 con 0x7f96b8152ec0 2021-11-15T14:43:33.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.576+0000 7f96b5ffb700 1 -- 172.21.2.135:0/3241067515 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v155) v1 ==== 110+0+10 (secure 0 0 0) 0x7f96a00180b0 con 0x7f96b8152ec0 2021-11-15T14:43:33.582 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:33.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 msgr2=0x7f969c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 0x7f969c0559e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f96980054d0 tx=0x7f96a8013000).stop 2021-11-15T14:43:33.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 msgr2=0x7f96b813d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f96a0002f70 tx=0x7f96a0006e10).stop 2021-11-15T14:43:33.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 shutdown_connections 2021-11-15T14:43:33.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f969c053520 0x7f969c0559e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f96b813d770 0x7f96b8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f96b8152ec0 0x7f96b813d280 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 --2- 172.21.2.135:0/3241067515 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f96b80b4b10 0x7f96b81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 >> 172.21.2.135:0/3241067515 conn(0x7f96b80b29f0 msgr2=0x7f96b80b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 shutdown_connections 2021-11-15T14:43:33.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.580+0000 7f96bee22700 1 -- 172.21.2.135:0/3241067515 wait complete. 2021-11-15T14:43:33.588 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:33.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 Processor -- start 2021-11-15T14:43:33.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 -- start start 2021-11-15T14:43:33.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcd580a9f40 0x7fcd580aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.650 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd58060450 0x7fcd5813cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd58061a10 con 0x7fcd5813d240 2021-11-15T14:43:33.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd58061cb0 con 0x7fcd580a9f40 2021-11-15T14:43:33.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd5e95d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd58060c10 con 0x7fcd58060450 2021-11-15T14:43:33.651 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd58060450 0x7fcd5813cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcd58060450 0x7fcd5813cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36054/0 (socket says 172.21.2.135:36054) 2021-11-15T14:43:33.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 -- 172.21.2.135:0/1081053682 learned_addr learned my addr 172.21.2.135:0/1081053682 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 -- 172.21.2.135:0/1081053682 >> v2:172.21.2.119:3300/0 conn(0x7fcd580a9f40 msgr2=0x7fcd580aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.652 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 --2- 172.21.2.135:0/1081053682 >> v2:172.21.2.119:3300/0 conn(0x7fcd580a9f40 0x7fcd580aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 -- 172.21.2.135:0/1081053682 >> v1:172.21.2.135:6789/0 conn(0x7fcd5813d240 legacy=0x7fcd5813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd56ffd700 1 -- 172.21.2.135:0/1081053682 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414535979 0 0) 0x7fcd58061a10 con 0x7fcd5813d240 2021-11-15T14:43:33.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 -- 172.21.2.135:0/1081053682 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58060eb0 con 0x7fcd58060450 2021-11-15T14:43:33.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.640+0000 7fcd577fe700 1 --2- 172.21.2.135:0/1081053682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd58060450 0x7fcd5813cd50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fcd580aab70 tx=0x7fcd4c006e40).ready entity=mon.1 client_cookie=ebfef760304d65f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd56ffd700 1 -- 172.21.2.135:0/1081053682 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c00bce0 con 0x7fcd58060450 2021-11-15T14:43:33.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd56ffd700 1 -- 172.21.2.135:0/1081053682 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c000e90 con 0x7fcd58060450 2021-11-15T14:43:33.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd56ffd700 1 -- 172.21.2.135:0/1081053682 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c0155e0 con 0x7fcd58060450 2021-11-15T14:43:33.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/1081053682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd58060450 msgr2=0x7fcd5813cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/1081053682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd58060450 0x7fcd5813cd50 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7fcd580aab70 tx=0x7fcd4c006e40).stop 2021-11-15T14:43:33.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/1081053682 shutdown_connections 2021-11-15T14:43:33.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/1081053682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd58060450 0x7fcd5813cd50 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/1081053682 >> v2:172.21.2.119:3300/0 conn(0x7fcd580a9f40 0x7fcd580aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/1081053682 >> 172.21.2.135:0/1081053682 conn(0x7fcd580b29f0 msgr2=0x7fcd580b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/1081053682 shutdown_connections 2021-11-15T14:43:33.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/1081053682 wait complete. 2021-11-15T14:43:33.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 Processor -- start 2021-11-15T14:43:33.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- start start 2021-11-15T14:43:33.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd58060450 0x7fcd581405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd5813d240 0x7fcd58066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5813f3f0 con 0x7fcd58060450 2021-11-15T14:43:33.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58153280 con 0x7fcd580a9f40 2021-11-15T14:43:33.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581534f0 con 0x7fcd5813d240 2021-11-15T14:43:33.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36056/0 (socket says 172.21.2.135:36056) 2021-11-15T14:43:33.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 -- 172.21.2.135:0/780947817 learned_addr learned my addr 172.21.2.135:0/780947817 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 -- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd5813d240 msgr2=0x7fcd58066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd5813d240 0x7fcd58066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 -- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd58060450 msgr2=0x7fcd581405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd58060450 0x7fcd581405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 -- 172.21.2.135:0/780947817 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c00d4d0 con 0x7fcd580a9f40 2021-11-15T14:43:33.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd577fe700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fcd580aab70 tx=0x7fcd4c018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c009070 con 0x7fcd580a9f40 2021-11-15T14:43:33.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c015cb0 con 0x7fcd580a9f40 2021-11-15T14:43:33.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd58153790 con 0x7fcd580a9f40 2021-11-15T14:43:33.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd4c01e5e0 con 0x7fcd580a9f40 2021-11-15T14:43:33.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd58140ac0 con 0x7fcd580a9f40 2021-11-15T14:43:33.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58061150 con 0x7fcd580a9f40 2021-11-15T14:43:33.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd4c025030 con 0x7fcd580a9f40 2021-11-15T14:43:33.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 0x7fcd38055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.644+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcd4c06c9d0 con 0x7fcd580a9f40 2021-11-15T14:43:33.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.648+0000 7fcd57fff700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 0x7fcd38055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.648+0000 7fcd57fff700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 0x7fcd38055a00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fcd48002f70 tx=0x7fcd48006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.648+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd4c0439e0 con 0x7fcd580a9f40 2021-11-15T14:43:33.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcd580573d0 con 0x7fcd580a9f40 2021-11-15T14:43:33.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd557fa700 1 -- 172.21.2.135:0/780947817 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcd4c047000 con 0x7fcd580a9f40 2021-11-15T14:43:33.736 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:33.737 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 msgr2=0x7fcd38055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 0x7fcd38055a00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fcd48002f70 tx=0x7fcd48006a80).stop 2021-11-15T14:43:33.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 msgr2=0x7fcd580630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fcd580aab70 tx=0x7fcd4c018000).stop 2021-11-15T14:43:33.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 shutdown_connections 2021-11-15T14:43:33.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcd38053540 0x7fcd38055a00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcd5813d240 0x7fcd58066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcd580a9f40 0x7fcd580630b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 --2- 172.21.2.135:0/780947817 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcd58060450 0x7fcd581405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 >> 172.21.2.135:0/780947817 conn(0x7fcd580b29f0 msgr2=0x7fcd5805f930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 shutdown_connections 2021-11-15T14:43:33.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.732+0000 7fcd5e95d700 1 -- 172.21.2.135:0/780947817 wait complete. 2021-11-15T14:43:33.743 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:33.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 Processor -- start 2021-11-15T14:43:33.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 -- start start 2021-11-15T14:43:33.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb3180aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb31813f810 0x7fb31813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb318061a10 con 0x7fb318060450 2021-11-15T14:43:33.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb318140190 con 0x7fb31813f810 2021-11-15T14:43:33.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31f709700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb318061cb0 con 0x7fb3180a9f40 2021-11-15T14:43:33.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31d4a5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb3180aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31dca6700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb31813f810 0x7fb31813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31d4a5700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb3180aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45840/0 (socket says 172.21.2.135:45840) 2021-11-15T14:43:33.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.792+0000 7fb31d4a5700 1 -- 172.21.2.135:0/2371324688 learned_addr learned my addr 172.21.2.135:0/2371324688 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 msgr2=0x7fb3180aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb3180aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2371324688 >> v1:172.21.2.119:6789/0 conn(0x7fb318060450 legacy=0x7fb31813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2371324688 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318060c10 con 0x7fb31813f810 2021-11-15T14:43:33.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb31813f810 0x7fb31813fca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fb3100032f0 tx=0x7fb3100091d0).ready entity=mon.0 client_cookie=49cc95e185d709fb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb307fff700 1 -- 172.21.2.135:0/2371324688 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31000b6c0 con 0x7fb31813f810 2021-11-15T14:43:33.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb307fff700 1 -- 172.21.2.135:0/2371324688 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31000b820 con 0x7fb31813f810 2021-11-15T14:43:33.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb307fff700 1 -- 172.21.2.135:0/2371324688 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31000b990 con 0x7fb31813f810 2021-11-15T14:43:33.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb31813f810 msgr2=0x7fb31813fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb31813f810 0x7fb31813fca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fb3100032f0 tx=0x7fb3100091d0).stop 2021-11-15T14:43:33.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- 172.21.2.135:0/2371324688 shutdown_connections 2021-11-15T14:43:33.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb31813f810 0x7fb31813fca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- 172.21.2.135:0/2371324688 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb3180aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- 172.21.2.135:0/2371324688 >> 172.21.2.135:0/2371324688 conn(0x7fb3180b29f0 msgr2=0x7fb3180b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- 172.21.2.135:0/2371324688 shutdown_connections 2021-11-15T14:43:33.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- 172.21.2.135:0/2371324688 wait complete. 2021-11-15T14:43:33.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 Processor -- start 2021-11-15T14:43:33.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- start start 2021-11-15T14:43:33.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb318060450 0x7fb3180b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb318143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.807 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180ae890 con 0x7fb318060450 2021-11-15T14:43:33.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3181428d0 con 0x7fb31813f810 2021-11-15T14:43:33.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31f709700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb318143850 con 0x7fb3180a9f40 2021-11-15T14:43:33.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.808 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36070/0 (socket says 172.21.2.135:36070) 2021-11-15T14:43:33.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2993733946 learned_addr learned my addr 172.21.2.135:0/2993733946 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 msgr2=0x7fb318143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb318143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.809 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb318060450 msgr2=0x7fb3180b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb318060450 0x7fb3180b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 -- 172.21.2.135:0/2993733946 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009470 con 0x7fb31813f810 2021-11-15T14:43:33.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.796+0000 7fb31dca6700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fb3181439e0 tx=0x7fb310016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31000b6c0 con 0x7fb31813f810 2021-11-15T14:43:33.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310011e40 con 0x7fb31813f810 2021-11-15T14:43:33.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3100107a0 con 0x7fb31813f810 2021-11-15T14:43:33.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb318142630 con 0x7fb31813f810 2021-11-15T14:43:33.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb318142ec0 con 0x7fb31813f810 2021-11-15T14:43:33.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb318060eb0 con 0x7fb31813f810 2021-11-15T14:43:33.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb31000f070 con 0x7fb31813f810 2021-11-15T14:43:33.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 0x7fb2f80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb31006c780 con 0x7fb31813f810 2021-11-15T14:43:33.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb31d4a5700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 0x7fb2f80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb31d4a5700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 0x7fb2f80559b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fb30800e000 tx=0x7fb30800f040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.800+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb310043730 con 0x7fb31813f810 2021-11-15T14:43:33.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3180573d0 con 0x7fb31813f810 2021-11-15T14:43:33.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb3067fc700 1 -- 172.21.2.135:0/2993733946 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb3100150a0 con 0x7fb31813f810 2021-11-15T14:43:33.889 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:33.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 msgr2=0x7fb2f80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 0x7fb2f80559b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fb30800e000 tx=0x7fb30800f040).stop 2021-11-15T14:43:33.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 msgr2=0x7fb3180ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fb3181439e0 tx=0x7fb310016000).stop 2021-11-15T14:43:33.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 shutdown_connections 2021-11-15T14:43:33.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb2f80534f0 0x7fb2f80559b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb31813f810 0x7fb3180ad1c0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb3180a9f40 0x7fb318143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 --2- 172.21.2.135:0/2993733946 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb318060450 0x7fb3180b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:33.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 >> 172.21.2.135:0/2993733946 conn(0x7fb3180b29f0 msgr2=0x7fb31805c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 shutdown_connections 2021-11-15T14:43:33.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.884+0000 7fb31f709700 1 -- 172.21.2.135:0/2993733946 wait complete. 2021-11-15T14:43:33.896 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:33.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 Processor -- start 2021-11-15T14:43:33.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 -- start start 2021-11-15T14:43:33.953 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa7840b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fa7840b0030 0x7fa7840b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7840b2810 con 0x7fa7840a7140 2021-11-15T14:43:33.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7840b0470 con 0x7fa7840b0030 2021-11-15T14:43:33.954 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78c548700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b06d0 con 0x7fa7840b1f40 2021-11-15T14:43:33.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78aae5700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa7840a7140 0x7fa7841412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51902/0 (socket says 172.21.2.135:51902) 2021-11-15T14:43:33.955 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78aae5700 1 -- 172.21.2.135:0/198782554 learned_addr learned my addr 172.21.2.135:0/198782554 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa78a2e4700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa7840b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852797058 0 0) 0x7fa7840b2810 con 0x7fa7840a7140 2021-11-15T14:43:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa789ae3700 1 --2- 172.21.2.135:0/198782554 >> v2:172.21.2.119:3300/0 conn(0x7fa7840b0030 0x7fa7840b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.948+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa76c003260 con 0x7fa7840a7140 2021-11-15T14:43:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712263453 0 0) 0x7fa76c003260 con 0x7fa7840a7140 2021-11-15T14:43:33.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 msgr2=0x7fa7840b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa7840b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 >> v2:172.21.2.119:3300/0 conn(0x7fa7840b0030 msgr2=0x7fa7840b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 --2- 172.21.2.135:0/198782554 >> v2:172.21.2.119:3300/0 conn(0x7fa7840b0030 0x7fa7840b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840b0970 con 0x7fa7840a7140 2021-11-15T14:43:33.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa77c0019e0 con 0x7fa7840a7140 2021-11-15T14:43:33.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 >> v1:172.21.2.135:6789/0 conn(0x7fa7840a7140 legacy=0x7fa7841412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa76c003750 0x7fa76c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa76c004500 0x7fa76c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa76c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b0470 con 0x7fa76c003750 2021-11-15T14:43:33.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b06d0 con 0x7fa76c004500 2021-11-15T14:43:33.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c00b7a0 con 0x7fa7840b1f40 2021-11-15T14:43:33.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa76c004500 0x7fa76c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 msgr2=0x7fa76c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78aae5700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa76c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa7840b1f40 0x7fa76c004e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa76c003750 msgr2=0x7fa76c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:33.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78a2e4700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa76c003750 0x7fa76c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa76c003750 0x7fa76c003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/198782554 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c003260 con 0x7fa76c004500 2021-11-15T14:43:33.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa76c004500 0x7fa76c004980 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fa78000a000 tx=0x7fa780008040).ready entity=mon.1 client_cookie=44d6ca5d4fa56317 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780013670 con 0x7fa76c004500 2021-11-15T14:43:33.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7800137d0 con 0x7fa76c004500 2021-11-15T14:43:33.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7892e2700 1 -- 172.21.2.135:0/198782554 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780013b30 con 0x7fa76c004500 2021-11-15T14:43:33.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/198782554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa76c004500 msgr2=0x7fa76c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 --2- 172.21.2.135:0/198782554 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa76c004500 0x7fa76c004980 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fa78000a000 tx=0x7fa780008040).stop 2021-11-15T14:43:33.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78aae5700 1 -- 172.21.2.135:0/198782554 reap_dead start 2021-11-15T14:43:33.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/198782554 shutdown_connections 2021-11-15T14:43:33.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/198782554 >> 172.21.2.135:0/198782554 conn(0x7fa78405f730 msgr2=0x7fa78405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:33.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/198782554 shutdown_connections 2021-11-15T14:43:33.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/198782554 wait complete. 2021-11-15T14:43:33.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 Processor -- start 2021-11-15T14:43:33.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- start start 2021-11-15T14:43:33.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa76c004500 0x7fa78413d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7840b4550 0x7fa78414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b56f0 con 0x7fa7840b4550 2021-11-15T14:43:33.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b5a00 con 0x7fa784148bb0 2021-11-15T14:43:33.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78414b0b0 con 0x7fa76c004500 2021-11-15T14:43:33.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36094/0 (socket says 172.21.2.135:36094) 2021-11-15T14:43:33.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/2064749036 learned_addr learned my addr 172.21.2.135:0/2064749036 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:33.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78a2e4700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa76c004500 0x7fa78413d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78aae5700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7840b4550 0x7fa78414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa76c004500 msgr2=0x7fa78413d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa76c004500 0x7fa78413d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7840b4550 msgr2=0x7fa78414abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:33.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7840b4550 0x7fa78414abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:33.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 -- 172.21.2.135:0/2064749036 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7841490c0 con 0x7fa784148bb0 2021-11-15T14:43:33.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa789ae3700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7fa7840abc90 tx=0x7fa780008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780012d20 con 0x7fa784148bb0 2021-11-15T14:43:33.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780000e90 con 0x7fa784148bb0 2021-11-15T14:43:33.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840b5c30 con 0x7fa784148bb0 2021-11-15T14:43:33.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78001d600 con 0x7fa784148bb0 2021-11-15T14:43:33.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.952+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7840b4a60 con 0x7fa784148bb0 2021-11-15T14:43:33.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7840b0c10 con 0x7fa784148bb0 2021-11-15T14:43:33.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa78001d760 con 0x7fa784148bb0 2021-11-15T14:43:33.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa7777fe700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 0x7fa764055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:33.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa78a2e4700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 0x7fa764055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:33.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa780047eb0 con 0x7fa784148bb0 2021-11-15T14:43:33.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.956+0000 7fa78a2e4700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 0x7fa764055b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa778009000 tx=0x7fa778008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:33.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:33.960+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa780044250 con 0x7fa784148bb0 2021-11-15T14:43:34.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7840573d0 con 0x7fa784148bb0 2021-11-15T14:43:34.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa7777fe700 1 -- 172.21.2.135:0/2064749036 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa78000b120 con 0x7fa784148bb0 2021-11-15T14:43:34.046 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:34.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 msgr2=0x7fa764055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 0x7fa764055b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa778009000 tx=0x7fa778008040).stop 2021-11-15T14:43:34.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 msgr2=0x7fa78414a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7fa7840abc90 tx=0x7fa780008040).stop 2021-11-15T14:43:34.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 shutdown_connections 2021-11-15T14:43:34.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa7640536a0 0x7fa764055b60 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa7840b4550 0x7fa78414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa784148bb0 0x7fa78414a6d0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 --2- 172.21.2.135:0/2064749036 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa76c004500 0x7fa78413d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 >> 172.21.2.135:0/2064749036 conn(0x7fa78405f730 msgr2=0x7fa7840af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:34.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 shutdown_connections 2021-11-15T14:43:34.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.040+0000 7fa78c548700 1 -- 172.21.2.135:0/2064749036 wait complete. 2021-11-15T14:43:34.052 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:34.053 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:34.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 Processor -- start 2021-11-15T14:43:34.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- start start 2021-11-15T14:43:34.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57b00b1e30 0x7f57b00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f57b00a7140 0x7f57b01447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00b03d0 con 0x7f57b0148420 2021-11-15T14:43:34.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00a9140 con 0x7f57b00a7140 2021-11-15T14:43:34.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b0670 con 0x7f57b00b1e30 2021-11-15T14:43:34.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57b00b1e30 0x7f57b00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:34.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f57b00b1e30 0x7f57b00b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36098/0 (socket says 172.21.2.135:36098) 2021-11-15T14:43:34.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 -- 172.21.2.135:0/1507659332 learned_addr learned my addr 172.21.2.135:0/1507659332 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:34.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 -- 172.21.2.135:0/1507659332 >> v2:172.21.2.119:3300/0 conn(0x7f57b00a7140 msgr2=0x7f57b01447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:34.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 --2- 172.21.2.135:0/1507659332 >> v2:172.21.2.119:3300/0 conn(0x7f57b00a7140 0x7f57b01447a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 -- 172.21.2.135:0/1507659332 >> v1:172.21.2.119:6789/0 conn(0x7f57b0148420 legacy=0x7f57b00b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:34.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 -- 172.21.2.135:0/1507659332 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00b0910 con 0x7f57b00b1e30 2021-11-15T14:43:34.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ae59c700 1 --2- 172.21.2.135:0/1507659332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b00b1050 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f57b01477b0 tx=0x7f57a0006eb0).ready entity=mon.1 client_cookie=4880361a10c0427b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:34.111 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ad59a700 1 -- 172.21.2.135:0/1507659332 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a000d5c0 con 0x7f57b00b1e30 2021-11-15T14:43:34.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ad59a700 1 -- 172.21.2.135:0/1507659332 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0000e90 con 0x7f57b00b1e30 2021-11-15T14:43:34.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57ad59a700 1 -- 172.21.2.135:0/1507659332 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a000d950 con 0x7f57b00b1e30 2021-11-15T14:43:34.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- 172.21.2.135:0/1507659332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 msgr2=0x7f57b00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.112 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/1507659332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b00b1050 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f57b01477b0 tx=0x7f57a0006eb0).stop 2021-11-15T14:43:34.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- 172.21.2.135:0/1507659332 shutdown_connections 2021-11-15T14:43:34.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/1507659332 >> v2:172.21.2.119:3300/0 conn(0x7f57b00a7140 0x7f57b01447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/1507659332 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b00b1050 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.113 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- 172.21.2.135:0/1507659332 >> 172.21.2.135:0/1507659332 conn(0x7f57b005f730 msgr2=0x7f57b005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:34.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- 172.21.2.135:0/1507659332 shutdown_connections 2021-11-15T14:43:34.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.100+0000 7f57b4b7f700 1 -- 172.21.2.135:0/1507659332 wait complete. 2021-11-15T14:43:34.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 Processor -- start 2021-11-15T14:43:34.114 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- start start 2021-11-15T14:43:34.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57b00a7140 0x7f57b00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57b0148420 0x7f57b0143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b014af90 con 0x7f57b00a7140 2021-11-15T14:43:34.115 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00af370 con 0x7f57b00b1e30 2021-11-15T14:43:34.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b014b1f0 con 0x7f57b0148420 2021-11-15T14:43:34.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:34.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36104/0 (socket says 172.21.2.135:36104) 2021-11-15T14:43:34.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 -- 172.21.2.135:0/2205404104 learned_addr learned my addr 172.21.2.135:0/2205404104 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:34.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 -- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57b0148420 msgr2=0x7f57b0143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57b0148420 0x7f57b0143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 -- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57b00a7140 msgr2=0x7f57b00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57b00a7140 0x7f57b00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 -- 172.21.2.135:0/2205404104 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a000b1e0 con 0x7f57b00b1e30 2021-11-15T14:43:34.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57add9b700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f57a4000ed0 tx=0x7f57a4006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:34.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a4009e00 con 0x7f57b00b1e30 2021-11-15T14:43:34.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4012410 con 0x7f57b00b1e30 2021-11-15T14:43:34.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a4012770 con 0x7f57b00b1e30 2021-11-15T14:43:34.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b014b490 con 0x7f57b00b1e30 2021-11-15T14:43:34.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00af060 con 0x7f57b00b1e30 2021-11-15T14:43:34.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b01444d0 con 0x7f57b00b1e30 2021-11-15T14:43:34.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f57a400f030 con 0x7f57b00b1e30 2021-11-15T14:43:34.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 0x7f578c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:34.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f57a406b740 con 0x7f57b00b1e30 2021-11-15T14:43:34.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.104+0000 7f57ae59c700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 0x7f578c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:34.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.108+0000 7f57ae59c700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 0x7f578c055bb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f57b01477b0 tx=0x7f57a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:34.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.108+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f57a4042640 con 0x7f57b00b1e30 2021-11-15T14:43:34.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57b014b620 con 0x7f57b00b1e30 2021-11-15T14:43:34.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f579f7fe700 1 -- 172.21.2.135:0/2205404104 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f57a4045c60 con 0x7f57b00b1e30 2021-11-15T14:43:34.222 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:34.222 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:30.114949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8386":{"gid":8386,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/3501994559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3501994559},{"type":"v1","addr":"172.21.2.135:6835","nonce":3501994559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:34.224 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 msgr2=0x7f578c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 0x7f578c055bb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f57b01477b0 tx=0x7f57a0015000).stop 2021-11-15T14:43:34.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 msgr2=0x7f57b0143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:34.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f57a4000ed0 tx=0x7f57a4006d60).stop 2021-11-15T14:43:34.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 shutdown_connections 2021-11-15T14:43:34.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f578c0536f0 0x7f578c055bb0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f57b0148420 0x7f57b0143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f57b00b1e30 0x7f57b0143950 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:34.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 --2- 172.21.2.135:0/2205404104 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f57b00a7140 0x7f57b00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:34.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 >> 172.21.2.135:0/2205404104 conn(0x7f57b005f730 msgr2=0x7f57b00af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 shutdown_connections 2021-11-15T14:43:34.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:34.216+0000 7f57b4b7f700 1 -- 172.21.2.135:0/2205404104 wait complete. 2021-11-15T14:43:34.230 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 76 2021-11-15T14:43:34.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:29.110271+0000', 'modified': '2021-11-15T14:43:30.114949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8386}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8386': {'gid': 8386, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/3501994559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6834', 'nonce': 3501994559}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 3501994559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:34.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:34.535 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:34.600 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8386,"want_state":"up:active","state":"up:active","rank_uptime":5.4788179589999997,"mdsmap_epoch":76,"osdmap_epoch":155,"osdmap_epoch_barrier":154,"uptime":9.6969021140000002} 2021-11-15T14:43:34.601 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8386, "mdsmap_epoch": 76, "osdmap_epoch": 155, "osdmap_epoch_barrier": 154, "rank_uptime": 5.478817959, "state": "up:active", "uptime": 9.696902114, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:34.602 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:34.602 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:43:34.602 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:43:34.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.604 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:34.615 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:34.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:34.629 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:34.635 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:34.635 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:34.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.637 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:34.682 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:34.683 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:34.686 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:34.695 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:34.696 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:34.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:43:34.718+0000 7fd3b334b080 -1 init, newargv = 0x5642fa312af0 newargc=9 2021-11-15T14:43:34.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14807]: starting ceph client 2021-11-15T14:43:34.732 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:34.733 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:34.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.734 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:34.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14807]: starting fuse 2021-11-15T14:43:34.744 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:43:34.744 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:34.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.745 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:43:34.745 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:43:34.746 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:43:34.746 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:43:34.746 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:43:34.747 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:34.747 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:43:34.748 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:43:34.748 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:43:34.748 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:34.749 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:43:34.749 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:43:34.749 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:43:34.750 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:43:34.750 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:34.751 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:43:34.751 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:34.751 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:34.752 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:43:34.752 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:34.753 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:34.753 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:43:34.753 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:43:34.836 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14807.asok 2021-11-15T14:43:34.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14807.asok 2021-11-15T14:43:34.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.841 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14807.asok status 2021-11-15T14:43:34.894 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:43:34.895 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:43:34.895 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:34.895 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:34.895 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:43:34.896 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:43:34.896 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:43:34.896 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14807", 2021-11-15T14:43:34.896 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:43:34.897 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:34.897 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:43:34.897 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:34.897 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 8596, 2021-11-15T14:43:34.897 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:43:34.898 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:43:34.898 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:43:34.898 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 8596 2021-11-15T14:43:34.898 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:34.899 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:34.899 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:34.899 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:34.899 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3783650042 2021-11-15T14:43:34.899 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:43:34.900 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:34.900 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:34.900 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:34.900 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:34.901 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 3783650042 2021-11-15T14:43:34.901 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:34.901 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.8596 172.21.2.132:0/3783650042", 2021-11-15T14:43:34.901 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/3783650042", 2021-11-15T14:43:34.902 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:43:34.902 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 76, 2021-11-15T14:43:34.902 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 155, 2021-11-15T14:43:34.902 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:34.902 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:43:34.903 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:43:34.903 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:43:34.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.905 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:34.905 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:34.911 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:34.911 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:34.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:34.912 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:34.962 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T14:43:34.963 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-11-15T14:43:35.001 INFO:teuthology.orchestra.run.gibba038.stdout:1636987414.955898689 2021-11-15T14:43:35.001 INFO:tasks.cephfs.test_misc:rctime = 1636987414.955898689 2021-11-15T14:43:35.002 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:43:35.002 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:35.012 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:35.025 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:35.037 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:35.052 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:43:35.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:35.053 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:35.053 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:35.063 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:35.064 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:35.065 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-15T14:43:35.065 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:35.066 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:35.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15257]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:35.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:35.123 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:35.123 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:35.127 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-15T14:43:35.128 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:35.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:43:35.233 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:35.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:35.281 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:35.282 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:35.294 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:35.295 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:35.296 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:43:35.297 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:35.297 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:35.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14807]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:35.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:35.359 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:35.359 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:35.368 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:43:35.370 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:35.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:43:35.480 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:35.525 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:43:35.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 Processor -- start 2021-11-15T14:43:35.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 -- start start 2021-11-15T14:43:35.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 0x7f71441447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440b03d0 con 0x7f7144148420 2021-11-15T14:43:35.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440a9140 con 0x7f71440a7140 2021-11-15T14:43:35.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.576+0000 7f714c7ee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440b0670 con 0x7f71440b1e30 2021-11-15T14:43:35.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714ad8b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 0x7f71441447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f7149d89700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f7144148420 0x7f71440b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:33118/0 (socket says 172.21.2.135:33118) 2021-11-15T14:43:35.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45886/0 (socket says 172.21.2.135:45886) 2021-11-15T14:43:35.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714ad8b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 0x7f71441447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:58158/0 (socket says 172.21.2.135:58158) 2021-11-15T14:43:35.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 -- 172.21.2.135:0/3131651873 learned_addr learned my addr 172.21.2.135:0/3131651873 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:35.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 -- 172.21.2.135:0/3131651873 >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 msgr2=0x7f71441447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:35.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 --2- 172.21.2.135:0/3131651873 >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 0x7f71441447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 -- 172.21.2.135:0/3131651873 >> v1:172.21.2.119:6789/0 conn(0x7f7144148420 legacy=0x7f71440b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 -- 172.21.2.135:0/3131651873 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440b0910 con 0x7f71440b1e30 2021-11-15T14:43:35.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f714a58a700 1 --2- 172.21.2.135:0/3131651873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140006eb0).ready entity=mon.2 client_cookie=67ff4795b16de4a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f7149588700 1 -- 172.21.2.135:0/3131651873 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714000d570 con 0x7f71440b1e30 2021-11-15T14:43:35.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f7149588700 1 -- 172.21.2.135:0/3131651873 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140000e90 con 0x7f71440b1e30 2021-11-15T14:43:35.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.580+0000 7f7149588700 1 -- 172.21.2.135:0/3131651873 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714000d900 con 0x7f71440b1e30 2021-11-15T14:43:35.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/3131651873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 msgr2=0x7f71440b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- 172.21.2.135:0/3131651873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140006eb0).stop 2021-11-15T14:43:35.588 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/3131651873 shutdown_connections 2021-11-15T14:43:35.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- 172.21.2.135:0/3131651873 >> v2:172.21.2.119:3300/0 conn(0x7f71440a7140 0x7f71441447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- 172.21.2.135:0/3131651873 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f71440b1e30 0x7f71440b1050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/3131651873 >> 172.21.2.135:0/3131651873 conn(0x7f714405f730 msgr2=0x7f714405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:35.589 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/3131651873 shutdown_connections 2021-11-15T14:43:35.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/3131651873 wait complete. 2021-11-15T14:43:35.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 Processor -- start 2021-11-15T14:43:35.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- start start 2021-11-15T14:43:35.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71440b1e30 0x7f714414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7144148420 0x7f7144159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71440a9e30 con 0x7f71440b1e30 2021-11-15T14:43:35.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71440aae90 con 0x7f71440a7140 2021-11-15T14:43:35.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440ab130 con 0x7f7144148420 2021-11-15T14:43:35.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36116/0 (socket says 172.21.2.135:36116) 2021-11-15T14:43:35.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 -- 172.21.2.135:0/2264340696 learned_addr learned my addr 172.21.2.135:0/2264340696 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:35.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 -- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7144148420 msgr2=0x7f7144159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714ad8b700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7144148420 0x7f7144159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7144148420 0x7f7144159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 -- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71440b1e30 msgr2=0x7f714414a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f7149d89700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71440b1e30 0x7f714414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71440b1e30 0x7f714414a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 -- 172.21.2.135:0/2264340696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714000b1e0 con 0x7f71440a7140 2021-11-15T14:43:35.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714a58a700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f71441492d0 tx=0x7f7140015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714000de20 con 0x7f71440a7140 2021-11-15T14:43:35.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140011ca0 con 0x7f71440a7140 2021-11-15T14:43:35.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71440ab3d0 con 0x7f71440a7140 2021-11-15T14:43:35.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714001e460 con 0x7f71440a7140 2021-11-15T14:43:35.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7144149e10 con 0x7f71440a7140 2021-11-15T14:43:35.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71440573d0 con 0x7f71440a7140 2021-11-15T14:43:35.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.584+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7140025030 con 0x7f71440a7140 2021-11-15T14:43:35.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.588+0000 7f71337fe700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 0x7f7124055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.588+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f714006cc30 con 0x7f71440a7140 2021-11-15T14:43:35.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.588+0000 7f7149d89700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 0x7f7124055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.588+0000 7f7149d89700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 0x7f7124055b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f7134008000 tx=0x7f7134009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.588+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7140043c80 con 0x7f71440a7140 2021-11-15T14:43:35.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.668+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f71440446d0 con 0x7f71440a7140 2021-11-15T14:43:35.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f71337fe700 1 -- 172.21.2.135:0/2264340696 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v155) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f7140023020 con 0x7f71440a7140 2021-11-15T14:43:35.675 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:35.675 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:35.675 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 155, 2021-11-15T14:43:35.676 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:43:35.676 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:43:35.676 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:43:30.116081+0000", 2021-11-15T14:43:35.676 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:35.676 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:35.677 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:43:35.677 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:43:35.677 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:43:35.677 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:43:35.678 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:43:35.678 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:43:35.678 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:43:35.678 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:35.679 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:43:35.679 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:43:35.679 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:43:35.679 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:43:35.679 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:43:35.680 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 28, 2021-11-15T14:43:35.680 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:43:35.680 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:43:35.680 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:43:35.681 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:43:35.681 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:43:35.681 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.681 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:43:35.682 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:43:35.682 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:43:35.682 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:35.682 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:35.682 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:35.683 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:35.683 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:35.683 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:35.683 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:35.684 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:35.684 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:43:35.684 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:43:35.684 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:43:35.684 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:43:35.685 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:43:35.685 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:35.685 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:35.685 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:35.686 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:35.686 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:35.686 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:35.686 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:35.686 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.687 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:43:35.687 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:35.687 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:35.687 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:35.688 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:35.688 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:35.688 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:35.688 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:35.688 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:35.689 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:35.689 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:35.689 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:35.689 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:35.690 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:35.690 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:35.690 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:35.690 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:35.690 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:35.691 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:35.691 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:35.691 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:35.691 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:35.692 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:35.692 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:35.692 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:35.692 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:35.692 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:35.693 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.693 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:35.693 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:35.693 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:35.694 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:35.694 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:35.694 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:35.694 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:35.695 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:35.695 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:35.695 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:35.695 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:35.695 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:35.696 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:43:35.696 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.696 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:35.696 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:43:35.697 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.697 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.697 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.697 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:43:35.697 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:43:35.698 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:43:35.698 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:35.698 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:35.698 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:35.698 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:35.699 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:35.699 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:35.699 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:35.699 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:35.700 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:35.700 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:35.700 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:35.700 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:35.701 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:35.701 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:35.701 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:35.701 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:35.701 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:35.702 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:35.702 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:35.702 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:35.702 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.703 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:43:35.703 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:35.703 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:35.703 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:35.703 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:35.704 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:35.704 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:35.704 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:35.704 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:35.705 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:35.705 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:35.705 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:35.705 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:35.706 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:35.706 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:35.706 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:35.706 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:35.706 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:35.707 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:35.707 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:35.707 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:35.707 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:35.708 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:35.708 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:35.708 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:35.708 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:35.709 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:35.709 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.709 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:35.709 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:35.709 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:35.710 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:35.710 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:35.710 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:35.710 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:35.711 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:35.711 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:35.711 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:35.711 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:35.711 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:35.712 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:35.712 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:43:35.712 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.712 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.713 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.713 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 27, 2021-11-15T14:43:35.713 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:43:35.713 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:43:27.057306+0000", 2021-11-15T14:43:35.713 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:35.714 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:35.714 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:35.714 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:35.714 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:35.715 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:35.715 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:35.715 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:35.715 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:35.716 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:35.716 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:35.716 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:35.716 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:35.716 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:35.717 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:35.717 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:35.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:35.717 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:35.718 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:35.718 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:35.718 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.718 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "154", 2021-11-15T14:43:35.719 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:35.719 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:35.719 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:35.719 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:35.720 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:35.720 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:35.720 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:35.720 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:35.721 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:35.721 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:35.721 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:35.721 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:35.721 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:35.722 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:35.722 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:35.722 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:35.722 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:35.723 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:35.723 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:35.723 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:35.723 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:35.724 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:35.724 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:35.724 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:35.724 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:35.724 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:35.725 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.725 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:35.725 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:35.725 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:35.726 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:35.726 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:35.726 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:35.726 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:35.726 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:35.727 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:35.727 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:35.727 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:35.727 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:35.728 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:43:35.728 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:43:35.728 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:43:35.728 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.728 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:35.729 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:43:35.729 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:43:35.729 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.729 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.730 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.730 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 28, 2021-11-15T14:43:35.730 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:43:35.731 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:43:28.115642+0000", 2021-11-15T14:43:35.731 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:35.731 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:35.731 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:35.731 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:35.732 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:35.732 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:35.732 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:35.732 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:35.733 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:35.733 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:35.733 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:35.733 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:35.733 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:35.734 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:35.734 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:35.734 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:35.734 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:35.735 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:35.735 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:35.735 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:35.735 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.735 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "155", 2021-11-15T14:43:35.736 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:35.736 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:35.736 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:35.736 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:35.737 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:35.737 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:35.737 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:35.737 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:35.738 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:35.738 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:35.738 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:35.738 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:35.738 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:35.739 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:35.739 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:35.739 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:35.739 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:35.740 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:35.740 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:35.740 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:35.740 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:35.740 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:35.741 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:35.741 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:35.741 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:35.741 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:35.742 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.742 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:35.742 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:35.742 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:35.742 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:35.743 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:35.743 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:35.743 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:35.743 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:35.744 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:35.744 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:35.744 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:35.744 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:35.744 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:35.745 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:43:35.745 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:43:35.745 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.745 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.745 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.746 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:35.746 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:43:35.746 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.746 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:35.747 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:43:35.747 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.747 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.747 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.747 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.748 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.748 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.748 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.748 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.749 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.749 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.749 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.749 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.750 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.750 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.750 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:43:35.750 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.750 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.751 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.751 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.751 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:43:35.751 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.752 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.752 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.752 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.752 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.752 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.753 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.753 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.753 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:43:35.753 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.754 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.754 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.754 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.754 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:43:35.754 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.755 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.755 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.755 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.755 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.756 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.756 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.756 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.756 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:43:35.756 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.757 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.757 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.757 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.757 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:43:35.758 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.758 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.758 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.758 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.758 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.759 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.759 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.759 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.759 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:43:35.760 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.760 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.760 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.760 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.761 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:43:35.761 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:35.761 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.761 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.761 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.762 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:43:35.762 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:43:35.762 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:43:35.762 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:43:35.763 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.763 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.763 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.763 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.763 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.764 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.764 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:35.764 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:43:35.764 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.765 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.765 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.765 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.765 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.765 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.766 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.766 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.766 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.766 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.767 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.767 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.767 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.767 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.768 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:43:35.768 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.768 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.768 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.768 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.769 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:43:35.769 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.769 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.769 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.769 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.770 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.770 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.770 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.770 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.771 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:43:35.771 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.771 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.771 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.772 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.772 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:43:35.772 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.772 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.772 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.773 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.773 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.773 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.773 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.774 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.774 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:43:35.774 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.774 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.774 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.775 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.775 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:43:35.775 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.775 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.776 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.776 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.776 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.776 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.776 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.777 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.777 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:43:35.777 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.777 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.778 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.778 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.778 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:43:35.778 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:35.779 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.779 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.779 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.779 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:43:35.779 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:43:35.780 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:43:35.780 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:43:35.780 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.780 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.781 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.781 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.781 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.781 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.781 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:35.782 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:43:35.782 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.782 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.782 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.783 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.783 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.783 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.783 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.784 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.784 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.784 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.784 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.784 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.785 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.785 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.785 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:43:35.785 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.786 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.786 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.786 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.786 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:43:35.786 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.787 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.787 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.787 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.787 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.788 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.788 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.788 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.788 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:43:35.788 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.789 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.789 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.789 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.789 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:43:35.790 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.790 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.790 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.790 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.790 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.791 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.791 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.791 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.791 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:43:35.792 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.792 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.792 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.792 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.793 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:43:35.793 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.793 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.793 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.793 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.794 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.794 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.794 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.794 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.795 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:43:35.795 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.795 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.795 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.796 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.796 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:43:35.796 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:35.796 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.796 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.797 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.797 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:43:35.797 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:43:35.797 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:43:35.798 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:43:35.798 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.798 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.798 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.798 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.799 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.799 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.799 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:35.799 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:43:35.800 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.800 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.800 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.800 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.801 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.801 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.801 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.801 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 152, 2021-11-15T14:43:35.801 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.802 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.802 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.802 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.802 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.803 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.803 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:43:35.803 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.803 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.804 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.804 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.804 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:43:35.804 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.804 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.805 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.805 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.805 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.805 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.806 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.806 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.806 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:43:35.806 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.807 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.807 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.807 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.807 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:43:35.807 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.808 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.808 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.808 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.808 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.809 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.809 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.809 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.809 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:43:35.809 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.810 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.810 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.810 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.810 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:43:35.811 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.811 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.811 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.811 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.811 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.812 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.812 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.812 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.812 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:43:35.813 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.813 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.813 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.813 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.813 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:43:35.814 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:35.814 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.814 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.814 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.815 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:43:35.815 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:43:35.815 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:43:35.815 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:43:35.815 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.816 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.816 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.816 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.816 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.817 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.817 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:35.817 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:43:35.817 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.818 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.818 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.818 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.818 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.819 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.819 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.819 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 152, 2021-11-15T14:43:35.819 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.819 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.820 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.820 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.820 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.820 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.821 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:43:35.821 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.821 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.821 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.822 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.822 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:43:35.822 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.822 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.822 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.823 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.823 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.823 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.823 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.824 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.824 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:43:35.824 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.824 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.824 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.825 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.825 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:43:35.825 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.825 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.826 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.826 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.826 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.826 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:43:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.827 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.828 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.828 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.828 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:43:35.828 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.829 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.829 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.829 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.829 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.829 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.830 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.830 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.830 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:43:35.830 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:43:35.831 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:35.832 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.832 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.832 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.832 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:43:35.832 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:43:35.833 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:43:35.833 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:43:35.833 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.833 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.834 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.834 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.834 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.834 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.834 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:35.835 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:43:35.835 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.835 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.835 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.836 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.836 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.836 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.836 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.836 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.837 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.837 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.837 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.837 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.838 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.838 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.838 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:43:35.838 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.838 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.839 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.839 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.839 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:43:35.839 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.840 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.840 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.840 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.840 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.840 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.841 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.841 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.841 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:43:35.841 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.842 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.842 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.842 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.842 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:43:35.842 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.843 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.843 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.843 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.843 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.844 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.844 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.844 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.844 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:43:35.844 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.845 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.845 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.845 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.845 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:43:35.846 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.846 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.846 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.846 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.846 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.847 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.847 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.847 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.847 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:43:35.848 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.848 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.848 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.848 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.848 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:43:35.849 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:35.849 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.849 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.849 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.850 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:43:35.850 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:43:35.850 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:43:35.850 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:43:35.850 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.851 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.851 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.851 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.851 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.852 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.852 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:35.852 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:43:35.852 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.852 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.853 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.853 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.853 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.853 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.854 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.854 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.854 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.854 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.854 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.855 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.855 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.855 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.855 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:43:35.856 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.856 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.856 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.856 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.856 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:43:35.857 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.857 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.857 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.857 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.858 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.858 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.858 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.858 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.859 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:43:35.859 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.859 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.859 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.859 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.860 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:43:35.860 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.860 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.860 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.860 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.861 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.861 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.861 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.861 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.862 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:43:35.862 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.862 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.862 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.863 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.863 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:43:35.863 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.863 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.863 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.864 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.864 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.864 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.864 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.865 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.865 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:43:35.865 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.865 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.865 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.866 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.866 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:43:35.866 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:35.866 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.867 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.867 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.867 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:43:35.867 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:43:35.867 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:43:35.868 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:43:35.868 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.868 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.868 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.869 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.869 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.869 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.869 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:35.869 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:43:35.870 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:35.870 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:35.870 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:35.870 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:35.871 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:35.871 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:35.871 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:35.871 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:35.871 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:35.872 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:35.872 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:35.872 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.872 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.873 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.873 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:43:35.873 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.873 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.873 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.874 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.874 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:43:35.874 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.874 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.875 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.875 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.875 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:35.875 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.875 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.876 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.876 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:43:35.876 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.876 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.877 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.877 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.877 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:43:35.877 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.877 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.878 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.878 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.878 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:35.878 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.879 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.879 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.879 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:43:35.879 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.879 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.880 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.880 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.880 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:43:35.880 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.881 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.881 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.881 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.881 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:35.881 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:35.882 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.882 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:35.882 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:43:35.882 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.883 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.883 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.883 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:35.883 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:43:35.883 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:35.884 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.884 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.884 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.884 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:43:35.885 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:43:35.885 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:43:35.885 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:43:35.885 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:35.885 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:35.886 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:35.886 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:35.886 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.886 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:35.887 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:43:35.887 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.887 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:35.887 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.887 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.888 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.888 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.888 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.888 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:43:35.889 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.889 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.889 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.889 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:35.889 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.890 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.890 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.890 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.890 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.891 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:43:35.891 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.891 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.891 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.891 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:35.892 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.892 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.892 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.892 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.893 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.893 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:43:35.893 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.893 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.893 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.894 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:35.894 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.894 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.894 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.895 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.895 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.895 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:43:35.895 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.896 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.896 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.896 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:35.896 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.896 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.897 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.897 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.897 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.897 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:43:35.897 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.898 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.898 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.898 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:35.898 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.899 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.899 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.899 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.899 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.899 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:43:35.900 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.900 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.900 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.900 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:35.901 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.901 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.901 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.901 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.901 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.902 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:43:35.902 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.902 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.902 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:35.903 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:35.903 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:35.903 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:35.903 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:35.904 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:35.904 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:35.904 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:43:35.904 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:35.904 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.905 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:35.905 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:43:35.905 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:43:35.905 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:43:35.906 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:43:35.906 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:43:35.906 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:43:35.906 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:43:35.906 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:43:35.907 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:35.907 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:43:35.907 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:43:35.907 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:35.907 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:43:35.908 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:35.908 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:35.908 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:43:35.908 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:43:35.909 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.909 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:43:35.909 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:35.909 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:35.910 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:43:35.910 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:35.910 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:35.910 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:43:35.910 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:35.911 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:35.911 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:43:35.911 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:43:35.911 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:43:35.912 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:43:35.912 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:43:35.912 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:35.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 msgr2=0x7f7124055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 0x7f7124055b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f7134008000 tx=0x7f7134009040).stop 2021-11-15T14:43:35.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 msgr2=0x7f71440a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f71441492d0 tx=0x7f7140015000).stop 2021-11-15T14:43:35.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 shutdown_connections 2021-11-15T14:43:35.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f71240536a0 0x7f7124055b60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7144148420 0x7f7144159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f71440b1e30 0x7f714414a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 --2- 172.21.2.135:0/2264340696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71440a7140 0x7f71440a9800 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 >> 172.21.2.135:0/2264340696 conn(0x7f714405f730 msgr2=0x7f7144144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:35.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 shutdown_connections 2021-11-15T14:43:35.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.672+0000 7f714c7ee700 1 -- 172.21.2.135:0/2264340696 wait complete. 2021-11-15T14:43:35.917 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:35.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 Processor -- start 2021-11-15T14:43:35.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 -- start start 2021-11-15T14:43:35.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f95fc0b1e30 0x7f95fc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0b03d0 con 0x7f95fc0a7140 2021-11-15T14:43:35.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0b0670 con 0x7f95fc148420 2021-11-15T14:43:35.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f9600c8a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0a9140 con 0x7f95fc0b1e30 2021-11-15T14:43:35.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f95f9d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f95fc148420 0x7f95fc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51944/0 (socket says 172.21.2.135:51944) 2021-11-15T14:43:35.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f95f9d9b700 1 -- 172.21.2.135:0/4228381184 learned_addr learned my addr 172.21.2.135:0/4228381184 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:35.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.972+0000 7f95fa59c700 1 --2- 172.21.2.135:0/4228381184 >> v2:172.21.2.135:3300/0 conn(0x7f95fc0b1e30 0x7f95fc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 -- 172.21.2.135:0/4228381184 >> v1:172.21.2.135:6789/0 conn(0x7f95fc148420 legacy=0x7f95fc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 -- 172.21.2.135:0/4228381184 >> v1:172.21.2.119:6789/0 conn(0x7f95fc0a7140 legacy=0x7f95fc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:35.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 -- 172.21.2.135:0/4228381184 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0b0910 con 0x7f95fc0b1e30 2021-11-15T14:43:35.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 --2- 172.21.2.135:0/4228381184 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0b1050 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f95fc0acee0 tx=0x7f95ec006df0).ready entity=mon.1 client_cookie=4a4f3f27883acabd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f959a700 1 -- 172.21.2.135:0/4228381184 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ec00d5c0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f959a700 1 -- 172.21.2.135:0/4228381184 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec000e90 con 0x7f95fc0b1e30 2021-11-15T14:43:35.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f959a700 1 -- 172.21.2.135:0/4228381184 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ec00d910 con 0x7f95fc0b1e30 2021-11-15T14:43:35.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- 172.21.2.135:0/4228381184 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 msgr2=0x7f95fc0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 --2- 172.21.2.135:0/4228381184 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0b1050 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f95fc0acee0 tx=0x7f95ec006df0).stop 2021-11-15T14:43:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- 172.21.2.135:0/4228381184 shutdown_connections 2021-11-15T14:43:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 --2- 172.21.2.135:0/4228381184 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0b1050 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- 172.21.2.135:0/4228381184 >> 172.21.2.135:0/4228381184 conn(0x7f95fc05f730 msgr2=0x7f95fc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- 172.21.2.135:0/4228381184 shutdown_connections 2021-11-15T14:43:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- 172.21.2.135:0/4228381184 wait complete. 2021-11-15T14:43:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 Processor -- start 2021-11-15T14:43:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- start start 2021-11-15T14:43:35.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 0x7f95fc0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95fc148420 0x7f95fc15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0ab2b0 con 0x7f95fc148420 2021-11-15T14:43:35.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0ab550 con 0x7f95fc0b1e30 2021-11-15T14:43:35.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f9600c8a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0ab7f0 con 0x7f95fc0a7140 2021-11-15T14:43:35.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 0x7f95fc0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 0x7f95fc0b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:45904/0 (socket says 172.21.2.135:45904) 2021-11-15T14:43:35.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fa59c700 1 -- 172.21.2.135:0/3362221182 learned_addr learned my addr 172.21.2.135:0/3362221182 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:35.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36130/0 (socket says 172.21.2.135:36130) 2021-11-15T14:43:35.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95fad9d700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95fc148420 0x7f95fc15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 -- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 msgr2=0x7f95fc0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 0x7f95fc0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 -- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95fc148420 msgr2=0x7f95fc15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:35.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95fc148420 0x7f95fc15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:35.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 -- 172.21.2.135:0/3362221182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec00b180 con 0x7f95fc0b1e30 2021-11-15T14:43:35.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.976+0000 7f95f9d9b700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f95fc0b31f0 tx=0x7f95e4007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e4007e50 con 0x7f95fc0b1e30 2021-11-15T14:43:35.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0a99b0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc0abeb0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40070d0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e4007430 con 0x7f95fc0b1e30 2021-11-15T14:43:35.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc0b0bb0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f95e4010070 con 0x7f95fc0b1e30 2021-11-15T14:43:35.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 0x7f95e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:35.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f95e406b0a0 con 0x7f95fc0b1e30 2021-11-15T14:43:35.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95fa59c700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 0x7f95e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:35.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95fa59c700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 0x7f95e0055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f95ec01a000 tx=0x7f95ec014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:35.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:35.980+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95e4041fd0 con 0x7f95fc0b1e30 2021-11-15T14:43:36.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.088+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95fc0573d0 con 0x7f95fc0b1e30 2021-11-15T14:43:36.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.088+0000 7f95f37fe700 1 -- 172.21.2.135:0/3362221182 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f95e4018030 con 0x7f95fc0b1e30 2021-11-15T14:43:36.094 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:36.094 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:30.114949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8386":{"gid":8386,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/3501994559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":3501994559},{"type":"v1","addr":"172.21.2.135:6835","nonce":3501994559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:36.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 msgr2=0x7f95e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 0x7f95e0055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f95ec01a000 tx=0x7f95ec014000).stop 2021-11-15T14:43:36.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 msgr2=0x7f95fc0a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f95fc0b31f0 tx=0x7f95e4007be0).stop 2021-11-15T14:43:36.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 shutdown_connections 2021-11-15T14:43:36.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95e0053610 0x7f95e0055ad0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f95fc148420 0x7f95fc15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95fc0b1e30 0x7f95fc0a94c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 --2- 172.21.2.135:0/3362221182 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95fc0a7140 0x7f95fc0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 >> 172.21.2.135:0/3362221182 conn(0x7f95fc05f730 msgr2=0x7f95fc1449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:36.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 shutdown_connections 2021-11-15T14:43:36.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.092+0000 7f9600c8a700 1 -- 172.21.2.135:0/3362221182 wait complete. 2021-11-15T14:43:36.098 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 76 2021-11-15T14:43:36.101 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:43:36.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 Processor -- start 2021-11-15T14:43:36.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 -- start start 2021-11-15T14:43:36.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7faaf80b2600 0x7faaf814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80a8b40 0x7faaf814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf80a7140 con 0x7faaf80b0090 2021-11-15T14:43:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf80a7370 con 0x7faaf80b2600 2021-11-15T14:43:36.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.148+0000 7faafeae3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80a7610 con 0x7faaf80a8b40 2021-11-15T14:43:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafe2e2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80a8b40 0x7faaf814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafd2e0700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7faaf80b0090 0x7faaf80a8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:33144/0 (socket says 172.21.2.135:33144) 2021-11-15T14:43:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7faaf80b2600 0x7faaf814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:36.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafd2e0700 1 -- 172.21.2.135:0/2261385736 learned_addr learned my addr 172.21.2.135:0/2261385736 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 -- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80a8b40 msgr2=0x7faaf814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 --2- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80a8b40 0x7faaf814b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 -- 172.21.2.135:0/2261385736 >> v1:172.21.2.119:6789/0 conn(0x7faaf80b0090 legacy=0x7faaf80a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 -- 172.21.2.135:0/2261385736 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80a78b0 con 0x7faaf80b2600 2021-11-15T14:43:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafdae1700 1 --2- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80b2600 0x7faaf814aec0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7faaf4002f70 tx=0x7faaf4006df0).ready entity=mon.0 client_cookie=459b3a048d9060cc server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafcadf700 1 -- 172.21.2.135:0/2261385736 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf400d570 con 0x7faaf80b2600 2021-11-15T14:43:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafcadf700 1 -- 172.21.2.135:0/2261385736 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4000e90 con 0x7faaf80b2600 2021-11-15T14:43:36.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafcadf700 1 -- 172.21.2.135:0/2261385736 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf400d8c0 con 0x7faaf80b2600 2021-11-15T14:43:36.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80b2600 msgr2=0x7faaf814aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 --2- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80b2600 0x7faaf814aec0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7faaf4002f70 tx=0x7faaf4006df0).stop 2021-11-15T14:43:36.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- 172.21.2.135:0/2261385736 shutdown_connections 2021-11-15T14:43:36.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 --2- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80a8b40 0x7faaf814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 --2- 172.21.2.135:0/2261385736 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80b2600 0x7faaf814aec0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- 172.21.2.135:0/2261385736 >> 172.21.2.135:0/2261385736 conn(0x7faaf8060200 msgr2=0x7faaf80b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:36.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- 172.21.2.135:0/2261385736 shutdown_connections 2021-11-15T14:43:36.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- 172.21.2.135:0/2261385736 wait complete. 2021-11-15T14:43:36.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 Processor -- start 2021-11-15T14:43:36.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.152+0000 7faafeae3700 1 -- start start 2021-11-15T14:43:36.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80a8b40 0x7faaf8156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80b0090 0x7faaf80641c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8157560 con 0x7faaf80a8b40 2021-11-15T14:43:36.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80b3480 con 0x7faaf80b2600 2021-11-15T14:43:36.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80b36e0 con 0x7faaf80b0090 2021-11-15T14:43:36.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:36.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36142/0 (socket says 172.21.2.135:36142) 2021-11-15T14:43:36.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 -- 172.21.2.135:0/2461707123 learned_addr learned my addr 172.21.2.135:0/2461707123 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:36.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 -- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80b0090 msgr2=0x7faaf80641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80b0090 0x7faaf80641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:36.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 -- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80a8b40 msgr2=0x7faaf8156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80a8b40 0x7faaf8156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:36.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 -- 172.21.2.135:0/2461707123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf400b180 con 0x7faaf80b2600 2021-11-15T14:43:36.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafe2e2700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7faaf8063dd0 tx=0x7faaf00091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:36.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf000c850 con 0x7faaf80b2600 2021-11-15T14:43:36.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000c9b0 con 0x7faaf80b2600 2021-11-15T14:43:36.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf000cd10 con 0x7faaf80b2600 2021-11-15T14:43:36.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf80b3980 con 0x7faaf80b2600 2021-11-15T14:43:36.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf8064840 con 0x7faaf80b2600 2021-11-15T14:43:36.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf80b3b10 con 0x7faaf80b2600 2021-11-15T14:43:36.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faaf0022070 con 0x7faaf80b2600 2021-11-15T14:43:36.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 0x7faad8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:36.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faaf006c270 con 0x7faaf80b2600 2021-11-15T14:43:36.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafdae1700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 0x7faad8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:36.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.156+0000 7faafdae1700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 0x7faad8055b60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7faaf4002f70 tx=0x7faaf4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:36.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.160+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faaf00431e0 con 0x7faaf80b2600 2021-11-15T14:43:36.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.268+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faaf80573d0 con 0x7faaf80b2600 2021-11-15T14:43:36.982 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:43:36.976+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:43:36.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faaeaffd700 1 -- 172.21.2.135:0/2461707123 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7faaf0016020 con 0x7faaf80b2600 2021-11-15T14:43:36.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 msgr2=0x7faad8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 0x7faad8055b60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7faaf4002f70 tx=0x7faaf4014000).stop 2021-11-15T14:43:36.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 msgr2=0x7faaf80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:36.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7faaf8063dd0 tx=0x7faaf00091d0).stop 2021-11-15T14:43:36.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 shutdown_connections 2021-11-15T14:43:36.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7faad80536a0 0x7faad8055b60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7faaf80b2600 0x7faaf80b4cc0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:36.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7faaf80b0090 0x7faaf80641c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:36.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 --2- 172.21.2.135:0/2461707123 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7faaf80a8b40 0x7faaf8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:36.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 >> 172.21.2.135:0/2461707123 conn(0x7faaf8060200 msgr2=0x7faaf80adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:36.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 shutdown_connections 2021-11-15T14:43:36.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:36.992+0000 7faafeae3700 1 -- 172.21.2.135:0/2461707123 wait complete. 2021-11-15T14:43:37.000 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:43:37.003 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:37.008 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:43:37.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 Processor -- start 2021-11-15T14:43:37.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- start start 2021-11-15T14:43:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec148420 0x7f8fec0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8fec0a7140 0x7f8fec1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0b03d0 con 0x7f8fec0b1e30 2021-11-15T14:43:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0a9140 con 0x7f8fec0a7140 2021-11-15T14:43:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0b0670 con 0x7f8fec148420 2021-11-15T14:43:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1539700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8fec0b1e30 0x7f8fec0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51982/0 (socket says 172.21.2.135:51982) 2021-11-15T14:43:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1539700 1 -- 172.21.2.135:0/3513120696 learned_addr learned my addr 172.21.2.135:0/3513120696 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3513120696 >> v2:172.21.2.135:3300/0 conn(0x7f8fec0a7140 0x7f8fec1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3513120696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec148420 msgr2=0x7f8fec0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3513120696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec148420 0x7f8fec0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3513120696 >> v1:172.21.2.135:6789/0 conn(0x7f8fec0b1e30 legacy=0x7f8fec0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3513120696 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0b0910 con 0x7f8fec0a7140 2021-11-15T14:43:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3513120696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec0a7140 0x7f8fec1447a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f8fe40032f0 tx=0x7f8fe40091d0).ready entity=mon.1 client_cookie=214eff550d7ff9b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8fdffff700 1 -- 172.21.2.135:0/3513120696 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe4009ea0 con 0x7f8fec0a7140 2021-11-15T14:43:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8fdffff700 1 -- 172.21.2.135:0/3513120696 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400b8a0 con 0x7f8fec0a7140 2021-11-15T14:43:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8fdffff700 1 -- 172.21.2.135:0/3513120696 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe400ba10 con 0x7f8fec0a7140 2021-11-15T14:43:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- 172.21.2.135:0/3513120696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec0a7140 msgr2=0x7f8fec1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3513120696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec0a7140 0x7f8fec1447a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f8fe40032f0 tx=0x7f8fe40091d0).stop 2021-11-15T14:43:37.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- 172.21.2.135:0/3513120696 shutdown_connections 2021-11-15T14:43:37.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3513120696 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec0a7140 0x7f8fec1447a0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:37.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3513120696 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec148420 0x7f8fec0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- 172.21.2.135:0/3513120696 >> 172.21.2.135:0/3513120696 conn(0x7f8fec05f730 msgr2=0x7f8fec05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:37.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- 172.21.2.135:0/3513120696 shutdown_connections 2021-11-15T14:43:37.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- 172.21.2.135:0/3513120696 wait complete. 2021-11-15T14:43:37.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 Processor -- start 2021-11-15T14:43:37.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- start start 2021-11-15T14:43:37.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fec0a7140 0x7f8fec0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec0b1e30 0x7f8fec0a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0ab600 con 0x7f8fec0a7140 2021-11-15T14:43:37.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec14a620 con 0x7f8fec148420 2021-11-15T14:43:37.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.052+0000 7f8ff379d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec14a0e0 con 0x7f8fec0b1e30 2021-11-15T14:43:37.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36170/0 (socket says 172.21.2.135:36170) 2021-11-15T14:43:37.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3935574896 learned_addr learned my addr 172.21.2.135:0/3935574896 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:37.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec0b1e30 msgr2=0x7f8fec0a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec0b1e30 0x7f8fec0a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fec0a7140 msgr2=0x7f8fec0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fec0a7140 0x7f8fec0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 -- 172.21.2.135:0/3935574896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4009470 con 0x7f8fec148420 2021-11-15T14:43:37.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1d3a700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f8fe40032f0 tx=0x7f8fe4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe4021440 con 0x7f8fec148420 2021-11-15T14:43:37.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe40215a0 con 0x7f8fec148420 2021-11-15T14:43:37.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe4021900 con 0x7f8fec148420 2021-11-15T14:43:37.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec14a380 con 0x7f8fec148420 2021-11-15T14:43:37.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec0abf50 con 0x7f8fec148420 2021-11-15T14:43:37.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec0ab770 con 0x7f8fec148420 2021-11-15T14:43:37.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fe4027020 con 0x7f8fec148420 2021-11-15T14:43:37.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 0x7f8fcc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f8fe406d080 con 0x7f8fec148420 2021-11-15T14:43:37.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1539700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 0x7f8fcc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.056+0000 7f8ff1539700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 0x7f8fcc055ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f8fec061420 tx=0x7f8fe0007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.071 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.060+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8fe4044030 con 0x7f8fec148420 2021-11-15T14:43:37.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fec0573d0 con 0x7f8fec148420 2021-11-15T14:43:37.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8fde7fc700 1 -- 172.21.2.135:0/3935574896 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f8fe4015090 con 0x7f8fec148420 2021-11-15T14:43:37.173 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:37.174 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":77,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:29.110271+0000","modified":"2021-11-15T14:43:36.980826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":156,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-15T14:43:37.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 msgr2=0x7f8fcc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 0x7f8fcc055ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f8fec061420 tx=0x7f8fe0007800).stop 2021-11-15T14:43:37.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 msgr2=0x7f8fec0aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.168+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f8fe40032f0 tx=0x7f8fe4016000).stop 2021-11-15T14:43:37.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 shutdown_connections 2021-11-15T14:43:37.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8fcc053610 0x7f8fcc055ad0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:37.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8fec148420 0x7f8fec0aba60 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:37.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8fec0b1e30 0x7f8fec0a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 --2- 172.21.2.135:0/3935574896 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8fec0a7140 0x7f8fec0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 >> 172.21.2.135:0/3935574896 conn(0x7f8fec05f730 msgr2=0x7f8fec0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:37.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 shutdown_connections 2021-11-15T14:43:37.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.172+0000 7f8ff379d700 1 -- 172.21.2.135:0/3935574896 wait complete. 2021-11-15T14:43:37.178 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 77 2021-11-15T14:43:37.180 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:43:37.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.228+0000 7fa194de0700 1 Processor -- start 2021-11-15T14:43:37.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.228+0000 7fa194de0700 1 -- start start 2021-11-15T14:43:37.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 0x7fa1900b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900a7850 con 0x7fa1900b2320 2021-11-15T14:43:37.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900b0470 con 0x7fa1900b0030 2021-11-15T14:43:37.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900b06d0 con 0x7fa1900b1f40 2021-11-15T14:43:37.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18dd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fa1900b0030 0x7fa1900a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:51996/0 (socket says 172.21.2.135:51996) 2021-11-15T14:43:37.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18dd9b700 1 -- 172.21.2.135:0/3485576086 learned_addr learned my addr 172.21.2.135:0/3485576086 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:37.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469873872 0 0) 0x7fa1900b0470 con 0x7fa1900b0030 2021-11-15T14:43:37.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa170003260 con 0x7fa1900b0030 2021-11-15T14:43:37.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301171888 0 0) 0x7fa170003260 con 0x7fa1900b0030 2021-11-15T14:43:37.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 msgr2=0x7fa1900b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:37.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 0x7fa1900b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 >> v1:172.21.2.119:6789/0 conn(0x7fa1900b2320 legacy=0x7fa1901412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:37.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900b0970 con 0x7fa1900b0030 2021-11-15T14:43:37.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fa178001660 con 0x7fa1900b0030 2021-11-15T14:43:37.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 >> v1:172.21.2.135:6789/0 conn(0x7fa1900b0030 legacy=0x7fa1900a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1700037d0 0x7fa170003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 0x7fa170004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa170004af0 0x7fa170004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900b06d0 con 0x7fa170004af0 2021-11-15T14:43:37.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17000b960 con 0x7fa1700037d0 2021-11-15T14:43:37.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17000bb20 con 0x7fa1900b1f40 2021-11-15T14:43:37.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1700037d0 0x7fa170003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 -- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 msgr2=0x7fa170004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:37.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1900b1f40 0x7fa170004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 -- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa170004af0 msgr2=0x7fa170004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:37.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa170004af0 0x7fa170004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 -- 172.21.2.135:0/3485576086 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900b0970 con 0x7fa1700037d0 2021-11-15T14:43:37.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18e59c700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1700037d0 0x7fa170003bd0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fa180002f70 tx=0x7fa180006ca0).ready entity=mon.1 client_cookie=16f01d7a007e4c72 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa180012410 con 0x7fa1700037d0 2021-11-15T14:43:37.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180012570 con 0x7fa1700037d0 2021-11-15T14:43:37.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18d59a700 1 -- 172.21.2.135:0/3485576086 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1800128d0 con 0x7fa1700037d0 2021-11-15T14:43:37.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- 172.21.2.135:0/3485576086 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1700037d0 msgr2=0x7fa170003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 --2- 172.21.2.135:0/3485576086 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa1700037d0 0x7fa170003bd0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fa180002f70 tx=0x7fa180006ca0).stop 2021-11-15T14:43:37.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 -- 172.21.2.135:0/3485576086 reap_dead start 2021-11-15T14:43:37.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- 172.21.2.135:0/3485576086 shutdown_connections 2021-11-15T14:43:37.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- 172.21.2.135:0/3485576086 >> 172.21.2.135:0/3485576086 conn(0x7fa19005f730 msgr2=0x7fa19005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:37.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- 172.21.2.135:0/3485576086 shutdown_connections 2021-11-15T14:43:37.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- 172.21.2.135:0/3485576086 wait complete. 2021-11-15T14:43:37.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 Processor -- start 2021-11-15T14:43:37.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- start start 2021-11-15T14:43:37.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1700037d0 0x7fa1900b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa19014b710 0x7fa19013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190149df0 con 0x7fa19014b710 2021-11-15T14:43:37.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19014a090 con 0x7fa19014ad90 2021-11-15T14:43:37.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa194de0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19014a330 con 0x7fa1700037d0 2021-11-15T14:43:37.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36188/0 (socket says 172.21.2.135:36188) 2021-11-15T14:43:37.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 -- 172.21.2.135:0/2642514879 learned_addr learned my addr 172.21.2.135:0/2642514879 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:37.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 -- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1700037d0 msgr2=0x7fa1900b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1700037d0 0x7fa1900b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 -- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa19014b710 msgr2=0x7fa19013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:37.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa19014b710 0x7fa19013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:37.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 -- 172.21.2.135:0/2642514879 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900aba90 con 0x7fa19014ad90 2021-11-15T14:43:37.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.232+0000 7fa18ed9d700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fa178001370 tx=0x7fa188007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa188004850 con 0x7fa19014ad90 2021-11-15T14:43:37.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880049b0 con 0x7fa19014ad90 2021-11-15T14:43:37.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900b5fa0 con 0x7fa19014ad90 2021-11-15T14:43:37.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa188004d50 con 0x7fa19014ad90 2021-11-15T14:43:37.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19014b3b0 con 0x7fa19014ad90 2021-11-15T14:43:37.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19014a4f0 con 0x7fa19014ad90 2021-11-15T14:43:37.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa18801b070 con 0x7fa19014ad90 2021-11-15T14:43:37.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 0x7fa1740559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:37.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa18806ae60 con 0x7fa19014ad90 2021-11-15T14:43:37.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa18e59c700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 0x7fa1740559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:37.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa18e59c700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 0x7fa1740559b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fa180002f70 tx=0x7fa180015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:37.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.236+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa188041e10 con 0x7fa19014ad90 2021-11-15T14:43:37.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:37.348+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa1900b0c10 con 0x7fa19014ad90 2021-11-15T14:43:38.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa1877fe700 1 -- 172.21.2.135:0/2642514879 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa188045430 con 0x7fa19014ad90 2021-11-15T14:43:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 msgr2=0x7fa1740559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 0x7fa1740559b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fa180002f70 tx=0x7fa180015000).stop 2021-11-15T14:43:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 msgr2=0x7fa19013c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fa178001370 tx=0x7fa188007e50).stop 2021-11-15T14:43:38.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 shutdown_connections 2021-11-15T14:43:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fa1740534f0 0x7fa1740559b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fa19014ad90 0x7fa19013c830 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fa19014b710 0x7fa19013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:38.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 --2- 172.21.2.135:0/2642514879 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fa1700037d0 0x7fa1900b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 >> 172.21.2.135:0/2642514879 conn(0x7fa19005f730 msgr2=0x7fa190140760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 shutdown_connections 2021-11-15T14:43:38.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.000+0000 7fa194de0700 1 -- 172.21.2.135:0/2642514879 wait complete. 2021-11-15T14:43:38.010 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:43:38.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 Processor -- start 2021-11-15T14:43:38.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 -- start start 2021-11-15T14:43:38.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 0x7f43a80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80b03d0 con 0x7f43a80b1e30 2021-11-15T14:43:38.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80b0670 con 0x7f43a80a7140 2021-11-15T14:43:38.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43ad702700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80a9140 con 0x7f43a8148420 2021-11-15T14:43:38.072 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43a77fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f43a80a7140 0x7f43a81447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52018/0 (socket says 172.21.2.135:52018) 2021-11-15T14:43:38.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43a77fe700 1 -- 172.21.2.135:0/116692391 learned_addr learned my addr 172.21.2.135:0/116692391 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:38.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731257319 0 0) 0x7f43a80b0670 con 0x7f43a80a7140 2021-11-15T14:43:38.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c003260 con 0x7f43a80a7140 2021-11-15T14:43:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.060+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169635076 0 0) 0x7f438c003260 con 0x7f43a80a7140 2021-11-15T14:43:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 msgr2=0x7f43a80b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 0x7f43a80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 >> v1:172.21.2.119:6789/0 conn(0x7f43a80b1e30 legacy=0x7f43a80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:38.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80b0910 con 0x7f43a80a7140 2021-11-15T14:43:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f43a00019e0 con 0x7f43a80a7140 2021-11-15T14:43:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 >> v1:172.21.2.135:6789/0 conn(0x7f43a80a7140 legacy=0x7f43a81447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c003750 0x7f438c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f438c004500 0x7f438c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 0x7f438c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00b8e0 con 0x7f438c003750 2021-11-15T14:43:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00ba20 con 0x7f438c004500 2021-11-15T14:43:38.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00bbe0 con 0x7f43a8148420 2021-11-15T14:43:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f438c004500 0x7f438c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 0x7f438c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a6ffd700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c003750 0x7f438c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 -- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 msgr2=0x7f438c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:38.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a8148420 0x7f438c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:38.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 -- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c003750 msgr2=0x7f438c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:38.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c003750 0x7f438c003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:38.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 -- 172.21.2.135:0/116692391 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c003260 con 0x7f438c004500 2021-11-15T14:43:38.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a6ffd700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c003750 0x7f438c003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:38.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a67fc700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f438c004500 0x7f438c004980 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f438c004470 tx=0x7f4398006ca0).ready entity=mon.1 client_cookie=e1a4928e7094c0a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:38.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4398013410 con 0x7f438c004500 2021-11-15T14:43:38.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398013570 con 0x7f438c004500 2021-11-15T14:43:38.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a5ffb700 1 -- 172.21.2.135:0/116692391 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43980138d0 con 0x7f438c004500 2021-11-15T14:43:38.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/116692391 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f438c004500 msgr2=0x7f438c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 --2- 172.21.2.135:0/116692391 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f438c004500 0x7f438c004980 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f438c004470 tx=0x7f4398006ca0).stop 2021-11-15T14:43:38.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 -- 172.21.2.135:0/116692391 reap_dead start 2021-11-15T14:43:38.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/116692391 shutdown_connections 2021-11-15T14:43:38.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/116692391 >> 172.21.2.135:0/116692391 conn(0x7f43a805f730 msgr2=0x7f43a805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:38.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/116692391 shutdown_connections 2021-11-15T14:43:38.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/116692391 wait complete. 2021-11-15T14:43:38.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 Processor -- start 2021-11-15T14:43:38.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- start start 2021-11-15T14:43:38.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c004500 0x7f43a80ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a80af040 0x7f43a8062840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8064ed0 con 0x7f438c004500 2021-11-15T14:43:38.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80ac9c0 con 0x7f43a8062d30 2021-11-15T14:43:38.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80aaec0 con 0x7f43a80af040 2021-11-15T14:43:38.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:38.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36212/0 (socket says 172.21.2.135:36212) 2021-11-15T14:43:38.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 -- 172.21.2.135:0/1930192444 learned_addr learned my addr 172.21.2.135:0/1930192444 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:38.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 -- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a80af040 msgr2=0x7f43a8062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a80af040 0x7f43a8062840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:38.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 -- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c004500 msgr2=0x7f43a80ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:38.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c004500 0x7f43a80ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:38.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 -- 172.21.2.135:0/1930192444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80ab160 con 0x7f43a8062d30 2021-11-15T14:43:38.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43a77fe700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f43a0001210 tx=0x7f43a80b0800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:38.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a0010710 con 0x7f43a8062d30 2021-11-15T14:43:38.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0010870 con 0x7f43a8062d30 2021-11-15T14:43:38.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a80ac280 con 0x7f43a8062d30 2021-11-15T14:43:38.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a0010bd0 con 0x7f43a8062d30 2021-11-15T14:43:38.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a8159fb0 con 0x7f43a8062d30 2021-11-15T14:43:38.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.064+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a80aad20 con 0x7f43a8062d30 2021-11-15T14:43:38.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43a001a020 con 0x7f43a8062d30 2021-11-15T14:43:38.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f4397fff700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 0x7f4384055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:38.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f43a006b860 con 0x7f43a8062d30 2021-11-15T14:43:38.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f43a6ffd700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 0x7f4384055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:38.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f43a6ffd700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 0x7f4384055b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f439c008000 tx=0x7f439c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:38.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.068+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43a80aad20 con 0x7f43a8062d30 2021-11-15T14:43:38.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:38.152+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43a80b2880 con 0x7f43a8062d30 2021-11-15T14:43:39.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.000+0000 7f4397fff700 1 -- 172.21.2.135:0/1930192444 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) v1 ==== 185+0+0 (secure 0 0 0) 0x7f43a80b2880 con 0x7f43a8062d30 2021-11-15T14:43:39.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 msgr2=0x7f4384055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 0x7f4384055b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f439c008000 tx=0x7f439c009040).stop 2021-11-15T14:43:39.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 msgr2=0x7f43a815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f43a0001210 tx=0x7f43a80b0800).stop 2021-11-15T14:43:39.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 shutdown_connections 2021-11-15T14:43:39.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4384053640 0x7f4384055b00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:39.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f43a8062d30 0x7f43a815a480 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:39.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f43a80af040 0x7f43a8062840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 --2- 172.21.2.135:0/1930192444 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f438c004500 0x7f43a80ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 >> 172.21.2.135:0/1930192444 conn(0x7f43a805f730 msgr2=0x7f43a81449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:39.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 shutdown_connections 2021-11-15T14:43:39.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.004+0000 7f43ad702700 1 -- 172.21.2.135:0/1930192444 wait complete. 2021-11-15T14:43:39.014 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:43:39.016 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:43:39.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 Processor -- start 2021-11-15T14:43:39.070 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- start start 2021-11-15T14:43:39.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbd8c148420 0x7fbd8c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 0x7fbd8c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c0b03d0 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c0a9140 con 0x7fbd8c148420 2021-11-15T14:43:39.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b0670 con 0x7fbd8c0a7140 2021-11-15T14:43:39.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fbd8c0b1e30 0x7fbd8c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52036/0 (socket says 172.21.2.135:52036) 2021-11-15T14:43:39.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/1699462988 learned_addr learned my addr 172.21.2.135:0/1699462988 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:39.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161777287 0 0) 0x7fbd8c0b03d0 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c003260 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734878093 0 0) 0x7fbd6c003260 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 msgr2=0x7fbd8c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 0x7fbd8c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 >> v2:172.21.2.119:3300/0 conn(0x7fbd8c148420 msgr2=0x7fbd8c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 --2- 172.21.2.135:0/1699462988 >> v2:172.21.2.119:3300/0 conn(0x7fbd8c148420 0x7fbd8c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0b0910 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fbd7c001660 con 0x7fbd8c0b1e30 2021-11-15T14:43:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 >> v1:172.21.2.135:6789/0 conn(0x7fbd8c0b1e30 legacy=0x7fbd8c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd6c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 0x7fbd6c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd6c004bf0 0x7fbd6c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b0670 con 0x7fbd6c004bf0 2021-11-15T14:43:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c005280 con 0x7fbd6c0037d0 2021-11-15T14:43:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c00bc40 con 0x7fbd8c0a7140 2021-11-15T14:43:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd6c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 msgr2=0x7fbd6c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c0a7140 0x7fbd6c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd6c004bf0 msgr2=0x7fbd6c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:39.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd6c004bf0 0x7fbd6c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/1699462988 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c003260 con 0x7fbd6c0037d0 2021-11-15T14:43:39.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd6c003bf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fbd8c1477b0 tx=0x7fbd8c0b0aa0).ready entity=mon.1 client_cookie=bc08b1dd4d8a9098 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:39.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7c0070d0 con 0x7fbd6c0037d0 2021-11-15T14:43:39.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c007230 con 0x7fbd6c0037d0 2021-11-15T14:43:39.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd89ffb700 1 -- 172.21.2.135:0/1699462988 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7c00c8f0 con 0x7fbd6c0037d0 2021-11-15T14:43:39.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- 172.21.2.135:0/1699462988 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 msgr2=0x7fbd6c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- 172.21.2.135:0/1699462988 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd6c003bf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fbd8c1477b0 tx=0x7fbd8c0b0aa0).stop 2021-11-15T14:43:39.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8b7fe700 1 -- 172.21.2.135:0/1699462988 reap_dead start 2021-11-15T14:43:39.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- 172.21.2.135:0/1699462988 shutdown_connections 2021-11-15T14:43:39.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- 172.21.2.135:0/1699462988 >> 172.21.2.135:0/1699462988 conn(0x7fbd8c05f730 msgr2=0x7fbd8c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:39.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- 172.21.2.135:0/1699462988 shutdown_connections 2021-11-15T14:43:39.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- 172.21.2.135:0/1699462988 wait complete. 2021-11-15T14:43:39.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 Processor -- start 2021-11-15T14:43:39.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- start start 2021-11-15T14:43:39.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c062840 0x7fbd8c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd8c062d50 0x7fbd8c0aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15a7c0 con 0x7fbd8c062d50 2021-11-15T14:43:39.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15aa60 con 0x7fbd6c0037d0 2021-11-15T14:43:39.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd9153a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c064010 con 0x7fbd8c062840 2021-11-15T14:43:39.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:39.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36228/0 (socket says 172.21.2.135:36228) 2021-11-15T14:43:39.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/2303481058 learned_addr learned my addr 172.21.2.135:0/2303481058 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:39.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c062840 msgr2=0x7fbd8c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c062840 0x7fbd8c159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd8c062d50 msgr2=0x7fbd8c0aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:39.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd8c062d50 0x7fbd8c0aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:39.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 -- 172.21.2.135:0/2303481058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0642b0 con 0x7fbd6c0037d0 2021-11-15T14:43:39.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.068+0000 7fbd8affd700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fbd8c1477b0 tx=0x7fbd7c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:39.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7c001b60 con 0x7fbd6c0037d0 2021-11-15T14:43:39.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c004920 con 0x7fbd6c0037d0 2021-11-15T14:43:39.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c15a470 con 0x7fbd6c0037d0 2021-11-15T14:43:39.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd7c004c80 con 0x7fbd6c0037d0 2021-11-15T14:43:39.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c0aa910 con 0x7fbd6c0037d0 2021-11-15T14:43:39.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd7c025020 con 0x7fbd6c0037d0 2021-11-15T14:43:39.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c0aa910 con 0x7fbd6c0037d0 2021-11-15T14:43:39.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 0x7fbd70055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:39.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fbd7c06ccf0 con 0x7fbd6c0037d0 2021-11-15T14:43:39.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd8a7fc700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 0x7fbd70055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:39.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd8a7fc700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 0x7fbd70055b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fbd74002f70 tx=0x7fbd74006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:39.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.072+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd7c043d50 con 0x7fbd6c0037d0 2021-11-15T14:43:39.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:39.156+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd8c0aa910 con 0x7fbd6c0037d0 2021-11-15T14:43:40.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.008+0000 7fbd83fff700 1 -- 172.21.2.135:0/2303481058 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbd7c047370 con 0x7fbd6c0037d0 2021-11-15T14:43:40.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 msgr2=0x7fbd70055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 0x7fbd70055b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fbd74002f70 tx=0x7fbd74006a80).stop 2021-11-15T14:43:40.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 msgr2=0x7fbd8c064750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fbd8c1477b0 tx=0x7fbd7c013000).stop 2021-11-15T14:43:40.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 shutdown_connections 2021-11-15T14:43:40.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbd700536d0 0x7fbd70055b90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbd8c062d50 0x7fbd8c0aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbd8c062840 0x7fbd8c159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 --2- 172.21.2.135:0/2303481058 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbd6c0037d0 0x7fbd8c064750 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 >> 172.21.2.135:0/2303481058 conn(0x7fbd8c05f730 msgr2=0x7fbd8c0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:40.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 shutdown_connections 2021-11-15T14:43:40.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.012+0000 7fbd9153a700 1 -- 172.21.2.135:0/2303481058 wait complete. 2021-11-15T14:43:40.017 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:43:40.021 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-15T14:43:40.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 Processor -- start 2021-11-15T14:43:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- start start 2021-11-15T14:43:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f12ec060040 0x7f12ec064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12ec0b3950 0x7f12ec065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0b2430 con 0x7f12ec0b2ca0 2021-11-15T14:43:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec065770 con 0x7f12ec060040 2021-11-15T14:43:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec0b26d0 con 0x7f12ec0b3950 2021-11-15T14:43:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12ec0b3950 0x7f12ec065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f12ec0b3950 0x7f12ec065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36236/0 (socket says 172.21.2.135:36236) 2021-11-15T14:43:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 -- 172.21.2.135:0/2132114799 learned_addr learned my addr 172.21.2.135:0/2132114799 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 -- 172.21.2.135:0/2132114799 >> v2:172.21.2.119:3300/0 conn(0x7f12ec060040 msgr2=0x7f12ec064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 --2- 172.21.2.135:0/2132114799 >> v2:172.21.2.119:3300/0 conn(0x7f12ec060040 0x7f12ec064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 -- 172.21.2.135:0/2132114799 >> v1:172.21.2.119:6789/0 conn(0x7f12ec0b2ca0 legacy=0x7f12ec0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 -- 172.21.2.135:0/2132114799 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0b2970 con 0x7f12ec0b3950 2021-11-15T14:43:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eb7fe700 1 --2- 172.21.2.135:0/2132114799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec0b3950 0x7f12ec065280 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f12ec13b870 tx=0x7f12dc006eb0).ready entity=mon.1 client_cookie=535ace490fd05833 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eaffd700 1 -- 172.21.2.135:0/2132114799 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc00d5c0 con 0x7f12ec0b3950 2021-11-15T14:43:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eaffd700 1 -- 172.21.2.135:0/2132114799 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc000e90 con 0x7f12ec0b3950 2021-11-15T14:43:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12eaffd700 1 -- 172.21.2.135:0/2132114799 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc00d910 con 0x7f12ec0b3950 2021-11-15T14:43:40.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- 172.21.2.135:0/2132114799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec0b3950 msgr2=0x7f12ec065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 --2- 172.21.2.135:0/2132114799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec0b3950 0x7f12ec065280 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f12ec13b870 tx=0x7f12dc006eb0).stop 2021-11-15T14:43:40.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- 172.21.2.135:0/2132114799 shutdown_connections 2021-11-15T14:43:40.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 --2- 172.21.2.135:0/2132114799 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec0b3950 0x7f12ec065280 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 --2- 172.21.2.135:0/2132114799 >> v2:172.21.2.119:3300/0 conn(0x7f12ec060040 0x7f12ec064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- 172.21.2.135:0/2132114799 >> 172.21.2.135:0/2132114799 conn(0x7f12ec05cfe0 msgr2=0x7f12ec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:40.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- 172.21.2.135:0/2132114799 shutdown_connections 2021-11-15T14:43:40.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.072+0000 7f12f25ed700 1 -- 172.21.2.135:0/2132114799 wait complete. 2021-11-15T14:43:40.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 Processor -- start 2021-11-15T14:43:40.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- start start 2021-11-15T14:43:40.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12ec0b2ca0 0x7f12ec0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12ec0b3950 0x7f12ec151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b0060 con 0x7f12ec0b2ca0 2021-11-15T14:43:40.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0ae840 con 0x7f12ec060040 2021-11-15T14:43:40.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b66a0 con 0x7f12ec0b3950 2021-11-15T14:43:40.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36244/0 (socket says 172.21.2.135:36244) 2021-11-15T14:43:40.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 -- 172.21.2.135:0/261051505 learned_addr learned my addr 172.21.2.135:0/261051505 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:40.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f0b8a700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12ec0b3950 0x7f12ec151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 -- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12ec0b3950 msgr2=0x7f12ec151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12ec0b3950 0x7f12ec151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 -- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12ec0b2ca0 msgr2=0x7f12ec0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12ec0b2ca0 0x7f12ec0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 -- 172.21.2.135:0/261051505 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc00b1e0 con 0x7f12ec060040 2021-11-15T14:43:40.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12ebfff700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f12d4002f70 tx=0x7f12d4006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d4013460 con 0x7f12ec060040 2021-11-15T14:43:40.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d40135c0 con 0x7f12ec060040 2021-11-15T14:43:40.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0b6940 con 0x7f12ec060040 2021-11-15T14:43:40.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d4013920 con 0x7f12ec060040 2021-11-15T14:43:40.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec140930 con 0x7f12ec060040 2021-11-15T14:43:40.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0aea00 con 0x7f12ec060040 2021-11-15T14:43:40.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f12d400f070 con 0x7f12ec060040 2021-11-15T14:43:40.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 0x7f12d0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f12d406b130 con 0x7f12ec060040 2021-11-15T14:43:40.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.076+0000 7f12eb7fe700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 0x7f12d0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.080+0000 7f12eb7fe700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 0x7f12d0055b00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f12ec13b870 tx=0x7f12dc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.080+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12ec0aea00 con 0x7f12ec060040 2021-11-15T14:43:40.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.168+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f12ec0ae9d0 con 0x7f12ec060040 2021-11-15T14:43:40.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12e97fa700 1 -- 172.21.2.135:0/261051505 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12d4045e40 con 0x7f12ec060040 2021-11-15T14:43:40.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 msgr2=0x7f12d0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 0x7f12d0055b00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f12ec13b870 tx=0x7f12dc015000).stop 2021-11-15T14:43:40.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 msgr2=0x7f12ec141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f12d4002f70 tx=0x7f12d4006ec0).stop 2021-11-15T14:43:40.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 shutdown_connections 2021-11-15T14:43:40.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f12d0053640 0x7f12d0055b00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f12ec0b3950 0x7f12ec151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f12ec0b2ca0 0x7f12ec0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:40.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 --2- 172.21.2.135:0/261051505 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f12ec060040 0x7f12ec141ff0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 >> 172.21.2.135:0/261051505 conn(0x7f12ec05cfe0 msgr2=0x7f12ec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 shutdown_connections 2021-11-15T14:43:40.186 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.180+0000 7f12f25ed700 1 -- 172.21.2.135:0/261051505 wait complete. 2021-11-15T14:43:40.190 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-15T14:43:40.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 Processor -- start 2021-11-15T14:43:40.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 -- start start 2021-11-15T14:43:40.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 0x7f287c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0b03d0 con 0x7f287c148420 2021-11-15T14:43:40.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0a9140 con 0x7f287c0a7140 2021-11-15T14:43:40.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.236+0000 7f2881d6a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b0670 con 0x7f287c0b1e30 2021-11-15T14:43:40.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287affd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f287c148420 0x7f287c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:33258/0 (socket says 172.21.2.135:33258) 2021-11-15T14:43:40.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287affd700 1 -- 172.21.2.135:0/2669902558 learned_addr learned my addr 172.21.2.135:0/2669902558 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 --2- 172.21.2.135:0/2669902558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- 172.21.2.135:0/2669902558 >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 0x7f287c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 -- 172.21.2.135:0/2669902558 >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 msgr2=0x7f287c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:40.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 --2- 172.21.2.135:0/2669902558 >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 0x7f287c1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 -- 172.21.2.135:0/2669902558 >> v1:172.21.2.119:6789/0 conn(0x7f287c148420 legacy=0x7f287c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 -- 172.21.2.135:0/2669902558 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0b0910 con 0x7f287c0b1e30 2021-11-15T14:43:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- 172.21.2.135:0/2669902558 >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 0x7f287c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:43:40.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 --2- 172.21.2.135:0/2669902558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0b1050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2864002f70 tx=0x7f2864006df0).ready entity=mon.2 client_cookie=e9d57d10d6b95a42 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287a7fc700 1 -- 172.21.2.135:0/2669902558 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286400d570 con 0x7f287c0b1e30 2021-11-15T14:43:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287a7fc700 1 -- 172.21.2.135:0/2669902558 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864000e90 con 0x7f287c0b1e30 2021-11-15T14:43:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287a7fc700 1 -- 172.21.2.135:0/2669902558 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286400d8c0 con 0x7f287c0b1e30 2021-11-15T14:43:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/2669902558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 msgr2=0x7f287c0b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- 172.21.2.135:0/2669902558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0b1050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2864002f70 tx=0x7f2864006df0).stop 2021-11-15T14:43:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/2669902558 shutdown_connections 2021-11-15T14:43:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- 172.21.2.135:0/2669902558 >> v2:172.21.2.119:3300/0 conn(0x7f287c0a7140 0x7f287c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- 172.21.2.135:0/2669902558 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0b1050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/2669902558 >> 172.21.2.135:0/2669902558 conn(0x7f287c05f730 msgr2=0x7f287c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/2669902558 shutdown_connections 2021-11-15T14:43:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/2669902558 wait complete. 2021-11-15T14:43:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 Processor -- start 2021-11-15T14:43:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- start start 2021-11-15T14:43:40.251 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 0x7f287c149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1569c0 con 0x7f287c0a7140 2021-11-15T14:43:40.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0aa940 con 0x7f287c148420 2021-11-15T14:43:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0a9ff0 con 0x7f287c0b1e30 2021-11-15T14:43:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36260/0 (socket says 172.21.2.135:36260) 2021-11-15T14:43:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 -- 172.21.2.135:0/831166775 learned_addr learned my addr 172.21.2.135:0/831166775 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:40.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 0x7f287c149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287affd700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 -- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 msgr2=0x7f287c0aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 -- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 msgr2=0x7f287c149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 0x7f287c149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 -- 172.21.2.135:0/831166775 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009470 con 0x7f287c148420 2021-11-15T14:43:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287b7fe700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 0x7f287c149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:43:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f287bfff700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7f287c159fc0 tx=0x7f28740091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f287400c9d0 con 0x7f287c148420 2021-11-15T14:43:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400cb30 con 0x7f287c148420 2021-11-15T14:43:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286400b180 con 0x7f287c148420 2021-11-15T14:43:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.240+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f287400ce90 con 0x7f287c148420 2021-11-15T14:43:40.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0a9d50 con 0x7f287c148420 2021-11-15T14:43:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c15a000 con 0x7f287c148420 2021-11-15T14:43:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2874022070 con 0x7f287c148420 2021-11-15T14:43:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2878ff9700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 0x7f2860055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:40.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f287406c170 con 0x7f287c148420 2021-11-15T14:43:40.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f287b7fe700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 0x7f2860055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f287b7fe700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 0x7f2860055a40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f2864018000 tx=0x7f2864014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:40.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.244+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2874043340 con 0x7f287c148420 2021-11-15T14:43:40.362 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:40.360+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f287c0573d0 con 0x7f287c148420 2021-11-15T14:43:41.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2878ff9700 1 -- 172.21.2.135:0/831166775 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v409) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2874046960 con 0x7f287c148420 2021-11-15T14:43:41.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 msgr2=0x7f2860055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:41.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 0x7f2860055a40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f2864018000 tx=0x7f2864014000).stop 2021-11-15T14:43:41.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 msgr2=0x7f287c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:41.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7f287c159fc0 tx=0x7f28740091d0).stop 2021-11-15T14:43:41.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 shutdown_connections 2021-11-15T14:43:41.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2860053580 0x7f2860055a40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:41.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f287c148420 0x7f287c15a260 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:41.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f287c0b1e30 0x7f287c0aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:41.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 --2- 172.21.2.135:0/831166775 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f287c0a7140 0x7f287c149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:41.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 >> 172.21.2.135:0/831166775 conn(0x7f287c05f730 msgr2=0x7f287c143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:41.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 shutdown_connections 2021-11-15T14:43:41.027 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.020+0000 7f2881d6a700 1 -- 172.21.2.135:0/831166775 wait complete. 2021-11-15T14:43:41.031 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-15T14:43:41.032 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T14:43:41.032 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-11-15T14:43:41.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 Processor -- start 2021-11-15T14:43:41.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 -- start start 2021-11-15T14:43:41.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca4c0b0520 0x7fca4c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fca4c0aa1a0 0x7fca4c0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0b2b70 con 0x7fca4c0b0900 2021-11-15T14:43:41.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c0b27f0 con 0x7fca4c0aa1a0 2021-11-15T14:43:41.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.080+0000 7fca531ac700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c0b2da0 con 0x7fca4c0b0520 2021-11-15T14:43:41.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca4c0b0520 0x7fca4c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:41.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fca4c0b0520 0x7fca4c0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36266/0 (socket says 172.21.2.135:36266) 2021-11-15T14:43:41.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 -- 172.21.2.135:0/2132374592 learned_addr learned my addr 172.21.2.135:0/2132374592 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:41.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 -- 172.21.2.135:0/2132374592 >> v2:172.21.2.119:3300/0 conn(0x7fca4c0aa1a0 msgr2=0x7fca4c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:41.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 --2- 172.21.2.135:0/2132374592 >> v2:172.21.2.119:3300/0 conn(0x7fca4c0aa1a0 0x7fca4c0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:41.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 -- 172.21.2.135:0/2132374592 >> v1:172.21.2.119:6789/0 conn(0x7fca4c0b0900 legacy=0x7fca4c143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:41.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 -- 172.21.2.135:0/2132374592 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0a9bf0 con 0x7fca4c0b0520 2021-11-15T14:43:41.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca50f48700 1 --2- 172.21.2.135:0/2132374592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c0b0520 0x7fca4c0addb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fca4c0b0130 tx=0x7fca34006eb0).ready entity=mon.1 client_cookie=2a226b83caf80d07 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:41.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca4b7fe700 1 -- 172.21.2.135:0/2132374592 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca3400d5c0 con 0x7fca4c0b0520 2021-11-15T14:43:41.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca4b7fe700 1 -- 172.21.2.135:0/2132374592 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34000e90 con 0x7fca4c0b0520 2021-11-15T14:43:41.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca4b7fe700 1 -- 172.21.2.135:0/2132374592 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca3400d910 con 0x7fca4c0b0520 2021-11-15T14:43:41.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2132374592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c0b0520 msgr2=0x7fca4c0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:41.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- 172.21.2.135:0/2132374592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c0b0520 0x7fca4c0addb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fca4c0b0130 tx=0x7fca34006eb0).stop 2021-11-15T14:43:41.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2132374592 shutdown_connections 2021-11-15T14:43:41.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- 172.21.2.135:0/2132374592 >> v2:172.21.2.119:3300/0 conn(0x7fca4c0aa1a0 0x7fca4c0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:41.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- 172.21.2.135:0/2132374592 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c0b0520 0x7fca4c0addb0 secure :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0x7fca4c0b0130 tx=0x7fca34006eb0).stop 2021-11-15T14:43:41.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2132374592 >> 172.21.2.135:0/2132374592 conn(0x7fca4c060840 msgr2=0x7fca4c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:41.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2132374592 shutdown_connections 2021-11-15T14:43:41.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2132374592 wait complete. 2021-11-15T14:43:41.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 Processor -- start 2021-11-15T14:43:41.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- start start 2021-11-15T14:43:41.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca4c0aa1a0 0x7fca4c13f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca4c0b0900 0x7fca4c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c067610 con 0x7fca4c0aa1a0 2021-11-15T14:43:41.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c064f20 con 0x7fca4c147f00 2021-11-15T14:43:41.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c154be0 con 0x7fca4c0b0900 2021-11-15T14:43:41.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:41.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36272/0 (socket says 172.21.2.135:36272) 2021-11-15T14:43:41.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 -- 172.21.2.135:0/2828244517 learned_addr learned my addr 172.21.2.135:0/2828244517 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:41.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 -- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca4c0b0900 msgr2=0x7fca4c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:41.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca4c0b0900 0x7fca4c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:41.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 -- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca4c0aa1a0 msgr2=0x7fca4c13f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:41.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca4c0aa1a0 0x7fca4c13f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:41.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 -- 172.21.2.135:0/2828244517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3400b1e0 con 0x7fca4c147f00 2021-11-15T14:43:41.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca51749700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fca44003290 tx=0x7fca440090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:41.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca4400f510 con 0x7fca4c147f00 2021-11-15T14:43:41.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400f670 con 0x7fca4c147f00 2021-11-15T14:43:41.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca4400f7e0 con 0x7fca4c147f00 2021-11-15T14:43:41.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c064740 con 0x7fca4c147f00 2021-11-15T14:43:41.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c064c80 con 0x7fca4c147f00 2021-11-15T14:43:41.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.084+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c0658c0 con 0x7fca4c147f00 2021-11-15T14:43:41.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca4400f070 con 0x7fca4c147f00 2021-11-15T14:43:41.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca49ffb700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 0x7fca30059ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:41.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fca4406b460 con 0x7fca4c147f00 2021-11-15T14:43:41.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca50f48700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 0x7fca30059ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:41.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca50f48700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 0x7fca30059ea0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fca4c0b0130 tx=0x7fca34015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:41.110 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.088+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca44042630 con 0x7fca4c147f00 2021-11-15T14:43:41.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:41.200+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7fca4c0573d0 con 0x7fca4c147f00 2021-11-15T14:43:42.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.024+0000 7fca49ffb700 1 -- 172.21.2.135:0/2828244517 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v410) v1 ==== 139+0+0 (secure 0 0 0) 0x7fca44045c50 con 0x7fca4c147f00 2021-11-15T14:43:42.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.024+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 msgr2=0x7fca30059ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.024+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 0x7fca30059ea0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fca4c0b0130 tx=0x7fca34015000).stop 2021-11-15T14:43:42.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.024+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 msgr2=0x7fca4c148390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.024+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fca44003290 tx=0x7fca440090f0).stop 2021-11-15T14:43:42.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 shutdown_connections 2021-11-15T14:43:42.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca300579e0 0x7fca30059ea0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fca4c147f00 0x7fca4c148390 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fca4c0b0900 0x7fca4c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 --2- 172.21.2.135:0/2828244517 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fca4c0aa1a0 0x7fca4c13f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 >> 172.21.2.135:0/2828244517 conn(0x7fca4c060840 msgr2=0x7fca4c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 shutdown_connections 2021-11-15T14:43:42.032 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.028+0000 7fca531ac700 1 -- 172.21.2.135:0/2828244517 wait complete. 2021-11-15T14:43:42.037 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-15T14:43:42.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 Processor -- start 2021-11-15T14:43:42.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 -- start start 2021-11-15T14:43:42.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b1f40 0x7f5a680b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5a680b2320 0x7f5a681412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680a7850 con 0x7f5a680b0030 2021-11-15T14:43:42.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680b0470 con 0x7f5a680b2320 2021-11-15T14:43:42.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a706a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680b06d0 con 0x7f5a680b1f40 2021-11-15T14:43:42.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6dc3b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5a680b0030 0x7f5a680a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52104/0 (socket says 172.21.2.135:52104) 2021-11-15T14:43:42.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6dc3b700 1 -- 172.21.2.135:0/2303239963 learned_addr learned my addr 172.21.2.135:0/2303239963 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:42.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 --2- 172.21.2.135:0/2303239963 >> v2:172.21.2.135:3300/0 conn(0x7f5a680b2320 0x7f5a681412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 -- 172.21.2.135:0/2303239963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b1f40 msgr2=0x7f5a680b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 --2- 172.21.2.135:0/2303239963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b1f40 0x7f5a680b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 -- 172.21.2.135:0/2303239963 >> v1:172.21.2.135:6789/0 conn(0x7f5a680b0030 legacy=0x7f5a680a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 -- 172.21.2.135:0/2303239963 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680b0970 con 0x7f5a680b2320 2021-11-15T14:43:42.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6ec3d700 1 --2- 172.21.2.135:0/2303239963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b2320 0x7f5a681412d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f5a600032f0 tx=0x7f5a600091d0).ready entity=mon.1 client_cookie=ac93eb67943ac0a1 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6d43a700 1 -- 172.21.2.135:0/2303239963 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a60009ea0 con 0x7f5a680b2320 2021-11-15T14:43:42.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6d43a700 1 -- 172.21.2.135:0/2303239963 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6000b8a0 con 0x7f5a680b2320 2021-11-15T14:43:42.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.088+0000 7f5a6d43a700 1 -- 172.21.2.135:0/2303239963 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6000ba10 con 0x7f5a680b2320 2021-11-15T14:43:42.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/2303239963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b2320 msgr2=0x7f5a681412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- 172.21.2.135:0/2303239963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b2320 0x7f5a681412d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f5a600032f0 tx=0x7f5a600091d0).stop 2021-11-15T14:43:42.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/2303239963 shutdown_connections 2021-11-15T14:43:42.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- 172.21.2.135:0/2303239963 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b2320 0x7f5a681412d0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- 172.21.2.135:0/2303239963 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b1f40 0x7f5a680b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/2303239963 >> 172.21.2.135:0/2303239963 conn(0x7f5a6805f730 msgr2=0x7f5a6805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/2303239963 shutdown_connections 2021-11-15T14:43:42.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/2303239963 wait complete. 2021-11-15T14:43:42.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 Processor -- start 2021-11-15T14:43:42.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- start start 2021-11-15T14:43:42.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a680b0030 0x7f5a68143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b2320 0x7f5a681572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68156ef0 con 0x7f5a680b0030 2021-11-15T14:43:42.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680aa3e0 con 0x7f5a680b1f40 2021-11-15T14:43:42.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680a94a0 con 0x7f5a680b2320 2021-11-15T14:43:42.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36290/0 (socket says 172.21.2.135:36290) 2021-11-15T14:43:42.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 -- 172.21.2.135:0/1672971769 learned_addr learned my addr 172.21.2.135:0/1672971769 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:42.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 -- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b2320 msgr2=0x7f5a681572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.104 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b2320 0x7f5a681572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 -- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a680b0030 msgr2=0x7f5a68143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a680b0030 0x7f5a68143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 -- 172.21.2.135:0/1672971769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009470 con 0x7f5a680b1f40 2021-11-15T14:43:42.105 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6dc3b700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f5a680abe10 tx=0x7f5a58007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5800ce10 con 0x7f5a680b1f40 2021-11-15T14:43:42.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a580072e0 con 0x7f5a680b1f40 2021-11-15T14:43:42.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a58005800 con 0x7f5a680b1f40 2021-11-15T14:43:42.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680a96d0 con 0x7f5a680b1f40 2021-11-15T14:43:42.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6813df90 con 0x7f5a680b1f40 2021-11-15T14:43:42.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680573d0 con 0x7f5a680b1f40 2021-11-15T14:43:42.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a58010070 con 0x7f5a680b1f40 2021-11-15T14:43:42.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 0x7f5a480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5a5806ad30 con 0x7f5a680b1f40 2021-11-15T14:43:42.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.092+0000 7f5a6e43c700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 0x7f5a480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.096+0000 7f5a6e43c700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 0x7f5a480559b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f5a64002f70 tx=0x7f5a64006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.109 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.096+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a58042010 con 0x7f5a680b1f40 2021-11-15T14:43:42.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.180+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a680ac7e0 con 0x7f5a680b1f40 2021-11-15T14:43:42.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a577fe700 1 -- 172.21.2.135:0/1672971769 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a58018030 con 0x7f5a680b1f40 2021-11-15T14:43:42.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 msgr2=0x7f5a480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 0x7f5a480559b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f5a64002f70 tx=0x7f5a64006a80).stop 2021-11-15T14:43:42.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 msgr2=0x7f5a68140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f5a680abe10 tx=0x7f5a58007c40).stop 2021-11-15T14:43:42.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 shutdown_connections 2021-11-15T14:43:42.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5a480534f0 0x7f5a480559b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5a680b2320 0x7f5a681572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5a680b1f40 0x7f5a68140310 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 --2- 172.21.2.135:0/1672971769 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5a680b0030 0x7f5a68143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 >> 172.21.2.135:0/1672971769 conn(0x7f5a6805f730 msgr2=0x7f5a68145650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 shutdown_connections 2021-11-15T14:43:42.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.192+0000 7f5a706a0700 1 -- 172.21.2.135:0/1672971769 wait complete. 2021-11-15T14:43:42.202 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:43:42.202 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:42.215 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:42.229 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:42.238 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:43:42.251 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:43:42.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:42.252 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:42.253 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:42.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:43:42.257 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-15T14:43:42.257 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:42.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:42.258 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:42.258 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:42.267 INFO:teuthology.orchestra.run.gibba032.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-15T14:43:42.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:43:42.269 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:42.270 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:43:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 Processor -- start 2021-11-15T14:43:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 -- start start 2021-11-15T14:43:42.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71900b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f71900a7140 0x7f71901447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900b03d0 con 0x7f71900b1e30 2021-11-15T14:43:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71900a9140 con 0x7f71900a7140 2021-11-15T14:43:42.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f7194d06700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71900b0670 con 0x7f7190148420 2021-11-15T14:43:42.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718e59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f71900b1e30 0x7f71900b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52114/0 (socket says 172.21.2.135:52114) 2021-11-15T14:43:42.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718e59c700 1 -- 172.21.2.135:0/3233273524 learned_addr learned my addr 172.21.2.135:0/3233273524 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:42.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459265318 0 0) 0x7f71900b03d0 con 0x7f71900b1e30 2021-11-15T14:43:42.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7170003260 con 0x7f71900b1e30 2021-11-15T14:43:42.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145003892 0 0) 0x7f7170003260 con 0x7f71900b1e30 2021-11-15T14:43:42.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718dd9b700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71900b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 msgr2=0x7f71900b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71900b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 >> v2:172.21.2.119:3300/0 conn(0x7f71900a7140 msgr2=0x7f71901447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 --2- 172.21.2.135:0/3233273524 >> v2:172.21.2.119:3300/0 conn(0x7f71900a7140 0x7f71901447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900b0910 con 0x7f71900b1e30 2021-11-15T14:43:42.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7180001660 con 0x7f71900b1e30 2021-11-15T14:43:42.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 >> v1:172.21.2.135:6789/0 conn(0x7f71900b1e30 legacy=0x7f71900b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71700037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.332 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7170003ee0 0x7f7170004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7170004bf0 0x7f717000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71900b0670 con 0x7f7170003ee0 2021-11-15T14:43:42.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7170005320 con 0x7f7170004bf0 2021-11-15T14:43:42.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717000bc40 con 0x7f7190148420 2021-11-15T14:43:42.333 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7170004bf0 0x7f717000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 -- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 msgr2=0x7f71700037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718e59c700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71700037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7190148420 0x7f71700037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.334 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 -- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7170003ee0 msgr2=0x7f7170004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7170003ee0 0x7f7170004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.320+0000 7f718ed9d700 1 -- 172.21.2.135:0/3233273524 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170003260 con 0x7f7170004bf0 2021-11-15T14:43:42.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7170004bf0 0x7f717000b750 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f71880032f0 tx=0x7f7188006f90).ready entity=mon.1 client_cookie=b8b6db9ef740a39f server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f718800b460 con 0x7f7170004bf0 2021-11-15T14:43:42.335 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800b5c0 con 0x7f7170004bf0 2021-11-15T14:43:42.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718d59a700 1 -- 172.21.2.135:0/3233273524 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f718800b730 con 0x7f7170004bf0 2021-11-15T14:43:42.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/3233273524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7170004bf0 msgr2=0x7f717000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 --2- 172.21.2.135:0/3233273524 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7170004bf0 0x7f717000b750 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f71880032f0 tx=0x7f7188006f90).stop 2021-11-15T14:43:42.336 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 -- 172.21.2.135:0/3233273524 reap_dead start 2021-11-15T14:43:42.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/3233273524 shutdown_connections 2021-11-15T14:43:42.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/3233273524 >> 172.21.2.135:0/3233273524 conn(0x7f719005f730 msgr2=0x7f719005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/3233273524 shutdown_connections 2021-11-15T14:43:42.337 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/3233273524 wait complete. 2021-11-15T14:43:42.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 Processor -- start 2021-11-15T14:43:42.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- start start 2021-11-15T14:43:42.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7170004bf0 0x7f71900ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719014b710 0x7f71900abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.338 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719014aeb0 con 0x7f719014b710 2021-11-15T14:43:42.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71900a94c0 con 0x7f71900ac210 2021-11-15T14:43:42.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719014b0e0 con 0x7f7170004bf0 2021-11-15T14:43:42.339 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36308/0 (socket says 172.21.2.135:36308) 2021-11-15T14:43:42.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 -- 172.21.2.135:0/4117265425 learned_addr learned my addr 172.21.2.135:0/4117265425 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:42.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 -- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7170004bf0 msgr2=0x7f71900ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7170004bf0 0x7f71900ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.340 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 -- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719014b710 msgr2=0x7f71900abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719014b710 0x7f71900abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 -- 172.21.2.135:0/4117265425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719014b380 con 0x7f71900ac210 2021-11-15T14:43:42.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f718ed9d700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f71900b31f0 tx=0x7f7188017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.341 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7188011a70 con 0x7f71900ac210 2021-11-15T14:43:42.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188011bd0 con 0x7f71900ac210 2021-11-15T14:43:42.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900a96f0 con 0x7f71900ac210 2021-11-15T14:43:42.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7188011d40 con 0x7f71900ac210 2021-11-15T14:43:42.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71900ab9f0 con 0x7f71900ac210 2021-11-15T14:43:42.342 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.324+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71900a9880 con 0x7f71900ac210 2021-11-15T14:43:42.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7188022030 con 0x7f71900ac210 2021-11-15T14:43:42.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f71877fe700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 0x7f7174055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f718806c380 con 0x7f71900ac210 2021-11-15T14:43:42.344 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f718e59c700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 0x7f7174055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f718e59c700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 0x7f7174055ac0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7180008000 tx=0x7f7180009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.345 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.328+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7188043550 con 0x7f71900ac210 2021-11-15T14:43:42.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.412+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f71900573d0 con 0x7f71900ac210 2021-11-15T14:43:42.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.412+0000 7f71877fe700 1 -- 172.21.2.135:0/4117265425 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v158) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f7188020020 con 0x7f71900ac210 2021-11-15T14:43:42.418 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:42.419 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:42.419 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 158, 2021-11-15T14:43:42.419 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:43:42.419 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:43:42.420 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:43:40.003511+0000", 2021-11-15T14:43:42.421 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:42.421 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:43:42.421 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:43:42.421 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:43:42.422 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:43:42.422 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:43:42.422 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:43:42.422 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:43:42.423 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:43:42.423 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:42.423 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:43:42.423 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:43:42.423 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:43:42.424 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:43:42.424 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:43:42.424 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 28, 2021-11-15T14:43:42.424 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:43:42.424 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:43:42.425 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:43:42.425 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:43:42.425 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:43:42.425 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.426 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:43:42.426 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:43:42.426 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:43:42.426 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:42.426 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:42.427 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:42.427 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:42.427 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:42.427 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:42.428 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:42.428 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:42.428 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:43:42.428 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:43:42.428 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:43:42.429 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:43:42.429 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:43:42.429 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:42.429 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:42.429 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:42.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:42.430 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:42.430 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:42.430 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:42.431 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.431 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:43:42.431 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:42.431 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:42.431 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:42.432 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:42.432 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:42.432 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:42.432 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:42.432 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:42.433 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:42.433 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:42.433 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:42.433 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:42.434 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:42.434 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:42.434 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:42.434 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:42.434 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:42.435 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:42.435 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:42.435 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:42.435 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:42.436 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:42.436 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:42.436 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:42.436 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:42.436 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:42.437 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.437 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:42.437 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:42.437 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:42.437 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:42.438 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:42.438 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:42.438 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:42.438 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:42.439 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:42.439 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:42.439 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:42.439 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:43:42.439 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:43:42.440 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.440 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:42.440 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:43:42.440 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.441 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.441 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.441 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:43:42.441 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:43:42.441 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:43:42.442 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:43:42.442 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:43:42.442 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:43:42.442 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:43:42.442 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:43:42.443 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:43:42.443 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:43:42.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:43:42.443 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:43:42.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:43:42.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:43:42.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:43:42.444 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:43:42.444 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:43:42.445 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:43:42.445 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:43:42.445 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:43:42.445 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:43:42.445 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:43:42.446 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:43:42.446 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:43:42.446 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:43:42.447 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:43:42.447 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:43:42.447 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:43:42.447 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:43:42.447 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:43:42.448 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:43:42.448 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:43:42.448 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:43:42.448 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:43:42.448 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:43:42.449 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:43:42.449 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:43:42.449 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:43:42.449 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:43:42.449 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:43:42.450 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:43:42.450 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:43:42.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:43:42.450 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:43:42.451 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:43:42.451 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:43:42.451 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:43:42.451 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:43:42.451 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:43:42.452 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:43:42.452 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.452 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:43:42.452 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:43:42.453 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:43:42.453 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:43:42.453 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:43:42.453 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:43:42.453 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:43:42.454 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:43:42.454 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:43:42.454 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:43:42.454 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:43:42.454 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:43:42.455 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:43:42.455 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:43:42.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.455 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.456 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:42.456 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:43:42.456 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.456 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:42.456 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:43:42.457 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.457 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.457 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.457 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.457 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.458 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.458 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.458 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.459 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.459 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.459 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.459 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.459 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.460 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:43:42.460 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.460 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.460 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.460 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.461 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:43:42.461 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.461 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.461 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.462 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.462 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.462 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.462 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.462 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.463 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:43:42.463 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.463 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.463 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.463 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.464 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:43:42.464 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.464 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.464 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.464 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.465 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.465 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.465 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.465 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:43:42.466 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.466 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.466 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.466 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.467 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:43:42.467 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.467 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.467 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.467 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.468 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.468 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.468 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.468 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.469 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:43:42.469 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.469 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.469 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.469 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.470 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:43:42.470 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:43:42.470 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.470 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.470 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.471 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:43:42.471 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:43:42.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:43:42.471 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:43:42.471 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.472 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.472 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.472 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.472 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.472 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.473 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:42.473 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:43:42.473 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.473 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.474 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.474 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.474 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.475 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.475 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.475 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.475 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.476 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.476 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.476 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:43:42.476 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.477 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.477 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.477 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.477 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:43:42.478 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.478 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.478 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.478 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.478 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.479 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.479 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.479 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:43:42.480 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.480 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.480 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.480 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.480 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:43:42.481 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.481 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.481 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.481 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.481 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.482 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.482 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.482 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:43:42.483 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.483 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.483 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.483 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.483 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:43:42.484 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.484 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.484 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.484 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.485 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.485 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.485 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.485 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:43:42.486 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.486 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.486 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.486 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.486 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:43:42.487 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:43:42.487 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.487 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.487 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.488 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:43:42.488 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:43:42.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:43:42.488 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:43:42.488 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.489 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.489 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.489 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.489 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.489 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.490 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:42.490 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:43:42.490 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.490 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.490 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.491 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.491 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.491 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.491 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.492 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.492 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.492 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.492 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.492 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.493 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.493 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.493 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:43:42.493 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.493 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.494 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.494 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.494 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:43:42.494 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.494 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.495 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.495 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.495 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.495 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.496 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.496 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.496 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:43:42.496 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.496 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.497 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.497 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.497 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:43:42.497 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.497 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.498 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.498 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.498 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.498 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.498 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.499 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.499 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:43:42.499 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.499 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.500 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.500 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.500 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:43:42.500 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.500 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.501 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.501 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.501 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.501 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.501 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.502 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.502 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:43:42.502 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.502 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.503 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.503 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.503 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:43:42.503 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:43:42.503 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.504 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.504 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.504 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:43:42.504 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:43:42.505 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:43:42.505 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:43:42.505 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.505 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.505 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.506 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.506 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.506 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.506 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:42.506 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:43:42.507 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.507 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.507 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.507 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.508 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.508 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.508 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.508 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 152, 2021-11-15T14:43:42.509 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.509 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.509 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.509 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.510 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.510 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.510 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:43:42.510 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.511 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.511 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.511 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.511 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:43:42.511 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.512 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.512 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.512 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.512 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.513 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.513 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.513 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:43:42.513 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.514 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.514 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.514 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.514 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:43:42.515 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.515 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.515 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.515 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.515 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.516 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.516 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.516 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:43:42.516 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.517 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.517 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.517 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.517 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:43:42.518 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.518 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.518 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.518 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.518 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.519 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.519 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.519 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:43:42.520 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.520 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.520 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.520 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.520 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:43:42.521 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:43:42.521 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.521 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.521 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.522 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:43:42.522 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:43:42.522 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:43:42.522 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:43:42.522 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.523 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.523 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.523 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.523 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.524 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.524 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:42.524 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:43:42.524 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.524 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.525 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.525 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.525 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.525 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.526 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.526 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 152, 2021-11-15T14:43:42.526 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.526 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.526 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.527 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.527 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.527 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:43:42.528 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.528 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.528 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.528 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.528 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:43:42.529 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.529 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.529 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.529 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.530 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.530 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.530 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.530 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:43:42.531 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.531 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.531 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.531 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.532 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:43:42.532 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.532 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.532 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.532 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.533 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.533 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.533 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.533 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.534 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:43:42.534 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.534 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.534 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.534 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.535 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:43:42.535 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.535 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.535 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.536 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.536 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.536 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.536 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.536 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.537 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:43:42.537 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.537 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.537 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.538 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.538 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:43:42.538 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:43:42.538 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.538 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.539 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.539 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:43:42.539 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:43:42.539 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:43:42.540 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:43:42.540 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.540 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.540 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.540 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.541 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.541 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.541 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:42.541 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:43:42.542 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.542 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.542 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.542 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.542 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.543 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.543 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.543 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.543 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.544 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.544 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.544 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.544 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.544 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.545 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:43:42.545 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.545 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.545 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.545 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.546 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:43:42.546 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.546 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.546 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.547 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.547 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.547 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.547 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.547 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.548 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:43:42.548 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.548 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.548 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.549 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.549 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:43:42.549 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.549 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.549 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.550 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.550 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.550 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.550 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.551 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.551 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:43:42.551 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.551 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.551 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.552 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.552 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:43:42.552 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.552 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.553 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.553 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.553 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.553 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.553 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.554 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.554 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:43:42.554 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.554 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.554 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.555 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.555 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:43:42.555 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:43:42.555 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.556 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.556 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.556 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:43:42.556 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:43:42.556 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:43:42.557 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:43:42.557 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.557 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.557 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.558 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.558 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.558 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.558 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:42.558 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:43:42.559 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.559 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.559 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.559 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.560 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.560 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.560 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.560 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.560 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.561 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.561 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.561 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.561 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.562 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.562 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:43:42.562 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.562 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.562 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.563 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.563 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:43:42.563 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.563 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.563 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.564 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.564 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.564 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.564 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.565 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.565 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:43:42.565 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.565 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.566 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.566 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.566 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:43:42.566 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.566 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.567 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.567 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.567 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.567 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.568 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.568 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.568 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:43:42.568 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.568 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.569 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.569 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.569 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:43:42.569 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.570 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.570 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.570 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.570 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.570 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.571 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.571 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.571 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:43:42.571 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.572 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.572 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.572 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.572 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:43:42.572 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:43:42.573 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.573 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.573 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.573 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:43:42.574 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:43:42.574 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:43:42.574 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:43:42.574 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.574 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.575 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.575 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.575 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.575 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.576 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:42.576 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:43:42.576 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:43:42.576 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:43:42.576 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:43:42.577 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:43:42.577 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:43:42.577 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:43:42.577 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:43:42.578 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 153, 2021-11-15T14:43:42.578 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:43:42.578 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:43:42.578 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:43:42.578 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.579 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.579 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.579 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:43:42.579 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.579 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.580 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.580 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.580 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:43:42.580 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.581 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.581 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.581 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.581 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:43:42.581 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.582 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.582 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.582 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:43:42.582 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.583 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.583 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.583 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.583 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:43:42.583 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.584 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.584 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.584 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.584 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:43:42.584 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.585 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.585 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.585 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:43:42.585 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.586 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.586 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.586 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.586 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:43:42.586 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.587 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.587 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.587 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.587 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:43:42.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:43:42.588 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.588 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:43:42.588 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:43:42.588 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.589 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.589 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.589 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:43:42.589 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:43:42.590 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:43:42.590 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.590 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.590 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.590 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:43:42.591 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:43:42.591 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:43:42.591 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:43:42.591 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:43:42.592 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:43:42.592 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:43:42.592 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:42.592 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.592 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:42.593 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:43:42.593 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.593 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:43:42.593 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.593 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.594 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.594 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.594 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.594 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:43:42.595 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.595 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.595 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.595 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:43:42.595 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.596 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.596 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.596 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.596 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.597 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:43:42.597 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.597 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.597 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.597 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:43:42.598 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.598 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.598 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.598 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.599 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.599 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:43:42.599 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.599 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.599 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.600 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:43:42.600 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.600 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.600 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.601 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.601 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.601 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:43:42.601 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.601 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.602 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.602 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:43:42.602 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.602 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.603 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.603 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.603 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.603 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:43:42.603 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:43:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.604 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.605 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:43:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:43:42.606 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.607 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.607 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.607 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.607 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.608 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:43:42.608 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.608 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.608 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:42.608 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:43:42.609 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:43:42.609 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:43:42.609 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:43:42.609 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:43:42.610 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:43:42.610 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:43:42.610 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:43:42.610 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.610 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:43:42.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:43:42.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:43:42.611 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:43:42.611 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:43:42.612 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": { 2021-11-15T14:43:42.612 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6835/3501994559": "2021-11-16T14:43:36.271179+0000", 2021-11-15T14:43:42.612 INFO:teuthology.orchestra.run.gibba035.stdout: "172.21.2.135:6834/3501994559": "2021-11-16T14:43:36.271179+0000" 2021-11-15T14:43:42.612 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.612 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:43:42.613 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:43:42.613 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:43:42.613 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:42.613 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:43:42.613 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:43:42.614 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:42.614 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:43:42.614 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:42.614 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:42.615 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:43:42.615 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:43:42.615 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.615 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:43:42.615 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:43:42.616 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:43:42.616 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:43:42.616 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:43:42.616 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:43:42.617 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:43:42.617 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:42.617 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:42.617 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:43:42.617 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:43:42.618 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:43:42.618 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:43:42.618 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:43:42.618 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:42.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 msgr2=0x7f7174055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 0x7f7174055ac0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7180008000 tx=0x7f7180009040).stop 2021-11-15T14:43:42.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 msgr2=0x7f719015a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f71900b31f0 tx=0x7f7188017000).stop 2021-11-15T14:43:42.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 shutdown_connections 2021-11-15T14:43:42.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7174053600 0x7f7174055ac0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f71900ac210 0x7f719015a070 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f719014b710 0x7f71900abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 --2- 172.21.2.135:0/4117265425 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7170004bf0 0x7f71900ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 >> 172.21.2.135:0/4117265425 conn(0x7f719005f730 msgr2=0x7f7190146830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 shutdown_connections 2021-11-15T14:43:42.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.416+0000 7f7194d06700 1 -- 172.21.2.135:0/4117265425 wait complete. 2021-11-15T14:43:42.623 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 Processor -- start 2021-11-15T14:43:42.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- start start 2021-11-15T14:43:42.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f25e40b1e30 0x7f25e40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e4148420 0x7f25e40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f25e40a7140 0x7f25e41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40a9140 con 0x7f25e40b1e30 2021-11-15T14:43:42.682 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40b03d0 con 0x7f25e40a7140 2021-11-15T14:43:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40b0670 con 0x7f25e4148420 2021-11-15T14:43:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f25e40a7140 0x7f25e41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f25e40a7140 0x7f25e41447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36318/0 (socket says 172.21.2.135:36318) 2021-11-15T14:43:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 -- 172.21.2.135:0/3984017827 learned_addr learned my addr 172.21.2.135:0/3984017827 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:42.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 -- 172.21.2.135:0/3984017827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e4148420 msgr2=0x7f25e40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 --2- 172.21.2.135:0/3984017827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e4148420 0x7f25e40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 -- 172.21.2.135:0/3984017827 >> v2:172.21.2.119:3300/0 conn(0x7f25e40b1e30 msgr2=0x7f25e40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 --2- 172.21.2.135:0/3984017827 >> v2:172.21.2.119:3300/0 conn(0x7f25e40b1e30 0x7f25e40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 -- 172.21.2.135:0/3984017827 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e40b0910 con 0x7f25e40a7140 2021-11-15T14:43:42.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25e9a44700 1 --2- 172.21.2.135:0/3984017827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40a7140 0x7f25e41447a0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f25dc0032f0 tx=0x7f25dc009290).ready entity=mon.1 client_cookie=90baabc6dbdedc86 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25d3fff700 1 -- 172.21.2.135:0/3984017827 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25dc00b870 con 0x7f25e40a7140 2021-11-15T14:43:42.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25d3fff700 1 -- 172.21.2.135:0/3984017827 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00b9d0 con 0x7f25e40a7140 2021-11-15T14:43:42.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25d3fff700 1 -- 172.21.2.135:0/3984017827 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25dc00bb40 con 0x7f25e40a7140 2021-11-15T14:43:42.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- 172.21.2.135:0/3984017827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40a7140 msgr2=0x7f25e41447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/3984017827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40a7140 0x7f25e41447a0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f25dc0032f0 tx=0x7f25dc009290).stop 2021-11-15T14:43:42.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- 172.21.2.135:0/3984017827 shutdown_connections 2021-11-15T14:43:42.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/3984017827 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40a7140 0x7f25e41447a0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/3984017827 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e4148420 0x7f25e40b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.690 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/3984017827 >> v2:172.21.2.119:3300/0 conn(0x7f25e40b1e30 0x7f25e40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- 172.21.2.135:0/3984017827 >> 172.21.2.135:0/3984017827 conn(0x7f25e405f730 msgr2=0x7f25e405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- 172.21.2.135:0/3984017827 shutdown_connections 2021-11-15T14:43:42.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.676+0000 7f25eb4a7700 1 -- 172.21.2.135:0/3984017827 wait complete. 2021-11-15T14:43:42.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 Processor -- start 2021-11-15T14:43:42.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- start start 2021-11-15T14:43:42.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e40a7140 0x7f25e40ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.698 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25e4148420 0x7f25e40ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40ac9d0 con 0x7f25e4148420 2021-11-15T14:43:42.699 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4149c70 con 0x7f25e40b1e30 2021-11-15T14:43:42.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e414a9e0 con 0x7f25e40a7140 2021-11-15T14:43:42.700 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36322/0 (socket says 172.21.2.135:36322) 2021-11-15T14:43:42.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 -- 172.21.2.135:0/1002899176 learned_addr learned my addr 172.21.2.135:0/1002899176 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:42.701 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 -- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e40a7140 msgr2=0x7f25e40ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e40a7140 0x7f25e40ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 -- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25e4148420 msgr2=0x7f25e40ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.702 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25e4148420 0x7f25e40ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 -- 172.21.2.135:0/1002899176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009530 con 0x7f25e40b1e30 2021-11-15T14:43:42.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e8a42700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f25e40acb10 tx=0x7f25d4006d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.703 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d4011400 con 0x7f25e40b1e30 2021-11-15T14:43:42.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4011560 con 0x7f25e40b1e30 2021-11-15T14:43:42.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4149ea0 con 0x7f25e40b1e30 2021-11-15T14:43:42.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d40116d0 con 0x7f25e40b1e30 2021-11-15T14:43:42.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e40ab210 con 0x7f25e40b1e30 2021-11-15T14:43:42.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e40b0bb0 con 0x7f25e40b1e30 2021-11-15T14:43:42.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f25d400f070 con 0x7f25e40b1e30 2021-11-15T14:43:42.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 0x7f25c4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.705 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f25d406afb0 con 0x7f25e40b1e30 2021-11-15T14:43:42.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.680+0000 7f25e9243700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 0x7f25c4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.684+0000 7f25e9243700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 0x7f25c4055b90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f25e0002f70 tx=0x7f25e0006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.706 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.684+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25d4042290 con 0x7f25e40b1e30 2021-11-15T14:43:42.791 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:42.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.788+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e40573d0 con 0x7f25e40b1e30 2021-11-15T14:43:42.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25d27fc700 1 -- 172.21.2.135:0/1002899176 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f25d40458b0 con 0x7f25e40b1e30 2021-11-15T14:43:42.794 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:42.794 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8614,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/2652395046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2652395046},{"type":"v1","addr":"172.21.2.135:6835","nonce":2652395046}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[]} 2021-11-15T14:43:42.795 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:42.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 msgr2=0x7f25c4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 0x7f25c4055b90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f25e0002f70 tx=0x7f25e0006a80).stop 2021-11-15T14:43:42.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 msgr2=0x7f25e40abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f25e40acb10 tx=0x7f25d4006d80).stop 2021-11-15T14:43:42.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 shutdown_connections 2021-11-15T14:43:42.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f25c40536d0 0x7f25c4055b90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f25e4148420 0x7f25e40ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f25e40b1e30 0x7f25e40abff0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 --2- 172.21.2.135:0/1002899176 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f25e40a7140 0x7f25e40ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:42.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 >> 172.21.2.135:0/1002899176 conn(0x7f25e405f730 msgr2=0x7f25e4144940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 shutdown_connections 2021-11-15T14:43:42.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.792+0000 7f25eb4a7700 1 -- 172.21.2.135:0/1002899176 wait complete. 2021-11-15T14:43:42.800 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 79 2021-11-15T14:43:42.802 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:42.803 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:42.805 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:43:42.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 Processor -- start 2021-11-15T14:43:42.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 -- start start 2021-11-15T14:43:42.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f49200b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200b03d0 con 0x7f49200b1e30 2021-11-15T14:43:42.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200b0670 con 0x7f49200a7140 2021-11-15T14:43:42.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f4924dad700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200a9140 con 0x7f4920148420 2021-11-15T14:43:42.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f491ed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f49200a7140 0x7f49201447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52152/0 (socket says 172.21.2.135:52152) 2021-11-15T14:43:42.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f491ed9d700 1 -- 172.21.2.135:0/176929621 learned_addr learned my addr 172.21.2.135:0/176929621 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:42.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f491dd9b700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f49200b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.848+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754749540 0 0) 0x7f49200b0670 con 0x7f49200a7140 2021-11-15T14:43:42.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4900003260 con 0x7f49200a7140 2021-11-15T14:43:42.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189363245 0 0) 0x7f4900003260 con 0x7f49200a7140 2021-11-15T14:43:42.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 msgr2=0x7f49200b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f49200b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 >> v1:172.21.2.119:6789/0 conn(0x7f49200b1e30 legacy=0x7f49200b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200b0910 con 0x7f49200a7140 2021-11-15T14:43:42.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f49180019e0 con 0x7f49200a7140 2021-11-15T14:43:42.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 >> v1:172.21.2.135:6789/0 conn(0x7f49200a7140 legacy=0x7f49201447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4900003750 0x7f4900003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4900004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f4900004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490000b750 con 0x7f4900003750 2021-11-15T14:43:42.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490000b890 con 0x7f4900004500 2021-11-15T14:43:42.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490000ba50 con 0x7f4920148420 2021-11-15T14:43:42.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4900004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491ed9d700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f4900004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4900003750 0x7f4900003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 -- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 msgr2=0x7f4900004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4920148420 0x7f4900004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 -- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4900003750 msgr2=0x7f4900003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:42.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4900003750 0x7f4900003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 -- 172.21.2.135:0/176929621 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900003260 con 0x7f4900004500 2021-11-15T14:43:42.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4900004980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f490800c000 tx=0x7f4908006df0).ready entity=mon.1 client_cookie=b9671902d99c8f3c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490800e800 con 0x7f4900004500 2021-11-15T14:43:42.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800e960 con 0x7f4900004500 2021-11-15T14:43:42.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491d59a700 1 -- 172.21.2.135:0/176929621 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490800ecc0 con 0x7f4900004500 2021-11-15T14:43:42.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/176929621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 msgr2=0x7f4900004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 --2- 172.21.2.135:0/176929621 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4900004980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f490800c000 tx=0x7f4908006df0).stop 2021-11-15T14:43:42.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491ed9d700 1 -- 172.21.2.135:0/176929621 reap_dead start 2021-11-15T14:43:42.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/176929621 shutdown_connections 2021-11-15T14:43:42.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/176929621 >> 172.21.2.135:0/176929621 conn(0x7f492005f730 msgr2=0x7f492005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/176929621 shutdown_connections 2021-11-15T14:43:42.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/176929621 wait complete. 2021-11-15T14:43:42.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 Processor -- start 2021-11-15T14:43:42.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- start start 2021-11-15T14:43:42.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49200ad960 0x7f49200add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 0x7f4920140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200ae720 con 0x7f49200ae270 2021-11-15T14:43:42.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492014b090 con 0x7f4900004500 2021-11-15T14:43:42.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200ace30 con 0x7f49200ad960 2021-11-15T14:43:42.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36340/0 (socket says 172.21.2.135:36340) 2021-11-15T14:43:42.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 -- 172.21.2.135:0/1654291426 learned_addr learned my addr 172.21.2.135:0/1654291426 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:42.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491dd9b700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49200ad960 0x7f49200add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 -- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49200ad960 msgr2=0x7f49200add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49200ad960 0x7f49200add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 -- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 msgr2=0x7f4920140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491ed9d700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 0x7f4920140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 0x7f4920140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 -- 172.21.2.135:0/1654291426 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200ad3b0 con 0x7f4900004500 2021-11-15T14:43:42.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491ed9d700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 0x7f4920140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:42.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f491e59c700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f49201440a0 tx=0x7f4910007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4910011590 con 0x7f4900004500 2021-11-15T14:43:42.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49100116f0 con 0x7f4900004500 2021-11-15T14:43:42.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4910011a50 con 0x7f4900004500 2021-11-15T14:43:42.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200b41c0 con 0x7f4900004500 2021-11-15T14:43:42.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.852+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200ac910 con 0x7f4900004500 2021-11-15T14:43:42.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49200ad540 con 0x7f4900004500 2021-11-15T14:43:42.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f491001a030 con 0x7f4900004500 2021-11-15T14:43:42.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f49177fe700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 0x7f4904055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:42.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f491006b200 con 0x7f4900004500 2021-11-15T14:43:42.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f491dd9b700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 0x7f4904055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:42.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f491dd9b700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 0x7f4904055a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f490801a000 tx=0x7f4908019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:42.880 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.856+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4910042590 con 0x7f4900004500 2021-11-15T14:43:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.964+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49200acff0 con 0x7f4900004500 2021-11-15T14:43:42.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.964+0000 7f49177fe700 1 -- 172.21.2.135:0/1654291426 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f4910045bb0 con 0x7f4900004500 2021-11-15T14:43:42.970 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:42.970 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5346,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.119:6835/4127813094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":4127813094},{"type":"v1","addr":"172.21.2.119:6835","nonce":4127813094}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.135:6833/790901942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":790901942},{"type":"v1","addr":"172.21.2.135:6833","nonce":790901942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74},{"gid":8614,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6835/2652395046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6834","nonce":2652395046},{"type":"v1","addr":"172.21.2.135:6835","nonce":2652395046}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[]} 2021-11-15T14:43:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 msgr2=0x7f4904055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 0x7f4904055a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f490801a000 tx=0x7f4908019000).stop 2021-11-15T14:43:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 msgr2=0x7f4920147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f49201440a0 tx=0x7f4910007a00).stop 2021-11-15T14:43:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 shutdown_connections 2021-11-15T14:43:42.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f49040535b0 0x7f4904055a70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f49200ae270 0x7f4920140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f49200ad960 0x7f49200add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 --2- 172.21.2.135:0/1654291426 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4900004500 0x7f4920147ae0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:42.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 >> 172.21.2.135:0/1654291426 conn(0x7f492005f730 msgr2=0x7f4920144100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:42.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 shutdown_connections 2021-11-15T14:43:42.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:42.968+0000 7f4924dad700 1 -- 172.21.2.135:0/1654291426 wait complete. 2021-11-15T14:43:42.974 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 79 2021-11-15T14:43:42.977 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-15T14:43:42.977 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-15T14:43:42.978 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T14:43:42.978 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:42.978 INFO:tasks.ceph.mds.c:Restarting daemon 2021-11-15T14:43:42.978 INFO:tasks.ceph.mds.c:Stopping old one... 2021-11-15T14:43:42.979 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T14:43:42.979 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:42.979 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-15T14:43:42.980 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-15T14:43:42.980 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T14:43:42.980 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T14:43:42.992 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T14:43:42.992 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-15T14:43:42.995 INFO:tasks.ceph.mds.b:Started 2021-11-15T14:43:42.995 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:43.023 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T14:43:43.024 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-15T14:43:43.025 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T14:43:43.025 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-11-15T14:43:43.026 INFO:tasks.ceph.mds.a:Started 2021-11-15T14:43:43.027 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:43.028 INFO:tasks.ceph.mds.c:Started 2021-11-15T14:43:43.028 DEBUG:teuthology.parallel:result is None 2021-11-15T14:43:43.029 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-15T14:43:43.031 INFO:tasks.ceph.mds.b.gibba019.stdout:starting mds.b at 2021-11-15T14:43:43.062 INFO:tasks.ceph.mds.a.gibba035.stdout:starting mds.a at 2021-11-15T14:43:43.063 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:43:43.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 Processor -- start 2021-11-15T14:43:43.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- start start 2021-11-15T14:43:43.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f059c0613a0 0x7f059c061780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c0ad640 0x7f059c0b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f059c1404c0 0x7f059c140950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0aed70 con 0x7f059c1404c0 2021-11-15T14:43:43.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0b6fa0 con 0x7f059c0613a0 2021-11-15T14:43:43.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0aefa0 con 0x7f059c0ad640 2021-11-15T14:43:43.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f059c0613a0 0x7f059c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f059c0613a0 0x7f059c061780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36374/0 (socket says 172.21.2.135:36374) 2021-11-15T14:43:43.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 -- 172.21.2.135:0/3361947931 learned_addr learned my addr 172.21.2.135:0/3361947931 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:43.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 -- 172.21.2.135:0/3361947931 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c0ad640 msgr2=0x7f059c0b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:43.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059a7fc700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c0ad640 0x7f059c0b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059b7fe700 1 --2- 172.21.2.135:0/3361947931 >> v2:172.21.2.119:3300/0 conn(0x7f059c1404c0 0x7f059c140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c0ad640 0x7f059c0b9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 -- 172.21.2.135:0/3361947931 >> v2:172.21.2.119:3300/0 conn(0x7f059c1404c0 msgr2=0x7f059c140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:43.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 --2- 172.21.2.135:0/3361947931 >> v2:172.21.2.119:3300/0 conn(0x7f059c1404c0 0x7f059c140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 -- 172.21.2.135:0/3361947931 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0af240 con 0x7f059c0613a0 2021-11-15T14:43:43.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059affd700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c061780 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f0584002f70 tx=0x7f0584006eb0).ready entity=mon.1 client_cookie=3db1cb5c5075e0d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:43.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f0599ffb700 1 -- 172.21.2.135:0/3361947931 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f058400d570 con 0x7f059c0613a0 2021-11-15T14:43:43.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f0599ffb700 1 -- 172.21.2.135:0/3361947931 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584000e90 con 0x7f059c0613a0 2021-11-15T14:43:43.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f0599ffb700 1 -- 172.21.2.135:0/3361947931 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f058400d900 con 0x7f059c0613a0 2021-11-15T14:43:43.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- 172.21.2.135:0/3361947931 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 msgr2=0x7f059c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:43.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c061780 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f0584002f70 tx=0x7f0584006eb0).stop 2021-11-15T14:43:43.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- 172.21.2.135:0/3361947931 shutdown_connections 2021-11-15T14:43:43.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- 172.21.2.135:0/3361947931 >> v2:172.21.2.119:3300/0 conn(0x7f059c1404c0 0x7f059c140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c0ad640 0x7f059c0b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 --2- 172.21.2.135:0/3361947931 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c061780 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- 172.21.2.135:0/3361947931 >> 172.21.2.135:0/3361947931 conn(0x7f059c066e60 msgr2=0x7f059c067240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:43.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- 172.21.2.135:0/3361947931 shutdown_connections 2021-11-15T14:43:43.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.080+0000 7f059bfff700 1 -- 172.21.2.135:0/3361947931 wait complete. 2021-11-15T14:43:43.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 Processor -- start 2021-11-15T14:43:43.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- start start 2021-11-15T14:43:43.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f059c0ad640 0x7f059c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c1404c0 0x7f059c0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c152ea0 con 0x7f059c0ad640 2021-11-15T14:43:43.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c153140 con 0x7f059c0613a0 2021-11-15T14:43:43.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b07b0 con 0x7f059c1404c0 2021-11-15T14:43:43.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36378/0 (socket says 172.21.2.135:36378) 2021-11-15T14:43:43.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 -- 172.21.2.135:0/1984546328 learned_addr learned my addr 172.21.2.135:0/1984546328 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:43.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059a7fc700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f059c0ad640 0x7f059c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059b7fe700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c1404c0 0x7f059c0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 -- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c1404c0 msgr2=0x7f059c0ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:43.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c1404c0 0x7f059c0ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 -- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f059c0ad640 msgr2=0x7f059c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:43.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f059c0ad640 0x7f059c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:43.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 -- 172.21.2.135:0/1984546328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058400b1e0 con 0x7f059c0613a0 2021-11-15T14:43:43.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059affd700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f0584002f70 tx=0x7f0584015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:43.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05840118e0 con 0x7f059c0613a0 2021-11-15T14:43:43.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584011a40 con 0x7f059c0613a0 2021-11-15T14:43:43.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0584011da0 con 0x7f059c0613a0 2021-11-15T14:43:43.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0b0c50 con 0x7f059c0613a0 2021-11-15T14:43:43.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0b18e0 con 0x7f059c0613a0 2021-11-15T14:43:43.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c152cf0 con 0x7f059c0613a0 2021-11-15T14:43:43.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0584025030 con 0x7f059c0613a0 2021-11-15T14:43:43.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 0x7f0580055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:43.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f058406cb50 con 0x7f059c0613a0 2021-11-15T14:43:43.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059a7fc700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 0x7f0580055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:43.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.084+0000 7f059a7fc700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 0x7f0580055b50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f058c00d000 tx=0x7f058c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:43.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.088+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0584043e30 con 0x7f059c0613a0 2021-11-15T14:43:43.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:43.180+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f059c0af4e0 con 0x7f059c0613a0 2021-11-15T14:43:44.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.096+0000 7f0593fff700 1 -- 172.21.2.135:0/1984546328 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v160) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0584047450 con 0x7f059c0613a0 2021-11-15T14:43:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.100+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 msgr2=0x7f0580055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.100+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 0x7f0580055b50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f058c00d000 tx=0x7f058c008040).stop 2021-11-15T14:43:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.100+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 msgr2=0x7f059c144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.106 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.100+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f0584002f70 tx=0x7f0584015000).stop 2021-11-15T14:43:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 shutdown_connections 2021-11-15T14:43:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0580053690 0x7f0580055b50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f059c1404c0 0x7f059c0ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f059c0ad640 0x7f059c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.107 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 --2- 172.21.2.135:0/1984546328 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f059c0613a0 0x7f059c144710 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 >> 172.21.2.135:0/1984546328 conn(0x7f059c066e60 msgr2=0x7f059c067240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 shutdown_connections 2021-11-15T14:43:44.108 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.104+0000 7f059bfff700 1 -- 172.21.2.135:0/1984546328 wait complete. 2021-11-15T14:43:44.109 INFO:teuthology.orchestra.run.gibba035.stderr: removed all blacklist entries 2021-11-15T14:43:44.136 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-11-15T14:43:44.137 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-15T14:43:44.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 Processor -- start 2021-11-15T14:43:44.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- start start 2021-11-15T14:43:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f5f60067380 0x7f5f60143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f600aac30 con 0x7f5f60060180 2021-11-15T14:43:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f60060560 con 0x7f5f60143e60 2021-11-15T14:43:44.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f60066f20 con 0x7f5f60067380 2021-11-15T14:43:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5ed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5f60143e60 0x7f5f6014b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52208/0 (socket says 172.21.2.135:52208) 2021-11-15T14:43:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5ed9d700 1 -- 172.21.2.135:0/3871749642 learned_addr learned my addr 172.21.2.135:0/3871749642 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760403699 0 0) 0x7f5f60060560 con 0x7f5f60143e60 2021-11-15T14:43:44.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f40003260 con 0x7f5f60143e60 2021-11-15T14:43:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 646134727 0 0) 0x7f5f40003260 con 0x7f5f60143e60 2021-11-15T14:43:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 >> v2:172.21.2.119:3300/0 conn(0x7f5f60067380 msgr2=0x7f5f60143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 --2- 172.21.2.135:0/3871749642 >> v2:172.21.2.119:3300/0 conn(0x7f5f60067380 0x7f5f60143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 >> v1:172.21.2.119:6789/0 conn(0x7f5f60060180 legacy=0x7f5f600b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f600b3430 con 0x7f5f60143e60 2021-11-15T14:43:44.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f5f580019e0 con 0x7f5f60143e60 2021-11-15T14:43:44.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 >> v1:172.21.2.135:6789/0 conn(0x7f5f60143e60 legacy=0x7f5f6014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 0x7f5f40003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40004500 0x7f5f40004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f40004f90 0x7f5f4000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60066f20 con 0x7f5f40004500 2021-11-15T14:43:44.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40010290 con 0x7f5f40003750 2021-11-15T14:43:44.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40010450 con 0x7f5f40004f90 2021-11-15T14:43:44.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 0x7f5f40003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 -- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f40004f90 msgr2=0x7f5f4000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f40004f90 0x7f5f4000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 -- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40004500 msgr2=0x7f5f40004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40004500 0x7f5f40004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 -- 172.21.2.135:0/3871749642 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f40003260 con 0x7f5f40003750 2021-11-15T14:43:44.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5ed9d700 1 -- 172.21.2.135:0/3871749642 reap_dead start 2021-11-15T14:43:44.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 0x7f5f40003b50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f5f48000f70 tx=0x7f5f480079e0).ready entity=mon.1 client_cookie=2fe7ffa310e1028e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f48007cf0 con 0x7f5f40003750 2021-11-15T14:43:44.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48014410 con 0x7f5f40003750 2021-11-15T14:43:44.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f5d59a700 1 -- 172.21.2.135:0/3871749642 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f48014790 con 0x7f5f40003750 2021-11-15T14:43:44.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 msgr2=0x7f5f40003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 0x7f5f40003b50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f5f48000f70 tx=0x7f5f480079e0).stop 2021-11-15T14:43:44.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- 172.21.2.135:0/3871749642 shutdown_connections 2021-11-15T14:43:44.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/3871749642 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f40003750 0x7f5f40003b50 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- 172.21.2.135:0/3871749642 >> 172.21.2.135:0/3871749642 conn(0x7f5f6005cfb0 msgr2=0x7f5f6005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- 172.21.2.135:0/3871749642 shutdown_connections 2021-11-15T14:43:44.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- 172.21.2.135:0/3871749642 wait complete. 2021-11-15T14:43:44.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 Processor -- start 2021-11-15T14:43:44.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.252+0000 7f5f64b3e700 1 -- start start 2021-11-15T14:43:44.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40003750 0x7f5f600b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f600ab810 0x7f5f600abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6013ec20 con 0x7f5f40003750 2021-11-15T14:43:44.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6013e430 con 0x7f5f6013c120 2021-11-15T14:43:44.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600b0360 con 0x7f5f600ab810 2021-11-15T14:43:44.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36402/0 (socket says 172.21.2.135:36402) 2021-11-15T14:43:44.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 -- 172.21.2.135:0/1362901983 learned_addr learned my addr 172.21.2.135:0/1362901983 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 -- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f600ab810 msgr2=0x7f5f600abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f600ab810 0x7f5f600abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 -- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40003750 msgr2=0x7f5f600b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40003750 0x7f5f600b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 -- 172.21.2.135:0/1362901983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6013d750 con 0x7f5f6013c120 2021-11-15T14:43:44.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5dd9b700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f5f600b1500 tx=0x7f5f50006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f50009e70 con 0x7f5f6013c120 2021-11-15T14:43:44.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50013460 con 0x7f5f6013c120 2021-11-15T14:43:44.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6013e980 con 0x7f5f6013c120 2021-11-15T14:43:44.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f500137c0 con 0x7f5f6013c120 2021-11-15T14:43:44.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6013d190 con 0x7f5f6013c120 2021-11-15T14:43:44.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6013cc10 con 0x7f5f6013c120 2021-11-15T14:43:44.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f5001a060 con 0x7f5f6013c120 2021-11-15T14:43:44.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 0x7f5f44055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f5f5006afc0 con 0x7f5f6013c120 2021-11-15T14:43:44.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.256+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 0x7f5f44055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.260+0000 7f5f5e59c700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 0x7f5f44055a70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f5f48000f70 tx=0x7f5f48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.260+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f50042300 con 0x7f5f6013c120 2021-11-15T14:43:44.371 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5f600b0190 con 0x7f5f6013c120 2021-11-15T14:43:44.372 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f577fe700 1 -- 172.21.2.135:0/1362901983 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5f50018030 con 0x7f5f6013c120 2021-11-15T14:43:44.372 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:44.373 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:43:44.373 INFO:teuthology.orchestra.run.gibba035.stdout: "auth_dump": [ 2021-11-15T14:43:44.373 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.373 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.a", 2021-11-15T14:43:44.374 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhdjDEBBAAKl2m92XuJqFOybL+7crhKg==", 2021-11-15T14:43:44.374 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.374 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:44.374 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.375 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.375 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.375 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.375 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.375 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.376 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.b", 2021-11-15T14:43:44.376 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhMOCeDBAAEPXk5oqWOdl+b68ylVMwTA==", 2021-11-15T14:43:44.376 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.376 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:44.377 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.377 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.377 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.377 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.377 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.378 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.378 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mds.c", 2021-11-15T14:43:44.378 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4+H8CRAAxWMKp5Cx99dhtHzu7/VpwQ==", 2021-11-15T14:43:44.378 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.378 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:44.379 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.379 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.379 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.379 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.380 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.380 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.380 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.0", 2021-11-15T14:43:44.380 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDHb5Jhf/E2ABAA71tjJkQjtVbQvdepn42zTA==", 2021-11-15T14:43:44.381 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.381 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.382 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.382 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.382 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.382 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.383 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.383 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.1", 2021-11-15T14:43:44.383 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDJb5JhIdDUHRAAnOogc34ooBdSYDzbMpy6iQ==", 2021-11-15T14:43:44.383 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.383 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.384 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.384 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.384 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.384 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.384 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.385 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.2", 2021-11-15T14:43:44.385 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDMb5JhGR2VAhAAFGW5O60Hc76ArJjAFTGXGw==", 2021-11-15T14:43:44.385 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.385 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.386 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.386 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.386 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.386 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.386 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.387 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.3", 2021-11-15T14:43:44.387 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDOb5JhCaT5HxAAezjysfIhjVtxUk0q2My+BA==", 2021-11-15T14:43:44.387 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.387 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.388 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.388 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.388 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.388 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.388 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.389 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.4", 2021-11-15T14:43:44.389 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDRb5Jh7Um2KRAALc4VjeU4aW5hd/+brbGJSg==", 2021-11-15T14:43:44.389 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.389 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.390 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.390 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.390 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.390 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.391 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.391 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.5", 2021-11-15T14:43:44.391 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDUb5JhG1v0DhAAZqvVtoa0zKQXQvll6hvTuA==", 2021-11-15T14:43:44.391 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.391 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.392 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.392 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.392 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.392 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.393 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.393 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.6", 2021-11-15T14:43:44.393 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDWb5JhtGqQLxAA/qATOvYpbNm0s1KRjsiKDA==", 2021-11-15T14:43:44.393 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.393 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.394 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.394 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.394 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.394 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.394 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.395 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "osd.7", 2021-11-15T14:43:44.395 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDZb5JhIvZNFBAAONBx4XA5wS/+hPU0UgiSlw==", 2021-11-15T14:43:44.395 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.395 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.396 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.396 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.396 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.396 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.396 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.397 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.0", 2021-11-15T14:43:44.397 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5Jh4tWJDxAAm9uvfVtHp2wjohpFtqhzVg==", 2021-11-15T14:43:44.397 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.397 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:44.397 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:43:44.398 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:43:44.398 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.398 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.398 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.399 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.1", 2021-11-15T14:43:44.399 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhSarDEhAAxBWI5JXGj2Ou4Z9zvhllWA==", 2021-11-15T14:43:44.399 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.399 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow", 2021-11-15T14:43:44.399 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow r", 2021-11-15T14:43:44.400 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-15T14:43:44.400 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.400 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.400 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.401 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "client.admin", 2021-11-15T14:43:44.401 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDFb5Jhr5sFKhAA+CTs0wSCtUE1fCebSuvHnA==", 2021-11-15T14:43:44.401 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.401 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:44.401 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr": "allow *", 2021-11-15T14:43:44.402 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow *", 2021-11-15T14:43:44.402 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.402 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.402 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.402 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.403 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.x", 2021-11-15T14:43:44.403 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhS0C0AhAALCFuYt88EghIj2MgvdWjGQ==", 2021-11-15T14:43:44.403 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.403 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:44.404 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:43:44.404 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.404 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.404 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:44.404 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:44.405 INFO:teuthology.orchestra.run.gibba035.stdout: "entity": "mgr.y", 2021-11-15T14:43:44.405 INFO:teuthology.orchestra.run.gibba035.stdout: "key": "AQDGb5JhyZIMABAA9PvtflHGl1oioXy55MJ/MA==", 2021-11-15T14:43:44.405 INFO:teuthology.orchestra.run.gibba035.stdout: "caps": { 2021-11-15T14:43:44.405 INFO:teuthology.orchestra.run.gibba035.stdout: "mds": "allow *", 2021-11-15T14:43:44.405 INFO:teuthology.orchestra.run.gibba035.stdout: "mon": "allow profile mgr", 2021-11-15T14:43:44.406 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": "allow *" 2021-11-15T14:43:44.406 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.406 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:44.406 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:43:44.407 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:43:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 msgr2=0x7f5f44055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 0x7f5f44055a70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f5f48000f70 tx=0x7f5f48015000).stop 2021-11-15T14:43:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 msgr2=0x7f5f6013c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f5f600b1500 tx=0x7f5f50006db0).stop 2021-11-15T14:43:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 shutdown_connections 2021-11-15T14:43:44.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5f440535b0 0x7f5f44055a70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5f600ab810 0x7f5f600abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5f6013c120 0x7f5f6013c580 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 --2- 172.21.2.135:0/1362901983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5f40003750 0x7f5f600b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 >> 172.21.2.135:0/1362901983 conn(0x7f5f6005cfb0 msgr2=0x7f5f600ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 shutdown_connections 2021-11-15T14:43:44.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.368+0000 7f5f64b3e700 1 -- 172.21.2.135:0/1362901983 wait complete. 2021-11-15T14:43:44.411 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:44.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 Processor -- start 2021-11-15T14:43:44.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 -- start start 2021-11-15T14:43:44.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b0900 0x7fdd0c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0b2b70 con 0x7fdd0c0aa1a0 2021-11-15T14:43:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0b27f0 con 0x7fdd0c0b0520 2021-11-15T14:43:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd10d0e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b2da0 con 0x7fdd0c0b0900 2021-11-15T14:43:44.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fdd0c0b0520 0x7fdd0c0addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52228/0 (socket says 172.21.2.135:52228) 2021-11-15T14:43:44.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0a59c700 1 -- 172.21.2.135:0/3096085808 learned_addr learned my addr 172.21.2.135:0/3096085808 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619487178 0 0) 0x7fdd0c0b27f0 con 0x7fdd0c0b0520 2021-11-15T14:43:44.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcec003260 con 0x7fdd0c0b0520 2021-11-15T14:43:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260918991 0 0) 0x7fdcec003260 con 0x7fdd0c0b0520 2021-11-15T14:43:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b0900 msgr2=0x7fdd0c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 --2- 172.21.2.135:0/3096085808 >> v2:172.21.2.119:3300/0 conn(0x7fdd0c0b0900 0x7fdd0c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 >> v1:172.21.2.119:6789/0 conn(0x7fdd0c0aa1a0 legacy=0x7fdd0c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0a9bf0 con 0x7fdd0c0b0520 2021-11-15T14:43:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fdcfc001660 con 0x7fdd0c0b0520 2021-11-15T14:43:44.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 >> v1:172.21.2.135:6789/0 conn(0x7fdd0c0b0520 legacy=0x7fdd0c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdcec003750 0x7fdcec003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdcec004500 0x7fdcec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdcec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b2da0 con 0x7fdcec004500 2021-11-15T14:43:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00be80 con 0x7fdcec004f90 2021-11-15T14:43:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec00c040 con 0x7fdcec003750 2021-11-15T14:43:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.460+0000 7fdd0ad9d700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdcec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 -- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdcec003750 msgr2=0x7fdcec003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdcec003750 0x7fdcec003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 -- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdcec004500 msgr2=0x7fdcec004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdcec004500 0x7fdcec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 -- 172.21.2.135:0/3096085808 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec003260 con 0x7fdcec004f90 2021-11-15T14:43:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 -- 172.21.2.135:0/3096085808 reap_dead start 2021-11-15T14:43:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0ad9d700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdcec00b750 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7fdd040032f0 tx=0x7fdd04006f90).ready entity=mon.1 client_cookie=1602646c9614e517 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd04011400 con 0x7fdcec004f90 2021-11-15T14:43:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd04011560 con 0x7fdcec004f90 2021-11-15T14:43:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0959a700 1 -- 172.21.2.135:0/3096085808 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd040116d0 con 0x7fdcec004f90 2021-11-15T14:43:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 msgr2=0x7fdcec00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdcec00b750 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7fdd040032f0 tx=0x7fdd04006f90).stop 2021-11-15T14:43:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/3096085808 shutdown_connections 2021-11-15T14:43:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/3096085808 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdcec00b750 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/3096085808 >> 172.21.2.135:0/3096085808 conn(0x7fdd0c060840 msgr2=0x7fdd0c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/3096085808 shutdown_connections 2021-11-15T14:43:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/3096085808 wait complete. 2021-11-15T14:43:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 Processor -- start 2021-11-15T14:43:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- start start 2021-11-15T14:43:44.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c060420 0x7fdd0c157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c156a30 con 0x7fdd0c060420 2021-11-15T14:43:44.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c138cc0 con 0x7fdcec004f90 2021-11-15T14:43:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c157a60 con 0x7fdd0c0a7140 2021-11-15T14:43:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36420/0 (socket says 172.21.2.135:36420) 2021-11-15T14:43:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 -- 172.21.2.135:0/4216966081 learned_addr learned my addr 172.21.2.135:0/4216966081 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 -- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 msgr2=0x7fdd0c157570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:44.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c157570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 -- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c060420 msgr2=0x7fdd0c157080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:44.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c060420 0x7fdd0c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 -- 172.21.2.135:0/4216966081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c156c20 con 0x7fdcec004f90 2021-11-15T14:43:44.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd0a59c700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fdd0c157ba0 tx=0x7fdd0c0b2980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc007170 con 0x7fdcec004f90 2021-11-15T14:43:44.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc0072d0 con 0x7fdcec004f90 2021-11-15T14:43:44.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc004920 con 0x7fdcec004f90 2021-11-15T14:43:44.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c138a20 con 0x7fdcec004f90 2021-11-15T14:43:44.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.464+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c0a9680 con 0x7fdcec004f90 2021-11-15T14:43:44.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c0573d0 con 0x7fdcec004f90 2021-11-15T14:43:44.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdcfc004a80 con 0x7fdcec004f90 2021-11-15T14:43:44.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd037fe700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 0x7fdcf0055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fdcfc06b3b0 con 0x7fdcec004f90 2021-11-15T14:43:44.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd09d9b700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 0x7fdcf0055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd09d9b700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 0x7fdcf0055a30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fdcf4000f70 tx=0x7fdcf40069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.468+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdcfc0425e0 con 0x7fdcec004f90 2021-11-15T14:43:44.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0c156db0 con 0x7fdcec004f90 2021-11-15T14:43:44.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd037fe700 1 -- 172.21.2.135:0/4216966081 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fdcfc045c00 con 0x7fdcec004f90 2021-11-15T14:43:44.558 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:44.558 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":160,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:44.079743+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:44.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 msgr2=0x7fdcf0055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 0x7fdcf0055a30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fdcf4000f70 tx=0x7fdcf40069b0).stop 2021-11-15T14:43:44.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 msgr2=0x7fdd0c0b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fdd0c157ba0 tx=0x7fdd0c0b2980).stop 2021-11-15T14:43:44.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 shutdown_connections 2021-11-15T14:43:44.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fdcf0053570 0x7fdcf0055a30 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fdd0c0a7140 0x7fdd0c157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fdd0c060420 0x7fdd0c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 --2- 172.21.2.135:0/4216966081 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fdcec004f90 0x7fdd0c0b49d0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.561 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 >> 172.21.2.135:0/4216966081 conn(0x7fdd0c060840 msgr2=0x7fdd0c0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.552+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 shutdown_connections 2021-11-15T14:43:44.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.556+0000 7fdd10d0e700 1 -- 172.21.2.135:0/4216966081 wait complete. 2021-11-15T14:43:44.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-15T14:43:44.565 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:44.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 Processor -- start 2021-11-15T14:43:44.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- start start 2021-11-15T14:43:44.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8e000b1f40 0x7f8e000b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8e000b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000b04a0 con 0x7f8e000a7140 2021-11-15T14:43:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000b2810 con 0x7f8e000b1f40 2021-11-15T14:43:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b06d0 con 0x7f8e000b0030 2021-11-15T14:43:44.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8e000a7140 0x7f8e001412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52250/0 (socket says 172.21.2.135:52250) 2021-11-15T14:43:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfed9d700 1 -- 172.21.2.135:0/1504721850 learned_addr learned my addr 172.21.2.135:0/1504721850 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494949187 0 0) 0x7f8e000b04a0 con 0x7f8e000a7140 2021-11-15T14:43:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de4003260 con 0x7f8e000a7140 2021-11-15T14:43:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> v2:172.21.2.119:3300/0 conn(0x7f8e000b1f40 0x7f8e000b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfdd9b700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8e000b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351829321 0 0) 0x7f8de4003260 con 0x7f8e000a7140 2021-11-15T14:43:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 msgr2=0x7f8e000b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8e000b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 >> v2:172.21.2.119:3300/0 conn(0x7f8e000b1f40 msgr2=0x7f8e000b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 --2- 172.21.2.135:0/1504721850 >> v2:172.21.2.119:3300/0 conn(0x7f8e000b1f40 0x7f8e000b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000b0970 con 0x7f8e000a7140 2021-11-15T14:43:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f8df80019e0 con 0x7f8e000a7140 2021-11-15T14:43:44.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 >> v1:172.21.2.135:6789/0 conn(0x7f8e000a7140 legacy=0x7f8e001412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8de40037d0 0x7f8de4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8de4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8de4004bf0 0x7f8de400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b2810 con 0x7f8de4004bf0 2021-11-15T14:43:44.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b06d0 con 0x7f8de40037d0 2021-11-15T14:43:44.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de4005330 con 0x7f8e000b0030 2021-11-15T14:43:44.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> v2:172.21.2.119:3300/0 conn(0x7f8e000b1f40 0x7f8e000b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:44.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8de40037d0 0x7f8de4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfed9d700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8de4004bf0 0x7f8de400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfdd9b700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8de4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 -- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 msgr2=0x7f8de4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e000b0030 0x7f8de4004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 -- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8de4004bf0 msgr2=0x7f8de400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8de4004bf0 0x7f8de400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.629 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 -- 172.21.2.135:0/1504721850 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4003260 con 0x7f8de40037d0 2021-11-15T14:43:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8de40037d0 0x7f8de4003bf0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f8df0007000 tx=0x7f8df0008040).ready entity=mon.1 client_cookie=67e3a07f82ef562a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0015070 con 0x7f8de40037d0 2021-11-15T14:43:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0011410 con 0x7f8de40037d0 2021-11-15T14:43:44.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfd59a700 1 -- 172.21.2.135:0/1504721850 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0011770 con 0x7f8de40037d0 2021-11-15T14:43:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- 172.21.2.135:0/1504721850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8de40037d0 msgr2=0x7f8de4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 --2- 172.21.2.135:0/1504721850 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8de40037d0 0x7f8de4003bf0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f8df0007000 tx=0x7f8df0008040).stop 2021-11-15T14:43:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8dfed9d700 1 -- 172.21.2.135:0/1504721850 reap_dead start 2021-11-15T14:43:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- 172.21.2.135:0/1504721850 shutdown_connections 2021-11-15T14:43:44.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- 172.21.2.135:0/1504721850 >> 172.21.2.135:0/1504721850 conn(0x7f8e0005f730 msgr2=0x7f8e0005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- 172.21.2.135:0/1504721850 shutdown_connections 2021-11-15T14:43:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- 172.21.2.135:0/1504721850 wait complete. 2021-11-15T14:43:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 Processor -- start 2021-11-15T14:43:44.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.616+0000 7f8e04955700 1 -- start start 2021-11-15T14:43:44.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8de40037d0 0x7f8e000ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0013bd10 0x7f8e00149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0014a7b0 con 0x7f8e0013bd10 2021-11-15T14:43:44.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0014aa50 con 0x7f8e0014b230 2021-11-15T14:43:44.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0014acf0 con 0x7f8de40037d0 2021-11-15T14:43:44.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36442/0 (socket says 172.21.2.135:36442) 2021-11-15T14:43:44.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 -- 172.21.2.135:0/2038126543 learned_addr learned my addr 172.21.2.135:0/2038126543 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 -- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8de40037d0 msgr2=0x7f8e000ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8de40037d0 0x7f8e000ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 -- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0013bd10 msgr2=0x7f8e00149050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:44.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0013bd10 0x7f8e00149050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 -- 172.21.2.135:0/2038126543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00148bb0 con 0x7f8e0014b230 2021-11-15T14:43:44.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfdd9b700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f8df4008000 tx=0x7f8df4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df4016070 con 0x7f8e0014b230 2021-11-15T14:43:44.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4000e90 con 0x7f8e0014b230 2021-11-15T14:43:44.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df40117e0 con 0x7f8e0014b230 2021-11-15T14:43:44.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e000b3270 con 0x7f8e0014b230 2021-11-15T14:43:44.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0013c190 con 0x7f8e0014b230 2021-11-15T14:43:44.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e000b6480 con 0x7f8e0014b230 2021-11-15T14:43:44.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8df4011a00 con 0x7f8e0014b230 2021-11-15T14:43:44.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 0x7f8ddc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f8df406b830 con 0x7f8e0014b230 2021-11-15T14:43:44.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 0x7f8ddc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.620+0000 7f8dfe59c700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 0x7f8ddc055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8df0007000 tx=0x7f8df0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.624+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8df4042b10 con 0x7f8e0014b230 2021-11-15T14:43:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8e000b0c10 con 0x7f8e0014b230 2021-11-15T14:43:44.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8def7fe700 1 -- 172.21.2.135:0/2038126543 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v160) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8df4046130 con 0x7f8e0014b230 2021-11-15T14:43:44.712 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:44.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 msgr2=0x7f8ddc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 0x7f8ddc055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8df0007000 tx=0x7f8df0008040).stop 2021-11-15T14:43:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 msgr2=0x7f8e0013b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f8df4008000 tx=0x7f8df4008040).stop 2021-11-15T14:43:44.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 shutdown_connections 2021-11-15T14:43:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8ddc053610 0x7f8ddc055ad0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0013bd10 0x7f8e00149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0014b230 0x7f8e0013b820 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 --2- 172.21.2.135:0/2038126543 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8de40037d0 0x7f8e000ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 >> 172.21.2.135:0/2038126543 conn(0x7f8e0005f730 msgr2=0x7f8e0013cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 shutdown_connections 2021-11-15T14:43:44.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.708+0000 7f8e04955700 1 -- 172.21.2.135:0/2038126543 wait complete. 2021-11-15T14:43:44.719 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 Processor -- start 2021-11-15T14:43:44.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 -- start start 2021-11-15T14:43:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1350 0x7f99040b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f99040b2320 0x7f99041412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99040a7850 con 0x7f99040b1f40 2021-11-15T14:43:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99040b17c0 con 0x7f99040b2320 2021-11-15T14:43:44.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990be09700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99040b06d0 con 0x7f99040b1350 2021-11-15T14:43:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f9909ba5700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f99040b1f40 0x7f99040a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52268/0 (socket says 172.21.2.135:52268) 2021-11-15T14:43:44.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f9909ba5700 1 -- 172.21.2.135:0/939941606 learned_addr learned my addr 172.21.2.135:0/939941606 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 --2- 172.21.2.135:0/939941606 >> v2:172.21.2.135:3300/0 conn(0x7f99040b2320 0x7f99041412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 -- 172.21.2.135:0/939941606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1350 msgr2=0x7f99040b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 --2- 172.21.2.135:0/939941606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1350 0x7f99040b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 -- 172.21.2.135:0/939941606 >> v1:172.21.2.135:6789/0 conn(0x7f99040b1f40 legacy=0x7f99040a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 -- 172.21.2.135:0/939941606 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040b0970 con 0x7f99040b2320 2021-11-15T14:43:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f990a3a6700 1 --2- 172.21.2.135:0/939941606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b2320 0x7f99041412d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f98fc0032f0 tx=0x7f98fc0091d0).ready entity=mon.1 client_cookie=1360c4fb9ec5f8ba server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.783 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f9908ba3700 1 -- 172.21.2.135:0/939941606 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98fc009ea0 con 0x7f99040b2320 2021-11-15T14:43:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f9908ba3700 1 -- 172.21.2.135:0/939941606 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00b8a0 con 0x7f99040b2320 2021-11-15T14:43:44.784 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.768+0000 7f9908ba3700 1 -- 172.21.2.135:0/939941606 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98fc00ba10 con 0x7f99040b2320 2021-11-15T14:43:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/939941606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b2320 msgr2=0x7f99041412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- 172.21.2.135:0/939941606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b2320 0x7f99041412d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f98fc0032f0 tx=0x7f98fc0091d0).stop 2021-11-15T14:43:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/939941606 shutdown_connections 2021-11-15T14:43:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- 172.21.2.135:0/939941606 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b2320 0x7f99041412d0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- 172.21.2.135:0/939941606 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1350 0x7f99040b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/939941606 >> 172.21.2.135:0/939941606 conn(0x7f990405f730 msgr2=0x7f990405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/939941606 shutdown_connections 2021-11-15T14:43:44.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/939941606 wait complete. 2021-11-15T14:43:44.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 Processor -- start 2021-11-15T14:43:44.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- start start 2021-11-15T14:43:44.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1f40 0x7f99040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99040b2320 0x7f9904139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.790 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904145250 con 0x7f99040b2320 2021-11-15T14:43:44.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904145480 con 0x7f99040b1350 2021-11-15T14:43:44.791 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9904145720 con 0x7f99040b1f40 2021-11-15T14:43:44.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.792 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36454/0 (socket says 172.21.2.135:36454) 2021-11-15T14:43:44.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 -- 172.21.2.135:0/3199951982 learned_addr learned my addr 172.21.2.135:0/3199951982 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.793 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 -- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1f40 msgr2=0x7f99040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1f40 0x7f99040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 -- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99040b2320 msgr2=0x7f9904139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.794 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99040b2320 0x7f9904139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 -- 172.21.2.135:0/3199951982 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009470 con 0x7f99040b1350 2021-11-15T14:43:44.795 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f9909ba5700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f99040b4ce0 tx=0x7f98f4007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f400ce20 con 0x7f99040b1350 2021-11-15T14:43:44.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f40072e0 con 0x7f99040b1350 2021-11-15T14:43:44.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99041459c0 con 0x7f99040b1350 2021-11-15T14:43:44.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f4005800 con 0x7f99040b1350 2021-11-15T14:43:44.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99040ac300 con 0x7f99040b1350 2021-11-15T14:43:44.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904145b50 con 0x7f99040b1350 2021-11-15T14:43:44.798 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98f4010070 con 0x7f99040b1350 2021-11-15T14:43:44.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 0x7f98e4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.772+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f98f406ae70 con 0x7f99040b1350 2021-11-15T14:43:44.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.776+0000 7f99093a4700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 0x7f98e4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.776+0000 7f99093a4700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 0x7f98e4055be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9900002f70 tx=0x7f9900006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.776+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98f40420a0 con 0x7f99040b1350 2021-11-15T14:43:44.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99040573d0 con 0x7f99040b1350 2021-11-15T14:43:44.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f98f2ffd700 1 -- 172.21.2.135:0/3199951982 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98f40456c0 con 0x7f99040b1350 2021-11-15T14:43:44.864 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:44.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 msgr2=0x7f98e4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 0x7f98e4055be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f9900002f70 tx=0x7f9900006a80).stop 2021-11-15T14:43:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 msgr2=0x7f99040ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f99040b4ce0 tx=0x7f98f4007c00).stop 2021-11-15T14:43:44.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 shutdown_connections 2021-11-15T14:43:44.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98e4053720 0x7f98e4055be0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f99040b2320 0x7f9904139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f99040b1f40 0x7f99040aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 --2- 172.21.2.135:0/3199951982 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f99040b1350 0x7f99040ab560 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 >> 172.21.2.135:0/3199951982 conn(0x7f990405f730 msgr2=0x7f99040a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 shutdown_connections 2021-11-15T14:43:44.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.860+0000 7f990be09700 1 -- 172.21.2.135:0/3199951982 wait complete. 2021-11-15T14:43:44.871 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-15T14:43:44.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.916+0000 7fcaaae5a700 1 Processor -- start 2021-11-15T14:43:44.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.916+0000 7fcaaae5a700 1 -- start start 2021-11-15T14:43:44.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fcaa4148420 0x7fcaa40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcaa40a7140 0x7fcaa41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40b03d0 con 0x7fcaa40b1e30 2021-11-15T14:43:44.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40a9140 con 0x7fcaa4148420 2021-11-15T14:43:44.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40b0670 con 0x7fcaa40a7140 2021-11-15T14:43:44.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcaa40a7140 0x7fcaa41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcaa40a7140 0x7fcaa41447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36464/0 (socket says 172.21.2.135:36464) 2021-11-15T14:43:44.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 -- 172.21.2.135:0/4283184269 learned_addr learned my addr 172.21.2.135:0/4283184269 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 -- 172.21.2.135:0/4283184269 >> v2:172.21.2.119:3300/0 conn(0x7fcaa4148420 msgr2=0x7fcaa40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 --2- 172.21.2.135:0/4283184269 >> v2:172.21.2.119:3300/0 conn(0x7fcaa4148420 0x7fcaa40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 -- 172.21.2.135:0/4283184269 >> v1:172.21.2.119:6789/0 conn(0x7fcaa40b1e30 legacy=0x7fcaa40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:44.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 -- 172.21.2.135:0/4283184269 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40b0910 con 0x7fcaa40a7140 2021-11-15T14:43:44.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa93f7700 1 --2- 172.21.2.135:0/4283184269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa41447a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fcaa40acee0 tx=0x7fca94006eb0).ready entity=mon.1 client_cookie=47f9b6059654be84 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa37fe700 1 -- 172.21.2.135:0/4283184269 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9400d5c0 con 0x7fcaa40a7140 2021-11-15T14:43:44.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa37fe700 1 -- 172.21.2.135:0/4283184269 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94000e90 con 0x7fcaa40a7140 2021-11-15T14:43:44.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa37fe700 1 -- 172.21.2.135:0/4283184269 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9400d950 con 0x7fcaa40a7140 2021-11-15T14:43:44.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/4283184269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 msgr2=0x7fcaa41447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/4283184269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa41447a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fcaa40acee0 tx=0x7fca94006eb0).stop 2021-11-15T14:43:44.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/4283184269 shutdown_connections 2021-11-15T14:43:44.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/4283184269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa41447a0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:44.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/4283184269 >> v2:172.21.2.119:3300/0 conn(0x7fcaa4148420 0x7fcaa40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/4283184269 >> 172.21.2.135:0/4283184269 conn(0x7fcaa405f730 msgr2=0x7fcaa405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:44.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/4283184269 shutdown_connections 2021-11-15T14:43:44.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/4283184269 wait complete. 2021-11-15T14:43:44.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 Processor -- start 2021-11-15T14:43:44.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- start start 2021-11-15T14:43:44.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa40b1e30 0x7fcaa40ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa4148420 0x7fcaa40aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40ae2f0 con 0x7fcaa4148420 2021-11-15T14:43:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40aedf0 con 0x7fcaa40a7140 2021-11-15T14:43:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40aae50 con 0x7fcaa40b1e30 2021-11-15T14:43:44.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36468/0 (socket says 172.21.2.135:36468) 2021-11-15T14:43:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 -- 172.21.2.135:0/2811497660 learned_addr learned my addr 172.21.2.135:0/2811497660 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 -- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa40b1e30 msgr2=0x7fcaa40ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa40b1e30 0x7fcaa40ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 -- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa4148420 msgr2=0x7fcaa40aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:44.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa4148420 0x7fcaa40aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:44.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 -- 172.21.2.135:0/2811497660 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9400b1e0 con 0x7fcaa40a7140 2021-11-15T14:43:44.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa8bf6700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fcaa40aa440 tx=0x7fca9c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c0016f0 con 0x7fcaa40a7140 2021-11-15T14:43:44.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c001850 con 0x7fcaa40a7140 2021-11-15T14:43:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c001bb0 con 0x7fcaa40a7140 2021-11-15T14:43:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40ab0f0 con 0x7fcaa40a7140 2021-11-15T14:43:44.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.920+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa414aa20 con 0x7fcaa40a7140 2021-11-15T14:43:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40ab280 con 0x7fcaa40a7140 2021-11-15T14:43:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca9c018030 con 0x7fcaa40a7140 2021-11-15T14:43:44.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa1ffb700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 0x7fca88055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fca9c06b6b0 con 0x7fcaa40a7140 2021-11-15T14:43:44.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa3fff700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 0x7fca88055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa3fff700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 0x7fca88055bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fca8c002f70 tx=0x7fca8c0069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:44.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:44.924+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca9c041e90 con 0x7fcaa40a7140 2021-11-15T14:43:45.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.008+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcaa40b0bb0 con 0x7fcaa40a7140 2021-11-15T14:43:45.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.008+0000 7fcaa1ffb700 1 -- 172.21.2.135:0/2811497660 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v160) v1 ==== 84+0+143 (secure 0 0 0) 0x7fca9c042990 con 0x7fcaa40a7140 2021-11-15T14:43:45.013 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:45.014 INFO:teuthology.orchestra.run.gibba035.stdout:[ 2021-11-15T14:43:45.014 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:45.014 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 1, 2021-11-15T14:43:45.015 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "device_health_metrics" 2021-11-15T14:43:45.015 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:43:45.015 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:43:45.015 INFO:teuthology.orchestra.run.gibba035.stdout: "poolnum": 2, 2021-11-15T14:43:45.016 INFO:teuthology.orchestra.run.gibba035.stdout: "poolname": "rbd" 2021-11-15T14:43:45.016 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:43:45.016 INFO:teuthology.orchestra.run.gibba035.stdout:] 2021-11-15T14:43:45.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 msgr2=0x7fca88055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:45.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 0x7fca88055bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fca8c002f70 tx=0x7fca8c0069f0).stop 2021-11-15T14:43:45.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 msgr2=0x7fcaa40af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:45.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fcaa40aa440 tx=0x7fca9c0091d0).stop 2021-11-15T14:43:45.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 shutdown_connections 2021-11-15T14:43:45.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fca880536f0 0x7fca88055bb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcaa4148420 0x7fcaa40aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:45.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcaa40b1e30 0x7fcaa40ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:45.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 --2- 172.21.2.135:0/2811497660 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcaa40a7140 0x7fcaa40af6a0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 >> 172.21.2.135:0/2811497660 conn(0x7fcaa405f730 msgr2=0x7fcaa40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:45.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 shutdown_connections 2021-11-15T14:43:45.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.012+0000 7fcaaae5a700 1 -- 172.21.2.135:0/2811497660 wait complete. 2021-11-15T14:43:45.021 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-15T14:43:45.021 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-15T14:43:45.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 Processor -- start 2021-11-15T14:43:45.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- start start 2021-11-15T14:43:45.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 0x7f4c9c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c0b3790 0x7f4c9c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c9c13dac0 0x7f4c9c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c1439a0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c143c40 con 0x7f4c9c13dac0 2021-11-15T14:43:45.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c143ee0 con 0x7f4c9c0b3790 2021-11-15T14:43:45.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c9c13dac0 0x7f4c9c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:45.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f4c9c13dac0 0x7f4c9c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36480/0 (socket says 172.21.2.135:36480) 2021-11-15T14:43:45.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 -- 172.21.2.135:0/71385027 learned_addr learned my addr 172.21.2.135:0/71385027 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:45.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9affd700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c0b3790 0x7f4c9c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:45.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9b7fe700 1 --2- 172.21.2.135:0/71385027 >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 0x7f4c9c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:45.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 -- 172.21.2.135:0/71385027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c0b3790 msgr2=0x7f4c9c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:45.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c0b3790 0x7f4c9c13d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 -- 172.21.2.135:0/71385027 >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 msgr2=0x7f4c9c0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:45.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 --2- 172.21.2.135:0/71385027 >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 0x7f4c9c0b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 -- 172.21.2.135:0/71385027 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c144180 con 0x7f4c9c13dac0 2021-11-15T14:43:45.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9b7fe700 1 --2- 172.21.2.135:0/71385027 >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 0x7f4c9c0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-15T14:43:45.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9bfff700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c13dac0 0x7f4c9c0b1130 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f4c8c002f70 tx=0x7f4c8c006eb0).ready entity=mon.1 client_cookie=390083b1bd8ae539 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:45.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9a7fc700 1 -- 172.21.2.135:0/71385027 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8c00d570 con 0x7f4c9c13dac0 2021-11-15T14:43:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9a7fc700 1 -- 172.21.2.135:0/71385027 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c000e90 con 0x7f4c9c13dac0 2021-11-15T14:43:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4c9a7fc700 1 -- 172.21.2.135:0/71385027 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8c00d900 con 0x7f4c9c13dac0 2021-11-15T14:43:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/71385027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c13dac0 msgr2=0x7f4c9c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:45.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c13dac0 0x7f4c9c0b1130 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f4c8c002f70 tx=0x7f4c8c006eb0).stop 2021-11-15T14:43:45.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/71385027 shutdown_connections 2021-11-15T14:43:45.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c13dac0 0x7f4c9c0b1130 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/71385027 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c0b3790 0x7f4c9c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.083 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/71385027 >> v2:172.21.2.119:3300/0 conn(0x7f4c9c0b0630 0x7f4c9c0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:45.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/71385027 >> 172.21.2.135:0/71385027 conn(0x7f4c9c060840 msgr2=0x7f4c9c060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:45.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/71385027 shutdown_connections 2021-11-15T14:43:45.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/71385027 wait complete. 2021-11-15T14:43:45.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 Processor -- start 2021-11-15T14:43:45.084 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- start start 2021-11-15T14:43:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c9c0b3790 0x7f4c9c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c13dac0 0x7f4c9c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0ae4b0 con 0x7f4c9c0b3790 2021-11-15T14:43:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1534c0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.072+0000 7f4ca1b4b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0aadb0 con 0x7f4c9c13dac0 2021-11-15T14:43:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:45.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36482/0 (socket says 172.21.2.135:36482) 2021-11-15T14:43:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 -- 172.21.2.135:0/3849588237 learned_addr learned my addr 172.21.2.135:0/3849588237 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:45.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 -- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c13dac0 msgr2=0x7f4c9c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c13dac0 0x7f4c9c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 -- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c9c0b3790 msgr2=0x7f4c9c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:45.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c9c0b3790 0x7f4c9c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:45.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 -- 172.21.2.135:0/3849588237 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c00b1e0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9b7fe700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f4c94006cc0 tx=0x7f4c94008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:45.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9400c7d0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9400c930 con 0x7f4c9c0b0630 2021-11-15T14:43:45.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c0ab050 con 0x7f4c9c0b0630 2021-11-15T14:43:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c13e5c0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9400cc90 con 0x7f4c9c0b0630 2021-11-15T14:43:45.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74003410 con 0x7f4c9c0b0630 2021-11-15T14:43:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c9401d460 con 0x7f4c9c0b0630 2021-11-15T14:43:45.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 0x7f4c7c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f4c9406be00 con 0x7f4c9c0b0630 2021-11-15T14:43:45.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9affd700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 0x7f4c7c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.076+0000 7f4c9affd700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 0x7f4c7c055a30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f4c9000e000 tx=0x7f4c90006e80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:45.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.080+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c94042fd0 con 0x7f4c9c0b0630 2021-11-15T14:43:45.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:45.164+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4c74003c40 con 0x7f4c9c0b0630 2021-11-15T14:43:46.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4c98ff9700 1 -- 172.21.2.135:0/3849588237 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v161) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4c940465f0 con 0x7f4c9c0b0630 2021-11-15T14:43:46.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 msgr2=0x7f4c7c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 0x7f4c7c055a30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f4c9000e000 tx=0x7f4c90006e80).stop 2021-11-15T14:43:46.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 msgr2=0x7f4c9c13e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f4c94006cc0 tx=0x7f4c94008040).stop 2021-11-15T14:43:46.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 shutdown_connections 2021-11-15T14:43:46.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f4c7c053570 0x7f4c7c055a30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:46.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4c9c13dac0 0x7f4c9c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:46.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f4c9c0b3790 0x7f4c9c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:46.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 --2- 172.21.2.135:0/3849588237 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4c9c0b0630 0x7f4c9c13e0d0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:46.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 >> 172.21.2.135:0/3849588237 conn(0x7f4c9c060840 msgr2=0x7f4c9c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:46.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 shutdown_connections 2021-11-15T14:43:46.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.052+0000 7f4ca1b4b700 1 -- 172.21.2.135:0/3849588237 wait complete. 2021-11-15T14:43:46.060 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' created 2021-11-15T14:43:46.064 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-15T14:43:46.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 Processor -- start 2021-11-15T14:43:46.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 -- start start 2021-11-15T14:43:46.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 0x7f7b8c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7b8c0b5ad0 0x7f7b8c13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c0aebe0 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0aee80 con 0x7f7b8c0b5ad0 2021-11-15T14:43:46.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b944a3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0af120 con 0x7f7b8c0afb70 2021-11-15T14:43:46.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9223f700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f7b8c05d7e0 0x7f7b8c13f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52310/0 (socket says 172.21.2.135:52310) 2021-11-15T14:43:46.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9223f700 1 -- 172.21.2.135:0/3311198575 learned_addr learned my addr 172.21.2.135:0/3311198575 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:46.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784967174 0 0) 0x7f7b8c0aebe0 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b91a3e700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 0x7f7b8c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b74003260 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b92a40700 1 --2- 172.21.2.135:0/3311198575 >> v2:172.21.2.119:3300/0 conn(0x7f7b8c0b5ad0 0x7f7b8c13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477050 0 0) 0x7f7b74003260 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 msgr2=0x7f7b8c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:46.125 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 0x7f7b8c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:46.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 >> v2:172.21.2.119:3300/0 conn(0x7f7b8c0b5ad0 msgr2=0x7f7b8c13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:46.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 --2- 172.21.2.135:0/3311198575 >> v2:172.21.2.119:3300/0 conn(0x7f7b8c0b5ad0 0x7f7b8c13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:46.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0af3c0 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.126 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f7b88001660 con 0x7f7b8c05d7e0 2021-11-15T14:43:46.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 >> v1:172.21.2.135:6789/0 conn(0x7f7b8c05d7e0 legacy=0x7f7b8c13f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b74003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b74004500 0x7f7b74004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 0x7f7b74004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0aee80 con 0x7f7b74004500 2021-11-15T14:43:46.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0af120 con 0x7f7b740037d0 2021-11-15T14:43:46.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7400b8d0 con 0x7f7b8c0afb70 2021-11-15T14:43:46.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.112+0000 7f7b9223f700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b74003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 msgr2=0x7f7b74004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:46.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c0afb70 0x7f7b74004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:46.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b74004500 msgr2=0x7f7b74004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:46.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b74004500 0x7f7b74004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:46.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/3311198575 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74003260 con 0x7f7b740037d0 2021-11-15T14:43:46.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b74003bf0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f7b88001370 tx=0x7f7b8c0b12f0).ready entity=mon.1 client_cookie=25693eafab8096e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:46.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b880070d0 con 0x7f7b740037d0 2021-11-15T14:43:46.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88007230 con 0x7f7b740037d0 2021-11-15T14:43:46.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9123d700 1 -- 172.21.2.135:0/3311198575 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b8800c8f0 con 0x7f7b740037d0 2021-11-15T14:43:46.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/3311198575 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 msgr2=0x7f7b74003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 --2- 172.21.2.135:0/3311198575 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b74003bf0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f7b88001370 tx=0x7f7b8c0b12f0).stop 2021-11-15T14:43:46.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b92a40700 1 -- 172.21.2.135:0/3311198575 reap_dead start 2021-11-15T14:43:46.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/3311198575 shutdown_connections 2021-11-15T14:43:46.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/3311198575 >> 172.21.2.135:0/3311198575 conn(0x7f7b8c05c510 msgr2=0x7f7b8c05c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:46.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/3311198575 shutdown_connections 2021-11-15T14:43:46.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/3311198575 wait complete. 2021-11-15T14:43:46.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 Processor -- start 2021-11-15T14:43:46.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- start start 2021-11-15T14:43:46.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c1406f0 0x7f7b8c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b8c156ea0 0x7f7b8c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c063cb0 con 0x7f7b8c156ea0 2021-11-15T14:43:46.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c141680 con 0x7f7b740037d0 2021-11-15T14:43:46.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c141920 con 0x7f7b8c1406f0 2021-11-15T14:43:46.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36506/0 (socket says 172.21.2.135:36506) 2021-11-15T14:43:46.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/1280954135 learned_addr learned my addr 172.21.2.135:0/1280954135 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:46.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c1406f0 msgr2=0x7f7b8c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c1406f0 0x7f7b8c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:46.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b92a40700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b8c156ea0 0x7f7b8c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b8c156ea0 msgr2=0x7f7b8c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:46.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b8c156ea0 0x7f7b8c157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:46.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 -- 172.21.2.135:0/1280954135 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c140c00 con 0x7f7b740037d0 2021-11-15T14:43:46.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b9223f700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f7b88001370 tx=0x7f7b88013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:46.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b88017070 con 0x7f7b740037d0 2021-11-15T14:43:46.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88004920 con 0x7f7b740037d0 2021-11-15T14:43:46.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c140ea0 con 0x7f7b740037d0 2021-11-15T14:43:46.137 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b88004c80 con 0x7f7b740037d0 2021-11-15T14:43:46.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c1403a0 con 0x7f7b740037d0 2021-11-15T14:43:46.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.116+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c0b5f00 con 0x7f7b740037d0 2021-11-15T14:43:46.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b88010070 con 0x7f7b740037d0 2021-11-15T14:43:46.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b7b7fe700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 0x7f7b6c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:46.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f7b8801a040 con 0x7f7b740037d0 2021-11-15T14:43:46.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b91a3e700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 0x7f7b6c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:46.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b91a3e700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 0x7f7b6c055a70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7b7c00a000 tx=0x7f7b7c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:46.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.120+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b880436d0 con 0x7f7b740037d0 2021-11-15T14:43:46.207 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:46.204+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7b8c0573d0 con 0x7f7b740037d0 2021-11-15T14:43:47.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b7b7fe700 1 -- 172.21.2.135:0/1280954135 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v162) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7b88046cf0 con 0x7f7b740037d0 2021-11-15T14:43:47.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 msgr2=0x7f7b6c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 0x7f7b6c055a70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f7b7c00a000 tx=0x7f7b7c008040).stop 2021-11-15T14:43:47.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 msgr2=0x7f7b8c13aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f7b88001370 tx=0x7f7b88013000).stop 2021-11-15T14:43:47.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 shutdown_connections 2021-11-15T14:43:47.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7b6c0535b0 0x7f7b6c055a70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b8c156ea0 0x7f7b8c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b8c1406f0 0x7f7b8c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 --2- 172.21.2.135:0/1280954135 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b740037d0 0x7f7b8c13aaa0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 >> 172.21.2.135:0/1280954135 conn(0x7f7b8c05c510 msgr2=0x7f7b8c13b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 shutdown_connections 2021-11-15T14:43:47.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.048+0000 7f7b944a3700 1 -- 172.21.2.135:0/1280954135 wait complete. 2021-11-15T14:43:47.056 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' created 2021-11-15T14:43:47.060 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-15T14:43:47.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 Processor -- start 2021-11-15T14:43:47.116 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 -- start start 2021-11-15T14:43:47.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff6740b0520 0x7ff6740addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6740ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.117 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740b2b70 con 0x7ff6740b0900 2021-11-15T14:43:47.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740b27f0 con 0x7ff6740b0520 2021-11-15T14:43:47.118 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff67999d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740b2da0 con 0x7ff6740aa1a0 2021-11-15T14:43:47.119 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff672ffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff6740b0520 0x7ff6740addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff6727fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6740ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff672ffd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7ff6740b0520 0x7ff6740addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:58556/0 (socket says 172.21.2.135:58556) 2021-11-15T14:43:47.120 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.112+0000 7ff672ffd700 1 -- 172.21.2.135:0/2468340443 learned_addr learned my addr 172.21.2.135:0/2468340443 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 -- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 msgr2=0x7ff6740ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 --2- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6740ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 -- 172.21.2.135:0/2468340443 >> v1:172.21.2.119:6789/0 conn(0x7ff6740b0900 legacy=0x7ff674143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.121 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 -- 172.21.2.135:0/2468340443 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740a9bf0 con 0x7ff6740b0520 2021-11-15T14:43:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 --2- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0520 0x7ff6740addb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff664002f70 tx=0x7ff664006eb0).ready entity=mon.0 client_cookie=a40543419af2aade server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff671ffb700 1 -- 172.21.2.135:0/2468340443 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66400d570 con 0x7ff6740b0520 2021-11-15T14:43:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff671ffb700 1 -- 172.21.2.135:0/2468340443 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664000e90 con 0x7ff6740b0520 2021-11-15T14:43:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff671ffb700 1 -- 172.21.2.135:0/2468340443 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66400d900 con 0x7ff6740b0520 2021-11-15T14:43:47.122 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0520 msgr2=0x7ff6740addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0520 0x7ff6740addb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff664002f70 tx=0x7ff664006eb0).stop 2021-11-15T14:43:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- 172.21.2.135:0/2468340443 shutdown_connections 2021-11-15T14:43:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6740ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.123 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- 172.21.2.135:0/2468340443 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0520 0x7ff6740addb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- 172.21.2.135:0/2468340443 >> 172.21.2.135:0/2468340443 conn(0x7ff674060840 msgr2=0x7ff674060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- 172.21.2.135:0/2468340443 shutdown_connections 2021-11-15T14:43:47.124 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- 172.21.2.135:0/2468340443 wait complete. 2021-11-15T14:43:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 Processor -- start 2021-11-15T14:43:47.127 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- start start 2021-11-15T14:43:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6741430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0900 0x7ff674153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67405ff10 con 0x7ff6740b0900 2021-11-15T14:43:47.128 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67405f730 con 0x7ff6740b0520 2021-11-15T14:43:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff67999d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67405f9d0 con 0x7ff6740aa1a0 2021-11-15T14:43:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36518/0 (socket says 172.21.2.135:36518) 2021-11-15T14:43:47.129 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 -- 172.21.2.135:0/2595954269 learned_addr learned my addr 172.21.2.135:0/2595954269 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff672ffd700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6741430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6737fe700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0900 0x7ff674153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 -- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 msgr2=0x7ff6741430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.130 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6741430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 -- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0900 msgr2=0x7ff674153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0900 0x7ff674153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 -- 172.21.2.135:0/2595954269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66400b1e0 con 0x7ff6740b0520 2021-11-15T14:43:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.116+0000 7ff6727fc700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7ff66800c000 tx=0x7ff668006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.131 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff668010780 con 0x7ff6740b0520 2021-11-15T14:43:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680108e0 con 0x7ff6740b0520 2021-11-15T14:43:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67405fc70 con 0x7ff6740b0520 2021-11-15T14:43:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff668010c40 con 0x7ff6740b0520 2021-11-15T14:43:47.132 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff674147490 con 0x7ff6740b0520 2021-11-15T14:43:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6740573d0 con 0x7ff6740b0520 2021-11-15T14:43:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff66801c460 con 0x7ff6740b0520 2021-11-15T14:43:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 0x7ff650055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.133 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6300+0+0 (secure 0 0 0) 0x7ff66806bec0 con 0x7ff6740b0520 2021-11-15T14:43:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff672ffd700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 0x7ff650055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff672ffd700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 0x7ff650055b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ff66401a000 tx=0x7ff664015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.120+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff668042ee0 con 0x7ff6740b0520 2021-11-15T14:43:47.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.232+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff6740446d0 con 0x7ff6740b0520 2021-11-15T14:43:47.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff663fff700 1 -- 172.21.2.135:0/2595954269 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v82) v1 ==== 189+0+0 (secure 0 0 0) 0x7ff668046500 con 0x7ff6740b0520 2021-11-15T14:43:47.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 msgr2=0x7ff650055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 0x7ff650055b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7ff66401a000 tx=0x7ff664015000).stop 2021-11-15T14:43:47.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 msgr2=0x7ff674153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7ff66800c000 tx=0x7ff668006df0).stop 2021-11-15T14:43:47.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 shutdown_connections 2021-11-15T14:43:47.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ff650053690 0x7ff650055b50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ff6740b0900 0x7ff674153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ff6740b0520 0x7ff674153a60 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 --2- 172.21.2.135:0/2595954269 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ff6740aa1a0 0x7ff6741430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 >> 172.21.2.135:0/2595954269 conn(0x7ff674060840 msgr2=0x7ff6740ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 shutdown_connections 2021-11-15T14:43:47.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.248+0000 7ff67999d700 1 -- 172.21.2.135:0/2595954269 wait complete. 2021-11-15T14:43:47.255 INFO:teuthology.orchestra.run.gibba035.stderr:new fs with metadata pool 29 and data pool 30 2021-11-15T14:43:47.258 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:47.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 Processor -- start 2021-11-15T14:43:47.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- start start 2021-11-15T14:43:47.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f3e140b1050 0x7f3e141447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140b03d0 con 0x7f3e14148420 2021-11-15T14:43:47.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140b0670 con 0x7f3e140b1e30 2021-11-15T14:43:47.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140a9140 con 0x7f3e140b1050 2021-11-15T14:43:47.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e193cc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3e140b1e30 0x7f3e140b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52352/0 (socket says 172.21.2.135:52352) 2021-11-15T14:43:47.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e193cc700 1 -- 172.21.2.135:0/1137984283 learned_addr learned my addr 172.21.2.135:0/1137984283 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:47.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e19bcd700 1 --2- 172.21.2.135:0/1137984283 >> v2:172.21.2.135:3300/0 conn(0x7f3e140b1050 0x7f3e141447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e07fff700 1 -- 172.21.2.135:0/1137984283 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544568657 0 0) 0x7f3e140b0670 con 0x7f3e140b1e30 2021-11-15T14:43:47.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e07fff700 1 -- 172.21.2.135:0/1137984283 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dfc003260 con 0x7f3e140b1e30 2021-11-15T14:43:47.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1137984283 >> v1:172.21.2.135:6789/0 conn(0x7f3e140b1e30 legacy=0x7f3e140b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1137984283 >> v1:172.21.2.119:6789/0 conn(0x7f3e14148420 legacy=0x7f3e140a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:47.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1137984283 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140b0910 con 0x7f3e140b1050 2021-11-15T14:43:47.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e19bcd700 1 --2- 172.21.2.135:0/1137984283 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e140b1050 0x7f3e141447a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f3e141477b0 tx=0x7f3e0c0091d0).ready entity=mon.1 client_cookie=1911294207130e71 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e07fff700 1 -- 172.21.2.135:0/1137984283 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c00b600 con 0x7f3e140b1050 2021-11-15T14:43:47.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e07fff700 1 -- 172.21.2.135:0/1137984283 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00b760 con 0x7f3e140b1050 2021-11-15T14:43:47.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e07fff700 1 -- 172.21.2.135:0/1137984283 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c00b8d0 con 0x7f3e140b1050 2021-11-15T14:43:47.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- 172.21.2.135:0/1137984283 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e140b1050 msgr2=0x7f3e141447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1137984283 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e140b1050 0x7f3e141447a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f3e141477b0 tx=0x7f3e0c0091d0).stop 2021-11-15T14:43:47.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- 172.21.2.135:0/1137984283 shutdown_connections 2021-11-15T14:43:47.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1137984283 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e140b1050 0x7f3e141447a0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- 172.21.2.135:0/1137984283 >> 172.21.2.135:0/1137984283 conn(0x7f3e1405f730 msgr2=0x7f3e1405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- 172.21.2.135:0/1137984283 shutdown_connections 2021-11-15T14:43:47.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.304+0000 7f3e1b630700 1 -- 172.21.2.135:0/1137984283 wait complete. 2021-11-15T14:43:47.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 Processor -- start 2021-11-15T14:43:47.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- start start 2021-11-15T14:43:47.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e140b1050 0x7f3e1414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e140b1e30 0x7f3e1414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140afda0 con 0x7f3e140b1050 2021-11-15T14:43:47.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1413dd00 con 0x7f3e14148420 2021-11-15T14:43:47.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1414c8a0 con 0x7f3e140b1e30 2021-11-15T14:43:47.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36542/0 (socket says 172.21.2.135:36542) 2021-11-15T14:43:47.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1068244981 learned_addr learned my addr 172.21.2.135:0/1068244981 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:47.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e18bcb700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e140b1e30 0x7f3e1414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e193cc700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e140b1050 0x7f3e1414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e140b1e30 msgr2=0x7f3e1414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e140b1e30 0x7f3e1414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e140b1050 msgr2=0x7f3e1414c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e140b1050 0x7f3e1414c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 -- 172.21.2.135:0/1068244981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009470 con 0x7f3e14148420 2021-11-15T14:43:47.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e19bcd700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f3e141477b0 tx=0x7f3e0c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c011cc0 con 0x7f3e14148420 2021-11-15T14:43:47.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c011e20 con 0x7f3e14148420 2021-11-15T14:43:47.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1414cb40 con 0x7f3e14148420 2021-11-15T14:43:47.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1413d970 con 0x7f3e14148420 2021-11-15T14:43:47.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c01f5e0 con 0x7f3e14148420 2021-11-15T14:43:47.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1414d520 con 0x7f3e14148420 2021-11-15T14:43:47.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e0c026030 con 0x7f3e14148420 2021-11-15T14:43:47.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 0x7f3df4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3e0c06c7a0 con 0x7f3e14148420 2021-11-15T14:43:47.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.308+0000 7f3e193cc700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 0x7f3df4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.312+0000 7f3e193cc700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 0x7f3df4055b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3e1000b000 tx=0x7f3e10009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.312+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e0c0436a0 con 0x7f3e14148420 2021-11-15T14:43:47.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e1414d520 con 0x7f3e14148420 2021-11-15T14:43:47.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e067fc700 1 -- 172.21.2.135:0/1068244981 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f3e0c046cc0 con 0x7f3e14148420 2021-11-15T14:43:47.400 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:47.401 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":164,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:47.237415+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:45.185060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:46.224957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:47.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 msgr2=0x7f3df4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 0x7f3df4055b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3e1000b000 tx=0x7f3e10009040).stop 2021-11-15T14:43:47.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 msgr2=0x7f3e14146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f3e141477b0 tx=0x7f3e0c016000).stop 2021-11-15T14:43:47.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 shutdown_connections 2021-11-15T14:43:47.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3df4053640 0x7f3df4055b00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3e14148420 0x7f3e14146ca0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3e140b1e30 0x7f3e1414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 --2- 172.21.2.135:0/1068244981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f3e140b1050 0x7f3e1414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 >> 172.21.2.135:0/1068244981 conn(0x7f3e1405f730 msgr2=0x7f3e140b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 shutdown_connections 2021-11-15T14:43:47.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.396+0000 7f3e1b630700 1 -- 172.21.2.135:0/1068244981 wait complete. 2021-11-15T14:43:47.408 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:47.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 Processor -- start 2021-11-15T14:43:47.459 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- start start 2021-11-15T14:43:47.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6e580b1050 0x7f6e581447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b03d0 con 0x7f6e58148420 2021-11-15T14:43:47.461 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b0670 con 0x7f6e580b1e30 2021-11-15T14:43:47.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580a9140 con 0x7f6e580b1050 2021-11-15T14:43:47.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d9d5700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6e580b1050 0x7f6e581447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d1d4700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f6e580b1e30 0x7f6e580b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52366/0 (socket says 172.21.2.135:52366) 2021-11-15T14:43:47.462 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d1d4700 1 -- 172.21.2.135:0/2373454251 learned_addr learned my addr 172.21.2.135:0/2373454251 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:47.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/2373454251 >> v1:172.21.2.135:6789/0 conn(0x7f6e580b1e30 legacy=0x7f6e580b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/2373454251 >> v1:172.21.2.119:6789/0 conn(0x7f6e58148420 legacy=0x7f6e580a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:47.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/2373454251 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580b0910 con 0x7f6e580b1050 2021-11-15T14:43:47.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5d9d5700 1 --2- 172.21.2.135:0/2373454251 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e580b1050 0x7f6e581447a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f6e581477b0 tx=0x7f6e500091d0).ready entity=mon.1 client_cookie=7be22341076a3b1b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e4bfff700 1 -- 172.21.2.135:0/2373454251 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5000b820 con 0x7f6e580b1050 2021-11-15T14:43:47.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e4bfff700 1 -- 172.21.2.135:0/2373454251 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000b980 con 0x7f6e580b1050 2021-11-15T14:43:47.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e4bfff700 1 -- 172.21.2.135:0/2373454251 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5000baf0 con 0x7f6e580b1050 2021-11-15T14:43:47.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- 172.21.2.135:0/2373454251 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e580b1050 msgr2=0x7f6e581447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 --2- 172.21.2.135:0/2373454251 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e580b1050 0x7f6e581447a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f6e581477b0 tx=0x7f6e500091d0).stop 2021-11-15T14:43:47.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- 172.21.2.135:0/2373454251 shutdown_connections 2021-11-15T14:43:47.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 --2- 172.21.2.135:0/2373454251 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e580b1050 0x7f6e581447a0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- 172.21.2.135:0/2373454251 >> 172.21.2.135:0/2373454251 conn(0x7f6e5805f730 msgr2=0x7f6e5805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- 172.21.2.135:0/2373454251 shutdown_connections 2021-11-15T14:43:47.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.456+0000 7f6e5f438700 1 -- 172.21.2.135:0/2373454251 wait complete. 2021-11-15T14:43:47.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 Processor -- start 2021-11-15T14:43:47.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- start start 2021-11-15T14:43:47.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e580b1050 0x7f6e58156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e580b1e30 0x7f6e580af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5815a160 con 0x7f6e580b1050 2021-11-15T14:43:47.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580aa640 con 0x7f6e58148420 2021-11-15T14:43:47.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580aa8e0 con 0x7f6e580b1e30 2021-11-15T14:43:47.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36556/0 (socket says 172.21.2.135:36556) 2021-11-15T14:43:47.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/1568452745 learned_addr learned my addr 172.21.2.135:0/1568452745 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:47.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e580b1e30 msgr2=0x7f6e580af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e580b1e30 0x7f6e580af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e580b1050 msgr2=0x7f6e58156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e580b1050 0x7f6e58156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 -- 172.21.2.135:0/1568452745 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009470 con 0x7f6e58148420 2021-11-15T14:43:47.471 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5d9d5700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f6e581477b0 tx=0x7f6e50016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5000b820 con 0x7f6e58148420 2021-11-15T14:43:47.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500032f0 con 0x7f6e58148420 2021-11-15T14:43:47.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5001f5e0 con 0x7f6e58148420 2021-11-15T14:43:47.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580aab80 con 0x7f6e58148420 2021-11-15T14:43:47.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e58064290 con 0x7f6e58148420 2021-11-15T14:43:47.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e580b0bb0 con 0x7f6e58148420 2021-11-15T14:43:47.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e50026030 con 0x7f6e58148420 2021-11-15T14:43:47.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 0x7f6e38055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.460+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6e5006c880 con 0x7f6e58148420 2021-11-15T14:43:47.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.464+0000 7f6e5d1d4700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 0x7f6e38055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.464+0000 7f6e5d1d4700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 0x7f6e38055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f6e580b31f0 tx=0x7f6e540077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.464+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e50043890 con 0x7f6e58148420 2021-11-15T14:43:47.550 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e580573d0 con 0x7f6e58148420 2021-11-15T14:43:47.551 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e4a7fc700 1 -- 172.21.2.135:0/1568452745 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f6e50046eb0 con 0x7f6e58148420 2021-11-15T14:43:47.552 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:47.552 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":164,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:47.237415+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:45.185060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:46.224957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:47.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 msgr2=0x7f6e38055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 0x7f6e38055ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f6e580b31f0 tx=0x7f6e540077d0).stop 2021-11-15T14:43:47.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 msgr2=0x7f6e5815a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f6e581477b0 tx=0x7f6e50016000).stop 2021-11-15T14:43:47.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 shutdown_connections 2021-11-15T14:43:47.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6e38053610 0x7f6e38055ad0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6e58148420 0x7f6e5815a830 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6e580b1e30 0x7f6e580af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 --2- 172.21.2.135:0/1568452745 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6e580b1050 0x7f6e58156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 >> 172.21.2.135:0/1568452745 conn(0x7f6e5805f730 msgr2=0x7f6e580b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.555 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 shutdown_connections 2021-11-15T14:43:47.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.548+0000 7f6e5f438700 1 -- 172.21.2.135:0/1568452745 wait complete. 2021-11-15T14:43:47.559 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-15T14:43:47.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 Processor -- start 2021-11-15T14:43:47.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- start start 2021-11-15T14:43:47.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5110060040 0x7f5110064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100b2430 con 0x7f51100b3950 2021-11-15T14:43:47.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5110065770 con 0x7f5110060040 2021-11-15T14:43:47.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b26d0 con 0x7f51100b2ca0 2021-11-15T14:43:47.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f51100b3950 0x7f51100b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52384/0 (socket says 172.21.2.135:52384) 2021-11-15T14:43:47.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510f7fe700 1 -- 172.21.2.135:0/3427081569 learned_addr learned my addr 172.21.2.135:0/3427081569 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:47.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 --2- 172.21.2.135:0/3427081569 >> v2:172.21.2.135:3300/0 conn(0x7f5110060040 0x7f5110064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 -- 172.21.2.135:0/3427081569 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 msgr2=0x7f5110065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 --2- 172.21.2.135:0/3427081569 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 -- 172.21.2.135:0/3427081569 >> v1:172.21.2.135:6789/0 conn(0x7f51100b3950 legacy=0x7f51100b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 -- 172.21.2.135:0/3427081569 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100b2970 con 0x7f5110060040 2021-11-15T14:43:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510ffff700 1 --2- 172.21.2.135:0/3427081569 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f5110064d90 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f5100002f70 tx=0x7f5100006df0).ready entity=mon.1 client_cookie=be5ebd44023f521e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510effd700 1 -- 172.21.2.135:0/3427081569 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000d570 con 0x7f5110060040 2021-11-15T14:43:47.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510effd700 1 -- 172.21.2.135:0/3427081569 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100000e90 con 0x7f5110060040 2021-11-15T14:43:47.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f510effd700 1 -- 172.21.2.135:0/3427081569 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000d8c0 con 0x7f5110060040 2021-11-15T14:43:47.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- 172.21.2.135:0/3427081569 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 msgr2=0x7f5110064d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 --2- 172.21.2.135:0/3427081569 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f5110064d90 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f5100002f70 tx=0x7f5100006df0).stop 2021-11-15T14:43:47.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- 172.21.2.135:0/3427081569 shutdown_connections 2021-11-15T14:43:47.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 --2- 172.21.2.135:0/3427081569 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 --2- 172.21.2.135:0/3427081569 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f5110064d90 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:47.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- 172.21.2.135:0/3427081569 >> 172.21.2.135:0/3427081569 conn(0x7f511005cfe0 msgr2=0x7f511005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:47.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- 172.21.2.135:0/3427081569 shutdown_connections 2021-11-15T14:43:47.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.608+0000 7f5116a10700 1 -- 172.21.2.135:0/3427081569 wait complete. 2021-11-15T14:43:47.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 Processor -- start 2021-11-15T14:43:47.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- start start 2021-11-15T14:43:47.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51100b3950 0x7f511013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b5aa0 con 0x7f51100b3950 2021-11-15T14:43:47.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100af130 con 0x7f5110060040 2021-11-15T14:43:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b55a0 con 0x7f51100b2ca0 2021-11-15T14:43:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36568/0 (socket says 172.21.2.135:36568) 2021-11-15T14:43:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 -- 172.21.2.135:0/652815016 learned_addr learned my addr 172.21.2.135:0/652815016 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:47.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 -- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 msgr2=0x7f5110140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 -- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51100b3950 msgr2=0x7f511013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:47.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51100b3950 0x7f511013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:47.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 -- 172.21.2.135:0/652815016 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510000b180 con 0x7f5110060040 2021-11-15T14:43:47.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510ffff700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f51100b56e0 tx=0x7f5100015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000de40 con 0x7f5110060040 2021-11-15T14:43:47.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100011ca0 con 0x7f5110060040 2021-11-15T14:43:47.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100b7440 con 0x7f5110060040 2021-11-15T14:43:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510001e460 con 0x7f5110060040 2021-11-15T14:43:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100aeae0 con 0x7f5110060040 2021-11-15T14:43:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51100ae950 con 0x7f5110060040 2021-11-15T14:43:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5100025030 con 0x7f5110060040 2021-11-15T14:43:47.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 0x7f50f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:47.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f510006ce00 con 0x7f5110060040 2021-11-15T14:43:47.627 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.612+0000 7f510f7fe700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 0x7f50f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.616+0000 7f510f7fe700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 0x7f50f4055ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f511005d4e0 tx=0x7f50f8007800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:47.628 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.616+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5100043e10 con 0x7f5110060040 2021-11-15T14:43:47.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:47.724+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f51100648f0 con 0x7f5110060040 2021-11-15T14:43:48.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f510d7fa700 1 -- 172.21.2.135:0/652815016 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5100023020 con 0x7f5110060040 2021-11-15T14:43:48.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 msgr2=0x7f50f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 0x7f50f4055ad0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f511005d4e0 tx=0x7f50f8007800).stop 2021-11-15T14:43:48.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 msgr2=0x7f511013ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f51100b56e0 tx=0x7f5100015000).stop 2021-11-15T14:43:48.256 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 shutdown_connections 2021-11-15T14:43:48.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f50f4053610 0x7f50f4055ad0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f51100b3950 0x7f511013ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f51100b2ca0 0x7f5110140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.257 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 --2- 172.21.2.135:0/652815016 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5110060040 0x7f511013ff60 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 >> 172.21.2.135:0/652815016 conn(0x7f511005cfe0 msgr2=0x7f51100b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 shutdown_connections 2021-11-15T14:43:48.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.252+0000 7f5116a10700 1 -- 172.21.2.135:0/652815016 wait complete. 2021-11-15T14:43:48.263 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:48.315 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 Processor -- start 2021-11-15T14:43:48.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- start start 2021-11-15T14:43:48.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0410139b60 0x7f0410142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f04100b1cd0 0x7f04100a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100ac4f0 con 0x7f0410143320 2021-11-15T14:43:48.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04100b3090 con 0x7f04100b1cd0 2021-11-15T14:43:48.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100af3a0 con 0x7f0410139b60 2021-11-15T14:43:48.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f04100b1cd0 0x7f04100a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f04100b1cd0 0x7f04100a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36578/0 (socket says 172.21.2.135:36578) 2021-11-15T14:43:48.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/1446556638 learned_addr learned my addr 172.21.2.135:0/1446556638 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/1446556638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0410139b60 msgr2=0x7f0410142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- 172.21.2.135:0/1446556638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0410139b60 0x7f0410142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/1446556638 >> v1:172.21.2.119:6789/0 conn(0x7f0410143320 legacy=0x7f04100ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/1446556638 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04101437b0 con 0x7f04100b1cd0 2021-11-15T14:43:48.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- 172.21.2.135:0/1446556638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b1cd0 0x7f04100a89d0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f0410061420 tx=0x7f040800b530).ready entity=mon.1 client_cookie=e01067a129c90f82 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0414952700 1 -- 172.21.2.135:0/1446556638 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040800bea0 con 0x7f04100b1cd0 2021-11-15T14:43:48.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0414952700 1 -- 172.21.2.135:0/1446556638 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080155e0 con 0x7f04100b1cd0 2021-11-15T14:43:48.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0414952700 1 -- 172.21.2.135:0/1446556638 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0408015980 con 0x7f04100b1cd0 2021-11-15T14:43:48.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- 172.21.2.135:0/1446556638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b1cd0 msgr2=0x7f04100a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- 172.21.2.135:0/1446556638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b1cd0 0x7f04100a89d0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f0410061420 tx=0x7f040800b530).stop 2021-11-15T14:43:48.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- 172.21.2.135:0/1446556638 shutdown_connections 2021-11-15T14:43:48.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- 172.21.2.135:0/1446556638 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b1cd0 0x7f04100a89d0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- 172.21.2.135:0/1446556638 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0410139b60 0x7f0410142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- 172.21.2.135:0/1446556638 >> 172.21.2.135:0/1446556638 conn(0x7f041005f730 msgr2=0x7f041005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- 172.21.2.135:0/1446556638 shutdown_connections 2021-11-15T14:43:48.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- 172.21.2.135:0/1446556638 wait complete. 2021-11-15T14:43:48.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 Processor -- start 2021-11-15T14:43:48.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- start start 2021-11-15T14:43:48.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04100b1cd0 0x7f04100b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0410140320 0x7f041014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041014e440 con 0x7f0410140320 2021-11-15T14:43:48.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041013e0f0 con 0x7f04100b5db0 2021-11-15T14:43:48.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0417bb8700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041013f1f0 con 0x7f04100b1cd0 2021-11-15T14:43:48.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36584/0 (socket says 172.21.2.135:36584) 2021-11-15T14:43:48.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/852081091 learned_addr learned my addr 172.21.2.135:0/852081091 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04100b1cd0 msgr2=0x7f04100b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04100b1cd0 0x7f04100b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0410140320 msgr2=0x7f041014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0410140320 0x7f041014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 -- 172.21.2.135:0/852081091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040800b7d0 con 0x7f04100b5db0 2021-11-15T14:43:48.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.312+0000 7f0416155700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f0410061420 tx=0x7f0408019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04080032f0 con 0x7f04100b5db0 2021-11-15T14:43:48.328 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080153f0 con 0x7f04100b5db0 2021-11-15T14:43:48.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0408014d70 con 0x7f04100b5db0 2021-11-15T14:43:48.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041013f490 con 0x7f04100b5db0 2021-11-15T14:43:48.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041013f9d0 con 0x7f04100b5db0 2021-11-15T14:43:48.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041014f340 con 0x7f04100b5db0 2021-11-15T14:43:48.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0408028460 con 0x7f04100b5db0 2021-11-15T14:43:48.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 0x7f03f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f040806f9d0 con 0x7f04100b5db0 2021-11-15T14:43:48.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f0415954700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 0x7f03f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f0415954700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 0x7f03f0055ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f0400002f70 tx=0x7f0400006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.316+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0408046980 con 0x7f04100b5db0 2021-11-15T14:43:48.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0410143cf0 con 0x7f04100b5db0 2021-11-15T14:43:48.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f040effd700 1 -- 172.21.2.135:0/852081091 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f0408049fa0 con 0x7f04100b5db0 2021-11-15T14:43:48.433 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:48.433 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":83,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:43:48.242650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8707":{"gid":8707,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/945123846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":945123846},{"type":"v1","addr":"172.21.2.135:6835","nonce":945123846}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:43:48.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 msgr2=0x7f03f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 0x7f03f0055ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f0400002f70 tx=0x7f0400006a80).stop 2021-11-15T14:43:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 msgr2=0x7f041014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f0410061420 tx=0x7f0408019000).stop 2021-11-15T14:43:48.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 shutdown_connections 2021-11-15T14:43:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f03f0053610 0x7f03f0055ad0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f04100b5db0 0x7f041014ecb0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0410140320 0x7f041014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 --2- 172.21.2.135:0/852081091 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f04100b1cd0 0x7f04100b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 >> 172.21.2.135:0/852081091 conn(0x7f041005f730 msgr2=0x7f04100a9390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 shutdown_connections 2021-11-15T14:43:48.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.428+0000 7f0417bb8700 1 -- 172.21.2.135:0/852081091 wait complete. 2021-11-15T14:43:48.437 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 83 2021-11-15T14:43:48.440 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:48.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 Processor -- start 2021-11-15T14:43:48.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 -- start start 2021-11-15T14:43:48.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0ef4139b60 0x7f0ef4142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4143320 0x7f0ef40ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef40ac4f0 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40b3090 con 0x7f0ef4139b60 2021-11-15T14:43:48.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.496+0000 7f0efbfe3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40af3a0 con 0x7f0ef4143320 2021-11-15T14:43:48.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0ef4139b60 0x7f0ef4142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f0ef4139b60 0x7f0ef4142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36588/0 (socket says 172.21.2.135:36588) 2021-11-15T14:43:48.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/2897678469 learned_addr learned my addr 172.21.2.135:0/2897678469 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/2897678469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4143320 msgr2=0x7f0ef40ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- 172.21.2.135:0/2897678469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4143320 0x7f0ef40ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/2897678469 >> v1:172.21.2.119:6789/0 conn(0x7f0ef40b1cd0 legacy=0x7f0ef40a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/2897678469 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef41437b0 con 0x7f0ef4139b60 2021-11-15T14:43:48.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- 172.21.2.135:0/2897678469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef4139b60 0x7f0ef4142e30 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f0ef4061420 tx=0x7f0ee8006eb0).ready entity=mon.1 client_cookie=a092d37a0cab412a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef8d7d700 1 -- 172.21.2.135:0/2897678469 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee800d570 con 0x7f0ef4139b60 2021-11-15T14:43:48.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef8d7d700 1 -- 172.21.2.135:0/2897678469 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8000e90 con 0x7f0ef4139b60 2021-11-15T14:43:48.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef8d7d700 1 -- 172.21.2.135:0/2897678469 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee800d900 con 0x7f0ef4139b60 2021-11-15T14:43:48.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/2897678469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef4139b60 msgr2=0x7f0ef4142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/2897678469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef4139b60 0x7f0ef4142e30 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f0ef4061420 tx=0x7f0ee8006eb0).stop 2021-11-15T14:43:48.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/2897678469 shutdown_connections 2021-11-15T14:43:48.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/2897678469 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4143320 0x7f0ef40ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/2897678469 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef4139b60 0x7f0ef4142e30 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/2897678469 >> 172.21.2.135:0/2897678469 conn(0x7f0ef405f730 msgr2=0x7f0ef405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/2897678469 shutdown_connections 2021-11-15T14:43:48.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/2897678469 wait complete. 2021-11-15T14:43:48.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 Processor -- start 2021-11-15T14:43:48.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- start start 2021-11-15T14:43:48.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ef40b4ba0 0x7f0ef4130510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4139f70 0x7f0ef415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41407d0 con 0x7f0ef40b4ba0 2021-11-15T14:43:48.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4140a70 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4131030 con 0x7f0ef4139f70 2021-11-15T14:43:48.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36594/0 (socket says 172.21.2.135:36594) 2021-11-15T14:43:48.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/4122179983 learned_addr learned my addr 172.21.2.135:0/4122179983 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4139f70 msgr2=0x7f0ef415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4139f70 0x7f0ef415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ef40b4ba0 msgr2=0x7f0ef4130510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ef40b4ba0 0x7f0ef4130510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 -- 172.21.2.135:0/4122179983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee800b1e0 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ef9d7f700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f0ef4061420 tx=0x7f0ee8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee8002f70 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800de10 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef41312d0 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee801e460 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.500+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4131730 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef4130a00 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ee8025030 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ee6ffd700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 0x7f0ed4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0ee806cdc0 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ef957e700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 0x7f0ed4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ef957e700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 0x7f0ed4055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0ef0002f70 tx=0x7f0ef00069f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.504+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ee8043d70 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef4131460 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0ee6ffd700 1 -- 172.21.2.135:0/4122179983 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f0ee8023030 con 0x7f0ef40b1cd0 2021-11-15T14:43:48.593 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:48.593 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":164,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:47.237415+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:45.185060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:46.224957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:48.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 msgr2=0x7f0ed4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 0x7f0ed4055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0ef0002f70 tx=0x7f0ef00069f0).stop 2021-11-15T14:43:48.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 msgr2=0x7f0ef40a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f0ef4061420 tx=0x7f0ee8015000).stop 2021-11-15T14:43:48.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 shutdown_connections 2021-11-15T14:43:48.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0ed4053610 0x7f0ed4055ad0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0ef4139f70 0x7f0ef415a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0ef40b4ba0 0x7f0ef4130510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 --2- 172.21.2.135:0/4122179983 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0ef40b1cd0 0x7f0ef40a7540 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.588+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 >> 172.21.2.135:0/4122179983 conn(0x7f0ef405f730 msgr2=0x7f0ef40b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.592+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 shutdown_connections 2021-11-15T14:43:48.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.592+0000 7f0efbfe3700 1 -- 172.21.2.135:0/4122179983 wait complete. 2021-11-15T14:43:48.600 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:48.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 Processor -- start 2021-11-15T14:43:48.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- start start 2021-11-15T14:43:48.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fbf080b1e30 0x7fbf080b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf081447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf080b03d0 con 0x7fbf08148420 2021-11-15T14:43:48.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf080a9140 con 0x7fbf080b1e30 2021-11-15T14:43:48.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080b0670 con 0x7fbf080a7140 2021-11-15T14:43:48.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf06ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fbf08148420 0x7fbf080b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52424/0 (socket says 172.21.2.135:52424) 2021-11-15T14:43:48.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf06ffd700 1 -- 172.21.2.135:0/1187387661 learned_addr learned my addr 172.21.2.135:0/1187387661 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:48.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 --2- 172.21.2.135:0/1187387661 >> v2:172.21.2.135:3300/0 conn(0x7fbf080b1e30 0x7fbf080b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 -- 172.21.2.135:0/1187387661 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 msgr2=0x7fbf081447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 --2- 172.21.2.135:0/1187387661 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf081447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 -- 172.21.2.135:0/1187387661 >> v1:172.21.2.135:6789/0 conn(0x7fbf08148420 legacy=0x7fbf080b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 -- 172.21.2.135:0/1187387661 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080b0910 con 0x7fbf080b1e30 2021-11-15T14:43:48.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf077fe700 1 --2- 172.21.2.135:0/1187387661 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf080b1e30 0x7fbf080b1050 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fbf081477b0 tx=0x7fbef0006df0).ready entity=mon.1 client_cookie=b1e2813f539f9e83 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf067fc700 1 -- 172.21.2.135:0/1187387661 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef000d570 con 0x7fbf080b1e30 2021-11-15T14:43:48.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf067fc700 1 -- 172.21.2.135:0/1187387661 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0000e90 con 0x7fbf080b1e30 2021-11-15T14:43:48.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf067fc700 1 -- 172.21.2.135:0/1187387661 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef000d8c0 con 0x7fbf080b1e30 2021-11-15T14:43:48.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/1187387661 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf080b1e30 msgr2=0x7fbf080b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/1187387661 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf080b1e30 0x7fbf080b1050 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7fbf081477b0 tx=0x7fbef0006df0).stop 2021-11-15T14:43:48.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/1187387661 shutdown_connections 2021-11-15T14:43:48.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/1187387661 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf081447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/1187387661 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf080b1e30 0x7fbf080b1050 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/1187387661 >> 172.21.2.135:0/1187387661 conn(0x7fbf0805f730 msgr2=0x7fbf0805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/1187387661 shutdown_connections 2021-11-15T14:43:48.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.652+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/1187387661 wait complete. 2021-11-15T14:43:48.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 Processor -- start 2021-11-15T14:43:48.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- start start 2021-11-15T14:43:48.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf08147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbf080b1e30 0x7fbf08157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080aa080 con 0x7fbf080b1e30 2021-11-15T14:43:48.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08156ac0 con 0x7fbf08148420 2021-11-15T14:43:48.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080aa2b0 con 0x7fbf080a7140 2021-11-15T14:43:48.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36610/0 (socket says 172.21.2.135:36610) 2021-11-15T14:43:48.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 -- 172.21.2.135:0/2872136343 learned_addr learned my addr 172.21.2.135:0/2872136343 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 -- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 msgr2=0x7fbf08147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf08147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 -- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbf080b1e30 msgr2=0x7fbf08157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbf080b1e30 0x7fbf08157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 -- 172.21.2.135:0/2872136343 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef000b180 con 0x7fbf08148420 2021-11-15T14:43:48.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf07fff700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fbf0814a1b0 tx=0x7fbf000091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0000d4a0 con 0x7fbf08148420 2021-11-15T14:43:48.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000d600 con 0x7fbf08148420 2021-11-15T14:43:48.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf080aa550 con 0x7fbf08148420 2021-11-15T14:43:48.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0000d960 con 0x7fbf08148420 2021-11-15T14:43:48.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf080ab430 con 0x7fbf08148420 2021-11-15T14:43:48.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf080573d0 con 0x7fbf08148420 2021-11-15T14:43:48.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf00018030 con 0x7fbf08148420 2021-11-15T14:43:48.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 0x7fbeec055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbf0006b520 con 0x7fbf08148420 2021-11-15T14:43:48.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.656+0000 7fbf077fe700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 0x7fbeec055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.660+0000 7fbf077fe700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 0x7fbeec055bb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fbf081477b0 tx=0x7fbef0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.660+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf000424d0 con 0x7fbf08148420 2021-11-15T14:43:48.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.768+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbf0814bb50 con 0x7fbf08148420 2021-11-15T14:43:48.785 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.780+0000 7fbf04ff9700 1 -- 172.21.2.135:0/2872136343 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbf00045af0 con 0x7fbf08148420 2021-11-15T14:43:48.786 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 msgr2=0x7fbeec055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 0x7fbeec055bb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fbf081477b0 tx=0x7fbef0015000).stop 2021-11-15T14:43:48.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 msgr2=0x7fbf08157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.787 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7fbf0814a1b0 tx=0x7fbf000091a0).stop 2021-11-15T14:43:48.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 shutdown_connections 2021-11-15T14:43:48.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeec0536f0 0x7fbeec055bb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbf08148420 0x7fbf08157670 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.788 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbf080b1e30 0x7fbf08157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 --2- 172.21.2.135:0/2872136343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbf080a7140 0x7fbf08147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:48.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 >> 172.21.2.135:0/2872136343 conn(0x7fbf0805f730 msgr2=0x7fbf080af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 shutdown_connections 2021-11-15T14:43:48.789 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.784+0000 7fbf0e1f0700 1 -- 172.21.2.135:0/2872136343 wait complete. 2021-11-15T14:43:48.790 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.0 2021-11-15T14:43:48.793 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-15T14:43:48.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 Processor -- start 2021-11-15T14:43:48.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 -- start start 2021-11-15T14:43:48.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 0x7f7b040b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040b03d0 con 0x7f7b040a7140 2021-11-15T14:43:48.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040a9140 con 0x7f7b04148420 2021-11-15T14:43:48.849 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b0a932700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b0670 con 0x7f7b040b1e30 2021-11-15T14:43:48.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:46390/0 (socket says 172.21.2.135:46390) 2021-11-15T14:43:48.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 -- 172.21.2.135:0/3217829763 learned_addr learned my addr 172.21.2.135:0/3217829763 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b08ecf700 1 --1- 172.21.2.135:0/3217829763 >> v1:172.21.2.119:6789/0 conn(0x7f7b040a7140 0x7f7b041447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:33620/0 (socket says 172.21.2.135:33620) 2021-11-15T14:43:48.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b037fe700 1 --2- 172.21.2.135:0/3217829763 >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 0x7f7b040b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 -- 172.21.2.135:0/3217829763 >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 msgr2=0x7f7b040b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:48.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 --2- 172.21.2.135:0/3217829763 >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 0x7f7b040b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 -- 172.21.2.135:0/3217829763 >> v1:172.21.2.119:6789/0 conn(0x7f7b040a7140 legacy=0x7f7b041447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 -- 172.21.2.135:0/3217829763 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040b0910 con 0x7f7b040b1e30 2021-11-15T14:43:48.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b037fe700 1 --2- 172.21.2.135:0/3217829763 >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 0x7f7b040b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:43:48.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.844+0000 7f7b03fff700 1 --2- 172.21.2.135:0/3217829763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7aec002f70 tx=0x7f7aec006eb0).ready entity=mon.2 client_cookie=614822af089b3f9e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b02ffd700 1 -- 172.21.2.135:0/3217829763 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aec00d570 con 0x7f7b040b1e30 2021-11-15T14:43:48.853 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b02ffd700 1 -- 172.21.2.135:0/3217829763 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec000e90 con 0x7f7b040b1e30 2021-11-15T14:43:48.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b02ffd700 1 -- 172.21.2.135:0/3217829763 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aec00d900 con 0x7f7b040b1e30 2021-11-15T14:43:48.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/3217829763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 msgr2=0x7f7b040b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- 172.21.2.135:0/3217829763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7aec002f70 tx=0x7f7aec006eb0).stop 2021-11-15T14:43:48.854 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/3217829763 shutdown_connections 2021-11-15T14:43:48.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- 172.21.2.135:0/3217829763 >> v2:172.21.2.119:3300/0 conn(0x7f7b04148420 0x7f7b040b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- 172.21.2.135:0/3217829763 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b040b1e30 0x7f7b040b1050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/3217829763 >> 172.21.2.135:0/3217829763 conn(0x7f7b0405f730 msgr2=0x7f7b0405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/3217829763 shutdown_connections 2021-11-15T14:43:48.855 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/3217829763 wait complete. 2021-11-15T14:43:48.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 Processor -- start 2021-11-15T14:43:48.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- start start 2021-11-15T14:43:48.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b040a7140 0x7f7b0414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b04148420 0x7f7b040ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040ab920 con 0x7f7b040a7140 2021-11-15T14:43:48.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040abbc0 con 0x7f7b040b1e30 2021-11-15T14:43:48.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040abed0 con 0x7f7b04148420 2021-11-15T14:43:48.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36622/0 (socket says 172.21.2.135:36622) 2021-11-15T14:43:48.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 -- 172.21.2.135:0/1183575216 learned_addr learned my addr 172.21.2.135:0/1183575216 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:48.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b08ecf700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b04148420 0x7f7b040ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b03fff700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b040a7140 0x7f7b0414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 -- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b04148420 msgr2=0x7f7b040ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b04148420 0x7f7b040ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 -- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b040a7140 msgr2=0x7f7b0414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b040a7140 0x7f7b0414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 -- 172.21.2.135:0/1183575216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af400b180 con 0x7f7b040b1e30 2021-11-15T14:43:48.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b037fe700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f7af400c000 tx=0x7f7af4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7af400c850 con 0x7f7b040b1e30 2021-11-15T14:43:48.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400c9b0 con 0x7f7b040b1e30 2021-11-15T14:43:48.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec00b1e0 con 0x7f7b040b1e30 2021-11-15T14:43:48.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7af400cd10 con 0x7f7b040b1e30 2021-11-15T14:43:48.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b040ab660 con 0x7f7b040b1e30 2021-11-15T14:43:48.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0414bc20 con 0x7f7b040b1e30 2021-11-15T14:43:48.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.848+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7af401c460 con 0x7f7b040b1e30 2021-11-15T14:43:48.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.852+0000 7f7b017fa700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 0x7f7ae8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:48.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.852+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7af406c050 con 0x7f7b040b1e30 2021-11-15T14:43:48.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.852+0000 7f7b03fff700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 0x7f7ae8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:48.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.852+0000 7f7b03fff700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 0x7f7ae8055b90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7aec01a000 tx=0x7f7aec015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:48.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.852+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b0414bc20 con 0x7f7b040b1e30 2021-11-15T14:43:48.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.964+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7b0414bc20 con 0x7f7b040b1e30 2021-11-15T14:43:48.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b017fa700 1 -- 172.21.2.135:0/1183575216 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7b0414bc20 con 0x7f7b040b1e30 2021-11-15T14:43:48.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 msgr2=0x7f7ae8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 0x7f7ae8055b90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7aec01a000 tx=0x7f7aec015000).stop 2021-11-15T14:43:48.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 msgr2=0x7f7b040ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:48.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f7af400c000 tx=0x7f7af4006df0).stop 2021-11-15T14:43:48.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 shutdown_connections 2021-11-15T14:43:48.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7ae80536d0 0x7f7ae8055b90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7b04148420 0x7f7b040ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7b040b1e30 0x7f7b040ac610 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 --2- 172.21.2.135:0/1183575216 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7b040a7140 0x7f7b0414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:48.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 >> 172.21.2.135:0/1183575216 conn(0x7f7b0405f730 msgr2=0x7f7b040b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:48.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 shutdown_connections 2021-11-15T14:43:48.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:48.976+0000 7f7b0a932700 1 -- 172.21.2.135:0/1183575216 wait complete. 2021-11-15T14:43:48.984 INFO:teuthology.orchestra.run.gibba035.stderr:updated caps for client.1 2021-11-15T14:43:48.987 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:49.037 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.032+0000 7f89766b2700 1 Processor -- start 2021-11-15T14:43:49.038 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.032+0000 7f89766b2700 1 -- start start 2021-11-15T14:43:49.039 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f89700b1050 0x7f89701447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700b03d0 con 0x7f89700b1e30 2021-11-15T14:43:49.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700b0670 con 0x7f8970148420 2021-11-15T14:43:49.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700a9140 con 0x7f89700b1050 2021-11-15T14:43:49.040 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f8974c4f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f89700b1050 0x7f89701447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8970148420 0x7f89700a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52450/0 (socket says 172.21.2.135:52450) 2021-11-15T14:43:49.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 -- 172.21.2.135:0/4123615149 learned_addr learned my addr 172.21.2.135:0/4123615149 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:49.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f8974c4f700 1 -- 172.21.2.135:0/4123615149 >> v1:172.21.2.135:6789/0 conn(0x7f8970148420 legacy=0x7f89700a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.041 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f8974c4f700 1 -- 172.21.2.135:0/4123615149 >> v1:172.21.2.119:6789/0 conn(0x7f89700b1e30 legacy=0x7f89700b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f8974c4f700 1 -- 172.21.2.135:0/4123615149 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700b0910 con 0x7f89700b1050 2021-11-15T14:43:49.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f8974c4f700 1 --2- 172.21.2.135:0/4123615149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1050 0x7f89701447a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f89700acee0 tx=0x7f89600091d0).ready entity=mon.1 client_cookie=c4ecc7b496a67229 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896effd700 1 -- 172.21.2.135:0/4123615149 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896000b820 con 0x7f89700b1050 2021-11-15T14:43:49.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896effd700 1 -- 172.21.2.135:0/4123615149 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896000b980 con 0x7f89700b1050 2021-11-15T14:43:49.042 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896effd700 1 -- 172.21.2.135:0/4123615149 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896000baf0 con 0x7f89700b1050 2021-11-15T14:43:49.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4123615149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1050 msgr2=0x7f89701447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- 172.21.2.135:0/4123615149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1050 0x7f89701447a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f89700acee0 tx=0x7f89600091d0).stop 2021-11-15T14:43:49.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4123615149 shutdown_connections 2021-11-15T14:43:49.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- 172.21.2.135:0/4123615149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1050 0x7f89701447a0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4123615149 >> 172.21.2.135:0/4123615149 conn(0x7f897005f730 msgr2=0x7f897005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4123615149 shutdown_connections 2021-11-15T14:43:49.044 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4123615149 wait complete. 2021-11-15T14:43:49.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 Processor -- start 2021-11-15T14:43:49.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- start start 2021-11-15T14:43:49.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89700b1050 0x7f8970063ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8970148420 0x7f8970066720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8970063190 con 0x7f89700b1050 2021-11-15T14:43:49.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89700633c0 con 0x7f89700b1e30 2021-11-15T14:43:49.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8970157460 con 0x7f8970148420 2021-11-15T14:43:49.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36636/0 (socket says 172.21.2.135:36636) 2021-11-15T14:43:49.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 -- 172.21.2.135:0/4202209761 learned_addr learned my addr 172.21.2.135:0/4202209761 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:49.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 -- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8970148420 msgr2=0x7f8970066720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8970148420 0x7f8970066720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 -- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89700b1050 msgr2=0x7f8970063ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89700b1050 0x7f8970063ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 -- 172.21.2.135:0/4202209761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960009470 con 0x7f89700b1e30 2021-11-15T14:43:49.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896f7fe700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f8970066000 tx=0x7f8968007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f896800ce20 con 0x7f89700b1e30 2021-11-15T14:43:49.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89680072e0 con 0x7f89700b1e30 2021-11-15T14:43:49.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8968005800 con 0x7f89700b1e30 2021-11-15T14:43:49.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8970157700 con 0x7f89700b1e30 2021-11-15T14:43:49.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.036+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89700ac110 con 0x7f89700b1e30 2021-11-15T14:43:49.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8970157890 con 0x7f89700b1e30 2021-11-15T14:43:49.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8968010070 con 0x7f89700b1e30 2021-11-15T14:43:49.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896d7fa700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 0x7f89540559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f896806b140 con 0x7f89700b1e30 2021-11-15T14:43:49.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896ffff700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 0x7f89540559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896ffff700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 0x7f89540559b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f8958002f90 tx=0x7f89580069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.040+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8968042150 con 0x7f89700b1e30 2021-11-15T14:43:49.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89700b0bb0 con 0x7f89700b1e30 2021-11-15T14:43:49.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f896d7fa700 1 -- 172.21.2.135:0/4202209761 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f8968045770 con 0x7f89700b1e30 2021-11-15T14:43:49.155 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:49.156 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":83,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:43:48.242650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8707":{"gid":8707,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/945123846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":945123846},{"type":"v1","addr":"172.21.2.135:6835","nonce":945123846}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:43:49.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 msgr2=0x7f89540559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 0x7f89540559b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f8958002f90 tx=0x7f89580069b0).stop 2021-11-15T14:43:49.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 msgr2=0x7f8970062880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f8970066000 tx=0x7f8968007c70).stop 2021-11-15T14:43:49.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 shutdown_connections 2021-11-15T14:43:49.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f89540534f0 0x7f89540559b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8970148420 0x7f8970066720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f89700b1e30 0x7f8970062880 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 --2- 172.21.2.135:0/4202209761 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f89700b1050 0x7f8970063ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 >> 172.21.2.135:0/4202209761 conn(0x7f897005f730 msgr2=0x7f8970143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 shutdown_connections 2021-11-15T14:43:49.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.152+0000 7f89766b2700 1 -- 172.21.2.135:0/4202209761 wait complete. 2021-11-15T14:43:49.160 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 83 2021-11-15T14:43:49.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:47.237805+0000', 'modified': '2021-11-15T14:43:48.242650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8707': {'gid': 8707, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/945123846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 945123846}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 945123846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:49.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:49.465 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:49.545 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8707,"want_state":"up:active","state":"up:active","rank_uptime":2.2958807860000001,"mdsmap_epoch":83,"osdmap_epoch":164,"osdmap_epoch_barrier":164,"uptime":6.4776830529999998} 2021-11-15T14:43:49.546 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8707, "mdsmap_epoch": 83, "osdmap_epoch": 164, "osdmap_epoch_barrier": 164, "rank_uptime": 2.295880786, "state": "up:active", "uptime": 6.477683053, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:49.547 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:49.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 Processor -- start 2021-11-15T14:43:49.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 -- start start 2021-11-15T14:43:49.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c144080 0x7f337c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c0aac30 con 0x7f337c060180 2021-11-15T14:43:49.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c060560 con 0x7f337c067380 2021-11-15T14:43:49.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f338122d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c066f20 con 0x7f337c144080 2021-11-15T14:43:49.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f337a59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f337c067380 0x7f337c143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52464/0 (socket says 172.21.2.135:52464) 2021-11-15T14:43:49.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.592+0000 7f337a59c700 1 -- 172.21.2.135:0/2940809876 learned_addr learned my addr 172.21.2.135:0/2940809876 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:49.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816490826 0 0) 0x7f337c060560 con 0x7f337c067380 2021-11-15T14:43:49.603 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f335c003260 con 0x7f337c067380 2021-11-15T14:43:49.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1326221055 0 0) 0x7f335c003260 con 0x7f337c067380 2021-11-15T14:43:49.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c144080 msgr2=0x7f337c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c144080 0x7f337c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 >> v1:172.21.2.119:6789/0 conn(0x7f337c060180 legacy=0x7f337c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.604 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0b3430 con 0x7f337c067380 2021-11-15T14:43:49.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f3364001660 con 0x7f337c067380 2021-11-15T14:43:49.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 >> v1:172.21.2.135:6789/0 conn(0x7f337c067380 legacy=0x7f337c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f335c0037d0 0x7f335c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.605 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f335c004500 0x7f335c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f335c004f90 0x7f335c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c066f20 con 0x7f335c004500 2021-11-15T14:43:49.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c00be50 con 0x7f335c004f90 2021-11-15T14:43:49.606 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c00c010 con 0x7f335c0037d0 2021-11-15T14:43:49.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f335c004f90 0x7f335c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f335c0037d0 0x7f335c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337a59c700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f335c004500 0x7f335c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 -- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f335c0037d0 msgr2=0x7f335c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.607 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f335c0037d0 0x7f335c003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 -- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f335c004500 msgr2=0x7f335c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f335c004500 0x7f335c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 -- 172.21.2.135:0/2940809876 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0b3430 con 0x7f335c004f90 2021-11-15T14:43:49.608 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f335c0037d0 0x7f335c003bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:49.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f335c004f90 0x7f335c00b750 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f33740032f0 tx=0x7f3374006f70).ready entity=mon.1 client_cookie=f50657d412caacc0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3374011400 con 0x7f335c004f90 2021-11-15T14:43:49.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374011560 con 0x7f335c004f90 2021-11-15T14:43:49.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f3379d9b700 1 -- 172.21.2.135:0/2940809876 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33740118c0 con 0x7f335c004f90 2021-11-15T14:43:49.609 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- 172.21.2.135:0/2940809876 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f335c004f90 msgr2=0x7f335c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 --2- 172.21.2.135:0/2940809876 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f335c004f90 0x7f335c00b750 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f33740032f0 tx=0x7f3374006f70).stop 2021-11-15T14:43:49.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337b59e700 1 -- 172.21.2.135:0/2940809876 reap_dead start 2021-11-15T14:43:49.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- 172.21.2.135:0/2940809876 shutdown_connections 2021-11-15T14:43:49.610 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- 172.21.2.135:0/2940809876 >> 172.21.2.135:0/2940809876 conn(0x7f337c05cfb0 msgr2=0x7f337c05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- 172.21.2.135:0/2940809876 shutdown_connections 2021-11-15T14:43:49.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- 172.21.2.135:0/2940809876 wait complete. 2021-11-15T14:43:49.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 Processor -- start 2021-11-15T14:43:49.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- start start 2021-11-15T14:43:49.611 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c0ae190 0x7f337c0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f337c156af0 0x7f337c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c1413a0 con 0x7f337c156af0 2021-11-15T14:43:49.612 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c061210 con 0x7f337c09e930 2021-11-15T14:43:49.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f338122d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c061440 con 0x7f337c0ae190 2021-11-15T14:43:49.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36654/0 (socket says 172.21.2.135:36654) 2021-11-15T14:43:49.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 -- 172.21.2.135:0/3345043299 learned_addr learned my addr 172.21.2.135:0/3345043299 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:49.613 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 -- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c0ae190 msgr2=0x7f337c0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c0ae190 0x7f337c0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 -- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f337c156af0 msgr2=0x7f337c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f337c156af0 0x7f337c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.614 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 -- 172.21.2.135:0/3345043299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c157490 con 0x7f337c09e930 2021-11-15T14:43:49.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.596+0000 7f337ad9d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f336c008000 tx=0x7f336c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336c007e80 con 0x7f337c09e930 2021-11-15T14:43:49.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00f440 con 0x7f337c09e930 2021-11-15T14:43:49.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336c00f7a0 con 0x7f337c09e930 2021-11-15T14:43:49.615 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c060c00 con 0x7f337c09e930 2021-11-15T14:43:49.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0a0d10 con 0x7f337c09e930 2021-11-15T14:43:49.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c060d90 con 0x7f337c09e930 2021-11-15T14:43:49.617 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f336c00f900 con 0x7f337c09e930 2021-11-15T14:43:49.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 0x7f33600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f336c06b6d0 con 0x7f337c09e930 2021-11-15T14:43:49.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f337a59c700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 0x7f33600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f337a59c700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 0x7f33600559b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3364008000 tx=0x7f3364009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.600+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f336c0426e0 con 0x7f337c09e930 2021-11-15T14:43:49.688 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.684+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f337c0622e0 con 0x7f337c09e930 2021-11-15T14:43:49.689 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.684+0000 7f3373fff700 1 -- 172.21.2.135:0/3345043299 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f336c024fb0 con 0x7f337c09e930 2021-11-15T14:43:49.689 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:49.690 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":164,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:47.237415+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:45.185060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:46.224957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 msgr2=0x7f33600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 0x7f33600559b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f3364008000 tx=0x7f3364009040).stop 2021-11-15T14:43:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 msgr2=0x7f337c09ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.691 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f336c008000 tx=0x7f336c009040).stop 2021-11-15T14:43:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 shutdown_connections 2021-11-15T14:43:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f33600534f0 0x7f33600559b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f337c156af0 0x7f337c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.692 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f337c0ae190 0x7f337c0ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 --2- 172.21.2.135:0/3345043299 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f337c09e930 0x7f337c09ed10 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 >> 172.21.2.135:0/3345043299 conn(0x7f337c05cfb0 msgr2=0x7f337c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 shutdown_connections 2021-11-15T14:43:49.693 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.688+0000 7f338122d700 1 -- 172.21.2.135:0/3345043299 wait complete. 2021-11-15T14:43:49.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:43:45.185060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:43:46.224957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:49.697 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:49.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.748+0000 7f790a68c700 1 Processor -- start 2021-11-15T14:43:49.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.748+0000 7f790a68c700 1 -- start start 2021-11-15T14:43:49.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a9650 0x7f79040a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f79040acad0 0x7f79040b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7904139c40 con 0x7f79040a8aa0 2021-11-15T14:43:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7904140580 con 0x7f79040acad0 2021-11-15T14:43:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b01b0 con 0x7f79040a9650 2021-11-15T14:43:49.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f7908c29700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f79040a8aa0 0x7f79040b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52484/0 (socket says 172.21.2.135:52484) 2021-11-15T14:43:49.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f7908c29700 1 -- 172.21.2.135:0/3756948789 learned_addr learned my addr 172.21.2.135:0/3756948789 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:49.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/3756948789 >> v2:172.21.2.135:3300/0 conn(0x7f79040acad0 0x7f79040b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/3756948789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a9650 msgr2=0x7f79040a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/3756948789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a9650 0x7f79040a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/3756948789 >> v1:172.21.2.135:6789/0 conn(0x7f79040a8aa0 legacy=0x7f79040b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/3756948789 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040b0450 con 0x7f79040acad0 2021-11-15T14:43:49.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/3756948789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040acad0 0x7f79040b2c80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f78ec002f70 tx=0x7f78ec006df0).ready entity=mon.1 client_cookie=c8a63d75918442c5 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f7902ffd700 1 -- 172.21.2.135:0/3756948789 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec00fa10 con 0x7f79040acad0 2021-11-15T14:43:49.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f7902ffd700 1 -- 172.21.2.135:0/3756948789 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec000e90 con 0x7f79040acad0 2021-11-15T14:43:49.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f7902ffd700 1 -- 172.21.2.135:0/3756948789 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec00fd60 con 0x7f79040acad0 2021-11-15T14:43:49.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- 172.21.2.135:0/3756948789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040acad0 msgr2=0x7f79040b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- 172.21.2.135:0/3756948789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040acad0 0x7f79040b2c80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f78ec002f70 tx=0x7f78ec006df0).stop 2021-11-15T14:43:49.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- 172.21.2.135:0/3756948789 shutdown_connections 2021-11-15T14:43:49.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- 172.21.2.135:0/3756948789 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040acad0 0x7f79040b2c80 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- 172.21.2.135:0/3756948789 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a9650 0x7f79040a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- 172.21.2.135:0/3756948789 >> 172.21.2.135:0/3756948789 conn(0x7f790405f730 msgr2=0x7f790405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- 172.21.2.135:0/3756948789 shutdown_connections 2021-11-15T14:43:49.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- 172.21.2.135:0/3756948789 wait complete. 2021-11-15T14:43:49.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 Processor -- start 2021-11-15T14:43:49.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- start start 2021-11-15T14:43:49.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a8aa0 0x7f790413adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.771 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79040acad0 0x7f7904156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.772 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790413d0e0 con 0x7f79040acad0 2021-11-15T14:43:49.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790415a3a0 con 0x7f79040a9650 2021-11-15T14:43:49.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f790a68c700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790415a640 con 0x7f79040a8aa0 2021-11-15T14:43:49.773 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36670/0 (socket says 172.21.2.135:36670) 2021-11-15T14:43:49.774 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/1822150768 learned_addr learned my addr 172.21.2.135:0/1822150768 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:49.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a8aa0 msgr2=0x7f790413adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.775 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a8aa0 0x7f790413adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79040acad0 msgr2=0x7f7904156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79040acad0 0x7f7904156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.776 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 -- 172.21.2.135:0/1822150768 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec00b180 con 0x7f79040a9650 2021-11-15T14:43:49.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.752+0000 7f79037fe700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f78ec002f70 tx=0x7f78ec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.777 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec01e070 con 0x7f79040a9650 2021-11-15T14:43:49.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec019e70 con 0x7f79040a9650 2021-11-15T14:43:49.778 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790415a8e0 con 0x7f79040a9650 2021-11-15T14:43:49.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec0192c0 con 0x7f79040a9650 2021-11-15T14:43:49.779 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790415b020 con 0x7f79040a9650 2021-11-15T14:43:49.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7904140210 con 0x7f79040a9650 2021-11-15T14:43:49.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78ec022400 con 0x7f79040a9650 2021-11-15T14:43:49.780 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 0x7f78e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f78ec06bc60 con 0x7f79040a9650 2021-11-15T14:43:49.781 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f7903fff700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 0x7f78e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f7903fff700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 0x7f78e8055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f78f4002f70 tx=0x7f78f4006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.782 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.756+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78ec042b00 con 0x7f79040a9650 2021-11-15T14:43:49.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f79040573d0 con 0x7f79040a9650 2021-11-15T14:43:49.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f79017fa700 1 -- 172.21.2.135:0/1822150768 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v164) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78ec046120 con 0x7f79040a9650 2021-11-15T14:43:49.844 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:49.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 msgr2=0x7f78e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 0x7f78e8055ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f78f4002f70 tx=0x7f78f4006a80).stop 2021-11-15T14:43:49.845 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 msgr2=0x7f79040abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f78ec002f70 tx=0x7f78ec017000).stop 2021-11-15T14:43:49.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 shutdown_connections 2021-11-15T14:43:49.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f78e8053610 0x7f78e8055ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.846 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f79040acad0 0x7f7904156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f79040a9650 0x7f79040abff0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 --2- 172.21.2.135:0/1822150768 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f79040a8aa0 0x7f790413adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 >> 172.21.2.135:0/1822150768 conn(0x7f790405f730 msgr2=0x7f79040b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 shutdown_connections 2021-11-15T14:43:49.847 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.840+0000 7f790a68c700 1 -- 172.21.2.135:0/1822150768 wait complete. 2021-11-15T14:43:49.851 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:49.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.924+0000 7fb1d584f700 1 Processor -- start 2021-11-15T14:43:49.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.924+0000 7fb1d584f700 1 -- start start 2021-11-15T14:43:49.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fb1d0060040 0x7fb1d0064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb1d00b2ca0 0x7fb1d0065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d00b2430 con 0x7fb1d00b3950 2021-11-15T14:43:49.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d0065770 con 0x7fb1d0060040 2021-11-15T14:43:49.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00b26d0 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1ce7fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fb1d00b3950 0x7fb1d00b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52498/0 (socket says 172.21.2.135:52498) 2021-11-15T14:43:49.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1ce7fc700 1 -- 172.21.2.135:0/3162913284 learned_addr learned my addr 172.21.2.135:0/3162913284 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:49.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3162913284 >> v2:172.21.2.135:3300/0 conn(0x7fb1d00b2ca0 0x7fb1d0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3162913284 >> v2:172.21.2.119:3300/0 conn(0x7fb1d0060040 msgr2=0x7fb1d0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:49.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3162913284 >> v2:172.21.2.119:3300/0 conn(0x7fb1d0060040 0x7fb1d0064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3162913284 >> v1:172.21.2.135:6789/0 conn(0x7fb1d00b3950 legacy=0x7fb1d00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3162913284 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00b2970 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3162913284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b2ca0 0x7fb1d0065280 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fb1c80032f0 tx=0x7fb1c80091d0).ready entity=mon.1 client_cookie=4e83ef7eb5b24d33 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cdffb700 1 -- 172.21.2.135:0/3162913284 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c8009ea0 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cdffb700 1 -- 172.21.2.135:0/3162913284 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800b870 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.936 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cdffb700 1 -- 172.21.2.135:0/3162913284 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c800b9e0 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3162913284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b2ca0 msgr2=0x7fb1d0065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3162913284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b2ca0 0x7fb1d0065280 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fb1c80032f0 tx=0x7fb1c80091d0).stop 2021-11-15T14:43:49.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3162913284 shutdown_connections 2021-11-15T14:43:49.937 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3162913284 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b2ca0 0x7fb1d0065280 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:49.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3162913284 >> v2:172.21.2.119:3300/0 conn(0x7fb1d0060040 0x7fb1d0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3162913284 >> 172.21.2.135:0/3162913284 conn(0x7fb1d005cfe0 msgr2=0x7fb1d005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:49.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3162913284 shutdown_connections 2021-11-15T14:43:49.938 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3162913284 wait complete. 2021-11-15T14:43:49.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 Processor -- start 2021-11-15T14:43:49.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- start start 2021-11-15T14:43:49.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb1d0060040 0x7fb1d0142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb1d00b2ca0 0x7fb1d00617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.939 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00621a0 con 0x7fb1d0060040 2021-11-15T14:43:49.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00626a0 con 0x7fb1d00b3950 2021-11-15T14:43:49.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00b6780 con 0x7fb1d00b2ca0 2021-11-15T14:43:49.940 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36684/0 (socket says 172.21.2.135:36684) 2021-11-15T14:43:49.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3645763235 learned_addr learned my addr 172.21.2.135:0/3645763235 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:49.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb1d00b2ca0 msgr2=0x7fb1d00617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb1d00b2ca0 0x7fb1d00617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.941 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb1d0060040 msgr2=0x7fb1d0142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:49.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb1d0060040 0x7fb1d0142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:49.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 -- 172.21.2.135:0/3645763235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009470 con 0x7fb1d00b3950 2021-11-15T14:43:49.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1cf7fe700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fb1c80032f0 tx=0x7fb1c8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.942 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c8021670 con 0x7fb1d00b3950 2021-11-15T14:43:49.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c80217d0 con 0x7fb1d00b3950 2021-11-15T14:43:49.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d013cb80 con 0x7fb1d00b3950 2021-11-15T14:43:49.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c8021b30 con 0x7fb1d00b3950 2021-11-15T14:43:49.943 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.928+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d00b54e0 con 0x7fb1d00b3950 2021-11-15T14:43:49.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d00b6940 con 0x7fb1d00b3950 2021-11-15T14:43:49.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1c800f070 con 0x7fb1d00b3950 2021-11-15T14:43:49.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1c7fff700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 0x7fb1b4055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:49.944 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb1c806d200 con 0x7fb1d00b3950 2021-11-15T14:43:49.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1ceffd700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 0x7fb1b4055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:49.945 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1ceffd700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 0x7fb1b4055a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb1c0002f70 tx=0x7fb1c0006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:49.946 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:49.932+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1c8044210 con 0x7fb1d00b3950 2021-11-15T14:43:50.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.016+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1d00648f0 con 0x7fb1d00b3950 2021-11-15T14:43:50.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1c7fff700 1 -- 172.21.2.135:0/3645763235 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1c80150a0 con 0x7fb1d00b3950 2021-11-15T14:43:50.023 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:50.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 msgr2=0x7fb1b4055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 0x7fb1b4055a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb1c0002f70 tx=0x7fb1c0006a80).stop 2021-11-15T14:43:50.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 msgr2=0x7fb1d00b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fb1c80032f0 tx=0x7fb1c8016000).stop 2021-11-15T14:43:50.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 shutdown_connections 2021-11-15T14:43:50.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb1b4053570 0x7fb1b4055a30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb1d00b3950 0x7fb1d00b4040 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb1d00b2ca0 0x7fb1d00617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 --2- 172.21.2.135:0/3645763235 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb1d0060040 0x7fb1d0142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 >> 172.21.2.135:0/3645763235 conn(0x7fb1d005cfe0 msgr2=0x7fb1d0143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 shutdown_connections 2021-11-15T14:43:50.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.020+0000 7fb1d584f700 1 -- 172.21.2.135:0/3645763235 wait complete. 2021-11-15T14:43:50.029 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 Processor -- start 2021-11-15T14:43:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 -- start start 2021-11-15T14:43:50.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f98f0060450 0x7f98f00aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f98f013f810 0x7f98f013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f0061a10 con 0x7f98f00a9f40 2021-11-15T14:43:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f0140170 con 0x7f98f013f810 2021-11-15T14:43:50.082 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f8241700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f0061cb0 con 0x7f98f0060450 2021-11-15T14:43:50.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f57dc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f98f0060450 0x7f98f00aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.085 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f57dc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f98f0060450 0x7f98f00aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36692/0 (socket says 172.21.2.135:36692) 2021-11-15T14:43:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.076+0000 7f98f57dc700 1 -- 172.21.2.135:0/1878819796 learned_addr learned my addr 172.21.2.135:0/1878819796 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f57dc700 1 -- 172.21.2.135:0/1878819796 >> v2:172.21.2.119:3300/0 conn(0x7f98f013f810 msgr2=0x7f98f013fc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f57dc700 1 --2- 172.21.2.135:0/1878819796 >> v2:172.21.2.119:3300/0 conn(0x7f98f013f810 0x7f98f013fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f57dc700 1 -- 172.21.2.135:0/1878819796 >> v1:172.21.2.119:6789/0 conn(0x7f98f00a9f40 legacy=0x7f98f013cd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f57dc700 1 -- 172.21.2.135:0/1878819796 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0060c10 con 0x7f98f0060450 2021-11-15T14:43:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f57dc700 1 --2- 172.21.2.135:0/1878819796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f0060450 0x7f98f00aa320 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f98f00abcc0 tx=0x7f98e4006eb0).ready entity=mon.1 client_cookie=bdb69d014923f6b9 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f4fdb700 1 -- 172.21.2.135:0/1878819796 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e400fa60 con 0x7f98f0060450 2021-11-15T14:43:50.087 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f4fdb700 1 -- 172.21.2.135:0/1878819796 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e4000e90 con 0x7f98f0060450 2021-11-15T14:43:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f4fdb700 1 -- 172.21.2.135:0/1878819796 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e400fdb0 con 0x7f98f0060450 2021-11-15T14:43:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/1878819796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f0060450 msgr2=0x7f98f00aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- 172.21.2.135:0/1878819796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f0060450 0x7f98f00aa320 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f98f00abcc0 tx=0x7f98e4006eb0).stop 2021-11-15T14:43:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/1878819796 shutdown_connections 2021-11-15T14:43:50.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- 172.21.2.135:0/1878819796 >> v2:172.21.2.119:3300/0 conn(0x7f98f013f810 0x7f98f013fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- 172.21.2.135:0/1878819796 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f0060450 0x7f98f00aa320 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/1878819796 >> 172.21.2.135:0/1878819796 conn(0x7f98f00b29f0 msgr2=0x7f98f00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/1878819796 shutdown_connections 2021-11-15T14:43:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/1878819796 wait complete. 2021-11-15T14:43:50.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 Processor -- start 2021-11-15T14:43:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- start start 2021-11-15T14:43:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f98f0060450 0x7f98f013e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98f00a9f40 0x7f98f013af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0146730 con 0x7f98f0060450 2021-11-15T14:43:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f01464d0 con 0x7f98f013f810 2021-11-15T14:43:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0145ea0 con 0x7f98f00a9f40 2021-11-15T14:43:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36694/0 (socket says 172.21.2.135:36694) 2021-11-15T14:43:50.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 -- 172.21.2.135:0/243979739 learned_addr learned my addr 172.21.2.135:0/243979739 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 -- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98f00a9f40 msgr2=0x7f98f013af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98f00a9f40 0x7f98f013af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 -- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f98f0060450 msgr2=0x7f98f013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f98f0060450 0x7f98f013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 -- 172.21.2.135:0/243979739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e400b1e0 con 0x7f98f013f810 2021-11-15T14:43:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f67de700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f98e8001250 tx=0x7f98e80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e80014e0 con 0x7f98f013f810 2021-11-15T14:43:50.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8001640 con 0x7f98f013f810 2021-11-15T14:43:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f013b8e0 con 0x7f98f013f810 2021-11-15T14:43:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e80019a0 con 0x7f98f013f810 2021-11-15T14:43:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f013cb40 con 0x7f98f013f810 2021-11-15T14:43:50.094 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f01460a0 con 0x7f98f013f810 2021-11-15T14:43:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98e8018030 con 0x7f98f013f810 2021-11-15T14:43:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.080+0000 7f98e2ffd700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 0x7f98d0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.095 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.084+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f98e806b4f0 con 0x7f98f013f810 2021-11-15T14:43:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.084+0000 7f98f5fdd700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 0x7f98d0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.084+0000 7f98f5fdd700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 0x7f98d0055a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f98ec002fb0 tx=0x7f98ec0069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.084+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98e80424a0 con 0x7f98f013f810 2021-11-15T14:43:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98f0060eb0 con 0x7f98f013f810 2021-11-15T14:43:50.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98e2ffd700 1 -- 172.21.2.135:0/243979739 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v164) v1 ==== 104+0+10 (secure 0 0 0) 0x7f98e8045ac0 con 0x7f98f013f810 2021-11-15T14:43:50.172 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:50.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 msgr2=0x7f98d0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 0x7f98d0055a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f98ec002fb0 tx=0x7f98ec0069b0).stop 2021-11-15T14:43:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 msgr2=0x7f98f013b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f98e8001250 tx=0x7f98e80090f0).stop 2021-11-15T14:43:50.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 shutdown_connections 2021-11-15T14:43:50.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f98d00535b0 0x7f98d0055a70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f98f013f810 0x7f98f013b3f0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f98f00a9f40 0x7f98f013af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 --2- 172.21.2.135:0/243979739 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f98f0060450 0x7f98f013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 >> 172.21.2.135:0/243979739 conn(0x7f98f00b29f0 msgr2=0x7f98f005c510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 shutdown_connections 2021-11-15T14:43:50.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.168+0000 7f98f8241700 1 -- 172.21.2.135:0/243979739 wait complete. 2021-11-15T14:43:50.180 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:50.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.228+0000 7f450cfdd700 1 Processor -- start 2021-11-15T14:43:50.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.228+0000 7f450cfdd700 1 -- start start 2021-11-15T14:43:50.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 0x7f450813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4508061a10 con 0x7f45080a9f40 2021-11-15T14:43:50.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508140190 con 0x7f450813f810 2021-11-15T14:43:50.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508061cb0 con 0x7f4508060450 2021-11-15T14:43:50.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4506d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 0x7f450813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4506d9d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 0x7f450813fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:58750/0 (socket says 172.21.2.135:58750) 2021-11-15T14:43:50.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:46482/0 (socket says 172.21.2.135:46482) 2021-11-15T14:43:50.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450659c700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f45080a9f40 0x7f450813cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:33706/0 (socket says 172.21.2.135:33706) 2021-11-15T14:43:50.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4506d9d700 1 -- 172.21.2.135:0/3850712266 learned_addr learned my addr 172.21.2.135:0/3850712266 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 -- 172.21.2.135:0/3850712266 >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 msgr2=0x7f450813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:50.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 --2- 172.21.2.135:0/3850712266 >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 0x7f450813fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 -- 172.21.2.135:0/3850712266 >> v1:172.21.2.119:6789/0 conn(0x7f45080a9f40 legacy=0x7f450813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 -- 172.21.2.135:0/3850712266 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508060c10 con 0x7f4508060450 2021-11-15T14:43:50.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f4505d9b700 1 --2- 172.21.2.135:0/3850712266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f44f8002f70 tx=0x7f44f8006df0).ready entity=mon.2 client_cookie=6ad638018096aac4 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450559a700 1 -- 172.21.2.135:0/3850712266 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f800d570 con 0x7f4508060450 2021-11-15T14:43:50.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450559a700 1 -- 172.21.2.135:0/3850712266 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8000e90 con 0x7f4508060450 2021-11-15T14:43:50.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450559a700 1 -- 172.21.2.135:0/3850712266 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f800d8c0 con 0x7f4508060450 2021-11-15T14:43:50.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- 172.21.2.135:0/3850712266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 msgr2=0x7f45080aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 --2- 172.21.2.135:0/3850712266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f44f8002f70 tx=0x7f44f8006df0).stop 2021-11-15T14:43:50.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- 172.21.2.135:0/3850712266 shutdown_connections 2021-11-15T14:43:50.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 --2- 172.21.2.135:0/3850712266 >> v2:172.21.2.119:3300/0 conn(0x7f450813f810 0x7f450813fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 --2- 172.21.2.135:0/3850712266 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f4508060450 0x7f45080aa320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.232+0000 7f450cfdd700 1 -- 172.21.2.135:0/3850712266 >> 172.21.2.135:0/3850712266 conn(0x7f45080b29f0 msgr2=0x7f45080b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- 172.21.2.135:0/3850712266 shutdown_connections 2021-11-15T14:43:50.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- 172.21.2.135:0/3850712266 wait complete. 2021-11-15T14:43:50.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 Processor -- start 2021-11-15T14:43:50.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- start start 2021-11-15T14:43:50.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f45080a9f40 0x7f45081540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.244 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f450813f810 0x7f45081545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508154a90 con 0x7f450813f810 2021-11-15T14:43:50.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081427f0 con 0x7f4508060450 2021-11-15T14:43:50.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508142a90 con 0x7f45080a9f40 2021-11-15T14:43:50.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36708/0 (socket says 172.21.2.135:36708) 2021-11-15T14:43:50.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 -- 172.21.2.135:0/878052826 learned_addr learned my addr 172.21.2.135:0/878052826 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 -- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f45080a9f40 msgr2=0x7f45081540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f45080a9f40 0x7f45081540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 -- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f450813f810 msgr2=0x7f45081545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f450813f810 0x7f45081545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 -- 172.21.2.135:0/878052826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f800b180 con 0x7f4508060450 2021-11-15T14:43:50.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450659c700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f450805fe10 tx=0x7f44f0007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f000ce30 con 0x7f4508060450 2021-11-15T14:43:50.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00072e0 con 0x7f4508060450 2021-11-15T14:43:50.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f0007450 con 0x7f4508060450 2021-11-15T14:43:50.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508142d30 con 0x7f4508060450 2021-11-15T14:43:50.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508146910 con 0x7f4508060450 2021-11-15T14:43:50.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508060eb0 con 0x7f4508060450 2021-11-15T14:43:50.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f44f0010070 con 0x7f4508060450 2021-11-15T14:43:50.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 0x7f44ec055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f44f006b2e0 con 0x7f4508060450 2021-11-15T14:43:50.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.236+0000 7f4505d9b700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 0x7f44ec055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.240+0000 7f4505d9b700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 0x7f44ec055a30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f44f8002f70 tx=0x7f44f8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.250 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.240+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44f00421e0 con 0x7f4508060450 2021-11-15T14:43:50.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45080573d0 con 0x7f4508060450 2021-11-15T14:43:50.327 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f44ff7fe700 1 -- 172.21.2.135:0/878052826 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+10 (secure 0 0 0) 0x7f44f0045800 con 0x7f4508060450 2021-11-15T14:43:50.328 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:50.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 msgr2=0x7f44ec055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 0x7f44ec055a30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f44f8002f70 tx=0x7f44f8014000).stop 2021-11-15T14:43:50.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 msgr2=0x7f4508146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.329 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f450805fe10 tx=0x7f44f0007c40).stop 2021-11-15T14:43:50.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 shutdown_connections 2021-11-15T14:43:50.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f44ec053570 0x7f44ec055a30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f450813f810 0x7f45081545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.330 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f45080a9f40 0x7f45081540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 --2- 172.21.2.135:0/878052826 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f4508060450 0x7f4508146420 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 >> 172.21.2.135:0/878052826 conn(0x7f45080b29f0 msgr2=0x7f450813e190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 shutdown_connections 2021-11-15T14:43:50.331 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.324+0000 7f450cfdd700 1 -- 172.21.2.135:0/878052826 wait complete. 2021-11-15T14:43:50.335 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:50.335 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:50.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 Processor -- start 2021-11-15T14:43:50.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- start start 2021-11-15T14:43:50.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7c7c0b1e30 0x7f7c7c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c7c0a7140 0x7f7c7c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0b03d0 con 0x7f7c7c148420 2021-11-15T14:43:50.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0a9140 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0b0670 con 0x7f7c7c0a7140 2021-11-15T14:43:50.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c7c0a7140 0x7f7c7c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7c7c0a7140 0x7f7c7c1447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36716/0 (socket says 172.21.2.135:36716) 2021-11-15T14:43:50.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 -- 172.21.2.135:0/2999892380 learned_addr learned my addr 172.21.2.135:0/2999892380 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 -- 172.21.2.135:0/2999892380 >> v2:172.21.2.119:3300/0 conn(0x7f7c7c0b1e30 msgr2=0x7f7c7c0b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:50.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 --2- 172.21.2.135:0/2999892380 >> v2:172.21.2.119:3300/0 conn(0x7f7c7c0b1e30 0x7f7c7c0b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 -- 172.21.2.135:0/2999892380 >> v1:172.21.2.119:6789/0 conn(0x7f7c7c148420 legacy=0x7f7c7c0b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:50.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 -- 172.21.2.135:0/2999892380 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0b0910 con 0x7f7c7c0a7140 2021-11-15T14:43:50.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7b7fe700 1 --2- 172.21.2.135:0/2999892380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c1447a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f7c7c1477b0 tx=0x7f7c74009290).ready entity=mon.1 client_cookie=80f070284ee9824 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c79ffb700 1 -- 172.21.2.135:0/2999892380 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7400b820 con 0x7f7c7c0a7140 2021-11-15T14:43:50.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c79ffb700 1 -- 172.21.2.135:0/2999892380 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400b980 con 0x7f7c7c0a7140 2021-11-15T14:43:50.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c79ffb700 1 -- 172.21.2.135:0/2999892380 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7400bb30 con 0x7f7c7c0a7140 2021-11-15T14:43:50.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- 172.21.2.135:0/2999892380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0a7140 msgr2=0x7f7c7c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- 172.21.2.135:0/2999892380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c1447a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f7c7c1477b0 tx=0x7f7c74009290).stop 2021-11-15T14:43:50.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- 172.21.2.135:0/2999892380 shutdown_connections 2021-11-15T14:43:50.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- 172.21.2.135:0/2999892380 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c1447a0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- 172.21.2.135:0/2999892380 >> v2:172.21.2.119:3300/0 conn(0x7f7c7c0b1e30 0x7f7c7c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- 172.21.2.135:0/2999892380 >> 172.21.2.135:0/2999892380 conn(0x7f7c7c05f730 msgr2=0x7f7c7c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- 172.21.2.135:0/2999892380 shutdown_connections 2021-11-15T14:43:50.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- 172.21.2.135:0/2999892380 wait complete. 2021-11-15T14:43:50.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 Processor -- start 2021-11-15T14:43:50.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- start start 2021-11-15T14:43:50.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c7c148420 0x7f7c7c0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0ab090 con 0x7f7c7c0a7140 2021-11-15T14:43:50.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c14ab50 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c81961700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0ab280 con 0x7f7c7c148420 2021-11-15T14:43:50.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36722/0 (socket says 172.21.2.135:36722) 2021-11-15T14:43:50.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 -- 172.21.2.135:0/2257193863 learned_addr learned my addr 172.21.2.135:0/2257193863 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:50.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 -- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c7c148420 msgr2=0x7f7c7c0ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c7c148420 0x7f7c7c0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 -- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c7c0a7140 msgr2=0x7f7c7c14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.384+0000 7f7c7a7fc700 1 -- 172.21.2.135:0/2257193863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009530 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c7a7fc700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f7c6c000ed0 tx=0x7f7c6c006d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6c009e00 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c012410 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6c012770 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c0ab520 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c149cb0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c0ab6b0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c6c00f030 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 0x7f7c60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:50.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7c6c06b6a0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c7affd700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 0x7f7c60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:50.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c7affd700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 0x7f7c60055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f7c64002fb0 tx=0x7f7c640069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:50.402 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.388+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c6c0426b0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.496+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c7c14ace0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c73fff700 1 -- 172.21.2.135:0/2257193863 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f7c6c045cd0 con 0x7f7c7c0b1e30 2021-11-15T14:43:50.502 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:50.503 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":83,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:43:48.242650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8707":{"gid":8707,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/945123846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":945123846},{"type":"v1","addr":"172.21.2.135:6835","nonce":945123846}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:43:50.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 msgr2=0x7f7c60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 0x7f7c60055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f7c64002fb0 tx=0x7f7c640069b0).stop 2021-11-15T14:43:50.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 msgr2=0x7f7c7c14b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:50.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f7c6c000ed0 tx=0x7f7c6c006d60).stop 2021-11-15T14:43:50.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 shutdown_connections 2021-11-15T14:43:50.505 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7c60053610 0x7f7c60055ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7c7c148420 0x7f7c7c0ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7c7c0b1e30 0x7f7c7c14b670 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:50.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 --2- 172.21.2.135:0/2257193863 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7c7c0a7140 0x7f7c7c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:50.506 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 >> 172.21.2.135:0/2257193863 conn(0x7f7c7c05f730 msgr2=0x7f7c7c0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:50.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 shutdown_connections 2021-11-15T14:43:50.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:50.500+0000 7f7c81961700 1 -- 172.21.2.135:0/2257193863 wait complete. 2021-11-15T14:43:50.507 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 83 2021-11-15T14:43:50.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:47.237805+0000', 'modified': '2021-11-15T14:43:48.242650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8707': {'gid': 8707, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/945123846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 945123846}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 945123846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:50.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:50.814 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:50.877 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8707,"want_state":"up:active","state":"up:active","rank_uptime":3.6278828820000002,"mdsmap_epoch":83,"osdmap_epoch":164,"osdmap_epoch_barrier":164,"uptime":7.8097008089999997} 2021-11-15T14:43:50.878 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8707, "mdsmap_epoch": 83, "osdmap_epoch": 164, "osdmap_epoch_barrier": 164, "rank_uptime": 3.627882882, "state": "up:active", "uptime": 7.809700809, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:50.878 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:50.879 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-15T14:43:50.879 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-15T14:43:50.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:50.880 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:50.891 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:50.903 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:50.903 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:50.951 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:50.952 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:50.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:50.953 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:50.958 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:50.958 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:50.961 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:50.969 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:50.970 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:50.975 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:50.976 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:50.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:50.977 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:50.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:2021-11-15T14:43:51.002+0000 7f0b73a99080 -1 init, newargv = 0x559132ffaff0 newargc=9 2021-11-15T14:43:50.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15342]: starting ceph client 2021-11-15T14:43:51.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba038.stderr:ceph-fuse[15342]: starting fuse 2021-11-15T14:43:52.103 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-15T14:43:52.116 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:52.117 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:52.164 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:52.164 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:52.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:52.166 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-15T14:43:52.171 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-15T14:43:52.171 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:52.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:52.172 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-15T14:43:52.173 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-15T14:43:52.173 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-15T14:43:52.174 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-15T14:43:52.174 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-15T14:43:52.175 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:52.175 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-15T14:43:52.175 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-15T14:43:52.176 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-15T14:43:52.176 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:52.177 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-15T14:43:52.177 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-15T14:43:52.177 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-15T14:43:52.178 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-15T14:43:52.178 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:52.179 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-15T14:43:52.179 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:52.179 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:52.180 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-15T14:43:52.180 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:52.181 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-15T14:43:52.181 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.0")) 2021-11-15T14:43:52.182 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-15T14:43:52.243 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.0.15342.asok 2021-11-15T14:43:52.243 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15342.asok 2021-11-15T14:43:52.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:52.244 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15342.asok status 2021-11-15T14:43:52.294 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-15T14:43:52.294 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-15T14:43:52.295 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:52.295 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:52.295 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "0", 2021-11-15T14:43:52.295 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-15T14:43:52.296 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-15T14:43:52.296 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "15342", 2021-11-15T14:43:52.296 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-15T14:43:52.296 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:52.297 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-15T14:43:52.297 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:52.297 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5216, 2021-11-15T14:43:52.297 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-15T14:43:52.298 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-15T14:43:52.298 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-15T14:43:52.298 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5216 2021-11-15T14:43:52.298 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:52.299 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:52.299 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:52.299 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:52.299 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3949030119 2021-11-15T14:43:52.299 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-15T14:43:52.300 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:52.300 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-15T14:43:52.300 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-15T14:43:52.300 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-15T14:43:52.301 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3949030119 2021-11-15T14:43:52.301 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-15T14:43:52.301 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5216 172.21.2.138:0/3949030119", 2021-11-15T14:43:52.301 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/3949030119", 2021-11-15T14:43:52.302 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-15T14:43:52.302 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 83, 2021-11-15T14:43:52.302 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 164, 2021-11-15T14:43:52.302 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:52.302 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-15T14:43:52.303 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-15T14:43:52.303 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-15T14:43:52.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:52.305 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:52.305 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:52.310 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-15T14:43:52.311 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-15T14:43:52.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:52.312 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:43:52.361 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T14:43:52.429 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.424+0000 7feac998b700 1 Processor -- start 2021-11-15T14:43:52.430 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.424+0000 7feac998b700 1 -- start start 2021-11-15T14:43:52.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 0x7feac40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac40b03d0 con 0x7feac40a7140 2021-11-15T14:43:52.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac40b0670 con 0x7feac4148420 2021-11-15T14:43:52.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac40a9140 con 0x7feac40b1e30 2021-11-15T14:43:52.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac27fc700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feac4148420 0x7feac40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52554/0 (socket says 172.21.2.135:52554) 2021-11-15T14:43:52.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac27fc700 1 -- 172.21.2.135:0/4104868349 learned_addr learned my addr 172.21.2.135:0/4104868349 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:52.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663019499 0 0) 0x7feac40b0670 con 0x7feac4148420 2021-11-15T14:43:52.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa4003260 con 0x7feac4148420 2021-11-15T14:43:52.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 0x7feac40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450127238 0 0) 0x7feaa4003260 con 0x7feac4148420 2021-11-15T14:43:52.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 msgr2=0x7feac40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:52.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 0x7feac40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 >> v1:172.21.2.119:6789/0 conn(0x7feac40a7140 legacy=0x7feac41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:52.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac40b0910 con 0x7feac4148420 2021-11-15T14:43:52.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7feaac001660 con 0x7feac4148420 2021-11-15T14:43:52.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 >> v1:172.21.2.135:6789/0 conn(0x7feac4148420 legacy=0x7feac40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feaa4003750 0x7feaa4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4004500 0x7feaa4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 0x7feaa4004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400b800 con 0x7feaa4004500 2021-11-15T14:43:52.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400b940 con 0x7feaa4003750 2021-11-15T14:43:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa400bb00 con 0x7feac40b1e30 2021-11-15T14:43:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feaa4003750 0x7feaa4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac27fc700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4004500 0x7feaa4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 -- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 msgr2=0x7feaa4004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:52.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac40b1e30 0x7feaa4004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 -- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4004500 msgr2=0x7feaa4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:52.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4004500 0x7feaa4004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 -- 172.21.2.135:0/4104868349 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4003260 con 0x7feaa4003750 2021-11-15T14:43:52.439 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac2ffd700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feaa4003750 0x7feaa4003b50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7feab400a000 tx=0x7feab4008040).ready entity=mon.1 client_cookie=669a7d05b6a3a594 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab4013670 con 0x7feaa4003750 2021-11-15T14:43:52.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40137d0 con 0x7feaa4003750 2021-11-15T14:43:52.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac1ffb700 1 -- 172.21.2.135:0/4104868349 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab4013b30 con 0x7feaa4003750 2021-11-15T14:43:52.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- 172.21.2.135:0/4104868349 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feaa4003750 msgr2=0x7feaa4003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 --2- 172.21.2.135:0/4104868349 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feaa4003750 0x7feaa4003b50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7feab400a000 tx=0x7feab4008040).stop 2021-11-15T14:43:52.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac37fe700 1 -- 172.21.2.135:0/4104868349 reap_dead start 2021-11-15T14:43:52.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- 172.21.2.135:0/4104868349 shutdown_connections 2021-11-15T14:43:52.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- 172.21.2.135:0/4104868349 >> 172.21.2.135:0/4104868349 conn(0x7feac405f730 msgr2=0x7feac405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- 172.21.2.135:0/4104868349 shutdown_connections 2021-11-15T14:43:52.441 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- 172.21.2.135:0/4104868349 wait complete. 2021-11-15T14:43:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 Processor -- start 2021-11-15T14:43:52.442 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.428+0000 7feac998b700 1 -- start start 2021-11-15T14:43:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4003750 0x7feac414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac414e9f0 0x7feac414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac414e130 con 0x7feaa4003750 2021-11-15T14:43:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac414d570 con 0x7feac40ab090 2021-11-15T14:43:52.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac40ab510 con 0x7feac414e9f0 2021-11-15T14:43:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36746/0 (socket says 172.21.2.135:36746) 2021-11-15T14:43:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 -- 172.21.2.135:0/2675493064 learned_addr learned my addr 172.21.2.135:0/2675493064 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 -- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac414e9f0 msgr2=0x7feac414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac414e9f0 0x7feac414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 -- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4003750 msgr2=0x7feac414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4003750 0x7feac414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 -- 172.21.2.135:0/2675493064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac40ab7a0 con 0x7feac40ab090 2021-11-15T14:43:52.447 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac37fe700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7feaac001370 tx=0x7feabc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc00ceb0 con 0x7feac40ab090 2021-11-15T14:43:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc005a90 con 0x7feac40ab090 2021-11-15T14:43:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac40aba40 con 0x7feac40ab090 2021-11-15T14:43:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc005e30 con 0x7feac40ab090 2021-11-15T14:43:52.448 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac40ac280 con 0x7feac40ab090 2021-11-15T14:43:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac40573d0 con 0x7feac40ab090 2021-11-15T14:43:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feabc01a060 con 0x7feac40ab090 2021-11-15T14:43:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 0x7feaa8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7feabc06b320 con 0x7feac40ab090 2021-11-15T14:43:52.449 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac2ffd700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 0x7feaa8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.432+0000 7feac2ffd700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 0x7feaa8055be0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7feab400a000 tx=0x7feab4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.450 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.436+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feabc042220 con 0x7feac40ab090 2021-11-15T14:43:52.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feac414e7d0 con 0x7feac40ab090 2021-11-15T14:43:52.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feabbfff700 1 -- 172.21.2.135:0/2675493064 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16285 (secure 0 0 0) 0x7feabc018020 con 0x7feac40ab090 2021-11-15T14:43:52.523 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:52.524 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":164,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:43:47.237415+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-15T14:43:45.185060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-15T14:43:46.224957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T14:43:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 msgr2=0x7feaa8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 0x7feaa8055be0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7feab400a000 tx=0x7feab4008040).stop 2021-11-15T14:43:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 msgr2=0x7feac40abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.525 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7feaac001370 tx=0x7feabc007dc0).stop 2021-11-15T14:43:52.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 shutdown_connections 2021-11-15T14:43:52.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7feaa8053720 0x7feaa8055be0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feac40ab090 0x7feac40abd90 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.526 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feac414e9f0 0x7feac414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 --2- 172.21.2.135:0/2675493064 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7feaa4003750 0x7feac414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 >> 172.21.2.135:0/2675493064 conn(0x7feac405f730 msgr2=0x7feac40aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 shutdown_connections 2021-11-15T14:43:52.527 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.520+0000 7feac998b700 1 -- 172.21.2.135:0/2675493064 wait complete. 2021-11-15T14:43:52.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-15T14:34:15.066105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-15T14:34:22.802865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-15T14:43:45.185060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-15T14:43:46.224957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-15T14:43:52.532 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-15T14:43:52.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 Processor -- start 2021-11-15T14:43:52.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 -- start start 2021-11-15T14:43:52.585 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f80e00a9f40 0x7f80e00aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f80e013f810 0x7f80e013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e0061a10 con 0x7f80e0060450 2021-11-15T14:43:52.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e0140170 con 0x7f80e013f810 2021-11-15T14:43:52.586 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e71fc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e0061cb0 con 0x7f80e00a9f40 2021-11-15T14:43:52.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f80e00a9f40 0x7f80e00aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80dffff700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f80e0060450 0x7f80e013cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52574/0 (socket says 172.21.2.135:52574) 2021-11-15T14:43:52.587 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80dffff700 1 -- 172.21.2.135:0/1123555236 learned_addr learned my addr 172.21.2.135:0/1123555236 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:52.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e5799700 1 --2- 172.21.2.135:0/1123555236 >> v2:172.21.2.119:3300/0 conn(0x7f80e013f810 0x7f80e013fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 -- 172.21.2.135:0/1123555236 >> v2:172.21.2.119:3300/0 conn(0x7f80e013f810 msgr2=0x7f80e013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:52.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 --2- 172.21.2.135:0/1123555236 >> v2:172.21.2.119:3300/0 conn(0x7f80e013f810 0x7f80e013fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 -- 172.21.2.135:0/1123555236 >> v1:172.21.2.135:6789/0 conn(0x7f80e0060450 legacy=0x7f80e013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 -- 172.21.2.135:0/1123555236 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e0060c10 con 0x7f80e00a9f40 2021-11-15T14:43:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80e4f98700 1 --2- 172.21.2.135:0/1123555236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00a9f40 0x7f80e00aa320 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f80e00aab70 tx=0x7f80c8006e80).ready entity=mon.1 client_cookie=7401e6500169425d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80df7fe700 1 -- 172.21.2.135:0/1123555236 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c800ba30 con 0x7f80e00a9f40 2021-11-15T14:43:52.592 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80df7fe700 1 -- 172.21.2.135:0/1123555236 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8000e90 con 0x7f80e00a9f40 2021-11-15T14:43:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.580+0000 7f80df7fe700 1 -- 172.21.2.135:0/1123555236 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c800bd80 con 0x7f80e00a9f40 2021-11-15T14:43:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/1123555236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00a9f40 msgr2=0x7f80e00aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- 172.21.2.135:0/1123555236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00a9f40 0x7f80e00aa320 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f80e00aab70 tx=0x7f80c8006e80).stop 2021-11-15T14:43:52.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/1123555236 shutdown_connections 2021-11-15T14:43:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- 172.21.2.135:0/1123555236 >> v2:172.21.2.119:3300/0 conn(0x7f80e013f810 0x7f80e013fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- 172.21.2.135:0/1123555236 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00a9f40 0x7f80e00aa320 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/1123555236 >> 172.21.2.135:0/1123555236 conn(0x7f80e00b29f0 msgr2=0x7f80e00b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/1123555236 shutdown_connections 2021-11-15T14:43:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/1123555236 wait complete. 2021-11-15T14:43:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 Processor -- start 2021-11-15T14:43:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- start start 2021-11-15T14:43:52.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80e0060450 0x7f80e01465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80e013f810 0x7f80e00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00b03b0 con 0x7f80e013f810 2021-11-15T14:43:52.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00b05e0 con 0x7f80e00ad500 2021-11-15T14:43:52.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00ad1c0 con 0x7f80e0060450 2021-11-15T14:43:52.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36760/0 (socket says 172.21.2.135:36760) 2021-11-15T14:43:52.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 -- 172.21.2.135:0/2794410306 learned_addr learned my addr 172.21.2.135:0/2794410306 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:52.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 -- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80e0060450 msgr2=0x7f80e01465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80e0060450 0x7f80e01465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 -- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80e013f810 msgr2=0x7f80e00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80e013f810 0x7f80e00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.598 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 -- 172.21.2.135:0/2794410306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c800d410 con 0x7f80e00ad500 2021-11-15T14:43:52.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e5799700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f80e00af8f0 tx=0x7f80d8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d8010580 con 0x7f80e00ad500 2021-11-15T14:43:52.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80106e0 con 0x7f80e00ad500 2021-11-15T14:43:52.599 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e0142ab0 con 0x7f80e00ad500 2021-11-15T14:43:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d8010a40 con 0x7f80e00ad500 2021-11-15T14:43:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e0142010 con 0x7f80e00ad500 2021-11-15T14:43:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e0060eb0 con 0x7f80e00ad500 2021-11-15T14:43:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f80d8010ba0 con 0x7f80e00ad500 2021-11-15T14:43:52.600 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 0x7f80c40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.584+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f80d806bf00 con 0x7f80e00ad500 2021-11-15T14:43:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.588+0000 7f80e4f98700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 0x7f80c40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.601 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.588+0000 7f80e4f98700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 0x7f80c40559b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f80c8009040 tx=0x7f80e0060da0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.602 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.588+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f80d8042f10 con 0x7f80e00ad500 2021-11-15T14:43:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f80e00573d0 con 0x7f80e00ad500 2021-11-15T14:43:52.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80ddffb700 1 -- 172.21.2.135:0/2794410306 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v164) v1 ==== 110+0+10 (secure 0 0 0) 0x7f80d8046530 con 0x7f80e00ad500 2021-11-15T14:43:52.676 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 1 2021-11-15T14:43:52.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 msgr2=0x7f80c40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 0x7f80c40559b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f80c8009040 tx=0x7f80e0060da0).stop 2021-11-15T14:43:52.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 msgr2=0x7f80e013ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f80e00af8f0 tx=0x7f80d8008040).stop 2021-11-15T14:43:52.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 shutdown_connections 2021-11-15T14:43:52.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c40534f0 0x7f80c40559b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80e00ad500 0x7f80e013ad30 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80e013f810 0x7f80e00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 --2- 172.21.2.135:0/2794410306 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80e0060450 0x7f80e01465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 >> 172.21.2.135:0/2794410306 conn(0x7f80e00b29f0 msgr2=0x7f80e013c060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 shutdown_connections 2021-11-15T14:43:52.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.672+0000 7f80e71fc700 1 -- 172.21.2.135:0/2794410306 wait complete. 2021-11-15T14:43:52.683 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-15T14:43:52.735 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 Processor -- start 2021-11-15T14:43:52.736 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- start start 2021-11-15T14:43:52.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f68040b1f40 0x7f68040b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f68040b0030 0x7f68040b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b04a0 con 0x7f68040a7140 2021-11-15T14:43:52.738 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b2810 con 0x7f68040b1f40 2021-11-15T14:43:52.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b06d0 con 0x7f68040b0030 2021-11-15T14:43:52.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f68040b0030 0x7f68040b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680897d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f68040a7140 0x7f68041412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52588/0 (socket says 172.21.2.135:52588) 2021-11-15T14:43:52.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680897d700 1 -- 172.21.2.135:0/1900313397 learned_addr learned my addr 172.21.2.135:0/1900313397 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:52.739 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 -- 172.21.2.135:0/1900313397 >> v2:172.21.2.119:3300/0 conn(0x7f68040b1f40 msgr2=0x7f68040b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:52.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 --2- 172.21.2.135:0/1900313397 >> v2:172.21.2.119:3300/0 conn(0x7f68040b1f40 0x7f68040b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 -- 172.21.2.135:0/1900313397 >> v1:172.21.2.135:6789/0 conn(0x7f68040a7140 legacy=0x7f68041412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 -- 172.21.2.135:0/1900313397 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040b0970 con 0x7f68040b0030 2021-11-15T14:43:52.740 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f68037fe700 1 --2- 172.21.2.135:0/1900313397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f68040b2320 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f67f4002f70 tx=0x7f67f4006df0).ready entity=mon.1 client_cookie=d8890addb8302cc6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f6802ffd700 1 -- 172.21.2.135:0/1900313397 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f400d5c0 con 0x7f68040b0030 2021-11-15T14:43:52.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f6802ffd700 1 -- 172.21.2.135:0/1900313397 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4000e90 con 0x7f68040b0030 2021-11-15T14:43:52.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f6802ffd700 1 -- 172.21.2.135:0/1900313397 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f400d950 con 0x7f68040b0030 2021-11-15T14:43:52.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- 172.21.2.135:0/1900313397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 msgr2=0x7f68040b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.741 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 --2- 172.21.2.135:0/1900313397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f68040b2320 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f67f4002f70 tx=0x7f67f4006df0).stop 2021-11-15T14:43:52.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- 172.21.2.135:0/1900313397 shutdown_connections 2021-11-15T14:43:52.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 --2- 172.21.2.135:0/1900313397 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f68040b2320 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 --2- 172.21.2.135:0/1900313397 >> v2:172.21.2.119:3300/0 conn(0x7f68040b1f40 0x7f68040b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.742 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- 172.21.2.135:0/1900313397 >> 172.21.2.135:0/1900313397 conn(0x7f680405f730 msgr2=0x7f680405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- 172.21.2.135:0/1900313397 shutdown_connections 2021-11-15T14:43:52.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.732+0000 7f680a3e0700 1 -- 172.21.2.135:0/1900313397 wait complete. 2021-11-15T14:43:52.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 Processor -- start 2021-11-15T14:43:52.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- start start 2021-11-15T14:43:52.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68040a7140 0x7f68040abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68040b1f40 0x7f680413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804140ce0 con 0x7f68040a7140 2021-11-15T14:43:52.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804140540 con 0x7f68040b0030 2021-11-15T14:43:52.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68041407a0 con 0x7f68040b1f40 2021-11-15T14:43:52.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36774/0 (socket says 172.21.2.135:36774) 2021-11-15T14:43:52.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 -- 172.21.2.135:0/71400790 learned_addr learned my addr 172.21.2.135:0/71400790 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:52.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 -- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68040b1f40 msgr2=0x7f680413ce20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:52.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68040b1f40 0x7f680413ce20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 -- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68040a7140 msgr2=0x7f68040abdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68040a7140 0x7f68040abdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 -- 172.21.2.135:0/71400790 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f400b180 con 0x7f68040b0030 2021-11-15T14:43:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68037fe700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f680414a180 tx=0x7f67f4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f4016070 con 0x7f68040b0030 2021-11-15T14:43:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f400de50 con 0x7f68040b0030 2021-11-15T14:43:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6804140a40 con 0x7f68040b0030 2021-11-15T14:43:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040aa380 con 0x7f68040b0030 2021-11-15T14:43:52.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f401e450 con 0x7f68040b0030 2021-11-15T14:43:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680414a4d0 con 0x7f68040b0030 2021-11-15T14:43:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67f4025030 con 0x7f68040b0030 2021-11-15T14:43:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 0x7f67e8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f67f406cdd0 con 0x7f68040b0030 2021-11-15T14:43:52.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.736+0000 7f6803fff700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 0x7f67e8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.740+0000 7f6803fff700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 0x7f67e8055b20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f67ec002ef0 tx=0x7f67ec006890).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.740+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67f4070030 con 0x7f68040b0030 2021-11-15T14:43:52.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.820+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f68040b0c10 con 0x7f68040b0030 2021-11-15T14:43:52.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.820+0000 7f68017fa700 1 -- 172.21.2.135:0/71400790 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67f4043cd0 con 0x7f68040b0030 2021-11-15T14:43:52.826 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:52.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 msgr2=0x7f67e8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 0x7f67e8055b20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f67ec002ef0 tx=0x7f67ec006890).stop 2021-11-15T14:43:52.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 msgr2=0x7f680413c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f680414a180 tx=0x7f67f4014000).stop 2021-11-15T14:43:52.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 shutdown_connections 2021-11-15T14:43:52.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f67e8053660 0x7f67e8055b20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f68040b1f40 0x7f680413ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f68040b0030 0x7f680413c930 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 --2- 172.21.2.135:0/71400790 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f68040a7140 0x7f68040abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 >> 172.21.2.135:0/71400790 conn(0x7f680405f730 msgr2=0x7f68040b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 shutdown_connections 2021-11-15T14:43:52.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.824+0000 7f680a3e0700 1 -- 172.21.2.135:0/71400790 wait complete. 2021-11-15T14:43:52.833 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-15T14:43:52.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.892+0000 7f07983ae700 1 Processor -- start 2021-11-15T14:43:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.892+0000 7f07983ae700 1 -- start start 2021-11-15T14:43:52.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f07900b1f40 0x7f07900b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900b0030 0x7f07900b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07900b04a0 con 0x7f07900a7140 2021-11-15T14:43:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900b2810 con 0x7f07900b1f40 2021-11-15T14:43:52.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b06d0 con 0x7f07900b0030 2021-11-15T14:43:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f07900a7140 0x7f07901412d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52602/0 (socket says 172.21.2.135:52602) 2021-11-15T14:43:52.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 -- 172.21.2.135:0/4126850739 learned_addr learned my addr 172.21.2.135:0/4126850739 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:43:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 --2- 172.21.2.135:0/4126850739 >> v2:172.21.2.135:3300/0 conn(0x7f07900b1f40 0x7f07900b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 -- 172.21.2.135:0/4126850739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900b0030 msgr2=0x7f07900b2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:52.904 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 --2- 172.21.2.135:0/4126850739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900b0030 0x7f07900b2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 -- 172.21.2.135:0/4126850739 >> v1:172.21.2.135:6789/0 conn(0x7f07900a7140 legacy=0x7f07901412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 -- 172.21.2.135:0/4126850739 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900b0970 con 0x7f07900b1f40 2021-11-15T14:43:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079614a700 1 --2- 172.21.2.135:0/4126850739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07900b1350 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c006df0).ready entity=mon.1 client_cookie=333504516e89abe2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f0795148700 1 -- 172.21.2.135:0/4126850739 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c00d570 con 0x7f07900b1f40 2021-11-15T14:43:52.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f0795148700 1 -- 172.21.2.135:0/4126850739 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c000e90 con 0x7f07900b1f40 2021-11-15T14:43:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f0795148700 1 -- 172.21.2.135:0/4126850739 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c00d900 con 0x7f07900b1f40 2021-11-15T14:43:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/4126850739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 msgr2=0x7f07900b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- 172.21.2.135:0/4126850739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07900b1350 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c006df0).stop 2021-11-15T14:43:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/4126850739 shutdown_connections 2021-11-15T14:43:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- 172.21.2.135:0/4126850739 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900b0030 0x7f07900b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- 172.21.2.135:0/4126850739 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07900b1350 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/4126850739 >> 172.21.2.135:0/4126850739 conn(0x7f079005f730 msgr2=0x7f079005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/4126850739 shutdown_connections 2021-11-15T14:43:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/4126850739 wait complete. 2021-11-15T14:43:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 Processor -- start 2021-11-15T14:43:52.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- start start 2021-11-15T14:43:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900a7140 0x7f07900a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07900b0030 0x7f07900ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900aa650 con 0x7f07900b0030 2021-11-15T14:43:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079014a1e0 con 0x7f07900b1f40 2021-11-15T14:43:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079014a480 con 0x7f07900a7140 2021-11-15T14:43:52.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36784/0 (socket says 172.21.2.135:36784) 2021-11-15T14:43:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 -- 172.21.2.135:0/56027878 learned_addr learned my addr 172.21.2.135:0/56027878 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 -- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900a7140 msgr2=0x7f07900a96a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:52.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900a7140 0x7f07900a96a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 -- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07900b0030 msgr2=0x7f07900ae850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T14:43:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07900b0030 0x7f07900ae850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 -- 172.21.2.135:0/56027878 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c00b180 con 0x7f07900b1f40 2021-11-15T14:43:52.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f079694b700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f079006a170 tx=0x7f0788007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0788005ba0 con 0x7f07900b1f40 2021-11-15T14:43:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0788005d00 con 0x7f07900b1f40 2021-11-15T14:43:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07901570d0 con 0x7f07900b1f40 2021-11-15T14:43:52.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0790149ee0 con 0x7f07900b1f40 2021-11-15T14:43:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.896+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07880072c0 con 0x7f07900b1f40 2021-11-15T14:43:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07900b0c10 con 0x7f07900b1f40 2021-11-15T14:43:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0788010070 con 0x7f07900b1f40 2021-11-15T14:43:52.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f07837fe700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 0x7f0770055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:52.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f078806b440 con 0x7f07900b1f40 2021-11-15T14:43:52.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f079614a700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 0x7f0770055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:52.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f079614a700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 0x7f0770055ad0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:52.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.900+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0788042340 con 0x7f07900b1f40 2021-11-15T14:43:52.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.984+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07900573d0 con 0x7f07900b1f40 2021-11-15T14:43:52.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.984+0000 7f07837fe700 1 -- 172.21.2.135:0/56027878 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v164) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0788045960 con 0x7f07900b1f40 2021-11-15T14:43:52.990 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:52.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 msgr2=0x7f0770055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 0x7f0770055ad0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c015000).stop 2021-11-15T14:43:52.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 msgr2=0x7f07901499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:52.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f079006a170 tx=0x7f0788007f00).stop 2021-11-15T14:43:52.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 shutdown_connections 2021-11-15T14:43:52.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0770053610 0x7f0770055ad0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f07900b1f40 0x7f07901499f0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:52.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f07900b0030 0x7f07900ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 --2- 172.21.2.135:0/56027878 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f07900a7140 0x7f07900a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:52.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 >> 172.21.2.135:0/56027878 conn(0x7f079005f730 msgr2=0x7f079013eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:52.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 shutdown_connections 2021-11-15T14:43:52.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:52.988+0000 7f07983ae700 1 -- 172.21.2.135:0/56027878 wait complete. 2021-11-15T14:43:52.997 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-15T14:43:53.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 Processor -- start 2021-11-15T14:43:53.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 -- start start 2021-11-15T14:43:53.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 0x7f42c01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.051 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c00a7850 con 0x7f42c00b1f40 2021-11-15T14:43:53.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c00b17c0 con 0x7f42c00b1350 2021-11-15T14:43:53.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c6b96700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00b06d0 con 0x7f42c00b2320 2021-11-15T14:43:53.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42bffff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 0x7f42c01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42bffff700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:58840/0 (socket says 172.21.2.135:58840) 2021-11-15T14:43:53.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42bffff700 1 -- 172.21.2.135:0/153249946 learned_addr learned my addr 172.21.2.135:0/153249946 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 -- 172.21.2.135:0/153249946 >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 msgr2=0x7f42c00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:53.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 --2- 172.21.2.135:0/153249946 >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 -- 172.21.2.135:0/153249946 >> v1:172.21.2.119:6789/0 conn(0x7f42c00b1f40 legacy=0x7f42c00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 -- 172.21.2.135:0/153249946 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00b0970 con 0x7f42c00b2320 2021-11-15T14:43:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42bffff700 1 --2- 172.21.2.135:0/153249946 >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T14:43:53.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.048+0000 7f42c5133700 1 --2- 172.21.2.135:0/153249946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 0x7f42c01412d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f42b80032f0 tx=0x7f42b80091d0).ready entity=mon.2 client_cookie=f9a962b9d87fcbb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bf7fe700 1 -- 172.21.2.135:0/153249946 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b800b6c0 con 0x7f42c00b2320 2021-11-15T14:43:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bf7fe700 1 -- 172.21.2.135:0/153249946 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b800b820 con 0x7f42c00b2320 2021-11-15T14:43:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bf7fe700 1 -- 172.21.2.135:0/153249946 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b800b990 con 0x7f42c00b2320 2021-11-15T14:43:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/153249946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 msgr2=0x7f42c01412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- 172.21.2.135:0/153249946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 0x7f42c01412d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f42b80032f0 tx=0x7f42b80091d0).stop 2021-11-15T14:43:53.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/153249946 shutdown_connections 2021-11-15T14:43:53.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- 172.21.2.135:0/153249946 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b2320 0x7f42c01412d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- 172.21.2.135:0/153249946 >> v2:172.21.2.119:3300/0 conn(0x7f42c00b1350 0x7f42c00b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/153249946 >> 172.21.2.135:0/153249946 conn(0x7f42c005f730 msgr2=0x7f42c005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:53.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/153249946 shutdown_connections 2021-11-15T14:43:53.061 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/153249946 wait complete. 2021-11-15T14:43:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 Processor -- start 2021-11-15T14:43:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- start start 2021-11-15T14:43:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 0x7f42c00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.062 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 0x7f42c015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00af110 con 0x7f42c00b1f40 2021-11-15T14:43:53.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c015b090 con 0x7f42c00b2320 2021-11-15T14:43:53.063 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00af370 con 0x7f42c00b1350 2021-11-15T14:43:53.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36798/0 (socket says 172.21.2.135:36798) 2021-11-15T14:43:53.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 -- 172.21.2.135:0/2674104482 learned_addr learned my addr 172.21.2.135:0/2674104482 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:53.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bffff700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 0x7f42c015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.064 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 -- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 msgr2=0x7f42c00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c4932700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 0x7f42c00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 0x7f42c00afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 -- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 msgr2=0x7f42c015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 0x7f42c015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.065 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 -- 172.21.2.135:0/2674104482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b000b1e0 con 0x7f42c00b2320 2021-11-15T14:43:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bffff700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 0x7f42c015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c4932700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 0x7f42c00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:43:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c5133700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f42b80032f0 tx=0x7f42b8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.066 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b800b6c0 con 0x7f42c00b2320 2021-11-15T14:43:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8011e50 con 0x7f42c00b2320 2021-11-15T14:43:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b80107a0 con 0x7f42c00b2320 2021-11-15T14:43:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b8009470 con 0x7f42c00b2320 2021-11-15T14:43:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.052+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c00af8b0 con 0x7f42c00b2320 2021-11-15T14:43:53.067 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c00afa70 con 0x7f42c00b2320 2021-11-15T14:43:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42b800f070 con 0x7f42c00b2320 2021-11-15T14:43:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42bdffb700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 0x7f42a4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f42b806cf90 con 0x7f42c00b2320 2021-11-15T14:43:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42c4932700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 0x7f42a4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.068 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42c4932700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 0x7f42a4055a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f42a8008000 tx=0x7f42a8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.069 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.056+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42b8043e90 con 0x7f42c00b2320 2021-11-15T14:43:53.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42c00573d0 con 0x7f42c00b2320 2021-11-15T14:43:53.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42bdffb700 1 -- 172.21.2.135:0/2674104482 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+10 (secure 0 0 0) 0x7f42b80150a0 con 0x7f42c00b2320 2021-11-15T14:43:53.145 INFO:teuthology.orchestra.run.gibba035.stdout:pg_num: 8 2021-11-15T14:43:53.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 msgr2=0x7f42a4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 0x7f42a4055a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f42a8008000 tx=0x7f42a8009040).stop 2021-11-15T14:43:53.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 msgr2=0x7f42c015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f42b80032f0 tx=0x7f42b8016000).stop 2021-11-15T14:43:53.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 shutdown_connections 2021-11-15T14:43:53.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f42a40535d0 0x7f42a4055a90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f42c00b2320 0x7f42c015aba0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f42c00b1f40 0x7f42c015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 --2- 172.21.2.135:0/2674104482 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f42c00b1350 0x7f42c00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 >> 172.21.2.135:0/2674104482 conn(0x7f42c005f730 msgr2=0x7f42c013cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:53.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 shutdown_connections 2021-11-15T14:43:53.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.140+0000 7f42c6b96700 1 -- 172.21.2.135:0/2674104482 wait complete. 2021-11-15T14:43:53.152 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-15T14:43:53.152 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:43:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 Processor -- start 2021-11-15T14:43:53.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- start start 2021-11-15T14:43:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40b1e30 0x7efec40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efec4148420 0x7efec40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40b03d0 con 0x7efec40a7140 2021-11-15T14:43:53.204 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40a9140 con 0x7efec4148420 2021-11-15T14:43:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b0670 con 0x7efec40b1e30 2021-11-15T14:43:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efec4148420 0x7efec40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7efec4148420 0x7efec40b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36810/0 (socket says 172.21.2.135:36810) 2021-11-15T14:43:53.205 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 -- 172.21.2.135:0/2003347157 learned_addr learned my addr 172.21.2.135:0/2003347157 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 -- 172.21.2.135:0/2003347157 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40b1e30 msgr2=0x7efec40b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:43:53.208 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 --2- 172.21.2.135:0/2003347157 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40b1e30 0x7efec40b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 -- 172.21.2.135:0/2003347157 >> v1:172.21.2.119:6789/0 conn(0x7efec40a7140 legacy=0x7efec41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:43:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 -- 172.21.2.135:0/2003347157 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40b0910 con 0x7efec4148420 2021-11-15T14:43:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec9699700 1 --2- 172.21.2.135:0/2003347157 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40b2210 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7efec4061420 tx=0x7efec0006eb0).ready entity=mon.1 client_cookie=7a30bc5fc27d5955 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec8e98700 1 -- 172.21.2.135:0/2003347157 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec000d570 con 0x7efec4148420 2021-11-15T14:43:53.209 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec8e98700 1 -- 172.21.2.135:0/2003347157 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0000e90 con 0x7efec4148420 2021-11-15T14:43:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efec8e98700 1 -- 172.21.2.135:0/2003347157 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec000d8c0 con 0x7efec4148420 2021-11-15T14:43:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- 172.21.2.135:0/2003347157 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 msgr2=0x7efec40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 --2- 172.21.2.135:0/2003347157 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40b2210 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7efec4061420 tx=0x7efec0006eb0).stop 2021-11-15T14:43:53.210 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- 172.21.2.135:0/2003347157 shutdown_connections 2021-11-15T14:43:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 --2- 172.21.2.135:0/2003347157 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40b2210 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 --2- 172.21.2.135:0/2003347157 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40b1e30 0x7efec40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- 172.21.2.135:0/2003347157 >> 172.21.2.135:0/2003347157 conn(0x7efec405f730 msgr2=0x7efec405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:53.211 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- 172.21.2.135:0/2003347157 shutdown_connections 2021-11-15T14:43:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- 172.21.2.135:0/2003347157 wait complete. 2021-11-15T14:43:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 Processor -- start 2021-11-15T14:43:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.200+0000 7efecc0fe700 1 -- start start 2021-11-15T14:43:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40a7140 0x7efec40ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.212 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efec40b1e30 0x7efec415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415b020 con 0x7efec40b1e30 2021-11-15T14:43:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40aac40 con 0x7efec4148420 2021-11-15T14:43:53.213 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40aaed0 con 0x7efec40a7140 2021-11-15T14:43:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36814/0 (socket says 172.21.2.135:36814) 2021-11-15T14:43:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 -- 172.21.2.135:0/3051369580 learned_addr learned my addr 172.21.2.135:0/3051369580 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:43:53.214 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 -- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40a7140 msgr2=0x7efec40ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40a7140 0x7efec40ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 -- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efec40b1e30 msgr2=0x7efec415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efec40b1e30 0x7efec415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 -- 172.21.2.135:0/3051369580 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec000b1e0 con 0x7efec4148420 2021-11-15T14:43:53.215 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeca69b700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7efebc003310 tx=0x7efebc0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc001500 con 0x7efec4148420 2021-11-15T14:43:53.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc001660 con 0x7efec4148420 2021-11-15T14:43:53.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40ab170 con 0x7efec4148420 2021-11-15T14:43:53.216 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efebc0019c0 con 0x7efec4148420 2021-11-15T14:43:53.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec4156b20 con 0x7efec4148420 2021-11-15T14:43:53.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40b0bb0 con 0x7efec4148420 2021-11-15T14:43:53.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efebc018030 con 0x7efec4148420 2021-11-15T14:43:53.217 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 0x7efea4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:43:53.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efebc06b4c0 con 0x7efec4148420 2021-11-15T14:43:53.218 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.204+0000 7efec9e9a700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 0x7efea4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:43:53.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.208+0000 7efec9e9a700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 0x7efea4055b20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7efeb4002fb0 tx=0x7efeb40069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:43:53.219 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.208+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efebc042580 con 0x7efec4148420 2021-11-15T14:43:53.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.316+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efec40573d0 con 0x7efec4148420 2021-11-15T14:43:53.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.316+0000 7efeb2ffd700 1 -- 172.21.2.135:0/3051369580 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2489 (secure 0 0 0) 0x7efebc045ba0 con 0x7efec4148420 2021-11-15T14:43:53.322 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:43:53.322 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":83,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:43:48.242650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8707":{"gid":8707,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/945123846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":945123846},{"type":"v1","addr":"172.21.2.135:6835","nonce":945123846}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:43:53.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 msgr2=0x7efea4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 0x7efea4055b20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7efeb4002fb0 tx=0x7efeb40069b0).stop 2021-11-15T14:43:53.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 msgr2=0x7efec40aa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:43:53.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7efebc003310 tx=0x7efebc0091a0).stop 2021-11-15T14:43:53.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 shutdown_connections 2021-11-15T14:43:53.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7efea4053660 0x7efea4055b20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7efec4148420 0x7efec40aa750 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:43:53.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7efec40b1e30 0x7efec415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 --2- 172.21.2.135:0/3051369580 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7efec40a7140 0x7efec40ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:43:53.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 >> 172.21.2.135:0/3051369580 conn(0x7efec405f730 msgr2=0x7efec4140740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:43:53.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 shutdown_connections 2021-11-15T14:43:53.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:43:53.320+0000 7efecc0fe700 1 -- 172.21.2.135:0/3051369580 wait complete. 2021-11-15T14:43:53.326 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 83 2021-11-15T14:43:53.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-15T14:43:47.237805+0000', 'modified': '2021-11-15T14:43:48.242650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8707': {'gid': 8707, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.135:6835/945123846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.135:6833', 'nonce': 945123846}, {'type': 'v1', 'addr': '172.21.2.135:6835', 'nonce': 945123846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-15T14:43:53.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-15T14:43:53.631 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-11-15T14:43:53.696 INFO:teuthology.orchestra.run.gibba035.stdout:{"cluster_fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","whoami":0,"id":8707,"want_state":"up:active","state":"up:active","rank_uptime":6.4463783179999998,"mdsmap_epoch":83,"osdmap_epoch":164,"osdmap_epoch_barrier":164,"uptime":10.628180082} 2021-11-15T14:43:53.696 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", "id": 8707, "mdsmap_epoch": 83, "osdmap_epoch": 164, "osdmap_epoch_barrier": 164, "rank_uptime": 6.446378318, "state": "up:active", "uptime": 10.628180082, "want_state": "up:active", "whoami": 0 } 2021-11-15T14:43:53.697 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-15T14:43:53.697 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-15T14:43:53.698 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba032.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-15T14:43:53.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:53.699 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:53.710 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:53.764 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:53.765 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:53.771 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:53.771 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:53.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:53.773 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:53.777 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-15T14:43:53.777 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:53.820 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:53.828 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:53.829 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:53.834 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:53.834 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:53.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:53.836 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:53.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14890]: starting ceph client 2021-11-15T14:43:53.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:2021-11-15T14:43:53.850+0000 7fa1ef2b5080 -1 init, newargv = 0x5644e95da050 newargc=9 2021-11-15T14:43:53.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14890]: starting fuse 2021-11-15T14:43:54.940 DEBUG:teuthology.orchestra.run.gibba032:> sudo modprobe fuse 2021-11-15T14:43:54.952 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-15T14:43:54.953 DEBUG:teuthology.orchestra.run.gibba032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-15T14:43:55.001 INFO:teuthology.orchestra.run.gibba032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-15T14:43:55.001 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-15T14:43:55.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.003 DEBUG:teuthology.orchestra.run.gibba032:> ls /sys/fs/fuse/connections 2021-11-15T14:43:55.008 INFO:teuthology.orchestra.run.gibba032.stdout:52 2021-11-15T14:43:55.008 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-15T14:43:55.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.009 DEBUG:teuthology.orchestra.run.gibba032:> sudo python3 -c ' 2021-11-15T14:43:55.010 DEBUG:teuthology.orchestra.run.gibba032:> import glob 2021-11-15T14:43:55.010 DEBUG:teuthology.orchestra.run.gibba032:> import re 2021-11-15T14:43:55.011 DEBUG:teuthology.orchestra.run.gibba032:> import os 2021-11-15T14:43:55.011 DEBUG:teuthology.orchestra.run.gibba032:> import subprocess 2021-11-15T14:43:55.011 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:55.012 DEBUG:teuthology.orchestra.run.gibba032:> def find_socket(client_name): 2021-11-15T14:43:55.012 DEBUG:teuthology.orchestra.run.gibba032:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-15T14:43:55.013 DEBUG:teuthology.orchestra.run.gibba032:> files = glob.glob(asok_path) 2021-11-15T14:43:55.013 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:55.013 DEBUG:teuthology.orchestra.run.gibba032:> # Given a non-glob path, it better be there 2021-11-15T14:43:55.014 DEBUG:teuthology.orchestra.run.gibba032:> if "*" not in asok_path: 2021-11-15T14:43:55.014 DEBUG:teuthology.orchestra.run.gibba032:> assert(len(files) == 1) 2021-11-15T14:43:55.015 DEBUG:teuthology.orchestra.run.gibba032:> return files[0] 2021-11-15T14:43:55.015 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:55.015 DEBUG:teuthology.orchestra.run.gibba032:> for f in files: 2021-11-15T14:43:55.016 DEBUG:teuthology.orchestra.run.gibba032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-15T14:43:55.016 DEBUG:teuthology.orchestra.run.gibba032:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-15T14:43:55.017 DEBUG:teuthology.orchestra.run.gibba032:> return f 2021-11-15T14:43:55.017 DEBUG:teuthology.orchestra.run.gibba032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-15T14:43:55.018 DEBUG:teuthology.orchestra.run.gibba032:> 2021-11-15T14:43:55.018 DEBUG:teuthology.orchestra.run.gibba032:> print(find_socket("client.1")) 2021-11-15T14:43:55.018 DEBUG:teuthology.orchestra.run.gibba032:> ' 2021-11-15T14:43:55.083 INFO:teuthology.orchestra.run.gibba032.stdout:/var/run/ceph/ceph-client.1.14890.asok 2021-11-15T14:43:55.086 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14890.asok 2021-11-15T14:43:55.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.087 DEBUG:teuthology.orchestra.run.gibba032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14890.asok status 2021-11-15T14:43:55.134 INFO:teuthology.orchestra.run.gibba032.stdout:{ 2021-11-15T14:43:55.135 INFO:teuthology.orchestra.run.gibba032.stdout: "metadata": { 2021-11-15T14:43:55.135 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_sha1": "b0aaed0fe8cdfe99c82a70b230004934b51091ff", 2021-11-15T14:43:55.135 INFO:teuthology.orchestra.run.gibba032.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-15T14:43:55.136 INFO:teuthology.orchestra.run.gibba032.stdout: "entity_id": "1", 2021-11-15T14:43:55.136 INFO:teuthology.orchestra.run.gibba032.stdout: "hostname": "gibba032", 2021-11-15T14:43:55.136 INFO:teuthology.orchestra.run.gibba032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-15T14:43:55.137 INFO:teuthology.orchestra.run.gibba032.stdout: "pid": "14890", 2021-11-15T14:43:55.137 INFO:teuthology.orchestra.run.gibba032.stdout: "root": "/" 2021-11-15T14:43:55.137 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:55.138 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_count": 0, 2021-11-15T14:43:55.138 INFO:teuthology.orchestra.run.gibba032.stdout: "dentry_pinned_count": 0, 2021-11-15T14:43:55.138 INFO:teuthology.orchestra.run.gibba032.stdout: "id": 5228, 2021-11-15T14:43:55.139 INFO:teuthology.orchestra.run.gibba032.stdout: "inst": { 2021-11-15T14:43:55.139 INFO:teuthology.orchestra.run.gibba032.stdout: "name": { 2021-11-15T14:43:55.139 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "client", 2021-11-15T14:43:55.139 INFO:teuthology.orchestra.run.gibba032.stdout: "num": 5228 2021-11-15T14:43:55.140 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:55.140 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:55.140 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:55.141 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:55.141 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 1526736643 2021-11-15T14:43:55.141 INFO:teuthology.orchestra.run.gibba032.stdout: } 2021-11-15T14:43:55.141 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:55.142 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": { 2021-11-15T14:43:55.142 INFO:teuthology.orchestra.run.gibba032.stdout: "type": "v1", 2021-11-15T14:43:55.142 INFO:teuthology.orchestra.run.gibba032.stdout: "addr": "172.21.2.132:0", 2021-11-15T14:43:55.142 INFO:teuthology.orchestra.run.gibba032.stdout: "nonce": 1526736643 2021-11-15T14:43:55.142 INFO:teuthology.orchestra.run.gibba032.stdout: }, 2021-11-15T14:43:55.143 INFO:teuthology.orchestra.run.gibba032.stdout: "inst_str": "client.5228 172.21.2.132:0/1526736643", 2021-11-15T14:43:55.143 INFO:teuthology.orchestra.run.gibba032.stdout: "addr_str": "172.21.2.132:0/1526736643", 2021-11-15T14:43:55.143 INFO:teuthology.orchestra.run.gibba032.stdout: "inode_count": 1, 2021-11-15T14:43:55.143 INFO:teuthology.orchestra.run.gibba032.stdout: "mds_epoch": 83, 2021-11-15T14:43:55.144 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch": 164, 2021-11-15T14:43:55.144 INFO:teuthology.orchestra.run.gibba032.stdout: "osd_epoch_barrier": 0, 2021-11-15T14:43:55.144 INFO:teuthology.orchestra.run.gibba032.stdout: "blacklisted": false, 2021-11-15T14:43:55.144 INFO:teuthology.orchestra.run.gibba032.stdout: "fs_name": "cephfs" 2021-11-15T14:43:55.144 INFO:teuthology.orchestra.run.gibba032.stdout:} 2021-11-15T14:43:55.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.146 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:55.147 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.152 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:55.152 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:55.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.153 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.203 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:55.204 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.209 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:55.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:55.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.211 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:55.211 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.217 INFO:teuthology.orchestra.run.gibba032.stdout:fuseblk 2021-11-15T14:43:55.218 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-15T14:43:55.219 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba032.front.sepia.ceph.com... 2021-11-15T14:43:55.219 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-15T14:43:55.219 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba032.stderr:ceph-fuse[14890]: fuse finished with error 0 and tester_r 0 2021-11-15T14:43:55.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:43:55.276 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:43:55.277 DEBUG:teuthology.orchestra.run.gibba032:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:43:55.281 INFO:teuthology.orchestra.run.gibba032.stdout:ext2/ext3 2021-11-15T14:43:55.281 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-15T14:43:55.281 INFO:teuthology.orchestra.run:waiting for 900 2021-11-15T14:44:01.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-15T14:44:01.384 DEBUG:teuthology.orchestra.run.gibba032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-15T14:44:01.394 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-15T14:44:01.395 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-15T14:44:01.415 INFO:teuthology.orchestra.run.gibba038.stdout: File: "." 2021-11-15T14:44:01.416 INFO:teuthology.orchestra.run.gibba038.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-11-15T14:44:01.416 INFO:teuthology.orchestra.run.gibba038.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-11-15T14:44:01.416 INFO:teuthology.orchestra.run.gibba038.stdout:Blocks: Total: 86525 Free: 86525 Available: 86525 2021-11-15T14:44:01.417 INFO:teuthology.orchestra.run.gibba038.stdout:Inodes: Total: 1 Free: 0 2021-11-15T14:44:01.418 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-15T14:44:01.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 Processor -- start 2021-11-15T14:44:01.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 -- start start 2021-11-15T14:44:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb04148420 0x7ffb040b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffb040a7140 0x7ffb041447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb040b03d0 con 0x7ffb040b1e30 2021-11-15T14:44:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb040a9140 con 0x7ffb040a7140 2021-11-15T14:44:01.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0c1ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040b0670 con 0x7ffb04148420 2021-11-15T14:44:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0a749700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffb040a7140 0x7ffb041447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0a749700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7ffb040a7140 0x7ffb041447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36822/0 (socket says 172.21.2.135:36822) 2021-11-15T14:44:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.468+0000 7ffb0a749700 1 -- 172.21.2.135:0/1359016656 learned_addr learned my addr 172.21.2.135:0/1359016656 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:01.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/1359016656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb04148420 msgr2=0x7ffb040b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:44:01.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- 172.21.2.135:0/1359016656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb04148420 0x7ffb040b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/1359016656 >> v1:172.21.2.119:6789/0 conn(0x7ffb040b1e30 legacy=0x7ffb040b2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:44:01.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/1359016656 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040b0910 con 0x7ffb040a7140 2021-11-15T14:44:01.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- 172.21.2.135:0/1359016656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb040a7140 0x7ffb041447a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7ffb04061420 tx=0x7ffafc009290).ready entity=mon.1 client_cookie=771dbbc525b01a05 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb08f46700 1 -- 172.21.2.135:0/1359016656 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc00b860 con 0x7ffb040a7140 2021-11-15T14:44:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb08f46700 1 -- 172.21.2.135:0/1359016656 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00b9c0 con 0x7ffb040a7140 2021-11-15T14:44:01.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb08f46700 1 -- 172.21.2.135:0/1359016656 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc00bb70 con 0x7ffb040a7140 2021-11-15T14:44:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/1359016656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb040a7140 msgr2=0x7ffb041447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/1359016656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb040a7140 0x7ffb041447a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7ffb04061420 tx=0x7ffafc009290).stop 2021-11-15T14:44:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/1359016656 shutdown_connections 2021-11-15T14:44:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/1359016656 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb040a7140 0x7ffb041447a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/1359016656 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb04148420 0x7ffb040b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/1359016656 >> 172.21.2.135:0/1359016656 conn(0x7ffb0405f730 msgr2=0x7ffb0405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:01.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/1359016656 shutdown_connections 2021-11-15T14:44:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/1359016656 wait complete. 2021-11-15T14:44:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 Processor -- start 2021-11-15T14:44:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- start start 2021-11-15T14:44:01.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffb040a7140 0x7ffb0415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb040b1e30 0x7ffb04142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb041434c0 con 0x7ffb040a7140 2021-11-15T14:44:01.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040ac2b0 con 0x7ffb04148420 2021-11-15T14:44:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0415aab0 con 0x7ffb040b1e30 2021-11-15T14:44:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36828/0 (socket says 172.21.2.135:36828) 2021-11-15T14:44:01.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/3618238618 learned_addr learned my addr 172.21.2.135:0/3618238618 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb040b1e30 msgr2=0x7ffb04142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb040b1e30 0x7ffb04142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffb040a7140 msgr2=0x7ffb0415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffb040a7140 0x7ffb0415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 -- 172.21.2.135:0/3618238618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009530 con 0x7ffb04148420 2021-11-15T14:44:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0a749700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7ffb04061420 tx=0x7ffafc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc00b860 con 0x7ffb04148420 2021-11-15T14:44:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0107a0 con 0x7ffb04148420 2021-11-15T14:44:01.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffafc0032d0 con 0x7ffb04148420 2021-11-15T14:44:01.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0415a7d0 con 0x7ffb04148420 2021-11-15T14:44:01.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.472+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb04149ad0 con 0x7ffb04148420 2021-11-15T14:44:01.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb040573d0 con 0x7ffb04148420 2021-11-15T14:44:01.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffafc027020 con 0x7ffb04148420 2021-11-15T14:44:01.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffaf6ffd700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 0x7ffae4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffafc06cf80 con 0x7ffb04148420 2021-11-15T14:44:01.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffb09f48700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 0x7ffae4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffb09f48700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 0x7ffae4055ad0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7ffb00002fb0 tx=0x7ffb000069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.476+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffafc043f90 con 0x7ffb04148420 2021-11-15T14:44:01.562 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffb040446d0 con 0x7ffb04148420 2021-11-15T14:44:01.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffaf6ffd700 1 -- 172.21.2.135:0/3618238618 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v164) v1 ==== 81+0+34051 (secure 0 0 0) 0x7ffafc015070 con 0x7ffb04148420 2021-11-15T14:44:01.564 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:44:01.564 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T14:44:01.564 INFO:teuthology.orchestra.run.gibba035.stdout: "epoch": 164, 2021-11-15T14:44:01.565 INFO:teuthology.orchestra.run.gibba035.stdout: "fsid": "aa03efb2-9530-4b02-8a4e-1fb04db0e3e8", 2021-11-15T14:44:01.565 INFO:teuthology.orchestra.run.gibba035.stdout: "created": "2021-11-15T14:34:12.786393+0000", 2021-11-15T14:44:01.565 INFO:teuthology.orchestra.run.gibba035.stdout: "modified": "2021-11-15T14:43:47.237415+0000", 2021-11-15T14:44:01.565 INFO:teuthology.orchestra.run.gibba035.stdout: "last_up_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:44:01.566 INFO:teuthology.orchestra.run.gibba035.stdout: "last_in_change": "2021-11-15T14:34:19.080252+0000", 2021-11-15T14:44:01.566 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-15T14:44:01.566 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_num": 5799936, 2021-11-15T14:44:01.566 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_set": [ 2021-11-15T14:44:01.567 INFO:teuthology.orchestra.run.gibba035.stdout: "pglog_hardlimit", 2021-11-15T14:44:01.567 INFO:teuthology.orchestra.run.gibba035.stdout: "purged_snapdirs", 2021-11-15T14:44:01.567 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_deletes", 2021-11-15T14:44:01.567 INFO:teuthology.orchestra.run.gibba035.stdout: "sortbitwise" 2021-11-15T14:44:01.567 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:44:01.568 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_version": 5, 2021-11-15T14:44:01.568 INFO:teuthology.orchestra.run.gibba035.stdout: "full_ratio": 0.94999998807907104, 2021-11-15T14:44:01.568 INFO:teuthology.orchestra.run.gibba035.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-15T14:44:01.568 INFO:teuthology.orchestra.run.gibba035.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-15T14:44:01.569 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_snapshot": "", 2021-11-15T14:44:01.569 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_max": 30, 2021-11-15T14:44:01.569 INFO:teuthology.orchestra.run.gibba035.stdout: "max_osd": 8, 2021-11-15T14:44:01.569 INFO:teuthology.orchestra.run.gibba035.stdout: "require_min_compat_client": "jewel", 2021-11-15T14:44:01.570 INFO:teuthology.orchestra.run.gibba035.stdout: "min_compat_client": "jewel", 2021-11-15T14:44:01.570 INFO:teuthology.orchestra.run.gibba035.stdout: "require_osd_release": "octopus", 2021-11-15T14:44:01.570 INFO:teuthology.orchestra.run.gibba035.stdout: "pools": [ 2021-11-15T14:44:01.570 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.570 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 1, 2021-11-15T14:44:01.571 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "device_health_metrics", 2021-11-15T14:44:01.571 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:15.066105+0000", 2021-11-15T14:44:01.571 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:44:01.571 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:44:01.572 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:44:01.572 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:44:01.572 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:44:01.572 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:44:01.572 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:44:01.573 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:44:01.573 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 1, 2021-11-15T14:44:01.573 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 1, 2021-11-15T14:44:01.573 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 1, 2021-11-15T14:44:01.574 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 1, 2021-11-15T14:44:01.574 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 1, 2021-11-15T14:44:01.574 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:44:01.574 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:44:01.574 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:44:01.575 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:44:01.575 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:44:01.575 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:44:01.575 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:44:01.576 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.576 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "16", 2021-11-15T14:44:01.576 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:44:01.576 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:44:01.576 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:44:01.577 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:44:01.577 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:44:01.577 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:44:01.577 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:44:01.578 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:44:01.578 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:44:01.578 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:44:01.578 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:44:01.578 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:44:01.579 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:44:01.579 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:44:01.579 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:44:01.579 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:44:01.580 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:44:01.580 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:44:01.580 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:44:01.580 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:44:01.580 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:44:01.581 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:44:01.581 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:44:01.581 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:44:01.581 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:44:01.582 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:44:01.582 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.582 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:44:01.582 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:44:01.583 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:44:01.583 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:44:01.583 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:44:01.583 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:44:01.583 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:44:01.584 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:44:01.584 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:44:01.584 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:44:01.584 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:44:01.585 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:44:01.585 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 1 2021-11-15T14:44:01.585 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.585 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:44:01.585 INFO:teuthology.orchestra.run.gibba035.stdout: "mgr_devicehealth": {} 2021-11-15T14:44:01.586 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.586 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.586 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.586 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 2, 2021-11-15T14:44:01.587 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "rbd", 2021-11-15T14:44:01.587 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:34:22.802865+0000", 2021-11-15T14:44:01.587 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:44:01.587 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:44:01.587 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:44:01.588 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:44:01.588 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:44:01.588 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:44:01.588 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:44:01.588 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:44:01.589 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:44:01.589 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:44:01.589 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:44:01.589 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:44:01.590 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:44:01.590 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:44:01.590 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:44:01.590 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:44:01.590 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:44:01.591 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:44:01.591 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:44:01.591 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:44:01.591 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.592 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "19", 2021-11-15T14:44:01.592 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:44:01.592 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:44:01.592 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:44:01.592 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:44:01.593 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:44:01.593 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:44:01.593 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:44:01.593 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:44:01.594 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:44:01.594 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:44:01.594 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:44:01.594 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:44:01.594 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:44:01.595 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:44:01.595 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:44:01.595 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:44:01.595 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:44:01.595 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:44:01.596 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:44:01.596 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:44:01.596 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:44:01.596 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:44:01.597 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:44:01.597 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:44:01.597 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:44:01.597 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:44:01.597 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.598 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:44:01.598 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:44:01.598 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:44:01.598 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:44:01.599 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:44:01.599 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:44:01.599 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:44:01.599 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:44:01.599 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:44:01.600 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:44:01.600 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:44:01.600 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:44:01.600 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:44:01.601 INFO:teuthology.orchestra.run.gibba035.stdout: "rbd": {} 2021-11-15T14:44:01.601 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.601 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.601 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.601 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 29, 2021-11-15T14:44:01.602 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_metadata", 2021-11-15T14:44:01.602 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:43:45.185060+0000", 2021-11-15T14:44:01.602 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:44:01.602 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:44:01.603 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:44:01.603 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:44:01.603 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:44:01.603 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:44:01.603 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:44:01.604 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:44:01.604 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:44:01.604 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:44:01.604 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:44:01.605 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:44:01.605 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:44:01.605 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:44:01.605 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:44:01.605 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:44:01.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:44:01.606 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:44:01.606 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:44:01.606 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:44:01.607 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.607 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "164", 2021-11-15T14:44:01.607 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:44:01.607 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:44:01.607 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:44:01.608 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:44:01.608 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:44:01.608 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:44:01.608 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:44:01.608 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:44:01.609 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:44:01.609 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:44:01.609 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:44:01.609 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:44:01.609 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:44:01.610 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:44:01.610 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:44:01.610 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:44:01.610 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:44:01.611 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:44:01.611 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:44:01.611 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:44:01.611 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:44:01.611 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:44:01.612 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:44:01.612 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:44:01.612 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:44:01.612 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:44:01.613 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.613 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:44:01.613 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:44:01.613 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:44:01.613 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:44:01.614 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:44:01.614 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:44:01.614 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:44:01.614 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:44:01.615 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:44:01.615 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:44:01.615 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:44:01.615 INFO:teuthology.orchestra.run.gibba035.stdout: "options": { 2021-11-15T14:44:01.615 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_bias": 4, 2021-11-15T14:44:01.616 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_min": 16, 2021-11-15T14:44:01.616 INFO:teuthology.orchestra.run.gibba035.stdout: "recovery_priority": 5 2021-11-15T14:44:01.616 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.616 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:44:01.617 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:44:01.617 INFO:teuthology.orchestra.run.gibba035.stdout: "metadata": "cephfs" 2021-11-15T14:44:01.617 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.617 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.617 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.618 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.618 INFO:teuthology.orchestra.run.gibba035.stdout: "pool": 30, 2021-11-15T14:44:01.618 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_name": "cephfs_data", 2021-11-15T14:44:01.618 INFO:teuthology.orchestra.run.gibba035.stdout: "create_time": "2021-11-15T14:43:46.224957+0000", 2021-11-15T14:44:01.619 INFO:teuthology.orchestra.run.gibba035.stdout: "flags": 1, 2021-11-15T14:44:01.619 INFO:teuthology.orchestra.run.gibba035.stdout: "flags_names": "hashpspool", 2021-11-15T14:44:01.619 INFO:teuthology.orchestra.run.gibba035.stdout: "type": 1, 2021-11-15T14:44:01.619 INFO:teuthology.orchestra.run.gibba035.stdout: "size": 2, 2021-11-15T14:44:01.620 INFO:teuthology.orchestra.run.gibba035.stdout: "min_size": 1, 2021-11-15T14:44:01.620 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_rule": 0, 2021-11-15T14:44:01.620 INFO:teuthology.orchestra.run.gibba035.stdout: "object_hash": 2, 2021-11-15T14:44:01.620 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_autoscale_mode": "off", 2021-11-15T14:44:01.620 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num": 8, 2021-11-15T14:44:01.621 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num": 8, 2021-11-15T14:44:01.621 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_placement_num_target": 8, 2021-11-15T14:44:01.621 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_target": 8, 2021-11-15T14:44:01.621 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_num_pending": 8, 2021-11-15T14:44:01.621 INFO:teuthology.orchestra.run.gibba035.stdout: "last_pg_merge_meta": { 2021-11-15T14:44:01.622 INFO:teuthology.orchestra.run.gibba035.stdout: "source_pgid": "0.0", 2021-11-15T14:44:01.622 INFO:teuthology.orchestra.run.gibba035.stdout: "ready_epoch": 0, 2021-11-15T14:44:01.622 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_started": 0, 2021-11-15T14:44:01.622 INFO:teuthology.orchestra.run.gibba035.stdout: "last_epoch_clean": 0, 2021-11-15T14:44:01.623 INFO:teuthology.orchestra.run.gibba035.stdout: "source_version": "0'0", 2021-11-15T14:44:01.623 INFO:teuthology.orchestra.run.gibba035.stdout: "target_version": "0'0" 2021-11-15T14:44:01.623 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.623 INFO:teuthology.orchestra.run.gibba035.stdout: "last_change": "164", 2021-11-15T14:44:01.623 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend": "0", 2021-11-15T14:44:01.624 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-15T14:44:01.624 INFO:teuthology.orchestra.run.gibba035.stdout: "last_force_op_resend_preluminous": "0", 2021-11-15T14:44:01.624 INFO:teuthology.orchestra.run.gibba035.stdout: "auid": 0, 2021-11-15T14:44:01.624 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_mode": "selfmanaged", 2021-11-15T14:44:01.625 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_seq": 0, 2021-11-15T14:44:01.625 INFO:teuthology.orchestra.run.gibba035.stdout: "snap_epoch": 0, 2021-11-15T14:44:01.625 INFO:teuthology.orchestra.run.gibba035.stdout: "pool_snaps": [], 2021-11-15T14:44:01.625 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps": "[]", 2021-11-15T14:44:01.625 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_bytes": 0, 2021-11-15T14:44:01.626 INFO:teuthology.orchestra.run.gibba035.stdout: "quota_max_objects": 0, 2021-11-15T14:44:01.626 INFO:teuthology.orchestra.run.gibba035.stdout: "tiers": [], 2021-11-15T14:44:01.626 INFO:teuthology.orchestra.run.gibba035.stdout: "tier_of": -1, 2021-11-15T14:44:01.626 INFO:teuthology.orchestra.run.gibba035.stdout: "read_tier": -1, 2021-11-15T14:44:01.627 INFO:teuthology.orchestra.run.gibba035.stdout: "write_tier": -1, 2021-11-15T14:44:01.627 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_mode": "none", 2021-11-15T14:44:01.627 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_bytes": 0, 2021-11-15T14:44:01.627 INFO:teuthology.orchestra.run.gibba035.stdout: "target_max_objects": 0, 2021-11-15T14:44:01.627 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-15T14:44:01.628 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-15T14:44:01.628 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-15T14:44:01.628 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_flush_age": 0, 2021-11-15T14:44:01.628 INFO:teuthology.orchestra.run.gibba035.stdout: "cache_min_evict_age": 0, 2021-11-15T14:44:01.628 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profile": "", 2021-11-15T14:44:01.629 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_params": { 2021-11-15T14:44:01.629 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "none" 2021-11-15T14:44:01.629 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.629 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_period": 0, 2021-11-15T14:44:01.629 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_count": 0, 2021-11-15T14:44:01.630 INFO:teuthology.orchestra.run.gibba035.stdout: "use_gmt_hitset": true, 2021-11-15T14:44:01.630 INFO:teuthology.orchestra.run.gibba035.stdout: "min_read_recency_for_promote": 0, 2021-11-15T14:44:01.630 INFO:teuthology.orchestra.run.gibba035.stdout: "min_write_recency_for_promote": 0, 2021-11-15T14:44:01.630 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_grade_decay_rate": 0, 2021-11-15T14:44:01.631 INFO:teuthology.orchestra.run.gibba035.stdout: "hit_set_search_last_n": 0, 2021-11-15T14:44:01.631 INFO:teuthology.orchestra.run.gibba035.stdout: "grade_table": [], 2021-11-15T14:44:01.631 INFO:teuthology.orchestra.run.gibba035.stdout: "stripe_width": 0, 2021-11-15T14:44:01.631 INFO:teuthology.orchestra.run.gibba035.stdout: "expected_num_objects": 0, 2021-11-15T14:44:01.631 INFO:teuthology.orchestra.run.gibba035.stdout: "fast_read": false, 2021-11-15T14:44:01.632 INFO:teuthology.orchestra.run.gibba035.stdout: "options": {}, 2021-11-15T14:44:01.632 INFO:teuthology.orchestra.run.gibba035.stdout: "application_metadata": { 2021-11-15T14:44:01.632 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs": { 2021-11-15T14:44:01.632 INFO:teuthology.orchestra.run.gibba035.stdout: "data": "cephfs" 2021-11-15T14:44:01.632 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.633 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.633 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.633 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:44:01.633 INFO:teuthology.orchestra.run.gibba035.stdout: "osds": [ 2021-11-15T14:44:01.633 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.634 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:44:01.634 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "8ff250b9-d13b-4150-b168-54ab0adafaf0", 2021-11-15T14:44:01.634 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.634 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.635 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.635 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.635 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.635 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.635 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.636 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.636 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.636 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.636 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.636 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.637 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.637 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.637 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6816", 2021-11-15T14:44:01.637 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.638 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.638 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.638 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.638 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6817", 2021-11-15T14:44:01.638 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.639 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.639 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.639 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.639 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.640 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.640 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.640 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.640 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6818", 2021-11-15T14:44:01.640 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.641 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.641 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.641 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.641 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6819", 2021-11-15T14:44:01.641 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.642 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.642 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.642 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.642 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.643 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.643 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.643 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.643 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6822", 2021-11-15T14:44:01.643 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.644 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.644 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.644 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.644 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6823", 2021-11-15T14:44:01.645 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.645 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.645 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.645 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.645 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.646 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.646 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.646 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.646 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6820", 2021-11-15T14:44:01.647 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.647 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.647 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.647 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.647 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6821", 2021-11-15T14:44:01.648 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14883 2021-11-15T14:44:01.648 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.648 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.648 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.649 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6817/14883", 2021-11-15T14:44:01.649 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6819/14883", 2021-11-15T14:44:01.649 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6823/14883", 2021-11-15T14:44:01.649 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6821/14883", 2021-11-15T14:44:01.649 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.650 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.650 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.650 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.650 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.651 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.651 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:44:01.651 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "ef743c61-c920-4fca-94c1-ac8a1976d803", 2021-11-15T14:44:01.651 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.651 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.652 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.652 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.652 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.652 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.653 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.653 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.653 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.653 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.653 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.654 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.654 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.654 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.654 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6824", 2021-11-15T14:44:01.654 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.655 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.655 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.655 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.655 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6825", 2021-11-15T14:44:01.656 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.656 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.656 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.656 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.656 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.657 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.657 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.657 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.657 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6826", 2021-11-15T14:44:01.658 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.658 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.658 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.658 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.658 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6827", 2021-11-15T14:44:01.659 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.659 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.659 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.659 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.660 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.660 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.660 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.660 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.660 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6830", 2021-11-15T14:44:01.661 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.661 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.661 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.661 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.661 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6831", 2021-11-15T14:44:01.662 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.662 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.662 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.662 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.662 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.663 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.663 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.663 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.663 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6828", 2021-11-15T14:44:01.664 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.664 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.664 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.664 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.664 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6829", 2021-11-15T14:44:01.665 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14884 2021-11-15T14:44:01.665 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.665 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.665 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.666 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6825/14884", 2021-11-15T14:44:01.666 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6827/14884", 2021-11-15T14:44:01.666 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6831/14884", 2021-11-15T14:44:01.666 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6829/14884", 2021-11-15T14:44:01.666 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.667 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.667 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.667 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.667 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.668 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.668 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:44:01.668 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1", 2021-11-15T14:44:01.668 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.668 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.669 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.669 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.669 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.669 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.669 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.670 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.670 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.670 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.670 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.671 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.671 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.671 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.671 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6800", 2021-11-15T14:44:01.671 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.672 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.672 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.672 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.672 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6801", 2021-11-15T14:44:01.673 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.673 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.673 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.673 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.673 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.674 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.674 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.674 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.674 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6802", 2021-11-15T14:44:01.675 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.675 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.675 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.675 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.675 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6803", 2021-11-15T14:44:01.676 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.676 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.676 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.676 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.677 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.677 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.677 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.677 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.677 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6806", 2021-11-15T14:44:01.678 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.678 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.678 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.678 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.679 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6807", 2021-11-15T14:44:01.679 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.679 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.679 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.679 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.680 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.680 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.680 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.680 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.680 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6804", 2021-11-15T14:44:01.681 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.681 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.681 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.681 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.682 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6805", 2021-11-15T14:44:01.682 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14885 2021-11-15T14:44:01.682 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.682 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.683 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.683 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6801/14885", 2021-11-15T14:44:01.683 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6803/14885", 2021-11-15T14:44:01.683 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6807/14885", 2021-11-15T14:44:01.683 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6805/14885", 2021-11-15T14:44:01.684 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.684 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.684 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.684 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.685 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.685 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.685 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:44:01.685 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d21a02d0-717e-4155-acfd-c9fcc0a575c8", 2021-11-15T14:44:01.685 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.686 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.686 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.686 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.686 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.687 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.687 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.687 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 152, 2021-11-15T14:44:01.687 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.687 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.688 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.688 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.688 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.688 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.689 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6808", 2021-11-15T14:44:01.689 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.689 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.689 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.689 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.690 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6809", 2021-11-15T14:44:01.690 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.690 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.690 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.691 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.691 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.691 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.691 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.691 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.692 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6810", 2021-11-15T14:44:01.692 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.692 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.692 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.692 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.693 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6811", 2021-11-15T14:44:01.693 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.693 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.693 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.694 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.694 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.694 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.694 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.694 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.695 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6814", 2021-11-15T14:44:01.695 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.695 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.695 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.695 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.696 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6815", 2021-11-15T14:44:01.696 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.696 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.696 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.697 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.697 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.697 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.697 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.697 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.698 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6812", 2021-11-15T14:44:01.698 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.698 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.698 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.699 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.699 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.135:6813", 2021-11-15T14:44:01.699 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 14886 2021-11-15T14:44:01.699 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.699 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.700 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.700 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.135:6809/14886", 2021-11-15T14:44:01.700 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.135:6811/14886", 2021-11-15T14:44:01.700 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.135:6815/14886", 2021-11-15T14:44:01.700 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.135:6813/14886", 2021-11-15T14:44:01.701 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.701 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.701 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.701 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.702 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.702 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.702 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:44:01.702 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d92b907a-4fe9-46a1-bee8-e17e6ff11b94", 2021-11-15T14:44:01.702 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.703 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.703 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.703 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.703 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.704 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.704 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.704 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.704 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.704 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.705 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.705 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.705 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.705 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.705 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6810", 2021-11-15T14:44:01.706 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.706 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.706 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.706 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.707 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6811", 2021-11-15T14:44:01.707 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.707 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.707 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.707 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.708 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.708 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.708 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.708 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.709 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6812", 2021-11-15T14:44:01.709 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.709 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.709 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.709 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.710 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6813", 2021-11-15T14:44:01.710 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.710 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.710 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.711 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.711 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.711 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.711 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.712 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.712 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6816", 2021-11-15T14:44:01.712 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.712 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.712 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.713 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.713 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6818", 2021-11-15T14:44:01.713 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.713 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.713 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.714 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.714 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.714 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.714 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.715 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.715 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6814", 2021-11-15T14:44:01.715 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.715 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.715 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.716 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.716 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6815", 2021-11-15T14:44:01.716 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15090 2021-11-15T14:44:01.716 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.716 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.717 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.717 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6811/15090", 2021-11-15T14:44:01.717 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6813/15090", 2021-11-15T14:44:01.717 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6818/15090", 2021-11-15T14:44:01.718 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6815/15090", 2021-11-15T14:44:01.718 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.718 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.718 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.718 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.719 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.719 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.719 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:44:01.719 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "1ff30a62-5ccd-4e1a-9a17-ceb30614052f", 2021-11-15T14:44:01.720 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.720 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.720 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.720 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.720 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.721 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.721 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.721 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.721 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.721 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.722 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.722 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.722 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.722 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.723 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6817", 2021-11-15T14:44:01.723 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.723 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.723 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.723 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.724 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6820", 2021-11-15T14:44:01.724 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.724 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.724 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.725 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.725 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.725 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.725 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.725 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.726 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6822", 2021-11-15T14:44:01.726 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.726 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.726 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.726 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.727 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6824", 2021-11-15T14:44:01.727 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.727 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.727 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.728 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.728 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.728 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.728 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.728 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.729 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6829", 2021-11-15T14:44:01.729 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.729 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.729 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.730 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.730 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6831", 2021-11-15T14:44:01.730 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.730 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.730 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.731 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.731 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.731 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.731 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.732 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.732 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6826", 2021-11-15T14:44:01.732 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.732 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.732 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.733 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.733 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6828", 2021-11-15T14:44:01.733 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15091 2021-11-15T14:44:01.733 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.734 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.734 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.734 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6820/15091", 2021-11-15T14:44:01.734 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6824/15091", 2021-11-15T14:44:01.734 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6831/15091", 2021-11-15T14:44:01.735 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6828/15091", 2021-11-15T14:44:01.735 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.735 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.735 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.736 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.736 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.736 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.736 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:44:01.736 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26", 2021-11-15T14:44:01.737 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.737 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.737 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.737 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.737 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.738 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.738 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.738 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.738 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.739 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.739 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.739 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.739 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.739 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.740 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6802", 2021-11-15T14:44:01.740 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.740 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.740 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.740 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.741 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6803", 2021-11-15T14:44:01.741 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.741 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.741 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.742 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.742 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.742 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.742 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.742 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.743 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6804", 2021-11-15T14:44:01.743 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.743 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.743 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.743 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.744 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6805", 2021-11-15T14:44:01.744 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.744 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.744 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.745 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.745 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.745 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.745 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.745 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.746 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6808", 2021-11-15T14:44:01.746 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.746 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.746 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.747 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.747 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6809", 2021-11-15T14:44:01.747 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.747 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.747 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.748 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.748 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.748 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.748 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.748 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.749 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6806", 2021-11-15T14:44:01.749 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.749 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.749 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.749 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.750 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6807", 2021-11-15T14:44:01.750 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15092 2021-11-15T14:44:01.750 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.750 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.751 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.751 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6803/15092", 2021-11-15T14:44:01.751 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6805/15092", 2021-11-15T14:44:01.751 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6809/15092", 2021-11-15T14:44:01.751 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6807/15092", 2021-11-15T14:44:01.752 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.752 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.752 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.752 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.753 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.753 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.753 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:44:01.753 INFO:teuthology.orchestra.run.gibba035.stdout: "uuid": "d052682a-32ba-4d00-91cd-285e266cf789", 2021-11-15T14:44:01.753 INFO:teuthology.orchestra.run.gibba035.stdout: "up": 1, 2021-11-15T14:44:01.754 INFO:teuthology.orchestra.run.gibba035.stdout: "in": 1, 2021-11-15T14:44:01.754 INFO:teuthology.orchestra.run.gibba035.stdout: "weight": 1, 2021-11-15T14:44:01.754 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_affinity": 1, 2021-11-15T14:44:01.754 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_begin": 0, 2021-11-15T14:44:01.755 INFO:teuthology.orchestra.run.gibba035.stdout: "last_clean_end": 0, 2021-11-15T14:44:01.755 INFO:teuthology.orchestra.run.gibba035.stdout: "up_from": 14, 2021-11-15T14:44:01.755 INFO:teuthology.orchestra.run.gibba035.stdout: "up_thru": 162, 2021-11-15T14:44:01.755 INFO:teuthology.orchestra.run.gibba035.stdout: "down_at": 0, 2021-11-15T14:44:01.755 INFO:teuthology.orchestra.run.gibba035.stdout: "lost_at": 0, 2021-11-15T14:44:01.756 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addrs": { 2021-11-15T14:44:01.756 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.756 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.756 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.757 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6819", 2021-11-15T14:44:01.757 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.757 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.757 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.757 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.758 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6821", 2021-11-15T14:44:01.758 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.758 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.758 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.758 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.759 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addrs": { 2021-11-15T14:44:01.759 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.759 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.759 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.760 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6823", 2021-11-15T14:44:01.760 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.760 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.760 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.760 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.761 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6825", 2021-11-15T14:44:01.761 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.761 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.761 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.762 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.762 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addrs": { 2021-11-15T14:44:01.762 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.762 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.762 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.763 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6832", 2021-11-15T14:44:01.763 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.763 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.763 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.764 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.764 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6833", 2021-11-15T14:44:01.764 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.764 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.764 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.765 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.765 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addrs": { 2021-11-15T14:44:01.765 INFO:teuthology.orchestra.run.gibba035.stdout: "addrvec": [ 2021-11-15T14:44:01.765 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.766 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v2", 2021-11-15T14:44:01.766 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6827", 2021-11-15T14:44:01.766 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.766 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.766 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.767 INFO:teuthology.orchestra.run.gibba035.stdout: "type": "v1", 2021-11-15T14:44:01.767 INFO:teuthology.orchestra.run.gibba035.stdout: "addr": "172.21.2.119:6830", 2021-11-15T14:44:01.767 INFO:teuthology.orchestra.run.gibba035.stdout: "nonce": 15101 2021-11-15T14:44:01.767 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.768 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.768 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.768 INFO:teuthology.orchestra.run.gibba035.stdout: "public_addr": "172.21.2.119:6821/15101", 2021-11-15T14:44:01.768 INFO:teuthology.orchestra.run.gibba035.stdout: "cluster_addr": "172.21.2.119:6825/15101", 2021-11-15T14:44:01.768 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_back_addr": "172.21.2.119:6833/15101", 2021-11-15T14:44:01.769 INFO:teuthology.orchestra.run.gibba035.stdout: "heartbeat_front_addr": "172.21.2.119:6830/15101", 2021-11-15T14:44:01.769 INFO:teuthology.orchestra.run.gibba035.stdout: "state": [ 2021-11-15T14:44:01.769 INFO:teuthology.orchestra.run.gibba035.stdout: "exists", 2021-11-15T14:44:01.769 INFO:teuthology.orchestra.run.gibba035.stdout: "up" 2021-11-15T14:44:01.769 INFO:teuthology.orchestra.run.gibba035.stdout: ] 2021-11-15T14:44:01.770 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.770 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:44:01.770 INFO:teuthology.orchestra.run.gibba035.stdout: "osd_xinfo": [ 2021-11-15T14:44:01.770 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.771 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 0, 2021-11-15T14:44:01.771 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.771 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.771 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.771 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.772 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.772 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.542333+0000", 2021-11-15T14:44:01.772 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.772 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.772 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.773 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 1, 2021-11-15T14:44:01.773 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.773 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.773 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.774 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.774 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.774 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.590151+0000", 2021-11-15T14:44:01.774 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.774 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.775 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.775 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 2, 2021-11-15T14:44:01.775 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.775 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.776 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.776 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.776 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.776 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.330854+0000", 2021-11-15T14:44:01.776 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.777 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.777 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.777 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 3, 2021-11-15T14:44:01.777 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.778 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.778 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.778 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.778 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.778 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.271792+0000", 2021-11-15T14:44:01.779 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.779 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.779 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.779 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 4, 2021-11-15T14:44:01.780 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.780 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.780 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.780 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.780 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.781 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.605032+0000", 2021-11-15T14:44:01.781 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.781 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.781 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.781 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 5, 2021-11-15T14:44:01.782 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.782 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.782 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.782 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.783 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.783 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.530191+0000", 2021-11-15T14:44:01.783 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.783 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.783 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.784 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 6, 2021-11-15T14:44:01.784 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.784 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.784 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.785 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.785 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.785 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.386596+0000", 2021-11-15T14:44:01.785 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.785 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.791 INFO:teuthology.orchestra.run.gibba035.stdout: { 2021-11-15T14:44:01.791 INFO:teuthology.orchestra.run.gibba035.stdout: "osd": 7, 2021-11-15T14:44:01.791 INFO:teuthology.orchestra.run.gibba035.stdout: "down_stamp": "0.000000", 2021-11-15T14:44:01.792 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_probability": 0, 2021-11-15T14:44:01.792 INFO:teuthology.orchestra.run.gibba035.stdout: "laggy_interval": 0, 2021-11-15T14:44:01.792 INFO:teuthology.orchestra.run.gibba035.stdout: "features": 4540138292840890367, 2021-11-15T14:44:01.792 INFO:teuthology.orchestra.run.gibba035.stdout: "old_weight": 0, 2021-11-15T14:44:01.792 INFO:teuthology.orchestra.run.gibba035.stdout: "last_purged_snaps_scrub": "2021-11-15T14:34:17.655449+0000", 2021-11-15T14:44:01.793 INFO:teuthology.orchestra.run.gibba035.stdout: "dead_epoch": 0 2021-11-15T14:44:01.793 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.793 INFO:teuthology.orchestra.run.gibba035.stdout: ], 2021-11-15T14:44:01.793 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap": [], 2021-11-15T14:44:01.793 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_upmap_items": [], 2021-11-15T14:44:01.794 INFO:teuthology.orchestra.run.gibba035.stdout: "pg_temp": [], 2021-11-15T14:44:01.794 INFO:teuthology.orchestra.run.gibba035.stdout: "primary_temp": [], 2021-11-15T14:44:01.794 INFO:teuthology.orchestra.run.gibba035.stdout: "blacklist": {}, 2021-11-15T14:44:01.794 INFO:teuthology.orchestra.run.gibba035.stdout: "erasure_code_profiles": { 2021-11-15T14:44:01.795 INFO:teuthology.orchestra.run.gibba035.stdout: "cephfs_data": { 2021-11-15T14:44:01.795 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-device-class": "", 2021-11-15T14:44:01.795 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:44:01.795 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-root": "default", 2021-11-15T14:44:01.795 INFO:teuthology.orchestra.run.gibba035.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-15T14:44:01.796 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:44:01.796 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "2", 2021-11-15T14:44:01.796 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:44:01.796 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:44:01.797 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van", 2021-11-15T14:44:01.797 INFO:teuthology.orchestra.run.gibba035.stdout: "w": "8" 2021-11-15T14:44:01.797 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.797 INFO:teuthology.orchestra.run.gibba035.stdout: "default": { 2021-11-15T14:44:01.797 INFO:teuthology.orchestra.run.gibba035.stdout: "crush-failure-domain": "osd", 2021-11-15T14:44:01.798 INFO:teuthology.orchestra.run.gibba035.stdout: "k": "2", 2021-11-15T14:44:01.798 INFO:teuthology.orchestra.run.gibba035.stdout: "m": "1", 2021-11-15T14:44:01.798 INFO:teuthology.orchestra.run.gibba035.stdout: "plugin": "jerasure", 2021-11-15T14:44:01.798 INFO:teuthology.orchestra.run.gibba035.stdout: "ruleset-failure-domain": "osd", 2021-11-15T14:44:01.799 INFO:teuthology.orchestra.run.gibba035.stdout: "technique": "reed_sol_van" 2021-11-15T14:44:01.799 INFO:teuthology.orchestra.run.gibba035.stdout: } 2021-11-15T14:44:01.799 INFO:teuthology.orchestra.run.gibba035.stdout: }, 2021-11-15T14:44:01.799 INFO:teuthology.orchestra.run.gibba035.stdout: "removed_snaps_queue": [], 2021-11-15T14:44:01.799 INFO:teuthology.orchestra.run.gibba035.stdout: "new_removed_snaps": [], 2021-11-15T14:44:01.800 INFO:teuthology.orchestra.run.gibba035.stdout: "new_purged_snaps": [], 2021-11-15T14:44:01.800 INFO:teuthology.orchestra.run.gibba035.stdout: "crush_node_flags": {}, 2021-11-15T14:44:01.800 INFO:teuthology.orchestra.run.gibba035.stdout: "device_class_flags": {} 2021-11-15T14:44:01.800 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T14:44:01.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 msgr2=0x7ffae4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 0x7ffae4055ad0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7ffb00002fb0 tx=0x7ffb000069b0).stop 2021-11-15T14:44:01.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 msgr2=0x7ffb04142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7ffb04061420 tx=0x7ffafc016000).stop 2021-11-15T14:44:01.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 shutdown_connections 2021-11-15T14:44:01.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7ffae4053610 0x7ffae4055ad0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7ffb04148420 0x7ffb04142fd0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7ffb040b1e30 0x7ffb04142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 --2- 172.21.2.135:0/3618238618 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7ffb040a7140 0x7ffb0415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 >> 172.21.2.135:0/3618238618 conn(0x7ffb0405f730 msgr2=0x7ffb04143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:01.804 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 shutdown_connections 2021-11-15T14:44:01.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.560+0000 7ffb0c1ac700 1 -- 172.21.2.135:0/3618238618 wait complete. 2021-11-15T14:44:01.805 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:44:01.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 Processor -- start 2021-11-15T14:44:01.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- start start 2021-11-15T14:44:01.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a800b6980 0x7f8a800acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8a80060990 0x7f8a800a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a800b6d60 con 0x7f8a800aa430 2021-11-15T14:44:01.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a80061260 con 0x7f8a80060990 2021-11-15T14:44:01.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80061500 con 0x7f8a800b6980 2021-11-15T14:44:01.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7ed9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f8a800aa430 0x7f8a800b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52654/0 (socket says 172.21.2.135:52654) 2021-11-15T14:44:01.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7ed9d700 1 -- 172.21.2.135:0/62345488 learned_addr learned my addr 172.21.2.135:0/62345488 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:44:01.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/62345488 >> v2:172.21.2.135:3300/0 conn(0x7f8a80060990 0x7f8a800a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7e59c700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a800b6980 0x7f8a800acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/62345488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a800b6980 msgr2=0x7f8a800acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:01.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a800b6980 0x7f8a800acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/62345488 >> v1:172.21.2.135:6789/0 conn(0x7f8a800aa430 legacy=0x7f8a800b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/62345488 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800617a0 con 0x7f8a80060990 2021-11-15T14:44:01.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a80060990 0x7f8a800a9f40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f8a68002f70 tx=0x7f8a68007f00).ready entity=mon.1 client_cookie=f23195bee1f9d0c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7d59a700 1 -- 172.21.2.135:0/62345488 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a68007610 con 0x7f8a80060990 2021-11-15T14:44:01.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7d59a700 1 -- 172.21.2.135:0/62345488 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680056f0 con 0x7f8a80060990 2021-11-15T14:44:01.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a7d59a700 1 -- 172.21.2.135:0/62345488 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a68005a50 con 0x7f8a80060990 2021-11-15T14:44:01.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- 172.21.2.135:0/62345488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a80060990 msgr2=0x7f8a800a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a80060990 0x7f8a800a9f40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f8a68002f70 tx=0x7f8a68007f00).stop 2021-11-15T14:44:01.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- 172.21.2.135:0/62345488 shutdown_connections 2021-11-15T14:44:01.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a80060990 0x7f8a800a9f40 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 --2- 172.21.2.135:0/62345488 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a800b6980 0x7f8a800acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- 172.21.2.135:0/62345488 >> 172.21.2.135:0/62345488 conn(0x7f8a800b3500 msgr2=0x7f8a800b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:01.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- 172.21.2.135:0/62345488 shutdown_connections 2021-11-15T14:44:01.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.860+0000 7f8a84902700 1 -- 172.21.2.135:0/62345488 wait complete. 2021-11-15T14:44:01.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 Processor -- start 2021-11-15T14:44:01.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- start start 2021-11-15T14:44:01.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a80060990 0x7f8a8013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a800b6980 0x7f8a800adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80140120 con 0x7f8a800b6980 2021-11-15T14:44:01.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80140380 con 0x7f8a800aa430 2021-11-15T14:44:01.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80140620 con 0x7f8a80060990 2021-11-15T14:44:01.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36838/0 (socket says 172.21.2.135:36838) 2021-11-15T14:44:01.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/688143461 learned_addr learned my addr 172.21.2.135:0/688143461 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:01.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a80060990 msgr2=0x7f8a8013ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a80060990 0x7f8a8013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a800b6980 msgr2=0x7f8a800adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a800b6980 0x7f8a800adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 -- 172.21.2.135:0/688143461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6800c200 con 0x7f8a800aa430 2021-11-15T14:44:01.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7dd9b700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f8a68002f70 tx=0x7f8a68017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a68010b80 con 0x7f8a800aa430 2021-11-15T14:44:01.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68000e90 con 0x7f8a800aa430 2021-11-15T14:44:01.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a800ad310 con 0x7f8a800aa430 2021-11-15T14:44:01.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a801515b0 con 0x7f8a800aa430 2021-11-15T14:44:01.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6801c420 con 0x7f8a800aa430 2021-11-15T14:44:01.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a800ad4a0 con 0x7f8a800aa430 2021-11-15T14:44:01.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a6801c580 con 0x7f8a800aa430 2021-11-15T14:44:01.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 0x7f8a64055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:01.877 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8a6806d770 con 0x7f8a800aa430 2021-11-15T14:44:01.878 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.864+0000 7f8a7e59c700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 0x7f8a64055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:01.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.868+0000 7f8a7e59c700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 0x7f8a64055a90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8a7000a000 tx=0x7f8a70008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:01.879 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.868+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a68044720 con 0x7f8a800aa430 2021-11-15T14:44:01.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a80061a40 con 0x7f8a800aa430 2021-11-15T14:44:01.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a777fe700 1 -- 172.21.2.135:0/688143461 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f8a68007070 con 0x7f8a800aa430 2021-11-15T14:44:01.981 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:44:01.981 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":83,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:43:48.242650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8707":{"gid":8707,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.2.135:6835/945123846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6833","nonce":945123846},{"type":"v1","addr":"172.21.2.135:6835","nonce":945123846}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:44:01.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 msgr2=0x7f8a64055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 0x7f8a64055a90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8a7000a000 tx=0x7f8a70008040).stop 2021-11-15T14:44:01.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 msgr2=0x7f8a800ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:01.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f8a68002f70 tx=0x7f8a68017000).stop 2021-11-15T14:44:01.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 shutdown_connections 2021-11-15T14:44:01.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8a640535d0 0x7f8a64055a90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8a800b6980 0x7f8a800adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8a800aa430 0x7f8a800ad7b0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:01.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 --2- 172.21.2.135:0/688143461 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8a80060990 0x7f8a8013ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:01.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 >> 172.21.2.135:0/688143461 conn(0x7f8a800b3500 msgr2=0x7f8a80136010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:01.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 shutdown_connections 2021-11-15T14:44:01.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:01.976+0000 7f8a84902700 1 -- 172.21.2.135:0/688143461 wait complete. 2021-11-15T14:44:01.985 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 83 2021-11-15T14:44:01.991 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-15T14:44:02.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 Processor -- start 2021-11-15T14:44:02.043 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- start start 2021-11-15T14:44:02.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcbf80b1e30 0x7fcbf80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.045 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf80b03d0 con 0x7fcbf80a7140 2021-11-15T14:44:02.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf80b0670 con 0x7fcbf8148420 2021-11-15T14:44:02.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf80a9140 con 0x7fcbf80b1e30 2021-11-15T14:44:02.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd907700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fcbf80b1e30 0x7fcbf80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd106700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fcbf8148420 0x7fcbf80b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52670/0 (socket says 172.21.2.135:52670) 2021-11-15T14:44:02.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd106700 1 -- 172.21.2.135:0/625188156 learned_addr learned my addr 172.21.2.135:0/625188156 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:44:02.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd907700 1 -- 172.21.2.135:0/625188156 >> v1:172.21.2.135:6789/0 conn(0x7fcbf8148420 legacy=0x7fcbf80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd907700 1 -- 172.21.2.135:0/625188156 >> v1:172.21.2.119:6789/0 conn(0x7fcbf80a7140 legacy=0x7fcbf81447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T14:44:02.047 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd907700 1 -- 172.21.2.135:0/625188156 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf80b0910 con 0x7fcbf80b1e30 2021-11-15T14:44:02.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfd907700 1 --2- 172.21.2.135:0/625188156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf80b1050 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fcbf80acee0 tx=0x7fcbf4006df0).ready entity=mon.1 client_cookie=4e50a159e5e108f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfc905700 1 -- 172.21.2.135:0/625188156 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbf400d5c0 con 0x7fcbf80b1e30 2021-11-15T14:44:02.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfc905700 1 -- 172.21.2.135:0/625188156 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4000e90 con 0x7fcbf80b1e30 2021-11-15T14:44:02.048 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbfc905700 1 -- 172.21.2.135:0/625188156 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbf400d910 con 0x7fcbf80b1e30 2021-11-15T14:44:02.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- 172.21.2.135:0/625188156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 msgr2=0x7fcbf80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/625188156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf80b1050 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fcbf80acee0 tx=0x7fcbf4006df0).stop 2021-11-15T14:44:02.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- 172.21.2.135:0/625188156 shutdown_connections 2021-11-15T14:44:02.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/625188156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf80b1050 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:02.049 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- 172.21.2.135:0/625188156 >> 172.21.2.135:0/625188156 conn(0x7fcbf805f730 msgr2=0x7fcbf805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:02.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- 172.21.2.135:0/625188156 shutdown_connections 2021-11-15T14:44:02.050 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.040+0000 7fcbffb6b700 1 -- 172.21.2.135:0/625188156 wait complete. 2021-11-15T14:44:02.052 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 Processor -- start 2021-11-15T14:44:02.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- start start 2021-11-15T14:44:02.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcbf80a7140 0x7fcbf80b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcbf8148420 0x7fcbf815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80aa2f0 con 0x7fcbf8148420 2021-11-15T14:44:02.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80ac340 con 0x7fcbf80b1e30 2021-11-15T14:44:02.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80aa670 con 0x7fcbf80a7140 2021-11-15T14:44:02.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36852/0 (socket says 172.21.2.135:36852) 2021-11-15T14:44:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 -- 172.21.2.135:0/1102231981 learned_addr learned my addr 172.21.2.135:0/1102231981 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 -- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcbf80a7140 msgr2=0x7fcbf80b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcbf80a7140 0x7fcbf80b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.055 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 -- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcbf8148420 msgr2=0x7fcbf815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcbf8148420 0x7fcbf815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 -- 172.21.2.135:0/1102231981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf400b180 con 0x7fcbf80b1e30 2021-11-15T14:44:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd106700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fcbf80b31f0 tx=0x7fcbe8007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe800ce30 con 0x7fcbf80b1e30 2021-11-15T14:44:02.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe80072e0 con 0x7fcbf80b1e30 2021-11-15T14:44:02.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf80aab10 con 0x7fcbf80b1e30 2021-11-15T14:44:02.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe8005800 con 0x7fcbf80b1e30 2021-11-15T14:44:02.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf815ab40 con 0x7fcbf80b1e30 2021-11-15T14:44:02.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf80a9d80 con 0x7fcbf80b1e30 2021-11-15T14:44:02.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbe801a060 con 0x7fcbf80b1e30 2021-11-15T14:44:02.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 0x7fcbd8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcbe806adf0 con 0x7fcbf80b1e30 2021-11-15T14:44:02.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.044+0000 7fcbfd907700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 0x7fcbd8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.048+0000 7fcbfd907700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 0x7fcbd8055ad0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fcbf80acee0 tx=0x7fcbf4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.048+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbe8041e00 con 0x7fcbf80b1e30 2021-11-15T14:44:02.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.152+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcbf80ac510 con 0x7fcbf80b1e30 2021-11-15T14:44:02.839 INFO:tasks.ceph.mon.b.gibba019.stderr:2021-11-15T14:44:02.836+0000 7f47132fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-15T14:44:02.848 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.844+0000 7fcbe6ffd700 1 -- 172.21.2.135:0/1102231981 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcbe8018070 con 0x7fcbf80b1e30 2021-11-15T14:44:02.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 msgr2=0x7fcbd8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 0x7fcbd8055ad0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fcbf80acee0 tx=0x7fcbf4014000).stop 2021-11-15T14:44:02.850 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 msgr2=0x7fcbf815a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fcbf80b31f0 tx=0x7fcbe8007c70).stop 2021-11-15T14:44:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 shutdown_connections 2021-11-15T14:44:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fcbd8053610 0x7fcbd8055ad0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:02.851 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fcbf8148420 0x7fcbf815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fcbf80b1e30 0x7fcbf815a160 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 --2- 172.21.2.135:0/1102231981 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fcbf80a7140 0x7fcbf80b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 >> 172.21.2.135:0/1102231981 conn(0x7fcbf805f730 msgr2=0x7fcbf8143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 shutdown_connections 2021-11-15T14:44:02.852 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.848+0000 7fcbffb6b700 1 -- 172.21.2.135:0/1102231981 wait complete. 2021-11-15T14:44:02.853 INFO:teuthology.orchestra.run.gibba035.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-15T14:44:02.857 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-15T14:44:02.862 INFO:tasks.ceph.mds.c.gibba035.stdout:starting mds.c at 2021-11-15T14:44:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 Processor -- start 2021-11-15T14:44:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 -- start start 2021-11-15T14:44:02.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd8840b1e30 0x7fd8840b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8840a7140 0x7fd8841447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8840b03d0 con 0x7fd884148420 2021-11-15T14:44:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840a9140 con 0x7fd8840b1e30 2021-11-15T14:44:02.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd88afe4700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840b0670 con 0x7fd8840a7140 2021-11-15T14:44:02.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd889581700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8840a7140 0x7fd8841447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd889581700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd8840a7140 0x7fd8841447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36882/0 (socket says 172.21.2.135:36882) 2021-11-15T14:44:02.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.904+0000 7fd889581700 1 -- 172.21.2.135:0/2448100300 learned_addr learned my addr 172.21.2.135:0/2448100300 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:02.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/2448100300 >> v2:172.21.2.119:3300/0 conn(0x7fd8840b1e30 msgr2=0x7fd8840b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:02.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- 172.21.2.135:0/2448100300 >> v2:172.21.2.119:3300/0 conn(0x7fd8840b1e30 0x7fd8840b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/2448100300 >> v1:172.21.2.119:6789/0 conn(0x7fd884148420 legacy=0x7fd8840b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:02.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/2448100300 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840b0910 con 0x7fd8840a7140 2021-11-15T14:44:02.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- 172.21.2.135:0/2448100300 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8840a7140 0x7fd8841447a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fd8841477b0 tx=0x7fd87c009290).ready entity=mon.1 client_cookie=d1103f193effb0cf server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd8837fe700 1 -- 172.21.2.135:0/2448100300 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00b820 con 0x7fd8840a7140 2021-11-15T14:44:02.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd8837fe700 1 -- 172.21.2.135:0/2448100300 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00b980 con 0x7fd8840a7140 2021-11-15T14:44:02.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd8837fe700 1 -- 172.21.2.135:0/2448100300 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00bb30 con 0x7fd8840a7140 2021-11-15T14:44:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/2448100300 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8840a7140 msgr2=0x7fd8841447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- 172.21.2.135:0/2448100300 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8840a7140 0x7fd8841447a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fd8841477b0 tx=0x7fd87c009290).stop 2021-11-15T14:44:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/2448100300 shutdown_connections 2021-11-15T14:44:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- 172.21.2.135:0/2448100300 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd8840a7140 0x7fd8841447a0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- 172.21.2.135:0/2448100300 >> v2:172.21.2.119:3300/0 conn(0x7fd8840b1e30 0x7fd8840b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/2448100300 >> 172.21.2.135:0/2448100300 conn(0x7fd88405f730 msgr2=0x7fd88405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/2448100300 shutdown_connections 2021-11-15T14:44:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/2448100300 wait complete. 2021-11-15T14:44:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 Processor -- start 2021-11-15T14:44:02.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- start start 2021-11-15T14:44:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8840a7140 0x7fd8840a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8840b1e30 0x7fd884143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841444d0 con 0x7fd8840a7140 2021-11-15T14:44:02.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840abb50 con 0x7fd884148420 2021-11-15T14:44:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840af8b0 con 0x7fd8840b1e30 2021-11-15T14:44:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36888/0 (socket says 172.21.2.135:36888) 2021-11-15T14:44:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/3560571377 learned_addr learned my addr 172.21.2.135:0/3560571377 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8840b1e30 msgr2=0x7fd884143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8840b1e30 0x7fd884143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8840a7140 msgr2=0x7fd8840a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8840a7140 0x7fd8840a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 -- 172.21.2.135:0/3560571377 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009530 con 0x7fd884148420 2021-11-15T14:44:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd889581700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fd8841477b0 tx=0x7fd87c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c00b820 con 0x7fd884148420 2021-11-15T14:44:02.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c0032f0 con 0x7fd884148420 2021-11-15T14:44:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87c020620 con 0x7fd884148420 2021-11-15T14:44:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8840afb50 con 0x7fd884148420 2021-11-15T14:44:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.908+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8840ae8f0 con 0x7fd884148420 2021-11-15T14:44:02.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8840aeab0 con 0x7fd884148420 2021-11-15T14:44:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd87c026020 con 0x7fd884148420 2021-11-15T14:44:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd881ffb700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 0x7fd868055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd87c06cb90 con 0x7fd884148420 2021-11-15T14:44:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd888d80700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 0x7fd868055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:02.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd888d80700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 0x7fd868055bb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd874002f70 tx=0x7fd874006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:02.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:02.912+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd87c043a30 con 0x7fd884148420 2021-11-15T14:44:03.025 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.020+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8840aea80 con 0x7fd884148420 2021-11-15T14:44:03.026 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd881ffb700 1 -- 172.21.2.135:0/3560571377 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fd87c015020 con 0x7fd884148420 2021-11-15T14:44:03.027 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T14:44:03.027 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":84,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.119:6835/420307565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6834","nonce":420307565},{"type":"v1","addr":"172.21.2.119:6835","nonce":420307565}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":81},{"gid":8704,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.135:6834/1205820886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6832","nonce":1205820886},{"type":"v1","addr":"172.21.2.135:6834","nonce":1205820886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-15T14:43:47.237805+0000","modified":"2021-11-15T14:44:02.838780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":165,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-15T14:44:03.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 msgr2=0x7fd868055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.028 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 0x7fd868055bb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd874002f70 tx=0x7fd874006a80).stop 2021-11-15T14:44:03.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 msgr2=0x7fd884143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7fd8841477b0 tx=0x7fd87c016000).stop 2021-11-15T14:44:03.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 shutdown_connections 2021-11-15T14:44:03.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd8680536f0 0x7fd868055bb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.029 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd884148420 0x7fd884143fe0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd8840b1e30 0x7fd884143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 --2- 172.21.2.135:0/3560571377 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd8840a7140 0x7fd8840a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 >> 172.21.2.135:0/3560571377 conn(0x7fd88405f730 msgr2=0x7fd8840b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:03.030 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 shutdown_connections 2021-11-15T14:44:03.031 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.024+0000 7fd88afe4700 1 -- 172.21.2.135:0/3560571377 wait complete. 2021-11-15T14:44:03.031 INFO:teuthology.orchestra.run.gibba035.stderr:dumped fsmap epoch 84 2021-11-15T14:44:03.034 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-15T14:44:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 Processor -- start 2021-11-15T14:44:03.086 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- start start 2021-11-15T14:44:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe3d00b1350 0x7fe3d00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe3d00b2320 0x7fe3d01412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.088 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00a7850 con 0x7fe3d00b1f40 2021-11-15T14:44:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00b17c0 con 0x7fe3d00b1350 2021-11-15T14:44:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00b06d0 con 0x7fe3d00b2320 2021-11-15T14:44:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ce59c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fe3d00b1f40 0x7fe3d00a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52712/0 (socket says 172.21.2.135:52712) 2021-11-15T14:44:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ce59c700 1 -- 172.21.2.135:0/1534756433 learned_addr learned my addr 172.21.2.135:0/1534756433 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:44:03.089 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1534756433 >> v2:172.21.2.135:3300/0 conn(0x7fe3d00b2320 0x7fe3d01412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3cd59a700 1 -- 172.21.2.135:0/1534756433 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450886227 0 0) 0x7fe3d00a7850 con 0x7fe3d00b1f40 2021-11-15T14:44:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3cd59a700 1 -- 172.21.2.135:0/1534756433 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b0003260 con 0x7fe3d00b1f40 2021-11-15T14:44:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1534756433 >> v2:172.21.2.119:3300/0 conn(0x7fe3d00b1350 msgr2=0x7fe3d00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:03.090 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1534756433 >> v2:172.21.2.119:3300/0 conn(0x7fe3d00b1350 0x7fe3d00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1534756433 >> v1:172.21.2.135:6789/0 conn(0x7fe3d00b1f40 legacy=0x7fe3d00a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1534756433 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00b0970 con 0x7fe3d00b2320 2021-11-15T14:44:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1534756433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d01412d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fe3b8001110 tx=0x7fe3c80091d0).ready entity=mon.1 client_cookie=b56ff65e3d725a1e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.091 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3cd59a700 1 -- 172.21.2.135:0/1534756433 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800b640 con 0x7fe3d00b2320 2021-11-15T14:44:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3cd59a700 1 -- 172.21.2.135:0/1534756433 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800b7a0 con 0x7fe3d00b2320 2021-11-15T14:44:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3cd59a700 1 -- 172.21.2.135:0/1534756433 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800b910 con 0x7fe3d00b2320 2021-11-15T14:44:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1534756433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 msgr2=0x7fe3d01412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1534756433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d01412d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fe3b8001110 tx=0x7fe3c80091d0).stop 2021-11-15T14:44:03.092 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1534756433 shutdown_connections 2021-11-15T14:44:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1534756433 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d01412d0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1534756433 >> v2:172.21.2.119:3300/0 conn(0x7fe3d00b1350 0x7fe3d00b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1534756433 >> 172.21.2.135:0/1534756433 conn(0x7fe3d005f730 msgr2=0x7fe3d005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1534756433 shutdown_connections 2021-11-15T14:44:03.093 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1534756433 wait complete. 2021-11-15T14:44:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 Processor -- start 2021-11-15T14:44:03.096 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- start start 2021-11-15T14:44:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 0x7fe3d00adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 0x7fe3d00630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0156ef0 con 0x7fe3d00b1350 2021-11-15T14:44:03.097 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0148980 con 0x7fe3d00b2320 2021-11-15T14:44:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.084+0000 7fe3d4c29700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0148c20 con 0x7fe3d00b1f40 2021-11-15T14:44:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36898/0 (socket says 172.21.2.135:36898) 2021-11-15T14:44:03.098 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1580991180 learned_addr learned my addr 172.21.2.135:0/1580991180 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ce59c700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 0x7fe3d00adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3cdd9b700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 0x7fe3d00630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 msgr2=0x7fe3d00630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 0x7fe3d00630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.099 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 msgr2=0x7fe3d00adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 0x7fe3d00adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 -- 172.21.2.135:0/1580991180 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009470 con 0x7fe3d00b2320 2021-11-15T14:44:03.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ce59c700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 0x7fe3d00adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:44:03.100 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3cdd9b700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 0x7fe3d00630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T14:44:03.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ced9d700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fe3b8001110 tx=0x7fe3c8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c80032d0 con 0x7fe3d00b2320 2021-11-15T14:44:03.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8021480 con 0x7fe3d00b2320 2021-11-15T14:44:03.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c80217e0 con 0x7fe3d00b2320 2021-11-15T14:44:03.101 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0148ec0 con 0x7fe3d00b2320 2021-11-15T14:44:03.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0149690 con 0x7fe3d00b2320 2021-11-15T14:44:03.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0149850 con 0x7fe3d00b2320 2021-11-15T14:44:03.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3c800f070 con 0x7fe3d00b2320 2021-11-15T14:44:03.102 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 0x7fe3b4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe3c806ce90 con 0x7fe3d00b2320 2021-11-15T14:44:03.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.088+0000 7fe3ce59c700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 0x7fe3b4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.092+0000 7fe3ce59c700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 0x7fe3b4055bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe3b8008000 tx=0x7fe3b8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.103 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.092+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3c8070030 con 0x7fe3d00b2320 2021-11-15T14:44:03.203 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.200+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe3d00573d0 con 0x7fe3d00b2320 2021-11-15T14:44:03.857 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.852+0000 7fe3c77fe700 1 -- 172.21.2.135:0/1580991180 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3c8015020 con 0x7fe3d00b2320 2021-11-15T14:44:03.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 msgr2=0x7fe3b4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 0x7fe3b4055bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe3b8008000 tx=0x7fe3b8009040).stop 2021-11-15T14:44:03.859 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 msgr2=0x7fe3d00635b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fe3b8001110 tx=0x7fe3c8016000).stop 2021-11-15T14:44:03.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 shutdown_connections 2021-11-15T14:44:03.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe3b40536f0 0x7fe3b4055bb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.860 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe3d00b2320 0x7fe3d00635b0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe3d00b1f40 0x7fe3d00630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 --2- 172.21.2.135:0/1580991180 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe3d00b1350 0x7fe3d00adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 >> 172.21.2.135:0/1580991180 conn(0x7fe3d005f730 msgr2=0x7fe3d013cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:03.861 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 shutdown_connections 2021-11-15T14:44:03.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.856+0000 7fe3d4c29700 1 -- 172.21.2.135:0/1580991180 wait complete. 2021-11-15T14:44:03.865 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-15T14:44:03.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 Processor -- start 2021-11-15T14:44:03.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 -- start start 2021-11-15T14:44:03.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f2aa4148420 0x7f2aa40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40b03d0 con 0x7f2aa40a7140 2021-11-15T14:44:03.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40b0670 con 0x7f2aa40b1e30 2021-11-15T14:44:03.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa8f97700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40a9140 con 0x7f2aa4148420 2021-11-15T14:44:03.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa259c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f2aa40b1e30 0x7f2aa40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52728/0 (socket says 172.21.2.135:52728) 2021-11-15T14:44:03.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa259c700 1 -- 172.21.2.135:0/3563448459 learned_addr learned my addr 172.21.2.135:0/3563448459 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T14:44:03.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa1d9b700 1 --2- 172.21.2.135:0/3563448459 >> v2:172.21.2.135:3300/0 conn(0x7f2aa4148420 0x7f2aa40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa1d9b700 1 -- 172.21.2.135:0/3563448459 >> v1:172.21.2.135:6789/0 conn(0x7f2aa40b1e30 legacy=0x7f2aa40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa1d9b700 1 -- 172.21.2.135:0/3563448459 >> v1:172.21.2.119:6789/0 conn(0x7f2aa40a7140 legacy=0x7f2aa41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:03.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa1d9b700 1 -- 172.21.2.135:0/3563448459 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40b0910 con 0x7f2aa4148420 2021-11-15T14:44:03.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.916+0000 7f2aa1d9b700 1 --2- 172.21.2.135:0/3563448459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa4148420 0x7f2aa40b1050 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f2aa40acee0 tx=0x7f2a94006df0).ready entity=mon.1 client_cookie=7779d739625c65eb server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa159a700 1 -- 172.21.2.135:0/3563448459 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9400d5c0 con 0x7f2aa4148420 2021-11-15T14:44:03.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa159a700 1 -- 172.21.2.135:0/3563448459 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94000e90 con 0x7f2aa4148420 2021-11-15T14:44:03.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa159a700 1 -- 172.21.2.135:0/3563448459 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9400d910 con 0x7f2aa4148420 2021-11-15T14:44:03.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/3563448459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa4148420 msgr2=0x7f2aa40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/3563448459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa4148420 0x7f2aa40b1050 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f2aa40acee0 tx=0x7f2a94006df0).stop 2021-11-15T14:44:03.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/3563448459 shutdown_connections 2021-11-15T14:44:03.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/3563448459 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa4148420 0x7f2aa40b1050 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:03.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/3563448459 >> 172.21.2.135:0/3563448459 conn(0x7f2aa405f730 msgr2=0x7f2aa405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:03.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/3563448459 shutdown_connections 2021-11-15T14:44:03.927 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/3563448459 wait complete. 2021-11-15T14:44:03.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 Processor -- start 2021-11-15T14:44:03.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- start start 2021-11-15T14:44:03.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2aa40b1e30 0x7f2aa40aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2aa4148420 0x7f2aa415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4062fe0 con 0x7f2aa4148420 2021-11-15T14:44:03.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa415a220 con 0x7f2aa40a7140 2021-11-15T14:44:03.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40aa240 con 0x7f2aa40b1e30 2021-11-15T14:44:03.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36916/0 (socket says 172.21.2.135:36916) 2021-11-15T14:44:03.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 -- 172.21.2.135:0/2073757030 learned_addr learned my addr 172.21.2.135:0/2073757030 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:03.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 -- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2aa40b1e30 msgr2=0x7f2aa40aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2aa40b1e30 0x7f2aa40aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 -- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2aa4148420 msgr2=0x7f2aa415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:03.932 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2aa4148420 0x7f2aa415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:03.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 -- 172.21.2.135:0/2073757030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9400b180 con 0x7f2aa40a7140 2021-11-15T14:44:03.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa259c700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f2aa40a9760 tx=0x7f2a8c007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8c00ce20 con 0x7f2aa40a7140 2021-11-15T14:44:03.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0072e0 con 0x7f2aa40a7140 2021-11-15T14:44:03.933 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8c005800 con 0x7f2aa40a7140 2021-11-15T14:44:03.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40aa4e0 con 0x7f2aa40a7140 2021-11-15T14:44:03.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa40a9f30 con 0x7f2aa40a7140 2021-11-15T14:44:03.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40b0bb0 con 0x7f2aa40a7140 2021-11-15T14:44:03.934 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a8c010070 con 0x7f2aa40a7140 2021-11-15T14:44:03.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 0x7f2a88055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:03.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.920+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f2a8c06b0f0 con 0x7f2aa40a7140 2021-11-15T14:44:03.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.924+0000 7f2aa1d9b700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 0x7f2a88055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:03.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.924+0000 7f2aa1d9b700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 0x7f2a88055ad0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f2aa40acee0 tx=0x7f2a94014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:03.935 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:03.924+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a8c0420a0 con 0x7f2aa40a7140 2021-11-15T14:44:04.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.008+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2aa40573d0 con 0x7f2aa40a7140 2021-11-15T14:44:04.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2a9b7fe700 1 -- 172.21.2.135:0/2073757030 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2a8c018020 con 0x7f2aa40a7140 2021-11-15T14:44:04.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 msgr2=0x7f2a88055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:04.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 0x7f2a88055ad0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f2aa40acee0 tx=0x7f2a94014000).stop 2021-11-15T14:44:04.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 msgr2=0x7f2aa4144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:04.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f2aa40a9760 tx=0x7f2a8c007c00).stop 2021-11-15T14:44:04.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 shutdown_connections 2021-11-15T14:44:04.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f2a88053610 0x7f2a88055ad0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:04.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f2aa4148420 0x7f2aa415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f2aa40b1e30 0x7f2aa40aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 --2- 172.21.2.135:0/2073757030 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f2aa40a7140 0x7f2aa4144cf0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:04.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 >> 172.21.2.135:0/2073757030 conn(0x7f2aa405f730 msgr2=0x7f2aa40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:04.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 shutdown_connections 2021-11-15T14:44:04.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.892+0000 7f2aa8f97700 1 -- 172.21.2.135:0/2073757030 wait complete. 2021-11-15T14:44:04.899 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_metadata' removed 2021-11-15T14:44:04.904 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-15T14:44:04.956 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 Processor -- start 2021-11-15T14:44:04.957 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 -- start start 2021-11-15T14:44:04.958 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fe5400b1e30 0x7fe5400b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5400a7140 0x7fe5401447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5400b03d0 con 0x7fe540148420 2021-11-15T14:44:04.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400a9140 con 0x7fe5400b1e30 2021-11-15T14:44:04.959 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe54611e700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400b0670 con 0x7fe5400a7140 2021-11-15T14:44:04.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe53ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5400a7140 0x7fe5401447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:04.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe53ffff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fe5400a7140 0x7fe5401447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36922/0 (socket says 172.21.2.135:36922) 2021-11-15T14:44:04.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.952+0000 7fe53ffff700 1 -- 172.21.2.135:0/1282980650 learned_addr learned my addr 172.21.2.135:0/1282980650 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:04.960 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1282980650 >> v2:172.21.2.119:3300/0 conn(0x7fe5400b1e30 msgr2=0x7fe5400b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:04.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- 172.21.2.135:0/1282980650 >> v2:172.21.2.119:3300/0 conn(0x7fe5400b1e30 0x7fe5400b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1282980650 >> v1:172.21.2.119:6789/0 conn(0x7fe540148420 legacy=0x7fe5400b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T14:44:04.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1282980650 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400b0910 con 0x7fe5400a7140 2021-11-15T14:44:04.961 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- 172.21.2.135:0/1282980650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5400a7140 0x7fe5401447a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fe5401477b0 tx=0x7fe538009290).ready entity=mon.1 client_cookie=7fd002b963878178 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:04.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53e7fc700 1 -- 172.21.2.135:0/1282980650 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800b820 con 0x7fe5400a7140 2021-11-15T14:44:04.962 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53e7fc700 1 -- 172.21.2.135:0/1282980650 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800b980 con 0x7fe5400a7140 2021-11-15T14:44:04.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53e7fc700 1 -- 172.21.2.135:0/1282980650 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800bb30 con 0x7fe5400a7140 2021-11-15T14:44:04.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1282980650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5400a7140 msgr2=0x7fe5401447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:04.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- 172.21.2.135:0/1282980650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5400a7140 0x7fe5401447a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fe5401477b0 tx=0x7fe538009290).stop 2021-11-15T14:44:04.963 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1282980650 shutdown_connections 2021-11-15T14:44:04.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- 172.21.2.135:0/1282980650 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe5400a7140 0x7fe5401447a0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:04.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- 172.21.2.135:0/1282980650 >> v2:172.21.2.119:3300/0 conn(0x7fe5400b1e30 0x7fe5400b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.964 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1282980650 >> 172.21.2.135:0/1282980650 conn(0x7fe54005f730 msgr2=0x7fe54005fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:04.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1282980650 shutdown_connections 2021-11-15T14:44:04.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1282980650 wait complete. 2021-11-15T14:44:04.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 Processor -- start 2021-11-15T14:44:04.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- start start 2021-11-15T14:44:04.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5400a7140 0x7fe5400ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5400b1e30 0x7fe5400ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54014b700 con 0x7fe5400b1e30 2021-11-15T14:44:04.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54014a710 con 0x7fe540148420 2021-11-15T14:44:04.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54014b930 con 0x7fe5400a7140 2021-11-15T14:44:04.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:04.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:36928/0 (socket says 172.21.2.135:36928) 2021-11-15T14:44:04.969 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1888950720 learned_addr learned my addr 172.21.2.135:0/1888950720 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T14:44:04.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5400a7140 msgr2=0x7fe5400ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:04.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5400a7140 0x7fe5400ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5400b1e30 msgr2=0x7fe5400ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:04.970 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5400b1e30 0x7fe5400ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:04.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 -- 172.21.2.135:0/1888950720 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009530 con 0x7fe540148420 2021-11-15T14:44:04.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53ffff700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fe5400a8010 tx=0x7fe538016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:04.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53800b820 con 0x7fe540148420 2021-11-15T14:44:04.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380032f0 con 0x7fe540148420 2021-11-15T14:44:04.971 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe538020620 con 0x7fe540148420 2021-11-15T14:44:04.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54014bbd0 con 0x7fe540148420 2021-11-15T14:44:04.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54014a9b0 con 0x7fe540148420 2021-11-15T14:44:04.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.956+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5400abf30 con 0x7fe540148420 2021-11-15T14:44:04.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe538026020 con 0x7fe540148420 2021-11-15T14:44:04.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53cff9700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 0x7fe520055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T14:44:04.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fe53806c9f0 con 0x7fe540148420 2021-11-15T14:44:04.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53f7fe700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 0x7fe520055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T14:44:04.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53f7fe700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 0x7fe520055bb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fe534002f70 tx=0x7fe534006a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T14:44:04.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:04.960+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe538043a50 con 0x7fe540148420 2021-11-15T14:44:05.046 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.044+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5400b0bb0 con 0x7fe540148420 2021-11-15T14:44:05.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe53cff9700 1 -- 172.21.2.135:0/1888950720 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe538015020 con 0x7fe540148420 2021-11-15T14:44:05.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 msgr2=0x7fe520055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:05.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 0x7fe520055bb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fe534002f70 tx=0x7fe534006a80).stop 2021-11-15T14:44:05.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 msgr2=0x7fe5400ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T14:44:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fe5400a8010 tx=0x7fe538016000).stop 2021-11-15T14:44:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 shutdown_connections 2021-11-15T14:44:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe5200536f0 0x7fe520055bb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:05.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe540148420 0x7fe5400ab780 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T14:44:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe5400b1e30 0x7fe5400ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 --2- 172.21.2.135:0/1888950720 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe5400a7140 0x7fe5400ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T14:44:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 >> 172.21.2.135:0/1888950720 conn(0x7fe54005f730 msgr2=0x7fe540144a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T14:44:05.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 shutdown_connections 2021-11-15T14:44:05.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T14:44:05.904+0000 7fe54611e700 1 -- 172.21.2.135:0/1888950720 wait complete. 2021-11-15T14:44:05.911 INFO:teuthology.orchestra.run.gibba035.stderr:pool 'cephfs_data' removed 2021-11-15T14:44:05.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-15T14:44:05.915 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-15T14:44:12.856 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:12.860 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:12.864 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:12.866 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:36.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:44:36.031 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:44:36.032 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:44:42.908 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:42.912 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:42.916 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:44:42.918 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:05.932 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T14:45:05.939 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T14:45:12.968 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:12.972 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:12.975 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:12.979 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:43.028 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:43.033 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:43.037 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:45:43.041 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:13.080 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:13.084 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:13.087 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:13.091 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:43.236 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:43.241 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:43.244 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:46:43.247 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:13.300 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:13.303 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:13.307 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:13.310 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:43.408 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:43.413 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:43.416 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:47:43.420 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:13.468 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:13.472 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:13.475 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:13.478 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:43.546 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:43.550 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:43.553 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:48:43.557 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:13.624 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:13.629 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:13.633 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:13.637 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:43.679 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:43.683 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:43.686 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:49:43.689 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:13.755 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:13.759 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:13.763 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:13.766 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:43.807 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:43.811 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:43.815 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:50:43.818 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:13.864 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:13.868 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:13.871 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:13.875 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:44.016 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:44.020 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:44.023 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:51:44.026 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:14.091 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:14.094 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:14.097 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:14.099 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:44.211 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:44.215 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:44.218 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:52:44.221 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:14.326 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:14.330 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:14.334 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:14.337 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:44.408 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:44.412 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:44.415 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:53:44.418 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:14.458 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:14.462 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:14.465 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:14.468 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:44.509 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:44.513 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:44.516 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:54:44.519 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:14.612 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:14.615 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:14.619 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:14.622 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:44.669 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:44.673 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:44.676 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:55:44.680 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:14.724 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:14.732 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:14.739 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:14.749 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:44.806 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:44.812 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:44.823 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:56:44.829 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:14.890 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:14.894 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:14.897 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:14.900 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:45.010 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:45.015 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:45.019 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:57:45.026 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:15.067 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:15.071 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:15.074 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:15.078 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:45.170 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:45.173 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:45.177 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:58:45.180 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:15.264 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:15.267 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:15.271 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:15.274 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:36.037 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T14:59:36.038 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T14:59:36.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T14:59:36.051 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-15T14:59:36.051 DEBUG:teuthology.orchestra.run.gibba019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:59:36.065 DEBUG:teuthology.orchestra.run.gibba032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:59:36.078 DEBUG:teuthology.orchestra.run.gibba035:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:59:36.092 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-15T14:59:36.105 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-15T14:59:36.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T14:59:36.106 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T14:59:36.106 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T14:59:45.321 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:45.325 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:45.328 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T14:59:45.332 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:15.381 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:15.385 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:15.389 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:15.392 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:45.468 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:45.472 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:45.475 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:00:45.478 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:15.519 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:15.523 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:15.526 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:15.528 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:45.571 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:45.607 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:45.610 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:01:45.614 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:15.652 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:15.656 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:15.659 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:15.662 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:45.727 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:45.731 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:45.735 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:02:45.738 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:15.780 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:15.784 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:15.787 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:15.791 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:45.857 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:45.861 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:45.864 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:03:45.867 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:15.914 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:15.918 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:15.922 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:15.925 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:45.991 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:45.995 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:45.998 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:04:46.001 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:16.072 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:16.079 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:16.085 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:16.089 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:46.136 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:46.140 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:46.144 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:05:46.147 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:16.210 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:16.214 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:16.218 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:16.221 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:46.288 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:46.292 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:46.295 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:06:46.298 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:16.343 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:16.347 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:16.351 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:16.354 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:46.448 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:46.452 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:46.456 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:07:46.459 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:16.508 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:16.513 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:16.516 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:16.519 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:46.585 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:46.590 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:46.593 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:08:46.596 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:16.680 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:16.683 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:16.686 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:16.688 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:46.738 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:46.752 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:46.765 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:09:46.774 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:16.824 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:16.828 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:16.831 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:16.834 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:46.882 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:46.886 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:46.889 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:10:46.893 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:16.943 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:16.947 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:16.950 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:16.953 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:47.002 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:47.006 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:47.009 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:11:47.013 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:17.060 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:17.064 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:17.068 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:17.071 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:47.128 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:47.133 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:47.136 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:12:47.139 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:17.202 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:17.206 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:17.209 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:17.213 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:47.274 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:47.277 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:47.281 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:13:47.284 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:17.332 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:17.336 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:17.339 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:17.343 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:36.109 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T15:14:36.110 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T15:14:36.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:14:36.115 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-11-15T15:14:36.115 INFO:tasks.cephfs_test_runner:ERROR 2021-11-15T15:14:36.116 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.116 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T15:14:36.116 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.117 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T15:14:36.117 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T15:14:36.118 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T15:14:36.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T15:14:36.118 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T15:14:36.119 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T15:14:36.119 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.119 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T15:14:36.119 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.120 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.120 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-15T15:14:36.120 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-15T15:14:36.120 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-15T15:14:36.121 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-15T15:14:36.121 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T15:14:36.121 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T15:14:36.121 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T15:14:36.122 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T15:14:36.122 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T15:14:36.122 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T15:14:36.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T15:14:36.123 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T15:14:36.123 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T15:14:36.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T15:14:36.124 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T15:14:36.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T15:14:36.124 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T15:14:36.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T15:14:36.125 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T15:14:36.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T15:14:36.125 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T15:14:36.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T15:14:36.126 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T15:14:36.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T15:14:36.127 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T15:14:36.127 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T15:14:36.127 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.127 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T15:14:36.128 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.128 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T15:14:36.128 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T15:14:36.129 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T15:14:36.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T15:14:36.130 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T15:14:36.130 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T15:14:36.130 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.130 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T15:14:36.131 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.131 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.131 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-15T15:14:36.132 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-15T15:14:36.132 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-15T15:14:36.132 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-15T15:14:36.132 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-15T15:14:36.133 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-15T15:14:36.133 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T15:14:36.133 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T15:14:36.133 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T15:14:36.134 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T15:14:36.134 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T15:14:36.134 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T15:14:36.135 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T15:14:36.135 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T15:14:36.135 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T15:14:36.135 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T15:14:36.136 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T15:14:36.136 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T15:14:36.136 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T15:14:36.137 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T15:14:36.137 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T15:14:36.137 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T15:14:36.137 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T15:14:36.138 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T15:14:36.138 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T15:14:36.138 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T15:14:36.139 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T15:14:36.139 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T15:14:36.139 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.140 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T15:14:36.140 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2390.169s 2021-11-15T15:14:36.140 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.141 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-11-15T15:14:36.141 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.141 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T15:14:36.142 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.142 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T15:14:36.142 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.142 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T15:14:36.143 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T15:14:36.143 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T15:14:36.143 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T15:14:36.144 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T15:14:36.144 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.144 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T15:14:36.145 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.145 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.145 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-15T15:14:36.145 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-15T15:14:36.146 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-15T15:14:36.146 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-15T15:14:36.146 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T15:14:36.146 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T15:14:36.147 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T15:14:36.147 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T15:14:36.147 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T15:14:36.148 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T15:14:36.148 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T15:14:36.148 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T15:14:36.148 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T15:14:36.149 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T15:14:36.149 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T15:14:36.149 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T15:14:36.150 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T15:14:36.150 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T15:14:36.150 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T15:14:36.150 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T15:14:36.151 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T15:14:36.151 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T15:14:36.151 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T15:14:36.152 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T15:14:36.152 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T15:14:36.152 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T15:14:36.152 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.153 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-15T15:14:36.153 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.153 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-15T15:14:36.153 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.154 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-15T15:14:36.154 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-15T15:14:36.154 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-15T15:14:36.155 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-15T15:14:36.155 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-15T15:14:36.155 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.156 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-15T15:14:36.156 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.156 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-15T15:14:36.156 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-15T15:14:36.157 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-15T15:14:36.157 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-15T15:14:36.157 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-15T15:14:36.158 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-15T15:14:36.158 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-15T15:14:36.158 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-15T15:14:36.158 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-15T15:14:36.159 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait 2021-11-15T15:14:36.159 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-15T15:14:36.159 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-15T15:14:36.160 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-15T15:14:36.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-15T15:14:36.160 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-15T15:14:36.160 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-15T15:14:36.161 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-15T15:14:36.161 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-15T15:14:36.161 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-15T15:14:36.161 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-15T15:14:36.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-15T15:14:36.162 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-15T15:14:36.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-15T15:14:36.163 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-15T15:14:36.163 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-15T15:14:36.163 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-15T15:14:36.164 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-15T15:14:36.164 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-15T15:14:36.164 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-15T15:14:36.164 INFO:tasks.cephfs_test_runner: 2021-11-15T15:14:36.165 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.422 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b64b20bef5b14509acd4d5b46f77e91e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-15T15:14:36.425 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-11-15T15:14:36.433 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-11-15T15:14:36.485 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-11-15T15:14:36.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T15:14:36.486 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T15:14:36.486 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T15:14:47.391 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:47.395 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:47.398 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:14:47.402 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:17.459 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:17.464 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:17.467 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:17.470 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:47.536 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:47.540 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:47.544 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:15:47.547 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:17.614 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:17.619 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:17.625 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:17.635 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:47.682 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:47.685 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:47.689 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:16:47.692 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:17.734 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:17.739 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:17.742 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:17.745 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:47.820 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:47.824 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:47.828 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:17:47.831 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:17.877 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:17.881 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:17.885 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:17.888 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:47.989 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:47.993 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:47.997 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:18:48.000 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:18.052 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:18.056 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:18.060 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:18.063 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:48.128 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:48.132 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:48.135 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:19:48.138 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:18.188 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:18.192 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:18.196 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:18.199 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:48.257 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:48.261 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:48.264 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:20:48.267 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:18.316 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:18.320 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:18.323 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:18.327 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:48.370 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:48.374 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:48.377 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:21:48.380 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:18.428 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:18.432 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:18.435 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:18.438 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:48.490 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:48.493 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:48.496 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:22:48.499 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:18.573 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:18.577 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:18.580 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:18.584 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:48.641 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:48.644 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:48.647 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:23:48.651 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:18.705 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:18.709 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:18.713 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:18.717 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:48.775 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:48.779 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:48.783 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:24:48.786 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:18.837 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:18.845 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:18.853 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:18.860 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:48.904 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:48.908 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:48.912 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:25:48.916 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:18.966 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:18.970 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:18.974 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:18.977 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:49.033 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:49.037 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:49.040 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:26:49.043 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:19.115 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:19.119 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:19.122 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:19.126 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:49.181 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:49.185 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:49.189 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:27:49.192 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:19.238 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:19.242 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:19.245 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:19.248 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:49.316 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:49.319 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:49.323 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:28:49.325 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:19.402 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:19.407 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:19.410 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:19.413 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:36.516 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Connection timed out 2021-11-15T15:29:36.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:29:36.518 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-15T15:29:36.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-15T15:29:36.519 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-15T15:29:36.520 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-15T15:29:49.464 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:49.468 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:49.472 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:29:49.475 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:19.524 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:19.527 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:19.531 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:19.534 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:49.581 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:49.586 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:49.589 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:30:49.592 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:19.645 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:19.648 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:19.652 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:19.655 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:49.706 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:49.709 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:49.713 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:31:49.715 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:19.764 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:19.768 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:19.771 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:19.774 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:49.893 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:49.897 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:49.901 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:32:49.904 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:19.970 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:19.974 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:19.978 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:19.981 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:50.043 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:50.046 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:50.048 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:33:50.050 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:20.095 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:20.098 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:20.100 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:20.103 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:50.172 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:50.175 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:50.178 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:34:50.181 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:20.249 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:20.254 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:20.257 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:20.260 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:50.323 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:50.327 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:50.329 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:35:50.332 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:20.384 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:20.389 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:20.392 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:20.395 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:50.520 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:50.524 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:50.527 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:36:50.531 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:20.580 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:20.584 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:20.588 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:20.591 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:50.651 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:50.655 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:50.658 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:37:50.661 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:20.707 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:20.711 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:20.714 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:20.718 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:50.773 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:50.778 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:50.782 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:38:50.786 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:20.835 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:20.862 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:20.865 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:20.868 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:50.921 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:50.924 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:50.928 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:39:50.930 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:20.979 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:20.983 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:20.986 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:20.989 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:51.038 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:51.045 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:51.057 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:40:51.068 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:21.132 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:21.136 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:21.140 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:21.143 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:51.190 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:51.194 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:51.197 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:41:51.200 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:21.250 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:21.254 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:21.257 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:21.261 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:51.316 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:51.320 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:51.323 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:42:51.327 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:21.367 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:21.371 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:21.374 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:21.377 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:51.449 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:51.453 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:51.456 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:43:51.459 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:21.508 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:21.513 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:21.516 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:21.519 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:36.524 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T15:44:36.541 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-15T15:44:36.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:44:36.568 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T15:44:36.579 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-11-15T15:44:36.590 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-11-15T15:44:36.591 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T15:44:36.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 Processor -- start 2021-11-15T15:44:36.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- start start 2021-11-15T15:44:36.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6780060180 0x7f6780066500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800669f0 0x7f678014b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6780060560 con 0x7f67800b37c0 2021-11-15T15:44:36.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6780065b20 con 0x7f6780060180 2021-11-15T15:44:36.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780065dc0 con 0x7f67800669f0 2021-11-15T15:44:36.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f6780060180 0x7f6780066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677dd9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f67800b37c0 0x7f678014ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52818/0 (socket says 172.21.2.135:52818) 2021-11-15T15:44:36.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677dd9b700 1 -- 172.21.2.135:0/3379537546 learned_addr learned my addr 172.21.2.135:0/3379537546 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:36.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677ed9d700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800669f0 0x7f678014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 -- 172.21.2.135:0/3379537546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800669f0 msgr2=0x7f678014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800669f0 0x7f678014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 -- 172.21.2.135:0/3379537546 >> v1:172.21.2.135:6789/0 conn(0x7f67800b37c0 legacy=0x7f678014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677d59a700 1 -- 172.21.2.135:0/3379537546 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683645711 0 0) 0x7f6780060560 con 0x7f67800b37c0 2021-11-15T15:44:36.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 -- 172.21.2.135:0/3379537546 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780066060 con 0x7f6780060180 2021-11-15T15:44:36.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677e59c700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6780060180 0x7f6780066500 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f6770002f70 tx=0x7f6770006df0).ready entity=mon.1 client_cookie=4757b5b681583a08 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677d59a700 1 -- 172.21.2.135:0/3379537546 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677000d570 con 0x7f6780060180 2021-11-15T15:44:36.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677d59a700 1 -- 172.21.2.135:0/3379537546 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770000e90 con 0x7f6780060180 2021-11-15T15:44:36.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f677d59a700 1 -- 172.21.2.135:0/3379537546 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677000d8c0 con 0x7f6780060180 2021-11-15T15:44:36.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- 172.21.2.135:0/3379537546 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6780060180 msgr2=0x7f6780066500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6780060180 0x7f6780066500 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f6770002f70 tx=0x7f6770006df0).stop 2021-11-15T15:44:36.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- 172.21.2.135:0/3379537546 shutdown_connections 2021-11-15T15:44:36.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800669f0 0x7f678014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 --2- 172.21.2.135:0/3379537546 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6780060180 0x7f6780066500 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.666 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- 172.21.2.135:0/3379537546 >> 172.21.2.135:0/3379537546 conn(0x7f678005cfb0 msgr2=0x7f678005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:36.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- 172.21.2.135:0/3379537546 shutdown_connections 2021-11-15T15:44:36.667 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.653+0000 7f6784ca2700 1 -- 172.21.2.135:0/3379537546 wait complete. 2021-11-15T15:44:36.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 Processor -- start 2021-11-15T15:44:36.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- start start 2021-11-15T15:44:36.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6780060180 0x7f6780149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800b37c0 0x7f6780148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800ab810 con 0x7f6780060180 2021-11-15T15:44:36.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800abab0 con 0x7f67800669f0 2021-11-15T15:44:36.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800abd50 con 0x7f67800b37c0 2021-11-15T15:44:36.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37008/0 (socket says 172.21.2.135:37008) 2021-11-15T15:44:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 -- 172.21.2.135:0/1405271293 learned_addr learned my addr 172.21.2.135:0/1405271293 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 -- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800b37c0 msgr2=0x7f6780148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800b37c0 0x7f6780148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677e59c700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6780060180 0x7f6780149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 -- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6780060180 msgr2=0x7f6780149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6780060180 0x7f6780149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 -- 172.21.2.135:0/1405271293 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677000b180 con 0x7f67800669f0 2021-11-15T15:44:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677dd9b700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f6774000ed0 tx=0x7f6774007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677400ce80 con 0x7f67800669f0 2021-11-15T15:44:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774001d50 con 0x7f67800669f0 2021-11-15T15:44:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800abff0 con 0x7f67800669f0 2021-11-15T15:44:36.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67740074d0 con 0x7f67800669f0 2021-11-15T15:44:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6780148500 con 0x7f67800669f0 2021-11-15T15:44:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67800573d0 con 0x7f67800669f0 2021-11-15T15:44:36.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6774010070 con 0x7f67800669f0 2021-11-15T15:44:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 0x7f675c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f677406af10 con 0x7f67800669f0 2021-11-15T15:44:36.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.657+0000 7f677e59c700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 0x7f675c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.661+0000 7f677e59c700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 0x7f675c055ad0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f6770017000 tx=0x7f6770015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.661+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6774042150 con 0x7f67800669f0 2021-11-15T15:44:36.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.741+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67800b6e90 con 0x7f67800669f0 2021-11-15T15:44:36.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.741+0000 7f676f7fe700 1 -- 172.21.2.135:0/1405271293 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+13551 (secure 0 0 0) 0x7f6774045770 con 0x7f67800669f0 2021-11-15T15:44:36.747 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T15:44:36.748 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":167,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:44:05.891515+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.135:6835/945123846":"2021-11-16T14:44:02.157879+0000","172.21.2.135:6833/945123846":"2021-11-16T14:44:02.157879+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T15:44:36.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 msgr2=0x7f675c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 0x7f675c055ad0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f6770017000 tx=0x7f6770015000).stop 2021-11-15T15:44:36.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 msgr2=0x7f6780147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f6774000ed0 tx=0x7f6774007c50).stop 2021-11-15T15:44:36.750 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 shutdown_connections 2021-11-15T15:44:36.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f675c053610 0x7f675c055ad0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f67800b37c0 0x7f6780148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:36.751 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f67800669f0 0x7f6780147b20 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 --2- 172.21.2.135:0/1405271293 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6780060180 0x7f6780149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 >> 172.21.2.135:0/1405271293 conn(0x7f678005cfb0 msgr2=0x7f67800b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:36.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 shutdown_connections 2021-11-15T15:44:36.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.745+0000 7f6784ca2700 1 -- 172.21.2.135:0/1405271293 wait complete. 2021-11-15T15:44:36.754 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T15:44:36.805 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 Processor -- start 2021-11-15T15:44:36.806 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 -- start start 2021-11-15T15:44:36.810 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff0060180 0x7feff00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7feff00b4cc0 0x7feff014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.811 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff00aac30 con 0x7feff0067380 2021-11-15T15:44:36.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff0060560 con 0x7feff00b4cc0 2021-11-15T15:44:36.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff82d2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff0066f20 con 0x7feff0060180 2021-11-15T15:44:36.812 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff586d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7feff0067380 0x7feff0143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52834/0 (socket says 172.21.2.135:52834) 2021-11-15T15:44:36.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff586d700 1 -- 172.21.2.135:0/2184636697 learned_addr learned my addr 172.21.2.135:0/2184636697 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:36.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967157996 0 0) 0x7feff00aac30 con 0x7feff0067380 2021-11-15T15:44:36.813 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd8003260 con 0x7feff0067380 2021-11-15T15:44:36.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> v2:172.21.2.119:3300/0 conn(0x7feff00b4cc0 0x7feff014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279501075 0 0) 0x7fefd8003260 con 0x7feff0067380 2021-11-15T15:44:36.814 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff0060180 msgr2=0x7feff00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff606e700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff0060180 0x7feff00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff0060180 0x7feff00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.815 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 >> v2:172.21.2.119:3300/0 conn(0x7feff00b4cc0 msgr2=0x7feff014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 --2- 172.21.2.135:0/2184636697 >> v2:172.21.2.119:3300/0 conn(0x7feff00b4cc0 0x7feff014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00b3430 con 0x7feff0067380 2021-11-15T15:44:36.816 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fefec001660 con 0x7feff0067380 2021-11-15T15:44:36.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 >> v1:172.21.2.135:6789/0 conn(0x7feff0067380 legacy=0x7feff0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd80037d0 0x7fefd8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.817 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefd8004500 0x7fefd8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefd8005070 0x7fefd800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0060560 con 0x7fefd80037d0 2021-11-15T15:44:36.818 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0066f20 con 0x7fefd8005070 2021-11-15T15:44:36.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd800bf00 con 0x7fefd8004500 2021-11-15T15:44:36.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> v2:172.21.2.119:3300/0 conn(0x7feff00b4cc0 0x7feff014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:36.819 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff606e700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff0060180 0x7feff00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefd8005070 0x7fefd800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff586d700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefd8004500 0x7fefd8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.820 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 -- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefd8004500 msgr2=0x7fefd8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fefd8004500 0x7fefd8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 -- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd80037d0 msgr2=0x7fefd8003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.821 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd80037d0 0x7fefd8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.801+0000 7feff686f700 1 -- 172.21.2.135:0/2184636697 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8003260 con 0x7fefd8005070 2021-11-15T15:44:36.822 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff686f700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefd8005070 0x7fefd800b750 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fefe8007000 tx=0x7fefe8008040).ready entity=mon.1 client_cookie=7a31257df8661601 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe800c610 con 0x7fefd8005070 2021-11-15T15:44:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe800c770 con 0x7fefd8005070 2021-11-15T15:44:36.823 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff506c700 1 -- 172.21.2.135:0/2184636697 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe800cad0 con 0x7fefd8005070 2021-11-15T15:44:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2184636697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefd8005070 msgr2=0x7fefd800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 --2- 172.21.2.135:0/2184636697 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fefd8005070 0x7fefd800b750 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fefe8007000 tx=0x7fefe8008040).stop 2021-11-15T15:44:36.824 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff686f700 1 -- 172.21.2.135:0/2184636697 reap_dead start 2021-11-15T15:44:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2184636697 shutdown_connections 2021-11-15T15:44:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2184636697 >> 172.21.2.135:0/2184636697 conn(0x7feff005cfb0 msgr2=0x7feff005f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:36.825 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2184636697 shutdown_connections 2021-11-15T15:44:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2184636697 wait complete. 2021-11-15T15:44:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 Processor -- start 2021-11-15T15:44:36.826 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- start start 2021-11-15T15:44:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd8005070 0x7feff015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.827 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff00a7140 0x7feff01428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00a8080 con 0x7fefd8005070 2021-11-15T15:44:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff015a790 con 0x7feff00ac420 2021-11-15T15:44:36.828 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff015a9c0 con 0x7feff00a7140 2021-11-15T15:44:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37026/0 (socket says 172.21.2.135:37026) 2021-11-15T15:44:36.829 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 -- 172.21.2.135:0/2204479849 learned_addr learned my addr 172.21.2.135:0/2204479849 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff606e700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd8005070 0x7feff015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff686f700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff00a7140 0x7feff01428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.830 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 -- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff00a7140 msgr2=0x7feff01428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff00a7140 0x7feff01428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 -- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd8005070 msgr2=0x7feff015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.831 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd8005070 0x7feff015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 -- 172.21.2.135:0/2204479849 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff015ac60 con 0x7feff00ac420 2021-11-15T15:44:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff586d700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7feff00a75b0 tx=0x7fefec001430).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.832 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefec015630 con 0x7feff00ac420 2021-11-15T15:44:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff00a7be0 con 0x7feff00ac420 2021-11-15T15:44:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec010040 con 0x7feff00ac420 2021-11-15T15:44:36.833 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefec015980 con 0x7feff00ac420 2021-11-15T15:44:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff00adeb0 con 0x7feff00ac420 2021-11-15T15:44:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff015adf0 con 0x7feff00ac420 2021-11-15T15:44:36.834 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fefec015ae0 con 0x7feff00ac420 2021-11-15T15:44:36.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 0x7fefd0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.835 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.805+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fefec06b210 con 0x7feff00ac420 2021-11-15T15:44:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.809+0000 7feff606e700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 0x7fefd0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.836 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.809+0000 7feff606e700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 0x7fefd0055b50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fefe000d000 tx=0x7fefe0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.809+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fefec0424f0 con 0x7feff00ac420 2021-11-15T15:44:36.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.889+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feff00a7a60 con 0x7fefd0053690 2021-11-15T15:44:36.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.897+0000 7fefdf7fe700 1 -- 172.21.2.135:0/2204479849 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66619 (secure 0 0 0) 0x7fefe0013460 con 0x7fefd0053690 2021-11-15T15:44:36.904 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T15:44:36.905 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 msgr2=0x7fefd0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 0x7fefd0055b50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fefe000d000 tx=0x7fefe0008040).stop 2021-11-15T15:44:36.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 msgr2=0x7feff00a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7feff00a75b0 tx=0x7fefec001430).stop 2021-11-15T15:44:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 shutdown_connections 2021-11-15T15:44:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fefd0053690 0x7fefd0055b50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7feff00a7140 0x7feff01428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7feff00ac420 0x7feff00a9170 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 --2- 172.21.2.135:0/2204479849 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fefd8005070 0x7feff015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 >> 172.21.2.135:0/2204479849 conn(0x7feff005cfb0 msgr2=0x7feff00655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:36.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 shutdown_connections 2021-11-15T15:44:36.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.901+0000 7feff82d2700 1 -- 172.21.2.135:0/2204479849 wait complete. 2021-11-15T15:44:36.909 INFO:teuthology.orchestra.run.gibba035.stderr:dumped all 2021-11-15T15:44:36.911 INFO:teuthology.orchestra.run.gibba035.stdout:{"pg_ready":true,"pg_map":{"version":2267,"stamp":"2021-11-15T15:44:34.973263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405240,"kb_used_data":16568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569480,"statfs":{"total":773094113280,"available":764487147520,"internally_reserved":8589934592,"allocated":16965632,"data_stored":8271227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005733"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":144,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.665399+0000","last_change":"2021-11-15T14:34:20.467684+0000","last_active":"2021-11-15T14:44:05.665399+0000","last_peered":"2021-11-15T14:44:05.665399+0000","last_clean":"2021-11-15T14:44:05.665399+0000","last_became_active":"2021-11-15T14:34:20.466743+0000","last_became_peered":"2021-11-15T14:34:20.466743+0000","last_unstale":"2021-11-15T14:44:05.665399+0000","last_undegraded":"2021-11-15T14:44:05.665399+0000","last_fullsized":"2021-11-15T14:44:05.665399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_clean_scrub_stamp":"2021-11-15T14:34:16.050418+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896419+0000","last_change":"2021-11-15T14:34:24.844233+0000","last_active":"2021-11-15T14:44:04.896419+0000","last_peered":"2021-11-15T14:44:04.896419+0000","last_clean":"2021-11-15T14:44:04.896419+0000","last_became_active":"2021-11-15T14:34:24.844069+0000","last_became_peered":"2021-11-15T14:34:24.844069+0000","last_unstale":"2021-11-15T14:44:04.896419+0000","last_undegraded":"2021-11-15T14:44:04.896419+0000","last_fullsized":"2021-11-15T14:44:04.896419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896441+0000","last_change":"2021-11-15T14:34:24.543141+0000","last_active":"2021-11-15T14:44:04.896441+0000","last_peered":"2021-11-15T14:44:04.896441+0000","last_clean":"2021-11-15T14:44:04.896441+0000","last_became_active":"2021-11-15T14:34:24.542973+0000","last_became_peered":"2021-11-15T14:34:24.542973+0000","last_unstale":"2021-11-15T14:44:04.896441+0000","last_undegraded":"2021-11-15T14:44:04.896441+0000","last_fullsized":"2021-11-15T14:44:04.896441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.661191+0000","last_change":"2021-11-15T14:34:24.544907+0000","last_active":"2021-11-15T14:44:05.661191+0000","last_peered":"2021-11-15T14:44:05.661191+0000","last_clean":"2021-11-15T14:44:05.661191+0000","last_became_active":"2021-11-15T14:34:24.544673+0000","last_became_peered":"2021-11-15T14:34:24.544673+0000","last_unstale":"2021-11-15T14:44:05.661191+0000","last_undegraded":"2021-11-15T14:44:05.661191+0000","last_fullsized":"2021-11-15T14:44:05.661191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896393+0000","last_change":"2021-11-15T14:34:24.543140+0000","last_active":"2021-11-15T14:44:04.896393+0000","last_peered":"2021-11-15T14:44:04.896393+0000","last_clean":"2021-11-15T14:44:04.896393+0000","last_became_active":"2021-11-15T14:34:24.542969+0000","last_became_peered":"2021-11-15T14:34:24.542969+0000","last_unstale":"2021-11-15T14:44:04.896393+0000","last_undegraded":"2021-11-15T14:44:04.896393+0000","last_fullsized":"2021-11-15T14:44:04.896393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.662262+0000","last_change":"2021-11-15T14:34:24.544839+0000","last_active":"2021-11-15T14:44:05.662262+0000","last_peered":"2021-11-15T14:44:05.662262+0000","last_clean":"2021-11-15T14:44:05.662262+0000","last_became_active":"2021-11-15T14:34:24.544587+0000","last_became_peered":"2021-11-15T14:34:24.544587+0000","last_unstale":"2021-11-15T14:44:05.662262+0000","last_undegraded":"2021-11-15T14:44:05.662262+0000","last_fullsized":"2021-11-15T14:44:05.662262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896388+0000","last_change":"2021-11-15T14:34:24.543128+0000","last_active":"2021-11-15T14:44:04.896388+0000","last_peered":"2021-11-15T14:44:04.896388+0000","last_clean":"2021-11-15T14:44:04.896388+0000","last_became_active":"2021-11-15T14:34:24.542965+0000","last_became_peered":"2021-11-15T14:34:24.542965+0000","last_unstale":"2021-11-15T14:44:04.896388+0000","last_undegraded":"2021-11-15T14:44:04.896388+0000","last_fullsized":"2021-11-15T14:44:04.896388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.892143+0000","last_change":"2021-11-15T14:34:24.640770+0000","last_active":"2021-11-15T14:44:04.892143+0000","last_peered":"2021-11-15T14:44:04.892143+0000","last_clean":"2021-11-15T14:44:04.892143+0000","last_became_active":"2021-11-15T14:34:24.640524+0000","last_became_peered":"2021-11-15T14:34:24.640524+0000","last_unstale":"2021-11-15T14:44:04.892143+0000","last_undegraded":"2021-11-15T14:44:04.892143+0000","last_fullsized":"2021-11-15T14:44:04.892143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896471+0000","last_change":"2021-11-15T14:34:24.638667+0000","last_active":"2021-11-15T14:44:04.896471+0000","last_peered":"2021-11-15T14:44:04.896471+0000","last_clean":"2021-11-15T14:44:04.896471+0000","last_became_active":"2021-11-15T14:34:24.638483+0000","last_became_peered":"2021-11-15T14:34:24.638483+0000","last_unstale":"2021-11-15T14:44:04.896471+0000","last_undegraded":"2021-11-15T14:44:04.896471+0000","last_fullsized":"2021-11-15T14:44:04.896471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1850000000000001,"15min":1.224},"min":{"1min":0.97699999999999998,"5min":0.54300000000000004,"15min":0.38800000000000001},"max":{"1min":1.595,"5min":1.6419999999999999,"15min":1.911},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.88200000000000001,"5min":0.622,"15min":0.374},"max":{"1min":1.5629999999999999,"5min":1.6519999999999999,"15min":1.7350000000000001},"last":1.5900000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.2350000000000001,"15min":1.236},"min":{"1min":1.012,"5min":0.60399999999999998,"15min":0.34000000000000002},"max":{"1min":1.498,"5min":1.5720000000000001,"15min":1.8859999999999999},"last":1.651},{"interface":"front","average":{"1min":1.24,"5min":1.202,"15min":1.21},"min":{"1min":0.98499999999999999,"5min":0.52700000000000002,"15min":0.33200000000000002},"max":{"1min":1.53,"5min":1.6559999999999999,"15min":1.804},"last":1.3}]},{"osd":2,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.252,"15min":1.2769999999999999},"min":{"1min":1.0740000000000001,"5min":0.52100000000000002,"15min":0.30599999999999999},"max":{"1min":1.766,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3089999999999999,"15min":1.3220000000000001},"min":{"1min":1.1930000000000001,"5min":0.61399999999999999,"15min":0.436},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.919},"last":1.403}]},{"osd":3,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2170000000000001,"15min":1.252},"min":{"1min":0.93999999999999995,"5min":0.55200000000000005,"15min":0.45000000000000001},"max":{"1min":1.5620000000000001,"5min":1.6100000000000001,"15min":1.8100000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.2250000000000001,"15min":1.2430000000000001},"min":{"1min":1.0860000000000001,"5min":0.57499999999999996,"15min":0.40500000000000003},"max":{"1min":1.651,"5min":1.7629999999999999,"15min":1.837},"last":1.5389999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85299999999999998,"15min":0.878},"min":{"1min":0.71699999999999997,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.1699999999999999,"5min":1.5469999999999999,"15min":1.7490000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.872,"15min":0.90600000000000003},"min":{"1min":0.75600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.748},"last":1.0489999999999999}]},{"osd":5,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.71199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.607,"5min":1.6899999999999999,"15min":1.6919999999999999},"last":1.121},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.78500000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.246,"5min":1.583,"15min":1.6819999999999999},"last":1.016}]},{"osd":6,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.79000000000000004,"5min":0.224,"15min":0.224},"max":{"1min":1.27,"5min":1.74,"15min":1.74},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90900000000000003,"15min":0.96399999999999997},"min":{"1min":0.74199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.256,"5min":1.804,"15min":1.804},"last":1.359}]}]},{"osd":6,"up_from":14,"seq":60129542990,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.288,"15min":1.2569999999999999},"min":{"1min":0.88800000000000001,"5min":0.58499999999999996,"15min":0.29099999999999998},"max":{"1min":1.4690000000000001,"5min":1.6659999999999999,"15min":1.6930000000000001},"last":1.258},{"interface":"front","average":{"1min":1.363,"5min":1.333,"15min":1.3180000000000001},"min":{"1min":1.1220000000000001,"5min":0.54700000000000004,"15min":0.33400000000000002},"max":{"1min":1.7569999999999999,"5min":1.7829999999999999,"15min":1.8440000000000001},"last":1.284}]},{"osd":1,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.284,"15min":1.2749999999999999},"min":{"1min":0.95899999999999996,"5min":0.59499999999999997,"15min":0.26800000000000002},"max":{"1min":1.6399999999999999,"5min":1.829,"15min":1.9019999999999999},"last":1.409},{"interface":"front","average":{"1min":1.282,"5min":1.288,"15min":1.258},"min":{"1min":1.0129999999999999,"5min":0.45500000000000002,"15min":0.35899999999999999},"max":{"1min":1.526,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.1799999999999999}]},{"osd":2,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.82999999999999996,"5min":0.53800000000000003,"15min":0.29099999999999998},"max":{"1min":1.5980000000000001,"5min":1.714,"15min":1.96},"last":1.327},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.264,"15min":1.2410000000000001},"min":{"1min":0.94499999999999995,"5min":0.51400000000000001,"15min":0.38700000000000001},"max":{"1min":1.625,"5min":1.677,"15min":1.7350000000000001},"last":1.147}]},{"osd":3,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2769999999999999,"15min":1.252},"min":{"1min":0.86199999999999999,"5min":0.499,"15min":0.36099999999999999},"max":{"1min":1.8200000000000001,"5min":1.825,"15min":1.825},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.284,"15min":1.2649999999999999},"min":{"1min":0.94099999999999995,"5min":0.55800000000000005,"15min":0.30099999999999999},"max":{"1min":1.651,"5min":1.696,"15min":1.774},"last":1.456}]},{"osd":4,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.79400000000000004,"5min":0.24099999999999999,"15min":0.193},"max":{"1min":1.48,"5min":1.48,"15min":2.0960000000000001},"last":0.997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91400000000000003,"15min":0.92500000000000004},"min":{"1min":0.72799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.48,"5min":1.4930000000000001,"15min":1.8560000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91700000000000004,"15min":0.92700000000000005},"min":{"1min":0.81100000000000005,"5min":0.222,"15min":0.214},"max":{"1min":1.4179999999999999,"5min":1.4750000000000001,"15min":1.593},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.76600000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":1.474,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.089}]},{"osd":7,"last update":"Mon Nov 15 15:43:31 2021","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.95299999999999996,"15min":0.96799999999999997},"min":{"1min":0.76000000000000001,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":1.53,"5min":1.579,"15min":1.726},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.008,"15min":1.0149999999999999},"min":{"1min":0.89600000000000002,"5min":0.28699999999999998,"15min":0.23200000000000001},"max":{"1min":1.361,"5min":1.736,"15min":1.736},"last":1.117}]}]},{"osd":5,"up_from":14,"seq":60129542989,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050648,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321192,"statfs":{"total":96636764160,"available":95560900608,"internally_reserved":1073741824,"allocated":2113536,"data_stored":1032870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2729999999999999,"15min":1.2669999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7090000000000001,"5min":1.841,"15min":1.8899999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.492,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.4770000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.131},{"interface":"front","average":{"1min":1.181,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.538,"5min":1.7330000000000001,"15min":1.8},"last":1.403}]},{"osd":2,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.575,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.284,"15min":1.282},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.617,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.2090000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2250000000000001,"15min":1.2330000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6479999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.736,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.323}]},{"osd":4,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.95999999999999996},"min":{"1min":0.35399999999999998,"5min":0.30099999999999999,"15min":0.17799999999999999},"max":{"1min":1.448,"5min":1.821,"15min":1.821},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.98599999999999999,"15min":0.97899999999999998},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.224},"max":{"1min":1.4279999999999999,"5min":1.625,"15min":1.625},"last":1.0069999999999999}]},{"osd":6,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.193},"max":{"1min":1.1040000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.41299999999999998,"5min":0.26600000000000001,"15min":0.252},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.5920000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97799999999999998,"15min":0.96599999999999997},"min":{"1min":0.38700000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.3460000000000001,"5min":1.5580000000000001,"15min":1.746},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.32700000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.7130000000000001},"last":0.80000000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542988,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2769999999999999,"15min":1.268},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.309},"max":{"1min":1.6160000000000001,"5min":1.8500000000000001,"15min":1.869},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.292,"15min":1.2849999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.36099999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8799999999999999},"last":1.4930000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2070000000000001,"15min":1.208},"min":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.32800000000000001},"max":{"1min":1.4059999999999999,"5min":1.599,"15min":1.8740000000000001},"last":1.302},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2410000000000001,"15min":1.2430000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.28499999999999998},"max":{"1min":1.4930000000000001,"5min":1.732,"15min":1.8120000000000001},"last":1.083}]},{"osd":2,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.232,"15min":1.2250000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.40500000000000003},"max":{"1min":1.486,"5min":1.845,"15min":1.9750000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.234,"15min":1.2290000000000001},"min":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.29799999999999999},"max":{"1min":1.4670000000000001,"5min":1.714,"15min":1.7430000000000001},"last":1.2290000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2549999999999999,"15min":1.2170000000000001},"min":{"1min":0.82499999999999996,"5min":0.70899999999999996,"15min":0.39700000000000002},"max":{"1min":1.6799999999999999,"5min":1.7490000000000001,"15min":1.8069999999999999},"last":1.387},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.208},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.314},"max":{"1min":1.585,"5min":1.6579999999999999,"15min":1.6779999999999999},"last":1.165}]},{"osd":5,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.54600000000000004,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":1.2190000000000001,"5min":1.2829999999999999,"15min":1.5800000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91600000000000004,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.184,"15min":0.184},"max":{"1min":1.1459999999999999,"5min":1.6899999999999999,"15min":1.75},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.53400000000000003,"5min":0.20499999999999999,"15min":0.16},"max":{"1min":1.2589999999999999,"5min":1.399,"15min":1.6779999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94399999999999995,"15min":0.94699999999999995},"min":{"1min":0.65500000000000003,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.1970000000000001,"5min":1.589,"15min":1.6379999999999999},"last":0.875}]},{"osd":7,"last update":"Mon Nov 15 15:43:27 2021","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.61399999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.25,"5min":1.556,"15min":1.7430000000000001},"last":1.258},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.58199999999999996,"5min":0.222,"15min":0.222},"max":{"1min":1.149,"5min":1.4610000000000001,"15min":1.595},"last":0.94199999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542990,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.17599999999999999},"max":{"1min":0.91000000000000003,"5min":1.119,"15min":1.3100000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.27600000000000002,"5min":0.223,"15min":0.215},"max":{"1min":0.99199999999999999,"5min":1.0640000000000001,"15min":1.0720000000000001},"last":0.81999999999999995}]},{"osd":1,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.184},"max":{"1min":0.76500000000000001,"5min":0.99299999999999999,"15min":1.2529999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.78400000000000003},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.4139999999999999},"last":0.878}]},{"osd":2,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82599999999999996,"15min":0.84699999999999998},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.24299999999999999},"max":{"1min":1.026,"5min":1.2549999999999999,"15min":1.6240000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.89200000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.20899999999999999},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94899999999999995}]},{"osd":4,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2989999999999999,"15min":1.3220000000000001},"min":{"1min":0.80000000000000004,"5min":0.53100000000000003,"15min":0.33400000000000002},"max":{"1min":1.6060000000000001,"5min":1.782,"15min":2.1219999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.302,"15min":1.331},"min":{"1min":0.70299999999999996,"5min":0.57499999999999996,"15min":0.39800000000000002},"max":{"1min":1.7110000000000001,"5min":1.865,"15min":2.2189999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.282,"15min":1.296},"min":{"1min":0.77900000000000003,"5min":0.53700000000000003,"15min":0.42199999999999999},"max":{"1min":1.554,"5min":1.821,"15min":1.821},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.443},"max":{"1min":1.5740000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.3899999999999999}]},{"osd":6,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2869999999999999,"15min":1.3129999999999999},"min":{"1min":0.63,"5min":0.56699999999999995,"15min":0.318},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.8320000000000001},"last":1.498},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.72599999999999998,"5min":0.56399999999999995,"15min":0.32200000000000001},"max":{"1min":1.6659999999999999,"5min":1.7070000000000001,"15min":1.853},"last":1.3080000000000001}]},{"osd":7,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.333,"15min":1.3200000000000001},"min":{"1min":0.754,"5min":0.61599999999999999,"15min":0.42799999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.218},{"interface":"front","average":{"1min":1.355,"5min":1.3100000000000001,"15min":1.339},"min":{"1min":0.68200000000000005,"5min":0.52200000000000002,"15min":0.38300000000000001},"max":{"1min":1.8,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.411}]}]},{"osd":2,"up_from":14,"seq":60129542990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.254,"5min":0.25,"15min":0.22},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.2490000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.32600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.1060000000000001,"5min":1.226,"15min":1.298},"last":0.83899999999999997}]},{"osd":1,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":1.1779999999999999,"5min":1.2789999999999999,"15min":1.3919999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.26200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":1.2729999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.749}]},{"osd":3,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.093,"15min":1.093},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.22800000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0149999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3180000000000001,"15min":1.3340000000000001},"min":{"1min":0.66100000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7210000000000001,"5min":1.726,"15min":1.778},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.65100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.667,"5min":1.7030000000000001,"15min":1.913},"last":1.446}]},{"osd":5,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.331,"15min":1.357},"min":{"1min":0.72199999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5800000000000001,"5min":1.806,"15min":1.984},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3169999999999999,"15min":1.351},"min":{"1min":0.63200000000000001,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.843},"last":1.294}]},{"osd":6,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.361,"15min":1.3600000000000001},"min":{"1min":0.70199999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6859999999999999,"5min":1.79,"15min":2.0590000000000002},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3640000000000001,"15min":1.3700000000000001},"min":{"1min":0.70899999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.9790000000000001},"last":1.3320000000000001}]},{"osd":7,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.353,"15min":1.3660000000000001},"min":{"1min":0.67500000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.623,"5min":1.8899999999999999,"15min":1.9710000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.333,"15min":1.3580000000000001},"min":{"1min":0.68200000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.8700000000000001},"last":1.4179999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.26100000000000001,"5min":0.23499999999999999,"15min":0.21099999999999999},"max":{"1min":0.996,"5min":1.036,"15min":1.139},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.1930000000000001,"15min":1.6359999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.77200000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":1.163,"15min":1.163},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.90900000000000003},"min":{"1min":0.28199999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.413},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20100000000000001},"max":{"1min":1.0609999999999999,"5min":1.163,"15min":1.389},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.247,"5min":0.20699999999999999,"15min":0.19700000000000001},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1619999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.3129999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.889,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.306,"5min":1.327,"15min":1.3200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.732,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.331,"15min":1.3129999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":1.762,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3180000000000001,"15min":1.325},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.42099999999999999},"max":{"1min":1.8120000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.874}]},{"osd":6,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.323,"15min":1.3400000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7689999999999999,"5min":1.857,"15min":1.857},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3200000000000001,"15min":1.3260000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.7829999999999999,"5min":1.8700000000000001,"15min":1.893},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7390000000000001,"5min":1.792,"15min":1.792},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.748,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.84199999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.60799999999999998,"5min":0.254,"15min":0.17599999999999999},"max":{"1min":0.97299999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74299999999999999,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.20100000000000001,"15min":0.192},"max":{"1min":1.0189999999999999,"5min":1.0860000000000001,"15min":1.3140000000000001},"last":0.85599999999999998}]},{"osd":2,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.252,"15min":0.20200000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.26800000000000002,"15min":0.216},"max":{"1min":1.0780000000000001,"5min":1.135,"15min":1.1910000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77300000000000002,"15min":0.76500000000000001},"min":{"1min":0.58199999999999996,"5min":0.26200000000000001,"15min":0.23000000000000001},"max":{"1min":1.048,"5min":1.0960000000000001,"15min":1.115},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.64700000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1359999999999999,"5min":1.2889999999999999,"15min":1.3560000000000001},"last":0.745}]},{"osd":4,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.343,"15min":1.357},"min":{"1min":0.997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7310000000000001,"5min":1.829,"15min":2.0070000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.3600000000000001,"15min":1.3759999999999999},"min":{"1min":0.97699999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.421}]},{"osd":5,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.3360000000000001,"15min":1.3680000000000001},"min":{"1min":1.042,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8169999999999999},"last":1.694},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.3160000000000001,"15min":1.3360000000000001},"min":{"1min":1.0660000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.8720000000000001},"last":1.278}]},{"osd":6,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3260000000000001,"15min":1.345},"min":{"1min":1.0549999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.371},{"interface":"front","average":{"1min":1.484,"5min":1.351,"15min":1.3720000000000001},"min":{"1min":1.1120000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.802,"5min":1.802,"15min":1.9259999999999999},"last":1.645}]},{"osd":7,"last update":"Mon Nov 15 15:43:25 2021","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.353,"15min":1.371},"min":{"1min":1.0489999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6930000000000001,"5min":1.746,"15min":1.923},"last":1.494},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.3380000000000001,"15min":1.3640000000000001},"min":{"1min":0.95399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.7050000000000001,"5min":1.7330000000000001,"15min":1.867},"last":1.571}]}]}]}} 2021-11-15T15:44:36.913 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-15T15:44:36.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 Processor -- start 2021-11-15T15:44:36.965 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- start start 2021-11-15T15:44:36.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f05a40b1e30 0x7f05a40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05a4148420 0x7f05a40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.966 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a40b03d0 con 0x7f05a40a7140 2021-11-15T15:44:36.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40a9140 con 0x7f05a40b1e30 2021-11-15T15:44:36.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40b0670 con 0x7f05a4148420 2021-11-15T15:44:36.967 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f05a4148420 0x7f05a40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05aad14700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f05a40a7140 0x7f05a41447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52854/0 (socket says 172.21.2.135:52854) 2021-11-15T15:44:36.968 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05aad14700 1 -- 172.21.2.135:0/3321464010 learned_addr learned my addr 172.21.2.135:0/3321464010 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:36.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 -- 172.21.2.135:0/3321464010 >> v2:172.21.2.119:3300/0 conn(0x7f05a40b1e30 msgr2=0x7f05a40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:36.972 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 --2- 172.21.2.135:0/3321464010 >> v2:172.21.2.119:3300/0 conn(0x7f05a40b1e30 0x7f05a40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:36.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 -- 172.21.2.135:0/3321464010 >> v1:172.21.2.135:6789/0 conn(0x7f05a40a7140 legacy=0x7f05a41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.973 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 -- 172.21.2.135:0/3321464010 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40b0910 con 0x7f05a4148420 2021-11-15T15:44:36.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9d12700 1 --2- 172.21.2.135:0/3321464010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a4148420 0x7f05a40b2210 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f05a41477b0 tx=0x7f05a0006df0).ready entity=mon.1 client_cookie=3a5afb71ecf8c41c server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9511700 1 -- 172.21.2.135:0/3321464010 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a000d5c0 con 0x7f05a4148420 2021-11-15T15:44:36.974 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9511700 1 -- 172.21.2.135:0/3321464010 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0000e90 con 0x7f05a4148420 2021-11-15T15:44:36.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05a9511700 1 -- 172.21.2.135:0/3321464010 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a000d910 con 0x7f05a4148420 2021-11-15T15:44:36.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- 172.21.2.135:0/3321464010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a4148420 msgr2=0x7f05a40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.975 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 --2- 172.21.2.135:0/3321464010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a4148420 0x7f05a40b2210 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f05a41477b0 tx=0x7f05a0006df0).stop 2021-11-15T15:44:36.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- 172.21.2.135:0/3321464010 shutdown_connections 2021-11-15T15:44:36.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 --2- 172.21.2.135:0/3321464010 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a4148420 0x7f05a40b2210 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.976 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 --2- 172.21.2.135:0/3321464010 >> v2:172.21.2.119:3300/0 conn(0x7f05a40b1e30 0x7f05a40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:36.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- 172.21.2.135:0/3321464010 >> 172.21.2.135:0/3321464010 conn(0x7f05a405f730 msgr2=0x7f05a405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:36.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- 172.21.2.135:0/3321464010 shutdown_connections 2021-11-15T15:44:36.977 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.961+0000 7f05ac777700 1 -- 172.21.2.135:0/3321464010 wait complete. 2021-11-15T15:44:36.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 Processor -- start 2021-11-15T15:44:36.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- start start 2021-11-15T15:44:36.978 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05a40b1e30 0x7f05a40ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05a4148420 0x7f05a40abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.979 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40acb50 con 0x7f05a4148420 2021-11-15T15:44:36.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40a94c0 con 0x7f05a40a7140 2021-11-15T15:44:36.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40a96f0 con 0x7f05a40b1e30 2021-11-15T15:44:36.980 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37036/0 (socket says 172.21.2.135:37036) 2021-11-15T15:44:36.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 -- 172.21.2.135:0/2509208153 learned_addr learned my addr 172.21.2.135:0/2509208153 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:36.981 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05a9d12700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05a40b1e30 0x7f05a40ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aad14700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05a4148420 0x7f05a40abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 -- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05a40b1e30 msgr2=0x7f05a40ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.982 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05a40b1e30 0x7f05a40ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 -- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05a4148420 msgr2=0x7f05a40abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:36.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05a4148420 0x7f05a40abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:36.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 -- 172.21.2.135:0/2509208153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a000b180 con 0x7f05a40a7140 2021-11-15T15:44:36.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05aa513700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f05a40ab200 tx=0x7f0598006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0598013460 con 0x7f05a40a7140 2021-11-15T15:44:36.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980135c0 con 0x7f05a40a7140 2021-11-15T15:44:36.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0598013920 con 0x7f05a40a7140 2021-11-15T15:44:36.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40a9990 con 0x7f05a40a7140 2021-11-15T15:44:36.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a40a9ed0 con 0x7f05a40a7140 2021-11-15T15:44:36.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40ab340 con 0x7f05a40a7140 2021-11-15T15:44:36.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f059800f070 con 0x7f05a40a7140 2021-11-15T15:44:36.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 0x7f0584055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:36.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f059806b130 con 0x7f05a40a7140 2021-11-15T15:44:36.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05a9d12700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 0x7f0584055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:36.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.965+0000 7f05a9d12700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 0x7f0584055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f05a0018000 tx=0x7f05a0012000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:36.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:36.969+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05a40ab340 con 0x7f05a40a7140 2021-11-15T15:44:37.053 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05a40ab340 con 0x7f05a40a7140 2021-11-15T15:44:37.054 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05977fe700 1 -- 172.21.2.135:0/2509208153 <== mon.1 v2:172.21.2.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+13551 (secure 0 0 0) 0x7f05a40ab340 con 0x7f05a40a7140 2021-11-15T15:44:37.055 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T15:44:37.055 INFO:teuthology.orchestra.run.gibba035.stdout:{"epoch":167,"fsid":"aa03efb2-9530-4b02-8a4e-1fb04db0e3e8","created":"2021-11-15T14:34:12.786393+0000","modified":"2021-11-15T14:44:05.891515+0000","last_up_change":"2021-11-15T14:34:19.080252+0000","last_in_change":"2021-11-15T14:34:19.080252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-15T14:34:15.066105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-15T14:34:22.802865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8ff250b9-d13b-4150-b168-54ab0adafaf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6816","nonce":14883},{"type":"v1","addr":"172.21.2.135:6817","nonce":14883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6818","nonce":14883},{"type":"v1","addr":"172.21.2.135:6819","nonce":14883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6822","nonce":14883},{"type":"v1","addr":"172.21.2.135:6823","nonce":14883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6820","nonce":14883},{"type":"v1","addr":"172.21.2.135:6821","nonce":14883}]},"public_addr":"172.21.2.135:6817/14883","cluster_addr":"172.21.2.135:6819/14883","heartbeat_back_addr":"172.21.2.135:6823/14883","heartbeat_front_addr":"172.21.2.135:6821/14883","state":["exists","up"]},{"osd":1,"uuid":"ef743c61-c920-4fca-94c1-ac8a1976d803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6824","nonce":14884},{"type":"v1","addr":"172.21.2.135:6825","nonce":14884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6826","nonce":14884},{"type":"v1","addr":"172.21.2.135:6827","nonce":14884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6830","nonce":14884},{"type":"v1","addr":"172.21.2.135:6831","nonce":14884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6828","nonce":14884},{"type":"v1","addr":"172.21.2.135:6829","nonce":14884}]},"public_addr":"172.21.2.135:6825/14884","cluster_addr":"172.21.2.135:6827/14884","heartbeat_back_addr":"172.21.2.135:6831/14884","heartbeat_front_addr":"172.21.2.135:6829/14884","state":["exists","up"]},{"osd":2,"uuid":"4eaec713-c5fe-4f55-a29d-a8e67bb0a6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6800","nonce":14885},{"type":"v1","addr":"172.21.2.135:6801","nonce":14885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6802","nonce":14885},{"type":"v1","addr":"172.21.2.135:6803","nonce":14885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6806","nonce":14885},{"type":"v1","addr":"172.21.2.135:6807","nonce":14885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6804","nonce":14885},{"type":"v1","addr":"172.21.2.135:6805","nonce":14885}]},"public_addr":"172.21.2.135:6801/14885","cluster_addr":"172.21.2.135:6803/14885","heartbeat_back_addr":"172.21.2.135:6807/14885","heartbeat_front_addr":"172.21.2.135:6805/14885","state":["exists","up"]},{"osd":3,"uuid":"d21a02d0-717e-4155-acfd-c9fcc0a575c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6808","nonce":14886},{"type":"v1","addr":"172.21.2.135:6809","nonce":14886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6810","nonce":14886},{"type":"v1","addr":"172.21.2.135:6811","nonce":14886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6814","nonce":14886},{"type":"v1","addr":"172.21.2.135:6815","nonce":14886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.135:6812","nonce":14886},{"type":"v1","addr":"172.21.2.135:6813","nonce":14886}]},"public_addr":"172.21.2.135:6809/14886","cluster_addr":"172.21.2.135:6811/14886","heartbeat_back_addr":"172.21.2.135:6815/14886","heartbeat_front_addr":"172.21.2.135:6813/14886","state":["exists","up"]},{"osd":4,"uuid":"d92b907a-4fe9-46a1-bee8-e17e6ff11b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":15090},{"type":"v1","addr":"172.21.2.119:6811","nonce":15090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":15090},{"type":"v1","addr":"172.21.2.119:6813","nonce":15090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":15090},{"type":"v1","addr":"172.21.2.119:6818","nonce":15090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":15090},{"type":"v1","addr":"172.21.2.119:6815","nonce":15090}]},"public_addr":"172.21.2.119:6811/15090","cluster_addr":"172.21.2.119:6813/15090","heartbeat_back_addr":"172.21.2.119:6818/15090","heartbeat_front_addr":"172.21.2.119:6815/15090","state":["exists","up"]},{"osd":5,"uuid":"1ff30a62-5ccd-4e1a-9a17-ceb30614052f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6817","nonce":15091},{"type":"v1","addr":"172.21.2.119:6820","nonce":15091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":15091},{"type":"v1","addr":"172.21.2.119:6824","nonce":15091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6829","nonce":15091},{"type":"v1","addr":"172.21.2.119:6831","nonce":15091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6826","nonce":15091},{"type":"v1","addr":"172.21.2.119:6828","nonce":15091}]},"public_addr":"172.21.2.119:6820/15091","cluster_addr":"172.21.2.119:6824/15091","heartbeat_back_addr":"172.21.2.119:6831/15091","heartbeat_front_addr":"172.21.2.119:6828/15091","state":["exists","up"]},{"osd":6,"uuid":"df4f93ba-dab5-4e88-a5fc-ff1ea5ad3c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":15092},{"type":"v1","addr":"172.21.2.119:6803","nonce":15092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":15092},{"type":"v1","addr":"172.21.2.119:6805","nonce":15092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":15092},{"type":"v1","addr":"172.21.2.119:6809","nonce":15092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":15092},{"type":"v1","addr":"172.21.2.119:6807","nonce":15092}]},"public_addr":"172.21.2.119:6803/15092","cluster_addr":"172.21.2.119:6805/15092","heartbeat_back_addr":"172.21.2.119:6809/15092","heartbeat_front_addr":"172.21.2.119:6807/15092","state":["exists","up"]},{"osd":7,"uuid":"d052682a-32ba-4d00-91cd-285e266cf789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6819","nonce":15101},{"type":"v1","addr":"172.21.2.119:6821","nonce":15101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6823","nonce":15101},{"type":"v1","addr":"172.21.2.119:6825","nonce":15101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6832","nonce":15101},{"type":"v1","addr":"172.21.2.119:6833","nonce":15101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6827","nonce":15101},{"type":"v1","addr":"172.21.2.119:6830","nonce":15101}]},"public_addr":"172.21.2.119:6821/15101","cluster_addr":"172.21.2.119:6825/15101","heartbeat_back_addr":"172.21.2.119:6833/15101","heartbeat_front_addr":"172.21.2.119:6830/15101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.542333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.590151+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.330854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.271792+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.605032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.530191+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.386596+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-15T14:34:17.655449+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.135:6835/945123846":"2021-11-16T14:44:02.157879+0000","172.21.2.135:6833/945123846":"2021-11-16T14:44:02.157879+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-15T15:44:37.056 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 msgr2=0x7f0584055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 0x7f0584055ad0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f05a0018000 tx=0x7f05a0012000).stop 2021-11-15T15:44:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 msgr2=0x7f05a4149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:37.057 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.049+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f05a40ab200 tx=0x7f0598006ec0).stop 2021-11-15T15:44:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 shutdown_connections 2021-11-15T15:44:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0584053610 0x7f0584055ad0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:37.058 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f05a4148420 0x7f05a40abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f05a40b1e30 0x7f05a40ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 --2- 172.21.2.135:0/2509208153 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f05a40a7140 0x7f05a4149e50 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:37.059 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 >> 172.21.2.135:0/2509208153 conn(0x7f05a405f730 msgr2=0x7f05a40b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 shutdown_connections 2021-11-15T15:44:37.060 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:37.053+0000 7f05ac777700 1 -- 172.21.2.135:0/2509208153 wait complete. 2021-11-15T15:44:38.063 INFO:tasks.ceph:Scrubbing osd.0 2021-11-15T15:44:38.064 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:38.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 Processor -- start 2021-11-15T15:44:38.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 -- start start 2021-11-15T15:44:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f8e0c0b1e30 0x7f8e0c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8e0c148420 0x7f8e0c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0b03d0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0a9140 con 0x7f8e0c0b1e30 2021-11-15T15:44:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e13093700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b0670 con 0x7f8e0c148420 2021-11-15T15:44:38.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e0bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8e0c148420 0x7f8e0c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e0bfff700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f8e0c148420 0x7f8e0c0b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37046/0 (socket says 172.21.2.135:37046) 2021-11-15T15:44:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.133+0000 7f8e0bfff700 1 -- 172.21.2.135:0/201241919 learned_addr learned my addr 172.21.2.135:0/201241919 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0bfff700 1 -- 172.21.2.135:0/201241919 >> v2:172.21.2.119:3300/0 conn(0x7f8e0c0b1e30 msgr2=0x7f8e0c0b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0bfff700 1 --2- 172.21.2.135:0/201241919 >> v2:172.21.2.119:3300/0 conn(0x7f8e0c0b1e30 0x7f8e0c0b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0bfff700 1 -- 172.21.2.135:0/201241919 >> v1:172.21.2.119:6789/0 conn(0x7f8e0c0a7140 legacy=0x7f8e0c1447a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0bfff700 1 -- 172.21.2.135:0/201241919 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0b0910 con 0x7f8e0c148420 2021-11-15T15:44:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0bfff700 1 --2- 172.21.2.135:0/201241919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c148420 0x7f8e0c0b2210 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f8e0c0acee0 tx=0x7f8df4006eb0).ready entity=mon.1 client_cookie=e17c6df4da3f9f9a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0b7fe700 1 -- 172.21.2.135:0/201241919 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df400d5c0 con 0x7f8e0c148420 2021-11-15T15:44:38.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0b7fe700 1 -- 172.21.2.135:0/201241919 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4000e90 con 0x7f8e0c148420 2021-11-15T15:44:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e0b7fe700 1 -- 172.21.2.135:0/201241919 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df400d950 con 0x7f8e0c148420 2021-11-15T15:44:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/201241919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c148420 msgr2=0x7f8e0c0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- 172.21.2.135:0/201241919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c148420 0x7f8e0c0b2210 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f8e0c0acee0 tx=0x7f8df4006eb0).stop 2021-11-15T15:44:38.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/201241919 shutdown_connections 2021-11-15T15:44:38.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- 172.21.2.135:0/201241919 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c148420 0x7f8e0c0b2210 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- 172.21.2.135:0/201241919 >> v2:172.21.2.119:3300/0 conn(0x7f8e0c0b1e30 0x7f8e0c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/201241919 >> 172.21.2.135:0/201241919 conn(0x7f8e0c05f730 msgr2=0x7f8e0c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/201241919 shutdown_connections 2021-11-15T15:44:38.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/201241919 wait complete. 2021-11-15T15:44:38.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 Processor -- start 2021-11-15T15:44:38.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- start start 2021-11-15T15:44:38.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 0x7f8e0c144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e0c0b1e30 0x7f8e0c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0c148420 0x7f8e0c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c064010 con 0x7f8e0c148420 2021-11-15T15:44:38.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0aa3d0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0aae00 con 0x7f8e0c0b1e30 2021-11-15T15:44:38.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 0x7f8e0c144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 0x7f8e0c144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37050/0 (socket says 172.21.2.135:37050) 2021-11-15T15:44:38.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 -- 172.21.2.135:0/2769258460 learned_addr learned my addr 172.21.2.135:0/2769258460 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 -- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e0c0b1e30 msgr2=0x7f8e0c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f8e0c0b1e30 0x7f8e0c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 -- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0c148420 msgr2=0x7f8e0c15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f8e0c148420 0x7f8e0c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df400b1e0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e10e2f700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 0x7f8e0c144c80 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f8dfc002fb0 tx=0x7f8dfc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dfc013460 con 0x7f8e0c0a7140 2021-11-15T15:44:38.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0135c0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c0ab0a0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dfc013920 con 0x7f8e0c0a7140 2021-11-15T15:44:38.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.137+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c0aa0c0 con 0x7f8e0c0a7140 2021-11-15T15:44:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e0c0a9e60 con 0x7f8e0c0a7140 2021-11-15T15:44:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8dfc00f070 con 0x7f8e0c0a7140 2021-11-15T15:44:38.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8df0053720 0x7f8df0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8dfc06b340 con 0x7f8e0c0a7140 2021-11-15T15:44:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7f8df005a530 0x7f8df005c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8df005cf10 con 0x7f8df005a530 2021-11-15T15:44:38.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dfc042510 con 0x7f8e0c0a7140 2021-11-15T15:44:38.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e11630700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7f8df005a530 0x7f8df005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e0bfff700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8df0053720 0x7f8df0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e11630700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7f8df005a530 0x7f8df005c950 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== osd.0 v2:172.21.2.135:6816/14883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f8df005cf10 con 0x7f8df005a530 2021-11-15T15:44:38.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.141+0000 7f8e0bfff700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8df0053720 0x7f8df0055be0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f8e0c0acee0 tx=0x7f8df4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 --> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8e0c0b0bb0 con 0x7f8df005a530 2021-11-15T15:44:38.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e09ffb700 1 -- 172.21.2.135:0/2769258460 <== osd.0 v2:172.21.2.135:6816/14883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8e0c0b0bb0 con 0x7f8df005a530 2021-11-15T15:44:38.164 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:38.165 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:38.165 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:38.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7f8df005a530 msgr2=0x7f8df005c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:6816/14883,v1:172.21.2.135:6817/14883] conn(0x7f8df005a530 0x7f8df005c950 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8df0053720 msgr2=0x7f8df0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f8df0053720 0x7f8df0055be0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f8e0c0acee0 tx=0x7f8df4015000).stop 2021-11-15T15:44:38.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 msgr2=0x7f8e0c144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 --2- 172.21.2.135:0/2769258460 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f8e0c0a7140 0x7f8e0c144c80 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f8dfc002fb0 tx=0x7f8dfc006df0).stop 2021-11-15T15:44:38.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e11630700 1 -- 172.21.2.135:0/2769258460 reap_dead start 2021-11-15T15:44:38.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 shutdown_connections 2021-11-15T15:44:38.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 >> 172.21.2.135:0/2769258460 conn(0x7f8e0c05f730 msgr2=0x7f8e0c143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 shutdown_connections 2021-11-15T15:44:38.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.149+0000 7f8e13093700 1 -- 172.21.2.135:0/2769258460 wait complete. 2021-11-15T15:44:38.170 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-11-15T15:44:38.220 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 Processor -- start 2021-11-15T15:44:38.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 -- start start 2021-11-15T15:44:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 0x7f95980b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.225 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980b03d0 con 0x7f95980a7140 2021-11-15T15:44:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980b0670 con 0x7f9598148420 2021-11-15T15:44:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959c9f7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95980a9140 con 0x7f95980b1e30 2021-11-15T15:44:38.226 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9595d9b700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f9598148420 0x7f95980b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52882/0 (socket says 172.21.2.135:52882) 2021-11-15T15:44:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9595d9b700 1 -- 172.21.2.135:0/1669292671 learned_addr learned my addr 172.21.2.135:0/1669292671 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817718156 0 0) 0x7f95980b0670 con 0x7f9598148420 2021-11-15T15:44:38.227 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f957c003260 con 0x7f9598148420 2021-11-15T15:44:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959659c700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 0x7f95980b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535994714 0 0) 0x7f957c003260 con 0x7f9598148420 2021-11-15T15:44:38.228 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 msgr2=0x7f95980b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 0x7f95980b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 >> v1:172.21.2.119:6789/0 conn(0x7f95980a7140 legacy=0x7f95981447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.229 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95980b0910 con 0x7f9598148420 2021-11-15T15:44:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f958c001660 con 0x7f9598148420 2021-11-15T15:44:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 >> v1:172.21.2.135:6789/0 conn(0x7f9598148420 legacy=0x7f95980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c0037d0 0x7f957c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 0x7f957c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f957c004b40 0x7f957c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.231 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c00b980 con 0x7f957c0037d0 2021-11-15T15:44:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c00baf0 con 0x7f957c004b40 2021-11-15T15:44:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c00bcb0 con 0x7f95980b1e30 2021-11-15T15:44:38.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f957c004b40 0x7f957c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 -- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 msgr2=0x7f957c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f95980b1e30 0x7f957c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 -- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c0037d0 msgr2=0x7f957c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c0037d0 0x7f957c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 -- 172.21.2.135:0/1669292671 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c003260 con 0x7f957c004b40 2021-11-15T15:44:38.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f9596d9d700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f957c004b40 0x7f957c004fc0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f9590002320 tx=0x7f9590007d80).ready entity=mon.1 client_cookie=f1d5448489b965ff server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9590002510 con 0x7f957c004b40 2021-11-15T15:44:38.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590006890 con 0x7f957c004b40 2021-11-15T15:44:38.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.217+0000 7f959559a700 1 -- 172.21.2.135:0/1669292671 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9590006bf0 con 0x7f957c004b40 2021-11-15T15:44:38.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/1669292671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f957c004b40 msgr2=0x7f957c004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 --2- 172.21.2.135:0/1669292671 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f957c004b40 0x7f957c004fc0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f9590002320 tx=0x7f9590007d80).stop 2021-11-15T15:44:38.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9596d9d700 1 -- 172.21.2.135:0/1669292671 reap_dead start 2021-11-15T15:44:38.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/1669292671 shutdown_connections 2021-11-15T15:44:38.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/1669292671 >> 172.21.2.135:0/1669292671 conn(0x7f959805f730 msgr2=0x7f959805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.237 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/1669292671 shutdown_connections 2021-11-15T15:44:38.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/1669292671 wait complete. 2021-11-15T15:44:38.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 Processor -- start 2021-11-15T15:44:38.238 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- start start 2021-11-15T15:44:38.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c004b40 0x7f95981570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.239 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9598066ee0 0x7f9598067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980aa660 con 0x7f957c004b40 2021-11-15T15:44:38.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598062f80 con 0x7f95980abc80 2021-11-15T15:44:38.240 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95980631b0 con 0x7f9598066ee0 2021-11-15T15:44:38.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37074/0 (socket says 172.21.2.135:37074) 2021-11-15T15:44:38.241 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 -- 172.21.2.135:0/2570761383 learned_addr learned my addr 172.21.2.135:0/2570761383 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 -- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9598066ee0 msgr2=0x7f9598067360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9598066ee0 0x7f9598067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.242 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 -- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c004b40 msgr2=0x7f95981570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c004b40 0x7f95981570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 -- 172.21.2.135:0/2570761383 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598063450 con 0x7f95980abc80 2021-11-15T15:44:38.243 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f9595d9b700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f9598063a70 tx=0x7f95980b0800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f958c007170 con 0x7f95980abc80 2021-11-15T15:44:38.245 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0072d0 con 0x7f95980abc80 2021-11-15T15:44:38.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f958c004920 con 0x7f95980abc80 2021-11-15T15:44:38.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95980636f0 con 0x7f95980abc80 2021-11-15T15:44:38.246 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598067850 con 0x7f95980abc80 2021-11-15T15:44:38.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598063880 con 0x7f95980abc80 2021-11-15T15:44:38.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f958c01b070 con 0x7f95980abc80 2021-11-15T15:44:38.247 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.221+0000 7f95877fe700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 0x7f9574055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.225+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f958c06b170 con 0x7f95980abc80 2021-11-15T15:44:38.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.225+0000 7f959659c700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 0x7f9574055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.248 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.225+0000 7f959659c700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 0x7f9574055bb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9588007000 tx=0x7f9588008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.249 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.225+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f958c042340 con 0x7f95980abc80 2021-11-15T15:44:38.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.309+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f95980573d0 con 0x7f95740536f0 2021-11-15T15:44:38.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.309+0000 7f95877fe700 1 -- 172.21.2.135:0/2570761383 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f95980573d0 con 0x7f95740536f0 2021-11-15T15:44:38.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 msgr2=0x7f9574055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 0x7f9574055bb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f9588007000 tx=0x7f9588008040).stop 2021-11-15T15:44:38.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 msgr2=0x7f95980a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f9598063a70 tx=0x7f95980b0800).stop 2021-11-15T15:44:38.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 shutdown_connections 2021-11-15T15:44:38.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f95740536f0 0x7f9574055bb0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f9598066ee0 0x7f9598067360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f95980abc80 0x7f95980a9860 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 --2- 172.21.2.135:0/2570761383 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f957c004b40 0x7f95981570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 >> 172.21.2.135:0/2570761383 conn(0x7f959805f730 msgr2=0x7f95980b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 shutdown_connections 2021-11-15T15:44:38.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.313+0000 7f959c9f7700 1 -- 172.21.2.135:0/2570761383 wait complete. 2021-11-15T15:44:38.320 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 0 to deep-scrub 2021-11-15T15:44:38.322 INFO:tasks.ceph:Scrubbing osd.1 2021-11-15T15:44:38.323 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:38.376 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 Processor -- start 2021-11-15T15:44:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- start start 2021-11-15T15:44:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fc68c148420 0x7fc68c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.377 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc68c0a7140 0x7fc68c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0b03d0 con 0x7fc68c0b1e30 2021-11-15T15:44:38.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c0a9140 con 0x7fc68c148420 2021-11-15T15:44:38.378 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c0b0670 con 0x7fc68c0a7140 2021-11-15T15:44:38.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fc68c0a7140 0x7fc68c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68ad9d700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fc68c0b1e30 0x7fc68c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52900/0 (socket says 172.21.2.135:52900) 2021-11-15T15:44:38.379 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68ad9d700 1 -- 172.21.2.135:0/2093937387 learned_addr learned my addr 172.21.2.135:0/2093937387 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.383 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 -- 172.21.2.135:0/2093937387 >> v2:172.21.2.119:3300/0 conn(0x7fc68c148420 msgr2=0x7fc68c0b1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 --2- 172.21.2.135:0/2093937387 >> v2:172.21.2.119:3300/0 conn(0x7fc68c148420 0x7fc68c0b1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 -- 172.21.2.135:0/2093937387 >> v1:172.21.2.135:6789/0 conn(0x7fc68c0b1e30 legacy=0x7fc68c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.384 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 -- 172.21.2.135:0/2093937387 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0b0910 con 0x7fc68c0a7140 2021-11-15T15:44:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc68b59e700 1 --2- 172.21.2.135:0/2093937387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0a7140 0x7fc68c1447a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fc68c1477b0 tx=0x7fc6840091d0).ready entity=mon.1 client_cookie=b6d5791c16b11ee server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc689d9b700 1 -- 172.21.2.135:0/2093937387 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc684009ea0 con 0x7fc68c0a7140 2021-11-15T15:44:38.385 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc689d9b700 1 -- 172.21.2.135:0/2093937387 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68400b860 con 0x7fc68c0a7140 2021-11-15T15:44:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc689d9b700 1 -- 172.21.2.135:0/2093937387 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68400ba10 con 0x7fc68c0a7140 2021-11-15T15:44:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- 172.21.2.135:0/2093937387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0a7140 msgr2=0x7fc68c1447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.386 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 --2- 172.21.2.135:0/2093937387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0a7140 0x7fc68c1447a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fc68c1477b0 tx=0x7fc6840091d0).stop 2021-11-15T15:44:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- 172.21.2.135:0/2093937387 shutdown_connections 2021-11-15T15:44:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 --2- 172.21.2.135:0/2093937387 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0a7140 0x7fc68c1447a0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.387 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 --2- 172.21.2.135:0/2093937387 >> v2:172.21.2.119:3300/0 conn(0x7fc68c148420 0x7fc68c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- 172.21.2.135:0/2093937387 >> 172.21.2.135:0/2093937387 conn(0x7fc68c05f730 msgr2=0x7fc68c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- 172.21.2.135:0/2093937387 shutdown_connections 2021-11-15T15:44:38.388 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- 172.21.2.135:0/2093937387 wait complete. 2021-11-15T15:44:38.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 Processor -- start 2021-11-15T15:44:38.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.373+0000 7fc691159700 1 -- start start 2021-11-15T15:44:38.389 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc68c0a7140 0x7fc68c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 0x7fc68c0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc68c148420 0x7fc68c062d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.390 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0ab330 con 0x7fc68c148420 2021-11-15T15:44:38.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0ab5d0 con 0x7fc68c0b1e30 2021-11-15T15:44:38.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0ab870 con 0x7fc68c0a7140 2021-11-15T15:44:38.391 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 0x7fc68c0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 0x7fc68c0abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37090/0 (socket says 172.21.2.135:37090) 2021-11-15T15:44:38.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 -- 172.21.2.135:0/3588710887 learned_addr learned my addr 172.21.2.135:0/3588710887 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.392 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 -- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc68c0a7140 msgr2=0x7fc68c0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fc68c0a7140 0x7fc68c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 -- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc68c148420 msgr2=0x7fc68c062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fc68c148420 0x7fc68c062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009470 con 0x7fc68c0b1e30 2021-11-15T15:44:38.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68a59c700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 0x7fc68c0abee0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fc674002ef0 tx=0x7fc674006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.394 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674009e00 con 0x7fc68c0b1e30 2021-11-15T15:44:38.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc674002320 con 0x7fc68c0b1e30 2021-11-15T15:44:38.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0628d0 con 0x7fc68c0b1e30 2021-11-15T15:44:38.395 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc674002680 con 0x7fc68c0b1e30 2021-11-15T15:44:38.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c15a580 con 0x7fc68c0b1e30 2021-11-15T15:44:38.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc68c0ac570 con 0x7fc68c0b1e30 2021-11-15T15:44:38.396 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc67400f030 con 0x7fc68c0b1e30 2021-11-15T15:44:38.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc670053610 0x7fc670055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc67406b4d0 con 0x7fc68c0b1e30 2021-11-15T15:44:38.397 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc67005a3a0 0x7fc67005c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc67005cd80 con 0x7fc67005a3a0 2021-11-15T15:44:38.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc67406db60 con 0x7fc68c0b1e30 2021-11-15T15:44:38.398 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68b59e700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc67005a3a0 0x7fc67005c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68b59e700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc67005a3a0 0x7fc67005c7c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc68ad9d700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc670053610 0x7fc670055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.399 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.377+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== osd.1 v2:172.21.2.135:6824/14884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc67005cd80 con 0x7fc67005a3a0 2021-11-15T15:44:38.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.381+0000 7fc68ad9d700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc670053610 0x7fc670055ad0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc68c0acee0 tx=0x7fc67c0077d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.400 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.385+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 --> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc68c0636a0 con 0x7fc67005a3a0 2021-11-15T15:44:38.401 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.385+0000 7fc683fff700 1 -- 172.21.2.135:0/3588710887 <== osd.1 v2:172.21.2.135:6824/14884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc68c0636a0 con 0x7fc67005a3a0 2021-11-15T15:44:38.401 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:38.402 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:38.402 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:38.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc67005a3a0 msgr2=0x7fc67005c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.404 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:6824/14884,v1:172.21.2.135:6825/14884] conn(0x7fc67005a3a0 0x7fc67005c7c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc670053610 msgr2=0x7fc670055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fc670053610 0x7fc670055ad0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc68c0acee0 tx=0x7fc67c0077d0).stop 2021-11-15T15:44:38.405 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 msgr2=0x7fc68c0abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 --2- 172.21.2.135:0/3588710887 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fc68c0b1e30 0x7fc68c0abee0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fc674002ef0 tx=0x7fc674006d40).stop 2021-11-15T15:44:38.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc68b59e700 1 -- 172.21.2.135:0/3588710887 reap_dead start 2021-11-15T15:44:38.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 shutdown_connections 2021-11-15T15:44:38.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 >> 172.21.2.135:0/3588710887 conn(0x7fc68c05f730 msgr2=0x7fc68c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 shutdown_connections 2021-11-15T15:44:38.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.389+0000 7fc691159700 1 -- 172.21.2.135:0/3588710887 wait complete. 2021-11-15T15:44:38.408 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-11-15T15:44:38.463 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 Processor -- start 2021-11-15T15:44:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 -- start start 2021-11-15T15:44:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f7dbc060180 0x7f7dbc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.464 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0aac30 con 0x7f7dbc060180 2021-11-15T15:44:38.465 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc060560 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc3fa0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc066f20 con 0x7f7dbc067380 2021-11-15T15:44:38.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.466 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37100/0 (socket says 172.21.2.135:37100) 2021-11-15T15:44:38.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 -- 172.21.2.135:0/53480127 learned_addr learned my addr 172.21.2.135:0/53480127 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 -- 172.21.2.135:0/53480127 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 msgr2=0x7f7dbc143970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.467 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 --2- 172.21.2.135:0/53480127 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc143970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 -- 172.21.2.135:0/53480127 >> v2:172.21.2.119:3300/0 conn(0x7f7dbc060180 msgr2=0x7f7dbc0b47d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 --2- 172.21.2.135:0/53480127 >> v2:172.21.2.119:3300/0 conn(0x7f7dbc060180 0x7f7dbc0b47d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.468 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.457+0000 7f7dc253d700 1 -- 172.21.2.135:0/53480127 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc144350 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc253d700 1 --2- 172.21.2.135:0/53480127 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f7db40032f0 tx=0x7f7db4009290).ready entity=mon.1 client_cookie=625fb1646771200e server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc0d3a700 1 -- 172.21.2.135:0/53480127 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db400b870 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.469 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc0d3a700 1 -- 172.21.2.135:0/53480127 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400b9d0 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.470 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc0d3a700 1 -- 172.21.2.135:0/53480127 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db400bb80 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.472 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/53480127 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc0b4cc0 msgr2=0x7f7dbc143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/53480127 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f7db40032f0 tx=0x7f7db4009290).stop 2021-11-15T15:44:38.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/53480127 shutdown_connections 2021-11-15T15:44:38.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/53480127 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc143e60 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/53480127 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/53480127 >> v2:172.21.2.119:3300/0 conn(0x7f7dbc060180 0x7f7dbc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.474 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/53480127 >> 172.21.2.135:0/53480127 conn(0x7f7dbc05cfb0 msgr2=0x7f7dbc05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/53480127 shutdown_connections 2021-11-15T15:44:38.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/53480127 wait complete. 2021-11-15T15:44:38.475 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 Processor -- start 2021-11-15T15:44:38.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- start start 2021-11-15T15:44:38.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.476 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc13c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc13c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0ae730 con 0x7f7dbc0b4cc0 2021-11-15T15:44:38.477 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0ade20 con 0x7f7dbc060180 2021-11-15T15:44:38.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0ae0c0 con 0x7f7dbc067380 2021-11-15T15:44:38.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.478 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37102/0 (socket says 172.21.2.135:37102) 2021-11-15T15:44:38.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 -- 172.21.2.135:0/1834822442 learned_addr learned my addr 172.21.2.135:0/1834822442 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 -- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 msgr2=0x7f7dbc13c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.479 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc13c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 -- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dbc0b4cc0 msgr2=0x7f7dbc13c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc13c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 -- 172.21.2.135:0/1834822442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4009530 con 0x7f7dbc060180 2021-11-15T15:44:38.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc1d3c700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f7db0002fb0 tx=0x7f7db0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db0013460 con 0x7f7dbc060180 2021-11-15T15:44:38.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00135c0 con 0x7f7dbc060180 2021-11-15T15:44:38.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db0013920 con 0x7f7dbc060180 2021-11-15T15:44:38.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc13ccc0 con 0x7f7dbc060180 2021-11-15T15:44:38.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0b0ba0 con 0x7f7dbc060180 2021-11-15T15:44:38.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc0b3820 con 0x7f7dbc060180 2021-11-15T15:44:38.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7db000f070 con 0x7f7dbc060180 2021-11-15T15:44:38.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.461+0000 7f7daeffd700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 0x7f7d9c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.465+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7db006af40 con 0x7f7dbc060180 2021-11-15T15:44:38.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.465+0000 7f7dc153b700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 0x7f7d9c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.465+0000 7f7dc153b700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 0x7f7d9c055a40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f7db8002fb0 tx=0x7f7db80069b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.465+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7dbc0b3820 con 0x7f7dbc060180 2021-11-15T15:44:38.553 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.549+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dbc0adca0 con 0x7f7d9c053580 2021-11-15T15:44:38.554 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.549+0000 7f7daeffd700 1 -- 172.21.2.135:0/1834822442 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7db8012450 con 0x7f7d9c053580 2021-11-15T15:44:38.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 msgr2=0x7f7d9c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.556 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 0x7f7d9c055a40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f7db8002fb0 tx=0x7f7db80069b0).stop 2021-11-15T15:44:38.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 msgr2=0x7f7dbc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f7db0002fb0 tx=0x7f7db0006df0).stop 2021-11-15T15:44:38.557 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 shutdown_connections 2021-11-15T15:44:38.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f7d9c053580 0x7f7d9c055a40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f7dbc0b4cc0 0x7f7dbc13c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.558 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f7dbc067380 0x7f7dbc13c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 --2- 172.21.2.135:0/1834822442 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f7dbc060180 0x7f7dbc0b0350 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 >> 172.21.2.135:0/1834822442 conn(0x7f7dbc05cfb0 msgr2=0x7f7dbc0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.559 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 shutdown_connections 2021-11-15T15:44:38.560 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.553+0000 7f7dc3fa0700 1 -- 172.21.2.135:0/1834822442 wait complete. 2021-11-15T15:44:38.560 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 1 to deep-scrub 2021-11-15T15:44:38.562 INFO:tasks.ceph:Scrubbing osd.2 2021-11-15T15:44:38.563 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:38.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 Processor -- start 2021-11-15T15:44:38.616 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- start start 2021-11-15T15:44:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f00b6600 0x7fd6f00b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.618 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fd6f00b4440 0x7fd6f00b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0144130 con 0x7fd6f0061db0 2021-11-15T15:44:38.619 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00b6ed0 con 0x7fd6f00b4440 2021-11-15T15:44:38.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0143bf0 con 0x7fd6f00b6600 2021-11-15T15:44:38.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ef7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd6f0061db0 0x7fd6f0146740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52932/0 (socket says 172.21.2.135:52932) 2021-11-15T15:44:38.620 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/3353807663 learned_addr learned my addr 172.21.2.135:0/3353807663 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 --2- 172.21.2.135:0/3353807663 >> v2:172.21.2.135:3300/0 conn(0x7fd6f00b4440 0x7fd6f00b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 -- 172.21.2.135:0/3353807663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f00b6600 msgr2=0x7fd6f00b5c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:38.621 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 --2- 172.21.2.135:0/3353807663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f00b6600 0x7fd6f00b5c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 -- 172.21.2.135:0/3353807663 >> v1:172.21.2.135:6789/0 conn(0x7fd6f0061db0 legacy=0x7fd6f0146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 -- 172.21.2.135:0/3353807663 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0143e90 con 0x7fd6f00b4440 2021-11-15T15:44:38.622 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ee7fc700 1 --2- 172.21.2.135:0/3353807663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b4440 0x7fd6f00b69e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fd6d8002f70 tx=0x7fd6d8006df0).ready entity=mon.1 client_cookie=3d3a86fd25ff7fe2 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6edffb700 1 -- 172.21.2.135:0/3353807663 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6d800d570 con 0x7fd6f00b4440 2021-11-15T15:44:38.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6edffb700 1 -- 172.21.2.135:0/3353807663 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8000e90 con 0x7fd6f00b4440 2021-11-15T15:44:38.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6edffb700 1 -- 172.21.2.135:0/3353807663 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6d800d900 con 0x7fd6f00b4440 2021-11-15T15:44:38.623 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- 172.21.2.135:0/3353807663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b4440 msgr2=0x7fd6f00b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- 172.21.2.135:0/3353807663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b4440 0x7fd6f00b69e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fd6d8002f70 tx=0x7fd6d8006df0).stop 2021-11-15T15:44:38.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- 172.21.2.135:0/3353807663 shutdown_connections 2021-11-15T15:44:38.624 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- 172.21.2.135:0/3353807663 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b4440 0x7fd6f00b69e0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- 172.21.2.135:0/3353807663 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f00b6600 0x7fd6f00b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- 172.21.2.135:0/3353807663 >> 172.21.2.135:0/3353807663 conn(0x7fd6f005c510 msgr2=0x7fd6f005c920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.625 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- 172.21.2.135:0/3353807663 shutdown_connections 2021-11-15T15:44:38.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- 172.21.2.135:0/3353807663 wait complete. 2021-11-15T15:44:38.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 Processor -- start 2021-11-15T15:44:38.626 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- start start 2021-11-15T15:44:38.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f0061db0 0x7fd6f00b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6f00b4440 0x7fd6f012a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.630 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 0x7fd6f0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00b0770 con 0x7fd6f00b4440 2021-11-15T15:44:38.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01525f0 con 0x7fd6f00b6600 2021-11-15T15:44:38.631 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6f5830700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00b85e0 con 0x7fd6f0061db0 2021-11-15T15:44:38.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ef7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 0x7fd6f0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ef7fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 0x7fd6f0152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37116/0 (socket says 172.21.2.135:37116) 2021-11-15T15:44:38.632 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.613+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/2583018908 learned_addr learned my addr 172.21.2.135:0/2583018908 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f0061db0 msgr2=0x7fd6f00b7fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:38.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd6f0061db0 0x7fd6f00b7fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.633 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6f00b4440 msgr2=0x7fd6f012a1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:38.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd6f00b4440 0x7fd6f012a1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d800b180 con 0x7fd6f00b6600 2021-11-15T15:44:38.634 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ef7fe700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 0x7fd6f0152c80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fd6f00b7bb0 tx=0x7fd6e80013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e8005ba0 con 0x7fd6f00b6600 2021-11-15T15:44:38.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8005d00 con 0x7fd6f00b6600 2021-11-15T15:44:38.635 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f00b8880 con 0x7fd6f00b6600 2021-11-15T15:44:38.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e80072c0 con 0x7fd6f00b6600 2021-11-15T15:44:38.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00ae920 con 0x7fd6f00b6600 2021-11-15T15:44:38.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6f01529e0 con 0x7fd6f00b6600 2021-11-15T15:44:38.636 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6e8010070 con 0x7fd6f00b6600 2021-11-15T15:44:38.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6d40536a0 0x7fd6d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd6e806b130 con 0x7fd6f00b6600 2021-11-15T15:44:38.637 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7fd6d405a430 0x7fd6d405c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6d405ce10 con 0x7fd6d405a430 2021-11-15T15:44:38.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e806d7c0 con 0x7fd6f00b6600 2021-11-15T15:44:38.638 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ee7fc700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7fd6d405a430 0x7fd6d405c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6ee7fc700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7fd6d405a430 0x7fd6d405c850 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6eeffd700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6d40536a0 0x7fd6d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.639 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== osd.2 v2:172.21.2.135:6800/14885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fd6d405ce10 con 0x7fd6d405a430 2021-11-15T15:44:38.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.617+0000 7fd6eeffd700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6d40536a0 0x7fd6d4055b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fd6e0002fb0 tx=0x7fd6e0006930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.640 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 --> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6f0061670 con 0x7fd6d405a430 2021-11-15T15:44:38.641 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6e7fff700 1 -- 172.21.2.135:0/2583018908 <== osd.2 v2:172.21.2.135:6800/14885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd6f0061670 con 0x7fd6d405a430 2021-11-15T15:44:38.641 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:38.642 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:38.642 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:38.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7fd6d405a430 msgr2=0x7fd6d405c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.644 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:6800/14885,v1:172.21.2.135:6801/14885] conn(0x7fd6d405a430 0x7fd6d405c850 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6d40536a0 msgr2=0x7fd6d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd6d40536a0 0x7fd6d4055b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fd6e0002fb0 tx=0x7fd6e0006930).stop 2021-11-15T15:44:38.645 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 msgr2=0x7fd6f0152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 --2- 172.21.2.135:0/2583018908 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd6f00b6600 0x7fd6f0152c80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7fd6f00b7bb0 tx=0x7fd6e80013a0).stop 2021-11-15T15:44:38.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6ef7fe700 1 -- 172.21.2.135:0/2583018908 reap_dead start 2021-11-15T15:44:38.646 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 shutdown_connections 2021-11-15T15:44:38.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 >> 172.21.2.135:0/2583018908 conn(0x7fd6f005c510 msgr2=0x7fd6f0128950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 shutdown_connections 2021-11-15T15:44:38.647 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.625+0000 7fd6f5830700 1 -- 172.21.2.135:0/2583018908 wait complete. 2021-11-15T15:44:38.648 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-11-15T15:44:38.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 Processor -- start 2021-11-15T15:44:38.704 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- start start 2021-11-15T15:44:38.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fea040b1050 0x7fea041447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.709 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040b03d0 con 0x7fea040b1e30 2021-11-15T15:44:38.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040b0670 con 0x7fea04148420 2021-11-15T15:44:38.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea040a9140 con 0x7fea040b1050 2021-11-15T15:44:38.710 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea09ab8700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fea04148420 0x7fea040a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52950/0 (socket says 172.21.2.135:52950) 2021-11-15T15:44:38.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea09ab8700 1 -- 172.21.2.135:0/3957382940 learned_addr learned my addr 172.21.2.135:0/3957382940 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246294193 0 0) 0x7fea040b0670 con 0x7fea04148420 2021-11-15T15:44:38.711 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ec003260 con 0x7fea04148420 2021-11-15T15:44:38.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 --2- 172.21.2.135:0/3957382940 >> v2:172.21.2.119:3300/0 conn(0x7fea040b1050 0x7fea041447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341841993 0 0) 0x7fe9ec003260 con 0x7fea04148420 2021-11-15T15:44:38.712 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 >> v2:172.21.2.119:3300/0 conn(0x7fea040b1050 msgr2=0x7fea041447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 --2- 172.21.2.135:0/3957382940 >> v2:172.21.2.119:3300/0 conn(0x7fea040b1050 0x7fea041447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 >> v1:172.21.2.119:6789/0 conn(0x7fea040b1e30 legacy=0x7fea040b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.713 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040b0910 con 0x7fea04148420 2021-11-15T15:44:38.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fe9f4001660 con 0x7fea04148420 2021-11-15T15:44:38.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 >> v1:172.21.2.135:6789/0 conn(0x7fea04148420 legacy=0x7fea040a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.714 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9ec003820 0x7fe9ec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9ec004500 0x7fe9ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fe9ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.715 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec00be20 con 0x7fe9ec003820 2021-11-15T15:44:38.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec00bf90 con 0x7fe9ec004f70 2021-11-15T15:44:38.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec00c150 con 0x7fe9ec004500 2021-11-15T15:44:38.716 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fe9ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 -- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9ec004500 msgr2=0x7fe9ec004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fe9ec004500 0x7fe9ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.717 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 -- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9ec003820 msgr2=0x7fe9ec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fe9ec003820 0x7fe9ec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 -- 172.21.2.135:0/3957382940 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec003260 con 0x7fe9ec004f70 2021-11-15T15:44:38.718 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 -- 172.21.2.135:0/3957382940 reap_dead start 2021-11-15T15:44:38.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0aaba700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fe9ec00b750 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fe9fc00a000 tx=0x7fe9fc008040).ready entity=mon.1 client_cookie=fa072eab72f912ad server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9fc00c070 con 0x7fe9ec004f70 2021-11-15T15:44:38.719 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc00e810 con 0x7fe9ec004f70 2021-11-15T15:44:38.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea092b7700 1 -- 172.21.2.135:0/3957382940 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9fc00eb70 con 0x7fe9ec004f70 2021-11-15T15:44:38.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 msgr2=0x7fe9ec00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.720 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fe9ec00b750 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fe9fc00a000 tx=0x7fe9fc008040).stop 2021-11-15T15:44:38.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- 172.21.2.135:0/3957382940 shutdown_connections 2021-11-15T15:44:38.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3957382940 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fe9ec00b750 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.721 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- 172.21.2.135:0/3957382940 >> 172.21.2.135:0/3957382940 conn(0x7fea0405f730 msgr2=0x7fea0405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- 172.21.2.135:0/3957382940 shutdown_connections 2021-11-15T15:44:38.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.701+0000 7fea0c51d700 1 -- 172.21.2.135:0/3957382940 wait complete. 2021-11-15T15:44:38.722 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 Processor -- start 2021-11-15T15:44:38.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- start start 2021-11-15T15:44:38.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.723 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea0414b600 0x7fea0414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea040a92a0 0x7fea0414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040aabb0 con 0x7fea0414b600 2021-11-15T15:44:38.724 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0414e860 con 0x7fe9ec004f70 2021-11-15T15:44:38.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea041574f0 con 0x7fea040a92a0 2021-11-15T15:44:38.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.725 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37138/0 (socket says 172.21.2.135:37138) 2021-11-15T15:44:38.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 -- 172.21.2.135:0/3018087601 learned_addr learned my addr 172.21.2.135:0/3018087601 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 -- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea040a92a0 msgr2=0x7fea0414d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.726 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea040a92a0 0x7fea0414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 -- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea0414b600 msgr2=0x7fea0414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea0414b600 0x7fea0414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.727 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 -- 172.21.2.135:0/3018087601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0414db50 con 0x7fe9ec004f70 2021-11-15T15:44:38.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0a2b9700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fea00001fa0 tx=0x7fea00007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0000ce80 con 0x7fe9ec004f70 2021-11-15T15:44:38.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00000e90 con 0x7fe9ec004f70 2021-11-15T15:44:38.728 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea040a9750 con 0x7fe9ec004f70 2021-11-15T15:44:38.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea00007430 con 0x7fe9ec004f70 2021-11-15T15:44:38.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0414ece0 con 0x7fe9ec004f70 2021-11-15T15:44:38.729 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea040b0bb0 con 0x7fe9ec004f70 2021-11-15T15:44:38.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea0001a060 con 0x7fe9ec004f70 2021-11-15T15:44:38.731 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 0x7fe9e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fea0006b0f0 con 0x7fe9ec004f70 2021-11-15T15:44:38.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.705+0000 7fea09ab8700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 0x7fe9e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.732 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.709+0000 7fea09ab8700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 0x7fe9e4055b60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fea041477b0 tx=0x7fea040b0800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.733 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.709+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea000422c0 con 0x7fe9ec004f70 2021-11-15T15:44:38.796 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fea04157370 con 0x7fe9e40536a0 2021-11-15T15:44:38.797 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fe9f37fe700 1 -- 172.21.2.135:0/3018087601 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe9f4007170 con 0x7fe9e40536a0 2021-11-15T15:44:38.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 msgr2=0x7fe9e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.799 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 0x7fe9e4055b60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fea041477b0 tx=0x7fea040b0800).stop 2021-11-15T15:44:38.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 msgr2=0x7fea040a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fea00001fa0 tx=0x7fea00007c30).stop 2021-11-15T15:44:38.800 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 shutdown_connections 2021-11-15T15:44:38.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fe9e40536a0 0x7fe9e4055b60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fea040a92a0 0x7fea0414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.801 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fea0414b600 0x7fea0414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 --2- 172.21.2.135:0/3018087601 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fe9ec004f70 0x7fea040a9c90 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 >> 172.21.2.135:0/3018087601 conn(0x7fea0405f730 msgr2=0x7fea040aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.802 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 shutdown_connections 2021-11-15T15:44:38.803 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.793+0000 7fea0c51d700 1 -- 172.21.2.135:0/3018087601 wait complete. 2021-11-15T15:44:38.803 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 2 to deep-scrub 2021-11-15T15:44:38.804 INFO:tasks.ceph:Scrubbing osd.3 2021-11-15T15:44:38.805 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:38.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 Processor -- start 2021-11-15T15:44:38.858 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 -- start start 2021-11-15T15:44:38.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fda7c148420 0x7fda7c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.862 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0b03d0 con 0x7fda7c0a7140 2021-11-15T15:44:38.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0b0670 con 0x7fda7c0b1e30 2021-11-15T15:44:38.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda81c75700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0a9140 con 0x7fda7c148420 2021-11-15T15:44:38.863 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda7b7fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fda7c0b1e30 0x7fda7c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52966/0 (socket says 172.21.2.135:52966) 2021-11-15T15:44:38.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.853+0000 7fda7b7fe700 1 -- 172.21.2.135:0/2223575506 learned_addr learned my addr 172.21.2.135:0/2223575506 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845038269 0 0) 0x7fda7c0b0670 con 0x7fda7c0b1e30 2021-11-15T15:44:38.864 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003260 con 0x7fda7c0b1e30 2021-11-15T15:44:38.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155217373 0 0) 0x7fda68003260 con 0x7fda7c0b1e30 2021-11-15T15:44:38.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 >> v2:172.21.2.119:3300/0 conn(0x7fda7c148420 msgr2=0x7fda7c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.865 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 --2- 172.21.2.135:0/2223575506 >> v2:172.21.2.119:3300/0 conn(0x7fda7c148420 0x7fda7c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 >> v1:172.21.2.119:6789/0 conn(0x7fda7c0a7140 legacy=0x7fda7c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0b0910 con 0x7fda7c0b1e30 2021-11-15T15:44:38.866 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fda6c001660 con 0x7fda7c0b1e30 2021-11-15T15:44:38.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 >> v1:172.21.2.135:6789/0 conn(0x7fda7c0b1e30 legacy=0x7fda7c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68003820 0x7fda68003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 0x7fda68004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.867 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda68005050 0x7fda6800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bf10 con 0x7fda68003820 2021-11-15T15:44:38.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800c080 con 0x7fda68004500 2021-11-15T15:44:38.868 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800c240 con 0x7fda68005050 2021-11-15T15:44:38.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 0x7fda68004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7b7fe700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68003820 0x7fda68003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.869 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7bfff700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda68005050 0x7fda6800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 -- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda68005050 msgr2=0x7fda6800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda68005050 0x7fda6800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.870 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 -- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68003820 msgr2=0x7fda68003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68003820 0x7fda68003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 -- 172.21.2.135:0/2223575506 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68003260 con 0x7fda68004500 2021-11-15T15:44:38.871 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7bfff700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda68005050 0x7fda6800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:38.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7bfff700 1 -- 172.21.2.135:0/2223575506 reap_dead start 2021-11-15T15:44:38.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 0x7fda68004980 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fda70002f70 tx=0x7fda70006ca0).ready entity=mon.1 client_cookie=fc15827fe0030db6 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.872 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda70013410 con 0x7fda68004500 2021-11-15T15:44:38.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70013570 con 0x7fda68004500 2021-11-15T15:44:38.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7a7fc700 1 -- 172.21.2.135:0/2223575506 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda700138d0 con 0x7fda68004500 2021-11-15T15:44:38.873 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 msgr2=0x7fda68004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 0x7fda68004980 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fda70002f70 tx=0x7fda70006ca0).stop 2021-11-15T15:44:38.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- 172.21.2.135:0/2223575506 shutdown_connections 2021-11-15T15:44:38.874 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 --2- 172.21.2.135:0/2223575506 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda68004500 0x7fda68004980 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- 172.21.2.135:0/2223575506 >> 172.21.2.135:0/2223575506 conn(0x7fda7c05f730 msgr2=0x7fda7c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- 172.21.2.135:0/2223575506 shutdown_connections 2021-11-15T15:44:38.875 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- 172.21.2.135:0/2223575506 wait complete. 2021-11-15T15:44:38.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 Processor -- start 2021-11-15T15:44:38.876 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- start start 2021-11-15T15:44:38.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68004500 0x7fda7c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.882 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 0x7fda7c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.883 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda7c14ae20 0x7fda7c0a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0ac020 con 0x7fda68004500 2021-11-15T15:44:38.884 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0ab940 con 0x7fda7c149c60 2021-11-15T15:44:38.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda81c75700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c14b4a0 con 0x7fda7c14ae20 2021-11-15T15:44:38.885 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 0x7fda7c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.886 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 0x7fda7c0abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37162/0 (socket says 172.21.2.135:37162) 2021-11-15T15:44:38.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.857+0000 7fda7affd700 1 -- 172.21.2.135:0/2415711647 learned_addr learned my addr 172.21.2.135:0/2415711647 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:38.887 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 -- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda7c14ae20 msgr2=0x7fda7c0a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fda7c14ae20 0x7fda7c0a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.888 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 -- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68004500 msgr2=0x7fda7c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fda68004500 0x7fda7c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.889 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c14a540 con 0x7fda7c149c60 2021-11-15T15:44:38.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7affd700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 0x7fda7c0abb30 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fda70002f70 tx=0x7fda70014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.890 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda70013410 con 0x7fda7c149c60 2021-11-15T15:44:38.891 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70012bf0 con 0x7fda7c149c60 2021-11-15T15:44:38.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c14a7e0 con 0x7fda7c149c60 2021-11-15T15:44:38.892 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda70021470 con 0x7fda7c149c60 2021-11-15T15:44:38.893 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c1438c0 con 0x7fda7c149c60 2021-11-15T15:44:38.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda7c14a3c0 con 0x7fda7c149c60 2021-11-15T15:44:38.894 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda700215d0 con 0x7fda7c149c60 2021-11-15T15:44:38.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda5c053660 0x7fda5c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.895 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fda7001b040 con 0x7fda7c149c60 2021-11-15T15:44:38.896 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7fda5c05a470 0x7fda5c05c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda5c05ce50 con 0x7fda5c05a470 2021-11-15T15:44:38.897 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda70071220 con 0x7fda7c149c60 2021-11-15T15:44:38.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7bfff700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7fda5c05a470 0x7fda5c05c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.898 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7b7fe700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda5c053660 0x7fda5c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:38.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7bfff700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7fda5c05a470 0x7fda5c05c890 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== osd.3 v2:172.21.2.135:6808/14886 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fda5c05ce50 con 0x7fda5c05a470 2021-11-15T15:44:38.899 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.861+0000 7fda7b7fe700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda5c053660 0x7fda5c055b20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fda6c00b000 tx=0x7fda7c0b0aa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:38.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 --> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fda7c1441a0 con 0x7fda5c05a470 2021-11-15T15:44:38.900 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda78ff9700 1 -- 172.21.2.135:0/2415711647 <== osd.3 v2:172.21.2.135:6808/14886 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fda7c1441a0 con 0x7fda5c05a470 2021-11-15T15:44:38.901 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:38.902 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:38.903 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:38.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7fda5c05a470 msgr2=0x7fda5c05c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.906 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:6808/14886,v1:172.21.2.135:6809/14886] conn(0x7fda5c05a470 0x7fda5c05c890 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:38.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda5c053660 msgr2=0x7fda5c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fda5c053660 0x7fda5c055b20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fda6c00b000 tx=0x7fda7c0b0aa0).stop 2021-11-15T15:44:38.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 msgr2=0x7fda7c0abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.869+0000 7fda81c75700 1 --2- 172.21.2.135:0/2415711647 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fda7c149c60 0x7fda7c0abb30 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fda70002f70 tx=0x7fda70014000).stop 2021-11-15T15:44:38.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.873+0000 7fda7bfff700 1 -- 172.21.2.135:0/2415711647 reap_dead start 2021-11-15T15:44:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.873+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 shutdown_connections 2021-11-15T15:44:38.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.873+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 >> 172.21.2.135:0/2415711647 conn(0x7fda7c05f730 msgr2=0x7fda7c0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.873+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 shutdown_connections 2021-11-15T15:44:38.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.873+0000 7fda81c75700 1 -- 172.21.2.135:0/2415711647 wait complete. 2021-11-15T15:44:38.912 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-11-15T15:44:38.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.977+0000 7f0c53b3d700 1 Processor -- start 2021-11-15T15:44:38.984 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.977+0000 7f0c53b3d700 1 -- start start 2021-11-15T15:44:38.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f0c4c148420 0x7f0c4c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.985 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 0x7f0c4c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0b03d0 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c0a9140 con 0x7f0c4c148420 2021-11-15T15:44:38.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b0670 con 0x7f0c4c0a7140 2021-11-15T15:44:38.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f0c4c0b1e30 0x7f0c4c0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:52988/0 (socket says 172.21.2.135:52988) 2021-11-15T15:44:38.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 -- 172.21.2.135:0/1486162174 learned_addr learned my addr 172.21.2.135:0/1486162174 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:38.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864135413 0 0) 0x7f0c4c0b03d0 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c34003260 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3368462355 0 0) 0x7f0c34003260 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 msgr2=0x7f0c4c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 0x7f0c4c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 >> v2:172.21.2.119:3300/0 conn(0x7f0c4c148420 msgr2=0x7f0c4c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:38.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 --2- 172.21.2.135:0/1486162174 >> v2:172.21.2.119:3300/0 conn(0x7f0c4c148420 0x7f0c4c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:38.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0b0910 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f0c40001660 con 0x7f0c4c0b1e30 2021-11-15T15:44:38.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 >> v1:172.21.2.135:6789/0 conn(0x7f0c4c0b1e30 legacy=0x7f0c4c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:38.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c340037d0 0x7f0c34003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c34004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 0x7f0c3400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:38.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b0670 con 0x7f0c340037d0 2021-11-15T15:44:39.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34005280 con 0x7f0c34004500 2021-11-15T15:44:39.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3400bc40 con 0x7f0c4c0a7140 2021-11-15T15:44:39.000 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c34004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 -- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 msgr2=0x7f0c3400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c0a7140 0x7f0c3400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 -- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c340037d0 msgr2=0x7f0c34003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c340037d0 0x7f0c34003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 -- 172.21.2.135:0/1486162174 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34003260 con 0x7f0c34004500 2021-11-15T15:44:39.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c510d8700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c34004980 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c48006ca0).ready entity=mon.1 client_cookie=d56b444394f36fd server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c48012410 con 0x7f0c34004500 2021-11-15T15:44:39.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48012570 con 0x7f0c34004500 2021-11-15T15:44:39.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c508d7700 1 -- 172.21.2.135:0/1486162174 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c480128d0 con 0x7f0c34004500 2021-11-15T15:44:39.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- 172.21.2.135:0/1486162174 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 msgr2=0x7f0c34004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/1486162174 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c34004980 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c48006ca0).stop 2021-11-15T15:44:39.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c520da700 1 -- 172.21.2.135:0/1486162174 reap_dead start 2021-11-15T15:44:39.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- 172.21.2.135:0/1486162174 shutdown_connections 2021-11-15T15:44:39.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- 172.21.2.135:0/1486162174 >> 172.21.2.135:0/1486162174 conn(0x7f0c4c05f730 msgr2=0x7f0c4c05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- 172.21.2.135:0/1486162174 shutdown_connections 2021-11-15T15:44:39.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- 172.21.2.135:0/1486162174 wait complete. 2021-11-15T15:44:39.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 Processor -- start 2021-11-15T15:44:39.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- start start 2021-11-15T15:44:39.010 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c14b780 0x7f0c4c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.011 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c4c0ab670 0x7f0c4c0abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0aa090 con 0x7f0c4c0ab670 2021-11-15T15:44:39.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0ae6a0 con 0x7f0c34004500 2021-11-15T15:44:39.012 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c53b3d700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0ae940 con 0x7f0c4c14b780 2021-11-15T15:44:39.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.013 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37180/0 (socket says 172.21.2.135:37180) 2021-11-15T15:44:39.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 -- 172.21.2.135:0/3834781098 learned_addr learned my addr 172.21.2.135:0/3834781098 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.014 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 -- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c14b780 msgr2=0x7f0c4c149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c14b780 0x7f0c4c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.015 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 -- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c4c0ab670 msgr2=0x7f0c4c0abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c4c0ab670 0x7f0c4c0abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.016 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 -- 172.21.2.135:0/3834781098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0aebe0 con 0x7f0c34004500 2021-11-15T15:44:39.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.981+0000 7f0c518d9700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f0c4c149ce0 tx=0x7f0c4c0b0aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.017 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c40007170 con 0x7f0c34004500 2021-11-15T15:44:39.018 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c400072d0 con 0x7f0c34004500 2021-11-15T15:44:39.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c40004920 con 0x7f0c34004500 2021-11-15T15:44:39.019 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0aee80 con 0x7f0c34004500 2021-11-15T15:44:39.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c14a410 con 0x7f0c34004500 2021-11-15T15:44:39.020 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c0573d0 con 0x7f0c34004500 2021-11-15T15:44:39.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c4001b070 con 0x7f0c34004500 2021-11-15T15:44:39.021 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 0x7f0c2c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.022 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0c4006afe0 con 0x7f0c34004500 2021-11-15T15:44:39.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c510d8700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 0x7f0c2c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.023 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c510d8700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 0x7f0c2c055b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.024 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:38.985+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c400422c0 con 0x7f0c34004500 2021-11-15T15:44:39.074 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.069+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c4c0ab3d0 con 0x7f0c2c053640 2021-11-15T15:44:39.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c3effd700 1 -- 172.21.2.135:0/3834781098 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0c4c0ab3d0 con 0x7f0c2c053640 2021-11-15T15:44:39.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 msgr2=0x7f0c2c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 0x7f0c2c055b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f0c48002f70 tx=0x7f0c48015000).stop 2021-11-15T15:44:39.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 msgr2=0x7f0c4c0ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f0c4c149ce0 tx=0x7f0c4c0b0aa0).stop 2021-11-15T15:44:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 shutdown_connections 2021-11-15T15:44:39.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f0c2c053640 0x7f0c2c055b00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f0c4c0ab670 0x7f0c4c0abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f0c4c14b780 0x7f0c4c149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 --2- 172.21.2.135:0/3834781098 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f0c34004500 0x7f0c4c0ac410 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 >> 172.21.2.135:0/3834781098 conn(0x7f0c4c05f730 msgr2=0x7f0c4c144be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 shutdown_connections 2021-11-15T15:44:39.081 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.073+0000 7f0c53b3d700 1 -- 172.21.2.135:0/3834781098 wait complete. 2021-11-15T15:44:39.082 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 3 to deep-scrub 2021-11-15T15:44:39.084 INFO:tasks.ceph:Scrubbing osd.4 2021-11-15T15:44:39.085 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:39.138 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 Processor -- start 2021-11-15T15:44:39.139 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 -- start start 2021-11-15T15:44:39.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640b1e30 0x7f37640b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640b03d0 con 0x7f37640a7140 2021-11-15T15:44:39.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640b0670 con 0x7f3764148420 2021-11-15T15:44:39.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.133+0000 7f3769d16700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640a9140 con 0x7f37640b1e30 2021-11-15T15:44:39.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3762ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f3764148420 0x7f37640b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53012/0 (socket says 172.21.2.135:53012) 2021-11-15T15:44:39.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3762ffd700 1 -- 172.21.2.135:0/2724317156 learned_addr learned my addr 172.21.2.135:0/2724317156 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:39.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816711416 0 0) 0x7f37640b0670 con 0x7f3764148420 2021-11-15T15:44:39.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3744003260 con 0x7f3764148420 2021-11-15T15:44:39.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37637fe700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640b1e30 0x7f37640b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335680716 0 0) 0x7f3744003260 con 0x7f3764148420 2021-11-15T15:44:39.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640b1e30 msgr2=0x7f37640b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640b1e30 0x7f37640b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 >> v1:172.21.2.119:6789/0 conn(0x7f37640a7140 legacy=0x7f37641447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640b0910 con 0x7f3764148420 2021-11-15T15:44:39.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f374c001660 con 0x7f3764148420 2021-11-15T15:44:39.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 >> v1:172.21.2.135:6789/0 conn(0x7f3764148420 legacy=0x7f37640b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f37440037d0 0x7f3744003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3744004500 0x7f3744004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f374400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.157 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374400bea0 con 0x7f37440037d0 2021-11-15T15:44:39.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374400c010 con 0x7f3744004f90 2021-11-15T15:44:39.158 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374400c1d0 con 0x7f3744004500 2021-11-15T15:44:39.159 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37637fe700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640b1e30 0x7f37640b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:39.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f374400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 -- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3744004500 msgr2=0x7f3744004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.160 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f3744004500 0x7f3744004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 -- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f37440037d0 msgr2=0x7f3744003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f37440037d0 0x7f3744003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.161 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 -- 172.21.2.135:0/2724317156 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640b0910 con 0x7f3744004f90 2021-11-15T15:44:39.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f374400b750 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f375c002320 tx=0x7f375c007d80).ready entity=mon.1 client_cookie=73117825b389a99d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.162 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c002510 con 0x7f3744004f90 2021-11-15T15:44:39.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c006890 con 0x7f3744004f90 2021-11-15T15:44:39.163 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f37627fc700 1 -- 172.21.2.135:0/2724317156 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c006bf0 con 0x7f3744004f90 2021-11-15T15:44:39.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- 172.21.2.135:0/2724317156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 msgr2=0x7f374400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.164 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 --2- 172.21.2.135:0/2724317156 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f374400b750 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f375c002320 tx=0x7f375c007d80).stop 2021-11-15T15:44:39.165 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3763fff700 1 -- 172.21.2.135:0/2724317156 reap_dead start 2021-11-15T15:44:39.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- 172.21.2.135:0/2724317156 shutdown_connections 2021-11-15T15:44:39.166 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- 172.21.2.135:0/2724317156 >> 172.21.2.135:0/2724317156 conn(0x7f376405f730 msgr2=0x7f376405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- 172.21.2.135:0/2724317156 shutdown_connections 2021-11-15T15:44:39.167 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- 172.21.2.135:0/2724317156 wait complete. 2021-11-15T15:44:39.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 Processor -- start 2021-11-15T15:44:39.168 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.137+0000 7f3769d16700 1 -- start start 2021-11-15T15:44:39.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f376414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.169 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640af2b0 0x7f376413fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.170 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f376413ff40 0x7f37641458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376414a360 con 0x7f376413ff40 2021-11-15T15:44:39.171 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640ad2b0 con 0x7f3744004f90 2021-11-15T15:44:39.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640ad550 con 0x7f37640af2b0 2021-11-15T15:44:39.172 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f376414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f376414d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37200/0 (socket says 172.21.2.135:37200) 2021-11-15T15:44:39.173 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 -- 172.21.2.135:0/2381941748 learned_addr learned my addr 172.21.2.135:0/2381941748 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 -- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640af2b0 msgr2=0x7f376413fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.174 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f37640af2b0 0x7f376413fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 -- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f376413ff40 msgr2=0x7f37641458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.175 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f376413ff40 0x7f37641458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.176 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640ad7f0 con 0x7f3744004f90 2021-11-15T15:44:39.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f37637fe700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f376414d860 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f3754007000 tx=0x7f3754008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.177 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375400f4e0 con 0x7f3744004f90 2021-11-15T15:44:39.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754000e90 con 0x7f3744004f90 2021-11-15T15:44:39.178 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37640ada90 con 0x7f3744004f90 2021-11-15T15:44:39.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375400f830 con 0x7f3744004f90 2021-11-15T15:44:39.179 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640add30 con 0x7f3744004f90 2021-11-15T15:44:39.180 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3764145620 con 0x7f3744004f90 2021-11-15T15:44:39.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f375400f990 con 0x7f3744004f90 2021-11-15T15:44:39.181 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3748053610 0x7f3748055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f375406b2d0 con 0x7f3744004f90 2021-11-15T15:44:39.182 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f374805a3a0 0x7f374805c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f374805cd80 con 0x7f374805a3a0 2021-11-15T15:44:39.183 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375406d960 con 0x7f3744004f90 2021-11-15T15:44:39.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3762ffd700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3748053610 0x7f3748055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.184 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.141+0000 7f3763fff700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f374805a3a0 0x7f374805c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.145+0000 7f3762ffd700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3748053610 0x7f3748055ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f374c001020 tx=0x7f374c001680).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.185 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.145+0000 7f3763fff700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f374805a3a0 0x7f374805c7c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.145+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== osd.4 v2:172.21.2.119:6810/15090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f374805cd80 con 0x7f374805a3a0 2021-11-15T15:44:39.187 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.153+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 --> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3764146270 con 0x7f374805a3a0 2021-11-15T15:44:39.188 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.153+0000 7f3760ff9700 1 -- 172.21.2.135:0/2381941748 <== osd.4 v2:172.21.2.119:6810/15090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3764146270 con 0x7f374805a3a0 2021-11-15T15:44:39.189 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:39.190 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:39.190 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:39.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f374805a3a0 msgr2=0x7f374805c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.194 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6810/15090,v1:172.21.2.119:6811/15090] conn(0x7f374805a3a0 0x7f374805c7c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3748053610 msgr2=0x7f3748055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f3748053610 0x7f3748055ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f374c001020 tx=0x7f374c001680).stop 2021-11-15T15:44:39.195 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 msgr2=0x7f376414d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 --2- 172.21.2.135:0/2381941748 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f3744004f90 0x7f376414d860 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f3754007000 tx=0x7f3754008040).stop 2021-11-15T15:44:39.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3763fff700 1 -- 172.21.2.135:0/2381941748 reap_dead start 2021-11-15T15:44:39.196 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 shutdown_connections 2021-11-15T15:44:39.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 >> 172.21.2.135:0/2381941748 conn(0x7f376405f730 msgr2=0x7f37640b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.197 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 shutdown_connections 2021-11-15T15:44:39.198 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.157+0000 7f3769d16700 1 -- 172.21.2.135:0/2381941748 wait complete. 2021-11-15T15:44:39.199 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-15T15:44:39.252 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 Processor -- start 2021-11-15T15:44:39.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- start start 2021-11-15T15:44:39.253 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f31e00b0520 0x7f31e00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00aa1a0 0x7f31e00ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00b2b70 con 0x7f31e00b0900 2021-11-15T15:44:39.254 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00b27f0 con 0x7f31e00b0520 2021-11-15T15:44:39.255 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00b2da0 con 0x7f31e00aa1a0 2021-11-15T15:44:39.258 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e5779700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f31e00b0900 0x7f31e0143790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53032/0 (socket says 172.21.2.135:53032) 2021-11-15T15:44:39.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e5779700 1 -- 172.21.2.135:0/258720682 learned_addr learned my addr 172.21.2.135:0/258720682 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:39.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 --2- 172.21.2.135:0/258720682 >> v2:172.21.2.135:3300/0 conn(0x7f31e00b0520 0x7f31e00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.259 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 -- 172.21.2.135:0/258720682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00aa1a0 msgr2=0x7f31e00ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 --2- 172.21.2.135:0/258720682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00aa1a0 0x7f31e00ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 -- 172.21.2.135:0/258720682 >> v1:172.21.2.135:6789/0 conn(0x7f31e00b0900 legacy=0x7f31e0143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.260 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 -- 172.21.2.135:0/258720682 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00a9bf0 con 0x7f31e00b0520 2021-11-15T15:44:39.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e4f78700 1 --2- 172.21.2.135:0/258720682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0520 0x7f31e00addb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f31d80032f0 tx=0x7f31d80091d0).ready entity=mon.1 client_cookie=660eac2e025b003a server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31df7fe700 1 -- 172.21.2.135:0/258720682 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8009ea0 con 0x7f31e00b0520 2021-11-15T15:44:39.261 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31df7fe700 1 -- 172.21.2.135:0/258720682 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800ba90 con 0x7f31e00b0520 2021-11-15T15:44:39.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31df7fe700 1 -- 172.21.2.135:0/258720682 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800bdf0 con 0x7f31e00b0520 2021-11-15T15:44:39.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- 172.21.2.135:0/258720682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0520 msgr2=0x7f31e00addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.262 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 --2- 172.21.2.135:0/258720682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0520 0x7f31e00addb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f31d80032f0 tx=0x7f31d80091d0).stop 2021-11-15T15:44:39.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- 172.21.2.135:0/258720682 shutdown_connections 2021-11-15T15:44:39.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 --2- 172.21.2.135:0/258720682 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00aa1a0 0x7f31e00ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 --2- 172.21.2.135:0/258720682 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0520 0x7f31e00addb0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.263 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- 172.21.2.135:0/258720682 >> 172.21.2.135:0/258720682 conn(0x7f31e0060840 msgr2=0x7f31e0060c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- 172.21.2.135:0/258720682 shutdown_connections 2021-11-15T15:44:39.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- 172.21.2.135:0/258720682 wait complete. 2021-11-15T15:44:39.264 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 Processor -- start 2021-11-15T15:44:39.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.249+0000 7f31e71dc700 1 -- start start 2021-11-15T15:44:39.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31e00aa1a0 0x7f31e00a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.265 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00b0520 0x7f31e015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00ab3b0 con 0x7f31e00aa1a0 2021-11-15T15:44:39.266 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e009fd20 con 0x7f31e00b0900 2021-11-15T15:44:39.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00aac70 con 0x7f31e00b0520 2021-11-15T15:44:39.267 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37220/0 (socket says 172.21.2.135:37220) 2021-11-15T15:44:39.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 -- 172.21.2.135:0/1508938455 learned_addr learned my addr 172.21.2.135:0/1508938455 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.268 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 -- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00b0520 msgr2=0x7f31e015a0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:39.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00b0520 0x7f31e015a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 -- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31e00aa1a0 msgr2=0x7f31e00a0520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:39.269 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31e00aa1a0 0x7f31e00a0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 -- 172.21.2.135:0/1508938455 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009470 con 0x7f31e00b0900 2021-11-15T15:44:39.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e5779700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f31e00ad450 tx=0x7f31d0007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.270 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d000ce30 con 0x7f31e00b0900 2021-11-15T15:44:39.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d00070d0 con 0x7f31e00b0900 2021-11-15T15:44:39.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d0007430 con 0x7f31e00b0900 2021-11-15T15:44:39.271 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00aaf10 con 0x7f31e00b0900 2021-11-15T15:44:39.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e015aa90 con 0x7f31e00b0900 2021-11-15T15:44:39.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e009f9e0 con 0x7f31e00b0900 2021-11-15T15:44:39.272 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31d0010070 con 0x7f31e00b0900 2021-11-15T15:44:39.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 0x7f31c4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f31d006ac80 con 0x7f31e00b0900 2021-11-15T15:44:39.273 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e4f78700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 0x7f31c4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.253+0000 7f31e4f78700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 0x7f31c4055b90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f31d80032f0 tx=0x7f31d8018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.274 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.257+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31d0071080 con 0x7f31e00b0900 2021-11-15T15:44:39.346 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.341+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e00ab0a0 con 0x7f31c40536d0 2021-11-15T15:44:39.347 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31ddffb700 1 -- 172.21.2.135:0/1508938455 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31e00ab0a0 con 0x7f31c40536d0 2021-11-15T15:44:39.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 msgr2=0x7f31c4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.349 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 0x7f31c4055b90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f31d80032f0 tx=0x7f31d8018000).stop 2021-11-15T15:44:39.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 msgr2=0x7f31e015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f31e00ad450 tx=0x7f31d0007be0).stop 2021-11-15T15:44:39.350 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 shutdown_connections 2021-11-15T15:44:39.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f31c40536d0 0x7f31c4055b90 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f31e00b0900 0x7f31e015a5a0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.351 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f31e00b0520 0x7f31e015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 --2- 172.21.2.135:0/1508938455 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f31e00aa1a0 0x7f31e00a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 >> 172.21.2.135:0/1508938455 conn(0x7f31e0060840 msgr2=0x7f31e00b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.352 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 shutdown_connections 2021-11-15T15:44:39.353 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.345+0000 7f31e71dc700 1 -- 172.21.2.135:0/1508938455 wait complete. 2021-11-15T15:44:39.353 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 4 to deep-scrub 2021-11-15T15:44:39.355 INFO:tasks.ceph:Scrubbing osd.5 2021-11-15T15:44:39.356 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:39.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 Processor -- start 2021-11-15T15:44:39.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- start start 2021-11-15T15:44:39.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f22ec060180 0x7f22ec0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec067380 0x7f22ec143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.411 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec0aac30 con 0x7f22ec0b4cc0 2021-11-15T15:44:39.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec060560 con 0x7f22ec060180 2021-11-15T15:44:39.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec066f20 con 0x7f22ec067380 2021-11-15T15:44:39.412 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2b11700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f22ec0b4cc0 0x7f22ec144590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53048/0 (socket says 172.21.2.135:53048) 2021-11-15T15:44:39.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2b11700 1 -- 172.21.2.135:0/73005352 learned_addr learned my addr 172.21.2.135:0/73005352 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:39.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 --2- 172.21.2.135:0/73005352 >> v2:172.21.2.135:3300/0 conn(0x7f22ec060180 0x7f22ec0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.413 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 -- 172.21.2.135:0/73005352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec067380 msgr2=0x7f22ec143970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-15T15:44:39.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 --2- 172.21.2.135:0/73005352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec067380 0x7f22ec143970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 -- 172.21.2.135:0/73005352 >> v1:172.21.2.135:6789/0 conn(0x7f22ec0b4cc0 legacy=0x7f22ec144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.414 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 -- 172.21.2.135:0/73005352 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0b3430 con 0x7f22ec060180 2021-11-15T15:44:39.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f2310700 1 --2- 172.21.2.135:0/73005352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec060180 0x7f22ec0b47d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f22e8002f70 tx=0x7f22e8006df0).ready entity=mon.1 client_cookie=be02d51a5fe0f941 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f130e700 1 -- 172.21.2.135:0/73005352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e800d570 con 0x7f22ec060180 2021-11-15T15:44:39.415 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f130e700 1 -- 172.21.2.135:0/73005352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8000e90 con 0x7f22ec060180 2021-11-15T15:44:39.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f130e700 1 -- 172.21.2.135:0/73005352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e800d900 con 0x7f22ec060180 2021-11-15T15:44:39.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- 172.21.2.135:0/73005352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec060180 msgr2=0x7f22ec0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.416 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 --2- 172.21.2.135:0/73005352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec060180 0x7f22ec0b47d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f22e8002f70 tx=0x7f22e8006df0).stop 2021-11-15T15:44:39.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- 172.21.2.135:0/73005352 shutdown_connections 2021-11-15T15:44:39.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 --2- 172.21.2.135:0/73005352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec067380 0x7f22ec143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.417 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 --2- 172.21.2.135:0/73005352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec060180 0x7f22ec0b47d0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- 172.21.2.135:0/73005352 >> 172.21.2.135:0/73005352 conn(0x7f22ec05cfb0 msgr2=0x7f22ec05f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- 172.21.2.135:0/73005352 shutdown_connections 2021-11-15T15:44:39.418 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- 172.21.2.135:0/73005352 wait complete. 2021-11-15T15:44:39.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 Processor -- start 2021-11-15T15:44:39.419 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.405+0000 7f22f4574700 1 -- start start 2021-11-15T15:44:39.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec060180 0x7f22ec142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.422 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 0x7f22ec15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22ec0b4cc0 0x7f22ec15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec15abc0 con 0x7f22ec0b4cc0 2021-11-15T15:44:39.423 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec15ae60 con 0x7f22ec067380 2021-11-15T15:44:39.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0abe70 con 0x7f22ec060180 2021-11-15T15:44:39.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 0x7f22ec15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.424 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 0x7f22ec15a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37230/0 (socket says 172.21.2.135:37230) 2021-11-15T15:44:39.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 -- 172.21.2.135:0/1545058466 learned_addr learned my addr 172.21.2.135:0/1545058466 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 -- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec060180 msgr2=0x7f22ec142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.425 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f22ec060180 0x7f22ec142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 -- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22ec0b4cc0 msgr2=0x7f22ec15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f22ec0b4cc0 0x7f22ec15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.432 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e800b180 con 0x7f22ec067380 2021-11-15T15:44:39.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f1b0f700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 0x7f22ec15a0b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f22e0002fb0 tx=0x7f22e0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e0009e00 con 0x7f22ec067380 2021-11-15T15:44:39.433 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0013460 con 0x7f22ec067380 2021-11-15T15:44:39.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec0ad710 con 0x7f22ec067380 2021-11-15T15:44:39.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e00137c0 con 0x7f22ec067380 2021-11-15T15:44:39.434 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec09ead0 con 0x7f22ec067380 2021-11-15T15:44:39.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22ec0ac030 con 0x7f22ec067380 2021-11-15T15:44:39.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f22e000f070 con 0x7f22ec067380 2021-11-15T15:44:39.435 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22cc053660 0x7f22cc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f22e006b230 con 0x7f22ec067380 2021-11-15T15:44:39.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f22cc05a470 0x7f22cc05c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.436 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22cc05ce50 con 0x7f22cc05a470 2021-11-15T15:44:39.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e006d840 con 0x7f22ec067380 2021-11-15T15:44:39.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f2310700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22cc053660 0x7f22cc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.437 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.409+0000 7f22f2b11700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f22cc05a470 0x7f22cc05c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.413+0000 7f22f2310700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22cc053660 0x7f22cc055b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f22e8002f70 tx=0x7f22e8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.413+0000 7f22f2b11700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f22cc05a470 0x7f22cc05c890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.438 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.413+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== osd.5 v2:172.21.2.119:6817/15091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f22cc05ce50 con 0x7f22cc05a470 2021-11-15T15:44:39.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.421+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 --> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22ec0573d0 con 0x7f22cc05a470 2021-11-15T15:44:39.440 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22df7fe700 1 -- 172.21.2.135:0/1545058466 <== osd.5 v2:172.21.2.119:6817/15091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f22ec0573d0 con 0x7f22cc05a470 2021-11-15T15:44:39.441 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:39.441 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:39.441 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:39.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f22cc05a470 msgr2=0x7f22cc05c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6817/15091,v1:172.21.2.119:6820/15091] conn(0x7f22cc05a470 0x7f22cc05c890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.443 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22cc053660 msgr2=0x7f22cc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f22cc053660 0x7f22cc055b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f22e8002f70 tx=0x7f22e8015000).stop 2021-11-15T15:44:39.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 msgr2=0x7f22ec15a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.444 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 --2- 172.21.2.135:0/1545058466 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f22ec067380 0x7f22ec15a0b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f22e0002fb0 tx=0x7f22e0006df0).stop 2021-11-15T15:44:39.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f2b11700 1 -- 172.21.2.135:0/1545058466 reap_dead start 2021-11-15T15:44:39.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 shutdown_connections 2021-11-15T15:44:39.445 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 >> 172.21.2.135:0/1545058466 conn(0x7f22ec05cfb0 msgr2=0x7f22ec0b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 shutdown_connections 2021-11-15T15:44:39.446 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.425+0000 7f22f4574700 1 -- 172.21.2.135:0/1545058466 wait complete. 2021-11-15T15:44:39.447 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-11-15T15:44:39.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 Processor -- start 2021-11-15T15:44:39.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- start start 2021-11-15T15:44:39.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0b1e30 0x7f80dc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f80dc148420 0x7f80dc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f80dc0a7140 0x7f80dc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0a9140 con 0x7f80dc0a7140 2021-11-15T15:44:39.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0b03d0 con 0x7f80dc148420 2021-11-15T15:44:39.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b0670 con 0x7f80dc0b1e30 2021-11-15T15:44:39.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f80dc148420 0x7f80dc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f80dc148420 0x7f80dc0b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37244/0 (socket says 172.21.2.135:37244) 2021-11-15T15:44:39.507 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 -- 172.21.2.135:0/3496425863 learned_addr learned my addr 172.21.2.135:0/3496425863 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 -- 172.21.2.135:0/3496425863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0b1e30 msgr2=0x7f80dc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 --2- 172.21.2.135:0/3496425863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0b1e30 0x7f80dc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.508 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 -- 172.21.2.135:0/3496425863 >> v2:172.21.2.119:3300/0 conn(0x7f80dc0a7140 msgr2=0x7f80dc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 --2- 172.21.2.135:0/3496425863 >> v2:172.21.2.119:3300/0 conn(0x7f80dc0a7140 0x7f80dc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 -- 172.21.2.135:0/3496425863 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0b0910 con 0x7f80dc148420 2021-11-15T15:44:39.509 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d9d9b700 1 --2- 172.21.2.135:0/3496425863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc0b2210 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f80cc002f70 tx=0x7f80cc006eb0).ready entity=mon.1 client_cookie=e52d366d61ef3fb8 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d959a700 1 -- 172.21.2.135:0/3496425863 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc00d570 con 0x7f80dc148420 2021-11-15T15:44:39.510 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d959a700 1 -- 172.21.2.135:0/3496425863 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc000e90 con 0x7f80dc148420 2021-11-15T15:44:39.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80d959a700 1 -- 172.21.2.135:0/3496425863 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc00d900 con 0x7f80dc148420 2021-11-15T15:44:39.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- 172.21.2.135:0/3496425863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 msgr2=0x7f80dc0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.511 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3496425863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc0b2210 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f80cc002f70 tx=0x7f80cc006eb0).stop 2021-11-15T15:44:39.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- 172.21.2.135:0/3496425863 shutdown_connections 2021-11-15T15:44:39.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3496425863 >> v2:172.21.2.119:3300/0 conn(0x7f80dc0a7140 0x7f80dc1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.512 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3496425863 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc0b2210 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3496425863 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0b1e30 0x7f80dc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- 172.21.2.135:0/3496425863 >> 172.21.2.135:0/3496425863 conn(0x7f80dc05f730 msgr2=0x7f80dc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.513 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- 172.21.2.135:0/3496425863 shutdown_connections 2021-11-15T15:44:39.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- 172.21.2.135:0/3496425863 wait complete. 2021-11-15T15:44:39.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 Processor -- start 2021-11-15T15:44:39.514 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- start start 2021-11-15T15:44:39.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0a7140 0x7f80dc140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80dc0b1e30 0x7f80dc149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.515 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc157a50 con 0x7f80dc0b1e30 2021-11-15T15:44:39.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc156dd0 con 0x7f80dc148420 2021-11-15T15:44:39.516 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80e0d18700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc157070 con 0x7f80dc0a7140 2021-11-15T15:44:39.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37248/0 (socket says 172.21.2.135:37248) 2021-11-15T15:44:39.517 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 -- 172.21.2.135:0/3025981149 learned_addr learned my addr 172.21.2.135:0/3025981149 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 -- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0a7140 msgr2=0x7f80dc140b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:39.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0a7140 0x7f80dc140b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.518 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 -- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80dc0b1e30 msgr2=0x7f80dc149cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-15T15:44:39.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80dc0b1e30 0x7f80dc149cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.519 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 -- 172.21.2.135:0/3025981149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc00b1e0 con 0x7f80dc148420 2021-11-15T15:44:39.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.497+0000 7f80dad9d700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f80dc157b90 tx=0x7f80d4009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d400d580 con 0x7f80dc148420 2021-11-15T15:44:39.520 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400d6e0 con 0x7f80dc148420 2021-11-15T15:44:39.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc157310 con 0x7f80dc148420 2021-11-15T15:44:39.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80d400da40 con 0x7f80dc148420 2021-11-15T15:44:39.521 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc156ac0 con 0x7f80dc148420 2021-11-15T15:44:39.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc1577b0 con 0x7f80dc148420 2021-11-15T15:44:39.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f80d400dba0 con 0x7f80dc148420 2021-11-15T15:44:39.522 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 0x7f80c0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f80d406bc70 con 0x7f80dc148420 2021-11-15T15:44:39.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80da59c700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 0x7f80c0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.523 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80da59c700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 0x7f80c0055b00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f80c4002f70 tx=0x7f80c4006980).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.524 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.501+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f80dc1577b0 con 0x7f80dc148420 2021-11-15T15:44:39.590 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.585+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f80dc1577b0 con 0x7f80c0053640 2021-11-15T15:44:39.591 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80d37fe700 1 -- 172.21.2.135:0/3025981149 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80dc1577b0 con 0x7f80c0053640 2021-11-15T15:44:39.593 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 msgr2=0x7f80c0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 0x7f80c0055b00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f80c4002f70 tx=0x7f80c4006980).stop 2021-11-15T15:44:39.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 msgr2=0x7f80dc14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.594 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f80dc157b90 tx=0x7f80d4009220).stop 2021-11-15T15:44:39.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 shutdown_connections 2021-11-15T15:44:39.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f80c0053640 0x7f80c0055b00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.595 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f80dc148420 0x7f80dc14a1b0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f80dc0b1e30 0x7f80dc149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 --2- 172.21.2.135:0/3025981149 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f80dc0a7140 0x7f80dc140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.596 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 >> 172.21.2.135:0/3025981149 conn(0x7f80dc05f730 msgr2=0x7f80dc143f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 shutdown_connections 2021-11-15T15:44:39.597 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.589+0000 7f80e0d18700 1 -- 172.21.2.135:0/3025981149 wait complete. 2021-11-15T15:44:39.598 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 5 to deep-scrub 2021-11-15T15:44:39.599 INFO:tasks.ceph:Scrubbing osd.6 2021-11-15T15:44:39.600 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:39.653 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 Processor -- start 2021-11-15T15:44:39.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 -- start start 2021-11-15T15:44:39.654 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbed4148420 0x7fbed40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 0x7fbed41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed40b03d0 con 0x7fbed40b1e30 2021-11-15T15:44:39.655 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed40a9140 con 0x7fbed4148420 2021-11-15T15:44:39.656 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed9a27700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40b0670 con 0x7fbed40a7140 2021-11-15T15:44:39.657 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed27fc700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fbed4148420 0x7fbed40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed37fe700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 0x7fbed41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.658 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.649+0000 7fbed2ffd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7fbed40b1e30 0x7fbed40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:34258/0 (socket says 172.21.2.135:34258) 2021-11-15T15:44:39.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed2ffd700 1 -- 172.21.2.135:0/4018122343 learned_addr learned my addr 172.21.2.135:0/4018122343 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:39.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed1ffb700 1 -- 172.21.2.135:0/4018122343 <== mon.0 v1:172.21.2.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316377723 0 0) 0x7fbed40b03d0 con 0x7fbed40b1e30 2021-11-15T15:44:39.659 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed1ffb700 1 -- 172.21.2.135:0/4018122343 --> v1:172.21.2.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb4003260 con 0x7fbed40b1e30 2021-11-15T15:44:39.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed27fc700 1 -- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 msgr2=0x7fbed41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed27fc700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 0x7fbed41447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.660 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed27fc700 1 -- 172.21.2.135:0/4018122343 >> v1:172.21.2.119:6789/0 conn(0x7fbed40b1e30 legacy=0x7fbed40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed27fc700 1 -- 172.21.2.135:0/4018122343 --> v2:172.21.2.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40b0910 con 0x7fbed4148420 2021-11-15T15:44:39.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed37fe700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 0x7fbed41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-15T15:44:39.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed27fc700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed40b1050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbed41477b0 tx=0x7fbebc006df0).ready entity=mon.0 client_cookie=4d8318f5fdac6f37 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.661 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed1ffb700 1 -- 172.21.2.135:0/4018122343 <== mon.0 v2:172.21.2.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbebc00d570 con 0x7fbed4148420 2021-11-15T15:44:39.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed1ffb700 1 -- 172.21.2.135:0/4018122343 <== mon.0 v2:172.21.2.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc000e90 con 0x7fbed4148420 2021-11-15T15:44:39.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed1ffb700 1 -- 172.21.2.135:0/4018122343 <== mon.0 v2:172.21.2.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbebc00d8c0 con 0x7fbed4148420 2021-11-15T15:44:39.662 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 msgr2=0x7fbed40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed40b1050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbed41477b0 tx=0x7fbebc006df0).stop 2021-11-15T15:44:39.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- 172.21.2.135:0/4018122343 shutdown_connections 2021-11-15T15:44:39.663 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40a7140 0x7fbed41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 --2- 172.21.2.135:0/4018122343 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed40b1050 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- 172.21.2.135:0/4018122343 >> 172.21.2.135:0/4018122343 conn(0x7fbed405f730 msgr2=0x7fbed405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.664 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- 172.21.2.135:0/4018122343 shutdown_connections 2021-11-15T15:44:39.665 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- 172.21.2.135:0/4018122343 wait complete. 2021-11-15T15:44:39.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 Processor -- start 2021-11-15T15:44:39.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.653+0000 7fbed9a27700 1 -- start start 2021-11-15T15:44:39.668 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 0x7fbed414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40b1e30 0x7fbed4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed414a210 con 0x7fbed4148420 2021-11-15T15:44:39.669 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed414a9c0 con 0x7fbed40a7140 2021-11-15T15:44:39.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed414a600 con 0x7fbed40b1e30 2021-11-15T15:44:39.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 0x7fbed414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.670 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 0x7fbed414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37260/0 (socket says 172.21.2.135:37260) 2021-11-15T15:44:39.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 -- 172.21.2.135:0/622594749 learned_addr learned my addr 172.21.2.135:0/622594749 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed27fc700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40b1e30 0x7fbed4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.671 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 -- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40b1e30 msgr2=0x7fbed4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed37fe700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40b1e30 0x7fbed4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.672 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 -- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 msgr2=0x7fbed4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009470 con 0x7fbed40a7140 2021-11-15T15:44:39.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed27fc700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fbed40b1e30 0x7fbed4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:39.673 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed37fe700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fbed4148420 0x7fbed4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-15T15:44:39.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed2ffd700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 0x7fbed414e2e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7fbec4001110 tx=0x7fbec4007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec40072e0 con 0x7fbed40a7140 2021-11-15T15:44:39.674 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4007440 con 0x7fbed40a7140 2021-11-15T15:44:39.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc00b180 con 0x7fbed40a7140 2021-11-15T15:44:39.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed414ae90 con 0x7fbed40a7140 2021-11-15T15:44:39.675 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec4005800 con 0x7fbed40a7140 2021-11-15T15:44:39.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbed40aa070 con 0x7fbed40a7140 2021-11-15T15:44:39.676 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbec401a060 con 0x7fbed40a7140 2021-11-15T15:44:39.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeb8053690 0x7fbeb8055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fbec406b690 con 0x7fbed40a7140 2021-11-15T15:44:39.677 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fbeb805a4a0 0x7fbeb805c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbeb805ce80 con 0x7fbeb805a4a0 2021-11-15T15:44:39.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec406b9f0 con 0x7fbed40a7140 2021-11-15T15:44:39.678 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed37fe700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fbeb805a4a0 0x7fbeb805c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.657+0000 7fbed27fc700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeb8053690 0x7fbeb8055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.661+0000 7fbed37fe700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fbeb805a4a0 0x7fbeb805c8c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.679 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.661+0000 7fbed27fc700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeb8053690 0x7fbeb8055b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fbebc015000 tx=0x7fbebc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.661+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== osd.6 v2:172.21.2.119:6802/15092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fbeb805ce80 con 0x7fbeb805a4a0 2021-11-15T15:44:39.680 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.669+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 --> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbed40573d0 con 0x7fbeb805a4a0 2021-11-15T15:44:39.681 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbecbfff700 1 -- 172.21.2.135:0/622594749 <== osd.6 v2:172.21.2.119:6802/15092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbed40573d0 con 0x7fbeb805a4a0 2021-11-15T15:44:39.681 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:39.682 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:39.682 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:39.683 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fbeb805a4a0 msgr2=0x7fbeb805c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6802/15092,v1:172.21.2.119:6803/15092] conn(0x7fbeb805a4a0 0x7fbeb805c8c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeb8053690 msgr2=0x7fbeb8055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.684 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fbeb8053690 0x7fbeb8055b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fbebc015000 tx=0x7fbebc014000).stop 2021-11-15T15:44:39.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 msgr2=0x7fbed414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 --2- 172.21.2.135:0/622594749 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fbed40a7140 0x7fbed414e2e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7fbec4001110 tx=0x7fbec4007ad0).stop 2021-11-15T15:44:39.685 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed37fe700 1 -- 172.21.2.135:0/622594749 reap_dead start 2021-11-15T15:44:39.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 shutdown_connections 2021-11-15T15:44:39.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 >> 172.21.2.135:0/622594749 conn(0x7fbed405f730 msgr2=0x7fbed4144cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.686 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 shutdown_connections 2021-11-15T15:44:39.687 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.673+0000 7fbed9a27700 1 -- 172.21.2.135:0/622594749 wait complete. 2021-11-15T15:44:39.687 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-11-15T15:44:39.743 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 Processor -- start 2021-11-15T15:44:39.744 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 -- start start 2021-11-15T15:44:39.745 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 0x7f6a240acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a240b6d60 con 0x7f6a24060990 2021-11-15T15:44:39.746 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24061260 con 0x7f6a240b6980 2021-11-15T15:44:39.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a29a76700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24061500 con 0x7f6a240aa650 2021-11-15T15:44:39.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.747 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a237fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 0x7f6a240acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3301/0 says I am v2:172.21.2.135:47046/0 (socket says 172.21.2.135:47046) 2021-11-15T15:44:39.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a22ffd700 1 --1- >> v1:172.21.2.119:6789/0 conn(0x7f6a24060990 0x7f6a240a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.119:6789/0 says I am v1:172.21.2.135:34278/0 (socket says 172.21.2.135:34278) 2021-11-15T15:44:39.748 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a237fe700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 0x7f6a240acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.119:3300/0 says I am v2:172.21.2.135:59316/0 (socket says 172.21.2.135:59316) 2021-11-15T15:44:39.749 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 -- 172.21.2.135:0/967428208 learned_addr learned my addr 172.21.2.135:0/967428208 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.752 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 -- 172.21.2.135:0/967428208 >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 msgr2=0x7f6a240acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 --2- 172.21.2.135:0/967428208 >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 0x7f6a240acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 -- 172.21.2.135:0/967428208 >> v1:172.21.2.119:6789/0 conn(0x7f6a24060990 legacy=0x7f6a240a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.753 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 -- 172.21.2.135:0/967428208 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240617a0 con 0x7f6a240aa650 2021-11-15T15:44:39.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.741+0000 7f6a23fff700 1 --2- 172.21.2.135:0/967428208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6a1c0032f0 tx=0x7f6a1c009290).ready entity=mon.2 client_cookie=ef4ee93f8e2eb276 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a227fc700 1 -- 172.21.2.135:0/967428208 <== mon.2 v2:172.21.2.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c00b8a0 con 0x7f6a240aa650 2021-11-15T15:44:39.754 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a227fc700 1 -- 172.21.2.135:0/967428208 <== mon.2 v2:172.21.2.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00ba00 con 0x7f6a240aa650 2021-11-15T15:44:39.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a227fc700 1 -- 172.21.2.135:0/967428208 <== mon.2 v2:172.21.2.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c00bb70 con 0x7f6a240aa650 2021-11-15T15:44:39.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/967428208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 msgr2=0x7f6a2405c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.755 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- 172.21.2.135:0/967428208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6a1c0032f0 tx=0x7f6a1c009290).stop 2021-11-15T15:44:39.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/967428208 shutdown_connections 2021-11-15T15:44:39.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- 172.21.2.135:0/967428208 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a2405c510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.756 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- 172.21.2.135:0/967428208 >> v2:172.21.2.119:3300/0 conn(0x7f6a240b6980 0x7f6a240acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/967428208 >> 172.21.2.135:0/967428208 conn(0x7f6a240b3500 msgr2=0x7f6a240b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/967428208 shutdown_connections 2021-11-15T15:44:39.757 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/967428208 wait complete. 2021-11-15T15:44:39.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 Processor -- start 2021-11-15T15:44:39.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- start start 2021-11-15T15:44:39.758 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a24060990 0x7f6a24156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a240b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.759 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2413a460 con 0x7f6a24060990 2021-11-15T15:44:39.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24157450 con 0x7f6a240b6980 2021-11-15T15:44:39.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241576f0 con 0x7f6a240aa650 2021-11-15T15:44:39.760 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37278/0 (socket says 172.21.2.135:37278) 2021-11-15T15:44:39.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 -- 172.21.2.135:0/1062456965 learned_addr learned my addr 172.21.2.135:0/1062456965 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.761 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 -- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 msgr2=0x7f6a240b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a240b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 -- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a24060990 msgr2=0x7f6a24156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.762 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a24060990 0x7f6a24156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 -- 172.21.2.135:0/1062456965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009530 con 0x7f6a240b6980 2021-11-15T15:44:39.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a23fff700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f6a1c0032f0 tx=0x7f6a1c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.763 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c00b8a0 con 0x7f6a240b6980 2021-11-15T15:44:39.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c021630 con 0x7f6a240b6980 2021-11-15T15:44:39.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2413e0b0 con 0x7f6a240b6980 2021-11-15T15:44:39.764 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c021990 con 0x7f6a240b6980 2021-11-15T15:44:39.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.745+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240ac880 con 0x7f6a240b6980 2021-11-15T15:44:39.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24061a40 con 0x7f6a240b6980 2021-11-15T15:44:39.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a1c00f070 con 0x7f6a240b6980 2021-11-15T15:44:39.765 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a20ff9700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 0x7f6a04055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6a1c06cf00 con 0x7f6a240b6980 2021-11-15T15:44:39.766 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a237fe700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 0x7f6a04055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a237fe700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 0x7f6a04055ad0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f6a1400c000 tx=0x7f6a14006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.767 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.749+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a1c0441e0 con 0x7f6a240b6980 2021-11-15T15:44:39.837 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.833+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2413e550 con 0x7f6a04053610 2021-11-15T15:44:39.839 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.833+0000 7f6a20ff9700 1 -- 172.21.2.135:0/1062456965 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a14000e90 con 0x7f6a04053610 2021-11-15T15:44:39.840 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 msgr2=0x7f6a04055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 0x7f6a04055ad0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f6a1400c000 tx=0x7f6a14006df0).stop 2021-11-15T15:44:39.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 msgr2=0x7f6a240b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.841 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f6a1c0032f0 tx=0x7f6a1c016000).stop 2021-11-15T15:44:39.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 shutdown_connections 2021-11-15T15:44:39.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f6a04053610 0x7f6a04055ad0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.842 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f6a240b6980 0x7f6a240b0ce0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f6a240aa650 0x7f6a240b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 --2- 172.21.2.135:0/1062456965 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f6a24060990 0x7f6a24156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 >> 172.21.2.135:0/1062456965 conn(0x7f6a240b3500 msgr2=0x7f6a2413ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.843 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 shutdown_connections 2021-11-15T15:44:39.844 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.837+0000 7f6a29a76700 1 -- 172.21.2.135:0/1062456965 wait complete. 2021-11-15T15:44:39.845 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 6 to deep-scrub 2021-11-15T15:44:39.846 INFO:tasks.ceph:Scrubbing osd.7 2021-11-15T15:44:39.847 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-11-15T15:44:39.901 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 Processor -- start 2021-11-15T15:44:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- start start 2021-11-15T15:44:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f761c060990 0x7f761c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.902 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c0aa650 0x7f761c13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761c0b6d60 con 0x7f761c0b6980 2021-11-15T15:44:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761c061260 con 0x7f761c060990 2021-11-15T15:44:39.903 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c061500 con 0x7f761c0aa650 2021-11-15T15:44:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f761c060990 0x7f761c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.907 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f761c060990 0x7f761c0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37284/0 (socket says 172.21.2.135:37284) 2021-11-15T15:44:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 -- 172.21.2.135:0/3917655651 learned_addr learned my addr 172.21.2.135:0/3917655651 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f762168c700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f761c0b6980 0x7f761c0a9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53102/0 (socket says 172.21.2.135:53102) 2021-11-15T15:44:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 -- 172.21.2.135:0/3917655651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c0aa650 msgr2=0x7f761c13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.908 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 --2- 172.21.2.135:0/3917655651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c0aa650 0x7f761c13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 -- 172.21.2.135:0/3917655651 >> v1:172.21.2.135:6789/0 conn(0x7f761c0b6980 legacy=0x7f761c0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 -- 172.21.2.135:0/3917655651 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c0617a0 con 0x7f761c060990 2021-11-15T15:44:39.909 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f7620e8b700 1 --2- 172.21.2.135:0/3917655651 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c060990 0x7f761c0acdd0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f7618002f70 tx=0x7f7618006eb0).ready entity=mon.1 client_cookie=8ee94160abe3a587 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f760ffff700 1 -- 172.21.2.135:0/3917655651 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761800d5c0 con 0x7f761c060990 2021-11-15T15:44:39.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f760ffff700 1 -- 172.21.2.135:0/3917655651 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618000e90 con 0x7f761c060990 2021-11-15T15:44:39.910 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f760ffff700 1 -- 172.21.2.135:0/3917655651 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761800d950 con 0x7f761c060990 2021-11-15T15:44:39.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- 172.21.2.135:0/3917655651 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c060990 msgr2=0x7f761c0acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 --2- 172.21.2.135:0/3917655651 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c060990 0x7f761c0acdd0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f7618002f70 tx=0x7f7618006eb0).stop 2021-11-15T15:44:39.911 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- 172.21.2.135:0/3917655651 shutdown_connections 2021-11-15T15:44:39.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 --2- 172.21.2.135:0/3917655651 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c060990 0x7f761c0acdd0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.912 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 --2- 172.21.2.135:0/3917655651 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c0aa650 0x7f761c13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- 172.21.2.135:0/3917655651 >> 172.21.2.135:0/3917655651 conn(0x7f761c0b3500 msgr2=0x7f761c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- 172.21.2.135:0/3917655651 shutdown_connections 2021-11-15T15:44:39.913 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.897+0000 7f76238f0700 1 -- 172.21.2.135:0/3917655651 wait complete. 2021-11-15T15:44:39.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 Processor -- start 2021-11-15T15:44:39.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- start start 2021-11-15T15:44:39.914 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c060990 0x7f761c1458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 0x7f761c0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f761c0b6980 0x7f761c1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.915 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c14e240 con 0x7f761c0b6980 2021-11-15T15:44:39.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c146500 con 0x7f761c0aa650 2021-11-15T15:44:39.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c14e430 con 0x7f761c060990 2021-11-15T15:44:39.916 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 0x7f761c0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 0x7f761c0b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37288/0 (socket says 172.21.2.135:37288) 2021-11-15T15:44:39.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 -- 172.21.2.135:0/191056939 learned_addr learned my addr 172.21.2.135:0/191056939 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:39.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 -- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c060990 msgr2=0x7f761c1458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.917 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f761c060990 0x7f761c1458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 -- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f761c0b6980 msgr2=0x7f761c1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f761c0b6980 0x7f761c1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.918 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761800b1e0 con 0x7f761c0aa650 2021-11-15T15:44:39.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7620e8b700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 0x7f761c0b54b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f7618002f70 tx=0x7f7618015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7618006be0 con 0x7f761c0aa650 2021-11-15T15:44:39.919 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618011ce0 con 0x7f761c0aa650 2021-11-15T15:44:39.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c14e6d0 con 0x7f761c0aa650 2021-11-15T15:44:39.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c146060 con 0x7f761c0aa650 2021-11-15T15:44:39.920 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761801e650 con 0x7f761c0aa650 2021-11-15T15:44:39.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f761c146700 con 0x7f761c0aa650 2021-11-15T15:44:39.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7618025030 con 0x7f761c0aa650 2021-11-15T15:44:39.921 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75fc053570 0x7f75fc055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f761806cb70 con 0x7f761c0aa650 2021-11-15T15:44:39.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f75fc05a3a0 0x7f75fc05c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.922 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75fc05ce20 con 0x7f75fc05a3a0 2021-11-15T15:44:39.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=167) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7618043e50 con 0x7f761c0aa650 2021-11-15T15:44:39.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f762168c700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75fc053570 0x7f75fc055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.923 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.901+0000 7f7621e8d700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f75fc05a3a0 0x7f75fc05c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.924 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.905+0000 7f762168c700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75fc053570 0x7f75fc055a30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f761c060380 tx=0x7f7610007830).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.905+0000 7f7621e8d700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f75fc05a3a0 0x7f75fc05c7c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.905+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== osd.7 v2:172.21.2.119:6819/15101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f75fc05ce20 con 0x7f75fc05a3a0 2021-11-15T15:44:39.925 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.913+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 --> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f761c14f1d0 con 0x7f75fc05a3a0 2021-11-15T15:44:39.926 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f760e7fc700 1 -- 172.21.2.135:0/191056939 <== osd.7 v2:172.21.2.119:6819/15101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f761c14f1d0 con 0x7f75fc05a3a0 2021-11-15T15:44:39.926 INFO:teuthology.orchestra.run.gibba035.stdout:{ 2021-11-15T15:44:39.927 INFO:teuthology.orchestra.run.gibba035.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-15T15:44:39.927 INFO:teuthology.orchestra.run.gibba035.stdout:} 2021-11-15T15:44:39.928 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f75fc05a3a0 msgr2=0x7f75fc05c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6819/15101,v1:172.21.2.119:6821/15101] conn(0x7f75fc05a3a0 0x7f75fc05c7c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:39.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75fc053570 msgr2=0x7f75fc055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.929 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f75fc053570 0x7f75fc055a30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f761c060380 tx=0x7f7610007830).stop 2021-11-15T15:44:39.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 msgr2=0x7f761c0b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 --2- 172.21.2.135:0/191056939 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f761c0aa650 0x7f761c0b54b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f7618002f70 tx=0x7f7618015000).stop 2021-11-15T15:44:39.930 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f7621e8d700 1 -- 172.21.2.135:0/191056939 reap_dead start 2021-11-15T15:44:39.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 shutdown_connections 2021-11-15T15:44:39.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 >> 172.21.2.135:0/191056939 conn(0x7f761c0b3500 msgr2=0x7f761c0af320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 shutdown_connections 2021-11-15T15:44:39.931 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.917+0000 7f76238f0700 1 -- 172.21.2.135:0/191056939 wait complete. 2021-11-15T15:44:39.932 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-11-15T15:44:39.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.977+0000 7f60d3cbc700 1 Processor -- start 2021-11-15T15:44:39.983 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- start start 2021-11-15T15:44:39.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 0x7f60cc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.986 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0b03d0 con 0x7f60cc148420 2021-11-15T15:44:39.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0b0670 con 0x7f60cc0b1e30 2021-11-15T15:44:39.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0a9140 con 0x7f60cc0b1050 2021-11-15T15:44:39.987 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f60cc0b1e30 0x7f60cc0b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53116/0 (socket says 172.21.2.135:53116) 2021-11-15T15:44:39.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 -- 172.21.2.135:0/3284550823 learned_addr learned my addr 172.21.2.135:0/3284550823 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:44:39.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653014791 0 0) 0x7f60cc0b0670 con 0x7f60cc0b1e30 2021-11-15T15:44:39.988 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b0003260 con 0x7f60cc0b1e30 2021-11-15T15:44:39.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2869761247 0 0) 0x7f60b0003260 con 0x7f60cc0b1e30 2021-11-15T15:44:39.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 msgr2=0x7f60cc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.989 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 0x7f60cc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 >> v1:172.21.2.119:6789/0 conn(0x7f60cc148420 legacy=0x7f60cc0a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0b0910 con 0x7f60cc0b1e30 2021-11-15T15:44:39.990 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7f60c8001660 con 0x7f60cc0b1e30 2021-11-15T15:44:39.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 >> v1:172.21.2.135:6789/0 conn(0x7f60cc0b1e30 legacy=0x7f60cc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60b0003800 0x7f60b0003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.991 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60b0004500 0x7f60b0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 0x7f60b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:39.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0005260 con 0x7f60b0004500 2021-11-15T15:44:39.992 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00053d0 con 0x7f60b0003800 2021-11-15T15:44:39.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b000bcc0 con 0x7f60cc0b1050 2021-11-15T15:44:39.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60b0003800 0x7f60b0003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:39.993 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 -- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 msgr2=0x7f60b000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60cc0b1050 0x7f60b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 -- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60b0004500 msgr2=0x7f60b0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:39.994 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60b0004500 0x7f60b0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:39.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 -- 172.21.2.135:0/3284550823 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0003260 con 0x7f60b0003800 2021-11-15T15:44:39.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d1a58700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60b0003800 0x7f60b0003c00 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f60cc0b31f0 tx=0x7f60cc0b0560).ready entity=mon.1 client_cookie=36ad1682608e049b server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:39.995 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c80070d0 con 0x7f60b0003800 2021-11-15T15:44:39.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8007230 con 0x7f60b0003800 2021-11-15T15:44:39.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d0a56700 1 -- 172.21.2.135:0/3284550823 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c800c8f0 con 0x7f60b0003800 2021-11-15T15:44:39.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- 172.21.2.135:0/3284550823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60b0003800 msgr2=0x7f60b0003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:39.996 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/3284550823 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60b0003800 0x7f60b0003c00 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f60cc0b31f0 tx=0x7f60cc0b0560).stop 2021-11-15T15:44:39.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d2259700 1 -- 172.21.2.135:0/3284550823 reap_dead start 2021-11-15T15:44:39.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- 172.21.2.135:0/3284550823 shutdown_connections 2021-11-15T15:44:39.997 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- 172.21.2.135:0/3284550823 >> 172.21.2.135:0/3284550823 conn(0x7f60cc05f730 msgr2=0x7f60cc05fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:39.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- 172.21.2.135:0/3284550823 shutdown_connections 2021-11-15T15:44:39.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- 172.21.2.135:0/3284550823 wait complete. 2021-11-15T15:44:39.998 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 Processor -- start 2021-11-15T15:44:39.999 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- start start 2021-11-15T15:44:40.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60b0003800 0x7f60cc062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60cc0aad50 0x7f60cc1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.001 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc1545b0 con 0x7f60cc0aad50 2021-11-15T15:44:40.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0ab260 con 0x7f60cc156ea0 2021-11-15T15:44:40.002 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d3cbc700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0ac590 con 0x7f60b0003800 2021-11-15T15:44:40.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d2259700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:40.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d2259700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37310/0 (socket says 172.21.2.135:37310) 2021-11-15T15:44:40.003 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.981+0000 7f60d2259700 1 -- 172.21.2.135:0/1169942052 learned_addr learned my addr 172.21.2.135:0/1169942052 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:40.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 -- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60b0003800 msgr2=0x7f60cc062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60b0003800 0x7f60cc062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.004 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 -- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60cc0aad50 msgr2=0x7f60cc1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60cc0aad50 0x7f60cc1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 -- 172.21.2.135:0/1169942052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0abd80 con 0x7f60cc156ea0 2021-11-15T15:44:40.005 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d2259700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f60c8001370 tx=0x7f60c400a060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:40.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c400ce40 con 0x7f60cc156ea0 2021-11-15T15:44:40.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4005c30 con 0x7f60cc156ea0 2021-11-15T15:44:40.006 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0ac830 con 0x7f60cc156ea0 2021-11-15T15:44:40.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c4007070 con 0x7f60cc156ea0 2021-11-15T15:44:40.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc159ea0 con 0x7f60cc156ea0 2021-11-15T15:44:40.007 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0573d0 con 0x7f60cc156ea0 2021-11-15T15:44:40.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60c401b060 con 0x7f60cc156ea0 2021-11-15T15:44:40.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 0x7f60b40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.008 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f60c406ae30 con 0x7f60cc156ea0 2021-11-15T15:44:40.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d1a58700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 0x7f60b40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:40.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60d1a58700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 0x7f60b40559b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f60cc0b31f0 tx=0x7f60c8013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:40.009 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:39.985+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60c4042110 con 0x7f60cc156ea0 2021-11-15T15:44:40.073 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.069+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f60cc0aaaf0 con 0x7f60b40534f0 2021-11-15T15:44:40.075 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.069+0000 7f60beffd700 1 -- 172.21.2.135:0/1169942052 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60c80073a0 con 0x7f60b40534f0 2021-11-15T15:44:40.076 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 msgr2=0x7f60b40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 0x7f60b40559b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f60cc0b31f0 tx=0x7f60c8013000).stop 2021-11-15T15:44:40.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 msgr2=0x7f60cc157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.077 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f60c8001370 tx=0x7f60c400a060).stop 2021-11-15T15:44:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 shutdown_connections 2021-11-15T15:44:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f60b40534f0 0x7f60b40559b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:40.078 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f60cc156ea0 0x7f60cc157320 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f60cc0aad50 0x7f60cc1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.079 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 --2- 172.21.2.135:0/1169942052 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f60b0003800 0x7f60cc062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 >> 172.21.2.135:0/1169942052 conn(0x7f60cc05f730 msgr2=0x7f60cc0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 shutdown_connections 2021-11-15T15:44:40.080 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.073+0000 7f60d3cbc700 1 -- 172.21.2.135:0/1169942052 wait complete. 2021-11-15T15:44:40.081 INFO:teuthology.orchestra.run.gibba035.stderr:instructed osd(s) 7 to deep-scrub 2021-11-15T15:44:40.082 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T15:44:40.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 Processor -- start 2021-11-15T15:44:40.134 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 -- start start 2021-11-15T15:44:40.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb57c0b6980 0x7fb57c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.135 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c0aa650 0x7fb57c13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 -- --> v1:172.21.2.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c0b6d60 con 0x7fb57c060990 2021-11-15T15:44:40.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c061260 con 0x7fb57c0b6980 2021-11-15T15:44:40.136 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb583314700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c061500 con 0x7fb57c0aa650 2021-11-15T15:44:40.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb57c0b6980 0x7fb57c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:40.140 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7fb57c0b6980 0x7fb57c0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37316/0 (socket says 172.21.2.135:37316) 2021-11-15T15:44:40.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 -- 172.21.2.135:0/3624021074 learned_addr learned my addr 172.21.2.135:0/3624021074 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:40.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 -- 172.21.2.135:0/3624021074 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c0aa650 msgr2=0x7fb57c13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:40.141 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 --2- 172.21.2.135:0/3624021074 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c0aa650 0x7fb57c13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 -- 172.21.2.135:0/3624021074 >> v1:172.21.2.119:6789/0 conn(0x7fb57c060990 legacy=0x7fb57c0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:44:40.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 -- 172.21.2.135:0/3624021074 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0617a0 con 0x7fb57c0b6980 2021-11-15T15:44:40.142 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb5810b0700 1 --2- 172.21.2.135:0/3624021074 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0b6980 0x7fb57c0acdd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fb57c060380 tx=0x7fb578006eb0).ready entity=mon.1 client_cookie=597a2e8ee32604b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:40.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.129+0000 7fb56ffff700 1 -- 172.21.2.135:0/3624021074 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb578010810 con 0x7fb57c0b6980 2021-11-15T15:44:40.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56ffff700 1 -- 172.21.2.135:0/3624021074 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578000e90 con 0x7fb57c0b6980 2021-11-15T15:44:40.143 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56ffff700 1 -- 172.21.2.135:0/3624021074 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb578010ba0 con 0x7fb57c0b6980 2021-11-15T15:44:40.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/3624021074 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0b6980 msgr2=0x7fb57c0acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- 172.21.2.135:0/3624021074 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0b6980 0x7fb57c0acdd0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fb57c060380 tx=0x7fb578006eb0).stop 2021-11-15T15:44:40.144 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/3624021074 shutdown_connections 2021-11-15T15:44:40.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- 172.21.2.135:0/3624021074 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c0aa650 0x7fb57c13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- 172.21.2.135:0/3624021074 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0b6980 0x7fb57c0acdd0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:40.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/3624021074 >> 172.21.2.135:0/3624021074 conn(0x7fb57c0b3500 msgr2=0x7fb57c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:40.145 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/3624021074 shutdown_connections 2021-11-15T15:44:40.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/3624021074 wait complete. 2021-11-15T15:44:40.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 Processor -- start 2021-11-15T15:44:40.146 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- start start 2021-11-15T15:44:40.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c060990 0x7fb57c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.147 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb57c0b6980 0x7fb57c13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1540a0 con 0x7fb57c0b6980 2021-11-15T15:44:40.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c154340 con 0x7fb57c0aa650 2021-11-15T15:44:40.148 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1545e0 con 0x7fb57c060990 2021-11-15T15:44:40.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:40.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37326/0 (socket says 172.21.2.135:37326) 2021-11-15T15:44:40.149 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 -- 172.21.2.135:0/2564302683 learned_addr learned my addr 172.21.2.135:0/2564302683 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:44:40.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 -- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c060990 msgr2=0x7fb57c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c060990 0x7fb57c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.150 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 -- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb57c0b6980 msgr2=0x7fb57c13f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb57c0b6980 0x7fb57c13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 -- 172.21.2.135:0/2564302683 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57800c2f0 con 0x7fb57c0aa650 2021-11-15T15:44:40.151 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb5808af700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fb570002f90 tx=0x7fb570006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:40.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb570013460 con 0x7fb57c0aa650 2021-11-15T15:44:40.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5700135c0 con 0x7fb57c0aa650 2021-11-15T15:44:40.152 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c154880 con 0x7fb57c0aa650 2021-11-15T15:44:40.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb570013920 con 0x7fb57c0aa650 2021-11-15T15:44:40.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c140230 con 0x7fb57c0aa650 2021-11-15T15:44:40.153 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c061a40 con 0x7fb57c0aa650 2021-11-15T15:44:40.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb57001a060 con 0x7fb57c0aa650 2021-11-15T15:44:40.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 0x7fb55c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:44:40.154 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.133+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb57006b140 con 0x7fb57c0aa650 2021-11-15T15:44:40.155 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.137+0000 7fb5810b0700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 0x7fb55c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:44:40.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.137+0000 7fb5810b0700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 0x7fb55c055ac0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fb57c060380 tx=0x7fb578017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:44:40.156 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.137+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb570042420 con 0x7fb57c0aa650 2021-11-15T15:44:40.221 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.217+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb57c0573d0 con 0x7fb55c053600 2021-11-15T15:44:40.230 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.225+0000 7fb56e7fc700 1 -- 172.21.2.135:0/2564302683 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66288 (secure 0 0 0) 0x7fb57c0573d0 con 0x7fb55c053600 2021-11-15T15:44:40.231 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T15:44:40.232 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 msgr2=0x7fb55c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 0x7fb55c055ac0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fb57c060380 tx=0x7fb578017000).stop 2021-11-15T15:44:40.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 msgr2=0x7fb57c13ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:44:40.233 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fb570002f90 tx=0x7fb570006df0).stop 2021-11-15T15:44:40.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 shutdown_connections 2021-11-15T15:44:40.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fb55c053600 0x7fb55c055ac0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:40.234 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fb57c0b6980 0x7fb57c13f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fb57c0aa650 0x7fb57c13ad70 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:44:40.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 --2- 172.21.2.135:0/2564302683 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fb57c060990 0x7fb57c153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:44:40.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 >> 172.21.2.135:0/2564302683 conn(0x7fb57c0b3500 msgr2=0x7fb57c0b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:44:40.235 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 shutdown_connections 2021-11-15T15:44:40.236 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:44:40.229+0000 7fb583314700 1 -- 172.21.2.135:0/2564302683 wait complete. 2021-11-15T15:44:40.236 INFO:teuthology.orchestra.run.gibba035.stderr:dumped all 2021-11-15T15:44:40.238 INFO:teuthology.orchestra.run.gibba035.stdout:{"pg_ready":true,"pg_map":{"version":2269,"stamp":"2021-11-15T15:44:38.974700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405240,"kb_used_data":16568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569480,"statfs":{"total":773094113280,"available":764487147520,"internally_reserved":8589934592,"allocated":16965632,"data_stored":8271227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005360"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":144,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.665399+0000","last_change":"2021-11-15T14:34:20.467684+0000","last_active":"2021-11-15T14:44:05.665399+0000","last_peered":"2021-11-15T14:44:05.665399+0000","last_clean":"2021-11-15T14:44:05.665399+0000","last_became_active":"2021-11-15T14:34:20.466743+0000","last_became_peered":"2021-11-15T14:34:20.466743+0000","last_unstale":"2021-11-15T14:44:05.665399+0000","last_undegraded":"2021-11-15T14:44:05.665399+0000","last_fullsized":"2021-11-15T14:44:05.665399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:16.050418+0000","last_clean_scrub_stamp":"2021-11-15T14:34:16.050418+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896419+0000","last_change":"2021-11-15T14:34:24.844233+0000","last_active":"2021-11-15T14:44:04.896419+0000","last_peered":"2021-11-15T14:44:04.896419+0000","last_clean":"2021-11-15T14:44:04.896419+0000","last_became_active":"2021-11-15T14:34:24.844069+0000","last_became_peered":"2021-11-15T14:34:24.844069+0000","last_unstale":"2021-11-15T14:44:04.896419+0000","last_undegraded":"2021-11-15T14:44:04.896419+0000","last_fullsized":"2021-11-15T14:44:04.896419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896441+0000","last_change":"2021-11-15T14:34:24.543141+0000","last_active":"2021-11-15T14:44:04.896441+0000","last_peered":"2021-11-15T14:44:04.896441+0000","last_clean":"2021-11-15T14:44:04.896441+0000","last_became_active":"2021-11-15T14:34:24.542973+0000","last_became_peered":"2021-11-15T14:34:24.542973+0000","last_unstale":"2021-11-15T14:44:04.896441+0000","last_undegraded":"2021-11-15T14:44:04.896441+0000","last_fullsized":"2021-11-15T14:44:04.896441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.661191+0000","last_change":"2021-11-15T14:34:24.544907+0000","last_active":"2021-11-15T14:44:05.661191+0000","last_peered":"2021-11-15T14:44:05.661191+0000","last_clean":"2021-11-15T14:44:05.661191+0000","last_became_active":"2021-11-15T14:34:24.544673+0000","last_became_peered":"2021-11-15T14:34:24.544673+0000","last_unstale":"2021-11-15T14:44:05.661191+0000","last_undegraded":"2021-11-15T14:44:05.661191+0000","last_fullsized":"2021-11-15T14:44:05.661191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896393+0000","last_change":"2021-11-15T14:34:24.543140+0000","last_active":"2021-11-15T14:44:04.896393+0000","last_peered":"2021-11-15T14:44:04.896393+0000","last_clean":"2021-11-15T14:44:04.896393+0000","last_became_active":"2021-11-15T14:34:24.542969+0000","last_became_peered":"2021-11-15T14:34:24.542969+0000","last_unstale":"2021-11-15T14:44:04.896393+0000","last_undegraded":"2021-11-15T14:44:04.896393+0000","last_fullsized":"2021-11-15T14:44:04.896393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:05.662262+0000","last_change":"2021-11-15T14:34:24.544839+0000","last_active":"2021-11-15T14:44:05.662262+0000","last_peered":"2021-11-15T14:44:05.662262+0000","last_clean":"2021-11-15T14:44:05.662262+0000","last_became_active":"2021-11-15T14:34:24.544587+0000","last_became_peered":"2021-11-15T14:34:24.544587+0000","last_unstale":"2021-11-15T14:44:05.662262+0000","last_undegraded":"2021-11-15T14:44:05.662262+0000","last_fullsized":"2021-11-15T14:44:05.662262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896388+0000","last_change":"2021-11-15T14:34:24.543128+0000","last_active":"2021-11-15T14:44:04.896388+0000","last_peered":"2021-11-15T14:44:04.896388+0000","last_clean":"2021-11-15T14:44:04.896388+0000","last_became_active":"2021-11-15T14:34:24.542965+0000","last_became_peered":"2021-11-15T14:34:24.542965+0000","last_unstale":"2021-11-15T14:44:04.896388+0000","last_undegraded":"2021-11-15T14:44:04.896388+0000","last_fullsized":"2021-11-15T14:44:04.896388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.892143+0000","last_change":"2021-11-15T14:34:24.640770+0000","last_active":"2021-11-15T14:44:04.892143+0000","last_peered":"2021-11-15T14:44:04.892143+0000","last_clean":"2021-11-15T14:44:04.892143+0000","last_became_active":"2021-11-15T14:34:24.640524+0000","last_became_peered":"2021-11-15T14:34:24.640524+0000","last_unstale":"2021-11-15T14:44:04.892143+0000","last_undegraded":"2021-11-15T14:44:04.892143+0000","last_fullsized":"2021-11-15T14:44:04.892143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":166,"state":"active+clean","last_fresh":"2021-11-15T14:44:04.896471+0000","last_change":"2021-11-15T14:34:24.638667+0000","last_active":"2021-11-15T14:44:04.896471+0000","last_peered":"2021-11-15T14:44:04.896471+0000","last_clean":"2021-11-15T14:44:04.896471+0000","last_became_active":"2021-11-15T14:34:24.638483+0000","last_became_peered":"2021-11-15T14:34:24.638483+0000","last_unstale":"2021-11-15T14:44:04.896471+0000","last_undegraded":"2021-11-15T14:44:04.896471+0000","last_fullsized":"2021-11-15T14:44:04.896471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T14:34:23.525084+0000","last_clean_scrub_stamp":"2021-11-15T14:34:23.525084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.90700000000000003,"5min":0.54300000000000004,"15min":0.52400000000000002},"max":{"1min":1.6000000000000001,"5min":1.6419999999999999,"15min":1.911},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.60399999999999998},"max":{"1min":1.5900000000000001,"5min":1.6519999999999999,"15min":1.7350000000000001},"last":1.5029999999999999}]},{"osd":1,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2450000000000001,"15min":1.24},"min":{"1min":0.99299999999999999,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.8859999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2050000000000001,"15min":1.2170000000000001},"min":{"1min":0.86899999999999999,"5min":0.52700000000000002,"15min":0.45700000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.804},"last":1.544}]},{"osd":2,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.77300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.597,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.321,"15min":1.3320000000000001},"min":{"1min":0.91300000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.919},"last":1.5980000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.252},"min":{"1min":0.89400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5489999999999999,"5min":1.6080000000000001,"15min":1.8100000000000001},"last":1.623},{"interface":"front","average":{"1min":1.262,"5min":1.242,"15min":1.25},"min":{"1min":0.96599999999999997,"5min":0.57499999999999996,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.837},"last":1.325}]},{"osd":4,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.333,"5min":1.5469999999999999,"15min":1.7490000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.86899999999999999,"15min":0.90400000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.377,"5min":1.548,"15min":1.748},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.89900000000000002},"min":{"1min":0.26800000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.524,"5min":1.6899999999999999,"15min":1.6919999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.419,"5min":1.583,"15min":1.6819999999999999},"last":1.268}]},{"osd":6,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.96299999999999997,"15min":1.01},"min":{"1min":0.26200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":1.5249999999999999,"5min":1.74,"15min":1.74},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90900000000000003,"15min":0.96299999999999997},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.359,"5min":1.804,"15min":1.804},"last":1.4570000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542991,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.88500000000000001,"5min":0.58499999999999996,"15min":0.29099999999999998},"max":{"1min":1.4870000000000001,"5min":1.6659999999999999,"15min":1.6930000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.85999999999999999,"5min":0.54700000000000004,"15min":0.33400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.381}]},{"osd":1,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2749999999999999,"15min":1.27},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.26800000000000002},"max":{"1min":1.494,"5min":1.829,"15min":1.9019999999999999},"last":1.329},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.26,"15min":1.252},"min":{"1min":0.91300000000000003,"5min":0.45500000000000002,"15min":0.35899999999999999},"max":{"1min":1.516,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.296}]},{"osd":2,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.91800000000000004,"5min":0.53800000000000003,"15min":0.29099999999999998},"max":{"1min":1.599,"5min":1.6830000000000001,"15min":1.96},"last":1.542},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.266,"15min":1.2430000000000001},"min":{"1min":0.87,"5min":0.51400000000000001,"15min":0.38800000000000001},"max":{"1min":1.5740000000000001,"5min":1.677,"15min":1.7350000000000001},"last":1.4850000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.264,"15min":1.252},"min":{"1min":0.83599999999999997,"5min":0.499,"15min":0.36099999999999999},"max":{"1min":1.657,"5min":1.825,"15min":1.825},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.28,"15min":1.2709999999999999},"min":{"1min":0.82499999999999996,"5min":0.55800000000000005,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.696,"15min":1.774},"last":1.4490000000000001}]},{"osd":4,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90600000000000003,"15min":0.88700000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.193},"max":{"1min":1.3009999999999999,"5min":1.48,"15min":2.0960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.29699999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.4350000000000001,"5min":1.4930000000000001,"15min":1.8560000000000001},"last":1.016}]},{"osd":5,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.214},"max":{"1min":1.381,"5min":1.4750000000000001,"15min":1.593},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.456,"5min":1.474,"15min":1.5840000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":1.2689999999999999,"5min":1.579,"15min":1.726},"last":1.111},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0369999999999999,"15min":1.0229999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1679999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542990,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050648,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321192,"statfs":{"total":96636764160,"available":95560900608,"internally_reserved":1073741824,"allocated":2113536,"data_stored":1032870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2729999999999999,"15min":1.2669999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7090000000000001,"5min":1.841,"15min":1.8899999999999999},"last":1.087},{"interface":"front","average":{"1min":1.145,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.492,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0669999999999999}]},{"osd":1,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.119},{"interface":"front","average":{"1min":1.181,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.538,"5min":1.7330000000000001,"15min":1.8},"last":1.149}]},{"osd":2,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.575,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.179},{"interface":"front","average":{"1min":1.254,"5min":1.284,"15min":1.282},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.617,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.01}]},{"osd":3,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2250000000000001,"15min":1.2330000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6479999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.736,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.0249999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.95999999999999996},"min":{"1min":0.35399999999999998,"5min":0.30099999999999999,"15min":0.17799999999999999},"max":{"1min":1.448,"5min":1.821,"15min":1.821},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98599999999999999,"15min":0.97899999999999998},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.224},"max":{"1min":1.4279999999999999,"5min":1.625,"15min":1.625},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.193},"max":{"1min":1.1040000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.41299999999999998,"5min":0.26600000000000001,"15min":0.252},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.5920000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97799999999999998,"15min":0.96599999999999997},"min":{"1min":0.38700000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.3460000000000001,"5min":1.5580000000000001,"15min":1.746},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.32700000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.7130000000000001},"last":0.60799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.244,"15min":1.258},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.5429999999999999,"5min":1.8500000000000001,"15min":1.869},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2749999999999999,"15min":1.278},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.7070000000000001,"5min":1.8100000000000001,"15min":1.8799999999999999},"last":1.4950000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1799999999999999,"15min":1.1970000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5149999999999999,"5min":1.599,"15min":1.8740000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.206,"15min":1.232},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.4299999999999999}]},{"osd":2,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2110000000000001,"15min":1.2230000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.9750000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.21,"15min":1.22},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7030000000000001,"5min":1.714,"15min":1.7430000000000001},"last":1.577}]},{"osd":3,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2250000000000001,"15min":1.206},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.53,"5min":1.7490000000000001,"15min":1.8069999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.1659999999999999,"15min":1.2010000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3300000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.85199999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.21299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.528,"5min":1.6899999999999999,"15min":1.75},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85599999999999998,"15min":0.86699999999999999},"min":{"1min":0.22900000000000001,"5min":0.20499999999999999,"15min":0.16},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.6779999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.94599999999999995,"15min":0.93999999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.5700000000000001,"5min":1.589,"15min":1.6379999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.97999999999999998,"15min":0.95699999999999996},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.671,"5min":1.671,"15min":1.7430000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.97899999999999998,"15min":0.96899999999999997},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.081}]}]},{"osd":3,"up_from":14,"seq":60129542991,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.17599999999999999},"max":{"1min":0.91000000000000003,"5min":1.119,"15min":1.3100000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.27600000000000002,"5min":0.223,"15min":0.215},"max":{"1min":0.99199999999999999,"5min":1.0640000000000001,"15min":1.0720000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.184},"max":{"1min":0.76500000000000001,"5min":0.99299999999999999,"15min":1.2529999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.78400000000000003},"min":{"1min":0.24299999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.248,"5min":1.248,"15min":1.4139999999999999},"last":0.91800000000000004}]},{"osd":2,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82599999999999996,"15min":0.84699999999999998},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.24299999999999999},"max":{"1min":1.026,"5min":1.2549999999999999,"15min":1.6240000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.89200000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.20899999999999999},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1140000000000001}]},{"osd":4,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2989999999999999,"15min":1.3220000000000001},"min":{"1min":0.80000000000000004,"5min":0.53100000000000003,"15min":0.33400000000000002},"max":{"1min":1.6060000000000001,"5min":1.782,"15min":2.1219999999999999},"last":1.006},{"interface":"front","average":{"1min":1.347,"5min":1.302,"15min":1.331},"min":{"1min":0.70299999999999996,"5min":0.57499999999999996,"15min":0.39800000000000002},"max":{"1min":1.7110000000000001,"5min":1.865,"15min":2.2189999999999999},"last":1.2030000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.282,"15min":1.296},"min":{"1min":0.77900000000000003,"5min":0.53700000000000003,"15min":0.42199999999999999},"max":{"1min":1.554,"5min":1.821,"15min":1.821},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.294,"15min":1.3220000000000001},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.443},"max":{"1min":1.5740000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.0800000000000001}]},{"osd":6,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2869999999999999,"15min":1.3129999999999999},"min":{"1min":0.63,"5min":0.56699999999999995,"15min":0.318},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.8320000000000001},"last":1.294},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.72599999999999998,"5min":0.56399999999999995,"15min":0.32200000000000001},"max":{"1min":1.6659999999999999,"5min":1.7070000000000001,"15min":1.853},"last":1.2470000000000001}]},{"osd":7,"last update":"Mon Nov 15 15:43:51 2021","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.333,"15min":1.3200000000000001},"min":{"1min":0.754,"5min":0.61599999999999999,"15min":0.42799999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.3100000000000001,"15min":1.339},"min":{"1min":0.68200000000000005,"5min":0.52200000000000002,"15min":0.38300000000000001},"max":{"1min":1.8,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0609999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.254,"5min":0.25,"15min":0.22},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.2490000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.32600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.1060000000000001,"5min":1.226,"15min":1.298},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":1.1779999999999999,"5min":1.2789999999999999,"15min":1.3919999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.26200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":1.2729999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.093,"15min":1.093},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.22800000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.96099999999999997}]},{"osd":4,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3180000000000001,"15min":1.3340000000000001},"min":{"1min":0.66100000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7210000000000001,"5min":1.726,"15min":1.778},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.3640000000000001,"15min":1.3680000000000001},"min":{"1min":0.65100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.667,"5min":1.7030000000000001,"15min":1.913},"last":1.552}]},{"osd":5,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.331,"15min":1.357},"min":{"1min":0.72199999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5800000000000001,"5min":1.806,"15min":1.984},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3169999999999999,"15min":1.351},"min":{"1min":0.63200000000000001,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.843},"last":1.677}]},{"osd":6,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.361,"15min":1.3600000000000001},"min":{"1min":0.70199999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6859999999999999,"5min":1.79,"15min":2.0590000000000002},"last":1.488},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3640000000000001,"15min":1.3700000000000001},"min":{"1min":0.70899999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.9790000000000001},"last":1.7370000000000001}]},{"osd":7,"last update":"Mon Nov 15 15:43:38 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.353,"15min":1.3660000000000001},"min":{"1min":0.67500000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.623,"5min":1.8899999999999999,"15min":1.9710000000000001},"last":1.625},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.333,"15min":1.3580000000000001},"min":{"1min":0.68200000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.8700000000000001},"last":1.4530000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.26100000000000001,"5min":0.23499999999999999,"15min":0.21099999999999999},"max":{"1min":0.996,"5min":1.036,"15min":1.139},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.1930000000000001,"15min":1.6359999999999999},"last":1.0680000000000001}]},{"osd":2,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.77200000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.93799999999999994,"5min":1.163,"15min":1.163},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.90900000000000003},"min":{"1min":0.28199999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.413},"last":1.2529999999999999}]},{"osd":3,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.20100000000000001},"max":{"1min":1.0609999999999999,"5min":1.163,"15min":1.389},"last":0.875},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.247,"5min":0.20699999999999999,"15min":0.19700000000000001},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1619999999999999},"last":1.0129999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.3129999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.889,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.403},{"interface":"front","average":{"1min":1.306,"5min":1.327,"15min":1.3200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.732,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.341}]},{"osd":5,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.331,"15min":1.3129999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":1.762,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.29},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3180000000000001,"15min":1.325},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.42099999999999999},"max":{"1min":1.8120000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.466}]},{"osd":6,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.323,"15min":1.3400000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7689999999999999,"5min":1.857,"15min":1.857},"last":1.496},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3200000000000001,"15min":1.3260000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.7829999999999999,"5min":1.8700000000000001,"15min":1.893},"last":1.391}]},{"osd":7,"last update":"Mon Nov 15 15:43:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7390000000000001,"5min":1.792,"15min":1.792},"last":1.357},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.748,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.2170000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542990,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.17599999999999999},"max":{"1min":0.90900000000000003,"5min":1.1479999999999999,"15min":1.2330000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.75700000000000001},"min":{"1min":0.224,"5min":0.20100000000000001,"15min":0.192},"max":{"1min":1.141,"5min":1.141,"15min":1.3140000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":0.95399999999999996,"5min":1.29,"15min":1.29},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.216},"max":{"1min":1.0389999999999999,"5min":1.105,"15min":1.1910000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23000000000000001},"max":{"1min":0.96299999999999997,"5min":1.0609999999999999,"15min":1.0960000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.29299999999999998,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":1.085,"5min":1.2889999999999999,"15min":1.3560000000000001},"last":0.95299999999999996}]},{"osd":4,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.367,"15min":1.359},"min":{"1min":0.81599999999999995,"5min":0.65600000000000003,"15min":0.41899999999999998},"max":{"1min":1.742,"5min":1.829,"15min":2.0070000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.365,"15min":1.3700000000000001},"min":{"1min":0.88700000000000001,"5min":0.627,"15min":0.45300000000000001},"max":{"1min":1.7230000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.111}]},{"osd":5,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3580000000000001,"15min":1.365},"min":{"1min":0.82599999999999996,"5min":0.66400000000000003,"15min":0.46999999999999997},"max":{"1min":1.694,"5min":1.7649999999999999,"15min":1.7669999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.333,"15min":1.3320000000000001},"min":{"1min":0.90300000000000002,"5min":0.66100000000000003,"15min":0.40699999999999997},"max":{"1min":1.724,"5min":1.859,"15min":1.8720000000000001},"last":1.21}]},{"osd":6,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.337,"15min":1.339},"min":{"1min":0.79800000000000004,"5min":0.67700000000000005,"15min":0.42899999999999999},"max":{"1min":1.6160000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.3700000000000001,"15min":1.365},"min":{"1min":0.87,"5min":0.61399999999999999,"15min":0.44400000000000001},"max":{"1min":1.732,"5min":1.802,"15min":1.9259999999999999},"last":1.0469999999999999}]},{"osd":7,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.355,"15min":1.369},"min":{"1min":0.83799999999999997,"5min":0.64000000000000001,"15min":0.46200000000000002},"max":{"1min":1.681,"5min":1.6930000000000001,"15min":1.923},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.367,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.64500000000000002,"15min":0.435},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.861},"last":1.2250000000000001}]}]}]}} 2021-11-15T15:44:40.241 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-11-15T14:34:16.050418+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=16, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.242 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.243 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.243 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.244 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.244 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.245 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.246 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.246 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-11-15T14:34:23.525084+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=14, tm_min=34, tm_sec=23, tm_wday=0, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=15, tm_hour=15, tm_min=44, tm_sec=37, tm_wday=0, tm_yday=319, tm_isdst=0) 2021-11-15T15:44:40.247 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-11-15T15:44:51.568 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:51.583 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:51.595 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:44:51.608 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:00.249 DEBUG:teuthology.orchestra.run.gibba035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-15T15:45:00.304 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 Processor -- start 2021-11-15T15:45:00.305 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- start start 2021-11-15T15:45:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 --2- >> v2:172.21.2.135:3300/0 conn(0x7f5ec40b1e30 0x7f5ec40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec40a7140 0x7f5ec41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.307 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec40b03d0 con 0x7f5ec4148420 2021-11-15T15:45:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- --> v2:172.21.2.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40a9140 con 0x7f5ec40b1e30 2021-11-15T15:45:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40b0670 con 0x7f5ec40a7140 2021-11-15T15:45:00.308 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec37fe700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7f5ec4148420 0x7f5ec40b2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53152/0 (socket says 172.21.2.135:53152) 2021-11-15T15:45:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec37fe700 1 -- 172.21.2.135:0/390050888 learned_addr learned my addr 172.21.2.135:0/390050888 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:45:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/390050888 >> v2:172.21.2.135:3300/0 conn(0x7f5ec40b1e30 0x7f5ec40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.309 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec2ffd700 1 -- 172.21.2.135:0/390050888 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160200044 0 0) 0x7f5ec40b03d0 con 0x7f5ec4148420 2021-11-15T15:45:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec2ffd700 1 -- 172.21.2.135:0/390050888 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb0003260 con 0x7f5ec4148420 2021-11-15T15:45:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 -- 172.21.2.135:0/390050888 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec40a7140 msgr2=0x7f5ec41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:45:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/390050888 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec40a7140 0x7f5ec41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.310 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 -- 172.21.2.135:0/390050888 >> v1:172.21.2.135:6789/0 conn(0x7f5ec4148420 legacy=0x7f5ec40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 -- 172.21.2.135:0/390050888 --> v2:172.21.2.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40b0910 con 0x7f5ec40b1e30 2021-11-15T15:45:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/390050888 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40b1050 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f5ec41477b0 tx=0x7f5eb4006df0).ready entity=mon.1 client_cookie=563a9818e8c8b1d server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.311 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec2ffd700 1 -- 172.21.2.135:0/390050888 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb400d570 con 0x7f5ec40b1e30 2021-11-15T15:45:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec2ffd700 1 -- 172.21.2.135:0/390050888 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4000e90 con 0x7f5ec40b1e30 2021-11-15T15:45:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5ec2ffd700 1 -- 172.21.2.135:0/390050888 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb400d8c0 con 0x7f5ec40b1e30 2021-11-15T15:45:00.312 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- 172.21.2.135:0/390050888 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40b1e30 msgr2=0x7f5ec40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/390050888 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40b1050 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f5ec41477b0 tx=0x7f5eb4006df0).stop 2021-11-15T15:45:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- 172.21.2.135:0/390050888 shutdown_connections 2021-11-15T15:45:00.313 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/390050888 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec40a7140 0x7f5ec41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/390050888 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40b1050 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- 172.21.2.135:0/390050888 >> 172.21.2.135:0/390050888 conn(0x7f5ec405f730 msgr2=0x7f5ec405fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:45:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- 172.21.2.135:0/390050888 shutdown_connections 2021-11-15T15:45:00.314 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.301+0000 7f5eca4dd700 1 -- 172.21.2.135:0/390050888 wait complete. 2021-11-15T15:45:00.316 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 Processor -- start 2021-11-15T15:45:00.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- start start 2021-11-15T15:45:00.317 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec4148420 0x7f5ec40ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.318 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40aeeb0 con 0x7f5ec40b1e30 2021-11-15T15:45:00.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40a9f20 con 0x7f5ec40a7140 2021-11-15T15:45:00.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40ab360 con 0x7f5ec4148420 2021-11-15T15:45:00.319 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37334/0 (socket says 172.21.2.135:37334) 2021-11-15T15:45:00.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 -- 172.21.2.135:0/786122654 learned_addr learned my addr 172.21.2.135:0/786122654 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:45:00.320 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 -- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec4148420 msgr2=0x7f5ec40ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec4148420 0x7f5ec40ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 -- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ec40b1e30 msgr2=0x7f5ec40ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.321 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 -- 172.21.2.135:0/786122654 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb400b180 con 0x7f5ec40a7140 2021-11-15T15:45:00.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec3fff700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f5ec41477b0 tx=0x7f5eb4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.322 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb4016070 con 0x7f5ec40a7140 2021-11-15T15:45:00.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4002f50 con 0x7f5ec40a7140 2021-11-15T15:45:00.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec40ab600 con 0x7f5ec40a7140 2021-11-15T15:45:00.323 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec40abb40 con 0x7f5ec40a7140 2021-11-15T15:45:00.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb4006b20 con 0x7f5ec40a7140 2021-11-15T15:45:00.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec40573d0 con 0x7f5ec40a7140 2021-11-15T15:45:00.324 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5eb4025030 con 0x7f5ec40a7140 2021-11-15T15:45:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 0x7f5ea4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5eb406c7f0 con 0x7f5ec40a7140 2021-11-15T15:45:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.305+0000 7f5ec37fe700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 0x7f5ea4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.325 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.309+0000 7f5ec37fe700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 0x7f5ea4055be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5eb8001110 tx=0x7f5eb80076c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.326 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.309+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5eb40439c0 con 0x7f5ec40a7140 2021-11-15T15:45:00.393 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.389+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 --> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ec4156b20 con 0x7f5ea4053720 2021-11-15T15:45:00.403 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.397+0000 7f5ec17fa700 1 -- 172.21.2.135:0/786122654 <== mgr.4101 v2:172.21.2.119:6800/14716 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66293 (secure 0 0 0) 0x7f5eb8007d50 con 0x7f5ea4053720 2021-11-15T15:45:00.404 INFO:teuthology.orchestra.run.gibba035.stdout: 2021-11-15T15:45:00.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 msgr2=0x7f5ea4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 0x7f5ea4055be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5eb8001110 tx=0x7f5eb80076c0).stop 2021-11-15T15:45:00.406 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 msgr2=0x7f5ec40ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f5ec41477b0 tx=0x7f5eb4014000).stop 2021-11-15T15:45:00.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 shutdown_connections 2021-11-15T15:45:00.407 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7f5ea4053720 0x7f5ea4055be0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7f5ec4148420 0x7f5ec40ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.408 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7f5ec40b1e30 0x7f5ec40ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 --2- 172.21.2.135:0/786122654 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7f5ec40a7140 0x7f5ec40ae1f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 >> 172.21.2.135:0/786122654 conn(0x7f5ec405f730 msgr2=0x7f5ec40b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:45:00.409 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 shutdown_connections 2021-11-15T15:45:00.410 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.401+0000 7f5eca4dd700 1 -- 172.21.2.135:0/786122654 wait complete. 2021-11-15T15:45:00.410 INFO:teuthology.orchestra.run.gibba035.stderr:dumped all 2021-11-15T15:45:00.416 INFO:teuthology.orchestra.run.gibba035.stdout:{"pg_ready":true,"pg_map":{"version":2279,"stamp":"2021-11-15T15:44:58.984248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9842,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8405240,"kb_used_data":16568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569480,"statfs":{"total":773094113280,"available":764487147520,"internally_reserved":8589934592,"allocated":16965632,"data_stored":8271227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005558"},"pg_stats":[{"pgid":"1.0","version":"167'4","reported_seq":149,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:39.288812+0000","last_change":"2021-11-15T15:44:39.288878+0000","last_active":"2021-11-15T15:44:39.288812+0000","last_peered":"2021-11-15T15:44:39.288812+0000","last_clean":"2021-11-15T15:44:39.288812+0000","last_became_active":"2021-11-15T14:34:20.466743+0000","last_became_peered":"2021-11-15T14:34:20.466743+0000","last_unstale":"2021-11-15T15:44:39.288812+0000","last_undegraded":"2021-11-15T15:44:39.288812+0000","last_fullsized":"2021-11-15T15:44:39.288812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'4","last_scrub_stamp":"2021-11-15T15:44:39.288812+0000","last_deep_scrub":"167'4","last_deep_scrub_stamp":"2021-11-15T15:44:39.288812+0000","last_clean_scrub_stamp":"2021-11-15T15:44:39.288812+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9842,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:46.722313+0000","last_change":"2021-11-15T15:44:46.722356+0000","last_active":"2021-11-15T15:44:46.722313+0000","last_peered":"2021-11-15T15:44:46.722313+0000","last_clean":"2021-11-15T15:44:46.722313+0000","last_became_active":"2021-11-15T14:34:24.844069+0000","last_became_peered":"2021-11-15T14:34:24.844069+0000","last_unstale":"2021-11-15T15:44:46.722313+0000","last_undegraded":"2021-11-15T15:44:46.722313+0000","last_fullsized":"2021-11-15T15:44:46.722313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:46.722313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:46.722313+0000","last_clean_scrub_stamp":"2021-11-15T15:44:46.722313+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:40.656702+0000","last_change":"2021-11-15T15:44:40.656960+0000","last_active":"2021-11-15T15:44:40.656702+0000","last_peered":"2021-11-15T15:44:40.656702+0000","last_clean":"2021-11-15T15:44:40.656702+0000","last_became_active":"2021-11-15T14:34:24.542973+0000","last_became_peered":"2021-11-15T14:34:24.542973+0000","last_unstale":"2021-11-15T15:44:40.656702+0000","last_undegraded":"2021-11-15T15:44:40.656702+0000","last_fullsized":"2021-11-15T15:44:40.656702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:40.656701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:40.656701+0000","last_clean_scrub_stamp":"2021-11-15T15:44:40.656701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:44.284846+0000","last_change":"2021-11-15T15:44:44.284896+0000","last_active":"2021-11-15T15:44:44.284846+0000","last_peered":"2021-11-15T15:44:44.284846+0000","last_clean":"2021-11-15T15:44:44.284846+0000","last_became_active":"2021-11-15T14:34:24.544673+0000","last_became_peered":"2021-11-15T14:34:24.544673+0000","last_unstale":"2021-11-15T15:44:44.284846+0000","last_undegraded":"2021-11-15T15:44:44.284846+0000","last_fullsized":"2021-11-15T15:44:44.284846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:44.284845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:44.284845+0000","last_clean_scrub_stamp":"2021-11-15T15:44:44.284845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":143,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:43.644448+0000","last_change":"2021-11-15T15:44:43.644721+0000","last_active":"2021-11-15T15:44:43.644448+0000","last_peered":"2021-11-15T15:44:43.644448+0000","last_clean":"2021-11-15T15:44:43.644448+0000","last_became_active":"2021-11-15T14:34:24.542969+0000","last_became_peered":"2021-11-15T14:34:24.542969+0000","last_unstale":"2021-11-15T15:44:43.644448+0000","last_undegraded":"2021-11-15T15:44:43.644448+0000","last_fullsized":"2021-11-15T15:44:43.644448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:43.644447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:43.644447+0000","last_clean_scrub_stamp":"2021-11-15T15:44:43.644447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:41.467245+0000","last_change":"2021-11-15T15:44:41.467288+0000","last_active":"2021-11-15T15:44:41.467245+0000","last_peered":"2021-11-15T15:44:41.467245+0000","last_clean":"2021-11-15T15:44:41.467245+0000","last_became_active":"2021-11-15T14:34:24.544587+0000","last_became_peered":"2021-11-15T14:34:24.544587+0000","last_unstale":"2021-11-15T15:44:41.467245+0000","last_undegraded":"2021-11-15T15:44:41.467245+0000","last_fullsized":"2021-11-15T15:44:41.467245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:41.467245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:41.467245+0000","last_clean_scrub_stamp":"2021-11-15T15:44:41.467245+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:51.748694+0000","last_change":"2021-11-15T15:44:51.748943+0000","last_active":"2021-11-15T15:44:51.748694+0000","last_peered":"2021-11-15T15:44:51.748694+0000","last_clean":"2021-11-15T15:44:51.748694+0000","last_became_active":"2021-11-15T14:34:24.542965+0000","last_became_peered":"2021-11-15T14:34:24.542965+0000","last_unstale":"2021-11-15T15:44:51.748694+0000","last_undegraded":"2021-11-15T15:44:51.748694+0000","last_fullsized":"2021-11-15T15:44:51.748694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:51.748693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:51.748693+0000","last_clean_scrub_stamp":"2021-11-15T15:44:51.748693+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:40.348562+0000","last_change":"2021-11-15T15:44:40.348634+0000","last_active":"2021-11-15T15:44:40.348562+0000","last_peered":"2021-11-15T15:44:40.348562+0000","last_clean":"2021-11-15T15:44:40.348562+0000","last_became_active":"2021-11-15T14:34:24.640524+0000","last_became_peered":"2021-11-15T14:34:24.640524+0000","last_unstale":"2021-11-15T15:44:40.348562+0000","last_undegraded":"2021-11-15T15:44:40.348562+0000","last_fullsized":"2021-11-15T15:44:40.348562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:40.348562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:40.348562+0000","last_clean_scrub_stamp":"2021-11-15T15:44:40.348562+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":167,"state":"active+clean","last_fresh":"2021-11-15T15:44:53.766849+0000","last_change":"2021-11-15T15:44:53.766893+0000","last_active":"2021-11-15T15:44:53.766849+0000","last_peered":"2021-11-15T15:44:53.766849+0000","last_clean":"2021-11-15T15:44:53.766849+0000","last_became_active":"2021-11-15T14:34:24.638483+0000","last_became_peered":"2021-11-15T14:34:24.638483+0000","last_unstale":"2021-11-15T15:44:53.766849+0000","last_undegraded":"2021-11-15T15:44:53.766849+0000","last_fullsized":"2021-11-15T15:44:53.766849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-15T15:44:53.766848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-15T15:44:53.766848+0000","last_clean_scrub_stamp":"2021-11-15T15:44:53.766848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9842,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.90700000000000003,"5min":0.54300000000000004,"15min":0.52400000000000002},"max":{"1min":1.6000000000000001,"5min":1.6419999999999999,"15min":1.911},"last":1.236},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.60399999999999998},"max":{"1min":1.5900000000000001,"5min":1.6519999999999999,"15min":1.7350000000000001},"last":1.284}]},{"osd":1,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2450000000000001,"15min":1.24},"min":{"1min":0.99299999999999999,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.8859999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2050000000000001,"15min":1.2170000000000001},"min":{"1min":0.86899999999999999,"5min":0.52700000000000002,"15min":0.45700000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.804},"last":0.92800000000000005}]},{"osd":2,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.77300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.597,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.321,"15min":1.3320000000000001},"min":{"1min":0.91300000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.919},"last":1.1839999999999999}]},{"osd":3,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2130000000000001,"15min":1.252},"min":{"1min":0.89400000000000002,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5489999999999999,"5min":1.6080000000000001,"15min":1.8100000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.262,"5min":1.242,"15min":1.25},"min":{"1min":0.96599999999999997,"5min":0.57499999999999996,"15min":0.54000000000000004},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.837},"last":1.0760000000000001}]},{"osd":4,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.333,"5min":1.5469999999999999,"15min":1.7490000000000001},"last":1.091},{"interface":"front","average":{"1min":0.87,"5min":0.86899999999999999,"15min":0.90400000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.377,"5min":1.548,"15min":1.748},"last":1.127}]},{"osd":5,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.89900000000000002},"min":{"1min":0.26800000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.524,"5min":1.6899999999999999,"15min":1.6919999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.419,"5min":1.583,"15min":1.6819999999999999},"last":1.258}]},{"osd":6,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.96299999999999997,"15min":1.01},"min":{"1min":0.26200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":1.5249999999999999,"5min":1.74,"15min":1.74},"last":1.351},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.90900000000000003,"15min":0.96299999999999997},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.359,"5min":1.804,"15min":1.804},"last":1.3}]}]},{"osd":6,"up_from":14,"seq":60129542995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.88500000000000001,"5min":0.58499999999999996,"15min":0.29099999999999998},"max":{"1min":1.4870000000000001,"5min":1.6659999999999999,"15min":1.6930000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.331,"15min":1.321},"min":{"1min":0.85999999999999999,"5min":0.54700000000000004,"15min":0.33400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.3120000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2749999999999999,"15min":1.27},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.26800000000000002},"max":{"1min":1.494,"5min":1.829,"15min":1.9019999999999999},"last":1.323},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.26,"15min":1.252},"min":{"1min":0.91300000000000003,"5min":0.45500000000000002,"15min":0.35899999999999999},"max":{"1min":1.516,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.292}]},{"osd":2,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.276,"15min":1.2589999999999999},"min":{"1min":0.91800000000000004,"5min":0.53800000000000003,"15min":0.29099999999999998},"max":{"1min":1.599,"5min":1.6830000000000001,"15min":1.96},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.266,"15min":1.2430000000000001},"min":{"1min":0.87,"5min":0.51400000000000001,"15min":0.38800000000000001},"max":{"1min":1.5740000000000001,"5min":1.677,"15min":1.7350000000000001},"last":1.2549999999999999}]},{"osd":3,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.264,"15min":1.252},"min":{"1min":0.83599999999999997,"5min":0.499,"15min":0.36099999999999999},"max":{"1min":1.657,"5min":1.825,"15min":1.825},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.28,"15min":1.2709999999999999},"min":{"1min":0.82499999999999996,"5min":0.55800000000000005,"15min":0.30099999999999999},"max":{"1min":1.5580000000000001,"5min":1.696,"15min":1.774},"last":1.2130000000000001}]},{"osd":4,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90600000000000003,"15min":0.88700000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.193},"max":{"1min":1.3009999999999999,"5min":1.48,"15min":2.0960000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.29699999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.4350000000000001,"5min":1.4930000000000001,"15min":1.8560000000000001},"last":1.038}]},{"osd":5,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.214},"max":{"1min":1.381,"5min":1.4750000000000001,"15min":1.593},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.456,"5min":1.474,"15min":1.5840000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":1.2689999999999999,"5min":1.579,"15min":1.726},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0369999999999999,"15min":1.0229999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.0089999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050648,"kb_used_data":2064,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321192,"statfs":{"total":96636764160,"available":95560900608,"internally_reserved":1073741824,"allocated":2113536,"data_stored":1032870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2729999999999999,"15min":1.2669999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7090000000000001,"5min":1.841,"15min":1.8899999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.492,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.1240000000000001}]},{"osd":1,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2290000000000001,"15min":1.24},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.4730000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.246},{"interface":"front","average":{"1min":1.181,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.538,"5min":1.7330000000000001,"15min":1.8},"last":1.0720000000000001}]},{"osd":2,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.262},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.575,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.284,"15min":1.282},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.617,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.1639999999999999}]},{"osd":3,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2250000000000001,"15min":1.2330000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6479999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.534},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.736,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.95999999999999996},"min":{"1min":0.35399999999999998,"5min":0.30099999999999999,"15min":0.17799999999999999},"max":{"1min":1.448,"5min":1.821,"15min":1.821},"last":1.28},{"interface":"front","average":{"1min":1.028,"5min":0.98599999999999999,"15min":0.97899999999999998},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.224},"max":{"1min":1.4279999999999999,"5min":1.625,"15min":1.625},"last":1.3220000000000001}]},{"osd":6,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.193},"max":{"1min":1.1040000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.41299999999999998,"5min":0.26600000000000001,"15min":0.252},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.5920000000000001},"last":1.379}]},{"osd":7,"last update":"Mon Nov 15 15:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97799999999999998,"15min":0.96599999999999997},"min":{"1min":0.38700000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.3460000000000001,"5min":1.5580000000000001,"15min":1.746},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.32700000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.7130000000000001},"last":1.4410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542993,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.244,"15min":1.258},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.5429999999999999,"5min":1.8500000000000001,"15min":1.869},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2749999999999999,"15min":1.278},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.7070000000000001,"5min":1.8100000000000001,"15min":1.8799999999999999},"last":1.3129999999999999}]},{"osd":1,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1799999999999999,"15min":1.1970000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5149999999999999,"5min":1.599,"15min":1.8740000000000001},"last":1.226},{"interface":"front","average":{"1min":1.099,"5min":1.206,"15min":1.232},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.264}]},{"osd":2,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2110000000000001,"15min":1.2230000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.9750000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.21,"15min":1.22},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7030000000000001,"5min":1.714,"15min":1.7430000000000001},"last":1.5660000000000001}]},{"osd":3,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2250000000000001,"15min":1.206},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.53,"5min":1.7490000000000001,"15min":1.8069999999999999},"last":1.2},{"interface":"front","average":{"1min":1.129,"5min":1.1659999999999999,"15min":1.2010000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.85199999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.90800000000000003},"min":{"1min":0.21299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.528,"5min":1.6899999999999999,"15min":1.75},"last":0.92800000000000005}]},{"osd":6,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85599999999999998,"15min":0.86699999999999999},"min":{"1min":0.22900000000000001,"5min":0.20499999999999999,"15min":0.16},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.6779999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.94599999999999995,"15min":0.93999999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.5700000000000001,"5min":1.589,"15min":1.6379999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Mon Nov 15 15:44:30 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.97999999999999998,"15min":0.95699999999999996},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.671,"5min":1.671,"15min":1.7430000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.97899999999999998,"15min":0.96899999999999997},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0960000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542995,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.45000000000000001,"5min":0.21099999999999999,"15min":0.17599999999999999},"max":{"1min":0.86699999999999999,"5min":1.119,"15min":1.3100000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.33500000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0720000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.35899999999999999,"5min":0.24199999999999999,"15min":0.184},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2529999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.78400000000000003},"min":{"1min":0.41799999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1000000000000001,"5min":1.248,"15min":1.4139999999999999},"last":0.88200000000000001}]},{"osd":2,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85499999999999998,"15min":0.85399999999999998},"min":{"1min":0.39900000000000002,"5min":0.252,"15min":0.24299999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.6240000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90100000000000002,"15min":0.89100000000000001},"min":{"1min":0.46999999999999997,"5min":0.26900000000000002,"15min":0.20899999999999999},"max":{"1min":1.218,"5min":1.456,"15min":1.456},"last":0.98099999999999998}]},{"osd":4,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3089999999999999,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.64200000000000002,"15min":0.33400000000000002},"max":{"1min":1.671,"5min":1.7609999999999999,"15min":1.9450000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.3280000000000001,"15min":1.329},"min":{"1min":0.71899999999999997,"5min":0.58399999999999996,"15min":0.39800000000000002},"max":{"1min":1.706,"5min":1.865,"15min":1.98},"last":1.5960000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.2989999999999999,"15min":1.2969999999999999},"min":{"1min":1.0229999999999999,"5min":0.59399999999999997,"15min":0.45800000000000002},"max":{"1min":1.778,"5min":1.821,"15min":1.821},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3089999999999999,"15min":1.3220000000000001},"min":{"1min":0.89600000000000002,"5min":0.64200000000000002,"15min":0.50800000000000001},"max":{"1min":1.6839999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.2230000000000001}]},{"osd":6,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3140000000000001},"min":{"1min":0.92800000000000005,"5min":0.56699999999999995,"15min":0.374},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.2969999999999999,"15min":1.302},"min":{"1min":0.68100000000000005,"5min":0.63100000000000001,"15min":0.50900000000000001},"max":{"1min":1.6000000000000001,"5min":1.6659999999999999,"15min":1.7250000000000001},"last":1.2869999999999999}]},{"osd":7,"last update":"Mon Nov 15 15:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3400000000000001,"15min":1.319},"min":{"1min":1.0429999999999999,"5min":0.66600000000000004,"15min":0.48399999999999999},"max":{"1min":1.748,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.165},{"interface":"front","average":{"1min":1.333,"5min":1.3149999999999999,"15min":1.3420000000000001},"min":{"1min":0.98599999999999999,"5min":0.60499999999999998,"15min":0.45400000000000001},"max":{"1min":1.6419999999999999,"5min":1.8,"15min":1.9990000000000001},"last":1.4419999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78500000000000003,"15min":0.80700000000000005},"min":{"1min":0.252,"5min":0.25,"15min":0.22},"max":{"1min":1.05,"5min":1.1259999999999999,"15min":1.2490000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.33200000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.0329999999999999,"5min":1.226,"15min":1.298},"last":1.0589999999999999}]},{"osd":1,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.35199999999999998,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":1.044,"5min":1.2789999999999999,"15min":1.3919999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.30399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":1.161,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.877}]},{"osd":3,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.26500000000000001,"5min":0.245,"15min":0.23599999999999999},"max":{"1min":0.89600000000000002,"5min":1.093,"15min":1.093},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84599999999999997,"15min":0.86399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26100000000000001,"15min":0.22800000000000001},"max":{"1min":1.23,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.151}]},{"osd":4,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3200000000000001,"15min":1.341},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.532,"5min":1.726,"15min":1.778},"last":1.335},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.373,"15min":1.373},"min":{"1min":0.69499999999999995,"5min":0.372,"15min":0.372},"max":{"1min":1.6870000000000001,"5min":1.7030000000000001,"15min":1.913},"last":1.202}]},{"osd":5,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.347,"15min":1.361},"min":{"1min":0.58399999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7170000000000001,"5min":1.7330000000000001,"15min":1.984},"last":1.175},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3280000000000001,"15min":1.355},"min":{"1min":0.56999999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.677,"5min":1.7909999999999999,"15min":1.843},"last":1.238}]},{"osd":6,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.367,"15min":1.365},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6439999999999999,"5min":1.79,"15min":2.0590000000000002},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.383,"15min":1.379},"min":{"1min":0.625,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.7370000000000001,"5min":1.8879999999999999,"15min":1.9790000000000001},"last":1.22}]},{"osd":7,"last update":"Mon Nov 15 15:44:43 2021","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3700000000000001,"15min":1.3759999999999999},"min":{"1min":0.67800000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.673,"5min":1.8899999999999999,"15min":1.9710000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.349,"15min":1.359},"min":{"1min":0.61199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.8700000000000001},"last":1.1140000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.21099999999999999},"max":{"1min":0.96399999999999997,"5min":1.0289999999999999,"15min":1.139},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83299999999999996},"min":{"1min":0.25,"5min":0.25,"15min":0.222},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.6359999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.27300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.98099999999999998,"5min":1.163,"15min":1.163},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.89800000000000002,"15min":0.90700000000000003},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.413},"last":1.2669999999999999}]},{"osd":3,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.32300000000000001,"5min":0.247,"15min":0.20100000000000001},"max":{"1min":1.0760000000000001,"5min":1.163,"15min":1.389},"last":0.872},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.28399999999999997,"5min":0.20699999999999999,"15min":0.19700000000000001},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1619999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3260000000000001,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.44,"15min":0.44},"max":{"1min":1.617,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3200000000000001,"15min":1.3120000000000001},"min":{"1min":0.72999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.73,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.3560000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.327,"15min":1.304},"min":{"1min":0.84999999999999998,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":1.5389999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.327,"15min":1.3200000000000001},"min":{"1min":0.75600000000000001,"5min":0.47299999999999998,"15min":0.42099999999999999},"max":{"1min":1.6699999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3879999999999999}]},{"osd":6,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.327,"15min":1.337},"min":{"1min":0.753,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6279999999999999,"5min":1.857,"15min":1.857},"last":1.004},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3320000000000001,"15min":1.3240000000000001},"min":{"1min":0.83299999999999996,"5min":0.38,"15min":0.38},"max":{"1min":1.8220000000000001,"5min":1.857,"15min":1.8700000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Mon Nov 15 15:44:48 2021","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.288,"15min":1.3009999999999999},"min":{"1min":0.74299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.476},{"interface":"front","average":{"1min":1.296,"5min":1.333,"15min":1.3300000000000001},"min":{"1min":0.76600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7130000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.3149999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050656,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321184,"statfs":{"total":96636764160,"available":95560892416,"internally_reserved":1073741824,"allocated":2121728,"data_stored":1034051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.17599999999999999},"max":{"1min":0.90900000000000003,"5min":1.1479999999999999,"15min":1.2330000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.75700000000000001},"min":{"1min":0.224,"5min":0.20100000000000001,"15min":0.192},"max":{"1min":1.141,"5min":1.141,"15min":1.3140000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20200000000000001},"max":{"1min":0.95399999999999996,"5min":1.29,"15min":1.29},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.216},"max":{"1min":1.0389999999999999,"5min":1.105,"15min":1.1910000000000001},"last":0.873}]},{"osd":3,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23000000000000001},"max":{"1min":0.96299999999999997,"5min":1.0609999999999999,"15min":1.0960000000000001},"last":0.998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.29299999999999998,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":1.085,"5min":1.2889999999999999,"15min":1.3560000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.367,"15min":1.359},"min":{"1min":0.81599999999999995,"5min":0.65600000000000003,"15min":0.41899999999999998},"max":{"1min":1.742,"5min":1.829,"15min":2.0070000000000001},"last":1.47},{"interface":"front","average":{"1min":1.343,"5min":1.365,"15min":1.3700000000000001},"min":{"1min":0.88700000000000001,"5min":0.627,"15min":0.45300000000000001},"max":{"1min":1.7230000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.2330000000000001}]},{"osd":5,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3580000000000001,"15min":1.365},"min":{"1min":0.82599999999999996,"5min":0.66400000000000003,"15min":0.46999999999999997},"max":{"1min":1.694,"5min":1.7649999999999999,"15min":1.7669999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.333,"15min":1.3320000000000001},"min":{"1min":0.90300000000000002,"5min":0.66100000000000003,"15min":0.40699999999999997},"max":{"1min":1.724,"5min":1.859,"15min":1.8720000000000001},"last":1.2030000000000001}]},{"osd":6,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.337,"15min":1.339},"min":{"1min":0.79800000000000004,"5min":0.67700000000000005,"15min":0.42899999999999999},"max":{"1min":1.6160000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.365},{"interface":"front","average":{"1min":1.387,"5min":1.3700000000000001,"15min":1.365},"min":{"1min":0.87,"5min":0.61399999999999999,"15min":0.44400000000000001},"max":{"1min":1.732,"5min":1.802,"15min":1.9259999999999999},"last":1.393}]},{"osd":7,"last update":"Mon Nov 15 15:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.355,"15min":1.369},"min":{"1min":0.83799999999999997,"5min":0.64000000000000001,"15min":0.46200000000000002},"max":{"1min":1.681,"5min":1.6930000000000001,"15min":1.923},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.367,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.64500000000000002,"15min":0.435},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.861},"last":1.169}]}]}]}} 2021-11-15T15:45:00.419 DEBUG:teuthology.orchestra.run.gibba035:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-11-15T15:45:00.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 Processor -- start 2021-11-15T15:45:00.473 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 -- start start 2021-11-15T15:45:00.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 0x7fd3880b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 --2- >> v2:172.21.2.119:3300/0 conn(0x7fd3880b2320 0x7fd3881412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.480 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 -- --> v1:172.21.2.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880a7850 con 0x7fd3880b1f40 2021-11-15T15:45:00.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 -- --> v2:172.21.2.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880b17c0 con 0x7fd3880b2320 2021-11-15T15:45:00.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd38d680700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b06d0 con 0x7fd3880b1350 2021-11-15T15:45:00.481 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd386ffd700 1 --1- >> v1:172.21.2.135:6789/0 conn(0x7fd3880b1f40 0x7fd3880a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.135:6789/0 says I am v1:172.21.2.135:53162/0 (socket says 172.21.2.135:53162) 2021-11-15T15:45:00.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd386ffd700 1 -- 172.21.2.135:0/2442066048 learned_addr learned my addr 172.21.2.135:0/2442066048 (peer_addr_for_me v1:172.21.2.135:0/0) 2021-11-15T15:45:00.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v1:172.21.2.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134607080 0 0) 0x7fd3880a7850 con 0x7fd3880b1f40 2021-11-15T15:45:00.482 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 --> v1:172.21.2.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368003260 con 0x7fd3880b1f40 2021-11-15T15:45:00.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd3867fc700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 0x7fd3880b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd3877fe700 1 --2- 172.21.2.135:0/2442066048 >> v2:172.21.2.119:3300/0 conn(0x7fd3880b2320 0x7fd3881412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.483 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v1:172.21.2.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826595144 0 0) 0x7fd368003260 con 0x7fd3880b1f40 2021-11-15T15:45:00.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 msgr2=0x7fd3880b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:45:00.484 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 0x7fd3880b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 >> v2:172.21.2.119:3300/0 conn(0x7fd3880b2320 msgr2=0x7fd3881412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:45:00.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 --2- 172.21.2.135:0/2442066048 >> v2:172.21.2.119:3300/0 conn(0x7fd3880b2320 0x7fd3881412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.485 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 --> v1:172.21.2.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880b0970 con 0x7fd3880b1f40 2021-11-15T15:45:00.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v1:172.21.2.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 418747590 0 0) 0x7fd370001660 con 0x7fd3880b1f40 2021-11-15T15:45:00.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 >> v1:172.21.2.135:6789/0 conn(0x7fd3880b1f40 legacy=0x7fd3880a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3680037d0 0x7fd368003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.486 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 0x7fd368004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3680049f0 0x7fd368004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b17c0 con 0x7fd3680049f0 2021-11-15T15:45:00.487 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b06d0 con 0x7fd3680037d0 2021-11-15T15:45:00.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36800b8b0 con 0x7fd3880b1350 2021-11-15T15:45:00.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.469+0000 7fd386ffd700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3680037d0 0x7fd368003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.488 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 -- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 msgr2=0x7fd368004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:45:00.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3880b1350 0x7fd368004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 -- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3680049f0 msgr2=0x7fd368004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-15T15:45:00.489 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd3680049f0 0x7fd368004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-15T15:45:00.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 -- 172.21.2.135:0/2442066048 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368003260 con 0x7fd3680037d0 2021-11-15T15:45:00.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3680037d0 0x7fd368003bf0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fd370001370 tx=0x7fd3880b2a80).ready entity=mon.1 client_cookie=cdadb7ae5938c768 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.490 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3700070d0 con 0x7fd3680037d0 2021-11-15T15:45:00.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370007230 con 0x7fd3680037d0 2021-11-15T15:45:00.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd385ffb700 1 -- 172.21.2.135:0/2442066048 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37000c8c0 con 0x7fd3680037d0 2021-11-15T15:45:00.491 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/2442066048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3680037d0 msgr2=0x7fd368003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 --2- 172.21.2.135:0/2442066048 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3680037d0 0x7fd368003bf0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fd370001370 tx=0x7fd3880b2a80).stop 2021-11-15T15:45:00.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3877fe700 1 -- 172.21.2.135:0/2442066048 reap_dead start 2021-11-15T15:45:00.492 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/2442066048 shutdown_connections 2021-11-15T15:45:00.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/2442066048 >> 172.21.2.135:0/2442066048 conn(0x7fd38805f730 msgr2=0x7fd38805fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:45:00.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/2442066048 shutdown_connections 2021-11-15T15:45:00.493 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/2442066048 wait complete. 2021-11-15T15:45:00.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 Processor -- start 2021-11-15T15:45:00.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- start start 2021-11-15T15:45:00.494 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 --2- >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3680037d0 0x7fd3880b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 --2- >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38813c8c0 0x7fd38813cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.495 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- --> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3881491a0 con 0x7fd38813c8c0 2021-11-15T15:45:00.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388149dd0 con 0x7fd3880b4920 2021-11-15T15:45:00.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- --> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b3410 con 0x7fd3680037d0 2021-11-15T15:45:00.496 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 --2- >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.135:3300/0 says I am v2:172.21.2.135:37356/0 (socket says 172.21.2.135:37356) 2021-11-15T15:45:00.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 -- 172.21.2.135:0/3810517352 learned_addr learned my addr 172.21.2.135:0/3810517352 (peer_addr_for_me v2:172.21.2.135:0/0) 2021-11-15T15:45:00.497 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd386ffd700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3680037d0 0x7fd3880b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3877fe700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38813c8c0 0x7fd38813cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 -- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3680037d0 msgr2=0x7fd3880b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.498 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3680037d0 0x7fd3880b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 -- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38813c8c0 msgr2=0x7fd38813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38813c8c0 0x7fd38813cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.499 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 -- 172.21.2.135:0/3810517352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388149b30 con 0x7fd3880b4920 2021-11-15T15:45:00.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd3867fc700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fd37800a000 tx=0x7fd378008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd378016070 con 0x7fd3880b4920 2021-11-15T15:45:00.500 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378000e90 con 0x7fd3880b4920 2021-11-15T15:45:00.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd388145210 con 0x7fd3880b4920 2021-11-15T15:45:00.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd378011970 con 0x7fd3880b4920 2021-11-15T15:45:00.501 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38814a040 con 0x7fd3880b4920 2021-11-15T15:45:00.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3880b0c10 con 0x7fd3880b4920 2021-11-15T15:45:00.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd378011ad0 con 0x7fd3880b4920 2021-11-15T15:45:00.502 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 0x7fd36c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-15T15:45:00.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.473+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd37806b5e0 con 0x7fd3880b4920 2021-11-15T15:45:00.503 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.477+0000 7fd386ffd700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 0x7fd36c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-15T15:45:00.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.477+0000 7fd386ffd700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 0x7fd36c055a90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fd370017000 tx=0x7fd370013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-15T15:45:00.504 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.477+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3780428c0 con 0x7fd3880b4920 2021-11-15T15:45:00.563 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.561+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 --> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd3880573d0 con 0x7fd3880b4920 2021-11-15T15:45:00.571 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.569+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd3780428c0 con 0x7fd3880b4920 2021-11-15T15:45:00.576 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.573+0000 7fd37ffff700 1 -- 172.21.2.135:0/3810517352 <== mon.1 v2:172.21.2.135:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd378045ee0 con 0x7fd3880b4920 2021-11-15T15:45:00.580 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 msgr2=0x7fd36c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 0x7fd36c055a90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fd370017000 tx=0x7fd370013000).stop 2021-11-15T15:45:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 msgr2=0x7fd38814a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-15T15:45:00.581 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fd37800a000 tx=0x7fd378008040).stop 2021-11-15T15:45:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 shutdown_connections 2021-11-15T15:45:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:6800/14716,v1:172.21.2.119:6801/14716] conn(0x7fd36c0535d0 0x7fd36c055a90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.582 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] conn(0x7fd38813c8c0 0x7fd38813cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.135:3300/0,v1:172.21.2.135:6789/0] conn(0x7fd3880b4920 0x7fd38814a900 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 --2- 172.21.2.135:0/3810517352 >> [v2:172.21.2.119:3301/0,v1:172.21.2.119:6790/0] conn(0x7fd3680037d0 0x7fd3880b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-15T15:45:00.583 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 >> 172.21.2.135:0/3810517352 conn(0x7fd38805f730 msgr2=0x7fd3880af720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-15T15:45:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 shutdown_connections 2021-11-15T15:45:00.584 INFO:teuthology.orchestra.run.gibba035.stderr:2021-11-15T15:45:00.577+0000 7fd38d680700 1 -- 172.21.2.135:0/3810517352 wait complete. 2021-11-15T15:45:00.593 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T15:45:00.596 INFO:teuthology.misc:Shutting down mds daemons... 2021-11-15T15:45:00.597 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-15T15:45:00.597 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:00.605 INFO:tasks.ceph.mds.a:Stopped 2021-11-15T15:45:00.606 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-11-15T15:45:00.607 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:00.662 INFO:tasks.ceph.mds.c:Stopped 2021-11-15T15:45:00.663 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-15T15:45:00.663 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:00.676 INFO:tasks.ceph.mds.b:Stopped 2021-11-15T15:45:00.677 INFO:teuthology.misc:Shutting down osd daemons... 2021-11-15T15:45:00.678 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-11-15T15:45:00.678 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:00.768 INFO:tasks.ceph.osd.0:Stopped 2021-11-15T15:45:00.769 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-11-15T15:45:00.769 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:00.872 INFO:tasks.ceph.osd.1:Stopped 2021-11-15T15:45:00.873 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-11-15T15:45:00.874 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:05.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2021-11-15T15:45:06.975 INFO:tasks.ceph.osd.2:Stopped 2021-11-15T15:45:06.977 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-11-15T15:45:06.977 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:07.054 INFO:tasks.ceph.osd.3:Stopped 2021-11-15T15:45:07.056 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-11-15T15:45:07.056 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:10.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2021-11-15T15:45:10.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2021-11-15T15:45:13.158 INFO:tasks.ceph.osd.4:Stopped 2021-11-15T15:45:13.160 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-11-15T15:45:13.160 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:13.244 INFO:tasks.ceph.osd.5:Stopped 2021-11-15T15:45:13.244 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-11-15T15:45:13.245 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:16.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2021-11-15T15:45:16.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2021-11-15T15:45:19.347 INFO:tasks.ceph.osd.6:Stopped 2021-11-15T15:45:19.348 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-11-15T15:45:19.349 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.417 INFO:tasks.ceph.osd.7:Stopped 2021-11-15T15:45:19.419 INFO:teuthology.misc:Shutting down mgr daemons... 2021-11-15T15:45:19.420 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-11-15T15:45:19.420 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.433 INFO:tasks.ceph.mgr.y:Stopped 2021-11-15T15:45:19.434 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-11-15T15:45:19.435 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.445 INFO:tasks.ceph.mgr.x:Stopped 2021-11-15T15:45:19.446 INFO:teuthology.misc:Shutting down mon daemons... 2021-11-15T15:45:19.447 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-11-15T15:45:19.448 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.456 INFO:tasks.ceph.mon.a:Stopped 2021-11-15T15:45:19.457 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-11-15T15:45:19.458 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.467 INFO:tasks.ceph.mon.b:Stopped 2021-11-15T15:45:19.468 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-11-15T15:45:19.469 INFO:teuthology.orchestra.run:waiting for 300 2021-11-15T15:45:19.528 INFO:tasks.ceph.mon.c:Stopped 2021-11-15T15:45:19.529 INFO:tasks.ceph:Checking cluster log for badness... 2021-11-15T15:45:19.530 DEBUG:teuthology.orchestra.run.gibba035:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-11-15T15:45:19.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T15:45:19.550 DEBUG:teuthology.orchestra.run.gibba035:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-11-15T15:45:19.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T15:45:19.777 DEBUG:teuthology.orchestra.run.gibba035:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-15T15:45:19.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T15:45:19.921 DEBUG:teuthology.orchestra.run.gibba035:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-11-15T15:45:20.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T15:45:20.062 DEBUG:teuthology.orchestra.run.gibba035:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-11-15T15:45:20.228 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T15:45:20.229 DEBUG:teuthology.orchestra.run.gibba019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-11-15T15:45:20.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T15:45:20.351 DEBUG:teuthology.orchestra.run.gibba019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-11-15T15:45:20.509 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T15:45:20.510 DEBUG:teuthology.orchestra.run.gibba019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-11-15T15:45:20.658 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T15:45:20.659 DEBUG:teuthology.orchestra.run.gibba019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-11-15T15:45:20.823 INFO:tasks.ceph:Archiving mon data... 2021-11-15T15:45:20.826 DEBUG:teuthology.misc:Transferring archived files from gibba035:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/data/mon.a.tgz 2021-11-15T15:45:20.827 DEBUG:teuthology.orchestra.run.gibba035:> mktemp 2021-11-15T15:45:20.836 INFO:teuthology.orchestra.run.gibba035.stdout:/tmp/tmp.s4evXsKTXR 2021-11-15T15:45:20.837 DEBUG:teuthology.orchestra.run.gibba035:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.s4evXsKTXR 2021-11-15T15:45:20.981 DEBUG:teuthology.orchestra.run.gibba035:> sudo chmod 0666 /tmp/tmp.s4evXsKTXR 2021-11-15T15:45:21.037 DEBUG:teuthology.orchestra.remote:gibba035:/tmp/tmp.s4evXsKTXR is 586KB 2021-11-15T15:45:21.101 DEBUG:teuthology.orchestra.run.gibba035:> rm -fr /tmp/tmp.s4evXsKTXR 2021-11-15T15:45:21.110 DEBUG:teuthology.misc:Transferring archived files from gibba019:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/data/mon.b.tgz 2021-11-15T15:45:21.110 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T15:45:21.120 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.lAKWnQQZd8 2021-11-15T15:45:21.120 DEBUG:teuthology.orchestra.run.gibba019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lAKWnQQZd8 2021-11-15T15:45:21.254 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.lAKWnQQZd8 2021-11-15T15:45:21.266 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.lAKWnQQZd8 is 514KB 2021-11-15T15:45:21.325 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.lAKWnQQZd8 2021-11-15T15:45:21.334 DEBUG:teuthology.misc:Transferring archived files from gibba019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/data/mon.c.tgz 2021-11-15T15:45:21.335 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-15T15:45:21.379 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.Ku0ZzeQFDa 2021-11-15T15:45:21.380 DEBUG:teuthology.orchestra.run.gibba019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ku0ZzeQFDa 2021-11-15T15:45:21.524 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.Ku0ZzeQFDa 2021-11-15T15:45:21.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2021-11-15T15:45:21.578 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.Ku0ZzeQFDa is 586KB 2021-11-15T15:45:21.639 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.Ku0ZzeQFDa 2021-11-15T15:45:21.649 INFO:tasks.ceph:Cleaning ceph cluster... 2021-11-15T15:45:21.649 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T15:45:21.663 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.694 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T15:45:21.695 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.698 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T15:45:21.700 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.702 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-15T15:45:21.704 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.714 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-11-15T15:45:21.715 DEBUG:teuthology.orchestra.run.gibba035:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T15:45:21.718 DEBUG:teuthology.orchestra.run.gibba019:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T15:45:21.720 DEBUG:teuthology.orchestra.run.gibba038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T15:45:21.739 INFO:teuthology.orchestra.run.gibba019.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T15:45:21.747 INFO:teuthology.orchestra.run.gibba035.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T15:45:21.785 DEBUG:teuthology.orchestra.run.gibba032:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-15T15:45:21.802 INFO:teuthology.orchestra.run.gibba038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T15:45:21.804 INFO:teuthology.orchestra.run.gibba032.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-15T15:45:21.814 INFO:tasks.ceph:Archiving crash dumps... 2021-11-15T15:45:21.816 DEBUG:teuthology.misc:Transferring archived files from gibba035:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba035/crash 2021-11-15T15:45:21.817 DEBUG:teuthology.orchestra.run.gibba035:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T15:45:21.831 DEBUG:teuthology.misc:Transferring archived files from gibba019:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba019/crash 2021-11-15T15:45:21.832 DEBUG:teuthology.orchestra.run.gibba019:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T15:45:21.859 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba038/crash 2021-11-15T15:45:21.860 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T15:45:21.887 DEBUG:teuthology.misc:Transferring archived files from gibba032:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba032/crash 2021-11-15T15:45:21.888 DEBUG:teuthology.orchestra.run.gibba032:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-15T15:45:21.900 INFO:tasks.ceph:Shutting down logrotate 2021-11-15T15:45:21.901 DEBUG:teuthology.orchestra.run.gibba019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.904 DEBUG:teuthology.orchestra.run.gibba032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.907 DEBUG:teuthology.orchestra.run.gibba035:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.909 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.961 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:21.982 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:22.001 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:22.021 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-15T15:45:22.043 INFO:tasks.ceph:Compressing logs... 2021-11-15T15:45:22.043 DEBUG:teuthology.orchestra.run.gibba019:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:22.047 DEBUG:teuthology.orchestra.run.gibba032:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:22.050 DEBUG:teuthology.orchestra.run.gibba035:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:22.065 DEBUG:teuthology.orchestra.run.gibba038:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:32.746 INFO:tasks.ceph:Archiving logs... 2021-11-15T15:45:32.748 DEBUG:teuthology.misc:Transferring archived files from gibba035:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba035/log 2021-11-15T15:45:32.750 DEBUG:teuthology.orchestra.run.gibba035:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T15:45:35.536 DEBUG:teuthology.misc:Transferring archived files from gibba019:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba019/log 2021-11-15T15:45:35.538 DEBUG:teuthology.orchestra.run.gibba019:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T15:45:37.370 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba038/log 2021-11-15T15:45:37.372 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T15:45:37.667 DEBUG:teuthology.misc:Transferring archived files from gibba032:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba032/log 2021-11-15T15:45:37.669 DEBUG:teuthology.orchestra.run.gibba032:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-15T15:45:37.692 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-11-15T15:45:37.703 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-15T15:45:37.707 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-11-15T15:45:37.708 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T15:45:37.712 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T15:45:37.727 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T15:45:37.731 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-15T15:45:37.853 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-11-15T15:45:37.873 INFO:teuthology.task.clock:Checking final clock skew... 2021-11-15T15:45:37.875 DEBUG:teuthology.orchestra.run.gibba035:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T15:45:37.900 INFO:teuthology.orchestra.run.gibba035.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T15:45:37.901 INFO:teuthology.orchestra.run.gibba035.stdout:============================================================================== 2021-11-15T15:45:37.902 INFO:teuthology.orchestra.run.gibba035.stdout:-hv01.front.sepi 216.240.36.24 3 u 68 128 377 0.168 4.624 0.165 2021-11-15T15:45:37.902 INFO:teuthology.orchestra.run.gibba035.stdout:*hv02.front.sepi 163.237.218.18 2 u 1 128 377 0.095 0.378 0.134 2021-11-15T15:45:37.903 INFO:teuthology.orchestra.run.gibba035.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 128 377 0.104 -1.841 0.115 2021-11-15T15:45:37.904 INFO:teuthology.orchestra.run.gibba035.stdout:+hv04.front.sepi 144.172.126.201 3 u 2 128 377 0.151 -0.521 0.133 2021-11-15T15:45:37.905 DEBUG:teuthology.orchestra.run.gibba019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T15:45:37.929 INFO:teuthology.orchestra.run.gibba019.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T15:45:37.930 INFO:teuthology.orchestra.run.gibba019.stdout:============================================================================== 2021-11-15T15:45:37.931 INFO:teuthology.orchestra.run.gibba019.stdout:-hv01.front.sepi 216.240.36.24 3 u 107 128 377 0.206 6.969 0.143 2021-11-15T15:45:37.932 INFO:teuthology.orchestra.run.gibba019.stdout:*hv02.front.sepi 163.237.218.18 2 u 114 128 377 0.108 2.973 0.395 2021-11-15T15:45:37.932 INFO:teuthology.orchestra.run.gibba019.stdout:+hv03.front.sepi 74.6.168.72 3 u 7 128 377 0.140 0.508 0.222 2021-11-15T15:45:37.933 INFO:teuthology.orchestra.run.gibba019.stdout:+hv04.front.sepi 144.172.126.201 3 u 120 128 377 0.164 1.604 0.257 2021-11-15T15:45:37.934 DEBUG:teuthology.orchestra.run.gibba038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T15:45:37.958 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T15:45:37.959 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-11-15T15:45:37.960 INFO:teuthology.orchestra.run.gibba038.stdout:-hv01.front.sepi 216.240.36.24 3 u 121 128 377 0.105 2.951 0.229 2021-11-15T15:45:37.960 INFO:teuthology.orchestra.run.gibba038.stdout:*hv02.front.sepi 163.237.218.18 2 u 48 128 377 0.170 -1.308 0.398 2021-11-15T15:45:37.961 INFO:teuthology.orchestra.run.gibba038.stdout:+hv03.front.sepi 74.6.168.72 3 u 126 128 377 0.185 -4.163 0.438 2021-11-15T15:45:37.961 INFO:teuthology.orchestra.run.gibba038.stdout:+hv04.front.sepi 144.172.126.201 3 u 116 128 377 0.152 -2.212 0.353 2021-11-15T15:45:37.962 DEBUG:teuthology.orchestra.run.gibba032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-15T15:45:37.987 INFO:teuthology.orchestra.run.gibba032.stdout: remote refid st t when poll reach delay offset jitter 2021-11-15T15:45:37.988 INFO:teuthology.orchestra.run.gibba032.stdout:============================================================================== 2021-11-15T15:45:37.988 INFO:teuthology.orchestra.run.gibba032.stdout:-hv01.front.sepi 216.240.36.24 3 u 103 128 377 0.129 10.111 0.533 2021-11-15T15:45:37.989 INFO:teuthology.orchestra.run.gibba032.stdout:*hv02.front.sepi 163.237.218.18 2 u 126 128 377 0.157 5.780 0.602 2021-11-15T15:45:37.990 INFO:teuthology.orchestra.run.gibba032.stdout:+hv03.front.sepi 74.6.168.72 3 u 96 128 377 0.164 3.870 0.670 2021-11-15T15:45:37.990 INFO:teuthology.orchestra.run.gibba032.stdout:+hv04.front.sepi 144.172.126.201 3 u 112 128 377 0.131 5.058 0.623 2021-11-15T15:45:37.991 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-11-15T15:45:38.011 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-11-15T15:45:38.012 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-11-15T15:45:38.134 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-11-15T15:45:38.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-11-15T15:45:38.244 INFO:teuthology.task.internal:Duration was 4642.882356 seconds 2021-11-15T15:45:38.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-11-15T15:45:38.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-15T15:45:38.275 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T15:45:38.279 DEBUG:teuthology.orchestra.run.gibba032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T15:45:38.283 DEBUG:teuthology.orchestra.run.gibba035:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T15:45:38.286 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-15T15:45:38.315 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-11-15T15:45:38.316 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba035.front.sepia.ceph.com 2021-11-15T15:45:38.317 DEBUG:teuthology.orchestra.run.gibba035:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T15:45:38.358 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba019.front.sepia.ceph.com 2021-11-15T15:45:38.358 DEBUG:teuthology.orchestra.run.gibba019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T15:45:38.369 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba038.front.sepia.ceph.com 2021-11-15T15:45:38.370 DEBUG:teuthology.orchestra.run.gibba038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T15:45:38.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba032.front.sepia.ceph.com 2021-11-15T15:45:38.379 DEBUG:teuthology.orchestra.run.gibba032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-15T15:45:38.391 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-11-15T15:45:38.391 DEBUG:teuthology.orchestra.run.gibba019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:38.414 DEBUG:teuthology.orchestra.run.gibba032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:38.435 DEBUG:teuthology.orchestra.run.gibba035:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:38.439 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-15T15:45:38.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-11-15T15:45:38.481 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-11-15T15:45:38.482 DEBUG:teuthology.orchestra.run.gibba019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T15:45:38.493 DEBUG:teuthology.orchestra.run.gibba032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T15:45:38.502 DEBUG:teuthology.orchestra.run.gibba035:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T15:45:38.510 DEBUG:teuthology.orchestra.run.gibba038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-15T15:45:38.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-11-15T15:45:38.603 DEBUG:teuthology.orchestra.run.gibba019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.607 DEBUG:teuthology.orchestra.run.gibba032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.611 DEBUG:teuthology.orchestra.run.gibba035:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.614 DEBUG:teuthology.orchestra.run.gibba038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.618 INFO:teuthology.orchestra.run.gibba019.stdout:kernel.core_pattern = core 2021-11-15T15:45:38.621 INFO:teuthology.orchestra.run.gibba032.stdout:kernel.core_pattern = core 2021-11-15T15:45:38.625 INFO:teuthology.orchestra.run.gibba035.stdout:kernel.core_pattern = core 2021-11-15T15:45:38.628 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = core 2021-11-15T15:45:38.639 DEBUG:teuthology.orchestra.run.gibba035:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:45:38.687 DEBUG:teuthology.orchestra.run.gibba019:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:45:38.694 DEBUG:teuthology.orchestra.run.gibba038:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:45:38.700 DEBUG:teuthology.orchestra.run.gibba032:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-15T15:45:38.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-15T15:45:38.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-11-15T15:45:38.718 INFO:teuthology.task.internal:Transferring archived files... 2021-11-15T15:45:38.719 DEBUG:teuthology.misc:Transferring archived files from gibba035:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba035 2021-11-15T15:45:38.720 DEBUG:teuthology.orchestra.run.gibba035:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T15:45:38.753 DEBUG:teuthology.misc:Transferring archived files from gibba019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba019 2021-11-15T15:45:38.754 DEBUG:teuthology.orchestra.run.gibba019:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T15:45:38.785 DEBUG:teuthology.misc:Transferring archived files from gibba038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba038 2021-11-15T15:45:38.785 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T15:45:38.803 DEBUG:teuthology.misc:Transferring archived files from gibba032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-12_04:10:03-fs-octopus-distro-default-gibba/6498751/remote/gibba032 2021-11-15T15:45:38.804 DEBUG:teuthology.orchestra.run.gibba032:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-15T15:45:38.821 INFO:teuthology.task.internal:Removing archive directory... 2021-11-15T15:45:38.822 DEBUG:teuthology.orchestra.run.gibba019:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T15:45:38.825 DEBUG:teuthology.orchestra.run.gibba032:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T15:45:38.827 DEBUG:teuthology.orchestra.run.gibba035:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T15:45:38.830 DEBUG:teuthology.orchestra.run.gibba038:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-15T15:45:38.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-11-15T15:45:38.861 INFO:teuthology.task.internal:Not uploading archives. 2021-11-15T15:45:38.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-11-15T15:45:38.915 INFO:teuthology.task.internal:Tidying up after the test... 2021-11-15T15:45:38.915 DEBUG:teuthology.orchestra.run.gibba019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T15:45:38.919 DEBUG:teuthology.orchestra.run.gibba032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T15:45:38.922 DEBUG:teuthology.orchestra.run.gibba035:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T15:45:38.925 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-15T15:45:38.927 INFO:teuthology.orchestra.run.gibba019.stdout: 655396 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 15:45 /home/ubuntu/cephtest 2021-11-15T15:45:38.930 INFO:teuthology.orchestra.run.gibba032.stdout: 655402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 15:45 /home/ubuntu/cephtest 2021-11-15T15:45:38.932 INFO:teuthology.orchestra.run.gibba035.stdout: 655402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 15:45 /home/ubuntu/cephtest 2021-11-16T02:13:33.201 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-11-16T02:13:33.229 DEBUG:teuthology.task.console_log:Killing console logger for gibba035 2021-11-16T02:13:33.231 DEBUG:teuthology.task.console_log:Killing console logger for gibba019 2021-11-16T02:13:33.231 DEBUG:teuthology.task.console_log:Killing console logger for gibba038 2021-11-16T02:13:33.232 DEBUG:teuthology.task.console_log:Killing console logger for gibba032 2021-11-16T02:13:33.233 DEBUG:teuthology.task.console_log:Killing console logger for gibba035 2021-11-16T02:13:33.234 DEBUG:teuthology.task.console_log:Killing console logger for gibba019 2021-11-16T02:13:33.235 DEBUG:teuthology.task.console_log:Killing console logger for gibba038 2021-11-16T02:13:33.235 DEBUG:teuthology.task.console_log:Killing console logger for gibba032 2021-11-16T02:13:33.236 DEBUG:teuthology.exit:Finished running handlers